2024-08-25T23:44:30.313 INFO:root:teuthology version: 1.2.1.dev2+g4d4c5e3 2024-08-25T23:44:30.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-25T23:44:30.433 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-08-25_21:24:02-fs-squid-distro-default-smithi/7872309 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/blogbench}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7872309' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-08-25_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: f273685f88d22802ccbd8a96b393734630028a13 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.dir_split install: ceph: flavor: default sha1: f273685f88d22802ccbd8a96b393734630028a13 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - nowsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: f273685f88d22802ccbd8a96b393734630028a13 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 4460 sha1: f273685f88d22802ccbd8a96b393734630028a13 sleep_before_teardown: 0 subset: 79/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_f273685f88d22802ccbd8a96b393734630028a13/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: f273685f88d22802ccbd8a96b393734630028a13 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi042.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBATR0zxebUKeYlAmxvXlwZRlsHtkhPOF7TmjzzLDQCJjK1H+5MuL8aixQupwhOlv2RZ1h0cWKwo2fNwnVs5O1H4= smithi043.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGLG2DZQd1DqksidSgF4w1ftM7djbrP8BOp+uDzOEvjHhB91HmbNFTJtn4R07ZB2/2lM0zlT/Sko7cTJ5fxkRjw= smithi181.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM54wNigwWJvaRpepI3SOvtIIRV7uU1AWz5yEPNi5AoYybGzQmoreja5x6JI69bSGA22Oubn0iZlZ/BT375payM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 4d4c5e30374204f3b32f867e61bb4e1a3880f672 timestamp: 2024-08-25_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-25T23:44:30.434 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_f273685f88d22802ccbd8a96b393734630028a13/qa; will attempt to use it 2024-08-25T23:44:30.434 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_f273685f88d22802ccbd8a96b393734630028a13/qa/tasks 2024-08-25T23:44:30.435 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-25T23:44:30.436 INFO:teuthology.task.internal:Checking packages... 2024-08-25T23:44:30.458 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f273685f88d22802ccbd8a96b393734630028a13' 2024-08-25T23:44:30.458 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-25T23:44:30.458 INFO:teuthology.packaging:ref: None 2024-08-25T23:44:30.458 INFO:teuthology.packaging:tag: None 2024-08-25T23:44:30.458 INFO:teuthology.packaging:branch: squid 2024-08-25T23:44:30.458 INFO:teuthology.packaging:sha1: f273685f88d22802ccbd8a96b393734630028a13 2024-08-25T23:44:30.459 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-08-25T23:44:30.654 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-207.gf273685f 2024-08-25T23:44:30.656 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-25T23:44:30.662 INFO:teuthology.task.internal:no buildpackages task found 2024-08-25T23:44:30.662 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-25T23:44:30.682 INFO:teuthology.task.internal:Saving configuration 2024-08-25T23:44:30.702 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-25T23:44:30.709 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-25T23:44:30.733 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-25_21:24:02-fs-squid-distro-default-smithi/7872309', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-25 23:39:37.351320', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBATR0zxebUKeYlAmxvXlwZRlsHtkhPOF7TmjzzLDQCJjK1H+5MuL8aixQupwhOlv2RZ1h0cWKwo2fNwnVs5O1H4='} 2024-08-25T23:44:30.755 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-25_21:24:02-fs-squid-distro-default-smithi/7872309', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-25 23:39:37.353195', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGLG2DZQd1DqksidSgF4w1ftM7djbrP8BOp+uDzOEvjHhB91HmbNFTJtn4R07ZB2/2lM0zlT/Sko7cTJ5fxkRjw='} 2024-08-25T23:44:30.780 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-25_21:24:02-fs-squid-distro-default-smithi/7872309', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-25 23:39:37.354804', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM54wNigwWJvaRpepI3SOvtIIRV7uU1AWz5yEPNi5AoYybGzQmoreja5x6JI69bSGA22Oubn0iZlZ/BT375payM='} 2024-08-25T23:44:30.781 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-25T23:44:30.787 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-08-25T23:44:30.787 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-08-25T23:44:30.787 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-08-25T23:44:30.787 INFO:teuthology.run_tasks:Running task console_log... 2024-08-25T23:44:30.870 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f45baef4dc0>, signals=[15]) 2024-08-25T23:44:30.871 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-25T23:44:30.876 INFO:teuthology.task.internal:Opening connections... 2024-08-25T23:44:30.877 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi042.front.sepia.ceph.com 2024-08-25T23:44:30.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-25T23:44:30.956 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi043.front.sepia.ceph.com 2024-08-25T23:44:30.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-25T23:44:31.032 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi181.front.sepia.ceph.com 2024-08-25T23:44:31.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-25T23:44:31.109 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-25T23:44:31.116 DEBUG:teuthology.orchestra.run.smithi042:> uname -m 2024-08-25T23:44:31.134 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2024-08-25T23:44:31.134 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2024-08-25T23:44:31.192 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream" 2024-08-25T23:44:31.192 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9" 2024-08-25T23:44:31.192 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2024-08-25T23:44:31.192 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2024-08-25T23:44:31.192 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9" 2024-08-25T23:44:31.192 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9" 2024-08-25T23:44:31.193 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-25T23:44:31.193 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2024-08-25T23:44:31.193 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon" 2024-08-25T23:44:31.193 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-25T23:44:31.193 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/" 2024-08-25T23:44:31.193 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-25T23:44:31.193 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-25T23:44:31.193 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-25T23:44:31.194 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2024-08-25T23:44:31.210 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2024-08-25T23:44:31.228 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2024-08-25T23:44:31.229 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2024-08-25T23:44:31.285 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2024-08-25T23:44:31.286 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9" 2024-08-25T23:44:31.286 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2024-08-25T23:44:31.286 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2024-08-25T23:44:31.286 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9" 2024-08-25T23:44:31.286 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9" 2024-08-25T23:44:31.286 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-25T23:44:31.286 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2024-08-25T23:44:31.286 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon" 2024-08-25T23:44:31.286 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-25T23:44:31.286 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2024-08-25T23:44:31.286 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-25T23:44:31.286 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-25T23:44:31.286 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-25T23:44:31.287 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2024-08-25T23:44:31.302 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-08-25T23:44:31.320 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-08-25T23:44:31.320 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-08-25T23:44:31.377 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-08-25T23:44:31.377 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2024-08-25T23:44:31.377 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-08-25T23:44:31.377 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-08-25T23:44:31.378 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2024-08-25T23:44:31.378 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2024-08-25T23:44:31.378 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-25T23:44:31.378 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-08-25T23:44:31.378 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2024-08-25T23:44:31.378 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-25T23:44:31.378 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-08-25T23:44:31.378 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-25T23:44:31.378 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-25T23:44:31.378 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-25T23:44:31.379 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-08-25T23:44:31.394 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-25T23:44:31.404 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-25T23:44:31.409 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-25T23:44:31.409 DEBUG:teuthology.orchestra.run.smithi042:> test '!' -e /home/ubuntu/cephtest 2024-08-25T23:44:31.411 DEBUG:teuthology.orchestra.run.smithi043:> test '!' -e /home/ubuntu/cephtest 2024-08-25T23:44:31.413 DEBUG:teuthology.orchestra.run.smithi181:> test '!' -e /home/ubuntu/cephtest 2024-08-25T23:44:31.433 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-25T23:44:31.438 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-25T23:44:31.439 DEBUG:teuthology.orchestra.run.smithi042:> test -z $(ls -A /var/lib/ceph) 2024-08-25T23:44:31.468 DEBUG:teuthology.orchestra.run.smithi043:> test -z $(ls -A /var/lib/ceph) 2024-08-25T23:44:31.471 DEBUG:teuthology.orchestra.run.smithi181:> test -z $(ls -A /var/lib/ceph) 2024-08-25T23:44:31.509 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-25T23:44:31.582 INFO:teuthology.run_tasks:Running task kernel... 2024-08-25T23:44:31.596 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-25T23:44:31.597 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-08-25T23:44:31.597 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-08-25T23:44:31.597 DEBUG:teuthology.orchestra.run.smithi042:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-25T23:44:31.614 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-25T23:44:31.615 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-25T23:44:31.770 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8618c856c9a644ad80ca70c748bebe0c9b6227d4 2024-08-25T23:44:31.771 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8618c856c9a644ad80ca70c748bebe0c9b6227d4"... 2024-08-25T23:44:31.771 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-08-25T23:44:31.789 INFO:teuthology.orchestra.run.smithi042.stdout:5.14.0-496.el9.x86_64 2024-08-25T23:44:31.789 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-496.el9.x86_64 vs 8618c856c9a644ad80ca70c748bebe0c9b6227d4 2024-08-25T23:44:31.790 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-25T23:44:31.790 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum upgrade -y linux-firmware 2024-08-25T23:44:35.517 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.2 MB 00:01 2024-08-25T23:44:37.493 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-08-25T23:44:42.843 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.6 MB 00:01 2024-08-25T23:44:44.427 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 18 kB 00:00 2024-08-25T23:44:45.165 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 36 MB/s | 22 MB 00:00 2024-08-25T23:44:50.696 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-08-25T23:44:52.730 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-08-25T23:44:52.731 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-08-25T23:44:52.731 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-08-25T23:44:52.827 INFO:teuthology.task.kernel:Downloading kernel 8618c856c9a644ad80ca70c748bebe0c9b6227d4 on client.0... 2024-08-25T23:44:52.827 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8618c856c9a644ad80ca70c748bebe0c9b6227d4 2024-08-25T23:44:52.980 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/8618c856c9a644ad80ca70c748bebe0c9b6227d4/centos/9/flavors/default/x86_64/ 2024-08-25T23:44:52.981 DEBUG:teuthology.orchestra.run.smithi042:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g8618c856c9a6-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/8618c856c9a644ad80ca70c748bebe0c9b6227d4/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-25T23:44:52.983 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi042.front.sepia.ceph.com to complete... 2024-08-25T23:44:59.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25 23:44:59 URL:https://2.chacra.ceph.com/r/kernel/testing/8618c856c9a644ad80ca70c748bebe0c9b6227d4/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g8618c856c9a6-1.x86_64.rpm [360008351/360008351] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-25T23:44:59.295 INFO:teuthology.orchestra.run.smithi042.stderr:FINISHED --2024-08-25 23:44:59-- 2024-08-25T23:44:59.295 INFO:teuthology.orchestra.run.smithi042.stderr:Total wall clock time: 6.3s 2024-08-25T23:44:59.296 INFO:teuthology.orchestra.run.smithi042.stderr:Downloaded: 1 files, 343M in 6.0s (57.1 MB/s) 2024-08-25T23:44:59.298 INFO:teuthology.task.kernel:Installing kernel 8618c856c9a644ad80ca70c748bebe0c9b6227d4 on client.0... 2024-08-25T23:44:59.298 DEBUG:teuthology.orchestra.run.smithi042:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-25T23:45:01.536 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying... ######################################## 2024-08-25T23:45:01.693 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing... ######################################## 2024-08-25T23:45:01.797 INFO:teuthology.orchestra.run.smithi042.stdout:Updating / installing... 2024-08-25T23:45:10.110 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-6.11.0_rc3_g8618c856c9a6-1 ######################################## 2024-08-25T23:45:50.596 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi042.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-25T23:45:50.596 DEBUG:teuthology.orchestra.run.smithi042:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-25T23:45:50.677 INFO:teuthology.orchestra.run.smithi042.stdout:/boot/System.map-6.11.0-rc3-g8618c856c9a6 2024-08-25T23:45:50.678 INFO:teuthology.orchestra.run.smithi042.stdout:/boot/config-6.11.0-rc3-g8618c856c9a6 2024-08-25T23:45:50.678 INFO:teuthology.orchestra.run.smithi042.stdout:/boot/vmlinuz-6.11.0-rc3-g8618c856c9a6 2024-08-25T23:45:50.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6 2024-08-25T23:45:50.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/System.map 2024-08-25T23:45:50.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/config 2024-08-25T23:45:50.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel 2024-08-25T23:45:50.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch 2024-08-25T23:45:50.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86 2024-08-25T23:45:50.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/crypto 2024-08-25T23:45:50.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-25T23:45:50.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-25T23:45:50.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-25T23:45:50.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-25T23:45:50.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-25T23:45:50.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-25T23:45:50.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-25T23:45:50.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-25T23:45:50.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-25T23:45:50.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-25T23:45:50.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-25T23:45:50.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-25T23:45:50.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-25T23:45:50.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-25T23:45:50.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-25T23:45:50.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-25T23:45:50.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-25T23:45:50.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-25T23:45:50.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-25T23:45:50.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-25T23:45:50.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/kernel 2024-08-25T23:45:50.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/kernel/cpu 2024-08-25T23:45:50.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/kernel/cpu/mce 2024-08-25T23:45:50.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-25T23:45:50.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/kvm 2024-08-25T23:45:50.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-25T23:45:50.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-25T23:45:50.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/arch/x86/kvm/kvm.ko 2024-08-25T23:45:50.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto 2024-08-25T23:45:50.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/ansi_cprng.ko 2024-08-25T23:45:50.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/anubis.ko 2024-08-25T23:45:50.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/arc4.ko 2024-08-25T23:45:50.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/async_tx 2024-08-25T23:45:50.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/async_tx/async_memcpy.ko 2024-08-25T23:45:50.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/async_tx/async_pq.ko 2024-08-25T23:45:50.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-25T23:45:50.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/async_tx/async_tx.ko 2024-08-25T23:45:50.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/async_tx/async_xor.ko 2024-08-25T23:45:50.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/async_tx/raid6test.ko 2024-08-25T23:45:50.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/authenc.ko 2024-08-25T23:45:50.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/authencesn.ko 2024-08-25T23:45:50.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/blake2b_generic.ko 2024-08-25T23:45:50.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/blowfish_common.ko 2024-08-25T23:45:50.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/blowfish_generic.ko 2024-08-25T23:45:50.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/camellia_generic.ko 2024-08-25T23:45:50.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/cast5_generic.ko 2024-08-25T23:45:50.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/cast6_generic.ko 2024-08-25T23:45:50.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/cast_common.ko 2024-08-25T23:45:50.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/ccm.ko 2024-08-25T23:45:50.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/cmac.ko 2024-08-25T23:45:50.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/crc32_generic.ko 2024-08-25T23:45:50.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/crypto_engine.ko 2024-08-25T23:45:50.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/crypto_user.ko 2024-08-25T23:45:50.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/cts.ko 2024-08-25T23:45:50.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/des_generic.ko 2024-08-25T23:45:50.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/dh_generic.ko 2024-08-25T23:45:50.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/ecc.ko 2024-08-25T23:45:50.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/ecdh_generic.ko 2024-08-25T23:45:50.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/echainiv.ko 2024-08-25T23:45:50.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/essiv.ko 2024-08-25T23:45:50.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/fcrypt.ko 2024-08-25T23:45:50.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/khazad.ko 2024-08-25T23:45:50.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/lz4.ko 2024-08-25T23:45:50.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/lz4hc.ko 2024-08-25T23:45:50.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/md4.ko 2024-08-25T23:45:50.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/michael_mic.ko 2024-08-25T23:45:50.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/pcbc.ko 2024-08-25T23:45:50.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/pcrypt.ko 2024-08-25T23:45:50.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/rmd160.ko 2024-08-25T23:45:50.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/seed.ko 2024-08-25T23:45:50.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/serpent_generic.ko 2024-08-25T23:45:50.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/tcrypt.ko 2024-08-25T23:45:50.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/tea.ko 2024-08-25T23:45:50.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/twofish_common.ko 2024-08-25T23:45:50.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/twofish_generic.ko 2024-08-25T23:45:50.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/vmac.ko 2024-08-25T23:45:50.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/wp512.ko 2024-08-25T23:45:50.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/xcbc.ko 2024-08-25T23:45:50.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/xor.ko 2024-08-25T23:45:50.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/crypto/xxhash_generic.ko 2024-08-25T23:45:50.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers 2024-08-25T23:45:50.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/acpi 2024-08-25T23:45:50.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-25T23:45:50.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/acpi/acpi_pad.ko 2024-08-25T23:45:50.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/acpi/ec_sys.ko 2024-08-25T23:45:50.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/acpi/platform_profile.ko 2024-08-25T23:45:50.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/acpi/sbs.ko 2024-08-25T23:45:50.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/acpi/sbshc.ko 2024-08-25T23:45:50.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/acpi/video.ko 2024-08-25T23:45:50.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata 2024-08-25T23:45:50.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/acard-ahci.ko 2024-08-25T23:45:50.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/ahci_platform.ko 2024-08-25T23:45:50.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/ata_generic.ko 2024-08-25T23:45:50.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/libahci_platform.ko 2024-08-25T23:45:50.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_acpi.ko 2024-08-25T23:45:50.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_ali.ko 2024-08-25T23:45:50.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_amd.ko 2024-08-25T23:45:50.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_artop.ko 2024-08-25T23:45:50.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_atiixp.ko 2024-08-25T23:45:50.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_atp867x.ko 2024-08-25T23:45:50.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_cmd640.ko 2024-08-25T23:45:50.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_cmd64x.ko 2024-08-25T23:45:50.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_cypress.ko 2024-08-25T23:45:50.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_efar.ko 2024-08-25T23:45:50.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_hpt366.ko 2024-08-25T23:45:50.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_hpt37x.ko 2024-08-25T23:45:50.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-25T23:45:50.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-25T23:45:50.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_it8213.ko 2024-08-25T23:45:50.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_it821x.ko 2024-08-25T23:45:50.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_jmicron.ko 2024-08-25T23:45:50.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_marvell.ko 2024-08-25T23:45:50.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_mpiix.ko 2024-08-25T23:45:50.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_netcell.ko 2024-08-25T23:45:50.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_ninja32.ko 2024-08-25T23:45:50.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_ns87410.ko 2024-08-25T23:45:50.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_ns87415.ko 2024-08-25T23:45:50.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_oldpiix.ko 2024-08-25T23:45:50.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_opti.ko 2024-08-25T23:45:50.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_optidma.ko 2024-08-25T23:45:50.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_pcmcia.ko 2024-08-25T23:45:50.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-25T23:45:50.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-25T23:45:50.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_piccolo.ko 2024-08-25T23:45:50.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_rdc.ko 2024-08-25T23:45:50.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_sch.ko 2024-08-25T23:45:50.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_serverworks.ko 2024-08-25T23:45:50.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_sil680.ko 2024-08-25T23:45:50.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_sis.ko 2024-08-25T23:45:50.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_sl82c105.ko 2024-08-25T23:45:50.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_triflex.ko 2024-08-25T23:45:50.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pata_via.ko 2024-08-25T23:45:50.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/pdc_adma.ko 2024-08-25T23:45:50.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/sata_inic162x.ko 2024-08-25T23:45:50.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/sata_mv.ko 2024-08-25T23:45:50.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/sata_nv.ko 2024-08-25T23:45:50.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/sata_promise.ko 2024-08-25T23:45:50.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/sata_qstor.ko 2024-08-25T23:45:50.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/sata_sil.ko 2024-08-25T23:45:50.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/sata_sil24.ko 2024-08-25T23:45:50.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/sata_sis.ko 2024-08-25T23:45:50.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/sata_svw.ko 2024-08-25T23:45:50.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/sata_sx4.ko 2024-08-25T23:45:50.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/sata_uli.ko 2024-08-25T23:45:50.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/sata_via.ko 2024-08-25T23:45:50.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ata/sata_vsc.ko 2024-08-25T23:45:50.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/auxdisplay 2024-08-25T23:45:50.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/auxdisplay/ks0108.ko 2024-08-25T23:45:50.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/base 2024-08-25T23:45:50.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/base/regmap 2024-08-25T23:45:50.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-25T23:45:50.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-25T23:45:50.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/bcma 2024-08-25T23:45:50.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/bcma/bcma.ko 2024-08-25T23:45:50.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/block 2024-08-25T23:45:50.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/block/aoe 2024-08-25T23:45:50.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/block/aoe/aoe.ko 2024-08-25T23:45:50.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/block/brd.ko 2024-08-25T23:45:50.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/block/drbd 2024-08-25T23:45:50.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/block/drbd/drbd.ko 2024-08-25T23:45:50.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/block/floppy.ko 2024-08-25T23:45:50.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/block/loop.ko 2024-08-25T23:45:50.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/block/mtip32xx 2024-08-25T23:45:50.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-25T23:45:50.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/block/nbd.ko 2024-08-25T23:45:50.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/block/null_blk 2024-08-25T23:45:50.691 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/block/null_blk/null_blk.ko 2024-08-25T23:45:50.691 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/block/pktcdvd.ko 2024-08-25T23:45:50.691 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/block/rbd.ko 2024-08-25T23:45:50.691 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/block/virtio_blk.ko 2024-08-25T23:45:50.691 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/block/xen-blkback 2024-08-25T23:45:50.691 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-25T23:45:50.691 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/block/xen-blkfront.ko 2024-08-25T23:45:50.691 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/block/zram 2024-08-25T23:45:50.691 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/block/zram/zram.ko 2024-08-25T23:45:50.691 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char 2024-08-25T23:45:50.691 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/hangcheck-timer.ko 2024-08-25T23:45:50.691 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/hw_random 2024-08-25T23:45:50.691 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-25T23:45:50.691 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-25T23:45:50.692 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-25T23:45:50.692 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/hw_random/via-rng.ko 2024-08-25T23:45:50.692 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-25T23:45:50.692 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/ipmi 2024-08-25T23:45:50.692 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-25T23:45:50.692 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-25T23:45:50.692 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-25T23:45:50.692 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-25T23:45:50.692 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-25T23:45:50.692 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-25T23:45:50.692 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/lp.ko 2024-08-25T23:45:50.692 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/mwave 2024-08-25T23:45:50.692 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/mwave/mwave.ko 2024-08-25T23:45:50.692 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/ppdev.ko 2024-08-25T23:45:50.693 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/tlclk.ko 2024-08-25T23:45:50.693 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/tpm 2024-08-25T23:45:50.693 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/tpm/tpm.ko 2024-08-25T23:45:50.693 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-25T23:45:50.693 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-25T23:45:50.693 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-25T23:45:50.693 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-25T23:45:50.693 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-25T23:45:50.693 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/uv_mmtimer.ko 2024-08-25T23:45:50.693 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/char/virtio_console.ko 2024-08-25T23:45:50.693 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/cpufreq 2024-08-25T23:45:50.693 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-25T23:45:50.693 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-25T23:45:50.693 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-25T23:45:50.694 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-25T23:45:50.694 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-25T23:45:50.694 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-25T23:45:50.694 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/crypto 2024-08-25T23:45:50.694 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/crypto/ccp 2024-08-25T23:45:50.694 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-25T23:45:50.694 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/crypto/ccp/ccp.ko 2024-08-25T23:45:50.694 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/crypto/intel 2024-08-25T23:45:50.694 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/crypto/intel/qat 2024-08-25T23:45:50.694 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/crypto/intel/qat/qat_common 2024-08-25T23:45:50.694 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-25T23:45:50.694 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-25T23:45:50.694 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-25T23:45:50.694 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/crypto/padlock-aes.ko 2024-08-25T23:45:50.695 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/crypto/padlock-sha.ko 2024-08-25T23:45:50.695 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/crypto/virtio 2024-08-25T23:45:50.695 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-25T23:45:50.695 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/dca 2024-08-25T23:45:50.695 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/dca/dca.ko 2024-08-25T23:45:50.695 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/devfreq 2024-08-25T23:45:50.695 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-25T23:45:50.695 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/dma 2024-08-25T23:45:50.695 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/dma/dw 2024-08-25T23:45:50.695 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-25T23:45:50.695 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/dma/ioat 2024-08-25T23:45:50.695 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-25T23:45:50.695 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/edac 2024-08-25T23:45:50.696 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/edac/amd64_edac.ko 2024-08-25T23:45:50.696 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/edac/e752x_edac.ko 2024-08-25T23:45:50.696 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/edac/edac_mce_amd.ko 2024-08-25T23:45:50.696 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/edac/i3000_edac.ko 2024-08-25T23:45:50.696 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/edac/i3200_edac.ko 2024-08-25T23:45:50.696 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/edac/i5100_edac.ko 2024-08-25T23:45:50.696 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/edac/i5400_edac.ko 2024-08-25T23:45:50.696 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/edac/i7300_edac.ko 2024-08-25T23:45:50.696 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/edac/i7core_edac.ko 2024-08-25T23:45:50.696 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/edac/i82975x_edac.ko 2024-08-25T23:45:50.696 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/edac/ie31200_edac.ko 2024-08-25T23:45:50.696 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/edac/sb_edac.ko 2024-08-25T23:45:50.696 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/edac/x38_edac.ko 2024-08-25T23:45:50.696 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/firmware 2024-08-25T23:45:50.697 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/firmware/edd.ko 2024-08-25T23:45:50.697 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-25T23:45:50.697 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/gpio 2024-08-25T23:45:50.697 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/gpio/gpio-ich.ko 2024-08-25T23:45:50.697 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-25T23:45:50.697 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid 2024-08-25T23:45:50.697 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-appleir.ko 2024-08-25T23:45:50.697 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-aureal.ko 2024-08-25T23:45:50.697 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-axff.ko 2024-08-25T23:45:50.697 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-dr.ko 2024-08-25T23:45:50.697 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-elecom.ko 2024-08-25T23:45:50.697 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-elo.ko 2024-08-25T23:45:50.697 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-emsff.ko 2024-08-25T23:45:50.697 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-gaff.ko 2024-08-25T23:45:50.698 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-gt683r.ko 2024-08-25T23:45:50.698 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-gyration.ko 2024-08-25T23:45:50.698 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-25T23:45:50.698 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-25T23:45:50.698 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-holtekff.ko 2024-08-25T23:45:50.698 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-hyperv.ko 2024-08-25T23:45:50.698 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-icade.ko 2024-08-25T23:45:50.698 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-keytouch.ko 2024-08-25T23:45:50.698 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-kye.ko 2024-08-25T23:45:50.698 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-lcpower.ko 2024-08-25T23:45:50.698 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-led.ko 2024-08-25T23:45:50.698 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-lenovo.ko 2024-08-25T23:45:50.698 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-25T23:45:50.699 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-25T23:45:50.699 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-multitouch.ko 2024-08-25T23:45:50.699 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-ortek.ko 2024-08-25T23:45:50.699 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-penmount.ko 2024-08-25T23:45:50.699 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-petalynx.ko 2024-08-25T23:45:50.699 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-picolcd.ko 2024-08-25T23:45:50.699 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-pl.ko 2024-08-25T23:45:50.699 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-plantronics.ko 2024-08-25T23:45:50.699 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-primax.ko 2024-08-25T23:45:50.699 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-rmi.ko 2024-08-25T23:45:50.699 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-25T23:45:50.699 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-roccat-common.ko 2024-08-25T23:45:50.699 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-25T23:45:50.699 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-25T23:45:50.700 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-25T23:45:50.700 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-25T23:45:50.700 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-25T23:45:50.700 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-25T23:45:50.700 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-25T23:45:50.700 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-25T23:45:50.700 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-25T23:45:50.700 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-roccat.ko 2024-08-25T23:45:50.700 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-saitek.ko 2024-08-25T23:45:50.700 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-samsung.ko 2024-08-25T23:45:50.700 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-25T23:45:50.700 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-sjoy.ko 2024-08-25T23:45:50.700 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-sony.ko 2024-08-25T23:45:50.700 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-speedlink.ko 2024-08-25T23:45:50.701 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-steelseries.ko 2024-08-25T23:45:50.701 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-sunplus.ko 2024-08-25T23:45:50.701 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-25T23:45:50.701 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-tivo.ko 2024-08-25T23:45:50.701 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-tmff.ko 2024-08-25T23:45:50.701 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-topseed.ko 2024-08-25T23:45:50.701 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-twinhan.ko 2024-08-25T23:45:50.701 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-uclogic.ko 2024-08-25T23:45:50.701 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-waltop.ko 2024-08-25T23:45:50.701 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-wiimote.ko 2024-08-25T23:45:50.701 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-xinmo.ko 2024-08-25T23:45:50.701 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-zpff.ko 2024-08-25T23:45:50.701 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/hid-zydacron.ko 2024-08-25T23:45:50.701 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/uhid.ko 2024-08-25T23:45:50.702 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hid/wacom.ko 2024-08-25T23:45:50.702 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hv 2024-08-25T23:45:50.702 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hv/hv_balloon.ko 2024-08-25T23:45:50.702 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hv/hv_utils.ko 2024-08-25T23:45:50.702 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hv/hv_vmbus.ko 2024-08-25T23:45:50.702 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon 2024-08-25T23:45:50.702 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/abituguru.ko 2024-08-25T23:45:50.702 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/abituguru3.ko 2024-08-25T23:45:50.702 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-25T23:45:50.702 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/ad7414.ko 2024-08-25T23:45:50.702 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/ad7418.ko 2024-08-25T23:45:50.702 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/adc128d818.ko 2024-08-25T23:45:50.702 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/adm1025.ko 2024-08-25T23:45:50.703 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/adm1026.ko 2024-08-25T23:45:50.703 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/adm1029.ko 2024-08-25T23:45:50.703 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/adm1031.ko 2024-08-25T23:45:50.703 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/adm9240.ko 2024-08-25T23:45:50.703 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/ads7828.ko 2024-08-25T23:45:50.703 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/adt7410.ko 2024-08-25T23:45:50.703 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/adt7411.ko 2024-08-25T23:45:50.703 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/adt7462.ko 2024-08-25T23:45:50.703 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/adt7470.ko 2024-08-25T23:45:50.703 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/adt7475.ko 2024-08-25T23:45:50.703 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/adt7x10.ko 2024-08-25T23:45:50.703 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/amc6821.ko 2024-08-25T23:45:50.703 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/applesmc.ko 2024-08-25T23:45:50.703 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/asb100.ko 2024-08-25T23:45:50.704 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/asc7621.ko 2024-08-25T23:45:50.704 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-25T23:45:50.704 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/atxp1.ko 2024-08-25T23:45:50.704 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/coretemp.ko 2024-08-25T23:45:50.704 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-25T23:45:50.704 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/dme1737.ko 2024-08-25T23:45:50.704 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/ds1621.ko 2024-08-25T23:45:50.704 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/ds620.ko 2024-08-25T23:45:50.704 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/emc1403.ko 2024-08-25T23:45:50.704 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/emc6w201.ko 2024-08-25T23:45:50.704 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/f71805f.ko 2024-08-25T23:45:50.704 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/f71882fg.ko 2024-08-25T23:45:50.704 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/f75375s.ko 2024-08-25T23:45:50.705 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/fam15h_power.ko 2024-08-25T23:45:50.705 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/fschmd.ko 2024-08-25T23:45:50.705 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/g760a.ko 2024-08-25T23:45:50.705 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/g762.ko 2024-08-25T23:45:50.705 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/gl518sm.ko 2024-08-25T23:45:50.705 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/gl520sm.ko 2024-08-25T23:45:50.705 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-25T23:45:50.705 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/i5500_temp.ko 2024-08-25T23:45:50.705 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/i5k_amb.ko 2024-08-25T23:45:50.705 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/ibmaem.ko 2024-08-25T23:45:50.705 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/ibmpex.ko 2024-08-25T23:45:50.705 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/ina209.ko 2024-08-25T23:45:50.705 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/ina2xx.ko 2024-08-25T23:45:50.706 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/it87.ko 2024-08-25T23:45:50.706 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/k10temp.ko 2024-08-25T23:45:50.706 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/k8temp.ko 2024-08-25T23:45:50.706 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/lineage-pem.ko 2024-08-25T23:45:50.706 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/lm63.ko 2024-08-25T23:45:50.706 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/lm73.ko 2024-08-25T23:45:50.706 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/lm75.ko 2024-08-25T23:45:50.706 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/lm77.ko 2024-08-25T23:45:50.706 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/lm78.ko 2024-08-25T23:45:50.706 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/lm80.ko 2024-08-25T23:45:50.706 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/lm83.ko 2024-08-25T23:45:50.706 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/lm85.ko 2024-08-25T23:45:50.706 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/lm87.ko 2024-08-25T23:45:50.707 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/lm90.ko 2024-08-25T23:45:50.707 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/lm92.ko 2024-08-25T23:45:50.707 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/lm93.ko 2024-08-25T23:45:50.707 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/lm95234.ko 2024-08-25T23:45:50.707 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/lm95241.ko 2024-08-25T23:45:50.707 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/lm95245.ko 2024-08-25T23:45:50.707 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/ltc2945.ko 2024-08-25T23:45:50.707 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/ltc4151.ko 2024-08-25T23:45:50.707 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/ltc4215.ko 2024-08-25T23:45:50.707 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/ltc4222.ko 2024-08-25T23:45:50.707 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/ltc4245.ko 2024-08-25T23:45:50.707 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/ltc4260.ko 2024-08-25T23:45:50.707 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/ltc4261.ko 2024-08-25T23:45:50.708 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/max16065.ko 2024-08-25T23:45:50.708 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/max1619.ko 2024-08-25T23:45:50.708 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/max1668.ko 2024-08-25T23:45:50.708 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/max197.ko 2024-08-25T23:45:50.708 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/max6639.ko 2024-08-25T23:45:50.708 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/max6650.ko 2024-08-25T23:45:50.708 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/max6697.ko 2024-08-25T23:45:50.708 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/mcp3021.ko 2024-08-25T23:45:50.708 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/nct6683.ko 2024-08-25T23:45:50.708 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/nct6775-core.ko 2024-08-25T23:45:50.708 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/nct6775.ko 2024-08-25T23:45:50.708 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/nct7802.ko 2024-08-25T23:45:50.708 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/pc87360.ko 2024-08-25T23:45:50.708 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/pc87427.ko 2024-08-25T23:45:50.709 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/pcf8591.ko 2024-08-25T23:45:50.709 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/pmbus 2024-08-25T23:45:50.709 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-25T23:45:50.709 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-25T23:45:50.709 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-25T23:45:50.709 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-25T23:45:50.709 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-25T23:45:50.709 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-25T23:45:50.709 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-25T23:45:50.709 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-25T23:45:50.709 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-25T23:45:50.709 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-25T23:45:50.709 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-25T23:45:50.710 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-25T23:45:50.710 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/powr1220.ko 2024-08-25T23:45:50.710 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/sch5627.ko 2024-08-25T23:45:50.710 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/sch5636.ko 2024-08-25T23:45:50.710 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-25T23:45:50.710 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/sht15.ko 2024-08-25T23:45:50.710 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/sht21.ko 2024-08-25T23:45:50.710 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/shtc1.ko 2024-08-25T23:45:50.710 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/sis5595.ko 2024-08-25T23:45:50.710 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/smsc47b397.ko 2024-08-25T23:45:50.710 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/smsc47m1.ko 2024-08-25T23:45:50.710 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/smsc47m192.ko 2024-08-25T23:45:50.710 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/thmc50.ko 2024-08-25T23:45:50.710 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/tmp102.ko 2024-08-25T23:45:50.711 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/tmp103.ko 2024-08-25T23:45:50.711 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/tmp401.ko 2024-08-25T23:45:50.711 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/tmp421.ko 2024-08-25T23:45:50.711 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/via-cputemp.ko 2024-08-25T23:45:50.711 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/via686a.ko 2024-08-25T23:45:50.711 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/vt1211.ko 2024-08-25T23:45:50.711 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/vt8231.ko 2024-08-25T23:45:50.711 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/w83627ehf.ko 2024-08-25T23:45:50.711 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/w83627hf.ko 2024-08-25T23:45:50.711 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/w83781d.ko 2024-08-25T23:45:50.711 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/w83791d.ko 2024-08-25T23:45:50.711 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/w83792d.ko 2024-08-25T23:45:50.711 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/w83793.ko 2024-08-25T23:45:50.711 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/w83795.ko 2024-08-25T23:45:50.712 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/w83l785ts.ko 2024-08-25T23:45:50.712 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/hwmon/w83l786ng.ko 2024-08-25T23:45:50.712 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c 2024-08-25T23:45:50.712 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/algos 2024-08-25T23:45:50.712 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-25T23:45:50.712 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-25T23:45:50.712 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses 2024-08-25T23:45:50.712 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-25T23:45:50.712 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-25T23:45:50.712 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-25T23:45:50.712 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-25T23:45:50.712 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-25T23:45:50.712 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-25T23:45:50.713 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-25T23:45:50.713 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-25T23:45:50.713 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-25T23:45:50.713 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-25T23:45:50.713 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-25T23:45:50.713 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-25T23:45:50.713 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-25T23:45:50.713 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-25T23:45:50.713 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-25T23:45:50.713 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-25T23:45:50.713 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-25T23:45:50.713 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-25T23:45:50.713 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-25T23:45:50.713 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-25T23:45:50.714 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-25T23:45:50.714 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-25T23:45:50.714 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-25T23:45:50.714 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/i2c-dev.ko 2024-08-25T23:45:50.714 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/i2c-mux.ko 2024-08-25T23:45:50.714 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-25T23:45:50.714 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/i2c-smbus.ko 2024-08-25T23:45:50.714 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/i2c/i2c-stub.ko 2024-08-25T23:45:50.714 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband 2024-08-25T23:45:50.714 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/core 2024-08-25T23:45:50.714 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-25T23:45:50.714 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/core/ib_core.ko 2024-08-25T23:45:50.714 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-25T23:45:50.714 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-25T23:45:50.715 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-25T23:45:50.715 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-25T23:45:50.715 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-25T23:45:50.715 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/hw 2024-08-25T23:45:50.715 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/hw/cxgb4 2024-08-25T23:45:50.715 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-25T23:45:50.715 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/hw/mlx4 2024-08-25T23:45:50.715 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-25T23:45:50.715 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/hw/mlx5 2024-08-25T23:45:50.715 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-25T23:45:50.715 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/hw/mthca 2024-08-25T23:45:50.715 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-25T23:45:50.715 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/ulp 2024-08-25T23:45:50.715 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/ulp/ipoib 2024-08-25T23:45:50.716 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-25T23:45:50.716 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/ulp/iser 2024-08-25T23:45:50.716 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-25T23:45:50.716 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/ulp/isert 2024-08-25T23:45:50.716 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-25T23:45:50.716 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/ulp/srp 2024-08-25T23:45:50.716 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-25T23:45:50.716 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/ulp/srpt 2024-08-25T23:45:50.716 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-25T23:45:50.716 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input 2024-08-25T23:45:50.716 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/gameport 2024-08-25T23:45:50.716 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-25T23:45:50.716 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-25T23:45:50.716 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/gameport/gameport.ko 2024-08-25T23:45:50.717 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/joydev.ko 2024-08-25T23:45:50.717 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/keyboard 2024-08-25T23:45:50.717 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-25T23:45:50.717 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/mouse 2024-08-25T23:45:50.717 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/mouse/appletouch.ko 2024-08-25T23:45:50.717 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/mouse/bcm5974.ko 2024-08-25T23:45:50.717 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/mouse/cyapatp.ko 2024-08-25T23:45:50.717 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-25T23:45:50.717 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/mouse/sermouse.ko 2024-08-25T23:45:50.717 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-25T23:45:50.717 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-25T23:45:50.717 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-25T23:45:50.717 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/rmi4 2024-08-25T23:45:50.717 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-25T23:45:50.718 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/serio 2024-08-25T23:45:50.718 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/serio/altera_ps2.ko 2024-08-25T23:45:50.718 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/serio/arc_ps2.ko 2024-08-25T23:45:50.718 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-25T23:45:50.718 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/serio/serio_raw.ko 2024-08-25T23:45:50.718 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/input/sparse-keymap.ko 2024-08-25T23:45:50.718 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/leds 2024-08-25T23:45:50.718 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/leds/leds-blinkm.ko 2024-08-25T23:45:50.718 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/leds/leds-lm3530.ko 2024-08-25T23:45:50.718 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/leds/leds-lp3944.ko 2024-08-25T23:45:50.718 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/leds/leds-ss4200.ko 2024-08-25T23:45:50.718 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/leds/trigger 2024-08-25T23:45:50.718 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-25T23:45:50.718 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-25T23:45:50.719 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-25T23:45:50.719 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-25T23:45:50.719 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-25T23:45:50.719 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-25T23:45:50.719 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-25T23:45:50.719 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-25T23:45:50.719 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md 2024-08-25T23:45:50.719 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md/bcache 2024-08-25T23:45:50.719 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md/bcache/bcache.ko 2024-08-25T23:45:50.719 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md/dm-bio-prison.ko 2024-08-25T23:45:50.719 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md/dm-cache-smq.ko 2024-08-25T23:45:50.719 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md/dm-cache.ko 2024-08-25T23:45:50.719 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md/dm-crypt.ko 2024-08-25T23:45:50.719 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md/dm-delay.ko 2024-08-25T23:45:50.720 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md/dm-flakey.ko 2024-08-25T23:45:50.720 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md/dm-log-userspace.ko 2024-08-25T23:45:50.720 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md/dm-multipath.ko 2024-08-25T23:45:50.720 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md/dm-queue-length.ko 2024-08-25T23:45:50.720 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md/dm-raid.ko 2024-08-25T23:45:50.720 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md/dm-round-robin.ko 2024-08-25T23:45:50.720 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md/dm-service-time.ko 2024-08-25T23:45:50.720 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md/dm-switch.ko 2024-08-25T23:45:50.720 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md/dm-thin-pool.ko 2024-08-25T23:45:50.720 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md/dm-verity.ko 2024-08-25T23:45:50.720 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md/persistent-data 2024-08-25T23:45:50.720 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-25T23:45:50.721 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md/raid0.ko 2024-08-25T23:45:50.721 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md/raid1.ko 2024-08-25T23:45:50.721 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md/raid10.ko 2024-08-25T23:45:50.721 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/md/raid456.ko 2024-08-25T23:45:50.721 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/message 2024-08-25T23:45:50.721 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/message/fusion 2024-08-25T23:45:50.721 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/message/fusion/mptbase.ko 2024-08-25T23:45:50.721 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/message/fusion/mptctl.ko 2024-08-25T23:45:50.721 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/message/fusion/mptfc.ko 2024-08-25T23:45:50.721 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/message/fusion/mptlan.ko 2024-08-25T23:45:50.721 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/message/fusion/mptsas.ko 2024-08-25T23:45:50.721 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/message/fusion/mptscsih.ko 2024-08-25T23:45:50.721 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/message/fusion/mptspi.ko 2024-08-25T23:45:50.721 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/mfd 2024-08-25T23:45:50.721 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/mfd/lpc_ich.ko 2024-08-25T23:45:50.722 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/mfd/lpc_sch.ko 2024-08-25T23:45:50.722 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/mfd/mfd-core.ko 2024-08-25T23:45:50.722 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/mfd/sm501.ko 2024-08-25T23:45:50.722 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/mfd/viperboard.ko 2024-08-25T23:45:50.722 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/mfd/vx855.ko 2024-08-25T23:45:50.722 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/mfd/wl1273-core.ko 2024-08-25T23:45:50.722 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc 2024-08-25T23:45:50.722 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/altera-stapl 2024-08-25T23:45:50.722 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-25T23:45:50.722 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/apds9802als.ko 2024-08-25T23:45:50.722 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/apds990x.ko 2024-08-25T23:45:50.722 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/bh1770glc.ko 2024-08-25T23:45:50.722 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/cb710 2024-08-25T23:45:50.723 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/cb710/cb710.ko 2024-08-25T23:45:50.723 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/eeprom 2024-08-25T23:45:50.723 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/eeprom/at24.ko 2024-08-25T23:45:50.723 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-25T23:45:50.723 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/eeprom/max6875.ko 2024-08-25T23:45:50.723 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/enclosure.ko 2024-08-25T23:45:50.723 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/hpilo.ko 2024-08-25T23:45:50.723 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/isl29003.ko 2024-08-25T23:45:50.723 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/isl29020.ko 2024-08-25T23:45:50.723 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/lis3lv02d 2024-08-25T23:45:50.723 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-25T23:45:50.723 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-25T23:45:50.723 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/mei 2024-08-25T23:45:50.723 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/mei/mei-me.ko 2024-08-25T23:45:50.724 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/mei/mei-txe.ko 2024-08-25T23:45:50.724 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/mei/mei.ko 2024-08-25T23:45:50.724 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/sgi-gru 2024-08-25T23:45:50.724 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-25T23:45:50.724 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/sgi-xp 2024-08-25T23:45:50.724 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-25T23:45:50.724 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-25T23:45:50.724 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-25T23:45:50.724 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/tifm_7xx1.ko 2024-08-25T23:45:50.724 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/tifm_core.ko 2024-08-25T23:45:50.724 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/tsl2550.ko 2024-08-25T23:45:50.724 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/vmw_balloon.ko 2024-08-25T23:45:50.724 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/vmw_vmci 2024-08-25T23:45:50.724 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-25T23:45:50.725 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net 2024-08-25T23:45:50.725 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/bonding 2024-08-25T23:45:50.725 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/bonding/bonding.ko 2024-08-25T23:45:50.725 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/dsa 2024-08-25T23:45:50.725 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/dsa/b53 2024-08-25T23:45:50.725 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-25T23:45:50.725 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-25T23:45:50.725 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-25T23:45:50.725 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/dsa/mv88e6xxx 2024-08-25T23:45:50.725 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-25T23:45:50.725 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/dummy.ko 2024-08-25T23:45:50.725 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/eql.ko 2024-08-25T23:45:50.725 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet 2024-08-25T23:45:50.725 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/3com 2024-08-25T23:45:50.726 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-25T23:45:50.726 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-25T23:45:50.726 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-25T23:45:50.726 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-25T23:45:50.726 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/8390 2024-08-25T23:45:50.726 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-25T23:45:50.726 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-25T23:45:50.726 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-25T23:45:50.726 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-25T23:45:50.726 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/adaptec 2024-08-25T23:45:50.726 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-25T23:45:50.726 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/agere 2024-08-25T23:45:50.726 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-25T23:45:50.726 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/alteon 2024-08-25T23:45:50.727 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-25T23:45:50.727 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/altera 2024-08-25T23:45:50.727 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-25T23:45:50.727 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/amd 2024-08-25T23:45:50.727 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-25T23:45:50.727 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-25T23:45:50.727 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-25T23:45:50.727 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/atheros 2024-08-25T23:45:50.727 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/atheros/alx 2024-08-25T23:45:50.727 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-25T23:45:50.727 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-25T23:45:50.727 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-25T23:45:50.727 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-25T23:45:50.727 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-25T23:45:50.728 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/atheros/atlx 2024-08-25T23:45:50.728 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-25T23:45:50.728 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-25T23:45:50.728 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/broadcom 2024-08-25T23:45:50.728 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-25T23:45:50.728 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-25T23:45:50.728 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-25T23:45:50.728 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-25T23:45:50.728 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-25T23:45:50.728 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/broadcom/genet 2024-08-25T23:45:50.728 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-25T23:45:50.728 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-25T23:45:50.728 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/brocade 2024-08-25T23:45:50.729 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/brocade/bna 2024-08-25T23:45:50.729 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-25T23:45:50.729 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/chelsio 2024-08-25T23:45:50.729 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-25T23:45:50.729 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-25T23:45:50.729 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-25T23:45:50.729 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-25T23:45:50.729 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-25T23:45:50.729 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-25T23:45:50.729 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-25T23:45:50.729 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-25T23:45:50.729 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-25T23:45:50.729 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-25T23:45:50.729 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/cisco 2024-08-25T23:45:50.730 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/cisco/enic 2024-08-25T23:45:50.730 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-25T23:45:50.730 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/dec 2024-08-25T23:45:50.730 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/dec/tulip 2024-08-25T23:45:50.730 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-25T23:45:50.730 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-25T23:45:50.730 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-25T23:45:50.730 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-25T23:45:50.730 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-25T23:45:50.730 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-25T23:45:50.730 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/dlink 2024-08-25T23:45:50.730 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-25T23:45:50.730 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-25T23:45:50.730 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/dnet.ko 2024-08-25T23:45:50.731 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/emulex 2024-08-25T23:45:50.731 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/emulex/benet 2024-08-25T23:45:50.731 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-25T23:45:50.731 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/ethoc.ko 2024-08-25T23:45:50.731 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/fealnx.ko 2024-08-25T23:45:50.731 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel 2024-08-25T23:45:50.731 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-25T23:45:50.731 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel/e1000 2024-08-25T23:45:50.731 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-25T23:45:50.731 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel/e1000e 2024-08-25T23:45:50.731 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-25T23:45:50.731 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel/fm10k 2024-08-25T23:45:50.731 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-25T23:45:50.732 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel/i40e 2024-08-25T23:45:50.732 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-25T23:45:50.732 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel/iavf 2024-08-25T23:45:50.732 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-25T23:45:50.732 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel/igb 2024-08-25T23:45:50.732 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-25T23:45:50.732 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel/igbvf 2024-08-25T23:45:50.732 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-25T23:45:50.732 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-25T23:45:50.732 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-25T23:45:50.732 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-25T23:45:50.732 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-25T23:45:50.732 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel/libeth 2024-08-25T23:45:50.732 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-25T23:45:50.732 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel/libie 2024-08-25T23:45:50.732 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-25T23:45:50.733 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/jme.ko 2024-08-25T23:45:50.733 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/marvell 2024-08-25T23:45:50.733 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-25T23:45:50.733 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-25T23:45:50.733 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-25T23:45:50.733 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/mellanox 2024-08-25T23:45:50.733 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-25T23:45:50.733 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-25T23:45:50.733 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-25T23:45:50.733 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-25T23:45:50.733 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-25T23:45:50.733 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-25T23:45:50.733 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/micrel 2024-08-25T23:45:50.733 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-25T23:45:50.734 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/myricom 2024-08-25T23:45:50.734 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-25T23:45:50.734 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-25T23:45:50.734 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/natsemi 2024-08-25T23:45:50.734 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-25T23:45:50.734 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-25T23:45:50.734 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/neterion 2024-08-25T23:45:50.734 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-25T23:45:50.734 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/nvidia 2024-08-25T23:45:50.734 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-25T23:45:50.734 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/packetengines 2024-08-25T23:45:50.734 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-25T23:45:50.734 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-25T23:45:50.734 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/qlogic 2024-08-25T23:45:50.735 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-25T23:45:50.735 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-25T23:45:50.735 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-25T23:45:50.735 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-25T23:45:50.735 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-25T23:45:50.735 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/rdc 2024-08-25T23:45:50.735 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-25T23:45:50.735 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/realtek 2024-08-25T23:45:50.735 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-25T23:45:50.735 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-25T23:45:50.735 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-25T23:45:50.735 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-25T23:45:50.735 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/rocker 2024-08-25T23:45:50.735 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-25T23:45:50.736 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/sfc 2024-08-25T23:45:50.736 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-25T23:45:50.736 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/silan 2024-08-25T23:45:50.736 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-25T23:45:50.736 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/sis 2024-08-25T23:45:50.736 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-25T23:45:50.736 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-25T23:45:50.736 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/smsc 2024-08-25T23:45:50.736 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-25T23:45:50.736 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-25T23:45:50.736 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-25T23:45:50.736 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-25T23:45:50.736 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/stmicro 2024-08-25T23:45:50.736 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-25T23:45:50.736 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-25T23:45:50.737 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-25T23:45:50.737 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/sun 2024-08-25T23:45:50.737 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-25T23:45:50.737 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-25T23:45:50.737 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-25T23:45:50.737 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-25T23:45:50.737 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/tehuti 2024-08-25T23:45:50.737 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-25T23:45:50.737 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/ti 2024-08-25T23:45:50.737 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-25T23:45:50.737 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/via 2024-08-25T23:45:50.737 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-25T23:45:50.737 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-25T23:45:50.738 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/wiznet 2024-08-25T23:45:50.738 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-25T23:45:50.738 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-25T23:45:50.738 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/xircom 2024-08-25T23:45:50.738 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-25T23:45:50.738 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/geneve.ko 2024-08-25T23:45:50.738 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/hyperv 2024-08-25T23:45:50.738 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-25T23:45:50.738 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ieee802154 2024-08-25T23:45:50.738 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-25T23:45:50.738 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ifb.ko 2024-08-25T23:45:50.738 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ipvlan 2024-08-25T23:45:50.738 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-25T23:45:50.738 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/macvlan.ko 2024-08-25T23:45:50.739 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/macvtap.ko 2024-08-25T23:45:50.739 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/mdio 2024-08-25T23:45:50.739 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/mdio.ko 2024-08-25T23:45:50.739 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-25T23:45:50.739 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-25T23:45:50.739 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-25T23:45:50.739 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/mii.ko 2024-08-25T23:45:50.739 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/net_failover.ko 2024-08-25T23:45:50.739 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/netconsole.ko 2024-08-25T23:45:50.739 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/nlmon.ko 2024-08-25T23:45:50.739 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/pcs 2024-08-25T23:45:50.739 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-25T23:45:50.739 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-25T23:45:50.739 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/phy 2024-08-25T23:45:50.740 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/phy/amd.ko 2024-08-25T23:45:50.740 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-25T23:45:50.740 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-25T23:45:50.740 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-25T23:45:50.740 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/phy/bcm87xx.ko 2024-08-25T23:45:50.740 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/phy/broadcom.ko 2024-08-25T23:45:50.740 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/phy/cicada.ko 2024-08-25T23:45:50.740 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/phy/davicom.ko 2024-08-25T23:45:50.740 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/phy/dp83640.ko 2024-08-25T23:45:50.740 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/phy/et1011c.ko 2024-08-25T23:45:50.740 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/phy/icplus.ko 2024-08-25T23:45:50.740 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/phy/lxt.ko 2024-08-25T23:45:50.741 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/phy/marvell.ko 2024-08-25T23:45:50.741 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/phy/micrel.ko 2024-08-25T23:45:50.741 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/phy/national.ko 2024-08-25T23:45:50.741 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/phy/phylink.ko 2024-08-25T23:45:50.741 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/phy/qsemi.ko 2024-08-25T23:45:50.741 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/phy/realtek.ko 2024-08-25T23:45:50.741 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/phy/smsc.ko 2024-08-25T23:45:50.741 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/phy/ste10Xp.ko 2024-08-25T23:45:50.741 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/phy/vitesse.ko 2024-08-25T23:45:50.741 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ppp 2024-08-25T23:45:50.741 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-25T23:45:50.741 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ppp/ppp_async.ko 2024-08-25T23:45:50.741 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-25T23:45:50.742 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-25T23:45:50.742 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-25T23:45:50.742 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-25T23:45:50.742 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ppp/pppoe.ko 2024-08-25T23:45:50.742 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ppp/pppox.ko 2024-08-25T23:45:50.742 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/ppp/pptp.ko 2024-08-25T23:45:50.742 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/slip 2024-08-25T23:45:50.742 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/slip/slhc.ko 2024-08-25T23:45:50.742 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/slip/slip.ko 2024-08-25T23:45:50.742 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/sungem_phy.ko 2024-08-25T23:45:50.742 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/tap.ko 2024-08-25T23:45:50.742 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/team 2024-08-25T23:45:50.742 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/team/team.ko 2024-08-25T23:45:50.742 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-25T23:45:50.743 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-25T23:45:50.743 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-25T23:45:50.743 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/team/team_mode_random.ko 2024-08-25T23:45:50.743 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-25T23:45:50.743 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/tun.ko 2024-08-25T23:45:50.743 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/veth.ko 2024-08-25T23:45:50.743 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/virtio_net.ko 2024-08-25T23:45:50.743 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/vmxnet3 2024-08-25T23:45:50.743 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-25T23:45:50.743 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/vxlan 2024-08-25T23:45:50.743 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/vxlan/vxlan.ko 2024-08-25T23:45:50.743 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/xen-netback 2024-08-25T23:45:50.744 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-25T23:45:50.744 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/net/xen-netfront.ko 2024-08-25T23:45:50.744 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ntb 2024-08-25T23:45:50.744 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ntb/ntb.ko 2024-08-25T23:45:50.744 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/nvme 2024-08-25T23:45:50.744 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/nvme/host 2024-08-25T23:45:50.744 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/nvme/host/nvme-core.ko 2024-08-25T23:45:50.744 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/nvme/host/nvme.ko 2024-08-25T23:45:50.744 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/parport 2024-08-25T23:45:50.744 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/parport/parport.ko 2024-08-25T23:45:50.744 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/parport/parport_cs.ko 2024-08-25T23:45:50.744 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/parport/parport_pc.ko 2024-08-25T23:45:50.744 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/parport/parport_serial.ko 2024-08-25T23:45:50.744 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/pci 2024-08-25T23:45:50.745 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/pci/hotplug 2024-08-25T23:45:50.745 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-25T23:45:50.745 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/pci/pcie 2024-08-25T23:45:50.745 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-25T23:45:50.745 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/pci/xen-pcifront.ko 2024-08-25T23:45:50.745 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/pcmcia 2024-08-25T23:45:50.745 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/pcmcia/i82092.ko 2024-08-25T23:45:50.745 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/pcmcia/pd6729.ko 2024-08-25T23:45:50.745 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-25T23:45:50.745 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/pinctrl 2024-08-25T23:45:50.745 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/pinctrl/intel 2024-08-25T23:45:50.745 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-25T23:45:50.745 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform 2024-08-25T23:45:50.745 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86 2024-08-25T23:45:50.746 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-25T23:45:50.746 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/acerhdf.ko 2024-08-25T23:45:50.746 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-25T23:45:50.746 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-25T23:45:50.746 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-25T23:45:50.746 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-25T23:45:50.746 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-25T23:45:50.746 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-25T23:45:50.746 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-25T23:45:50.746 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-25T23:45:50.746 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-25T23:45:50.746 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/hdaps.ko 2024-08-25T23:45:50.746 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/intel 2024-08-25T23:45:50.746 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-25T23:45:50.747 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/intel_ips.ko 2024-08-25T23:45:50.747 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-25T23:45:50.747 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-25T23:45:50.747 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-25T23:45:50.747 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-25T23:45:50.747 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-25T23:45:50.747 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-25T23:45:50.747 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-25T23:45:50.747 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-25T23:45:50.747 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-25T23:45:50.747 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/platform/x86/wmi.ko 2024-08-25T23:45:50.747 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/powercap 2024-08-25T23:45:50.747 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-25T23:45:50.747 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-25T23:45:50.748 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/pps 2024-08-25T23:45:50.748 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/pps/clients 2024-08-25T23:45:50.748 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-25T23:45:50.748 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-25T23:45:50.748 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/pps/clients/pps_parport.ko 2024-08-25T23:45:50.748 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/pps/pps_core.ko 2024-08-25T23:45:50.748 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ptp 2024-08-25T23:45:50.748 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ptp/ptp.ko 2024-08-25T23:45:50.748 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ptp/ptp_kvm.ko 2024-08-25T23:45:50.748 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ras 2024-08-25T23:45:50.748 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ras/amd 2024-08-25T23:45:50.748 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ras/amd/atl 2024-08-25T23:45:50.748 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-25T23:45:50.748 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ras/amd/fmpm.ko 2024-08-25T23:45:50.749 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc 2024-08-25T23:45:50.749 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-25T23:45:50.749 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-25T23:45:50.749 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-25T23:45:50.749 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-25T23:45:50.749 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-25T23:45:50.749 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-25T23:45:50.749 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-25T23:45:50.749 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-25T23:45:50.749 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-25T23:45:50.749 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-25T23:45:50.749 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-em3027.ko 2024-08-25T23:45:50.749 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-25T23:45:50.749 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-25T23:45:50.750 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-25T23:45:50.750 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-25T23:45:50.750 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-25T23:45:50.750 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-25T23:45:50.750 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-max6900.ko 2024-08-25T23:45:50.750 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-25T23:45:50.750 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-25T23:45:50.750 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-25T23:45:50.750 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-25T23:45:50.750 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-25T23:45:50.750 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-25T23:45:50.750 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-25T23:45:50.750 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-25T23:45:50.750 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-25T23:45:50.750 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-25T23:45:50.751 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-25T23:45:50.751 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-25T23:45:50.751 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/rtc/rtc-x1205.ko 2024-08-25T23:45:50.751 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi 2024-08-25T23:45:50.751 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/3w-9xxx.ko 2024-08-25T23:45:50.751 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/3w-sas.ko 2024-08-25T23:45:50.751 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/3w-xxxx.ko 2024-08-25T23:45:50.751 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/BusLogic.ko 2024-08-25T23:45:50.751 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/a100u2w.ko 2024-08-25T23:45:50.751 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/aacraid 2024-08-25T23:45:50.751 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-25T23:45:50.751 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/advansys.ko 2024-08-25T23:45:50.751 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/aic7xxx 2024-08-25T23:45:50.752 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-25T23:45:50.752 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-25T23:45:50.752 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/am53c974.ko 2024-08-25T23:45:50.752 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/arcmsr 2024-08-25T23:45:50.752 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-25T23:45:50.752 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/atp870u.ko 2024-08-25T23:45:50.752 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/be2iscsi 2024-08-25T23:45:50.752 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-25T23:45:50.752 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/bfa 2024-08-25T23:45:50.752 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/bfa/bfa.ko 2024-08-25T23:45:50.752 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/bnx2fc 2024-08-25T23:45:50.752 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-25T23:45:50.752 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/bnx2i 2024-08-25T23:45:50.752 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-25T23:45:50.753 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/ch.ko 2024-08-25T23:45:50.753 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/csiostor 2024-08-25T23:45:50.753 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-25T23:45:50.753 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/cxgbi 2024-08-25T23:45:50.753 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-25T23:45:50.753 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-25T23:45:50.753 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-25T23:45:50.753 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-25T23:45:50.753 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-25T23:45:50.753 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/dc395x.ko 2024-08-25T23:45:50.753 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/device_handler 2024-08-25T23:45:50.753 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-25T23:45:50.753 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-25T23:45:50.753 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-25T23:45:50.754 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-25T23:45:50.754 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/dmx3191d.ko 2024-08-25T23:45:50.754 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/esas2r 2024-08-25T23:45:50.754 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-25T23:45:50.754 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/esp_scsi.ko 2024-08-25T23:45:50.754 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/fcoe 2024-08-25T23:45:50.754 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-25T23:45:50.754 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-25T23:45:50.754 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/fnic 2024-08-25T23:45:50.754 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/fnic/fnic.ko 2024-08-25T23:45:50.754 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/hpsa.ko 2024-08-25T23:45:50.754 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/hptiop.ko 2024-08-25T23:45:50.754 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/hv_storvsc.ko 2024-08-25T23:45:50.754 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/initio.ko 2024-08-25T23:45:50.755 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/ipr.ko 2024-08-25T23:45:50.755 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/ips.ko 2024-08-25T23:45:50.755 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/isci 2024-08-25T23:45:50.755 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/isci/isci.ko 2024-08-25T23:45:50.755 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-25T23:45:50.755 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-25T23:45:50.755 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/libfc 2024-08-25T23:45:50.755 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/libfc/libfc.ko 2024-08-25T23:45:50.755 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/libiscsi.ko 2024-08-25T23:45:50.755 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-25T23:45:50.755 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/libsas 2024-08-25T23:45:50.755 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/libsas/libsas.ko 2024-08-25T23:45:50.755 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/lpfc 2024-08-25T23:45:50.756 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-25T23:45:50.756 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/megaraid 2024-08-25T23:45:50.756 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/megaraid.ko 2024-08-25T23:45:50.756 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-25T23:45:50.756 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-25T23:45:50.756 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-25T23:45:50.756 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/mpt3sas 2024-08-25T23:45:50.756 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-25T23:45:50.756 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/mvsas 2024-08-25T23:45:50.756 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-25T23:45:50.756 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/mvumi.ko 2024-08-25T23:45:50.756 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/pm8001 2024-08-25T23:45:50.756 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-25T23:45:50.756 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/pmcraid.ko 2024-08-25T23:45:50.757 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/qla1280.ko 2024-08-25T23:45:50.757 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/qla2xxx 2024-08-25T23:45:50.757 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-25T23:45:50.757 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-25T23:45:50.757 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/qla4xxx 2024-08-25T23:45:50.757 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-25T23:45:50.757 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/raid_class.ko 2024-08-25T23:45:50.757 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/scsi_debug.ko 2024-08-25T23:45:50.757 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-25T23:45:50.757 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-25T23:45:50.757 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-25T23:45:50.757 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-25T23:45:50.757 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-25T23:45:50.758 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/ses.ko 2024-08-25T23:45:50.758 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/st.ko 2024-08-25T23:45:50.758 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/stex.ko 2024-08-25T23:45:50.758 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/sym53c8xx_2 2024-08-25T23:45:50.758 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-25T23:45:50.758 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/virtio_scsi.ko 2024-08-25T23:45:50.758 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-25T23:45:50.758 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/scsi/wd719x.ko 2024-08-25T23:45:50.758 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ssb 2024-08-25T23:45:50.758 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ssb/ssb.ko 2024-08-25T23:45:50.758 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/target 2024-08-25T23:45:50.758 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/target/iscsi 2024-08-25T23:45:50.758 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-25T23:45:50.758 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/target/loopback 2024-08-25T23:45:50.759 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-25T23:45:50.759 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/target/target_core_file.ko 2024-08-25T23:45:50.759 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/target/target_core_iblock.ko 2024-08-25T23:45:50.759 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/target/target_core_mod.ko 2024-08-25T23:45:50.759 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/target/target_core_pscsi.ko 2024-08-25T23:45:50.759 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/target/target_core_user.ko 2024-08-25T23:45:50.759 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/target/tcm_fc 2024-08-25T23:45:50.759 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-25T23:45:50.759 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/thermal 2024-08-25T23:45:50.759 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/thermal/intel 2024-08-25T23:45:50.759 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/thermal/intel/int340x_thermal 2024-08-25T23:45:50.759 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-25T23:45:50.759 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-25T23:45:50.759 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-25T23:45:50.760 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-25T23:45:50.760 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-25T23:45:50.760 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-25T23:45:50.760 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-25T23:45:50.760 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-25T23:45:50.760 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-25T23:45:50.760 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-25T23:45:50.760 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-25T23:45:50.760 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-25T23:45:50.760 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-25T23:45:50.760 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-25T23:45:50.760 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-25T23:45:50.760 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-25T23:45:50.761 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-25T23:45:50.761 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-25T23:45:50.761 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/tty 2024-08-25T23:45:50.761 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/tty/ipwireless 2024-08-25T23:45:50.761 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-25T23:45:50.761 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/tty/n_gsm.ko 2024-08-25T23:45:50.761 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/tty/n_hdlc.ko 2024-08-25T23:45:50.761 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/tty/nozomi.ko 2024-08-25T23:45:50.761 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/tty/serial 2024-08-25T23:45:50.761 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/tty/serial/8250 2024-08-25T23:45:50.761 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-25T23:45:50.761 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/tty/serial/arc_uart.ko 2024-08-25T23:45:50.761 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/tty/serial/jsm 2024-08-25T23:45:50.761 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-25T23:45:50.762 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ufs 2024-08-25T23:45:50.762 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ufs/core 2024-08-25T23:45:50.762 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-25T23:45:50.762 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ufs/host 2024-08-25T23:45:50.762 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-25T23:45:50.762 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/uio 2024-08-25T23:45:50.762 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/uio/uio.ko 2024-08-25T23:45:50.762 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/uio/uio_aec.ko 2024-08-25T23:45:50.762 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/uio/uio_cif.ko 2024-08-25T23:45:50.762 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/uio/uio_pci_generic.ko 2024-08-25T23:45:50.762 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/uio/uio_sercos3.ko 2024-08-25T23:45:50.762 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb 2024-08-25T23:45:50.762 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/class 2024-08-25T23:45:50.762 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/class/cdc-acm.ko 2024-08-25T23:45:50.763 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-25T23:45:50.763 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/class/usblp.ko 2024-08-25T23:45:50.763 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/class/usbtmc.ko 2024-08-25T23:45:50.763 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/host 2024-08-25T23:45:50.763 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-25T23:45:50.763 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/image 2024-08-25T23:45:50.763 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/image/mdc800.ko 2024-08-25T23:45:50.763 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/image/microtek.ko 2024-08-25T23:45:50.763 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/misc 2024-08-25T23:45:50.763 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/misc/adutux.ko 2024-08-25T23:45:50.763 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/misc/appledisplay.ko 2024-08-25T23:45:50.763 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/misc/emi26.ko 2024-08-25T23:45:50.763 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/misc/emi62.ko 2024-08-25T23:45:50.764 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/misc/ezusb.ko 2024-08-25T23:45:50.764 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/misc/idmouse.ko 2024-08-25T23:45:50.764 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/misc/iowarrior.ko 2024-08-25T23:45:50.764 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-25T23:45:50.764 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/misc/ldusb.ko 2024-08-25T23:45:50.764 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/misc/legousbtower.ko 2024-08-25T23:45:50.764 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/misc/sisusbvga 2024-08-25T23:45:50.764 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-25T23:45:50.764 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-25T23:45:50.764 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/misc/usb3503.ko 2024-08-25T23:45:50.764 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/misc/usblcd.ko 2024-08-25T23:45:50.764 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-25T23:45:50.764 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/misc/uss720.ko 2024-08-25T23:45:50.764 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/misc/yurex.ko 2024-08-25T23:45:50.765 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/phy 2024-08-25T23:45:50.765 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/phy/phy-generic.ko 2024-08-25T23:45:50.765 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial 2024-08-25T23:45:50.765 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/aircable.ko 2024-08-25T23:45:50.765 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/ark3116.ko 2024-08-25T23:45:50.765 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-25T23:45:50.765 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/ch341.ko 2024-08-25T23:45:50.765 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/cp210x.ko 2024-08-25T23:45:50.765 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/cyberjack.ko 2024-08-25T23:45:50.765 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-25T23:45:50.765 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-25T23:45:50.765 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/empeg.ko 2024-08-25T23:45:50.765 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-25T23:45:50.765 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-25T23:45:50.765 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-25T23:45:50.766 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/io_ti.ko 2024-08-25T23:45:50.766 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/ipaq.ko 2024-08-25T23:45:50.766 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/ipw.ko 2024-08-25T23:45:50.766 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/ir-usb.ko 2024-08-25T23:45:50.766 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-25T23:45:50.766 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/keyspan.ko 2024-08-25T23:45:50.766 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-25T23:45:50.766 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-25T23:45:50.766 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-25T23:45:50.766 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/mct_u232.ko 2024-08-25T23:45:50.766 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/mos7720.ko 2024-08-25T23:45:50.766 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/mos7840.ko 2024-08-25T23:45:50.766 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/navman.ko 2024-08-25T23:45:50.767 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/omninet.ko 2024-08-25T23:45:50.767 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/opticon.ko 2024-08-25T23:45:50.767 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/option.ko 2024-08-25T23:45:50.767 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/oti6858.ko 2024-08-25T23:45:50.767 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/pl2303.ko 2024-08-25T23:45:50.767 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/qcaux.ko 2024-08-25T23:45:50.767 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/qcserial.ko 2024-08-25T23:45:50.767 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/quatech2.ko 2024-08-25T23:45:50.767 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/safe_serial.ko 2024-08-25T23:45:50.767 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/sierra.ko 2024-08-25T23:45:50.767 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-25T23:45:50.767 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/ssu100.ko 2024-08-25T23:45:50.767 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/symbolserial.ko 2024-08-25T23:45:50.768 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-25T23:45:50.768 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-25T23:45:50.768 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/usb_debug.ko 2024-08-25T23:45:50.768 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-25T23:45:50.768 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/visor.ko 2024-08-25T23:45:50.768 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/whiteheat.ko 2024-08-25T23:45:50.768 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-25T23:45:50.768 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/storage 2024-08-25T23:45:50.768 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/storage/uas.ko 2024-08-25T23:45:50.768 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-25T23:45:50.768 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-25T23:45:50.768 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-25T23:45:50.768 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-25T23:45:50.769 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-25T23:45:50.769 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-25T23:45:50.769 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-25T23:45:50.769 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/storage/ums-karma.ko 2024-08-25T23:45:50.769 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-25T23:45:50.769 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-25T23:45:50.769 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-25T23:45:50.769 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-25T23:45:50.769 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-25T23:45:50.769 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/storage/usb-storage.ko 2024-08-25T23:45:50.769 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/usbip 2024-08-25T23:45:50.769 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-25T23:45:50.769 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-25T23:45:50.769 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-25T23:45:50.770 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/vfio 2024-08-25T23:45:50.770 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/vfio/pci 2024-08-25T23:45:50.770 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-25T23:45:50.770 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-25T23:45:50.770 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/vfio/vfio.ko 2024-08-25T23:45:50.770 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-25T23:45:50.770 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/vhost 2024-08-25T23:45:50.770 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/vhost/vhost.ko 2024-08-25T23:45:50.770 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-25T23:45:50.770 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/vhost/vhost_net.ko 2024-08-25T23:45:50.770 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/vhost/vhost_scsi.ko 2024-08-25T23:45:50.770 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/video 2024-08-25T23:45:50.770 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/video/backlight 2024-08-25T23:45:50.770 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/video/backlight/apple_bl.ko 2024-08-25T23:45:50.770 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/video/backlight/lcd.ko 2024-08-25T23:45:50.771 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-25T23:45:50.771 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/virtio 2024-08-25T23:45:50.771 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/virtio/virtio.ko 2024-08-25T23:45:50.771 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/virtio/virtio_balloon.ko 2024-08-25T23:45:50.771 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/virtio/virtio_mmio.ko 2024-08-25T23:45:50.771 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/virtio/virtio_pci.ko 2024-08-25T23:45:50.771 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-25T23:45:50.771 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-25T23:45:50.771 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/virtio/virtio_ring.ko 2024-08-25T23:45:50.771 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/w1 2024-08-25T23:45:50.771 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/w1/masters 2024-08-25T23:45:50.771 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/w1/masters/ds2482.ko 2024-08-25T23:45:50.771 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/w1/masters/ds2490.ko 2024-08-25T23:45:50.771 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/w1/slaves 2024-08-25T23:45:50.772 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-25T23:45:50.772 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-25T23:45:50.772 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-25T23:45:50.772 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-25T23:45:50.772 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-25T23:45:50.772 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-25T23:45:50.772 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-25T23:45:50.772 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-25T23:45:50.772 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-25T23:45:50.772 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-25T23:45:50.772 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-25T23:45:50.772 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/w1/wire.ko 2024-08-25T23:45:50.772 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog 2024-08-25T23:45:50.772 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-25T23:45:50.773 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-25T23:45:50.773 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-25T23:45:50.773 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/hpwdt.ko 2024-08-25T23:45:50.773 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/i6300esb.ko 2024-08-25T23:45:50.773 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-25T23:45:50.773 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-25T23:45:50.773 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/ib700wdt.ko 2024-08-25T23:45:50.773 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/ibmasr.ko 2024-08-25T23:45:50.773 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-25T23:45:50.773 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-25T23:45:50.773 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/it87_wdt.ko 2024-08-25T23:45:50.773 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/machzwd.ko 2024-08-25T23:45:50.773 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/nv_tco.ko 2024-08-25T23:45:50.773 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-25T23:45:50.773 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-25T23:45:50.774 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-25T23:45:50.774 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-25T23:45:50.774 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/softdog.ko 2024-08-25T23:45:50.774 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-25T23:45:50.774 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/via_wdt.ko 2024-08-25T23:45:50.774 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-25T23:45:50.774 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-25T23:45:50.774 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-25T23:45:50.774 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/wdt_pci.ko 2024-08-25T23:45:50.774 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/watchdog/xen_wdt.ko 2024-08-25T23:45:50.774 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/xen 2024-08-25T23:45:50.774 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-25T23:45:50.774 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/xen/xen-evtchn.ko 2024-08-25T23:45:50.774 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/xen/xen-gntalloc.ko 2024-08-25T23:45:50.775 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/xen/xen-gntdev.ko 2024-08-25T23:45:50.775 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/xen/xen-pciback 2024-08-25T23:45:50.775 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-25T23:45:50.775 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/xen/xen-privcmd.ko 2024-08-25T23:45:50.775 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/xen/xenfs 2024-08-25T23:45:50.775 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-25T23:45:50.775 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs 2024-08-25T23:45:50.775 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/9p 2024-08-25T23:45:50.775 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/9p/9p.ko 2024-08-25T23:45:50.775 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/affs 2024-08-25T23:45:50.775 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/affs/affs.ko 2024-08-25T23:45:50.775 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/befs 2024-08-25T23:45:50.775 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/befs/befs.ko 2024-08-25T23:45:50.775 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/binfmt_misc.ko 2024-08-25T23:45:50.776 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/btrfs 2024-08-25T23:45:50.776 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/btrfs/btrfs.ko 2024-08-25T23:45:50.776 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/cachefiles 2024-08-25T23:45:50.776 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/cachefiles/cachefiles.ko 2024-08-25T23:45:50.776 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/ceph 2024-08-25T23:45:50.776 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/ceph/ceph.ko 2024-08-25T23:45:50.776 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/coda 2024-08-25T23:45:50.776 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/coda/coda.ko 2024-08-25T23:45:50.776 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/cramfs 2024-08-25T23:45:50.776 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/cramfs/cramfs.ko 2024-08-25T23:45:50.776 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/dlm 2024-08-25T23:45:50.776 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/dlm/dlm.ko 2024-08-25T23:45:50.776 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/ecryptfs 2024-08-25T23:45:50.776 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-25T23:45:50.776 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/f2fs 2024-08-25T23:45:50.777 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/f2fs/f2fs.ko 2024-08-25T23:45:50.777 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/fat 2024-08-25T23:45:50.777 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/fat/fat.ko 2024-08-25T23:45:50.777 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/fat/msdos.ko 2024-08-25T23:45:50.777 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/fat/vfat.ko 2024-08-25T23:45:50.777 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/fuse 2024-08-25T23:45:50.777 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/fuse/cuse.ko 2024-08-25T23:45:50.777 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/fuse/fuse.ko 2024-08-25T23:45:50.777 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/gfs2 2024-08-25T23:45:50.777 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/gfs2/gfs2.ko 2024-08-25T23:45:50.777 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/hfs 2024-08-25T23:45:50.777 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/hfs/hfs.ko 2024-08-25T23:45:50.777 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/hfsplus 2024-08-25T23:45:50.777 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/hfsplus/hfsplus.ko 2024-08-25T23:45:50.778 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/isofs 2024-08-25T23:45:50.778 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/isofs/isofs.ko 2024-08-25T23:45:50.778 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/jfs 2024-08-25T23:45:50.778 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/jfs/jfs.ko 2024-08-25T23:45:50.778 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/lockd 2024-08-25T23:45:50.778 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/lockd/lockd.ko 2024-08-25T23:45:50.778 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/minix 2024-08-25T23:45:50.778 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/minix/minix.ko 2024-08-25T23:45:50.778 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/netfs 2024-08-25T23:45:50.778 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/netfs/netfs.ko 2024-08-25T23:45:50.778 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nfs 2024-08-25T23:45:50.778 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nfs/blocklayout 2024-08-25T23:45:50.778 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-25T23:45:50.779 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nfs/filelayout 2024-08-25T23:45:50.779 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-25T23:45:50.779 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nfs/flexfilelayout 2024-08-25T23:45:50.779 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-25T23:45:50.779 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nfs/nfs.ko 2024-08-25T23:45:50.779 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nfs/nfsv3.ko 2024-08-25T23:45:50.779 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nfs/nfsv4.ko 2024-08-25T23:45:50.779 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nfs_common 2024-08-25T23:45:50.779 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nfs_common/grace.ko 2024-08-25T23:45:50.779 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nfs_common/nfs_acl.ko 2024-08-25T23:45:50.779 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nfsd 2024-08-25T23:45:50.779 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nfsd/nfsd.ko 2024-08-25T23:45:50.779 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nilfs2 2024-08-25T23:45:50.780 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nilfs2/nilfs2.ko 2024-08-25T23:45:50.780 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls 2024-08-25T23:45:50.780 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/mac-celtic.ko 2024-08-25T23:45:50.780 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/mac-centeuro.ko 2024-08-25T23:45:50.780 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/mac-croatian.ko 2024-08-25T23:45:50.780 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/mac-cyrillic.ko 2024-08-25T23:45:50.780 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/mac-gaelic.ko 2024-08-25T23:45:50.780 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/mac-greek.ko 2024-08-25T23:45:50.780 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/mac-iceland.ko 2024-08-25T23:45:50.780 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/mac-inuit.ko 2024-08-25T23:45:50.780 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/mac-roman.ko 2024-08-25T23:45:50.780 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/mac-romanian.ko 2024-08-25T23:45:50.780 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/mac-turkish.ko 2024-08-25T23:45:50.780 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_cp1250.ko 2024-08-25T23:45:50.781 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_cp1251.ko 2024-08-25T23:45:50.781 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_cp1255.ko 2024-08-25T23:45:50.781 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_cp737.ko 2024-08-25T23:45:50.781 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_cp775.ko 2024-08-25T23:45:50.781 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_cp850.ko 2024-08-25T23:45:50.781 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_cp852.ko 2024-08-25T23:45:50.781 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_cp855.ko 2024-08-25T23:45:50.781 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_cp857.ko 2024-08-25T23:45:50.781 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_cp860.ko 2024-08-25T23:45:50.781 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_cp861.ko 2024-08-25T23:45:50.781 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_cp862.ko 2024-08-25T23:45:50.781 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_cp863.ko 2024-08-25T23:45:50.781 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_cp864.ko 2024-08-25T23:45:50.782 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_cp865.ko 2024-08-25T23:45:50.782 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_cp866.ko 2024-08-25T23:45:50.782 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_cp869.ko 2024-08-25T23:45:50.782 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_cp874.ko 2024-08-25T23:45:50.782 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_cp932.ko 2024-08-25T23:45:50.782 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_cp936.ko 2024-08-25T23:45:50.782 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_cp949.ko 2024-08-25T23:45:50.782 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_cp950.ko 2024-08-25T23:45:50.782 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_euc-jp.ko 2024-08-25T23:45:50.782 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_iso8859-1.ko 2024-08-25T23:45:50.782 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_iso8859-13.ko 2024-08-25T23:45:50.782 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_iso8859-14.ko 2024-08-25T23:45:50.782 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_iso8859-15.ko 2024-08-25T23:45:50.782 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_iso8859-2.ko 2024-08-25T23:45:50.783 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_iso8859-3.ko 2024-08-25T23:45:50.783 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_iso8859-4.ko 2024-08-25T23:45:50.783 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_iso8859-5.ko 2024-08-25T23:45:50.783 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_iso8859-6.ko 2024-08-25T23:45:50.783 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_iso8859-7.ko 2024-08-25T23:45:50.783 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_iso8859-9.ko 2024-08-25T23:45:50.783 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_koi8-r.ko 2024-08-25T23:45:50.783 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_koi8-ru.ko 2024-08-25T23:45:50.783 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_koi8-u.ko 2024-08-25T23:45:50.783 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-25T23:45:50.783 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/nls/nls_utf8.ko 2024-08-25T23:45:50.783 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/ocfs2 2024-08-25T23:45:50.783 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/ocfs2/cluster 2024-08-25T23:45:50.783 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-25T23:45:50.784 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/ocfs2/dlm 2024-08-25T23:45:50.784 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-25T23:45:50.784 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/ocfs2/dlmfs 2024-08-25T23:45:50.784 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-25T23:45:50.784 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/ocfs2/ocfs2.ko 2024-08-25T23:45:50.784 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-25T23:45:50.784 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-25T23:45:50.784 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-25T23:45:50.784 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/overlayfs 2024-08-25T23:45:50.784 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/overlayfs/overlay.ko 2024-08-25T23:45:50.784 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/pstore 2024-08-25T23:45:50.784 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/pstore/ramoops.ko 2024-08-25T23:45:50.784 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/reiserfs 2024-08-25T23:45:50.785 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/reiserfs/reiserfs.ko 2024-08-25T23:45:50.785 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/romfs 2024-08-25T23:45:50.785 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/romfs/romfs.ko 2024-08-25T23:45:50.785 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/smb 2024-08-25T23:45:50.785 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/smb/client 2024-08-25T23:45:50.785 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/smb/client/cifs.ko 2024-08-25T23:45:50.785 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/smb/common 2024-08-25T23:45:50.785 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/smb/common/cifs_arc4.ko 2024-08-25T23:45:50.785 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/smb/common/cifs_md4.ko 2024-08-25T23:45:50.785 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/squashfs 2024-08-25T23:45:50.785 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/squashfs/squashfs.ko 2024-08-25T23:45:50.785 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/sysv 2024-08-25T23:45:50.785 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/sysv/sysv.ko 2024-08-25T23:45:50.786 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/udf 2024-08-25T23:45:50.786 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/udf/udf.ko 2024-08-25T23:45:50.786 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/ufs 2024-08-25T23:45:50.786 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/ufs/ufs.ko 2024-08-25T23:45:50.786 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/xfs 2024-08-25T23:45:50.786 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/fs/xfs/xfs.ko 2024-08-25T23:45:50.786 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/kernel 2024-08-25T23:45:50.786 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/kernel/rcu 2024-08-25T23:45:50.786 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/kernel/rcu/rcutorture.ko 2024-08-25T23:45:50.786 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/kernel/torture.ko 2024-08-25T23:45:50.786 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/kernel/trace 2024-08-25T23:45:50.786 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-25T23:45:50.786 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib 2024-08-25T23:45:50.786 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib/asn1_encoder.ko 2024-08-25T23:45:50.787 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib/crc-itu-t.ko 2024-08-25T23:45:50.787 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib/crc8.ko 2024-08-25T23:45:50.787 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib/crypto 2024-08-25T23:45:50.787 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib/crypto/libaescfb.ko 2024-08-25T23:45:50.787 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib/crypto/libarc4.ko 2024-08-25T23:45:50.787 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib/crypto/libdes.ko 2024-08-25T23:45:50.787 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib/libcrc32c.ko 2024-08-25T23:45:50.787 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib/lru_cache.ko 2024-08-25T23:45:50.787 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib/lz4 2024-08-25T23:45:50.787 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib/lz4/lz4_compress.ko 2024-08-25T23:45:50.787 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib/lz4/lz4hc_compress.ko 2024-08-25T23:45:50.787 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib/math 2024-08-25T23:45:50.787 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib/math/cordic.ko 2024-08-25T23:45:50.787 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib/raid6 2024-08-25T23:45:50.788 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib/raid6/raid6_pq.ko 2024-08-25T23:45:50.788 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib/reed_solomon 2024-08-25T23:45:50.788 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-25T23:45:50.788 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib/ts_bm.ko 2024-08-25T23:45:50.788 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib/ts_fsm.ko 2024-08-25T23:45:50.788 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib/ts_kmp.ko 2024-08-25T23:45:50.788 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib/zstd 2024-08-25T23:45:50.788 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/lib/zstd/zstd_compress.ko 2024-08-25T23:45:50.788 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/mm 2024-08-25T23:45:50.788 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/mm/hwpoison-inject.ko 2024-08-25T23:45:50.788 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net 2024-08-25T23:45:50.788 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/6lowpan 2024-08-25T23:45:50.788 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/6lowpan/6lowpan.ko 2024-08-25T23:45:50.788 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/6lowpan/nhc_dest.ko 2024-08-25T23:45:50.789 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/6lowpan/nhc_fragment.ko 2024-08-25T23:45:50.789 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/6lowpan/nhc_hop.ko 2024-08-25T23:45:50.789 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-25T23:45:50.789 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/6lowpan/nhc_mobility.ko 2024-08-25T23:45:50.789 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/6lowpan/nhc_routing.ko 2024-08-25T23:45:50.789 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/6lowpan/nhc_udp.ko 2024-08-25T23:45:50.789 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/802 2024-08-25T23:45:50.789 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/802/garp.ko 2024-08-25T23:45:50.789 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/802/mrp.ko 2024-08-25T23:45:50.789 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/802/p8022.ko 2024-08-25T23:45:50.789 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/802/psnap.ko 2024-08-25T23:45:50.789 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/802/stp.ko 2024-08-25T23:45:50.789 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/8021q 2024-08-25T23:45:50.789 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/8021q/8021q.ko 2024-08-25T23:45:50.790 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/9p 2024-08-25T23:45:50.790 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/9p/9pnet.ko 2024-08-25T23:45:50.790 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/9p/9pnet_fd.ko 2024-08-25T23:45:50.790 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/9p/9pnet_rdma.ko 2024-08-25T23:45:50.790 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/9p/9pnet_virtio.ko 2024-08-25T23:45:50.790 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/batman-adv 2024-08-25T23:45:50.790 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/batman-adv/batman-adv.ko 2024-08-25T23:45:50.790 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge 2024-08-25T23:45:50.790 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/br_netfilter.ko 2024-08-25T23:45:50.790 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/bridge.ko 2024-08-25T23:45:50.790 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter 2024-08-25T23:45:50.790 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-25T23:45:50.790 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-25T23:45:50.790 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-25T23:45:50.790 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-25T23:45:50.791 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-25T23:45:50.791 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-25T23:45:50.791 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-25T23:45:50.791 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-25T23:45:50.791 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-25T23:45:50.791 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-25T23:45:50.791 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-25T23:45:50.791 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-25T23:45:50.791 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-25T23:45:50.791 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-25T23:45:50.791 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-25T23:45:50.791 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-25T23:45:50.791 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-25T23:45:50.792 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-25T23:45:50.792 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-25T23:45:50.792 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-25T23:45:50.792 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/ebtables.ko 2024-08-25T23:45:50.792 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-25T23:45:50.792 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-25T23:45:50.792 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-25T23:45:50.792 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ceph 2024-08-25T23:45:50.792 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ceph/libceph.ko 2024-08-25T23:45:50.792 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/core 2024-08-25T23:45:50.792 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/core/failover.ko 2024-08-25T23:45:50.792 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/core/pktgen.ko 2024-08-25T23:45:50.792 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/dccp 2024-08-25T23:45:50.792 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/dccp/dccp.ko 2024-08-25T23:45:50.792 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/dccp/dccp_diag.ko 2024-08-25T23:45:50.793 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/dccp/dccp_ipv4.ko 2024-08-25T23:45:50.793 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/dccp/dccp_ipv6.ko 2024-08-25T23:45:50.793 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/dns_resolver 2024-08-25T23:45:50.793 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/dns_resolver/dns_resolver.ko 2024-08-25T23:45:50.793 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/dsa 2024-08-25T23:45:50.793 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/dsa/dsa_core.ko 2024-08-25T23:45:50.793 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/dsa/tag_brcm.ko 2024-08-25T23:45:50.793 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/dsa/tag_dsa.ko 2024-08-25T23:45:50.793 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/dsa/tag_none.ko 2024-08-25T23:45:50.793 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/dsa/tag_trailer.ko 2024-08-25T23:45:50.793 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ieee802154 2024-08-25T23:45:50.793 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ieee802154/6lowpan 2024-08-25T23:45:50.793 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-25T23:45:50.793 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ieee802154/ieee802154.ko 2024-08-25T23:45:50.794 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-25T23:45:50.794 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4 2024-08-25T23:45:50.794 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/ah4.ko 2024-08-25T23:45:50.794 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/esp4.ko 2024-08-25T23:45:50.794 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/fou.ko 2024-08-25T23:45:50.794 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/gre.ko 2024-08-25T23:45:50.794 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/inet_diag.ko 2024-08-25T23:45:50.794 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/ip_gre.ko 2024-08-25T23:45:50.794 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/ip_tunnel.ko 2024-08-25T23:45:50.794 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/ip_vti.ko 2024-08-25T23:45:50.794 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/ipcomp.ko 2024-08-25T23:45:50.794 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/ipip.ko 2024-08-25T23:45:50.794 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/netfilter 2024-08-25T23:45:50.794 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-25T23:45:50.794 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-25T23:45:50.794 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-25T23:45:50.795 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-25T23:45:50.795 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-25T23:45:50.795 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-25T23:45:50.795 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-25T23:45:50.795 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-25T23:45:50.795 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-25T23:45:50.795 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-25T23:45:50.795 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-25T23:45:50.795 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-25T23:45:50.795 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-25T23:45:50.795 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-25T23:45:50.795 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-25T23:45:50.795 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-25T23:45:50.795 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-25T23:45:50.796 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-25T23:45:50.796 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-25T23:45:50.796 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-25T23:45:50.796 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-25T23:45:50.796 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/tcp_bic.ko 2024-08-25T23:45:50.796 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/tcp_dctcp.ko 2024-08-25T23:45:50.796 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/tcp_diag.ko 2024-08-25T23:45:50.796 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/tcp_highspeed.ko 2024-08-25T23:45:50.796 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/tcp_htcp.ko 2024-08-25T23:45:50.796 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/tcp_hybla.ko 2024-08-25T23:45:50.796 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/tcp_illinois.ko 2024-08-25T23:45:50.796 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/tcp_lp.ko 2024-08-25T23:45:50.796 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/tcp_scalable.ko 2024-08-25T23:45:50.796 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/tcp_vegas.ko 2024-08-25T23:45:50.797 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/tcp_veno.ko 2024-08-25T23:45:50.797 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/tcp_westwood.ko 2024-08-25T23:45:50.797 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/tcp_yeah.ko 2024-08-25T23:45:50.797 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/tunnel4.ko 2024-08-25T23:45:50.797 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/udp_diag.ko 2024-08-25T23:45:50.797 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/udp_tunnel.ko 2024-08-25T23:45:50.797 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-25T23:45:50.797 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6 2024-08-25T23:45:50.797 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/ah6.ko 2024-08-25T23:45:50.797 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/esp6.ko 2024-08-25T23:45:50.797 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/fou6.ko 2024-08-25T23:45:50.797 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/ip6_tunnel.ko 2024-08-25T23:45:50.797 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-25T23:45:50.798 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/ip6_vti.ko 2024-08-25T23:45:50.798 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/ipcomp6.ko 2024-08-25T23:45:50.798 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter 2024-08-25T23:45:50.798 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-25T23:45:50.798 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-25T23:45:50.798 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-25T23:45:50.798 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-25T23:45:50.798 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-25T23:45:50.798 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-25T23:45:50.798 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-25T23:45:50.798 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-25T23:45:50.798 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-25T23:45:50.798 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-25T23:45:50.798 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-25T23:45:50.799 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-25T23:45:50.799 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-25T23:45:50.799 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-25T23:45:50.799 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-25T23:45:50.799 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-25T23:45:50.799 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-25T23:45:50.799 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-25T23:45:50.799 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-25T23:45:50.799 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-25T23:45:50.799 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-25T23:45:50.799 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-25T23:45:50.799 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-25T23:45:50.799 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-25T23:45:50.799 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/sit.ko 2024-08-25T23:45:50.800 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/tunnel6.ko 2024-08-25T23:45:50.800 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-25T23:45:50.800 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/key 2024-08-25T23:45:50.800 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/key/af_key.ko 2024-08-25T23:45:50.800 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/l2tp 2024-08-25T23:45:50.800 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/l2tp/l2tp_core.ko 2024-08-25T23:45:50.800 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-25T23:45:50.800 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/l2tp/l2tp_eth.ko 2024-08-25T23:45:50.800 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/l2tp/l2tp_ip.ko 2024-08-25T23:45:50.800 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/l2tp/l2tp_ip6.ko 2024-08-25T23:45:50.800 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/l2tp/l2tp_netlink.ko 2024-08-25T23:45:50.800 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/l2tp/l2tp_ppp.ko 2024-08-25T23:45:50.800 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/llc 2024-08-25T23:45:50.800 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/llc/llc.ko 2024-08-25T23:45:50.800 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/mac802154 2024-08-25T23:45:50.800 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/mac802154/mac802154.ko 2024-08-25T23:45:50.801 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/mpls 2024-08-25T23:45:50.801 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/mpls/mpls_gso.ko 2024-08-25T23:45:50.801 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter 2024-08-25T23:45:50.801 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipset 2024-08-25T23:45:50.801 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipset/ip_set.ko 2024-08-25T23:45:50.801 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-25T23:45:50.801 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-25T23:45:50.801 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-25T23:45:50.801 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-25T23:45:50.801 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-25T23:45:50.801 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-25T23:45:50.801 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-25T23:45:50.801 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-25T23:45:50.801 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-25T23:45:50.801 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-25T23:45:50.801 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-25T23:45:50.802 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-25T23:45:50.802 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-25T23:45:50.802 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-25T23:45:50.802 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-25T23:45:50.802 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipvs 2024-08-25T23:45:50.802 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-25T23:45:50.802 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-25T23:45:50.802 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-25T23:45:50.802 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-25T23:45:50.802 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-25T23:45:50.802 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-25T23:45:50.802 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-25T23:45:50.802 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-25T23:45:50.802 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-25T23:45:50.803 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-25T23:45:50.803 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-25T23:45:50.803 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-25T23:45:50.803 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-25T23:45:50.803 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-25T23:45:50.803 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_conncount.ko 2024-08-25T23:45:50.803 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_conntrack.ko 2024-08-25T23:45:50.803 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-25T23:45:50.803 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-25T23:45:50.803 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-25T23:45:50.803 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-25T23:45:50.803 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-25T23:45:50.803 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-25T23:45:50.803 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-25T23:45:50.803 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-25T23:45:50.804 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-25T23:45:50.804 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-25T23:45:50.804 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-25T23:45:50.804 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-25T23:45:50.804 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-25T23:45:50.804 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_flow_table.ko 2024-08-25T23:45:50.804 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-25T23:45:50.804 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_log_syslog.ko 2024-08-25T23:45:50.804 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_nat.ko 2024-08-25T23:45:50.804 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-25T23:45:50.804 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-25T23:45:50.804 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_nat_irc.ko 2024-08-25T23:45:50.804 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_nat_sip.ko 2024-08-25T23:45:50.804 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-25T23:45:50.804 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-25T23:45:50.804 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nf_tables.ko 2024-08-25T23:45:50.805 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nfnetlink.ko 2024-08-25T23:45:50.805 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-25T23:45:50.805 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nfnetlink_log.ko 2024-08-25T23:45:50.805 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-25T23:45:50.805 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-25T23:45:50.805 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nft_chain_nat.ko 2024-08-25T23:45:50.805 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nft_compat.ko 2024-08-25T23:45:50.805 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nft_ct.ko 2024-08-25T23:45:50.805 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-25T23:45:50.805 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nft_fib.ko 2024-08-25T23:45:50.805 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-25T23:45:50.805 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nft_hash.ko 2024-08-25T23:45:50.805 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nft_limit.ko 2024-08-25T23:45:50.805 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nft_log.ko 2024-08-25T23:45:50.805 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nft_masq.ko 2024-08-25T23:45:50.806 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nft_nat.ko 2024-08-25T23:45:50.806 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nft_numgen.ko 2024-08-25T23:45:50.806 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nft_queue.ko 2024-08-25T23:45:50.806 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nft_quota.ko 2024-08-25T23:45:50.806 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nft_redir.ko 2024-08-25T23:45:50.806 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nft_reject.ko 2024-08-25T23:45:50.806 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nft_reject_inet.ko 2024-08-25T23:45:50.806 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nft_socket.ko 2024-08-25T23:45:50.806 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/nft_tunnel.ko 2024-08-25T23:45:50.806 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_AUDIT.ko 2024-08-25T23:45:50.806 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-25T23:45:50.806 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-25T23:45:50.806 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-25T23:45:50.807 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_CT.ko 2024-08-25T23:45:50.807 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_DSCP.ko 2024-08-25T23:45:50.807 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_HL.ko 2024-08-25T23:45:50.807 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_HMARK.ko 2024-08-25T23:45:50.807 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-25T23:45:50.807 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_LED.ko 2024-08-25T23:45:50.807 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_LOG.ko 2024-08-25T23:45:50.807 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-25T23:45:50.807 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_NETMAP.ko 2024-08-25T23:45:50.807 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_NFLOG.ko 2024-08-25T23:45:50.807 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-25T23:45:50.807 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_RATEEST.ko 2024-08-25T23:45:50.809 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-25T23:45:50.810 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_SECMARK.ko 2024-08-25T23:45:50.810 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-25T23:45:50.810 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-25T23:45:50.810 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_TEE.ko 2024-08-25T23:45:50.810 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_TPROXY.ko 2024-08-25T23:45:50.810 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_TRACE.ko 2024-08-25T23:45:50.810 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_addrtype.ko 2024-08-25T23:45:50.810 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_bpf.ko 2024-08-25T23:45:50.810 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_cgroup.ko 2024-08-25T23:45:50.810 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_cluster.ko 2024-08-25T23:45:50.810 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_comment.ko 2024-08-25T23:45:50.810 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_connbytes.ko 2024-08-25T23:45:50.810 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_connlabel.ko 2024-08-25T23:45:50.810 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_connlimit.ko 2024-08-25T23:45:50.811 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_connmark.ko 2024-08-25T23:45:50.811 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_conntrack.ko 2024-08-25T23:45:50.811 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_cpu.ko 2024-08-25T23:45:50.811 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_dccp.ko 2024-08-25T23:45:50.811 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_devgroup.ko 2024-08-25T23:45:50.811 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_dscp.ko 2024-08-25T23:45:50.811 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_ecn.ko 2024-08-25T23:45:50.811 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_esp.ko 2024-08-25T23:45:50.811 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_hashlimit.ko 2024-08-25T23:45:50.811 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_helper.ko 2024-08-25T23:45:50.811 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_hl.ko 2024-08-25T23:45:50.811 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_ipcomp.ko 2024-08-25T23:45:50.811 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_iprange.ko 2024-08-25T23:45:50.812 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_ipvs.ko 2024-08-25T23:45:50.812 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_l2tp.ko 2024-08-25T23:45:50.812 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_length.ko 2024-08-25T23:45:50.812 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_limit.ko 2024-08-25T23:45:50.812 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_mac.ko 2024-08-25T23:45:50.812 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_mark.ko 2024-08-25T23:45:50.812 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_multiport.ko 2024-08-25T23:45:50.812 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_nat.ko 2024-08-25T23:45:50.812 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_nfacct.ko 2024-08-25T23:45:50.812 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_osf.ko 2024-08-25T23:45:50.812 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_owner.ko 2024-08-25T23:45:50.812 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_physdev.ko 2024-08-25T23:45:50.812 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_pkttype.ko 2024-08-25T23:45:50.812 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_policy.ko 2024-08-25T23:45:50.813 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_quota.ko 2024-08-25T23:45:50.813 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_rateest.ko 2024-08-25T23:45:50.813 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_realm.ko 2024-08-25T23:45:50.813 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_recent.ko 2024-08-25T23:45:50.813 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_sctp.ko 2024-08-25T23:45:50.813 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_set.ko 2024-08-25T23:45:50.813 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_socket.ko 2024-08-25T23:45:50.813 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_state.ko 2024-08-25T23:45:50.813 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_statistic.ko 2024-08-25T23:45:50.813 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_string.ko 2024-08-25T23:45:50.813 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_tcpmss.ko 2024-08-25T23:45:50.813 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_time.ko 2024-08-25T23:45:50.813 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netfilter/xt_u32.ko 2024-08-25T23:45:50.813 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netlink 2024-08-25T23:45:50.813 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/netlink/netlink_diag.ko 2024-08-25T23:45:50.814 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/nsh 2024-08-25T23:45:50.814 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/nsh/nsh.ko 2024-08-25T23:45:50.814 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/openvswitch 2024-08-25T23:45:50.814 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/openvswitch/openvswitch.ko 2024-08-25T23:45:50.814 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/openvswitch/vport-geneve.ko 2024-08-25T23:45:50.814 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/openvswitch/vport-gre.ko 2024-08-25T23:45:50.814 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/openvswitch/vport-vxlan.ko 2024-08-25T23:45:50.814 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/packet 2024-08-25T23:45:50.814 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/packet/af_packet_diag.ko 2024-08-25T23:45:50.814 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/rds 2024-08-25T23:45:50.814 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/rds/rds.ko 2024-08-25T23:45:50.814 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/rds/rds_rdma.ko 2024-08-25T23:45:50.814 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/rds/rds_tcp.ko 2024-08-25T23:45:50.814 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched 2024-08-25T23:45:50.815 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/act_csum.ko 2024-08-25T23:45:50.815 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/act_gact.ko 2024-08-25T23:45:50.815 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/act_mirred.ko 2024-08-25T23:45:50.815 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/act_nat.ko 2024-08-25T23:45:50.815 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/act_pedit.ko 2024-08-25T23:45:50.815 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/act_police.ko 2024-08-25T23:45:50.815 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/act_simple.ko 2024-08-25T23:45:50.815 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/act_skbedit.ko 2024-08-25T23:45:50.815 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/act_vlan.ko 2024-08-25T23:45:50.815 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/cls_basic.ko 2024-08-25T23:45:50.815 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/cls_bpf.ko 2024-08-25T23:45:50.815 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/cls_flow.ko 2024-08-25T23:45:50.815 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/cls_fw.ko 2024-08-25T23:45:50.815 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/cls_route.ko 2024-08-25T23:45:50.816 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/cls_u32.ko 2024-08-25T23:45:50.816 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/em_cmp.ko 2024-08-25T23:45:50.816 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/em_ipset.ko 2024-08-25T23:45:50.816 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/em_meta.ko 2024-08-25T23:45:50.816 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/em_nbyte.ko 2024-08-25T23:45:50.816 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/em_text.ko 2024-08-25T23:45:50.816 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/em_u32.ko 2024-08-25T23:45:50.816 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/sch_choke.ko 2024-08-25T23:45:50.816 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/sch_codel.ko 2024-08-25T23:45:50.816 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/sch_drr.ko 2024-08-25T23:45:50.816 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/sch_fq.ko 2024-08-25T23:45:50.816 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/sch_gred.ko 2024-08-25T23:45:50.816 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/sch_hfsc.ko 2024-08-25T23:45:50.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/sch_hhf.ko 2024-08-25T23:45:50.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/sch_htb.ko 2024-08-25T23:45:50.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/sch_ingress.ko 2024-08-25T23:45:50.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/sch_mqprio.ko 2024-08-25T23:45:50.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/sch_mqprio_lib.ko 2024-08-25T23:45:50.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/sch_multiq.ko 2024-08-25T23:45:50.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/sch_netem.ko 2024-08-25T23:45:50.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/sch_pie.ko 2024-08-25T23:45:50.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/sch_plug.ko 2024-08-25T23:45:50.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/sch_prio.ko 2024-08-25T23:45:50.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/sch_qfq.ko 2024-08-25T23:45:50.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/sch_red.ko 2024-08-25T23:45:50.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/sch_sfb.ko 2024-08-25T23:45:50.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/sch_sfq.ko 2024-08-25T23:45:50.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/sch_tbf.ko 2024-08-25T23:45:50.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sched/sch_teql.ko 2024-08-25T23:45:50.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sctp 2024-08-25T23:45:50.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sctp/sctp.ko 2024-08-25T23:45:50.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sctp/sctp_diag.ko 2024-08-25T23:45:50.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sunrpc 2024-08-25T23:45:50.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sunrpc/auth_gss 2024-08-25T23:45:50.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-25T23:45:50.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-25T23:45:50.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sunrpc/sunrpc.ko 2024-08-25T23:45:50.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sunrpc/xprtrdma 2024-08-25T23:45:50.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-25T23:45:50.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/tipc 2024-08-25T23:45:50.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/tipc/tipc.ko 2024-08-25T23:45:50.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/tipc/tipc_diag.ko 2024-08-25T23:45:50.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/unix 2024-08-25T23:45:50.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/unix/unix_diag.ko 2024-08-25T23:45:50.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/vmw_vsock 2024-08-25T23:45:50.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-25T23:45:50.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-25T23:45:50.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/vmw_vsock/vsock.ko 2024-08-25T23:45:50.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-25T23:45:50.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-25T23:45:50.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/xfrm 2024-08-25T23:45:50.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-25T23:45:50.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/security 2024-08-25T23:45:50.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/security/keys 2024-08-25T23:45:50.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/security/keys/encrypted-keys 2024-08-25T23:45:50.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-25T23:45:50.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/security/keys/trusted-keys 2024-08-25T23:45:50.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/kernel/security/keys/trusted-keys/trusted.ko 2024-08-25T23:45:50.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/modules.alias 2024-08-25T23:45:50.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/modules.alias.bin 2024-08-25T23:45:50.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/modules.builtin 2024-08-25T23:45:50.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/modules.builtin.alias.bin 2024-08-25T23:45:50.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/modules.builtin.bin 2024-08-25T23:45:50.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/modules.builtin.modinfo 2024-08-25T23:45:50.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/modules.dep 2024-08-25T23:45:50.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/modules.dep.bin 2024-08-25T23:45:50.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/modules.devname 2024-08-25T23:45:50.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/modules.order 2024-08-25T23:45:50.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/modules.softdep 2024-08-25T23:45:50.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/modules.symbols 2024-08-25T23:45:50.821 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/modules.symbols.bin 2024-08-25T23:45:50.821 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/modules.weakdep 2024-08-25T23:45:50.821 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g8618c856c9a6/vmlinuz 2024-08-25T23:45:50.824 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g8618c856c9a6 2024-08-25T23:45:50.825 DEBUG:teuthology.orchestra.run.smithi042:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-25T23:45:50.848 INFO:teuthology.orchestra.run.smithi042.stdout:postinstall scriptlet (using /bin/sh): 2024-08-25T23:45:50.848 INFO:teuthology.orchestra.run.smithi042.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-25T23:45:50.848 INFO:teuthology.orchestra.run.smithi042.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g8618c856c9a6 /lib/modules/6.11.0-rc3-g8618c856c9a6/vmlinuz 2024-08-25T23:45:50.848 INFO:teuthology.orchestra.run.smithi042.stdout:fi 2024-08-25T23:45:50.848 INFO:teuthology.orchestra.run.smithi042.stdout:for file in vmlinuz System.map config; do 2024-08-25T23:45:50.848 INFO:teuthology.orchestra.run.smithi042.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g8618c856c9a6/${file}" "/boot/${file}-6.11.0-rc3-g8618c856c9a6"; then 2024-08-25T23:45:50.848 INFO:teuthology.orchestra.run.smithi042.stdout: cp "/lib/modules/6.11.0-rc3-g8618c856c9a6/${file}" "/boot/${file}-6.11.0-rc3-g8618c856c9a6" 2024-08-25T23:45:50.848 INFO:teuthology.orchestra.run.smithi042.stdout: fi 2024-08-25T23:45:50.848 INFO:teuthology.orchestra.run.smithi042.stdout:done 2024-08-25T23:45:50.848 INFO:teuthology.orchestra.run.smithi042.stdout:if [ -d "/lib/modules/6.11.0-rc3-g8618c856c9a6/dtb" ] && \ 2024-08-25T23:45:50.849 INFO:teuthology.orchestra.run.smithi042.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g8618c856c9a6/dtb" "/boot/dtb-6.11.0-rc3-g8618c856c9a6" >/dev/null 2>&1; then 2024-08-25T23:45:50.849 INFO:teuthology.orchestra.run.smithi042.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g8618c856c9a6" 2024-08-25T23:45:50.849 INFO:teuthology.orchestra.run.smithi042.stdout: cp -r "/lib/modules/6.11.0-rc3-g8618c856c9a6/dtb" "/boot/dtb-6.11.0-rc3-g8618c856c9a6" 2024-08-25T23:45:50.849 INFO:teuthology.orchestra.run.smithi042.stdout:fi 2024-08-25T23:45:50.849 INFO:teuthology.orchestra.run.smithi042.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g8618c856c9a6/modules.dep" ]; then 2024-08-25T23:45:50.849 INFO:teuthology.orchestra.run.smithi042.stdout: /usr/sbin/depmod 6.11.0-rc3-g8618c856c9a6 2024-08-25T23:45:50.849 INFO:teuthology.orchestra.run.smithi042.stdout:fi 2024-08-25T23:45:50.849 INFO:teuthology.orchestra.run.smithi042.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-25T23:45:50.849 INFO:teuthology.orchestra.run.smithi042.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-25T23:45:50.849 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-install remove 6.11.0-rc3-g8618c856c9a6 2024-08-25T23:45:50.849 INFO:teuthology.orchestra.run.smithi042.stdout:fi 2024-08-25T23:45:50.850 DEBUG:teuthology.orchestra.run.smithi042:> sudo rpm -qi grub2-tools 2024-08-25T23:45:50.925 INFO:teuthology.orchestra.run.smithi042.stdout:Name : grub2-tools 2024-08-25T23:45:50.925 INFO:teuthology.orchestra.run.smithi042.stdout:Epoch : 1 2024-08-25T23:45:50.925 INFO:teuthology.orchestra.run.smithi042.stdout:Version : 2.06 2024-08-25T23:45:50.925 INFO:teuthology.orchestra.run.smithi042.stdout:Release : 82.el9 2024-08-25T23:45:50.925 INFO:teuthology.orchestra.run.smithi042.stdout:Architecture: x86_64 2024-08-25T23:45:50.925 INFO:teuthology.orchestra.run.smithi042.stdout:Install Date: Wed 21 Aug 2024 09:12:29 PM UTC 2024-08-25T23:45:50.925 INFO:teuthology.orchestra.run.smithi042.stdout:Group : Unspecified 2024-08-25T23:45:50.925 INFO:teuthology.orchestra.run.smithi042.stdout:Size : 8274670 2024-08-25T23:45:50.925 INFO:teuthology.orchestra.run.smithi042.stdout:License : GPLv3+ 2024-08-25T23:45:50.925 INFO:teuthology.orchestra.run.smithi042.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-08-25T23:45:50.925 INFO:teuthology.orchestra.run.smithi042.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-08-25T23:45:50.925 INFO:teuthology.orchestra.run.smithi042.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-08-25T23:45:50.925 INFO:teuthology.orchestra.run.smithi042.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-25T23:45:50.926 INFO:teuthology.orchestra.run.smithi042.stdout:Packager : builder@centos.org 2024-08-25T23:45:50.926 INFO:teuthology.orchestra.run.smithi042.stdout:Vendor : CentOS 2024-08-25T23:45:50.926 INFO:teuthology.orchestra.run.smithi042.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-25T23:45:50.926 INFO:teuthology.orchestra.run.smithi042.stdout:Summary : Support tools for GRUB. 2024-08-25T23:45:50.926 INFO:teuthology.orchestra.run.smithi042.stdout:Description : 2024-08-25T23:45:50.926 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:45:50.926 INFO:teuthology.orchestra.run.smithi042.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-25T23:45:50.926 INFO:teuthology.orchestra.run.smithi042.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-25T23:45:50.926 INFO:teuthology.orchestra.run.smithi042.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-25T23:45:50.926 INFO:teuthology.orchestra.run.smithi042.stdout:hardware devices. 2024-08-25T23:45:50.926 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:45:50.926 INFO:teuthology.orchestra.run.smithi042.stdout:This subpackage provides tools for support of all platforms. 2024-08-25T23:45:50.927 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-25T23:45:50.927 INFO:teuthology.task.kernel:Updating grub on smithi042 to boot 6.11.0-rc3-g8618c856c9a6 2024-08-25T23:45:50.927 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-25T23:45:51.526 INFO:teuthology.orchestra.run.smithi042.stderr:Generating grub configuration file ... 2024-08-25T23:45:52.889 INFO:teuthology.orchestra.run.smithi042.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-25T23:45:52.922 INFO:teuthology.orchestra.run.smithi042.stderr:done 2024-08-25T23:45:52.924 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-08-25T23:45:52.939 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.FqgTpeXpXG 2024-08-25T23:45:52.939 DEBUG:teuthology.orchestra.run.smithi042:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.FqgTpeXpXG 2024-08-25T23:45:53.006 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.FqgTpeXpXG 2024-08-25T23:45:53.146 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.FqgTpeXpXG is 6KB 2024-08-25T23:45:53.195 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.FqgTpeXpXG 2024-08-25T23:45:53.210 DEBUG:teuthology.orchestra.run.smithi042:> sudo /bin/ls /boot/loader/entries || true 2024-08-25T23:45:53.272 INFO:teuthology.orchestra.run.smithi042.stdout:7acb1e34f9714b649e59f4e98f1746e5-0-rescue.conf 2024-08-25T23:45:53.272 INFO:teuthology.orchestra.run.smithi042.stdout:7acb1e34f9714b649e59f4e98f1746e5-5.14.0-239.el9.x86_64.conf 2024-08-25T23:45:53.272 INFO:teuthology.orchestra.run.smithi042.stdout:7acb1e34f9714b649e59f4e98f1746e5-5.14.0-496.el9.x86_64.conf 2024-08-25T23:45:53.272 INFO:teuthology.orchestra.run.smithi042.stdout:7acb1e34f9714b649e59f4e98f1746e5-6.11.0-rc3-g8618c856c9a6.conf 2024-08-25T23:45:53.274 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-set-default 7acb1e34f9714b649e59f4e98f1746e5-6.11.0-rc3-g8618c856c9a6 2024-08-25T23:45:53.429 DEBUG:teuthology.orchestra.run.smithi042:> sudo shutdown -r now 2024-08-25T23:46:23.431 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-25T23:46:23.432 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-08-25T23:46:23.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-25T23:47:23.435 DEBUG:teuthology.orchestra.remote:timed out 2024-08-25T23:47:32.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-08-25T23:47:32.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-25T23:47:32.797 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-08-25T23:47:33.318 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-08-25T23:47:33.318 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc3-g8618c856c9a6"... 2024-08-25T23:47:33.319 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-08-25T23:47:33.352 INFO:teuthology.orchestra.run.smithi042.stdout:6.11.0-rc3-g8618c856c9a6 2024-08-25T23:47:33.352 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g8618c856c9a6 vs 6.11.0-rc3-g8618c856c9a6 2024-08-25T23:47:33.352 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-25T23:47:33.352 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-25T23:47:34.356 DEBUG:teuthology.parallel:result is None 2024-08-25T23:47:34.356 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-25T23:47:34.453 INFO:teuthology.task.internal:Creating test directory... 2024-08-25T23:47:34.454 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-25T23:47:34.458 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-25T23:47:34.460 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-25T23:47:34.489 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-25T23:47:34.523 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-25T23:47:34.535 INFO:teuthology.task.internal:Creating archive directory... 2024-08-25T23:47:34.535 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-25T23:47:34.539 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-25T23:47:34.542 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-25T23:47:34.601 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-25T23:47:34.609 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-25T23:47:34.609 DEBUG:teuthology.orchestra.run.smithi043:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-25T23:47:34.626 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-25T23:47:34.626 DEBUG:teuthology.orchestra.run.smithi181:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-25T23:47:34.643 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-25T23:47:34.644 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-25T23:47:34.647 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-25T23:47:34.668 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-25T23:47:34.704 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-25T23:47:34.724 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-25T23:47:34.738 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-25T23:47:34.756 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-25T23:47:34.796 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-25T23:47:34.844 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-25T23:47:34.847 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-25T23:47:34.855 INFO:teuthology.task.internal:Configuring sudo... 2024-08-25T23:47:34.856 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-25T23:47:34.860 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-25T23:47:34.862 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-25T23:47:34.912 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-25T23:47:34.922 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-25T23:47:34.923 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-25T23:47:34.926 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-25T23:47:34.930 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-25T23:47:34.958 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-25T23:47:35.063 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-25T23:47:35.141 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-25T23:47:35.202 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-25T23:47:35.275 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-25T23:47:35.275 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-25T23:47:35.339 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-25T23:47:35.375 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-25T23:47:35.435 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-25T23:47:35.519 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-25T23:47:35.562 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-08-25T23:47:35.562 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-25T23:47:35.630 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-25T23:47:35.674 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-25T23:47:35.733 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-25T23:47:35.818 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-25T23:47:35.861 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-25T23:47:35.861 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-25T23:47:35.927 DEBUG:teuthology.orchestra.run.smithi042:> sudo service rsyslog restart 2024-08-25T23:47:35.931 DEBUG:teuthology.orchestra.run.smithi043:> sudo service rsyslog restart 2024-08-25T23:47:35.934 DEBUG:teuthology.orchestra.run.smithi181:> sudo service rsyslog restart 2024-08-25T23:47:35.966 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-25T23:47:35.999 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-25T23:47:36.022 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-25T23:47:36.317 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-25T23:47:36.325 INFO:teuthology.task.internal:Starting timer... 2024-08-25T23:47:36.325 INFO:teuthology.run_tasks:Running task pcp... 2024-08-25T23:47:36.336 INFO:teuthology.run_tasks:Running task selinux... 2024-08-25T23:47:36.347 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-08-25T23:47:36.347 DEBUG:teuthology.orchestra.run.smithi042:> sudo service auditd rotate 2024-08-25T23:47:36.427 INFO:teuthology.orchestra.run.smithi042.stdout:Rotating logs: 2024-08-25T23:47:36.430 DEBUG:teuthology.orchestra.run.smithi043:> sudo service auditd rotate 2024-08-25T23:47:36.498 INFO:teuthology.orchestra.run.smithi043.stdout:Rotating logs: 2024-08-25T23:47:36.500 DEBUG:teuthology.orchestra.run.smithi181:> sudo service auditd rotate 2024-08-25T23:47:36.568 INFO:teuthology.orchestra.run.smithi181.stdout:Rotating logs: 2024-08-25T23:47:36.570 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-25T23:47:36.570 DEBUG:teuthology.orchestra.run.smithi042:> /usr/sbin/getenforce 2024-08-25T23:47:36.630 INFO:teuthology.orchestra.run.smithi042.stdout:Permissive 2024-08-25T23:47:36.631 DEBUG:teuthology.orchestra.run.smithi043:> /usr/sbin/getenforce 2024-08-25T23:47:36.656 INFO:teuthology.orchestra.run.smithi043.stdout:Permissive 2024-08-25T23:47:36.656 DEBUG:teuthology.orchestra.run.smithi181:> /usr/sbin/getenforce 2024-08-25T23:47:36.684 INFO:teuthology.orchestra.run.smithi181.stdout:Permissive 2024-08-25T23:47:36.684 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi042.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi043.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi181.front.sepia.ceph.com': 'permissive'} 2024-08-25T23:47:36.684 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-25T23:47:36.743 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-25T23:47:36.743 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-25T23:47:36.773 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-25T23:47:36.773 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-25T23:47:36.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-25T23:47:36.802 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-25T23:47:36.802 DEBUG:teuthology.orchestra.run.smithi042:> sudo /usr/sbin/setenforce permissive 2024-08-25T23:47:36.864 DEBUG:teuthology.orchestra.run.smithi043:> sudo /usr/sbin/setenforce permissive 2024-08-25T23:47:36.890 DEBUG:teuthology.orchestra.run.smithi181:> sudo /usr/sbin/setenforce permissive 2024-08-25T23:47:36.917 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-25T23:47:36.927 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-08-25T23:47:36.930 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-08-25T23:47:37.068 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-25T23:47:37.079 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-25T23:47:37.080 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi042.front.sepia.ceph.com,smithi043.front.sepia.ceph.com,smithi181.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-25T23:49:41.982 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi042.front.sepia.ceph.com'), Remote(name='ubuntu@smithi043.front.sepia.ceph.com'), Remote(name='ubuntu@smithi181.front.sepia.ceph.com')] 2024-08-25T23:49:41.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-08-25T23:49:41.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-25T23:49:42.070 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-08-25T23:49:42.189 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-08-25T23:49:42.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-08-25T23:49:42.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-25T23:49:42.265 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-08-25T23:49:42.343 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-08-25T23:49:42.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-08-25T23:49:42.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-25T23:49:42.419 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-08-25T23:49:42.507 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-08-25T23:49:42.507 INFO:teuthology.run_tasks:Running task clock... 2024-08-25T23:49:42.516 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-25T23:49:42.517 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-25T23:49:42.517 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-25T23:49:42.521 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-25T23:49:42.521 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-25T23:49:42.523 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-25T23:49:42.524 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-25T23:49:42.554 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-25T23:49:42.569 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-25T23:49:42.577 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-25T23:49:42.579 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-25T23:49:42.592 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-25T23:49:42.596 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: ntpd: command not found 2024-08-25T23:49:42.607 INFO:teuthology.orchestra.run.smithi043.stdout:506 Cannot talk to daemon 2024-08-25T23:49:42.608 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-25T23:49:42.618 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: ntpd: command not found 2024-08-25T23:49:42.621 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-25T23:49:42.629 INFO:teuthology.orchestra.run.smithi181.stdout:506 Cannot talk to daemon 2024-08-25T23:49:42.636 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-25T23:49:42.643 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-25T23:49:42.657 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-25T23:49:42.659 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: ntpd: command not found 2024-08-25T23:49:42.685 INFO:teuthology.orchestra.run.smithi042.stdout:506 Cannot talk to daemon 2024-08-25T23:49:42.690 INFO:teuthology.orchestra.run.smithi043.stderr:bash: line 1: ntpq: command not found 2024-08-25T23:49:42.693 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-25T23:49:42.693 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2024-08-25T23:49:42.693 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-25T23:49:42.693 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-25T23:49:42.693 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-25T23:49:42.693 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-25T23:49:42.711 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-08-25T23:49:42.714 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-25T23:49:42.714 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-08-25T23:49:42.714 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-25T23:49:42.714 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-25T23:49:42.714 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-25T23:49:42.714 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-25T23:49:42.715 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-25T23:49:42.744 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-25T23:49:42.840 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-08-25T23:49:42.847 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-25T23:49:42.847 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-08-25T23:49:42.847 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-25T23:49:42.847 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-25T23:49:42.847 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-25T23:49:42.847 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-25T23:49:42.848 INFO:teuthology.run_tasks:Running task install... 2024-08-25T23:49:42.856 DEBUG:teuthology.task.install:project ceph 2024-08-25T23:49:42.856 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f273685f88d22802ccbd8a96b393734630028a13'}} 2024-08-25T23:49:42.856 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f273685f88d22802ccbd8a96b393734630028a13'} 2024-08-25T23:49:42.856 INFO:teuthology.task.install:Using flavor: default 2024-08-25T23:49:42.861 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-25T23:49:42.861 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-08-25T23:49:42.861 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f273685f88d22802ccbd8a96b393734630028a13', 'tag': None, 'wait_for_package': False} 2024-08-25T23:49:42.862 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f273685f88d22802ccbd8a96b393734630028a13 2024-08-25T23:49:42.863 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f273685f88d22802ccbd8a96b393734630028a13', 'tag': None, 'wait_for_package': False} 2024-08-25T23:49:42.863 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f273685f88d22802ccbd8a96b393734630028a13 2024-08-25T23:49:42.864 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f273685f88d22802ccbd8a96b393734630028a13', 'tag': None, 'wait_for_package': False} 2024-08-25T23:49:42.864 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f273685f88d22802ccbd8a96b393734630028a13 2024-08-25T23:49:43.008 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/f273685f88d22802ccbd8a96b393734630028a13/centos/9/flavors/default/ 2024-08-25T23:49:43.008 INFO:teuthology.task.install.rpm:Package version is 19.1.1-207.gf273685f 2024-08-25T23:49:43.020 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/f273685f88d22802ccbd8a96b393734630028a13/centos/9/flavors/default/ 2024-08-25T23:49:43.021 INFO:teuthology.task.install.rpm:Package version is 19.1.1-207.gf273685f 2024-08-25T23:49:43.024 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/f273685f88d22802ccbd8a96b393734630028a13/centos/9/flavors/default/ 2024-08-25T23:49:43.024 INFO:teuthology.task.install.rpm:Package version is 19.1.1-207.gf273685f 2024-08-25T23:49:43.117 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/f273685f88d22802ccbd8a96b393734630028a13/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/f273685f88d22802ccbd8a96b393734630028a13/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/f273685f88d22802ccbd8a96b393734630028a13/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-25T23:49:43.117 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-25T23:49:43.118 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-25T23:49:43.131 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/f273685f88d22802ccbd8a96b393734630028a13/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/f273685f88d22802ccbd8a96b393734630028a13/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/f273685f88d22802ccbd8a96b393734630028a13/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-25T23:49:43.132 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-25T23:49:43.132 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-25T23:49:43.137 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/f273685f88d22802ccbd8a96b393734630028a13/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/f273685f88d22802ccbd8a96b393734630028a13/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/f273685f88d22802ccbd8a96b393734630028a13/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-25T23:49:43.138 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-08-25T23:49:43.138 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-25T23:49:43.157 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-25T23:49:43.158 DEBUG:teuthology.orchestra.run.smithi181:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f273685f88d22802ccbd8a96b393734630028a13/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-25T23:49:43.164 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-25T23:49:43.164 DEBUG:teuthology.orchestra.run.smithi043:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f273685f88d22802ccbd8a96b393734630028a13/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-25T23:49:43.176 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-25T23:49:43.176 DEBUG:teuthology.orchestra.run.smithi042:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f273685f88d22802ccbd8a96b393734630028a13/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-25T23:49:43.223 DEBUG:teuthology.orchestra.run.smithi181:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-25T23:49:43.231 DEBUG:teuthology.orchestra.run.smithi043:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-25T23:49:43.273 DEBUG:teuthology.orchestra.run.smithi042:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-25T23:49:43.298 DEBUG:teuthology.orchestra.run.smithi181:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-25T23:49:43.306 DEBUG:teuthology.orchestra.run.smithi043:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-25T23:49:43.352 DEBUG:teuthology.orchestra.run.smithi042:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-25T23:49:43.362 INFO:teuthology.orchestra.run.smithi181.stdout:check_obsoletes = 1 2024-08-25T23:49:43.364 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum clean all 2024-08-25T23:49:43.370 INFO:teuthology.orchestra.run.smithi043.stdout:check_obsoletes = 1 2024-08-25T23:49:43.372 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum clean all 2024-08-25T23:49:43.407 INFO:teuthology.orchestra.run.smithi042.stdout:check_obsoletes = 1 2024-08-25T23:49:43.410 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum clean all 2024-08-25T23:49:43.587 INFO:teuthology.orchestra.run.smithi181.stdout:45 files removed 2024-08-25T23:49:43.602 INFO:teuthology.orchestra.run.smithi043.stdout:45 files removed 2024-08-25T23:49:43.613 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-25T23:49:43.629 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-25T23:49:43.689 INFO:teuthology.orchestra.run.smithi042.stdout:45 files removed 2024-08-25T23:49:43.721 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-25T23:49:44.178 INFO:teuthology.orchestra.run.smithi181.stdout:ceph packages for x86_64 291 kB/s | 83 kB 00:00 2024-08-25T23:49:44.205 INFO:teuthology.orchestra.run.smithi043.stdout:ceph packages for x86_64 285 kB/s | 83 kB 00:00 2024-08-25T23:49:44.422 INFO:teuthology.orchestra.run.smithi042.stdout:ceph packages for x86_64 293 kB/s | 83 kB 00:00 2024-08-25T23:49:44.462 INFO:teuthology.orchestra.run.smithi181.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-08-25T23:49:44.488 INFO:teuthology.orchestra.run.smithi043.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-08-25T23:49:44.714 INFO:teuthology.orchestra.run.smithi042.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-08-25T23:49:44.729 INFO:teuthology.orchestra.run.smithi181.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-08-25T23:49:44.782 INFO:teuthology.orchestra.run.smithi043.stdout:ceph source packages 7.4 kB/s | 1.9 kB 00:00 2024-08-25T23:49:45.006 INFO:teuthology.orchestra.run.smithi042.stdout:ceph source packages 7.5 kB/s | 1.9 kB 00:00 2024-08-25T23:49:45.480 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-08-25T23:49:45.598 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-08-25T23:49:47.508 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-08-25T23:49:48.539 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 8.2 MB 00:03 2024-08-25T23:49:48.865 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 8.8 MB/s | 20 MB 00:02 2024-08-25T23:49:50.374 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-08-25T23:49:52.226 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.6 MB 00:00 2024-08-25T23:49:53.257 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.6 MB 00:00 2024-08-25T23:49:54.885 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 18 kB 00:01 2024-08-25T23:49:55.074 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 18 kB 00:00 2024-08-25T23:49:55.508 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - CRB 5.6 MB/s | 6.6 MB 00:01 2024-08-25T23:49:55.904 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 31 MB/s | 22 MB 00:00 2024-08-25T23:49:56.114 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 20 MB/s | 22 MB 00:01 2024-08-25T23:49:57.034 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - Extras packages 87 kB/s | 18 kB 00:00 2024-08-25T23:49:57.771 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 36 MB/s | 22 MB 00:00 2024-08-25T23:50:01.293 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 48 kB/s | 1.7 kB 00:00 2024-08-25T23:50:02.662 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-08-25T23:50:03.413 INFO:teuthology.orchestra.run.smithi181.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-25T23:50:03.414 INFO:teuthology.orchestra.run.smithi181.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-25T23:50:03.425 INFO:teuthology.orchestra.run.smithi181.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-25T23:50:03.426 INFO:teuthology.orchestra.run.smithi181.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-25T23:50:03.427 INFO:teuthology.orchestra.run.smithi181.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-25T23:50:03.428 INFO:teuthology.orchestra.run.smithi181.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-25T23:50:03.429 INFO:teuthology.orchestra.run.smithi181.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-25T23:50:03.431 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-25T23:50:03.432 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-25T23:50:03.477 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-08-25T23:50:03.492 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-08-25T23:50:03.514 INFO:teuthology.orchestra.run.smithi181.stdout:====================================================================================== 2024-08-25T23:50:03.514 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-08-25T23:50:03.514 INFO:teuthology.orchestra.run.smithi181.stdout:====================================================================================== 2024-08-25T23:50:03.515 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-08-25T23:50:03.515 INFO:teuthology.orchestra.run.smithi181.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-25T23:50:03.515 INFO:teuthology.orchestra.run.smithi181.stdout: ceph x86_64 2:19.1.1-207.gf273685f.el9 ceph 6.5 k 2024-08-25T23:50:03.515 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base x86_64 2:19.1.1-207.gf273685f.el9 ceph 5.4 M 2024-08-25T23:50:03.515 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse x86_64 2:19.1.1-207.gf273685f.el9 ceph 896 k 2024-08-25T23:50:03.515 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-207.gf273685f.el9 ceph 145 k 2024-08-25T23:50:03.515 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr x86_64 2:19.1.1-207.gf273685f.el9 ceph 1.5 M 2024-08-25T23:50:03.515 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 146 k 2024-08-25T23:50:03.515 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 3.6 M 2024-08-25T23:50:03.515 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 7.4 M 2024-08-25T23:50:03.515 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 49 k 2024-08-25T23:50:03.515 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw x86_64 2:19.1.1-207.gf273685f.el9 ceph 11 M 2024-08-25T23:50:03.516 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test x86_64 2:19.1.1-207.gf273685f.el9 ceph 49 M 2024-08-25T23:50:03.516 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 285 k 2024-08-25T23:50:03.516 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 765 k 2024-08-25T23:50:03.516 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror x86_64 2:19.1.1-207.gf273685f.el9 ceph 225 k 2024-08-25T23:50:03.516 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell x86_64 2:19.1.1-207.gf273685f.el9 ceph 27 k 2024-08-25T23:50:03.516 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 18 k 2024-08-25T23:50:03.516 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-25T23:50:03.516 INFO:teuthology.orchestra.run.smithi181.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-25T23:50:03.516 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-25T23:50:03.516 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel x86_64 2:19.1.1-207.gf273685f.el9 ceph 32 k 2024-08-25T23:50:03.516 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2 x86_64 2:19.1.1-207.gf273685f.el9 ceph 751 k 2024-08-25T23:50:03.516 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel x86_64 2:19.1.1-207.gf273685f.el9 ceph 127 k 2024-08-25T23:50:03.516 INFO:teuthology.orchestra.run.smithi181.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-25T23:50:03.516 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-25T23:50:03.517 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-25T23:50:03.517 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-25T23:50:03.517 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-25T23:50:03.517 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-25T23:50:03.517 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs x86_64 2:19.1.1-207.gf273685f.el9 ceph 162 k 2024-08-25T23:50:03.517 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados x86_64 2:19.1.1-207.gf273685f.el9 ceph 321 k 2024-08-25T23:50:03.517 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd x86_64 2:19.1.1-207.gf273685f.el9 ceph 301 k 2024-08-25T23:50:03.517 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw x86_64 2:19.1.1-207.gf273685f.el9 ceph 99 k 2024-08-25T23:50:03.517 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse x86_64 2:19.1.1-207.gf273685f.el9 ceph 85 k 2024-08-25T23:50:03.517 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror x86_64 2:19.1.1-207.gf273685f.el9 ceph 3.1 M 2024-08-25T23:50:03.517 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd x86_64 2:19.1.1-207.gf273685f.el9 ceph 170 k 2024-08-25T23:50:03.517 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-25T23:50:03.517 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrading: 2024-08-25T23:50:03.518 INFO:teuthology.orchestra.run.smithi181.stdout: librados2 x86_64 2:19.1.1-207.gf273685f.el9 ceph 3.4 M 2024-08-25T23:50:03.518 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1 x86_64 2:19.1.1-207.gf273685f.el9 ceph 3.2 M 2024-08-25T23:50:03.518 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-08-25T23:50:03.518 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-25T23:50:03.518 INFO:teuthology.orchestra.run.smithi181.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-25T23:50:03.518 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-25T23:50:03.518 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common x86_64 2:19.1.1-207.gf273685f.el9 ceph 21 M 2024-08-25T23:50:03.518 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 32 k 2024-08-25T23:50:03.518 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds x86_64 2:19.1.1-207.gf273685f.el9 ceph 2.4 M 2024-08-25T23:50:03.518 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 249 k 2024-08-25T23:50:03.518 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon x86_64 2:19.1.1-207.gf273685f.el9 ceph 4.7 M 2024-08-25T23:50:03.518 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd x86_64 2:19.1.1-207.gf273685f.el9 ceph 17 M 2024-08-25T23:50:03.518 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 16 k 2024-08-25T23:50:03.518 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux x86_64 2:19.1.1-207.gf273685f.el9 ceph 25 k 2024-08-25T23:50:03.519 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-25T23:50:03.519 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-25T23:50:03.519 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-25T23:50:03.519 INFO:teuthology.orchestra.run.smithi181.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-25T23:50:03.519 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-25T23:50:03.519 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-25T23:50:03.519 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-25T23:50:03.519 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-25T23:50:03.519 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite x86_64 2:19.1.1-207.gf273685f.el9 ceph 163 k 2024-08-25T23:50:03.519 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-25T23:50:03.519 INFO:teuthology.orchestra.run.smithi181.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-25T23:50:03.519 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-25T23:50:03.520 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-25T23:50:03.520 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-25T23:50:03.520 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1 x86_64 2:19.1.1-207.gf273685f.el9 ceph 506 k 2024-08-25T23:50:03.520 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-25T23:50:03.520 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2 x86_64 2:19.1.1-207.gf273685f.el9 ceph 5.3 M 2024-08-25T23:50:03.520 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-25T23:50:03.520 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-25T23:50:03.520 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-25T23:50:03.520 INFO:teuthology.orchestra.run.smithi181.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-25T23:50:03.520 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-25T23:50:03.520 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-25T23:50:03.520 INFO:teuthology.orchestra.run.smithi181.stdout: openblas x86_64 0.3.26-1.el9 appstream 38 k 2024-08-25T23:50:03.520 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp x86_64 0.3.26-1.el9 appstream 4.9 M 2024-08-25T23:50:03.520 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-25T23:50:03.521 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-25T23:50:03.521 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-25T23:50:03.521 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-25T23:50:03.521 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-25T23:50:03.521 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-25T23:50:03.521 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-25T23:50:03.521 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-25T23:50:03.521 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-25T23:50:03.521 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse x86_64 2:19.1.1-207.gf273685f.el9 ceph 45 k 2024-08-25T23:50:03.521 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common x86_64 2:19.1.1-207.gf273685f.el9 ceph 136 k 2024-08-25T23:50:03.521 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-25T23:50:03.521 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-25T23:50:03.521 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-25T23:50:03.521 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-25T23:50:03.522 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-25T23:50:03.522 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-25T23:50:03.522 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-25T23:50:03.522 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel x86_64 3.9.19-7.el9 appstream 245 k 2024-08-25T23:50:03.522 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-25T23:50:03.522 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-25T23:50:03.522 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-25T23:50:03.522 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-25T23:50:03.522 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-25T23:50:03.522 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-25T23:50:03.522 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-25T23:50:03.522 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-25T23:50:03.522 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-25T23:50:03.523 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-25T23:50:03.523 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-25T23:50:03.523 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-25T23:50:03.523 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-25T23:50:03.523 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-25T23:50:03.523 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-25T23:50:03.523 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-25T23:50:03.523 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-25T23:50:03.523 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-25T23:50:03.523 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-25T23:50:03.523 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-25T23:50:03.523 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-25T23:50:03.523 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-25T23:50:03.524 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-25T23:50:03.524 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-25T23:50:03.524 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-25T23:50:03.524 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-25T23:50:03.524 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-25T23:50:03.524 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-25T23:50:03.524 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-25T23:50:03.524 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-25T23:50:03.524 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-25T23:50:03.524 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-25T23:50:03.524 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-25T23:50:03.525 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-25T23:50:03.525 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-25T23:50:03.525 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-25T23:50:03.525 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-25T23:50:03.525 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-25T23:50:03.525 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-25T23:50:03.525 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-25T23:50:03.525 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-25T23:50:03.525 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-25T23:50:03.525 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-25T23:50:03.525 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-25T23:50:03.525 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-25T23:50:03.525 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-25T23:50:03.525 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-25T23:50:03.526 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-25T23:50:03.526 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-25T23:50:03.526 INFO:teuthology.orchestra.run.smithi181.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-25T23:50:03.526 INFO:teuthology.orchestra.run.smithi181.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-25T23:50:03.526 INFO:teuthology.orchestra.run.smithi181.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-25T23:50:03.526 INFO:teuthology.orchestra.run.smithi181.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-25T23:50:03.526 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-25T23:50:03.526 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-25T23:50:03.526 INFO:teuthology.orchestra.run.smithi181.stdout:Installing weak dependencies: 2024-08-25T23:50:03.526 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-25T23:50:03.526 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-25T23:50:03.526 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-08-25T23:50:03.526 INFO:teuthology.orchestra.run.smithi181.stdout:====================================================================================== 2024-08-25T23:50:03.527 INFO:teuthology.orchestra.run.smithi181.stdout:Install 148 Packages 2024-08-25T23:50:03.527 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrade 2 Packages 2024-08-25T23:50:03.527 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-25T23:50:03.527 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 218 M 2024-08-25T23:50:03.527 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-08-25T23:50:03.977 INFO:teuthology.orchestra.run.smithi181.stdout:(1/150): ceph-19.1.1-207.gf273685f.el9.x86_64.r 59 kB/s | 6.5 kB 00:00 2024-08-25T23:50:04.161 INFO:teuthology.orchestra.run.smithi181.stdout:(2/150): ceph-fuse-19.1.1-207.gf273685f.el9.x86 4.8 MB/s | 896 kB 00:00 2024-08-25T23:50:04.237 INFO:teuthology.orchestra.run.smithi181.stdout:(3/150): ceph-immutable-object-cache-19.1.1-207 1.9 MB/s | 145 kB 00:00 2024-08-25T23:50:04.337 INFO:teuthology.orchestra.run.smithi181.stdout:(4/150): ceph-base-19.1.1-207.gf273685f.el9.x86 11 MB/s | 5.4 MB 00:00 2024-08-25T23:50:04.420 INFO:teuthology.orchestra.run.smithi181.stdout:(5/150): ceph-mds-19.1.1-207.gf273685f.el9.x86_ 13 MB/s | 2.4 MB 00:00 2024-08-25T23:50:04.471 INFO:teuthology.orchestra.run.smithi181.stdout:(6/150): ceph-mgr-19.1.1-207.gf273685f.el9.x86_ 11 MB/s | 1.5 MB 00:00 2024-08-25T23:50:04.821 INFO:teuthology.orchestra.run.smithi181.stdout:(7/150): ceph-mon-19.1.1-207.gf273685f.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-08-25T23:50:05.088 INFO:teuthology.orchestra.run.smithi181.stdout:(8/150): ceph-common-19.1.1-207.gf273685f.el9.x 17 MB/s | 21 MB 00:01 2024-08-25T23:50:05.146 INFO:teuthology.orchestra.run.smithi042.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-25T23:50:05.146 INFO:teuthology.orchestra.run.smithi042.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-25T23:50:05.146 INFO:teuthology.orchestra.run.smithi181.stdout:(9/150): ceph-selinux-19.1.1-207.gf273685f.el9. 432 kB/s | 25 kB 00:00 2024-08-25T23:50:05.159 INFO:teuthology.orchestra.run.smithi042.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-25T23:50:05.159 INFO:teuthology.orchestra.run.smithi042.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-25T23:50:05.160 INFO:teuthology.orchestra.run.smithi042.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-25T23:50:05.161 INFO:teuthology.orchestra.run.smithi042.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-25T23:50:05.163 INFO:teuthology.orchestra.run.smithi042.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-25T23:50:05.165 INFO:teuthology.orchestra.run.smithi042.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-25T23:50:05.166 INFO:teuthology.orchestra.run.smithi042.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-25T23:50:05.235 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-08-25T23:50:05.260 INFO:teuthology.orchestra.run.smithi042.stdout:====================================================================================== 2024-08-25T23:50:05.260 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-08-25T23:50:05.260 INFO:teuthology.orchestra.run.smithi042.stdout:====================================================================================== 2024-08-25T23:50:05.260 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-08-25T23:50:05.260 INFO:teuthology.orchestra.run.smithi042.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-25T23:50:05.260 INFO:teuthology.orchestra.run.smithi042.stdout: ceph x86_64 2:19.1.1-207.gf273685f.el9 ceph 6.5 k 2024-08-25T23:50:05.260 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base x86_64 2:19.1.1-207.gf273685f.el9 ceph 5.4 M 2024-08-25T23:50:05.261 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse x86_64 2:19.1.1-207.gf273685f.el9 ceph 896 k 2024-08-25T23:50:05.261 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-207.gf273685f.el9 ceph 145 k 2024-08-25T23:50:05.261 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr x86_64 2:19.1.1-207.gf273685f.el9 ceph 1.5 M 2024-08-25T23:50:05.261 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 146 k 2024-08-25T23:50:05.261 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 3.6 M 2024-08-25T23:50:05.261 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 7.4 M 2024-08-25T23:50:05.261 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 49 k 2024-08-25T23:50:05.261 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw x86_64 2:19.1.1-207.gf273685f.el9 ceph 11 M 2024-08-25T23:50:05.261 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test x86_64 2:19.1.1-207.gf273685f.el9 ceph 49 M 2024-08-25T23:50:05.261 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 285 k 2024-08-25T23:50:05.261 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 765 k 2024-08-25T23:50:05.261 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-mirror x86_64 2:19.1.1-207.gf273685f.el9 ceph 225 k 2024-08-25T23:50:05.261 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-shell x86_64 2:19.1.1-207.gf273685f.el9 ceph 27 k 2024-08-25T23:50:05.261 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-top noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 18 k 2024-08-25T23:50:05.262 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-25T23:50:05.262 INFO:teuthology.orchestra.run.smithi042.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-25T23:50:05.262 INFO:teuthology.orchestra.run.smithi042.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-25T23:50:05.262 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel x86_64 2:19.1.1-207.gf273685f.el9 ceph 32 k 2024-08-25T23:50:05.262 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2 x86_64 2:19.1.1-207.gf273685f.el9 ceph 751 k 2024-08-25T23:50:05.262 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel x86_64 2:19.1.1-207.gf273685f.el9 ceph 127 k 2024-08-25T23:50:05.262 INFO:teuthology.orchestra.run.smithi042.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-25T23:50:05.262 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-25T23:50:05.262 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-25T23:50:05.262 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-25T23:50:05.262 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-25T23:50:05.262 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-25T23:50:05.262 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs x86_64 2:19.1.1-207.gf273685f.el9 ceph 162 k 2024-08-25T23:50:05.263 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados x86_64 2:19.1.1-207.gf273685f.el9 ceph 321 k 2024-08-25T23:50:05.263 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd x86_64 2:19.1.1-207.gf273685f.el9 ceph 301 k 2024-08-25T23:50:05.263 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw x86_64 2:19.1.1-207.gf273685f.el9 ceph 99 k 2024-08-25T23:50:05.263 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse x86_64 2:19.1.1-207.gf273685f.el9 ceph 85 k 2024-08-25T23:50:05.263 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror x86_64 2:19.1.1-207.gf273685f.el9 ceph 3.1 M 2024-08-25T23:50:05.263 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd x86_64 2:19.1.1-207.gf273685f.el9 ceph 170 k 2024-08-25T23:50:05.263 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-25T23:50:05.263 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrading: 2024-08-25T23:50:05.263 INFO:teuthology.orchestra.run.smithi042.stdout: librados2 x86_64 2:19.1.1-207.gf273685f.el9 ceph 3.4 M 2024-08-25T23:50:05.263 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1 x86_64 2:19.1.1-207.gf273685f.el9 ceph 3.2 M 2024-08-25T23:50:05.263 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-08-25T23:50:05.263 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-25T23:50:05.263 INFO:teuthology.orchestra.run.smithi042.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-25T23:50:05.264 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-25T23:50:05.264 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common x86_64 2:19.1.1-207.gf273685f.el9 ceph 21 M 2024-08-25T23:50:05.264 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 32 k 2024-08-25T23:50:05.264 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds x86_64 2:19.1.1-207.gf273685f.el9 ceph 2.4 M 2024-08-25T23:50:05.264 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 249 k 2024-08-25T23:50:05.264 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon x86_64 2:19.1.1-207.gf273685f.el9 ceph 4.7 M 2024-08-25T23:50:05.264 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd x86_64 2:19.1.1-207.gf273685f.el9 ceph 17 M 2024-08-25T23:50:05.264 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 16 k 2024-08-25T23:50:05.264 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux x86_64 2:19.1.1-207.gf273685f.el9 ceph 25 k 2024-08-25T23:50:05.264 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-25T23:50:05.264 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-25T23:50:05.264 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-25T23:50:05.264 INFO:teuthology.orchestra.run.smithi042.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-25T23:50:05.264 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-25T23:50:05.265 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-25T23:50:05.265 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-25T23:50:05.265 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-25T23:50:05.265 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite x86_64 2:19.1.1-207.gf273685f.el9 ceph 163 k 2024-08-25T23:50:05.265 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-25T23:50:05.265 INFO:teuthology.orchestra.run.smithi042.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-25T23:50:05.265 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-25T23:50:05.265 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-25T23:50:05.265 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-25T23:50:05.265 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1 x86_64 2:19.1.1-207.gf273685f.el9 ceph 506 k 2024-08-25T23:50:05.265 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-25T23:50:05.265 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2 x86_64 2:19.1.1-207.gf273685f.el9 ceph 5.3 M 2024-08-25T23:50:05.265 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-25T23:50:05.265 INFO:teuthology.orchestra.run.smithi042.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-25T23:50:05.266 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-25T23:50:05.266 INFO:teuthology.orchestra.run.smithi042.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-25T23:50:05.266 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-25T23:50:05.266 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-25T23:50:05.266 INFO:teuthology.orchestra.run.smithi042.stdout: openblas x86_64 0.3.26-1.el9 appstream 38 k 2024-08-25T23:50:05.266 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp x86_64 0.3.26-1.el9 appstream 4.9 M 2024-08-25T23:50:05.266 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-25T23:50:05.266 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-25T23:50:05.267 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-25T23:50:05.267 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-25T23:50:05.267 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-25T23:50:05.267 INFO:teuthology.orchestra.run.smithi042.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-25T23:50:05.267 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-25T23:50:05.267 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-25T23:50:05.267 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-25T23:50:05.267 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse x86_64 2:19.1.1-207.gf273685f.el9 ceph 45 k 2024-08-25T23:50:05.267 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common x86_64 2:19.1.1-207.gf273685f.el9 ceph 136 k 2024-08-25T23:50:05.267 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-25T23:50:05.267 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-25T23:50:05.267 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-25T23:50:05.267 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-25T23:50:05.268 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-25T23:50:05.268 INFO:teuthology.orchestra.run.smithi042.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-25T23:50:05.268 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-25T23:50:05.268 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel x86_64 3.9.19-7.el9 appstream 245 k 2024-08-25T23:50:05.268 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-25T23:50:05.268 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-25T23:50:05.268 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-25T23:50:05.268 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-25T23:50:05.268 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-25T23:50:05.268 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-25T23:50:05.268 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-25T23:50:05.268 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-25T23:50:05.269 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-25T23:50:05.269 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-25T23:50:05.269 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-25T23:50:05.269 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-25T23:50:05.269 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-25T23:50:05.269 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-25T23:50:05.269 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-25T23:50:05.269 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-25T23:50:05.269 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-25T23:50:05.269 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-25T23:50:05.269 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-25T23:50:05.269 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-25T23:50:05.269 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-25T23:50:05.269 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-25T23:50:05.269 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-25T23:50:05.270 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-25T23:50:05.270 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-25T23:50:05.270 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-25T23:50:05.270 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-25T23:50:05.270 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-25T23:50:05.270 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-25T23:50:05.270 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-25T23:50:05.270 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-25T23:50:05.270 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-25T23:50:05.270 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-25T23:50:05.270 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-25T23:50:05.270 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-25T23:50:05.271 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-25T23:50:05.271 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-25T23:50:05.271 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-25T23:50:05.271 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-25T23:50:05.271 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-25T23:50:05.271 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-25T23:50:05.271 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-25T23:50:05.271 INFO:teuthology.orchestra.run.smithi042.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-25T23:50:05.271 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-25T23:50:05.271 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-25T23:50:05.271 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-25T23:50:05.271 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-25T23:50:05.271 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-25T23:50:05.271 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-25T23:50:05.271 INFO:teuthology.orchestra.run.smithi042.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-25T23:50:05.272 INFO:teuthology.orchestra.run.smithi042.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-25T23:50:05.272 INFO:teuthology.orchestra.run.smithi042.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-25T23:50:05.272 INFO:teuthology.orchestra.run.smithi042.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-25T23:50:05.272 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-25T23:50:05.272 INFO:teuthology.orchestra.run.smithi042.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-25T23:50:05.272 INFO:teuthology.orchestra.run.smithi042.stdout:Installing weak dependencies: 2024-08-25T23:50:05.272 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-25T23:50:05.272 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:50:05.272 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-08-25T23:50:05.272 INFO:teuthology.orchestra.run.smithi042.stdout:====================================================================================== 2024-08-25T23:50:05.272 INFO:teuthology.orchestra.run.smithi042.stdout:Install 148 Packages 2024-08-25T23:50:05.272 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrade 2 Packages 2024-08-25T23:50:05.272 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:50:05.273 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 218 M 2024-08-25T23:50:05.273 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-08-25T23:50:05.538 INFO:teuthology.orchestra.run.smithi181.stdout:(10/150): ceph-osd-19.1.1-207.gf273685f.el9.x86 16 MB/s | 17 MB 00:01 2024-08-25T23:50:05.647 INFO:teuthology.orchestra.run.smithi181.stdout:(11/150): ceph-radosgw-19.1.1-207.gf273685f.el9 13 MB/s | 11 MB 00:00 2024-08-25T23:50:05.664 INFO:teuthology.orchestra.run.smithi181.stdout:(12/150): cephfs-mirror-19.1.1-207.gf273685f.el 1.8 MB/s | 225 kB 00:00 2024-08-25T23:50:05.697 INFO:teuthology.orchestra.run.smithi181.stdout:(13/150): cephfs-shell-19.1.1-207.gf273685f.el9 540 kB/s | 27 kB 00:00 2024-08-25T23:50:05.713 INFO:teuthology.orchestra.run.smithi043.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-25T23:50:05.713 INFO:teuthology.orchestra.run.smithi043.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-25T23:50:05.722 INFO:teuthology.orchestra.run.smithi181.stdout:(14/150): libcephfs-devel-19.1.1-207.gf273685f. 541 kB/s | 32 kB 00:00 2024-08-25T23:50:05.728 INFO:teuthology.orchestra.run.smithi043.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-25T23:50:05.728 INFO:teuthology.orchestra.run.smithi043.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-25T23:50:05.729 INFO:teuthology.orchestra.run.smithi043.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-25T23:50:05.731 INFO:teuthology.orchestra.run.smithi043.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-25T23:50:05.733 INFO:teuthology.orchestra.run.smithi043.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-25T23:50:05.735 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-25T23:50:05.736 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-25T23:50:05.781 INFO:teuthology.orchestra.run.smithi181.stdout:(15/150): libcephfs2-19.1.1-207.gf273685f.el9.x 8.8 MB/s | 751 kB 00:00 2024-08-25T23:50:05.801 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-08-25T23:50:05.806 INFO:teuthology.orchestra.run.smithi181.stdout:(16/150): libcephsqlite-19.1.1-207.gf273685f.el 1.9 MB/s | 163 kB 00:00 2024-08-25T23:50:05.819 INFO:teuthology.orchestra.run.smithi043.stdout:====================================================================================== 2024-08-25T23:50:05.819 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2024-08-25T23:50:05.819 INFO:teuthology.orchestra.run.smithi043.stdout:====================================================================================== 2024-08-25T23:50:05.819 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-08-25T23:50:05.819 INFO:teuthology.orchestra.run.smithi043.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-25T23:50:05.819 INFO:teuthology.orchestra.run.smithi043.stdout: ceph x86_64 2:19.1.1-207.gf273685f.el9 ceph 6.5 k 2024-08-25T23:50:05.819 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base x86_64 2:19.1.1-207.gf273685f.el9 ceph 5.4 M 2024-08-25T23:50:05.819 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse x86_64 2:19.1.1-207.gf273685f.el9 ceph 896 k 2024-08-25T23:50:05.819 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-207.gf273685f.el9 ceph 145 k 2024-08-25T23:50:05.820 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr x86_64 2:19.1.1-207.gf273685f.el9 ceph 1.5 M 2024-08-25T23:50:05.820 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 146 k 2024-08-25T23:50:05.820 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 3.6 M 2024-08-25T23:50:05.820 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 7.4 M 2024-08-25T23:50:05.820 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 49 k 2024-08-25T23:50:05.820 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw x86_64 2:19.1.1-207.gf273685f.el9 ceph 11 M 2024-08-25T23:50:05.820 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test x86_64 2:19.1.1-207.gf273685f.el9 ceph 49 M 2024-08-25T23:50:05.820 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 285 k 2024-08-25T23:50:05.820 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 765 k 2024-08-25T23:50:05.820 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-mirror x86_64 2:19.1.1-207.gf273685f.el9 ceph 225 k 2024-08-25T23:50:05.820 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-shell x86_64 2:19.1.1-207.gf273685f.el9 ceph 27 k 2024-08-25T23:50:05.820 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-top noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 18 k 2024-08-25T23:50:05.820 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-25T23:50:05.820 INFO:teuthology.orchestra.run.smithi043.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-25T23:50:05.821 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-25T23:50:05.821 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel x86_64 2:19.1.1-207.gf273685f.el9 ceph 32 k 2024-08-25T23:50:05.821 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2 x86_64 2:19.1.1-207.gf273685f.el9 ceph 751 k 2024-08-25T23:50:05.821 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel x86_64 2:19.1.1-207.gf273685f.el9 ceph 127 k 2024-08-25T23:50:05.821 INFO:teuthology.orchestra.run.smithi043.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-25T23:50:05.821 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-25T23:50:05.821 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-25T23:50:05.821 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-25T23:50:05.821 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-25T23:50:05.821 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-25T23:50:05.821 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs x86_64 2:19.1.1-207.gf273685f.el9 ceph 162 k 2024-08-25T23:50:05.821 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados x86_64 2:19.1.1-207.gf273685f.el9 ceph 321 k 2024-08-25T23:50:05.821 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd x86_64 2:19.1.1-207.gf273685f.el9 ceph 301 k 2024-08-25T23:50:05.821 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw x86_64 2:19.1.1-207.gf273685f.el9 ceph 99 k 2024-08-25T23:50:05.822 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse x86_64 2:19.1.1-207.gf273685f.el9 ceph 85 k 2024-08-25T23:50:05.822 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror x86_64 2:19.1.1-207.gf273685f.el9 ceph 3.1 M 2024-08-25T23:50:05.822 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd x86_64 2:19.1.1-207.gf273685f.el9 ceph 170 k 2024-08-25T23:50:05.822 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-25T23:50:05.822 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrading: 2024-08-25T23:50:05.822 INFO:teuthology.orchestra.run.smithi043.stdout: librados2 x86_64 2:19.1.1-207.gf273685f.el9 ceph 3.4 M 2024-08-25T23:50:05.822 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1 x86_64 2:19.1.1-207.gf273685f.el9 ceph 3.2 M 2024-08-25T23:50:05.822 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-08-25T23:50:05.822 INFO:teuthology.orchestra.run.smithi043.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-25T23:50:05.822 INFO:teuthology.orchestra.run.smithi043.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-25T23:50:05.822 INFO:teuthology.orchestra.run.smithi043.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-25T23:50:05.822 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common x86_64 2:19.1.1-207.gf273685f.el9 ceph 21 M 2024-08-25T23:50:05.822 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 32 k 2024-08-25T23:50:05.823 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds x86_64 2:19.1.1-207.gf273685f.el9 ceph 2.4 M 2024-08-25T23:50:05.823 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 249 k 2024-08-25T23:50:05.823 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon x86_64 2:19.1.1-207.gf273685f.el9 ceph 4.7 M 2024-08-25T23:50:05.823 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd x86_64 2:19.1.1-207.gf273685f.el9 ceph 17 M 2024-08-25T23:50:05.823 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts noarch 2:19.1.1-207.gf273685f.el9 ceph-noarch 16 k 2024-08-25T23:50:05.823 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux x86_64 2:19.1.1-207.gf273685f.el9 ceph 25 k 2024-08-25T23:50:05.823 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-25T23:50:05.823 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-25T23:50:05.823 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-25T23:50:05.823 INFO:teuthology.orchestra.run.smithi043.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-25T23:50:05.823 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-25T23:50:05.823 INFO:teuthology.orchestra.run.smithi043.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-25T23:50:05.824 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-25T23:50:05.824 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-25T23:50:05.824 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite x86_64 2:19.1.1-207.gf273685f.el9 ceph 163 k 2024-08-25T23:50:05.824 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-25T23:50:05.824 INFO:teuthology.orchestra.run.smithi043.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-25T23:50:05.824 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-25T23:50:05.824 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-25T23:50:05.824 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-25T23:50:05.824 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1 x86_64 2:19.1.1-207.gf273685f.el9 ceph 506 k 2024-08-25T23:50:05.824 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-25T23:50:05.824 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2 x86_64 2:19.1.1-207.gf273685f.el9 ceph 5.3 M 2024-08-25T23:50:05.824 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-25T23:50:05.824 INFO:teuthology.orchestra.run.smithi043.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-25T23:50:05.825 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-25T23:50:05.825 INFO:teuthology.orchestra.run.smithi043.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-25T23:50:05.825 INFO:teuthology.orchestra.run.smithi043.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-25T23:50:05.825 INFO:teuthology.orchestra.run.smithi043.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-25T23:50:05.825 INFO:teuthology.orchestra.run.smithi043.stdout: openblas x86_64 0.3.26-1.el9 appstream 38 k 2024-08-25T23:50:05.825 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-openmp x86_64 0.3.26-1.el9 appstream 4.9 M 2024-08-25T23:50:05.825 INFO:teuthology.orchestra.run.smithi043.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-25T23:50:05.825 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-25T23:50:05.825 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-25T23:50:05.825 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-25T23:50:05.825 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-25T23:50:05.825 INFO:teuthology.orchestra.run.smithi043.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-25T23:50:05.825 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-25T23:50:05.826 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-25T23:50:05.826 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-25T23:50:05.826 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse x86_64 2:19.1.1-207.gf273685f.el9 ceph 45 k 2024-08-25T23:50:05.826 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common x86_64 2:19.1.1-207.gf273685f.el9 ceph 136 k 2024-08-25T23:50:05.826 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-25T23:50:05.826 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-25T23:50:05.826 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-25T23:50:05.826 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-25T23:50:05.826 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-25T23:50:05.826 INFO:teuthology.orchestra.run.smithi043.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-25T23:50:05.826 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-25T23:50:05.826 INFO:teuthology.orchestra.run.smithi043.stdout: python3-devel x86_64 3.9.19-7.el9 appstream 245 k 2024-08-25T23:50:05.826 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-25T23:50:05.827 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-25T23:50:05.827 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-25T23:50:05.827 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-25T23:50:05.827 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-25T23:50:05.827 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-25T23:50:05.827 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-25T23:50:05.827 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-25T23:50:05.827 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-25T23:50:05.827 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-25T23:50:05.827 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-25T23:50:05.827 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-25T23:50:05.827 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-25T23:50:05.827 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-25T23:50:05.827 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-25T23:50:05.828 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-25T23:50:05.828 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-25T23:50:05.828 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-25T23:50:05.828 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-25T23:50:05.828 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-25T23:50:05.828 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-25T23:50:05.828 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-25T23:50:05.828 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-25T23:50:05.828 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-25T23:50:05.828 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-25T23:50:05.828 INFO:teuthology.orchestra.run.smithi043.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-25T23:50:05.828 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-25T23:50:05.828 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-25T23:50:05.828 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-25T23:50:05.829 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-25T23:50:05.829 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-25T23:50:05.829 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-25T23:50:05.829 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-25T23:50:05.829 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-25T23:50:05.829 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-25T23:50:05.829 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-25T23:50:05.829 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-25T23:50:05.829 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-25T23:50:05.829 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-25T23:50:05.829 INFO:teuthology.orchestra.run.smithi043.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-25T23:50:05.829 INFO:teuthology.orchestra.run.smithi043.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-25T23:50:05.829 INFO:teuthology.orchestra.run.smithi043.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-25T23:50:05.830 INFO:teuthology.orchestra.run.smithi043.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-25T23:50:05.830 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-25T23:50:05.830 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-25T23:50:05.830 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-25T23:50:05.830 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-25T23:50:05.830 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-25T23:50:05.830 INFO:teuthology.orchestra.run.smithi043.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-25T23:50:05.830 INFO:teuthology.orchestra.run.smithi043.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-25T23:50:05.830 INFO:teuthology.orchestra.run.smithi043.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-25T23:50:05.830 INFO:teuthology.orchestra.run.smithi043.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-25T23:50:05.830 INFO:teuthology.orchestra.run.smithi043.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-25T23:50:05.830 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-25T23:50:05.830 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-25T23:50:05.830 INFO:teuthology.orchestra.run.smithi043.stdout:Installing weak dependencies: 2024-08-25T23:50:05.831 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-25T23:50:05.831 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-08-25T23:50:05.831 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-08-25T23:50:05.831 INFO:teuthology.orchestra.run.smithi043.stdout:====================================================================================== 2024-08-25T23:50:05.831 INFO:teuthology.orchestra.run.smithi043.stdout:Install 148 Packages 2024-08-25T23:50:05.831 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrade 2 Packages 2024-08-25T23:50:05.831 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-08-25T23:50:05.832 INFO:teuthology.orchestra.run.smithi181.stdout:(17/150): librados-devel-19.1.1-207.gf273685f.e 2.5 MB/s | 127 kB 00:00 2024-08-25T23:50:05.832 INFO:teuthology.orchestra.run.smithi042.stdout:(1/150): ceph-19.1.1-207.gf273685f.el9.x86_64.r 41 kB/s | 6.5 kB 00:00 2024-08-25T23:50:05.832 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 218 M 2024-08-25T23:50:05.832 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-08-25T23:50:05.865 INFO:teuthology.orchestra.run.smithi181.stdout:(18/150): libradosstriper1-19.1.1-207.gf273685f 8.5 MB/s | 506 kB 00:00 2024-08-25T23:50:05.924 INFO:teuthology.orchestra.run.smithi181.stdout:(19/150): python3-ceph-argparse-19.1.1-207.gf27 772 kB/s | 45 kB 00:00 2024-08-25T23:50:05.991 INFO:teuthology.orchestra.run.smithi181.stdout:(20/150): python3-ceph-common-19.1.1-207.gf2736 2.0 MB/s | 136 kB 00:00 2024-08-25T23:50:06.050 INFO:teuthology.orchestra.run.smithi181.stdout:(21/150): python3-cephfs-19.1.1-207.gf273685f.e 2.7 MB/s | 162 kB 00:00 2024-08-25T23:50:06.155 INFO:teuthology.orchestra.run.smithi042.stdout:(2/150): ceph-fuse-19.1.1-207.gf273685f.el9.x86 2.7 MB/s | 896 kB 00:00 2024-08-25T23:50:06.208 INFO:teuthology.orchestra.run.smithi181.stdout:(22/150): librgw2-19.1.1-207.gf273685f.el9.x86_ 14 MB/s | 5.3 MB 00:00 2024-08-25T23:50:06.214 INFO:teuthology.orchestra.run.smithi042.stdout:(3/150): ceph-immutable-object-cache-19.1.1-207 2.4 MB/s | 145 kB 00:00 2024-08-25T23:50:06.233 INFO:teuthology.orchestra.run.smithi181.stdout:(23/150): python3-rados-19.1.1-207.gf273685f.el 1.7 MB/s | 321 kB 00:00 2024-08-25T23:50:06.259 INFO:teuthology.orchestra.run.smithi181.stdout:(24/150): python3-rbd-19.1.1-207.gf273685f.el9. 5.9 MB/s | 301 kB 00:00 2024-08-25T23:50:06.292 INFO:teuthology.orchestra.run.smithi181.stdout:(25/150): python3-rgw-19.1.1-207.gf273685f.el9. 1.7 MB/s | 99 kB 00:00 2024-08-25T23:50:06.317 INFO:teuthology.orchestra.run.smithi181.stdout:(26/150): rbd-fuse-19.1.1-207.gf273685f.el9.x86 1.4 MB/s | 85 kB 00:00 2024-08-25T23:50:06.393 INFO:teuthology.orchestra.run.smithi181.stdout:(27/150): rbd-nbd-19.1.1-207.gf273685f.el9.x86_ 2.2 MB/s | 170 kB 00:00 2024-08-25T23:50:06.452 INFO:teuthology.orchestra.run.smithi181.stdout:(28/150): ceph-grafana-dashboards-19.1.1-207.gf 545 kB/s | 32 kB 00:00 2024-08-25T23:50:06.464 INFO:teuthology.orchestra.run.smithi042.stdout:(4/150): ceph-base-19.1.1-207.gf273685f.el9.x86 6.8 MB/s | 5.4 MB 00:00 2024-08-25T23:50:06.470 INFO:teuthology.orchestra.run.smithi043.stdout:(1/150): ceph-19.1.1-207.gf273685f.el9.x86_64.r 32 kB/s | 6.5 kB 00:00 2024-08-25T23:50:06.520 INFO:teuthology.orchestra.run.smithi181.stdout:(29/150): rbd-mirror-19.1.1-207.gf273685f.el9.x 14 MB/s | 3.1 MB 00:00 2024-08-25T23:50:06.544 INFO:teuthology.orchestra.run.smithi181.stdout:(30/150): ceph-mgr-cephadm-19.1.1-207.gf273685f 1.6 MB/s | 146 kB 00:00 2024-08-25T23:50:06.614 INFO:teuthology.orchestra.run.smithi042.stdout:(5/150): ceph-mgr-19.1.1-207.gf273685f.el9.x86_ 10 MB/s | 1.5 MB 00:00 2024-08-25T23:50:06.756 INFO:teuthology.orchestra.run.smithi042.stdout:(6/150): ceph-mds-19.1.1-207.gf273685f.el9.x86_ 4.4 MB/s | 2.4 MB 00:00 2024-08-25T23:50:06.903 INFO:teuthology.orchestra.run.smithi181.stdout:(31/150): ceph-mgr-dashboard-19.1.1-207.gf27368 9.3 MB/s | 3.6 MB 00:00 2024-08-25T23:50:07.003 INFO:teuthology.orchestra.run.smithi181.stdout:(32/150): ceph-mgr-modules-core-19.1.1-207.gf27 2.4 MB/s | 249 kB 00:00 2024-08-25T23:50:07.095 INFO:teuthology.orchestra.run.smithi181.stdout:(33/150): ceph-mgr-rook-19.1.1-207.gf273685f.el 539 kB/s | 49 kB 00:00 2024-08-25T23:50:07.153 INFO:teuthology.orchestra.run.smithi043.stdout:(2/150): ceph-fuse-19.1.1-207.gf273685f.el9.x86 1.3 MB/s | 896 kB 00:00 2024-08-25T23:50:07.178 INFO:teuthology.orchestra.run.smithi181.stdout:(34/150): ceph-prometheus-alerts-19.1.1-207.gf2 197 kB/s | 16 kB 00:00 2024-08-25T23:50:07.189 INFO:teuthology.orchestra.run.smithi042.stdout:(7/150): ceph-mon-19.1.1-207.gf273685f.el9.x86_ 8.2 MB/s | 4.7 MB 00:00 2024-08-25T23:50:07.262 INFO:teuthology.orchestra.run.smithi043.stdout:(3/150): ceph-immutable-object-cache-19.1.1-207 1.3 MB/s | 145 kB 00:00 2024-08-25T23:50:07.262 INFO:teuthology.orchestra.run.smithi181.stdout:(35/150): ceph-mgr-diskprediction-local-19.1.1- 10 MB/s | 7.4 MB 00:00 2024-08-25T23:50:07.287 INFO:teuthology.orchestra.run.smithi181.stdout:(36/150): ceph-volume-19.1.1-207.gf273685f.el9. 2.6 MB/s | 285 kB 00:00 2024-08-25T23:50:07.363 INFO:teuthology.orchestra.run.smithi181.stdout:(37/150): cephadm-19.1.1-207.gf273685f.el9.noar 7.5 MB/s | 765 kB 00:00 2024-08-25T23:50:07.388 INFO:teuthology.orchestra.run.smithi181.stdout:(38/150): cephfs-top-19.1.1-207.gf273685f.el9.n 182 kB/s | 18 kB 00:00 2024-08-25T23:50:07.705 INFO:teuthology.orchestra.run.smithi181.stdout:(39/150): fuse-2.9.9-16.el9.x86_64.rpm 233 kB/s | 80 kB 00:00 2024-08-25T23:50:07.889 INFO:teuthology.orchestra.run.smithi181.stdout:(40/150): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-08-25T23:50:08.082 INFO:teuthology.orchestra.run.smithi042.stdout:(8/150): ceph-radosgw-19.1.1-207.gf273685f.el9. 12 MB/s | 11 MB 00:00 2024-08-25T23:50:08.121 INFO:teuthology.orchestra.run.smithi043.stdout:(4/150): ceph-mds-19.1.1-207.gf273685f.el9.x86_ 2.8 MB/s | 2.4 MB 00:00 2024-08-25T23:50:08.304 INFO:teuthology.orchestra.run.smithi043.stdout:(5/150): ceph-base-19.1.1-207.gf273685f.el9.x86 2.6 MB/s | 5.4 MB 00:02 2024-08-25T23:50:08.365 INFO:teuthology.orchestra.run.smithi042.stdout:(9/150): ceph-common-19.1.1-207.gf273685f.el9.x 7.9 MB/s | 21 MB 00:02 2024-08-25T23:50:08.390 INFO:teuthology.orchestra.run.smithi042.stdout:(10/150): ceph-selinux-19.1.1-207.gf273685f.el9 81 kB/s | 25 kB 00:00 2024-08-25T23:50:08.406 INFO:teuthology.orchestra.run.smithi181.stdout:(41/150): ceph-test-19.1.1-207.gf273685f.el9.x8 15 MB/s | 49 MB 00:03 2024-08-25T23:50:08.421 INFO:teuthology.orchestra.run.smithi043.stdout:(6/150): ceph-mgr-19.1.1-207.gf273685f.el9.x86_ 5.1 MB/s | 1.5 MB 00:00 2024-08-25T23:50:08.431 INFO:teuthology.orchestra.run.smithi181.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 467 kB/s | 253 kB 00:00 2024-08-25T23:50:08.441 INFO:teuthology.orchestra.run.smithi042.stdout:(11/150): cephfs-mirror-19.1.1-207.gf273685f.el 4.4 MB/s | 225 kB 00:00 2024-08-25T23:50:08.456 INFO:teuthology.orchestra.run.smithi181.stdout:(43/150): libgfortran-11.5.0-2.el9.x86_64.rpm 750 kB/s | 801 kB 00:01 2024-08-25T23:50:08.499 INFO:teuthology.orchestra.run.smithi042.stdout:(12/150): cephfs-shell-19.1.1-207.gf273685f.el9 467 kB/s | 27 kB 00:00 2024-08-25T23:50:08.556 INFO:teuthology.orchestra.run.smithi181.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 851 kB/s | 106 kB 00:00 2024-08-25T23:50:08.558 INFO:teuthology.orchestra.run.smithi042.stdout:(13/150): libcephfs-devel-19.1.1-207.gf273685f. 544 kB/s | 32 kB 00:00 2024-08-25T23:50:08.582 INFO:teuthology.orchestra.run.smithi181.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-08-25T23:50:08.665 INFO:teuthology.orchestra.run.smithi181.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-08-25T23:50:08.666 INFO:teuthology.orchestra.run.smithi042.stdout:(14/150): libcephfs2-19.1.1-207.gf273685f.el9.x 6.8 MB/s | 751 kB 00:00 2024-08-25T23:50:08.691 INFO:teuthology.orchestra.run.smithi181.stdout:(47/150): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-08-25T23:50:08.726 INFO:teuthology.orchestra.run.smithi042.stdout:(15/150): libcephsqlite-19.1.1-207.gf273685f.el 2.7 MB/s | 163 kB 00:00 2024-08-25T23:50:08.857 INFO:teuthology.orchestra.run.smithi181.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-08-25T23:50:08.899 INFO:teuthology.orchestra.run.smithi181.stdout:(49/150): bison-3.7.4-5.el9.x86_64.rpm 4.4 MB/s | 943 kB 00:00 2024-08-25T23:50:08.934 INFO:teuthology.orchestra.run.smithi042.stdout:(16/150): ceph-osd-19.1.1-207.gf273685f.el9.x86 7.7 MB/s | 17 MB 00:02 2024-08-25T23:50:08.950 INFO:teuthology.orchestra.run.smithi181.stdout:(50/150): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-08-25T23:50:08.959 INFO:teuthology.orchestra.run.smithi042.stdout:(17/150): librados-devel-19.1.1-207.gf273685f.e 543 kB/s | 127 kB 00:00 2024-08-25T23:50:09.000 INFO:teuthology.orchestra.run.smithi181.stdout:(51/150): elfutils-libelf-devel-0.191-4.el9.x86 216 kB/s | 22 kB 00:00 2024-08-25T23:50:09.009 INFO:teuthology.orchestra.run.smithi042.stdout:(18/150): libradosstriper1-19.1.1-207.gf273685f 6.6 MB/s | 506 kB 00:00 2024-08-25T23:50:09.030 INFO:teuthology.orchestra.run.smithi043.stdout:(7/150): ceph-mon-19.1.1-207.gf273685f.el9.x86_ 6.5 MB/s | 4.7 MB 00:00 2024-08-25T23:50:09.058 INFO:teuthology.orchestra.run.smithi181.stdout:(52/150): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-08-25T23:50:09.076 INFO:teuthology.orchestra.run.smithi042.stdout:(19/150): python3-ceph-argparse-19.1.1-207.gf27 680 kB/s | 45 kB 00:00 2024-08-25T23:50:09.101 INFO:teuthology.orchestra.run.smithi181.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 326 kB/s | 33 kB 00:00 2024-08-25T23:50:09.143 INFO:teuthology.orchestra.run.smithi042.stdout:(20/150): python3-ceph-common-19.1.1-207.gf2736 2.0 MB/s | 136 kB 00:00 2024-08-25T23:50:09.209 INFO:teuthology.orchestra.run.smithi181.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-08-25T23:50:09.210 INFO:teuthology.orchestra.run.smithi042.stdout:(21/150): python3-cephfs-19.1.1-207.gf273685f.e 2.4 MB/s | 162 kB 00:00 2024-08-25T23:50:09.318 INFO:teuthology.orchestra.run.smithi181.stdout:(55/150): libaio-devel-0.3.111-13.el9.x86_64.rp 103 kB/s | 11 kB 00:00 2024-08-25T23:50:09.322 INFO:teuthology.orchestra.run.smithi042.stdout:(22/150): librgw2-19.1.1-207.gf273685f.el9.x86_ 15 MB/s | 5.3 MB 00:00 2024-08-25T23:50:09.352 INFO:teuthology.orchestra.run.smithi042.stdout:(23/150): python3-rados-19.1.1-207.gf273685f.el 2.2 MB/s | 321 kB 00:00 2024-08-25T23:50:09.368 INFO:teuthology.orchestra.run.smithi181.stdout:(56/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.7 MB/s | 3.0 MB 00:00 2024-08-25T23:50:09.386 INFO:teuthology.orchestra.run.smithi042.stdout:(24/150): python3-rbd-19.1.1-207.gf273685f.el9. 4.6 MB/s | 301 kB 00:00 2024-08-25T23:50:09.410 INFO:teuthology.orchestra.run.smithi181.stdout:(57/150): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:01 2024-08-25T23:50:09.411 INFO:teuthology.orchestra.run.smithi042.stdout:(25/150): python3-rgw-19.1.1-207.gf273685f.el9. 1.7 MB/s | 99 kB 00:00 2024-08-25T23:50:09.427 INFO:teuthology.orchestra.run.smithi181.stdout:(58/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-08-25T23:50:09.445 INFO:teuthology.orchestra.run.smithi042.stdout:(26/150): rbd-fuse-19.1.1-207.gf273685f.el9.x86 1.4 MB/s | 85 kB 00:00 2024-08-25T23:50:09.460 INFO:teuthology.orchestra.run.smithi181.stdout:(59/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 491 kB/s | 45 kB 00:00 2024-08-25T23:50:09.503 INFO:teuthology.orchestra.run.smithi042.stdout:(27/150): rbd-nbd-19.1.1-207.gf273685f.el9.x86_ 2.9 MB/s | 170 kB 00:00 2024-08-25T23:50:09.520 INFO:teuthology.orchestra.run.smithi181.stdout:(60/150): librdkafka-1.6.1-102.el9.x86_64.rpm 5.9 MB/s | 662 kB 00:00 2024-08-25T23:50:09.545 INFO:teuthology.orchestra.run.smithi181.stdout:(61/150): libtool-2.4.6-46.el9.x86_64.rpm 4.8 MB/s | 581 kB 00:00 2024-08-25T23:50:09.562 INFO:teuthology.orchestra.run.smithi181.stdout:(62/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 252 kB/s | 25 kB 00:00 2024-08-25T23:50:09.562 INFO:teuthology.orchestra.run.smithi042.stdout:(28/150): ceph-grafana-dashboards-19.1.1-207.gf 548 kB/s | 32 kB 00:00 2024-08-25T23:50:09.620 INFO:teuthology.orchestra.run.smithi181.stdout:(63/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 472 kB/s | 47 kB 00:00 2024-08-25T23:50:09.621 INFO:teuthology.orchestra.run.smithi042.stdout:(29/150): ceph-mgr-cephadm-19.1.1-207.gf273685f 2.5 MB/s | 146 kB 00:00 2024-08-25T23:50:09.654 INFO:teuthology.orchestra.run.smithi181.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-08-25T23:50:09.696 INFO:teuthology.orchestra.run.smithi181.stdout:(65/150): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-08-25T23:50:09.704 INFO:teuthology.orchestra.run.smithi042.stdout:(30/150): rbd-mirror-19.1.1-207.gf273685f.el9.x 11 MB/s | 3.1 MB 00:00 2024-08-25T23:50:09.721 INFO:teuthology.orchestra.run.smithi181.stdout:(66/150): openblas-0.3.26-1.el9.x86_64.rpm 382 kB/s | 38 kB 00:00 2024-08-25T23:50:09.880 INFO:teuthology.orchestra.run.smithi042.stdout:(31/150): ceph-mgr-dashboard-19.1.1-207.gf27368 14 MB/s | 3.6 MB 00:00 2024-08-25T23:50:09.921 INFO:teuthology.orchestra.run.smithi181.stdout:(67/150): postgresql-13.16-1.el9.x86_64.rpm 7.9 MB/s | 1.6 MB 00:00 2024-08-25T23:50:09.938 INFO:teuthology.orchestra.run.smithi042.stdout:(32/150): ceph-mgr-modules-core-19.1.1-207.gf27 4.2 MB/s | 249 kB 00:00 2024-08-25T23:50:09.997 INFO:teuthology.orchestra.run.smithi042.stdout:(33/150): ceph-mgr-rook-19.1.1-207.gf273685f.el 848 kB/s | 49 kB 00:00 2024-08-25T23:50:10.047 INFO:teuthology.orchestra.run.smithi181.stdout:(68/150): postgresql-contrib-13.16-1.el9.x86_64 7.1 MB/s | 910 kB 00:00 2024-08-25T23:50:10.047 INFO:teuthology.orchestra.run.smithi042.stdout:(34/150): ceph-prometheus-alerts-19.1.1-207.gf2 331 kB/s | 16 kB 00:00 2024-08-25T23:50:10.114 INFO:teuthology.orchestra.run.smithi181.stdout:(69/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-08-25T23:50:10.114 INFO:teuthology.orchestra.run.smithi042.stdout:(35/150): ceph-volume-19.1.1-207.gf273685f.el9. 4.2 MB/s | 285 kB 00:00 2024-08-25T23:50:10.172 INFO:teuthology.orchestra.run.smithi181.stdout:(70/150): openblas-openmp-0.3.26-1.el9.x86_64.r 9.6 MB/s | 4.9 MB 00:00 2024-08-25T23:50:10.197 INFO:teuthology.orchestra.run.smithi181.stdout:(71/150): postgresql-private-libs-13.16-1.el9.x 913 kB/s | 137 kB 00:00 2024-08-25T23:50:10.198 INFO:teuthology.orchestra.run.smithi042.stdout:(36/150): cephadm-19.1.1-207.gf273685f.el9.noar 9.0 MB/s | 765 kB 00:00 2024-08-25T23:50:10.282 INFO:teuthology.orchestra.run.smithi042.stdout:(37/150): cephfs-top-19.1.1-207.gf273685f.el9.n 219 kB/s | 18 kB 00:00 2024-08-25T23:50:10.298 INFO:teuthology.orchestra.run.smithi181.stdout:(72/150): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-08-25T23:50:10.323 INFO:teuthology.orchestra.run.smithi181.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 698 kB/s | 87 kB 00:00 2024-08-25T23:50:10.431 INFO:teuthology.orchestra.run.smithi181.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 566 kB/s | 61 kB 00:00 2024-08-25T23:50:10.440 INFO:teuthology.orchestra.run.smithi042.stdout:(38/150): ceph-mgr-diskprediction-local-19.1.1- 10 MB/s | 7.4 MB 00:00 2024-08-25T23:50:10.540 INFO:teuthology.orchestra.run.smithi181.stdout:(75/150): python3-devel-3.9.19-7.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-08-25T23:50:10.630 INFO:teuthology.orchestra.run.smithi043.stdout:(8/150): ceph-radosgw-19.1.1-207.gf273685f.el9. 6.6 MB/s | 11 MB 00:01 2024-08-25T23:50:10.640 INFO:teuthology.orchestra.run.smithi181.stdout:(76/150): postgresql-server-13.16-1.el9.x86_64. 11 MB/s | 5.8 MB 00:00 2024-08-25T23:50:10.663 INFO:teuthology.orchestra.run.smithi043.stdout:(9/150): ceph-selinux-19.1.1-207.gf273685f.el9. 766 kB/s | 25 kB 00:00 2024-08-25T23:50:10.665 INFO:teuthology.orchestra.run.smithi181.stdout:(77/150): python3-jinja2-2.11.3-6.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-08-25T23:50:10.749 INFO:teuthology.orchestra.run.smithi181.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-08-25T23:50:10.774 INFO:teuthology.orchestra.run.smithi181.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-08-25T23:50:10.842 INFO:teuthology.orchestra.run.smithi181.stdout:(80/150): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2024-08-25T23:50:10.867 INFO:teuthology.orchestra.run.smithi181.stdout:(81/150): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-08-25T23:50:10.892 INFO:teuthology.orchestra.run.smithi181.stdout:(82/150): python3-markupsafe-1.1.1-12.el9.x86_6 296 kB/s | 35 kB 00:00 2024-08-25T23:50:10.941 INFO:teuthology.orchestra.run.smithi042.stdout:(39/150): ceph-test-19.1.1-207.gf273685f.el9.x8 19 MB/s | 49 MB 00:02 2024-08-25T23:50:10.976 INFO:teuthology.orchestra.run.smithi181.stdout:(83/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-08-25T23:50:11.001 INFO:teuthology.orchestra.run.smithi181.stdout:(84/150): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-08-25T23:50:11.076 INFO:teuthology.orchestra.run.smithi181.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 770 kB/s | 77 kB 00:00 2024-08-25T23:50:11.101 INFO:teuthology.orchestra.run.smithi181.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 422 kB/s | 42 kB 00:00 2024-08-25T23:50:11.139 INFO:teuthology.orchestra.run.smithi043.stdout:(10/150): ceph-osd-19.1.1-207.gf273685f.el9.x86 6.2 MB/s | 17 MB 00:02 2024-08-25T23:50:11.185 INFO:teuthology.orchestra.run.smithi181.stdout:(87/150): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-08-25T23:50:11.202 INFO:teuthology.orchestra.run.smithi181.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-08-25T23:50:11.277 INFO:teuthology.orchestra.run.smithi181.stdout:(89/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-08-25T23:50:11.303 INFO:teuthology.orchestra.run.smithi181.stdout:(90/150): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-08-25T23:50:11.320 INFO:teuthology.orchestra.run.smithi181.stdout:(91/150): python3-pytz-2021.1-5.el9.noarch.rpm 434 kB/s | 51 kB 00:00 2024-08-25T23:50:11.378 INFO:teuthology.orchestra.run.smithi181.stdout:(92/150): python3-requests-oauthlib-1.3.0-12.el 532 kB/s | 54 kB 00:00 2024-08-25T23:50:11.389 INFO:teuthology.orchestra.run.smithi043.stdout:(11/150): ceph-common-19.1.1-207.gf273685f.el9. 4.1 MB/s | 21 MB 00:05 2024-08-25T23:50:11.414 INFO:teuthology.orchestra.run.smithi043.stdout:(12/150): cephfs-mirror-19.1.1-207.gf273685f.el 819 kB/s | 225 kB 00:00 2024-08-25T23:50:11.420 INFO:teuthology.orchestra.run.smithi181.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-08-25T23:50:11.431 INFO:teuthology.orchestra.run.smithi043.stdout:(13/150): cephfs-shell-19.1.1-207.gf273685f.el9 651 kB/s | 27 kB 00:00 2024-08-25T23:50:11.433 INFO:teuthology.orchestra.run.smithi042.stdout:(40/150): fuse-2.9.9-16.el9.x86_64.rpm 69 kB/s | 80 kB 00:01 2024-08-25T23:50:11.448 INFO:teuthology.orchestra.run.smithi043.stdout:(14/150): libcephfs-devel-19.1.1-207.gf273685f. 946 kB/s | 32 kB 00:00 2024-08-25T23:50:11.479 INFO:teuthology.orchestra.run.smithi181.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 441 kB/s | 44 kB 00:00 2024-08-25T23:50:11.515 INFO:teuthology.orchestra.run.smithi043.stdout:(15/150): libcephsqlite-19.1.1-207.gf273685f.el 2.4 MB/s | 163 kB 00:00 2024-08-25T23:50:11.529 INFO:teuthology.orchestra.run.smithi181.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-08-25T23:50:11.565 INFO:teuthology.orchestra.run.smithi043.stdout:(16/150): librados-devel-19.1.1-207.gf273685f.e 2.5 MB/s | 127 kB 00:00 2024-08-25T23:50:11.579 INFO:teuthology.orchestra.run.smithi181.stdout:(96/150): qatlib-service-24.02.0-1.el9.x86_64.r 358 kB/s | 36 kB 00:00 2024-08-25T23:50:11.599 INFO:teuthology.orchestra.run.smithi043.stdout:(17/150): libcephfs2-19.1.1-207.gf273685f.el9.x 4.4 MB/s | 751 kB 00:00 2024-08-25T23:50:11.621 INFO:teuthology.orchestra.run.smithi181.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 516 kB/s | 47 kB 00:00 2024-08-25T23:50:11.666 INFO:teuthology.orchestra.run.smithi043.stdout:(18/150): libradosstriper1-19.1.1-207.gf273685f 4.9 MB/s | 506 kB 00:00 2024-08-25T23:50:11.688 INFO:teuthology.orchestra.run.smithi181.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-08-25T23:50:11.714 INFO:teuthology.orchestra.run.smithi181.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 629 kB/s | 58 kB 00:00 2024-08-25T23:50:11.716 INFO:teuthology.orchestra.run.smithi043.stdout:(19/150): python3-ceph-argparse-19.1.1-207.gf27 907 kB/s | 45 kB 00:00 2024-08-25T23:50:11.733 INFO:teuthology.orchestra.run.smithi042.stdout:(41/150): libquadmath-11.5.0-2.el9.x86_64.rpm 241 kB/s | 191 kB 00:00 2024-08-25T23:50:11.767 INFO:teuthology.orchestra.run.smithi043.stdout:(20/150): python3-ceph-common-19.1.1-207.gf2736 2.7 MB/s | 136 kB 00:00 2024-08-25T23:50:11.797 INFO:teuthology.orchestra.run.smithi181.stdout:(100/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 882 kB/s | 96 kB 00:00 2024-08-25T23:50:11.814 INFO:teuthology.orchestra.run.smithi181.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 636 kB/s | 64 kB 00:00 2024-08-25T23:50:11.816 INFO:teuthology.orchestra.run.smithi042.stdout:(42/150): libgfortran-11.5.0-2.el9.x86_64.rpm 582 kB/s | 801 kB 00:01 2024-08-25T23:50:11.817 INFO:teuthology.orchestra.run.smithi043.stdout:(21/150): python3-cephfs-19.1.1-207.gf273685f.e 3.2 MB/s | 162 kB 00:00 2024-08-25T23:50:11.881 INFO:teuthology.orchestra.run.smithi181.stdout:(102/150): lua-devel-5.4.4-4.el9.x86_64.rpm 335 kB/s | 22 kB 00:00 2024-08-25T23:50:11.884 INFO:teuthology.orchestra.run.smithi043.stdout:(22/150): python3-rados-19.1.1-207.gf273685f.el 4.7 MB/s | 321 kB 00:00 2024-08-25T23:50:11.898 INFO:teuthology.orchestra.run.smithi181.stdout:(103/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 446 kB/s | 45 kB 00:00 2024-08-25T23:50:11.949 INFO:teuthology.orchestra.run.smithi181.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-08-25T23:50:11.959 INFO:teuthology.orchestra.run.smithi043.stdout:(23/150): python3-rbd-19.1.1-207.gf273685f.el9. 3.9 MB/s | 301 kB 00:00 2024-08-25T23:50:11.982 INFO:teuthology.orchestra.run.smithi181.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-08-25T23:50:11.999 INFO:teuthology.orchestra.run.smithi181.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-08-25T23:50:12.009 INFO:teuthology.orchestra.run.smithi043.stdout:(24/150): python3-rgw-19.1.1-207.gf273685f.el9. 1.9 MB/s | 99 kB 00:00 2024-08-25T23:50:12.049 INFO:teuthology.orchestra.run.smithi181.stdout:(107/150): protobuf-compiler-3.14.0-13.el9.x86_ 5.0 MB/s | 863 kB 00:00 2024-08-25T23:50:12.060 INFO:teuthology.orchestra.run.smithi043.stdout:(25/150): rbd-fuse-19.1.1-207.gf273685f.el9.x86 1.7 MB/s | 85 kB 00:00 2024-08-25T23:50:12.091 INFO:teuthology.orchestra.run.smithi181.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 627 kB/s | 26 kB 00:00 2024-08-25T23:50:12.116 INFO:teuthology.orchestra.run.smithi181.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-25T23:50:12.175 INFO:teuthology.orchestra.run.smithi181.stdout:(110/150): libarrow-9.0.0-11.el9.x86_64.rpm 25 MB/s | 4.4 MB 00:00 2024-08-25T23:50:12.200 INFO:teuthology.orchestra.run.smithi181.stdout:(111/150): libunwind-1.6.2-1.el9.x86_64.rpm 805 kB/s | 67 kB 00:00 2024-08-25T23:50:12.216 INFO:teuthology.orchestra.run.smithi042.stdout:(43/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 323 kB/s | 253 kB 00:00 2024-08-25T23:50:12.225 INFO:teuthology.orchestra.run.smithi181.stdout:(112/150): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-08-25T23:50:12.260 INFO:teuthology.orchestra.run.smithi043.stdout:(26/150): librgw2-19.1.1-207.gf273685f.el9.x86_ 8.1 MB/s | 5.3 MB 00:00 2024-08-25T23:50:12.268 INFO:teuthology.orchestra.run.smithi181.stdout:(113/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-08-25T23:50:12.293 INFO:teuthology.orchestra.run.smithi181.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-25T23:50:12.310 INFO:teuthology.orchestra.run.smithi043.stdout:(27/150): rbd-nbd-19.1.1-207.gf273685f.el9.x86_ 3.3 MB/s | 170 kB 00:00 2024-08-25T23:50:12.318 INFO:teuthology.orchestra.run.smithi181.stdout:(115/150): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-08-25T23:50:12.343 INFO:teuthology.orchestra.run.smithi181.stdout:(116/150): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-08-25T23:50:12.360 INFO:teuthology.orchestra.run.smithi043.stdout:(28/150): ceph-grafana-dashboards-19.1.1-207.gf 638 kB/s | 32 kB 00:00 2024-08-25T23:50:12.369 INFO:teuthology.orchestra.run.smithi181.stdout:(117/150): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-08-25T23:50:12.394 INFO:teuthology.orchestra.run.smithi181.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-08-25T23:50:12.411 INFO:teuthology.orchestra.run.smithi043.stdout:(29/150): ceph-mgr-cephadm-19.1.1-207.gf273685f 2.9 MB/s | 146 kB 00:00 2024-08-25T23:50:12.420 INFO:teuthology.orchestra.run.smithi181.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 6.9 MB/s | 358 kB 00:00 2024-08-25T23:50:12.445 INFO:teuthology.orchestra.run.smithi181.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-08-25T23:50:12.470 INFO:teuthology.orchestra.run.smithi181.stdout:(121/150): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-08-25T23:50:12.487 INFO:teuthology.orchestra.run.smithi181.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 8.5 MB/s | 144 kB 00:00 2024-08-25T23:50:12.494 INFO:teuthology.orchestra.run.smithi043.stdout:(30/150): rbd-mirror-19.1.1-207.gf273685f.el9.x 7.1 MB/s | 3.1 MB 00:00 2024-08-25T23:50:12.512 INFO:teuthology.orchestra.run.smithi181.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-08-25T23:50:12.517 INFO:teuthology.orchestra.run.smithi042.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 152 kB/s | 106 kB 00:00 2024-08-25T23:50:12.537 INFO:teuthology.orchestra.run.smithi181.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-08-25T23:50:12.579 INFO:teuthology.orchestra.run.smithi181.stdout:(125/150): python3-jaraco-collections-3.0.0-8.e 557 kB/s | 23 kB 00:00 2024-08-25T23:50:12.605 INFO:teuthology.orchestra.run.smithi181.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 772 kB/s | 19 kB 00:00 2024-08-25T23:50:12.630 INFO:teuthology.orchestra.run.smithi181.stdout:(127/150): python3-jaraco-text-3.2.0-6.el9.noar 791 kB/s | 20 kB 00:00 2024-08-25T23:50:12.759 INFO:teuthology.orchestra.run.smithi042.stdout:(45/150): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:01 2024-08-25T23:50:12.789 INFO:teuthology.orchestra.run.smithi181.stdout:(128/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-08-25T23:50:12.831 INFO:teuthology.orchestra.run.smithi181.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-08-25T23:50:12.845 INFO:teuthology.orchestra.run.smithi043.stdout:(31/150): ceph-mgr-dashboard-19.1.1-207.gf27368 8.2 MB/s | 3.6 MB 00:00 2024-08-25T23:50:12.848 INFO:teuthology.orchestra.run.smithi181.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 4.7 MB/s | 79 kB 00:00 2024-08-25T23:50:12.864 INFO:teuthology.orchestra.run.smithi181.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-08-25T23:50:12.890 INFO:teuthology.orchestra.run.smithi181.stdout:(132/150): python3-kubernetes-26.1.0-2.el9.noar 3.9 MB/s | 1.0 MB 00:00 2024-08-25T23:50:12.907 INFO:teuthology.orchestra.run.smithi181.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 992 kB/s | 16 kB 00:00 2024-08-25T23:50:12.912 INFO:teuthology.orchestra.run.smithi043.stdout:(32/150): ceph-mgr-modules-core-19.1.1-207.gf27 3.7 MB/s | 249 kB 00:00 2024-08-25T23:50:12.958 INFO:teuthology.orchestra.run.smithi181.stdout:(134/150): python3-grpcio-1.46.7-10.el9.x86_64. 4.0 MB/s | 2.0 MB 00:00 2024-08-25T23:50:12.959 INFO:teuthology.orchestra.run.smithi042.stdout:(46/150): python3-pycparser-2.20-6.el9.noarch.r 182 kB/s | 135 kB 00:00 2024-08-25T23:50:12.962 INFO:teuthology.orchestra.run.smithi043.stdout:(33/150): ceph-mgr-rook-19.1.1-207.gf273685f.el 993 kB/s | 49 kB 00:00 2024-08-25T23:50:12.982 INFO:teuthology.orchestra.run.smithi181.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-08-25T23:50:13.000 INFO:teuthology.orchestra.run.smithi181.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 679 kB/s | 28 kB 00:00 2024-08-25T23:50:13.004 INFO:teuthology.orchestra.run.smithi043.stdout:(34/150): ceph-prometheus-alerts-19.1.1-207.gf2 394 kB/s | 16 kB 00:00 2024-08-25T23:50:13.025 INFO:teuthology.orchestra.run.smithi181.stdout:(137/150): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-08-25T23:50:13.042 INFO:teuthology.orchestra.run.smithi181.stdout:(138/150): python3-repoze-lru-0.7-16.el9.noarch 522 kB/s | 31 kB 00:00 2024-08-25T23:50:13.058 INFO:teuthology.orchestra.run.smithi181.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-08-25T23:50:13.071 INFO:teuthology.orchestra.run.smithi043.stdout:(35/150): ceph-volume-19.1.1-207.gf273685f.el9. 4.2 MB/s | 285 kB 00:00 2024-08-25T23:50:13.075 INFO:teuthology.orchestra.run.smithi181.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-08-25T23:50:13.101 INFO:teuthology.orchestra.run.smithi181.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-08-25T23:50:13.150 INFO:teuthology.orchestra.run.smithi181.stdout:(142/150): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-08-25T23:50:13.176 INFO:teuthology.orchestra.run.smithi181.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-08-25T23:50:13.196 INFO:teuthology.orchestra.run.smithi043.stdout:(36/150): cephadm-19.1.1-207.gf273685f.el9.noar 6.0 MB/s | 765 kB 00:00 2024-08-25T23:50:13.202 INFO:teuthology.orchestra.run.smithi181.stdout:(144/150): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-08-25T23:50:13.227 INFO:teuthology.orchestra.run.smithi181.stdout:(145/150): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-08-25T23:50:13.230 INFO:teuthology.orchestra.run.smithi043.stdout:(37/150): cephfs-top-19.1.1-207.gf273685f.el9.n 546 kB/s | 18 kB 00:00 2024-08-25T23:50:13.242 INFO:teuthology.orchestra.run.smithi042.stdout:(47/150): python3-requests-2.25.1-8.el9.noarch. 172 kB/s | 125 kB 00:00 2024-08-25T23:50:13.252 INFO:teuthology.orchestra.run.smithi181.stdout:(146/150): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-08-25T23:50:13.278 INFO:teuthology.orchestra.run.smithi181.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-08-25T23:50:13.322 INFO:teuthology.orchestra.run.smithi043.stdout:(38/150): ceph-mgr-diskprediction-local-19.1.1- 9.0 MB/s | 7.4 MB 00:00 2024-08-25T23:50:13.336 INFO:teuthology.orchestra.run.smithi181.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-08-25T23:50:13.489 INFO:teuthology.orchestra.run.smithi043.stdout:(39/150): fuse-2.9.9-16.el9.x86_64.rpm 309 kB/s | 80 kB 00:00 2024-08-25T23:50:13.511 INFO:teuthology.orchestra.run.smithi181.stdout:(149/150): librados2-19.1.1-207.gf273685f.el9.x 13 MB/s | 3.4 MB 00:00 2024-08-25T23:50:13.517 INFO:teuthology.orchestra.run.smithi042.stdout:(48/150): python3-urllib3-1.26.5-6.el9.noarch.r 288 kB/s | 215 kB 00:00 2024-08-25T23:50:13.556 INFO:teuthology.orchestra.run.smithi043.stdout:(40/150): libquadmath-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-08-25T23:50:13.570 INFO:teuthology.orchestra.run.smithi181.stdout:(150/150): librbd1-19.1.1-207.gf273685f.el9.x86 11 MB/s | 3.2 MB 00:00 2024-08-25T23:50:13.576 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-08-25T23:50:13.576 INFO:teuthology.orchestra.run.smithi181.stdout:Total 22 MB/s | 218 MB 00:10 2024-08-25T23:50:13.597 INFO:teuthology.orchestra.run.smithi043.stdout:(41/150): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-08-25T23:50:13.623 INFO:teuthology.orchestra.run.smithi043.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-08-25T23:50:13.665 INFO:teuthology.orchestra.run.smithi043.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-08-25T23:50:13.732 INFO:teuthology.orchestra.run.smithi043.stdout:(44/150): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-08-25T23:50:13.791 INFO:teuthology.orchestra.run.smithi043.stdout:(45/150): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-08-25T23:50:13.818 INFO:teuthology.orchestra.run.smithi042.stdout:(49/150): automake-1.16.2-8.el9.noarch.rpm 803 kB/s | 689 kB 00:00 2024-08-25T23:50:13.883 INFO:teuthology.orchestra.run.smithi043.stdout:(46/150): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-08-25T23:50:13.933 INFO:teuthology.orchestra.run.smithi043.stdout:(47/150): python3-cryptography-36.0.1-4.el9.x86 3.7 MB/s | 1.2 MB 00:00 2024-08-25T23:50:14.000 INFO:teuthology.orchestra.run.smithi043.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 5.8 MB/s | 689 kB 00:00 2024-08-25T23:50:14.059 INFO:teuthology.orchestra.run.smithi043.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-08-25T23:50:14.101 INFO:teuthology.orchestra.run.smithi043.stdout:(50/150): elfutils-libelf-devel-0.191-4.el9.x86 523 kB/s | 22 kB 00:00 2024-08-25T23:50:14.134 INFO:teuthology.orchestra.run.smithi043.stdout:(51/150): bison-3.7.4-5.el9.x86_64.rpm 4.6 MB/s | 943 kB 00:00 2024-08-25T23:50:14.160 INFO:teuthology.orchestra.run.smithi042.stdout:(50/150): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-08-25T23:50:14.176 INFO:teuthology.orchestra.run.smithi043.stdout:(52/150): flexiblas-3.0.4-8.el9.x86_64.rpm 783 kB/s | 33 kB 00:00 2024-08-25T23:50:14.193 INFO:teuthology.orchestra.run.smithi042.stdout:(51/150): boost-program-options-1.75.0-8.el9.x8 158 kB/s | 107 kB 00:00 2024-08-25T23:50:14.202 INFO:teuthology.orchestra.run.smithi043.stdout:(53/150): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 313 kB 00:00 2024-08-25T23:50:14.244 INFO:teuthology.orchestra.run.smithi043.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 438 kB/s | 18 kB 00:00 2024-08-25T23:50:14.286 INFO:teuthology.orchestra.run.smithi043.stdout:(55/150): libaio-devel-0.3.111-13.el9.x86_64.rp 268 kB/s | 11 kB 00:00 2024-08-25T23:50:14.353 INFO:teuthology.orchestra.run.smithi043.stdout:(56/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 160 kB 00:00 2024-08-25T23:50:14.360 INFO:teuthology.orchestra.run.smithi042.stdout:(52/150): elfutils-libelf-devel-0.191-4.el9.x86 40 kB/s | 22 kB 00:00 2024-08-25T23:50:14.395 INFO:teuthology.orchestra.run.smithi043.stdout:(57/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-08-25T23:50:14.595 INFO:teuthology.orchestra.run.smithi043.stdout:(58/150): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-08-25T23:50:14.683 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-08-25T23:50:14.760 INFO:teuthology.orchestra.run.smithi042.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 58 kB/s | 33 kB 00:00 2024-08-25T23:50:14.787 INFO:teuthology.orchestra.run.smithi043.stdout:(59/150): libtool-2.4.6-46.el9.x86_64.rpm 3.0 MB/s | 581 kB 00:00 2024-08-25T23:50:14.809 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-08-25T23:50:14.809 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-08-25T23:50:14.829 INFO:teuthology.orchestra.run.smithi043.stdout:(60/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 613 kB/s | 25 kB 00:00 2024-08-25T23:50:14.871 INFO:teuthology.orchestra.run.smithi043.stdout:(61/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-08-25T23:50:14.936 INFO:teuthology.orchestra.run.smithi042.stdout:(54/150): flex-2.6.4-9.el9.x86_64.rpm 404 kB/s | 313 kB 00:00 2024-08-25T23:50:14.979 INFO:teuthology.orchestra.run.smithi043.stdout:(62/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-08-25T23:50:15.055 INFO:teuthology.orchestra.run.smithi043.stdout:(63/150): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-08-25T23:50:15.113 INFO:teuthology.orchestra.run.smithi043.stdout:(64/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.2 MB/s | 3.0 MB 00:00 2024-08-25T23:50:15.130 INFO:teuthology.orchestra.run.smithi043.stdout:(65/150): openblas-0.3.26-1.el9.x86_64.rpm 511 kB/s | 38 kB 00:00 2024-08-25T23:50:15.270 INFO:teuthology.orchestra.run.smithi042.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 36 kB/s | 18 kB 00:00 2024-08-25T23:50:15.420 INFO:teuthology.orchestra.run.smithi042.stdout:(56/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-08-25T23:50:15.487 INFO:teuthology.orchestra.run.smithi042.stdout:(57/150): libaio-devel-0.3.111-13.el9.x86_64.rp 20 kB/s | 11 kB 00:00 2024-08-25T23:50:15.748 INFO:teuthology.orchestra.run.smithi043.stdout:(66/150): ceph-test-19.1.1-207.gf273685f.el9.x8 9.6 MB/s | 49 MB 00:05 2024-08-25T23:50:16.004 INFO:teuthology.orchestra.run.smithi042.stdout:(58/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 219 kB/s | 160 kB 00:00 2024-08-25T23:50:16.071 INFO:teuthology.orchestra.run.smithi042.stdout:(59/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 70 kB/s | 45 kB 00:00 2024-08-25T23:50:16.123 INFO:teuthology.orchestra.run.smithi043.stdout:(67/150): postgresql-13.16-1.el9.x86_64.rpm 4.2 MB/s | 1.6 MB 00:00 2024-08-25T23:50:16.330 INFO:teuthology.orchestra.run.smithi042.stdout:(60/150): librdkafka-1.6.1-102.el9.x86_64.rpm 787 kB/s | 662 kB 00:00 2024-08-25T23:50:16.390 INFO:teuthology.orchestra.run.smithi043.stdout:(68/150): postgresql-contrib-13.16-1.el9.x86_64 3.3 MB/s | 910 kB 00:00 2024-08-25T23:50:16.456 INFO:teuthology.orchestra.run.smithi043.stdout:(69/150): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-08-25T23:50:16.532 INFO:teuthology.orchestra.run.smithi043.stdout:(70/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 3.2 MB/s | 4.4 MB 00:01 2024-08-25T23:50:16.544 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-08-25T23:50:16.547 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-08-25T23:50:16.613 INFO:teuthology.orchestra.run.smithi042.stdout:(61/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 47 kB/s | 25 kB 00:00 2024-08-25T23:50:16.682 INFO:teuthology.orchestra.run.smithi043.stdout:(71/150): openblas-openmp-0.3.26-1.el9.x86_64.r 3.2 MB/s | 4.9 MB 00:01 2024-08-25T23:50:16.741 INFO:teuthology.orchestra.run.smithi043.stdout:(72/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-08-25T23:50:16.774 INFO:teuthology.orchestra.run.smithi043.stdout:(73/150): protobuf-3.14.0-13.el9.x86_64.rpm 4.2 MB/s | 1.0 MB 00:00 2024-08-25T23:50:16.808 INFO:teuthology.orchestra.run.smithi043.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-08-25T23:50:16.850 INFO:teuthology.orchestra.run.smithi043.stdout:(75/150): python3-devel-3.9.19-7.el9.x86_64.rpm 5.8 MB/s | 245 kB 00:00 2024-08-25T23:50:16.872 INFO:teuthology.orchestra.run.smithi042.stdout:(62/150): libtool-2.4.6-46.el9.x86_64.rpm 671 kB/s | 581 kB 00:00 2024-08-25T23:50:16.892 INFO:teuthology.orchestra.run.smithi043.stdout:(76/150): python3-jinja2-2.11.3-6.el9.noarch.rp 5.8 MB/s | 248 kB 00:00 2024-08-25T23:50:16.906 INFO:teuthology.orchestra.run.smithi042.stdout:(63/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 83 kB/s | 47 kB 00:00 2024-08-25T23:50:16.925 INFO:teuthology.orchestra.run.smithi043.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 771 kB/s | 26 kB 00:00 2024-08-25T23:50:16.959 INFO:teuthology.orchestra.run.smithi043.stdout:(78/150): python3-jsonpointer-2.0-4.el9.noarch. 577 kB/s | 19 kB 00:00 2024-08-25T23:50:17.001 INFO:teuthology.orchestra.run.smithi043.stdout:(79/150): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-08-25T23:50:17.051 INFO:teuthology.orchestra.run.smithi043.stdout:(80/150): python3-markupsafe-1.1.1-12.el9.x86_6 691 kB/s | 35 kB 00:00 2024-08-25T23:50:17.406 INFO:teuthology.orchestra.run.smithi042.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 369 kB/s | 292 kB 00:00 2024-08-25T23:50:17.523 INFO:teuthology.orchestra.run.smithi042.stdout:(65/150): openblas-0.3.26-1.el9.x86_64.rpm 62 kB/s | 38 kB 00:00 2024-08-25T23:50:17.656 INFO:teuthology.orchestra.run.smithi042.stdout:(66/150): lua-5.4.4-4.el9.x86_64.rpm 241 kB/s | 188 kB 00:00 2024-08-25T23:50:17.952 INFO:teuthology.orchestra.run.smithi043.stdout:(81/150): postgresql-server-13.16-1.el9.x86_64. 3.9 MB/s | 5.8 MB 00:01 2024-08-25T23:50:18.035 INFO:teuthology.orchestra.run.smithi043.stdout:(82/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-08-25T23:50:18.127 INFO:teuthology.orchestra.run.smithi043.stdout:(83/150): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-08-25T23:50:18.186 INFO:teuthology.orchestra.run.smithi043.stdout:(84/150): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-08-25T23:50:18.228 INFO:teuthology.orchestra.run.smithi043.stdout:(85/150): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-08-25T23:50:18.328 INFO:teuthology.orchestra.run.smithi043.stdout:(86/150): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-08-25T23:50:18.395 INFO:teuthology.orchestra.run.smithi043.stdout:(87/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.8 MB/s | 5.1 MB 00:01 2024-08-25T23:50:18.437 INFO:teuthology.orchestra.run.smithi043.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-08-25T23:50:18.479 INFO:teuthology.orchestra.run.smithi043.stdout:(89/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-08-25T23:50:18.490 INFO:teuthology.orchestra.run.smithi042.stdout:(67/150): openblas-openmp-0.3.26-1.el9.x86_64.r 4.6 MB/s | 4.9 MB 00:01 2024-08-25T23:50:18.554 INFO:teuthology.orchestra.run.smithi043.stdout:(90/150): python3-babel-2.9.1-2.el9.noarch.rpm 3.3 MB/s | 6.0 MB 00:01 2024-08-25T23:50:18.579 INFO:teuthology.orchestra.run.smithi043.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 535 kB/s | 54 kB 00:00 2024-08-25T23:50:18.613 INFO:teuthology.orchestra.run.smithi043.stdout:(92/150): python3-pyasn1-modules-0.4.8-6.el9.no 1.3 MB/s | 279 kB 00:00 2024-08-25T23:50:18.638 INFO:teuthology.orchestra.run.smithi043.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-08-25T23:50:18.640 INFO:teuthology.orchestra.run.smithi042.stdout:(68/150): postgresql-13.16-1.el9.x86_64.rpm 1.6 MB/s | 1.6 MB 00:00 2024-08-25T23:50:18.663 INFO:teuthology.orchestra.run.smithi043.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 880 kB/s | 44 kB 00:00 2024-08-25T23:50:18.705 INFO:teuthology.orchestra.run.smithi043.stdout:(95/150): qatlib-service-24.02.0-1.el9.x86_64.r 862 kB/s | 36 kB 00:00 2024-08-25T23:50:18.732 INFO:teuthology.orchestra.run.smithi042.stdout:(69/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-08-25T23:50:18.750 INFO:teuthology.orchestra.run.smithi043.stdout:(96/150): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-08-25T23:50:18.773 INFO:teuthology.orchestra.run.smithi043.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 707 kB/s | 47 kB 00:00 2024-08-25T23:50:18.815 INFO:teuthology.orchestra.run.smithi043.stdout:(98/150): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-08-25T23:50:18.874 INFO:teuthology.orchestra.run.smithi043.stdout:(99/150): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-08-25T23:50:18.899 INFO:teuthology.orchestra.run.smithi043.stdout:(100/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-08-25T23:50:18.941 INFO:teuthology.orchestra.run.smithi043.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 953 kB/s | 64 kB 00:00 2024-08-25T23:50:18.966 INFO:teuthology.orchestra.run.smithi043.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 671 kB/s | 45 kB 00:00 2024-08-25T23:50:19.367 INFO:teuthology.orchestra.run.smithi042.stdout:(70/150): postgresql-private-libs-13.16-1.el9.x 189 kB/s | 137 kB 00:00 2024-08-25T23:50:19.416 INFO:teuthology.orchestra.run.smithi042.stdout:(71/150): postgresql-contrib-13.16-1.el9.x86_64 983 kB/s | 910 kB 00:00 2024-08-25T23:50:19.508 INFO:teuthology.orchestra.run.smithi043.stdout:(103/150): lua-devel-5.4.4-4.el9.x86_64.rpm 39 kB/s | 22 kB 00:00 2024-08-25T23:50:19.558 INFO:teuthology.orchestra.run.smithi043.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-08-25T23:50:19.583 INFO:teuthology.orchestra.run.smithi043.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-08-25T23:50:19.609 INFO:teuthology.orchestra.run.smithi043.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 777 kB/s | 19 kB 00:00 2024-08-25T23:50:19.718 INFO:teuthology.orchestra.run.smithi043.stdout:(107/150): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-08-25T23:50:19.743 INFO:teuthology.orchestra.run.smithi043.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-08-25T23:50:19.768 INFO:teuthology.orchestra.run.smithi043.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-25T23:50:19.794 INFO:teuthology.orchestra.run.smithi043.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-08-25T23:50:19.819 INFO:teuthology.orchestra.run.smithi043.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-08-25T23:50:19.878 INFO:teuthology.orchestra.run.smithi043.stdout:(112/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-08-25T23:50:19.911 INFO:teuthology.orchestra.run.smithi043.stdout:(113/150): protobuf-compiler-3.14.0-13.el9.x86_ 913 kB/s | 863 kB 00:00 2024-08-25T23:50:19.925 INFO:teuthology.orchestra.run.smithi042.stdout:(72/150): postgresql-server-13.16-1.el9.x86_64. 4.9 MB/s | 5.8 MB 00:01 2024-08-25T23:50:19.953 INFO:teuthology.orchestra.run.smithi043.stdout:(114/150): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-08-25T23:50:19.970 INFO:teuthology.orchestra.run.smithi043.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 2.2 MB/s | 32 kB 00:00 2024-08-25T23:50:19.987 INFO:teuthology.orchestra.run.smithi043.stdout:(116/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 575 kB/s | 43 kB 00:00 2024-08-25T23:50:20.004 INFO:teuthology.orchestra.run.smithi043.stdout:(117/150): python3-certifi-2023.05.07-4.el9.noa 419 kB/s | 14 kB 00:00 2024-08-25T23:50:20.029 INFO:teuthology.orchestra.run.smithi043.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-08-25T23:50:20.059 INFO:teuthology.orchestra.run.smithi042.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 136 kB/s | 87 kB 00:00 2024-08-25T23:50:20.063 INFO:teuthology.orchestra.run.smithi043.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-08-25T23:50:20.088 INFO:teuthology.orchestra.run.smithi043.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-08-25T23:50:20.113 INFO:teuthology.orchestra.run.smithi043.stdout:(121/150): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-08-25T23:50:20.139 INFO:teuthology.orchestra.run.smithi043.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-08-25T23:50:20.164 INFO:teuthology.orchestra.run.smithi043.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-08-25T23:50:20.189 INFO:teuthology.orchestra.run.smithi043.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-08-25T23:50:20.215 INFO:teuthology.orchestra.run.smithi043.stdout:(125/150): python3-jaraco-collections-3.0.0-8.e 933 kB/s | 23 kB 00:00 2024-08-25T23:50:20.240 INFO:teuthology.orchestra.run.smithi043.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 779 kB/s | 19 kB 00:00 2024-08-25T23:50:20.265 INFO:teuthology.orchestra.run.smithi043.stdout:(127/150): python3-jaraco-text-3.2.0-6.el9.noar 791 kB/s | 20 kB 00:00 2024-08-25T23:50:20.316 INFO:teuthology.orchestra.run.smithi043.stdout:(128/150): python3-kubernetes-26.1.0-2.el9.noar 20 MB/s | 1.0 MB 00:00 2024-08-25T23:50:20.341 INFO:teuthology.orchestra.run.smithi043.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-25T23:50:20.366 INFO:teuthology.orchestra.run.smithi043.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-25T23:50:20.367 INFO:teuthology.orchestra.run.smithi042.stdout:(74/150): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:00 2024-08-25T23:50:20.391 INFO:teuthology.orchestra.run.smithi043.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-25T23:50:20.442 INFO:teuthology.orchestra.run.smithi043.stdout:(132/150): python3-grpcio-1.46.7-10.el9.x86_64. 5.8 MB/s | 2.0 MB 00:00 2024-08-25T23:50:20.467 INFO:teuthology.orchestra.run.smithi043.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-08-25T23:50:20.493 INFO:teuthology.orchestra.run.smithi043.stdout:(134/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-25T23:50:20.518 INFO:teuthology.orchestra.run.smithi043.stdout:(135/150): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-08-25T23:50:20.668 INFO:teuthology.orchestra.run.smithi043.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 161 kB/s | 28 kB 00:00 2024-08-25T23:50:20.684 INFO:teuthology.orchestra.run.smithi042.stdout:(75/150): python3-colorama-0.4.6-3.el9.noarch.r 98 kB/s | 61 kB 00:00 2024-08-25T23:50:20.694 INFO:teuthology.orchestra.run.smithi043.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 175 kB/s | 31 kB 00:00 2024-08-25T23:50:20.719 INFO:teuthology.orchestra.run.smithi043.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-25T23:50:20.744 INFO:teuthology.orchestra.run.smithi043.stdout:(139/150): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-08-25T23:50:20.769 INFO:teuthology.orchestra.run.smithi043.stdout:(140/150): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-08-25T23:50:20.795 INFO:teuthology.orchestra.run.smithi043.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-25T23:50:20.820 INFO:teuthology.orchestra.run.smithi043.stdout:(142/150): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-25T23:50:20.845 INFO:teuthology.orchestra.run.smithi043.stdout:(143/150): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-25T23:50:20.871 INFO:teuthology.orchestra.run.smithi043.stdout:(144/150): python3-zc-lockfile-2.0-10.el9.noarc 808 kB/s | 20 kB 00:00 2024-08-25T23:50:20.896 INFO:teuthology.orchestra.run.smithi043.stdout:(145/150): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-08-25T23:50:20.921 INFO:teuthology.orchestra.run.smithi043.stdout:(146/150): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-08-25T23:50:20.980 INFO:teuthology.orchestra.run.smithi043.stdout:(147/150): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-08-25T23:50:21.084 INFO:teuthology.orchestra.run.smithi042.stdout:(76/150): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-08-25T23:50:21.151 INFO:teuthology.orchestra.run.smithi042.stdout:(77/150): python3-devel-3.9.19-7.el9.x86_64.rpm 313 kB/s | 245 kB 00:00 2024-08-25T23:50:21.314 INFO:teuthology.orchestra.run.smithi043.stdout:(148/150): librbd1-19.1.1-207.gf273685f.el9.x86 9.5 MB/s | 3.2 MB 00:00 2024-08-25T23:50:21.372 INFO:teuthology.orchestra.run.smithi043.stdout:(149/150): librados2-19.1.1-207.gf273685f.el9.x 7.6 MB/s | 3.4 MB 00:00 2024-08-25T23:50:21.468 INFO:teuthology.orchestra.run.smithi042.stdout:(78/150): python3-jinja2-2.11.3-6.el9.noarch.rp 317 kB/s | 248 kB 00:00 2024-08-25T23:50:21.652 INFO:teuthology.orchestra.run.smithi042.stdout:(79/150): python3-jsonpatch-1.21-16.el9.noarch. 45 kB/s | 26 kB 00:00 2024-08-25T23:50:21.677 INFO:teuthology.orchestra.run.smithi042.stdout:(80/150): python3-jsonpointer-2.0-4.el9.noarch. 36 kB/s | 19 kB 00:00 2024-08-25T23:50:22.186 INFO:teuthology.orchestra.run.smithi042.stdout:(81/150): python3-mako-1.1.4-6.el9.noarch.rpm 240 kB/s | 172 kB 00:00 2024-08-25T23:50:22.211 INFO:teuthology.orchestra.run.smithi042.stdout:(82/150): python3-markupsafe-1.1.1-12.el9.x86_6 62 kB/s | 35 kB 00:00 2024-08-25T23:50:22.365 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-08-25T23:50:22.447 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-25T23:50:22.473 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-25T23:50:22.516 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-25T23:50:22.828 INFO:teuthology.orchestra.run.smithi042.stdout:(83/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.4 MB/s | 5.1 MB 00:01 2024-08-25T23:50:22.847 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-25T23:50:22.957 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librados2-2:19.1.1-207.gf273685f.el9.x86_64 5/152 2024-08-25T23:50:22.961 INFO:teuthology.orchestra.run.smithi042.stdout:(84/150): python3-oauthlib-3.1.1-5.el9.noarch.r 296 kB/s | 222 kB 00:00 2024-08-25T23:50:22.987 INFO:teuthology.orchestra.run.smithi042.stdout:(85/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 313 kB/s | 250 kB 00:00 2024-08-25T23:50:23.062 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:19.1.1-207.gf273685f.el9.x86_64 5/152 2024-08-25T23:50:23.091 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs2-2:19.1.1-207.gf273685f.el9.x86_64 6/152 2024-08-25T23:50:23.167 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephfs2-2:19.1.1-207.gf273685f.el9.x86_64 6/152 2024-08-25T23:50:23.208 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rados-2:19.1.1-207.gf273685f.el9.x86_64 7/152 2024-08-25T23:50:23.237 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-25T23:50:23.263 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-25T23:50:23.419 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-25T23:50:23.468 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-25T23:50:23.470 INFO:teuthology.orchestra.run.smithi042.stdout:(86/150): python3-packaging-20.9-5.el9.noarch.r 120 kB/s | 77 kB 00:00 2024-08-25T23:50:23.508 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephsqlite-2:19.1.1-207.gf273685f.el9.x86_64 12/152 2024-08-25T23:50:23.520 INFO:teuthology.orchestra.run.smithi042.stdout:(87/150): python3-prettytable-0.7.2-27.el9.noar 76 kB/s | 42 kB 00:00 2024-08-25T23:50:23.618 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephsqlite-2:19.1.1-207.gf273685f.el9.x86_64 12/152 2024-08-25T23:50:23.631 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libradosstriper1-2:19.1.1-207.gf273685f.el9.x86_ 13/152 2024-08-25T23:50:23.689 INFO:teuthology.orchestra.run.smithi043.stdout:(150/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.2 MB/s | 16 MB 00:05 2024-08-25T23:50:23.694 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libradosstriper1-2:19.1.1-207.gf273685f.el9.x86_ 13/152 2024-08-25T23:50:23.694 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-08-25T23:50:23.694 INFO:teuthology.orchestra.run.smithi043.stdout:Total 12 MB/s | 218 MB 00:17 2024-08-25T23:50:23.715 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-25T23:50:23.741 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-25T23:50:23.762 INFO:teuthology.orchestra.run.smithi042.stdout:(88/150): python3-protobuf-3.14.0-13.el9.noarch 347 kB/s | 269 kB 00:00 2024-08-25T23:50:24.000 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-25T23:50:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-25T23:50:24.123 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-25T23:50:24.220 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-25T23:50:24.255 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-08-25T23:50:24.279 INFO:teuthology.orchestra.run.smithi042.stdout:(89/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 196 kB/s | 159 kB 00:00 2024-08-25T23:50:24.291 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-08-25T23:50:24.365 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-08-25T23:50:24.388 INFO:teuthology.orchestra.run.smithi042.stdout:(90/150): python3-pyasn1-modules-0.4.8-6.el9.no 322 kB/s | 279 kB 00:00 2024-08-25T23:50:24.417 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-08-25T23:50:24.449 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-packaging-20.9-5.el9.noarch 22/152 2024-08-25T23:50:24.492 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/152 2024-08-25T23:50:24.522 INFO:teuthology.orchestra.run.smithi042.stdout:(91/150): python3-pytz-2021.1-5.el9.noarch.rpm 68 kB/s | 51 kB 00:00 2024-08-25T23:50:24.525 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/152 2024-08-25T23:50:24.552 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/152 2024-08-25T23:50:24.623 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/152 2024-08-25T23:50:24.676 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 27/152 2024-08-25T23:50:24.705 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/152 2024-08-25T23:50:24.749 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 29/152 2024-08-25T23:50:24.823 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-08-25T23:50:24.827 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 30/152 2024-08-25T23:50:24.860 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-common-2:19.1.1-207.gf273685f.el9.x 31/152 2024-08-25T23:50:24.903 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-argparse-2:19.1.1-207.gf273685f.el9 32/152 2024-08-25T23:50:24.922 INFO:teuthology.orchestra.run.smithi042.stdout:(92/150): python3-requests-oauthlib-1.3.0-12.el 84 kB/s | 54 kB 00:00 2024-08-25T23:50:24.932 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cephfs-2:19.1.1-207.gf273685f.el9.x86_64 33/152 2024-08-25T23:50:24.957 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-08-25T23:50:24.958 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-08-25T23:50:25.006 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/152 2024-08-25T23:50:25.047 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : luarocks-3.9.2-5.el9.noarch 35/152 2024-08-25T23:50:25.089 INFO:teuthology.orchestra.run.smithi042.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 73 kB/s | 42 kB 00:00 2024-08-25T23:50:25.124 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/152 2024-08-25T23:50:25.260 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/152 2024-08-25T23:50:25.317 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/152 2024-08-25T23:50:25.531 INFO:teuthology.orchestra.run.smithi042.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 73 kB/s | 44 kB 00:00 2024-08-25T23:50:25.815 INFO:teuthology.orchestra.run.smithi042.stdout:(95/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-08-25T23:50:25.862 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/152 2024-08-25T23:50:25.939 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/152 2024-08-25T23:50:25.974 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 41/152 2024-08-25T23:50:26.017 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/152 2024-08-25T23:50:26.031 INFO:teuthology.orchestra.run.smithi042.stdout:(96/150): qatlib-24.02.0-1.el9.x86_64.rpm 234 kB/s | 221 kB 00:00 2024-08-25T23:50:26.056 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librados-devel-2:19.1.1-207.gf273685f.el9.x86_64 43/152 2024-08-25T23:50:26.088 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/152 2024-08-25T23:50:26.145 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/152 2024-08-25T23:50:26.218 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-25T23:50:26.256 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/152 2024-08-25T23:50:26.281 INFO:teuthology.orchestra.run.smithi042.stdout:(97/150): qatlib-service-24.02.0-1.el9.x86_64.r 48 kB/s | 36 kB 00:00 2024-08-25T23:50:26.292 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-25T23:50:26.340 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-25T23:50:26.375 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-25T23:50:26.419 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-25T23:50:26.440 INFO:teuthology.orchestra.run.smithi042.stdout:(98/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 76 kB/s | 47 kB 00:00 2024-08-25T23:50:26.462 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-25T23:50:26.601 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-25T23:50:26.637 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-25T23:50:26.679 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-25T23:50:26.764 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-08-25T23:50:26.764 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-08-25T23:50:26.784 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-25T23:50:26.799 INFO:teuthology.orchestra.run.smithi042.stdout:(99/150): socat-1.7.4.1-6.el9.x86_64.rpm 396 kB/s | 304 kB 00:00 2024-08-25T23:50:26.829 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-25T23:50:26.861 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-25T23:50:26.886 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-25T23:50:26.908 INFO:teuthology.orchestra.run.smithi042.stdout:(100/150): uuid-1.6.2-55.el9.x86_64.rpm 92 kB/s | 58 kB 00:00 2024-08-25T23:50:26.911 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-25T23:50:26.987 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-25T23:50:27.108 INFO:teuthology.orchestra.run.smithi042.stdout:(101/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 143 kB/s | 96 kB 00:00 2024-08-25T23:50:27.116 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-25T23:50:27.152 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-25T23:50:27.188 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-25T23:50:27.222 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-25T23:50:27.259 INFO:teuthology.orchestra.run.smithi042.stdout:(102/150): lua-devel-5.4.4-4.el9.x86_64.rpm 150 kB/s | 22 kB 00:00 2024-08-25T23:50:27.267 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-25T23:50:27.304 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-25T23:50:27.336 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-25T23:50:27.357 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-25T23:50:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-25T23:50:27.409 INFO:teuthology.orchestra.run.smithi042.stdout:(103/150): protobuf-compiler-3.14.0-13.el9.x86_ 5.6 MB/s | 863 kB 00:00 2024-08-25T23:50:27.434 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-25T23:50:27.434 INFO:teuthology.orchestra.run.smithi042.stdout:(104/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 100 kB/s | 64 kB 00:00 2024-08-25T23:50:27.484 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-25T23:50:27.484 INFO:teuthology.orchestra.run.smithi042.stdout:(105/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 78 kB/s | 45 kB 00:00 2024-08-25T23:50:27.518 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-25T23:50:27.526 INFO:teuthology.orchestra.run.smithi042.stdout:(106/150): gperftools-libs-2.9.1-2.el9.x86_64.r 3.3 MB/s | 309 kB 00:00 2024-08-25T23:50:27.593 INFO:teuthology.orchestra.run.smithi042.stdout:(107/150): grpc-data-1.46.7-10.el9.noarch.rpm 182 kB/s | 19 kB 00:00 2024-08-25T23:50:27.607 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-25T23:50:27.627 INFO:teuthology.orchestra.run.smithi042.stdout:(108/150): abseil-cpp-20211102.0-3.el9.x86_64.r 2.5 MB/s | 548 kB 00:00 2024-08-25T23:50:27.652 INFO:teuthology.orchestra.run.smithi042.stdout:(109/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 445 kB/s | 26 kB 00:00 2024-08-25T23:50:27.657 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-25T23:50:27.762 INFO:teuthology.orchestra.run.smithi042.stdout:(110/150): liboath-2.6.7-2.el9.x86_64.rpm 362 kB/s | 49 kB 00:00 2024-08-25T23:50:27.811 INFO:teuthology.orchestra.run.smithi042.stdout:(111/150): libunwind-1.6.2-1.el9.x86_64.rpm 425 kB/s | 67 kB 00:00 2024-08-25T23:50:27.836 INFO:teuthology.orchestra.run.smithi042.stdout:(112/150): luarocks-3.9.2-5.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-08-25T23:50:27.878 INFO:teuthology.orchestra.run.smithi042.stdout:(113/150): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-08-25T23:50:27.895 INFO:teuthology.orchestra.run.smithi042.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-08-25T23:50:27.912 INFO:teuthology.orchestra.run.smithi042.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-08-25T23:50:27.915 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-25T23:50:27.946 INFO:teuthology.orchestra.run.smithi042.stdout:(116/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 839 kB 00:00 2024-08-25T23:50:27.963 INFO:teuthology.orchestra.run.smithi042.stdout:(117/150): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-08-25T23:50:27.988 INFO:teuthology.orchestra.run.smithi042.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-08-25T23:50:28.022 INFO:teuthology.orchestra.run.smithi042.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-08-25T23:50:28.046 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-25T23:50:28.047 INFO:teuthology.orchestra.run.smithi042.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-08-25T23:50:28.072 INFO:teuthology.orchestra.run.smithi042.stdout:(121/150): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-08-25T23:50:28.098 INFO:teuthology.orchestra.run.smithi042.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-08-25T23:50:28.108 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-25T23:50:28.123 INFO:teuthology.orchestra.run.smithi042.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 432 kB/s | 11 kB 00:00 2024-08-25T23:50:28.148 INFO:teuthology.orchestra.run.smithi042.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 710 kB/s | 18 kB 00:00 2024-08-25T23:50:28.174 INFO:teuthology.orchestra.run.smithi042.stdout:(125/150): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-08-25T23:50:28.199 INFO:teuthology.orchestra.run.smithi042.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 786 kB/s | 19 kB 00:00 2024-08-25T23:50:28.224 INFO:teuthology.orchestra.run.smithi042.stdout:(127/150): python3-jaraco-text-3.2.0-6.el9.noar 789 kB/s | 20 kB 00:00 2024-08-25T23:50:28.274 INFO:teuthology.orchestra.run.smithi042.stdout:(128/150): python3-kubernetes-26.1.0-2.el9.noar 21 MB/s | 1.0 MB 00:00 2024-08-25T23:50:28.300 INFO:teuthology.orchestra.run.smithi042.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-25T23:50:28.325 INFO:teuthology.orchestra.run.smithi042.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-25T23:50:28.350 INFO:teuthology.orchestra.run.smithi042.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-25T23:50:28.400 INFO:teuthology.orchestra.run.smithi042.stdout:(132/150): python3-grpcio-1.46.7-10.el9.x86_64. 5.8 MB/s | 2.0 MB 00:00 2024-08-25T23:50:28.426 INFO:teuthology.orchestra.run.smithi042.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-08-25T23:50:28.451 INFO:teuthology.orchestra.run.smithi042.stdout:(134/150): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-08-25T23:50:28.477 INFO:teuthology.orchestra.run.smithi042.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-08-25T23:50:28.525 INFO:teuthology.orchestra.run.smithi042.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 384 kB/s | 28 kB 00:00 2024-08-25T23:50:28.552 INFO:teuthology.orchestra.run.smithi042.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 410 kB/s | 31 kB 00:00 2024-08-25T23:50:28.577 INFO:teuthology.orchestra.run.smithi042.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-25T23:50:28.603 INFO:teuthology.orchestra.run.smithi042.stdout:(139/150): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-08-25T23:50:28.628 INFO:teuthology.orchestra.run.smithi042.stdout:(140/150): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-08-25T23:50:28.653 INFO:teuthology.orchestra.run.smithi042.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-08-25T23:50:28.729 INFO:teuthology.orchestra.run.smithi042.stdout:(142/150): libarrow-9.0.0-11.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-08-25T23:50:28.754 INFO:teuthology.orchestra.run.smithi042.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 895 kB/s | 90 kB 00:00 2024-08-25T23:50:28.779 INFO:teuthology.orchestra.run.smithi042.stdout:(144/150): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-08-25T23:50:28.804 INFO:teuthology.orchestra.run.smithi042.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-08-25T23:50:28.838 INFO:teuthology.orchestra.run.smithi042.stdout:(146/150): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-08-25T23:50:28.851 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-25T23:50:28.872 INFO:teuthology.orchestra.run.smithi042.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-08-25T23:50:28.895 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-25T23:50:28.928 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-25T23:50:28.930 INFO:teuthology.orchestra.run.smithi042.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-08-25T23:50:29.032 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-25T23:50:29.092 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-devel-3.9.19-7.el9.x86_64 83/152 2024-08-25T23:50:29.137 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-25T23:50:29.147 INFO:teuthology.orchestra.run.smithi042.stdout:(149/150): librados2-19.1.1-207.gf273685f.el9.x 11 MB/s | 3.4 MB 00:00 2024-08-25T23:50:29.214 INFO:teuthology.orchestra.run.smithi042.stdout:(150/150): librbd1-19.1.1-207.gf273685f.el9.x86 9.2 MB/s | 3.2 MB 00:00 2024-08-25T23:50:29.220 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-08-25T23:50:29.221 INFO:teuthology.orchestra.run.smithi042.stdout:Total 9.1 MB/s | 218 MB 00:23 2024-08-25T23:50:29.226 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-25T23:50:29.264 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-25T23:50:29.448 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-0.3.26-1.el9.x86_64 87/152 2024-08-25T23:50:29.478 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-openmp-0.3.26-1.el9.x86_64 88/152 2024-08-25T23:50:29.557 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-25T23:50:30.225 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-25T23:50:30.339 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-25T23:50:31.121 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-08-25T23:50:31.287 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-08-25T23:50:31.287 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-08-25T23:50:31.594 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-25T23:50:31.693 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-25T23:50:31.721 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-25T23:50:31.753 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-25T23:50:32.062 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-25T23:50:32.100 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librbd1-2:19.1.1-207.gf273685f.el9.x86_64 97/152 2024-08-25T23:50:32.192 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:19.1.1-207.gf273685f.el9.x86_64 97/152 2024-08-25T23:50:32.213 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rbd-2:19.1.1-207.gf273685f.el9.x86_64 98/152 2024-08-25T23:50:32.241 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-25T23:50:32.722 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-25T23:50:32.761 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librgw2-2:19.1.1-207.gf273685f.el9.x86_64 101/152 2024-08-25T23:50:32.832 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librgw2-2:19.1.1-207.gf273685f.el9.x86_64 101/152 2024-08-25T23:50:32.863 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rgw-2:19.1.1-207.gf273685f.el9.x86_64 102/152 2024-08-25T23:50:32.883 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-08-25T23:50:32.958 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-25T23:50:32.983 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-25T23:50:33.026 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-25T23:50:33.374 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-25T23:50:33.478 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librados2-2:19.1.1-207.gf273685f.el9.x86_64 5/152 2024-08-25T23:50:33.600 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:19.1.1-207.gf273685f.el9.x86_64 5/152 2024-08-25T23:50:33.635 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs2-2:19.1.1-207.gf273685f.el9.x86_64 6/152 2024-08-25T23:50:33.727 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephfs2-2:19.1.1-207.gf273685f.el9.x86_64 6/152 2024-08-25T23:50:33.770 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rados-2:19.1.1-207.gf273685f.el9.x86_64 7/152 2024-08-25T23:50:33.798 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-25T23:50:33.823 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-25T23:50:33.836 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-08-25T23:50:33.836 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-08-25T23:50:33.985 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-25T23:50:34.038 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-25T23:50:34.065 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephsqlite-2:19.1.1-207.gf273685f.el9.x86_64 12/152 2024-08-25T23:50:34.171 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephsqlite-2:19.1.1-207.gf273685f.el9.x86_64 12/152 2024-08-25T23:50:34.200 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libradosstriper1-2:19.1.1-207.gf273685f.el9.x86_ 13/152 2024-08-25T23:50:34.246 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libradosstriper1-2:19.1.1-207.gf273685f.el9.x86_ 13/152 2024-08-25T23:50:34.267 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-25T23:50:34.286 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-25T23:50:34.581 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-25T23:50:34.609 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-25T23:50:34.719 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-25T23:50:34.817 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-25T23:50:34.849 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-08-25T23:50:34.885 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-08-25T23:50:34.961 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-08-25T23:50:35.011 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-08-25T23:50:35.051 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-packaging-20.9-5.el9.noarch 22/152 2024-08-25T23:50:35.095 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/152 2024-08-25T23:50:35.127 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/152 2024-08-25T23:50:35.137 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.1.1-207.gf273685f.el9.x86_64 103/152 2024-08-25T23:50:35.146 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/152 2024-08-25T23:50:35.184 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-common-2:19.1.1-207.gf273685f.el9.x86_64 103/152 2024-08-25T23:50:35.220 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/152 2024-08-25T23:50:35.279 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 27/152 2024-08-25T23:50:35.307 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/152 2024-08-25T23:50:35.343 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 29/152 2024-08-25T23:50:35.422 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 30/152 2024-08-25T23:50:35.462 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-common-2:19.1.1-207.gf273685f.el9.x 31/152 2024-08-25T23:50:35.505 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-argparse-2:19.1.1-207.gf273685f.el9 32/152 2024-08-25T23:50:35.534 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cephfs-2:19.1.1-207.gf273685f.el9.x86_64 33/152 2024-08-25T23:50:35.605 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/152 2024-08-25T23:50:35.658 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : luarocks-3.9.2-5.el9.noarch 35/152 2024-08-25T23:50:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.1.1-207.gf273685f.el9.x86_64 103/152 2024-08-25T23:50:35.735 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/152 2024-08-25T23:50:35.771 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-base-2:19.1.1-207.gf273685f.el9.x86_64 104/152 2024-08-25T23:50:35.866 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-base-2:19.1.1-207.gf273685f.el9.x86_64 104/152 2024-08-25T23:50:35.866 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-25T23:50:35.867 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-25T23:50:35.867 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-25T23:50:35.884 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/152 2024-08-25T23:50:35.897 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-selinux-2:19.1.1-207.gf273685f.el9.x86_64 105/152 2024-08-25T23:50:35.947 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/152 2024-08-25T23:50:36.531 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/152 2024-08-25T23:50:36.617 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/152 2024-08-25T23:50:36.651 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 41/152 2024-08-25T23:50:36.694 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/152 2024-08-25T23:50:36.732 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librados-devel-2:19.1.1-207.gf273685f.el9.x86_64 43/152 2024-08-25T23:50:36.766 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/152 2024-08-25T23:50:36.823 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/152 2024-08-25T23:50:36.896 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-25T23:50:36.933 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/152 2024-08-25T23:50:36.969 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-25T23:50:37.017 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-25T23:50:37.052 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-25T23:50:37.096 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-25T23:50:37.138 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-25T23:50:37.283 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-25T23:50:37.322 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-25T23:50:37.357 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-25T23:50:37.463 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-25T23:50:37.497 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-25T23:50:37.537 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-25T23:50:37.563 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-25T23:50:37.587 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-25T23:50:37.666 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-25T23:50:37.796 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-25T23:50:37.836 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-25T23:50:37.856 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-25T23:50:37.882 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-25T23:50:37.935 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-25T23:50:37.973 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-25T23:50:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-25T23:50:38.042 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-25T23:50:38.076 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-25T23:50:38.109 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-25T23:50:38.160 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-25T23:50:38.194 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-25T23:50:38.286 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-25T23:50:38.334 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-25T23:50:38.364 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-25T23:50:38.473 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-25T23:50:38.729 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-25T23:50:39.514 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-25T23:50:39.571 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-25T23:50:39.596 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-25T23:50:39.696 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-25T23:50:39.752 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-devel-3.9.19-7.el9.x86_64 83/152 2024-08-25T23:50:39.798 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-25T23:50:39.897 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-25T23:50:39.932 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-25T23:50:39.983 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-08-25T23:50:40.115 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-0.3.26-1.el9.x86_64 87/152 2024-08-25T23:50:40.146 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-openmp-0.3.26-1.el9.x86_64 88/152 2024-08-25T23:50:40.195 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-25T23:50:40.226 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-25T23:50:40.244 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-25T23:50:40.336 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-25T23:50:40.730 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-25T23:50:40.851 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librados2-2:19.1.1-207.gf273685f.el9.x86_64 5/152 2024-08-25T23:50:40.920 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-25T23:50:40.983 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:19.1.1-207.gf273685f.el9.x86_64 5/152 2024-08-25T23:50:41.044 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-25T23:50:41.161 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs2-2:19.1.1-207.gf273685f.el9.x86_64 6/152 2024-08-25T23:50:41.285 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephfs2-2:19.1.1-207.gf273685f.el9.x86_64 6/152 2024-08-25T23:50:41.334 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rados-2:19.1.1-207.gf273685f.el9.x86_64 7/152 2024-08-25T23:50:41.367 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-25T23:50:41.401 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-25T23:50:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-25T23:50:41.725 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-25T23:50:41.758 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephsqlite-2:19.1.1-207.gf273685f.el9.x86_64 12/152 2024-08-25T23:50:41.886 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephsqlite-2:19.1.1-207.gf273685f.el9.x86_64 12/152 2024-08-25T23:50:41.925 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libradosstriper1-2:19.1.1-207.gf273685f.el9.x86_ 13/152 2024-08-25T23:50:42.036 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libradosstriper1-2:19.1.1-207.gf273685f.el9.x86_ 13/152 2024-08-25T23:50:42.060 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-25T23:50:42.105 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-25T23:50:42.366 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-25T23:50:42.431 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-25T23:50:42.436 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-25T23:50:42.478 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-25T23:50:42.489 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-25T23:50:42.522 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-25T23:50:42.619 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-25T23:50:42.736 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-25T23:50:42.791 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-08-25T23:50:42.839 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-25T23:50:42.839 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-08-25T23:50:42.876 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librbd1-2:19.1.1-207.gf273685f.el9.x86_64 97/152 2024-08-25T23:50:42.924 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-08-25T23:50:42.960 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:19.1.1-207.gf273685f.el9.x86_64 97/152 2024-08-25T23:50:42.984 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-08-25T23:50:42.990 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rbd-2:19.1.1-207.gf273685f.el9.x86_64 98/152 2024-08-25T23:50:43.022 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-packaging-20.9-5.el9.noarch 22/152 2024-08-25T23:50:43.026 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-25T23:50:43.077 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/152 2024-08-25T23:50:43.115 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/152 2024-08-25T23:50:43.148 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/152 2024-08-25T23:50:43.241 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/152 2024-08-25T23:50:43.311 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 27/152 2024-08-25T23:50:43.344 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/152 2024-08-25T23:50:43.383 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 29/152 2024-08-25T23:50:43.475 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 30/152 2024-08-25T23:50:43.514 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-common-2:19.1.1-207.gf273685f.el9.x 31/152 2024-08-25T23:50:43.534 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-25T23:50:43.559 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-argparse-2:19.1.1-207.gf273685f.el9 32/152 2024-08-25T23:50:43.563 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librgw2-2:19.1.1-207.gf273685f.el9.x86_64 101/152 2024-08-25T23:50:43.586 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cephfs-2:19.1.1-207.gf273685f.el9.x86_64 33/152 2024-08-25T23:50:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librgw2-2:19.1.1-207.gf273685f.el9.x86_64 101/152 2024-08-25T23:50:43.648 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rgw-2:19.1.1-207.gf273685f.el9.x86_64 102/152 2024-08-25T23:50:43.684 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/152 2024-08-25T23:50:43.740 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : luarocks-3.9.2-5.el9.noarch 35/152 2024-08-25T23:50:43.835 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/152 2024-08-25T23:50:44.034 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/152 2024-08-25T23:50:44.094 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/152 2024-08-25T23:50:44.781 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/152 2024-08-25T23:50:44.912 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/152 2024-08-25T23:50:44.953 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 41/152 2024-08-25T23:50:44.998 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/152 2024-08-25T23:50:45.036 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librados-devel-2:19.1.1-207.gf273685f.el9.x86_64 43/152 2024-08-25T23:50:45.077 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/152 2024-08-25T23:50:45.140 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/152 2024-08-25T23:50:45.226 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-25T23:50:45.278 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/152 2024-08-25T23:50:45.314 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-25T23:50:45.375 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-25T23:50:45.413 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-25T23:50:45.460 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-25T23:50:45.510 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-25T23:50:45.692 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-25T23:50:45.734 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-25T23:50:45.777 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-25T23:50:45.921 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-25T23:50:45.959 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-25T23:50:46.004 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-25T23:50:46.039 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-25T23:50:46.081 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-25T23:50:46.089 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:19.1.1-207.gf273685f.el9.x86_64 103/152 2024-08-25T23:50:46.127 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-common-2:19.1.1-207.gf273685f.el9.x86_64 103/152 2024-08-25T23:50:46.213 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-25T23:50:46.375 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-25T23:50:46.419 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-25T23:50:46.452 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-25T23:50:46.488 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-25T23:50:46.534 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-25T23:50:46.577 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-25T23:50:46.616 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-25T23:50:46.653 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-25T23:50:46.688 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-25T23:50:46.702 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:19.1.1-207.gf273685f.el9.x86_64 103/152 2024-08-25T23:50:46.721 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-25T23:50:46.739 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-base-2:19.1.1-207.gf273685f.el9.x86_64 104/152 2024-08-25T23:50:46.794 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-25T23:50:46.830 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-25T23:50:46.831 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-base-2:19.1.1-207.gf273685f.el9.x86_64 104/152 2024-08-25T23:50:46.831 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-25T23:50:46.832 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-25T23:50:46.832 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-08-25T23:50:46.866 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-selinux-2:19.1.1-207.gf273685f.el9.x86_64 105/152 2024-08-25T23:50:46.935 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-25T23:50:46.990 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-25T23:50:47.025 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-25T23:50:47.156 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-25T23:50:47.224 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-25T23:50:47.409 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-selinux-2:19.1.1-207.gf273685f.el9.x86_64 105/152 2024-08-25T23:50:47.409 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /sys 2024-08-25T23:50:47.409 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /proc 2024-08-25T23:50:47.409 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /mnt 2024-08-25T23:50:47.409 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /var/tmp 2024-08-25T23:50:47.409 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /home 2024-08-25T23:50:47.409 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /root 2024-08-25T23:50:47.409 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /tmp 2024-08-25T23:50:47.409 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-25T23:50:47.595 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-volume-2:19.1.1-207.gf273685f.el9.noarch 106/152 2024-08-25T23:50:47.612 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-volume-2:19.1.1-207.gf273685f.el9.noarch 106/152 2024-08-25T23:50:47.612 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:50:47.612 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-25T23:50:47.612 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-25T23:50:48.180 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-25T23:50:48.241 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-25T23:50:48.274 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-25T23:50:48.390 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-25T23:50:48.450 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-devel-3.9.19-7.el9.x86_64 83/152 2024-08-25T23:50:48.503 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-25T23:50:48.614 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-25T23:50:48.660 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-25T23:50:48.927 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-0.3.26-1.el9.x86_64 87/152 2024-08-25T23:50:48.964 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-openmp-0.3.26-1.el9.x86_64 88/152 2024-08-25T23:50:49.055 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-25T23:50:49.096 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-osd-2:19.1.1-207.gf273685f.el9.x86_64 107/152 2024-08-25T23:50:49.123 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-osd-2:19.1.1-207.gf273685f.el9.x86_64 107/152 2024-08-25T23:50:49.123 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:50:49.123 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-25T23:50:49.123 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-25T23:50:49.123 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-25T23:50:49.123 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-25T23:50:49.346 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mds-2:19.1.1-207.gf273685f.el9.x86_64 108/152 2024-08-25T23:50:49.370 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mds-2:19.1.1-207.gf273685f.el9.x86_64 108/152 2024-08-25T23:50:49.370 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:50:49.370 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-25T23:50:49.370 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-25T23:50:49.370 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-25T23:50:49.370 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-25T23:50:49.814 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mon-2:19.1.1-207.gf273685f.el9.x86_64 109/152 2024-08-25T23:50:49.838 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mon-2:19.1.1-207.gf273685f.el9.x86_64 109/152 2024-08-25T23:50:49.839 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:50:49.839 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-25T23:50:49.839 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-25T23:50:49.839 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-25T23:50:49.839 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-25T23:50:49.927 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-25T23:50:49.944 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-25T23:50:50.001 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-25T23:50:50.056 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-25T23:50:50.077 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-25T23:50:50.242 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-25T23:50:50.289 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-25T23:50:50.368 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-25T23:50:50.456 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-25T23:50:50.597 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-25T23:50:50.631 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-25T23:50:50.663 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-25T23:50:50.691 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-25T23:50:51.128 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephadm-2:19.1.1-207.gf273685f.el9.noarch 121/152 2024-08-25T23:50:51.156 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephadm-2:19.1.1-207.gf273685f.el9.noarch 121/152 2024-08-25T23:50:51.187 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-207.gf273685f.el 122/152 2024-08-25T23:50:51.242 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-207.gf273685f.e 123/152 2024-08-25T23:50:51.298 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-207.gf273685f.el9.noar 124/152 2024-08-25T23:50:51.754 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-25T23:50:51.854 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-25T23:50:51.892 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-25T23:50:51.931 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-25T23:50:52.290 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-25T23:50:52.334 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librbd1-2:19.1.1-207.gf273685f.el9.x86_64 97/152 2024-08-25T23:50:52.342 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-207.gf273685f.el9.noar 124/152 2024-08-25T23:50:52.389 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-207.gf273685f.el9.no 125/152 2024-08-25T23:50:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:19.1.1-207.gf273685f.el9.x86_64 97/152 2024-08-25T23:50:52.484 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rbd-2:19.1.1-207.gf273685f.el9.x86_64 98/152 2024-08-25T23:50:52.553 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-25T23:50:53.204 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-25T23:50:53.230 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librgw2-2:19.1.1-207.gf273685f.el9.x86_64 101/152 2024-08-25T23:50:53.322 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librgw2-2:19.1.1-207.gf273685f.el9.x86_64 101/152 2024-08-25T23:50:53.345 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-207.gf273685f.el9.no 125/152 2024-08-25T23:50:53.349 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rgw-2:19.1.1-207.gf273685f.el9.x86_64 102/152 2024-08-25T23:50:53.373 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-207.gf273 126/152 2024-08-25T23:50:53.475 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-207.gf273 126/152 2024-08-25T23:50:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-207.gf273685f.el9 127/152 2024-08-25T23:50:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-2:19.1.1-207.gf273685f.el9.x86_64 128/152 2024-08-25T23:50:53.699 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-2:19.1.1-207.gf273685f.el9.x86_64 128/152 2024-08-25T23:50:53.699 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:50:53.699 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-25T23:50:53.699 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-25T23:50:53.699 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-25T23:50:53.699 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-25T23:50:53.751 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-rook-2:19.1.1-207.gf273685f.el9.noarch 129/152 2024-08-25T23:50:53.763 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-207.gf273685f.el9.noarch 129/152 2024-08-25T23:50:53.860 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-2:19.1.1-207.gf273685f.el9.x86_64 130/152 2024-08-25T23:50:53.908 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-fuse-2:19.1.1-207.gf273685f.el9.x86_64 131/152 2024-08-25T23:50:54.832 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-25T23:50:54.869 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-radosgw-2:19.1.1-207.gf273685f.el9.x86_64 133/152 2024-08-25T23:50:54.893 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-207.gf273685f.el9.x86_64 133/152 2024-08-25T23:50:54.893 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:50:54.894 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-25T23:50:54.894 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-25T23:50:54.894 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-25T23:50:54.894 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-25T23:50:54.928 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-207.gf27368 134/152 2024-08-25T23:50:54.952 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-207.gf27368 134/152 2024-08-25T23:50:54.953 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:50:54.953 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-25T23:50:54.953 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-25T23:50:55.004 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-mirror-2:19.1.1-207.gf273685f.el9.x86_64 135/152 2024-08-25T23:50:55.027 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-207.gf273685f.el9.x86_64 135/152 2024-08-25T23:50:55.027 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:50:55.027 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-25T23:50:55.027 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-25T23:50:55.027 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-25T23:50:55.028 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-25T23:50:55.330 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-mirror-2:19.1.1-207.gf273685f.el9.x86_64 136/152 2024-08-25T23:50:55.353 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rbd-mirror-2:19.1.1-207.gf273685f.el9.x86_64 136/152 2024-08-25T23:50:55.353 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:50:55.354 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-25T23:50:55.354 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-25T23:50:55.354 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-25T23:50:55.354 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-25T23:50:56.045 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.1.1-207.gf273685f.el9.x86_64 103/152 2024-08-25T23:50:56.100 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-common-2:19.1.1-207.gf273685f.el9.x86_64 103/152 2024-08-25T23:50:56.806 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.1.1-207.gf273685f.el9.x86_64 103/152 2024-08-25T23:50:56.854 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-base-2:19.1.1-207.gf273685f.el9.x86_64 104/152 2024-08-25T23:50:56.964 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-base-2:19.1.1-207.gf273685f.el9.x86_64 104/152 2024-08-25T23:50:56.964 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-25T23:50:56.964 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-25T23:50:56.964 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:50:57.006 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-selinux-2:19.1.1-207.gf273685f.el9.x86_64 105/152 2024-08-25T23:50:58.847 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-selinux-2:19.1.1-207.gf273685f.el9.x86_64 105/152 2024-08-25T23:50:58.847 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /sys 2024-08-25T23:50:58.847 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /proc 2024-08-25T23:50:58.847 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /mnt 2024-08-25T23:50:58.847 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /var/tmp 2024-08-25T23:50:58.847 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /home 2024-08-25T23:50:58.847 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /root 2024-08-25T23:50:58.847 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /tmp 2024-08-25T23:50:58.847 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-08-25T23:50:59.020 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-volume-2:19.1.1-207.gf273685f.el9.noarch 106/152 2024-08-25T23:50:59.037 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-volume-2:19.1.1-207.gf273685f.el9.noarch 106/152 2024-08-25T23:50:59.037 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:50:59.038 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-25T23:50:59.038 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-08-25T23:50:59.950 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-test-2:19.1.1-207.gf273685f.el9.x86_64 137/152 2024-08-25T23:50:59.991 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-fuse-2:19.1.1-207.gf273685f.el9.x86_64 138/152 2024-08-25T23:51:00.033 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-nbd-2:19.1.1-207.gf273685f.el9.x86_64 139/152 2024-08-25T23:51:00.064 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-25T23:51:00.092 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-25T23:51:00.277 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-shell-2:19.1.1-207.gf273685f.el9.x86_64 142/152 2024-08-25T23:51:00.321 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-25T23:51:00.351 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs-devel-2:19.1.1-207.gf273685f.el9.x86_6 144/152 2024-08-25T23:51:00.557 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-osd-2:19.1.1-207.gf273685f.el9.x86_64 107/152 2024-08-25T23:51:00.583 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-osd-2:19.1.1-207.gf273685f.el9.x86_64 107/152 2024-08-25T23:51:00.584 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:51:00.584 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-25T23:51:00.584 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-25T23:51:00.584 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-25T23:51:00.584 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-08-25T23:51:00.824 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mds-2:19.1.1-207.gf273685f.el9.x86_64 108/152 2024-08-25T23:51:00.847 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mds-2:19.1.1-207.gf273685f.el9.x86_64 108/152 2024-08-25T23:51:00.848 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:51:00.848 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-25T23:51:00.848 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-25T23:51:00.848 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-25T23:51:00.848 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-08-25T23:51:00.924 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-25T23:51:00.966 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-25T23:51:00.986 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-25T23:51:01.300 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mon-2:19.1.1-207.gf273685f.el9.x86_64 109/152 2024-08-25T23:51:01.323 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mon-2:19.1.1-207.gf273685f.el9.x86_64 109/152 2024-08-25T23:51:01.323 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:51:01.323 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-25T23:51:01.323 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-25T23:51:01.323 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-25T23:51:01.323 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-08-25T23:51:01.431 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-25T23:51:01.489 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-25T23:51:01.545 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-25T23:51:01.741 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-25T23:51:01.793 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-25T23:51:01.804 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-top-2:19.1.1-207.gf273685f.el9.noarch 146/152 2024-08-25T23:51:01.873 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-25T23:51:01.887 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-25T23:51:01.919 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-25T23:51:01.964 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-25T23:51:02.001 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-25T23:51:02.041 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-25T23:51:02.041 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-25T23:51:02.115 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-25T23:51:02.124 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-25T23:51:02.125 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-25T23:51:02.160 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-25T23:51:02.191 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-25T23:51:02.219 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-25T23:51:02.614 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephadm-2:19.1.1-207.gf273685f.el9.noarch 121/152 2024-08-25T23:51:02.642 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephadm-2:19.1.1-207.gf273685f.el9.noarch 121/152 2024-08-25T23:51:02.674 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-207.gf273685f.el 122/152 2024-08-25T23:51:02.739 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-207.gf273685f.e 123/152 2024-08-25T23:51:02.766 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-207.gf273685f.el9.noar 124/152 2024-08-25T23:51:03.866 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-207.gf273685f.el9.noar 124/152 2024-08-25T23:51:03.901 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-207.gf273685f.el9.no 125/152 2024-08-25T23:51:04.915 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-207.gf273685f.el9.no 125/152 2024-08-25T23:51:04.943 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-207.gf273 126/152 2024-08-25T23:51:05.053 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-207.gf273 126/152 2024-08-25T23:51:05.221 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-207.gf273685f.el9 127/152 2024-08-25T23:51:05.253 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-2:19.1.1-207.gf273685f.el9.x86_64 128/152 2024-08-25T23:51:05.277 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-2:19.1.1-207.gf273685f.el9.x86_64 128/152 2024-08-25T23:51:05.277 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:51:05.277 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-25T23:51:05.277 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-25T23:51:05.277 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-25T23:51:05.277 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-08-25T23:51:05.329 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-rook-2:19.1.1-207.gf273685f.el9.noarch 129/152 2024-08-25T23:51:05.341 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-207.gf273685f.el9.noarch 129/152 2024-08-25T23:51:05.442 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-2:19.1.1-207.gf273685f.el9.x86_64 130/152 2024-08-25T23:51:05.495 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-fuse-2:19.1.1-207.gf273685f.el9.x86_64 131/152 2024-08-25T23:51:06.471 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-25T23:51:06.507 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-radosgw-2:19.1.1-207.gf273685f.el9.x86_64 133/152 2024-08-25T23:51:06.531 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-207.gf273685f.el9.x86_64 133/152 2024-08-25T23:51:06.531 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:51:06.531 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-25T23:51:06.531 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-25T23:51:06.531 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-25T23:51:06.531 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-08-25T23:51:06.574 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-207.gf27368 134/152 2024-08-25T23:51:06.597 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-207.gf27368 134/152 2024-08-25T23:51:06.597 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:51:06.597 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-25T23:51:06.597 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-08-25T23:51:06.641 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-mirror-2:19.1.1-207.gf273685f.el9.x86_64 135/152 2024-08-25T23:51:06.664 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-207.gf273685f.el9.x86_64 135/152 2024-08-25T23:51:06.665 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:51:06.665 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-25T23:51:06.665 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-25T23:51:06.665 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-25T23:51:06.665 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-08-25T23:51:06.984 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-mirror-2:19.1.1-207.gf273685f.el9.x86_64 136/152 2024-08-25T23:51:07.007 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: rbd-mirror-2:19.1.1-207.gf273685f.el9.x86_64 136/152 2024-08-25T23:51:07.007 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:51:07.007 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-25T23:51:07.007 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-25T23:51:07.007 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-25T23:51:07.007 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-08-25T23:51:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-25T23:51:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-2:19.1.1-207.gf273685f.el9.x86_64 1/152 2024-08-25T23:51:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-base-2:19.1.1-207.gf273685f.el9.x86_64 2/152 2024-08-25T23:51:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-common-2:19.1.1-207.gf273685f.el9.x86_64 3/152 2024-08-25T23:51:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-fuse-2:19.1.1-207.gf273685f.el9.x86_64 4/152 2024-08-25T23:51:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-207.gf27368 5/152 2024-08-25T23:51:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mds-2:19.1.1-207.gf273685f.el9.x86_64 6/152 2024-08-25T23:51:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-2:19.1.1-207.gf273685f.el9.x86_64 7/152 2024-08-25T23:51:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mon-2:19.1.1-207.gf273685f.el9.x86_64 8/152 2024-08-25T23:51:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-osd-2:19.1.1-207.gf273685f.el9.x86_64 9/152 2024-08-25T23:51:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-radosgw-2:19.1.1-207.gf273685f.el9.x86_64 10/152 2024-08-25T23:51:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-selinux-2:19.1.1-207.gf273685f.el9.x86_64 11/152 2024-08-25T23:51:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-test-2:19.1.1-207.gf273685f.el9.x86_64 12/152 2024-08-25T23:51:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-mirror-2:19.1.1-207.gf273685f.el9.x86_64 13/152 2024-08-25T23:51:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-shell-2:19.1.1-207.gf273685f.el9.x86_64 14/152 2024-08-25T23:51:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs-devel-2:19.1.1-207.gf273685f.el9.x86_6 15/152 2024-08-25T23:51:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs2-2:19.1.1-207.gf273685f.el9.x86_64 16/152 2024-08-25T23:51:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephsqlite-2:19.1.1-207.gf273685f.el9.x86_64 17/152 2024-08-25T23:51:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados-devel-2:19.1.1-207.gf273685f.el9.x86_64 18/152 2024-08-25T23:51:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libradosstriper1-2:19.1.1-207.gf273685f.el9.x86_ 19/152 2024-08-25T23:51:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librgw2-2:19.1.1-207.gf273685f.el9.x86_64 20/152 2024-08-25T23:51:08.189 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-argparse-2:19.1.1-207.gf273685f.el9 21/152 2024-08-25T23:51:08.189 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-common-2:19.1.1-207.gf273685f.el9.x 22/152 2024-08-25T23:51:08.189 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cephfs-2:19.1.1-207.gf273685f.el9.x86_64 23/152 2024-08-25T23:51:08.189 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rados-2:19.1.1-207.gf273685f.el9.x86_64 24/152 2024-08-25T23:51:08.189 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rbd-2:19.1.1-207.gf273685f.el9.x86_64 25/152 2024-08-25T23:51:08.189 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rgw-2:19.1.1-207.gf273685f.el9.x86_64 26/152 2024-08-25T23:51:08.189 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-fuse-2:19.1.1-207.gf273685f.el9.x86_64 27/152 2024-08-25T23:51:08.189 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-mirror-2:19.1.1-207.gf273685f.el9.x86_64 28/152 2024-08-25T23:51:08.189 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-nbd-2:19.1.1-207.gf273685f.el9.x86_64 29/152 2024-08-25T23:51:08.189 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-207.gf273685f.e 30/152 2024-08-25T23:51:08.189 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-207.gf273685f.el9.noar 31/152 2024-08-25T23:51:08.189 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-207.gf273685f.el9.no 32/152 2024-08-25T23:51:08.189 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-207.gf273 33/152 2024-08-25T23:51:08.189 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-207.gf273685f.el9 34/152 2024-08-25T23:51:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-rook-2:19.1.1-207.gf273685f.el9.noarch 35/152 2024-08-25T23:51:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-207.gf273685f.el 36/152 2024-08-25T23:51:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-volume-2:19.1.1-207.gf273685f.el9.noarch 37/152 2024-08-25T23:51:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephadm-2:19.1.1-207.gf273685f.el9.noarch 38/152 2024-08-25T23:51:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-top-2:19.1.1-207.gf273685f.el9.noarch 39/152 2024-08-25T23:51:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-25T23:51:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-25T23:51:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-25T23:51:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-25T23:51:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-25T23:51:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-25T23:51:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-25T23:51:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-25T23:51:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-25T23:51:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-25T23:51:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-25T23:51:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-25T23:51:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-25T23:51:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-25T23:51:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-25T23:51:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-25T23:51:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-25T23:51:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-25T23:51:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-25T23:51:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-25T23:51:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-25T23:51:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-25T23:51:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-25T23:51:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-25T23:51:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-25T23:51:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-25T23:51:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-0.3.26-1.el9.x86_64 66/152 2024-08-25T23:51:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-openmp-0.3.26-1.el9.x86_64 67/152 2024-08-25T23:51:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-25T23:51:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-25T23:51:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-25T23:51:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-25T23:51:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-25T23:51:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-25T23:51:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-25T23:51:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-25T23:51:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-25T23:51:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-devel-3.9.19-7.el9.x86_64 77/152 2024-08-25T23:51:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-25T23:51:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-25T23:51:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-25T23:51:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-25T23:51:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-25T23:51:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-25T23:51:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-25T23:51:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-25T23:51:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-25T23:51:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-25T23:51:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-25T23:51:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-25T23:51:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-25T23:51:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-25T23:51:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-25T23:51:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-25T23:51:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-25T23:51:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-25T23:51:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-25T23:51:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-25T23:51:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-25T23:51:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-25T23:51:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-25T23:51:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-25T23:51:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-25T23:51:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-25T23:51:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-25T23:51:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-25T23:51:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-25T23:51:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-25T23:51:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-25T23:51:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-25T23:51:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-25T23:51:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-25T23:51:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-25T23:51:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-25T23:51:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-25T23:51:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-25T23:51:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-25T23:51:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-25T23:51:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-25T23:51:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-25T23:51:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-25T23:51:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-25T23:51:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-25T23:51:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-25T23:51:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-25T23:51:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-25T23:51:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-25T23:51:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-25T23:51:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-25T23:51:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-25T23:51:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-25T23:51:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-25T23:51:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-25T23:51:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-25T23:51:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-25T23:51:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-25T23:51:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-25T23:51:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-25T23:51:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-25T23:51:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-25T23:51:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-25T23:51:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-25T23:51:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-25T23:51:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-08-25T23:51:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-25T23:51:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-25T23:51:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-25T23:51:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-25T23:51:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-25T23:51:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:19.1.1-207.gf273685f.el9.x86_64 149/152 2024-08-25T23:51:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-25T23:51:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:19.1.1-207.gf273685f.el9.x86_64 151/152 2024-08-25T23:51:10.358 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-selinux-2:19.1.1-207.gf273685f.el9.x86_64 105/152 2024-08-25T23:51:10.358 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /sys 2024-08-25T23:51:10.358 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /proc 2024-08-25T23:51:10.358 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /mnt 2024-08-25T23:51:10.358 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /var/tmp 2024-08-25T23:51:10.358 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /home 2024-08-25T23:51:10.358 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /root 2024-08-25T23:51:10.358 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /tmp 2024-08-25T23:51:10.359 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:51:10.535 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-25T23:51:10.535 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-25T23:51:10.536 INFO:teuthology.orchestra.run.smithi181.stdout:Upgraded: 2024-08-25T23:51:10.536 INFO:teuthology.orchestra.run.smithi181.stdout: librados2-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.536 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.536 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-08-25T23:51:10.536 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-25T23:51:10.536 INFO:teuthology.orchestra.run.smithi181.stdout: automake-1.16.2-8.el9.noarch 2024-08-25T23:51:10.536 INFO:teuthology.orchestra.run.smithi181.stdout: bison-3.7.4-5.el9.x86_64 2024-08-25T23:51:10.536 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-25T23:51:10.536 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.536 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.536 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.536 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.537 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:10.537 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.537 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.537 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.537 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:10.537 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:10.537 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:10.537 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:10.537 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:10.537 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.537 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.537 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:10.537 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.538 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.538 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.538 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:10.538 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:10.538 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.538 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.538 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:10.538 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-25T23:51:10.538 INFO:teuthology.orchestra.run.smithi181.stdout: flex-2.6.4-9.el9.x86_64 2024-08-25T23:51:10.538 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-25T23:51:10.538 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-25T23:51:10.538 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-25T23:51:10.539 INFO:teuthology.orchestra.run.smithi181.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-25T23:51:10.539 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-25T23:51:10.539 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-25T23:51:10.539 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-25T23:51:10.539 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-25T23:51:10.539 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-25T23:51:10.539 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.539 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.539 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.539 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-25T23:51:10.539 INFO:teuthology.orchestra.run.smithi181.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-25T23:51:10.539 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-25T23:51:10.539 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-25T23:51:10.540 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-25T23:51:10.540 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.540 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.540 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-25T23:51:10.540 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.540 INFO:teuthology.orchestra.run.smithi181.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-25T23:51:10.540 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-25T23:51:10.540 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-25T23:51:10.540 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-25T23:51:10.540 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-25T23:51:10.540 INFO:teuthology.orchestra.run.smithi181.stdout: lua-5.4.4-4.el9.x86_64 2024-08-25T23:51:10.540 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-25T23:51:10.540 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-25T23:51:10.541 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-0.3.26-1.el9.x86_64 2024-08-25T23:51:10.541 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp-0.3.26-1.el9.x86_64 2024-08-25T23:51:10.541 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-25T23:51:10.541 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-25T23:51:10.541 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-13.16-1.el9.x86_64 2024-08-25T23:51:10.541 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-25T23:51:10.541 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-25T23:51:10.541 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-25T23:51:10.541 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-25T23:51:10.541 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-25T23:51:10.541 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-25T23:51:10.541 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-25T23:51:10.541 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-25T23:51:10.542 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-25T23:51:10.542 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-25T23:51:10.542 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.542 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.542 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.542 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-25T23:51:10.542 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-25T23:51:10.542 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-25T23:51:10.542 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-25T23:51:10.542 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-25T23:51:10.542 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-25T23:51:10.542 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-25T23:51:10.543 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel-3.9.19-7.el9.x86_64 2024-08-25T23:51:10.543 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-25T23:51:10.543 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-25T23:51:10.543 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-25T23:51:10.543 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-25T23:51:10.543 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-25T23:51:10.543 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-25T23:51:10.543 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-25T23:51:10.543 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-25T23:51:10.543 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-25T23:51:10.543 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-25T23:51:10.543 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-25T23:51:10.543 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-25T23:51:10.544 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-25T23:51:10.544 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-25T23:51:10.544 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-25T23:51:10.544 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-25T23:51:10.544 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-25T23:51:10.544 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-25T23:51:10.544 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-25T23:51:10.544 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-25T23:51:10.544 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-25T23:51:10.544 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-25T23:51:10.544 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply-3.11-14.el9.noarch 2024-08-25T23:51:10.544 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-25T23:51:10.545 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-25T23:51:10.545 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-25T23:51:10.545 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-25T23:51:10.545 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-25T23:51:10.545 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-25T23:51:10.545 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-25T23:51:10.545 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-25T23:51:10.545 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-25T23:51:10.545 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.545 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.545 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-25T23:51:10.545 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-25T23:51:10.545 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-25T23:51:10.545 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.546 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-25T23:51:10.546 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-25T23:51:10.546 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-25T23:51:10.546 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-25T23:51:10.546 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-25T23:51:10.546 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-25T23:51:10.546 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-25T23:51:10.546 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-25T23:51:10.546 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-25T23:51:10.546 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-25T23:51:10.546 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-25T23:51:10.546 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-25T23:51:10.546 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-25T23:51:10.546 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-25T23:51:10.547 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-25T23:51:10.547 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.547 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.547 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:10.547 INFO:teuthology.orchestra.run.smithi181.stdout: re2-1:20211101-20.el9.x86_64 2024-08-25T23:51:10.547 INFO:teuthology.orchestra.run.smithi181.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-25T23:51:10.547 INFO:teuthology.orchestra.run.smithi181.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-25T23:51:10.547 INFO:teuthology.orchestra.run.smithi181.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-25T23:51:10.547 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-25T23:51:10.547 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-25T23:51:10.547 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-25T23:51:10.548 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-25T23:51:10.548 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-08-25T23:51:10.571 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-volume-2:19.1.1-207.gf273685f.el9.noarch 106/152 2024-08-25T23:51:10.609 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-volume-2:19.1.1-207.gf273685f.el9.noarch 106/152 2024-08-25T23:51:10.609 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:51:10.609 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-25T23:51:10.609 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:51:10.887 DEBUG:teuthology.parallel:result is None 2024-08-25T23:51:11.821 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-test-2:19.1.1-207.gf273685f.el9.x86_64 137/152 2024-08-25T23:51:11.871 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-fuse-2:19.1.1-207.gf273685f.el9.x86_64 138/152 2024-08-25T23:51:11.912 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-nbd-2:19.1.1-207.gf273685f.el9.x86_64 139/152 2024-08-25T23:51:11.944 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-25T23:51:11.971 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-25T23:51:12.165 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-shell-2:19.1.1-207.gf273685f.el9.x86_64 142/152 2024-08-25T23:51:12.209 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-25T23:51:12.230 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs-devel-2:19.1.1-207.gf273685f.el9.x86_6 144/152 2024-08-25T23:51:12.266 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-osd-2:19.1.1-207.gf273685f.el9.x86_64 107/152 2024-08-25T23:51:12.326 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-osd-2:19.1.1-207.gf273685f.el9.x86_64 107/152 2024-08-25T23:51:12.326 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:51:12.326 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-25T23:51:12.326 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-25T23:51:12.326 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-25T23:51:12.326 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:51:12.584 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mds-2:19.1.1-207.gf273685f.el9.x86_64 108/152 2024-08-25T23:51:12.635 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mds-2:19.1.1-207.gf273685f.el9.x86_64 108/152 2024-08-25T23:51:12.636 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:51:12.636 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-25T23:51:12.636 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-25T23:51:12.636 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-25T23:51:12.636 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:51:12.876 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-25T23:51:12.919 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-25T23:51:12.940 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-25T23:51:13.143 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mon-2:19.1.1-207.gf273685f.el9.x86_64 109/152 2024-08-25T23:51:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mon-2:19.1.1-207.gf273685f.el9.x86_64 109/152 2024-08-25T23:51:13.195 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:51:13.195 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-25T23:51:13.195 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-25T23:51:13.195 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-25T23:51:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:51:13.335 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-25T23:51:13.397 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-25T23:51:13.471 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-25T23:51:13.715 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-25T23:51:13.781 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-25T23:51:13.856 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-top-2:19.1.1-207.gf273685f.el9.noarch 146/152 2024-08-25T23:51:13.869 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-25T23:51:13.942 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-25T23:51:13.980 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-25T23:51:13.984 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-25T23:51:14.068 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-25T23:51:14.096 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-25T23:51:14.096 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-25T23:51:14.150 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-25T23:51:14.179 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-25T23:51:14.180 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-25T23:51:14.197 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-25T23:51:14.238 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-25T23:51:14.262 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-25T23:51:14.832 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephadm-2:19.1.1-207.gf273685f.el9.noarch 121/152 2024-08-25T23:51:14.863 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephadm-2:19.1.1-207.gf273685f.el9.noarch 121/152 2024-08-25T23:51:14.904 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-207.gf273685f.el 122/152 2024-08-25T23:51:14.984 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-207.gf273685f.e 123/152 2024-08-25T23:51:15.018 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-207.gf273685f.el9.noar 124/152 2024-08-25T23:51:16.318 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-207.gf273685f.el9.noar 124/152 2024-08-25T23:51:16.362 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-207.gf273685f.el9.no 125/152 2024-08-25T23:51:17.515 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-207.gf273685f.el9.no 125/152 2024-08-25T23:51:17.571 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-207.gf273 126/152 2024-08-25T23:51:17.716 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-207.gf273 126/152 2024-08-25T23:51:17.911 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-207.gf273685f.el9 127/152 2024-08-25T23:51:17.940 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-2:19.1.1-207.gf273685f.el9.x86_64 128/152 2024-08-25T23:51:17.992 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-2:19.1.1-207.gf273685f.el9.x86_64 128/152 2024-08-25T23:51:17.992 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:51:17.992 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-25T23:51:17.992 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-25T23:51:17.992 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-25T23:51:17.992 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:51:18.057 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-rook-2:19.1.1-207.gf273685f.el9.noarch 129/152 2024-08-25T23:51:18.083 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-207.gf273685f.el9.noarch 129/152 2024-08-25T23:51:18.194 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-2:19.1.1-207.gf273685f.el9.x86_64 130/152 2024-08-25T23:51:18.274 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-fuse-2:19.1.1-207.gf273685f.el9.x86_64 131/152 2024-08-25T23:51:19.330 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-25T23:51:19.359 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-radosgw-2:19.1.1-207.gf273685f.el9.x86_64 133/152 2024-08-25T23:51:19.411 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-207.gf273685f.el9.x86_64 133/152 2024-08-25T23:51:19.411 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:51:19.411 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-25T23:51:19.411 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-25T23:51:19.411 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-25T23:51:19.411 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:51:19.477 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-207.gf27368 134/152 2024-08-25T23:51:19.527 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-207.gf27368 134/152 2024-08-25T23:51:19.527 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:51:19.527 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-25T23:51:19.527 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:51:19.578 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-mirror-2:19.1.1-207.gf273685f.el9.x86_64 135/152 2024-08-25T23:51:19.629 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-207.gf273685f.el9.x86_64 135/152 2024-08-25T23:51:19.629 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:51:19.629 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-25T23:51:19.629 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-25T23:51:19.629 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-25T23:51:19.629 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:51:19.978 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-mirror-2:19.1.1-207.gf273685f.el9.x86_64 136/152 2024-08-25T23:51:20.030 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: rbd-mirror-2:19.1.1-207.gf273685f.el9.x86_64 136/152 2024-08-25T23:51:20.030 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-25T23:51:20.030 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-25T23:51:20.030 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-25T23:51:20.030 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-25T23:51:20.030 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:51:20.146 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-25T23:51:20.146 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-2:19.1.1-207.gf273685f.el9.x86_64 1/152 2024-08-25T23:51:20.146 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-base-2:19.1.1-207.gf273685f.el9.x86_64 2/152 2024-08-25T23:51:20.147 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-common-2:19.1.1-207.gf273685f.el9.x86_64 3/152 2024-08-25T23:51:20.147 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-fuse-2:19.1.1-207.gf273685f.el9.x86_64 4/152 2024-08-25T23:51:20.147 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-207.gf27368 5/152 2024-08-25T23:51:20.147 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mds-2:19.1.1-207.gf273685f.el9.x86_64 6/152 2024-08-25T23:51:20.147 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-2:19.1.1-207.gf273685f.el9.x86_64 7/152 2024-08-25T23:51:20.147 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mon-2:19.1.1-207.gf273685f.el9.x86_64 8/152 2024-08-25T23:51:20.147 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-osd-2:19.1.1-207.gf273685f.el9.x86_64 9/152 2024-08-25T23:51:20.147 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-radosgw-2:19.1.1-207.gf273685f.el9.x86_64 10/152 2024-08-25T23:51:20.147 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-selinux-2:19.1.1-207.gf273685f.el9.x86_64 11/152 2024-08-25T23:51:20.147 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-test-2:19.1.1-207.gf273685f.el9.x86_64 12/152 2024-08-25T23:51:20.147 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-mirror-2:19.1.1-207.gf273685f.el9.x86_64 13/152 2024-08-25T23:51:20.147 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-shell-2:19.1.1-207.gf273685f.el9.x86_64 14/152 2024-08-25T23:51:20.147 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs-devel-2:19.1.1-207.gf273685f.el9.x86_6 15/152 2024-08-25T23:51:20.147 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs2-2:19.1.1-207.gf273685f.el9.x86_64 16/152 2024-08-25T23:51:20.148 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephsqlite-2:19.1.1-207.gf273685f.el9.x86_64 17/152 2024-08-25T23:51:20.148 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados-devel-2:19.1.1-207.gf273685f.el9.x86_64 18/152 2024-08-25T23:51:20.148 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libradosstriper1-2:19.1.1-207.gf273685f.el9.x86_ 19/152 2024-08-25T23:51:20.148 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librgw2-2:19.1.1-207.gf273685f.el9.x86_64 20/152 2024-08-25T23:51:20.148 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-argparse-2:19.1.1-207.gf273685f.el9 21/152 2024-08-25T23:51:20.148 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-common-2:19.1.1-207.gf273685f.el9.x 22/152 2024-08-25T23:51:20.148 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cephfs-2:19.1.1-207.gf273685f.el9.x86_64 23/152 2024-08-25T23:51:20.148 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rados-2:19.1.1-207.gf273685f.el9.x86_64 24/152 2024-08-25T23:51:20.148 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rbd-2:19.1.1-207.gf273685f.el9.x86_64 25/152 2024-08-25T23:51:20.148 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rgw-2:19.1.1-207.gf273685f.el9.x86_64 26/152 2024-08-25T23:51:20.148 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-fuse-2:19.1.1-207.gf273685f.el9.x86_64 27/152 2024-08-25T23:51:20.148 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-mirror-2:19.1.1-207.gf273685f.el9.x86_64 28/152 2024-08-25T23:51:20.148 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-nbd-2:19.1.1-207.gf273685f.el9.x86_64 29/152 2024-08-25T23:51:20.148 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-207.gf273685f.e 30/152 2024-08-25T23:51:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-207.gf273685f.el9.noar 31/152 2024-08-25T23:51:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-207.gf273685f.el9.no 32/152 2024-08-25T23:51:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-207.gf273 33/152 2024-08-25T23:51:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-207.gf273685f.el9 34/152 2024-08-25T23:51:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-rook-2:19.1.1-207.gf273685f.el9.noarch 35/152 2024-08-25T23:51:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-207.gf273685f.el 36/152 2024-08-25T23:51:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-volume-2:19.1.1-207.gf273685f.el9.noarch 37/152 2024-08-25T23:51:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephadm-2:19.1.1-207.gf273685f.el9.noarch 38/152 2024-08-25T23:51:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-top-2:19.1.1-207.gf273685f.el9.noarch 39/152 2024-08-25T23:51:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-25T23:51:20.159 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-25T23:51:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-25T23:51:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-25T23:51:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-25T23:51:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-25T23:51:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-25T23:51:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-25T23:51:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-25T23:51:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-25T23:51:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-25T23:51:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-25T23:51:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-25T23:51:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-25T23:51:20.160 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-25T23:51:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-25T23:51:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-25T23:51:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-25T23:51:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-25T23:51:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-25T23:51:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-25T23:51:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-25T23:51:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-25T23:51:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-25T23:51:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-25T23:51:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-25T23:51:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-0.3.26-1.el9.x86_64 66/152 2024-08-25T23:51:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-openmp-0.3.26-1.el9.x86_64 67/152 2024-08-25T23:51:20.161 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-25T23:51:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-25T23:51:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-25T23:51:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-25T23:51:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-25T23:51:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-25T23:51:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-25T23:51:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-25T23:51:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-25T23:51:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-devel-3.9.19-7.el9.x86_64 77/152 2024-08-25T23:51:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-25T23:51:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-25T23:51:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-25T23:51:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-25T23:51:20.162 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-25T23:51:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-25T23:51:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-25T23:51:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-25T23:51:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-25T23:51:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-25T23:51:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-25T23:51:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-25T23:51:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-25T23:51:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-25T23:51:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-25T23:51:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-25T23:51:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-25T23:51:20.163 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-25T23:51:20.164 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-25T23:51:20.164 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-25T23:51:20.164 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-25T23:51:20.164 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-25T23:51:20.164 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-25T23:51:20.164 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-25T23:51:20.164 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-25T23:51:20.164 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-25T23:51:20.164 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-25T23:51:20.164 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-25T23:51:20.164 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-25T23:51:20.164 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-25T23:51:20.164 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-25T23:51:20.164 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-25T23:51:20.165 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-25T23:51:20.165 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-25T23:51:20.165 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-25T23:51:20.165 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-25T23:51:20.165 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-25T23:51:20.165 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-25T23:51:20.165 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-25T23:51:20.165 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-25T23:51:20.165 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-25T23:51:20.165 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-25T23:51:20.165 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-25T23:51:20.165 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-25T23:51:20.165 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-25T23:51:20.165 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-25T23:51:20.166 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-25T23:51:20.166 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-25T23:51:20.166 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-25T23:51:20.166 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-25T23:51:20.166 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-25T23:51:20.166 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-25T23:51:20.166 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-25T23:51:20.166 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-25T23:51:20.166 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-25T23:51:20.166 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-25T23:51:20.166 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-25T23:51:20.166 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-25T23:51:20.166 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-25T23:51:20.166 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-25T23:51:20.167 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-25T23:51:20.167 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-25T23:51:20.167 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-25T23:51:20.167 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-25T23:51:20.167 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-25T23:51:20.167 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-08-25T23:51:20.167 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-25T23:51:20.167 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-25T23:51:20.167 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-25T23:51:20.167 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-25T23:51:20.167 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-25T23:51:20.167 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:19.1.1-207.gf273685f.el9.x86_64 149/152 2024-08-25T23:51:20.167 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-25T23:51:20.168 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:19.1.1-207.gf273685f.el9.x86_64 151/152 2024-08-25T23:51:22.460 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-25T23:51:22.460 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-08-25T23:51:22.460 INFO:teuthology.orchestra.run.smithi043.stdout:Upgraded: 2024-08-25T23:51:22.460 INFO:teuthology.orchestra.run.smithi043.stdout: librados2-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.461 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.461 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-08-25T23:51:22.461 INFO:teuthology.orchestra.run.smithi043.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-25T23:51:22.461 INFO:teuthology.orchestra.run.smithi043.stdout: automake-1.16.2-8.el9.noarch 2024-08-25T23:51:22.461 INFO:teuthology.orchestra.run.smithi043.stdout: bison-3.7.4-5.el9.x86_64 2024-08-25T23:51:22.461 INFO:teuthology.orchestra.run.smithi043.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-25T23:51:22.461 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.461 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.461 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.461 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.461 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:22.461 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.461 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.461 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.462 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:22.462 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:22.462 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:22.462 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:22.462 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:22.462 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.462 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.462 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:22.462 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.462 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.462 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.462 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:22.462 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:22.463 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-mirror-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.463 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-shell-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.463 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-top-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:22.463 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-25T23:51:22.463 INFO:teuthology.orchestra.run.smithi043.stdout: flex-2.6.4-9.el9.x86_64 2024-08-25T23:51:22.463 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-25T23:51:22.463 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-25T23:51:22.463 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-25T23:51:22.463 INFO:teuthology.orchestra.run.smithi043.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-25T23:51:22.463 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-25T23:51:22.463 INFO:teuthology.orchestra.run.smithi043.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-25T23:51:22.463 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-25T23:51:22.464 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-25T23:51:22.464 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-25T23:51:22.464 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.464 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.464 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.464 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-25T23:51:22.464 INFO:teuthology.orchestra.run.smithi043.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-25T23:51:22.464 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-25T23:51:22.464 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-25T23:51:22.464 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-25T23:51:22.464 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.464 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.464 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-25T23:51:22.464 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.465 INFO:teuthology.orchestra.run.smithi043.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-25T23:51:22.465 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-25T23:51:22.465 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-25T23:51:22.465 INFO:teuthology.orchestra.run.smithi043.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-25T23:51:22.465 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-25T23:51:22.465 INFO:teuthology.orchestra.run.smithi043.stdout: lua-5.4.4-4.el9.x86_64 2024-08-25T23:51:22.465 INFO:teuthology.orchestra.run.smithi043.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-25T23:51:22.465 INFO:teuthology.orchestra.run.smithi043.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-25T23:51:22.465 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-0.3.26-1.el9.x86_64 2024-08-25T23:51:22.465 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-openmp-0.3.26-1.el9.x86_64 2024-08-25T23:51:22.465 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-25T23:51:22.465 INFO:teuthology.orchestra.run.smithi043.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-25T23:51:22.465 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-13.16-1.el9.x86_64 2024-08-25T23:51:22.465 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-25T23:51:22.465 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-25T23:51:22.466 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-25T23:51:22.466 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-25T23:51:22.466 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-25T23:51:22.466 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-25T23:51:22.466 INFO:teuthology.orchestra.run.smithi043.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-25T23:51:22.466 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-25T23:51:22.466 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-25T23:51:22.466 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-25T23:51:22.466 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.466 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.466 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.466 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-25T23:51:22.466 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-25T23:51:22.467 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-25T23:51:22.467 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-25T23:51:22.467 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-25T23:51:22.467 INFO:teuthology.orchestra.run.smithi043.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-25T23:51:22.467 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-25T23:51:22.467 INFO:teuthology.orchestra.run.smithi043.stdout: python3-devel-3.9.19-7.el9.x86_64 2024-08-25T23:51:22.467 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-25T23:51:22.467 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-25T23:51:22.467 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-25T23:51:22.467 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-25T23:51:22.467 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-25T23:51:22.467 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-25T23:51:22.467 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-25T23:51:22.467 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-25T23:51:22.468 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-25T23:51:22.468 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-25T23:51:22.468 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-25T23:51:22.468 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-25T23:51:22.468 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-25T23:51:22.468 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-25T23:51:22.468 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-25T23:51:22.468 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-25T23:51:22.468 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-25T23:51:22.468 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-25T23:51:22.468 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-25T23:51:22.468 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-25T23:51:22.468 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-25T23:51:22.468 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-25T23:51:22.469 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ply-3.11-14.el9.noarch 2024-08-25T23:51:22.469 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-25T23:51:22.469 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-25T23:51:22.469 INFO:teuthology.orchestra.run.smithi043.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-25T23:51:22.469 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-25T23:51:22.469 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-25T23:51:22.469 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-25T23:51:22.469 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-25T23:51:22.469 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-25T23:51:22.469 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-25T23:51:22.469 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.469 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.469 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-25T23:51:22.469 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-25T23:51:22.470 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-25T23:51:22.470 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.470 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-25T23:51:22.470 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-25T23:51:22.470 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-25T23:51:22.470 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-25T23:51:22.470 INFO:teuthology.orchestra.run.smithi043.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-25T23:51:22.470 INFO:teuthology.orchestra.run.smithi043.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-25T23:51:22.470 INFO:teuthology.orchestra.run.smithi043.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-25T23:51:22.470 INFO:teuthology.orchestra.run.smithi043.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-25T23:51:22.470 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-25T23:51:22.470 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-25T23:51:22.470 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-25T23:51:22.470 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-25T23:51:22.470 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-25T23:51:22.471 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-25T23:51:22.471 INFO:teuthology.orchestra.run.smithi043.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-25T23:51:22.471 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.471 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.471 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:22.471 INFO:teuthology.orchestra.run.smithi043.stdout: re2-1:20211101-20.el9.x86_64 2024-08-25T23:51:22.471 INFO:teuthology.orchestra.run.smithi043.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-25T23:51:22.471 INFO:teuthology.orchestra.run.smithi043.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-25T23:51:22.471 INFO:teuthology.orchestra.run.smithi043.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-25T23:51:22.471 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-25T23:51:22.471 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-25T23:51:22.471 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-25T23:51:22.471 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-08-25T23:51:22.471 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-08-25T23:51:22.797 DEBUG:teuthology.parallel:result is None 2024-08-25T23:51:25.310 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-test-2:19.1.1-207.gf273685f.el9.x86_64 137/152 2024-08-25T23:51:25.360 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-fuse-2:19.1.1-207.gf273685f.el9.x86_64 138/152 2024-08-25T23:51:25.422 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-nbd-2:19.1.1-207.gf273685f.el9.x86_64 139/152 2024-08-25T23:51:25.457 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-25T23:51:25.493 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-25T23:51:25.743 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-shell-2:19.1.1-207.gf273685f.el9.x86_64 142/152 2024-08-25T23:51:25.798 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-25T23:51:25.828 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs-devel-2:19.1.1-207.gf273685f.el9.x86_6 144/152 2024-08-25T23:51:26.633 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-25T23:51:26.694 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-25T23:51:26.740 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-25T23:51:28.116 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-top-2:19.1.1-207.gf273685f.el9.noarch 146/152 2024-08-25T23:51:28.227 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-25T23:51:28.280 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-25T23:51:28.408 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-25T23:51:28.449 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-25T23:51:28.449 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-25T23:51:28.548 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-25T23:51:28.548 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-25T23:51:28.923 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-25T23:51:28.923 INFO:teuthology.orchestra.run.smithi042.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-25T23:51:28.923 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:51:34.370 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-2:19.1.1-207.gf273685f.el9.x86_64 1/152 2024-08-25T23:51:34.370 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-base-2:19.1.1-207.gf273685f.el9.x86_64 2/152 2024-08-25T23:51:34.370 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-common-2:19.1.1-207.gf273685f.el9.x86_64 3/152 2024-08-25T23:51:34.370 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-fuse-2:19.1.1-207.gf273685f.el9.x86_64 4/152 2024-08-25T23:51:34.370 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-207.gf27368 5/152 2024-08-25T23:51:34.371 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mds-2:19.1.1-207.gf273685f.el9.x86_64 6/152 2024-08-25T23:51:34.371 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-2:19.1.1-207.gf273685f.el9.x86_64 7/152 2024-08-25T23:51:34.371 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mon-2:19.1.1-207.gf273685f.el9.x86_64 8/152 2024-08-25T23:51:34.371 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-osd-2:19.1.1-207.gf273685f.el9.x86_64 9/152 2024-08-25T23:51:34.371 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-radosgw-2:19.1.1-207.gf273685f.el9.x86_64 10/152 2024-08-25T23:51:34.371 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-selinux-2:19.1.1-207.gf273685f.el9.x86_64 11/152 2024-08-25T23:51:34.371 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-test-2:19.1.1-207.gf273685f.el9.x86_64 12/152 2024-08-25T23:51:34.371 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-mirror-2:19.1.1-207.gf273685f.el9.x86_64 13/152 2024-08-25T23:51:34.371 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-shell-2:19.1.1-207.gf273685f.el9.x86_64 14/152 2024-08-25T23:51:34.371 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs-devel-2:19.1.1-207.gf273685f.el9.x86_6 15/152 2024-08-25T23:51:34.371 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs2-2:19.1.1-207.gf273685f.el9.x86_64 16/152 2024-08-25T23:51:34.371 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephsqlite-2:19.1.1-207.gf273685f.el9.x86_64 17/152 2024-08-25T23:51:34.371 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados-devel-2:19.1.1-207.gf273685f.el9.x86_64 18/152 2024-08-25T23:51:34.371 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libradosstriper1-2:19.1.1-207.gf273685f.el9.x86_ 19/152 2024-08-25T23:51:34.372 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librgw2-2:19.1.1-207.gf273685f.el9.x86_64 20/152 2024-08-25T23:51:34.372 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-argparse-2:19.1.1-207.gf273685f.el9 21/152 2024-08-25T23:51:34.372 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-common-2:19.1.1-207.gf273685f.el9.x 22/152 2024-08-25T23:51:34.372 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cephfs-2:19.1.1-207.gf273685f.el9.x86_64 23/152 2024-08-25T23:51:34.372 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rados-2:19.1.1-207.gf273685f.el9.x86_64 24/152 2024-08-25T23:51:34.372 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rbd-2:19.1.1-207.gf273685f.el9.x86_64 25/152 2024-08-25T23:51:34.383 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rgw-2:19.1.1-207.gf273685f.el9.x86_64 26/152 2024-08-25T23:51:34.383 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-fuse-2:19.1.1-207.gf273685f.el9.x86_64 27/152 2024-08-25T23:51:34.383 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-mirror-2:19.1.1-207.gf273685f.el9.x86_64 28/152 2024-08-25T23:51:34.383 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-nbd-2:19.1.1-207.gf273685f.el9.x86_64 29/152 2024-08-25T23:51:34.383 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-207.gf273685f.e 30/152 2024-08-25T23:51:34.383 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-207.gf273685f.el9.noar 31/152 2024-08-25T23:51:34.383 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-207.gf273685f.el9.no 32/152 2024-08-25T23:51:34.383 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-207.gf273 33/152 2024-08-25T23:51:34.383 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-207.gf273685f.el9 34/152 2024-08-25T23:51:34.383 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-rook-2:19.1.1-207.gf273685f.el9.noarch 35/152 2024-08-25T23:51:34.383 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-207.gf273685f.el 36/152 2024-08-25T23:51:34.384 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-volume-2:19.1.1-207.gf273685f.el9.noarch 37/152 2024-08-25T23:51:34.384 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephadm-2:19.1.1-207.gf273685f.el9.noarch 38/152 2024-08-25T23:51:34.384 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-top-2:19.1.1-207.gf273685f.el9.noarch 39/152 2024-08-25T23:51:34.384 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-25T23:51:34.384 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-25T23:51:34.384 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-25T23:51:34.384 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-25T23:51:34.384 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-25T23:51:34.384 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-25T23:51:34.384 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-25T23:51:34.384 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-25T23:51:34.384 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-25T23:51:34.384 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-25T23:51:34.384 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-25T23:51:34.385 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-25T23:51:34.385 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-25T23:51:34.385 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-25T23:51:34.385 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-25T23:51:34.385 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-25T23:51:34.385 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-25T23:51:34.385 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-25T23:51:34.385 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-25T23:51:34.385 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-25T23:51:34.385 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-25T23:51:34.385 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-25T23:51:34.385 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-25T23:51:34.385 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-25T23:51:34.385 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-25T23:51:34.385 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-25T23:51:34.386 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-0.3.26-1.el9.x86_64 66/152 2024-08-25T23:51:34.386 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-openmp-0.3.26-1.el9.x86_64 67/152 2024-08-25T23:51:34.386 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-25T23:51:34.386 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-25T23:51:34.386 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-25T23:51:34.386 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-25T23:51:34.386 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-25T23:51:34.386 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-25T23:51:34.386 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-25T23:51:34.386 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-25T23:51:34.386 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-25T23:51:34.386 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-devel-3.9.19-7.el9.x86_64 77/152 2024-08-25T23:51:34.386 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-25T23:51:34.386 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-25T23:51:34.387 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-25T23:51:34.387 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-25T23:51:34.387 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-25T23:51:34.387 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-25T23:51:34.387 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-25T23:51:34.387 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-25T23:51:34.387 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-25T23:51:34.387 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-25T23:51:34.387 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-25T23:51:34.387 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-25T23:51:34.387 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-25T23:51:34.387 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-25T23:51:34.387 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-25T23:51:34.387 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-25T23:51:34.387 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-25T23:51:34.388 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-25T23:51:34.388 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-25T23:51:34.388 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-25T23:51:34.388 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-25T23:51:34.388 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-25T23:51:34.388 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-25T23:51:34.388 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-25T23:51:34.388 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-25T23:51:34.388 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-25T23:51:34.388 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-25T23:51:34.388 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-25T23:51:34.388 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-25T23:51:34.388 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-25T23:51:34.388 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-25T23:51:34.389 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-25T23:51:34.389 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-25T23:51:34.389 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-25T23:51:34.389 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-25T23:51:34.389 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-25T23:51:34.389 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-25T23:51:34.389 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-25T23:51:34.389 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-25T23:51:34.389 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-25T23:51:34.389 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-25T23:51:34.389 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-25T23:51:34.389 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-25T23:51:34.389 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-25T23:51:34.389 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-25T23:51:34.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-25T23:51:34.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-25T23:51:34.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-25T23:51:34.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-25T23:51:34.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-25T23:51:34.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-25T23:51:34.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-25T23:51:34.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-25T23:51:34.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-25T23:51:34.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-25T23:51:34.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-25T23:51:34.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-25T23:51:34.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-25T23:51:34.390 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-25T23:51:34.391 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-25T23:51:34.391 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-25T23:51:34.391 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-25T23:51:34.391 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-25T23:51:34.391 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-25T23:51:34.391 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-25T23:51:34.391 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-08-25T23:51:34.391 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-25T23:51:34.391 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-25T23:51:34.391 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-25T23:51:34.391 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-25T23:51:34.391 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-25T23:51:34.391 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:19.1.1-207.gf273685f.el9.x86_64 149/152 2024-08-25T23:51:34.391 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-25T23:51:34.391 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:19.1.1-207.gf273685f.el9.x86_64 151/152 2024-08-25T23:51:36.927 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-25T23:51:36.927 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:51:36.927 INFO:teuthology.orchestra.run.smithi042.stdout:Upgraded: 2024-08-25T23:51:36.928 INFO:teuthology.orchestra.run.smithi042.stdout: librados2-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.928 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.928 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-08-25T23:51:36.928 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-25T23:51:36.928 INFO:teuthology.orchestra.run.smithi042.stdout: automake-1.16.2-8.el9.noarch 2024-08-25T23:51:36.928 INFO:teuthology.orchestra.run.smithi042.stdout: bison-3.7.4-5.el9.x86_64 2024-08-25T23:51:36.928 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-25T23:51:36.928 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.928 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.928 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.928 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.928 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:36.928 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.929 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.929 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.929 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:36.929 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:36.929 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:36.929 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:36.929 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:36.929 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.929 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.929 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:36.929 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.929 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.929 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.929 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:36.929 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:36.930 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-mirror-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.930 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-shell-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.930 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-top-2:19.1.1-207.gf273685f.el9.noarch 2024-08-25T23:51:36.930 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-25T23:51:36.930 INFO:teuthology.orchestra.run.smithi042.stdout: flex-2.6.4-9.el9.x86_64 2024-08-25T23:51:36.930 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-25T23:51:36.930 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-25T23:51:36.930 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-25T23:51:36.930 INFO:teuthology.orchestra.run.smithi042.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-25T23:51:36.930 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-25T23:51:36.930 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-25T23:51:36.930 INFO:teuthology.orchestra.run.smithi042.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-25T23:51:36.930 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-25T23:51:36.931 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-25T23:51:36.931 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.931 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.931 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.931 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-25T23:51:36.931 INFO:teuthology.orchestra.run.smithi042.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-25T23:51:36.931 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-25T23:51:36.931 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-25T23:51:36.931 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-25T23:51:36.931 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.931 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.931 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-25T23:51:36.931 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.931 INFO:teuthology.orchestra.run.smithi042.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-25T23:51:36.932 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-25T23:51:36.932 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-25T23:51:36.932 INFO:teuthology.orchestra.run.smithi042.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-25T23:51:36.932 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-25T23:51:36.932 INFO:teuthology.orchestra.run.smithi042.stdout: lua-5.4.4-4.el9.x86_64 2024-08-25T23:51:36.932 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-25T23:51:36.932 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-25T23:51:36.932 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-0.3.26-1.el9.x86_64 2024-08-25T23:51:36.932 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp-0.3.26-1.el9.x86_64 2024-08-25T23:51:36.932 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-25T23:51:36.932 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-25T23:51:36.932 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-13.16-1.el9.x86_64 2024-08-25T23:51:36.932 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-25T23:51:36.932 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-25T23:51:36.933 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-25T23:51:36.933 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-25T23:51:36.933 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-25T23:51:36.933 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-25T23:51:36.933 INFO:teuthology.orchestra.run.smithi042.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-25T23:51:36.933 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-25T23:51:36.933 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-25T23:51:36.933 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-25T23:51:36.933 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.933 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.933 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.933 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-25T23:51:36.933 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-25T23:51:36.933 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-25T23:51:36.934 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-25T23:51:36.934 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-25T23:51:36.934 INFO:teuthology.orchestra.run.smithi042.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-25T23:51:36.934 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-25T23:51:36.934 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel-3.9.19-7.el9.x86_64 2024-08-25T23:51:36.934 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-25T23:51:36.934 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-25T23:51:36.934 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-25T23:51:36.934 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-25T23:51:36.934 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-25T23:51:36.934 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-25T23:51:36.934 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-25T23:51:36.934 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-25T23:51:36.934 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-25T23:51:36.935 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-25T23:51:36.935 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-25T23:51:36.935 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-25T23:51:36.935 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-25T23:51:36.935 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-25T23:51:36.935 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-25T23:51:36.935 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-25T23:51:36.935 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-25T23:51:36.935 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-25T23:51:36.935 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-25T23:51:36.935 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-25T23:51:36.935 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-25T23:51:36.935 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-25T23:51:36.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply-3.11-14.el9.noarch 2024-08-25T23:51:36.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-25T23:51:36.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-25T23:51:36.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-25T23:51:36.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-25T23:51:36.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-25T23:51:36.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-25T23:51:36.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-25T23:51:36.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-25T23:51:36.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-25T23:51:36.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-25T23:51:36.937 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-25T23:51:36.937 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-25T23:51:36.937 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.937 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-25T23:51:36.937 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-25T23:51:36.937 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-25T23:51:36.937 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-25T23:51:36.937 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-25T23:51:36.937 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-25T23:51:36.937 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-25T23:51:36.937 INFO:teuthology.orchestra.run.smithi042.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-25T23:51:36.937 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-25T23:51:36.937 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-25T23:51:36.937 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-25T23:51:36.938 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-25T23:51:36.938 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-25T23:51:36.938 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-25T23:51:36.938 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-25T23:51:36.938 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.938 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.938 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd-2:19.1.1-207.gf273685f.el9.x86_64 2024-08-25T23:51:36.938 INFO:teuthology.orchestra.run.smithi042.stdout: re2-1:20211101-20.el9.x86_64 2024-08-25T23:51:36.938 INFO:teuthology.orchestra.run.smithi042.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-25T23:51:36.938 INFO:teuthology.orchestra.run.smithi042.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-25T23:51:36.938 INFO:teuthology.orchestra.run.smithi042.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-25T23:51:36.938 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-25T23:51:36.938 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-25T23:51:36.939 INFO:teuthology.orchestra.run.smithi042.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-25T23:51:36.939 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:51:36.939 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-08-25T23:51:37.439 DEBUG:teuthology.parallel:result is None 2024-08-25T23:51:37.440 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f273685f88d22802ccbd8a96b393734630028a13 2024-08-25T23:51:37.585 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-25T23:51:37.630 INFO:teuthology.orchestra.run.smithi042.stdout:19.1.1-207.gf273685f.el9 2024-08-25T23:51:37.631 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-207.gf273685f.el9 2024-08-25T23:51:37.631 INFO:teuthology.task.install:The correct ceph version 19.1.1-207.gf273685f is installed. 2024-08-25T23:51:37.632 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f273685f88d22802ccbd8a96b393734630028a13 2024-08-25T23:51:37.765 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-25T23:51:37.791 INFO:teuthology.orchestra.run.smithi043.stdout:19.1.1-207.gf273685f.el9 2024-08-25T23:51:37.791 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-207.gf273685f.el9 2024-08-25T23:51:37.792 INFO:teuthology.task.install:The correct ceph version 19.1.1-207.gf273685f is installed. 2024-08-25T23:51:37.793 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f273685f88d22802ccbd8a96b393734630028a13 2024-08-25T23:51:37.926 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-25T23:51:37.954 INFO:teuthology.orchestra.run.smithi181.stdout:19.1.1-207.gf273685f.el9 2024-08-25T23:51:37.954 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-207.gf273685f.el9 2024-08-25T23:51:37.954 INFO:teuthology.task.install:The correct ceph version 19.1.1-207.gf273685f is installed. 2024-08-25T23:51:37.956 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-25T23:51:37.956 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-25T23:51:37.956 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-25T23:51:38.020 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-08-25T23:51:38.020 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-25T23:51:38.052 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-25T23:51:38.052 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-25T23:51:38.084 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-25T23:51:38.085 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-25T23:51:38.085 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/daemon-helper 2024-08-25T23:51:38.142 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-25T23:51:38.239 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-08-25T23:51:38.239 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/daemon-helper 2024-08-25T23:51:38.269 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-25T23:51:38.340 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-25T23:51:38.340 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/daemon-helper 2024-08-25T23:51:38.370 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-25T23:51:38.438 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-25T23:51:38.439 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-25T23:51:38.439 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-25T23:51:38.495 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-25T23:51:38.591 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-08-25T23:51:38.591 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-25T23:51:38.617 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-25T23:51:38.681 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-25T23:51:38.682 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-25T23:51:38.707 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-25T23:51:38.772 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-25T23:51:38.772 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-25T23:51:38.772 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/stdin-killer 2024-08-25T23:51:38.830 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-25T23:51:38.932 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-08-25T23:51:38.932 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/stdin-killer 2024-08-25T23:51:38.957 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-25T23:51:39.021 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-25T23:51:39.022 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/stdin-killer 2024-08-25T23:51:39.047 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-25T23:51:39.112 INFO:teuthology.run_tasks:Running task cephadm... 2024-08-25T23:51:39.200 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'f273685f88d22802ccbd8a96b393734630028a13', 'subvols': {'create': 2}} 2024-08-25T23:51:39.200 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 2024-08-25T23:51:39.201 INFO:tasks.cephadm:Cluster fsid is f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:51:39.201 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-08-25T23:51:39.201 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.42', 'mon.b': '172.21.15.43', 'mon.c': '172.21.15.181'} 2024-08-25T23:51:39.201 INFO:tasks.cephadm:First mon is mon.a on smithi042 2024-08-25T23:51:39.202 INFO:tasks.cephadm:First mgr is x 2024-08-25T23:51:39.202 INFO:tasks.cephadm:Normalizing hostnames... 2024-08-25T23:51:39.202 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname $(hostname -s) 2024-08-25T23:51:39.260 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname $(hostname -s) 2024-08-25T23:51:39.284 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname $(hostname -s) 2024-08-25T23:51:39.309 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-08-25T23:51:39.310 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f273685f88d22802ccbd8a96b393734630028a13 2024-08-25T23:51:39.449 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'f273685f88d22802ccbd8a96b393734630028a13', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/55921/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-207-gf273685f', 'node_name': '172.21.5.32+adami02', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-207.gf273685f'}, 'url': 'https://3.chacra.ceph.com/r/ceph/squid/f273685f88d22802ccbd8a96b393734630028a13/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-08-25 16:16:31.043723', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/squid/f273685f88d22802ccbd8a96b393734630028a13/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-08-25T23:51:39.590 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref squid, sha1 f273685f88d22802ccbd8a96b393734630028a13 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=f273685f88d22802ccbd8a96b393734630028a13 2024-08-25T23:51:39.591 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/squid/f273685f88d22802ccbd8a96b393734630028a13/centos/9/x86_64/flavors/default/cephadm 2024-08-25T23:51:39.591 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/squid/f273685f88d22802ccbd8a96b393734630028a13/centos/9/x86_64/flavors/default/cephadm 2024-08-25T23:51:39.591 DEBUG:teuthology.orchestra.run.smithi042:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/f273685f88d22802ccbd8a96b393734630028a13/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-25T23:51:40.010 INFO:teuthology.orchestra.run.smithi042.stdout:-rw-r--r--. 1 ubuntu ubuntu 784494 Aug 25 23:51 /home/ubuntu/cephtest/cephadm 2024-08-25T23:51:40.010 DEBUG:teuthology.orchestra.run.smithi043:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/f273685f88d22802ccbd8a96b393734630028a13/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-25T23:51:40.389 INFO:teuthology.orchestra.run.smithi043.stdout:-rw-r--r--. 1 ubuntu ubuntu 784494 Aug 25 23:51 /home/ubuntu/cephtest/cephadm 2024-08-25T23:51:40.389 DEBUG:teuthology.orchestra.run.smithi181:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/f273685f88d22802ccbd8a96b393734630028a13/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-25T23:51:40.778 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r--. 1 ubuntu ubuntu 784494 Aug 25 23:51 /home/ubuntu/cephtest/cephadm 2024-08-25T23:51:40.778 DEBUG:teuthology.orchestra.run.smithi042:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-25T23:51:40.816 DEBUG:teuthology.orchestra.run.smithi043:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-25T23:51:40.835 DEBUG:teuthology.orchestra.run.smithi181:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-25T23:51:40.869 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 on all hosts... 2024-08-25T23:51:40.869 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 pull 2024-08-25T23:51:40.873 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 pull 2024-08-25T23:51:40.877 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 pull 2024-08-25T23:51:42.334 INFO:teuthology.orchestra.run.smithi181.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13... 2024-08-25T23:51:42.558 INFO:teuthology.orchestra.run.smithi043.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13... 2024-08-25T23:51:43.002 INFO:teuthology.orchestra.run.smithi042.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13... 2024-08-25T23:52:13.012 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-25T23:52:13.012 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_version": "ceph version 19.1.1-207-gf273685f (f273685f88d22802ccbd8a96b393734630028a13) squid (rc)", 2024-08-25T23:52:13.012 INFO:teuthology.orchestra.run.smithi042.stdout: "image_id": "c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4", 2024-08-25T23:52:13.012 INFO:teuthology.orchestra.run.smithi042.stdout: "repo_digests": [ 2024-08-25T23:52:13.012 INFO:teuthology.orchestra.run.smithi042.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34" 2024-08-25T23:52:13.012 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-08-25T23:52:13.012 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-25T23:52:15.731 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-08-25T23:52:15.731 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_version": "ceph version 19.1.1-207-gf273685f (f273685f88d22802ccbd8a96b393734630028a13) squid (rc)", 2024-08-25T23:52:15.731 INFO:teuthology.orchestra.run.smithi181.stdout: "image_id": "c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4", 2024-08-25T23:52:15.731 INFO:teuthology.orchestra.run.smithi181.stdout: "repo_digests": [ 2024-08-25T23:52:15.731 INFO:teuthology.orchestra.run.smithi181.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34" 2024-08-25T23:52:15.731 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-08-25T23:52:15.731 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-08-25T23:52:18.582 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-08-25T23:52:18.583 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_version": "ceph version 19.1.1-207-gf273685f (f273685f88d22802ccbd8a96b393734630028a13) squid (rc)", 2024-08-25T23:52:18.583 INFO:teuthology.orchestra.run.smithi043.stdout: "image_id": "c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4", 2024-08-25T23:52:18.583 INFO:teuthology.orchestra.run.smithi043.stdout: "repo_digests": [ 2024-08-25T23:52:18.583 INFO:teuthology.orchestra.run.smithi043.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34" 2024-08-25T23:52:18.583 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-08-25T23:52:18.583 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-08-25T23:52:18.608 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /etc/ceph 2024-08-25T23:52:18.674 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph 2024-08-25T23:52:18.701 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /etc/ceph 2024-08-25T23:52:18.734 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 777 /etc/ceph 2024-08-25T23:52:18.793 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 777 /etc/ceph 2024-08-25T23:52:18.818 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 777 /etc/ceph 2024-08-25T23:52:18.846 INFO:tasks.cephadm:Writing seed config... 2024-08-25T23:52:18.847 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-08-25T23:52:18.848 INFO:tasks.cephadm: override: [client] debug client = 20 2024-08-25T23:52:18.848 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-08-25T23:52:18.848 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-08-25T23:52:18.848 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-08-25T23:52:18.848 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-08-25T23:52:18.848 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-08-25T23:52:18.848 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-08-25T23:52:18.848 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-08-25T23:52:18.848 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-08-25T23:52:18.848 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-08-25T23:52:18.848 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-08-25T23:52:18.848 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-08-25T23:52:18.848 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-08-25T23:52:18.849 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-08-25T23:52:18.849 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-08-25T23:52:18.849 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-08-25T23:52:18.849 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-08-25T23:52:18.849 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-08-25T23:52:18.849 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-08-25T23:52:18.849 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-08-25T23:52:18.849 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-08-25T23:52:18.849 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-08-25T23:52:18.849 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-08-25T23:52:18.849 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-08-25T23:52:18.849 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-08-25T23:52:18.849 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-08-25T23:52:18.849 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-08-25T23:52:18.849 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-08-25T23:52:18.850 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-08-25T23:52:18.850 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-08-25T23:52:18.850 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-08-25T23:52:18.850 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-08-25T23:52:18.850 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-08-25T23:52:18.850 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-08-25T23:52:18.850 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-08-25T23:52:18.850 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-08-25T23:52:18.850 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-08-25T23:52:18.850 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-08-25T23:52:18.850 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-08-25T23:52:18.850 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-08-25T23:52:18.850 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-08-25T23:52:18.850 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-08-25T23:52:18.850 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-08-25T23:52:18.851 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-08-25T23:52:18.851 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-08-25T23:52:18.851 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-08-25T23:52:18.851 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-08-25T23:52:18.851 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-25T23:52:18.851 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-08-25T23:52:18.886 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f89d317a-633c-11ef-bcd2-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-08-25T23:52:18.887 DEBUG:teuthology.orchestra.run.smithi042:mon.a> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mon.a.service 2024-08-25T23:52:18.932 DEBUG:teuthology.orchestra.run.smithi042:mgr.x> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mgr.x.service 2024-08-25T23:52:18.976 INFO:tasks.cephadm:Bootstrapping... 2024-08-25T23:52:18.977 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 -v bootstrap --fsid f89d317a-633c-11ef-bcd2-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.42 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-08-25T23:52:19.251 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-08-25T23:52:19.251 INFO:teuthology.orchestra.run.smithi042.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13', '-v', 'bootstrap', '--fsid', 'f89d317a-633c-11ef-bcd2-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.42', '--skip-admin-label'] 2024-08-25T23:52:19.252 INFO:teuthology.orchestra.run.smithi042.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-08-25T23:52:19.252 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying podman|docker is present... 2024-08-25T23:52:19.302 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stdout 5.2.1 2024-08-25T23:52:19.302 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying lvm2 is present... 2024-08-25T23:52:19.302 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying time synchronization is in place... 2024-08-25T23:52:19.316 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-25T23:52:19.316 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-25T23:52:19.329 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-25T23:52:19.329 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-08-25T23:52:19.343 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout enabled 2024-08-25T23:52:19.355 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout active 2024-08-25T23:52:19.355 INFO:teuthology.orchestra.run.smithi042.stdout:Unit chronyd.service is enabled and running 2024-08-25T23:52:19.356 INFO:teuthology.orchestra.run.smithi042.stdout:Repeating the final host check... 2024-08-25T23:52:19.400 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stdout 5.2.1 2024-08-25T23:52:19.400 INFO:teuthology.orchestra.run.smithi042.stdout:podman (/bin/podman) version 5.2.1 is present 2024-08-25T23:52:19.400 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl is present 2024-08-25T23:52:19.400 INFO:teuthology.orchestra.run.smithi042.stdout:lvcreate is present 2024-08-25T23:52:19.413 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-25T23:52:19.414 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-25T23:52:19.427 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-25T23:52:19.427 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-08-25T23:52:19.443 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout enabled 2024-08-25T23:52:19.456 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout active 2024-08-25T23:52:19.456 INFO:teuthology.orchestra.run.smithi042.stdout:Unit chronyd.service is enabled and running 2024-08-25T23:52:19.456 INFO:teuthology.orchestra.run.smithi042.stdout:Host looks OK 2024-08-25T23:52:19.457 INFO:teuthology.orchestra.run.smithi042.stdout:Cluster fsid: f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:52:19.457 INFO:teuthology.orchestra.run.smithi042.stdout:Acquiring lock 140224793371648 on /run/cephadm/f89d317a-633c-11ef-bcd2-c7b262605968.lock 2024-08-25T23:52:19.457 INFO:teuthology.orchestra.run.smithi042.stdout:Lock 140224793371648 acquired on /run/cephadm/f89d317a-633c-11ef-bcd2-c7b262605968.lock 2024-08-25T23:52:19.457 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying IP 172.21.15.42 port 3300 ... 2024-08-25T23:52:19.458 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying IP 172.21.15.42 port 6789 ... 2024-08-25T23:52:19.458 INFO:teuthology.orchestra.run.smithi042.stdout:Base mon IP(s) is [172.21.15.42:3300, 172.21.15.42:6789], mon addrv is [v2:172.21.15.42:3300,v1:172.21.15.42:6789] 2024-08-25T23:52:19.465 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.42 metric 100 2024-08-25T23:52:19.465 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.42 metric 100 2024-08-25T23:52:19.472 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-08-25T23:52:19.472 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-08-25T23:52:19.472 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1791sec hoplimit 64 pref medium 2024-08-25T23:52:19.478 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-08-25T23:52:19.478 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-08-25T23:52:19.478 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-25T23:52:19.478 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-08-25T23:52:19.478 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-08-25T23:52:19.478 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-25T23:52:19.479 INFO:teuthology.orchestra.run.smithi042.stdout:Mon IP `172.21.15.42` is in CIDR network `172.21.0.0/20` 2024-08-25T23:52:19.479 INFO:teuthology.orchestra.run.smithi042.stdout:Mon IP `172.21.15.42` is in CIDR network `172.21.0.0/20` 2024-08-25T23:52:19.479 INFO:teuthology.orchestra.run.smithi042.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-08-25T23:52:19.480 INFO:teuthology.orchestra.run.smithi042.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-08-25T23:52:19.481 INFO:teuthology.orchestra.run.smithi042.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13... 2024-08-25T23:52:29.906 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stdout c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 2024-08-25T23:52:29.906 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13... 2024-08-25T23:52:29.906 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Getting image source signatures 2024-08-25T23:52:29.906 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-08-25T23:52:29.906 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Copying blob sha256:b05f645c3687cb0379c6889d0d6c8d727c4f4f18d819e972c159a66ffbe42eab 2024-08-25T23:52:29.906 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Copying config sha256:c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 2024-08-25T23:52:29.906 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Writing manifest to image destination 2024-08-25T23:52:30.965 INFO:teuthology.orchestra.run.smithi042.stdout:ceph: stdout ceph version 19.1.1-207-gf273685f (f273685f88d22802ccbd8a96b393734630028a13) squid (rc) 2024-08-25T23:52:30.965 INFO:teuthology.orchestra.run.smithi042.stdout:Ceph version: ceph version 19.1.1-207-gf273685f (f273685f88d22802ccbd8a96b393734630028a13) squid (rc) 2024-08-25T23:52:30.965 INFO:teuthology.orchestra.run.smithi042.stdout:Extracting ceph user uid/gid from container image... 2024-08-25T23:52:32.172 INFO:teuthology.orchestra.run.smithi042.stdout:stat: stdout 167 167 2024-08-25T23:52:32.172 INFO:teuthology.orchestra.run.smithi042.stdout:Creating initial keys... 2024-08-25T23:52:33.128 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph-authtool: stdout AQDAw8tmIs3vIBAAx0tyeSGIr/mqE/mwqY4uuQ== 2024-08-25T23:52:34.141 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph-authtool: stdout AQDBw8tmFmW1IBAAXTIRdFmBgYQKIJiGxU2lfA== 2024-08-25T23:52:35.264 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph-authtool: stdout AQDCw8tmuUQfIBAApu2KKPPWGgRahI0UYbc8Cg== 2024-08-25T23:52:35.265 INFO:teuthology.orchestra.run.smithi042.stdout:Creating initial monmap... 2024-08-25T23:52:36.481 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-25T23:52:36.481 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-08-25T23:52:36.481 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:52:36.482 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-25T23:52:36.482 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool for a [v2:172.21.15.42:3300,v1:172.21.15.42:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-25T23:52:36.482 INFO:teuthology.orchestra.run.smithi042.stdout:setting min_mon_release = quincy 2024-08-25T23:52:36.482 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: set fsid to f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:52:36.482 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-25T23:52:36.482 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:52:36.482 INFO:teuthology.orchestra.run.smithi042.stdout:Creating mon... 2024-08-25T23:52:37.500 INFO:teuthology.orchestra.run.smithi042.stdout:create mon.a on 2024-08-25T23:52:37.828 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-08-25T23:52:38.053 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-08-25T23:52:38.358 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f89d317a-633c-11ef-bcd2-c7b262605968.target → /etc/systemd/system/ceph-f89d317a-633c-11ef-bcd2-c7b262605968.target. 2024-08-25T23:52:38.358 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f89d317a-633c-11ef-bcd2-c7b262605968.target → /etc/systemd/system/ceph-f89d317a-633c-11ef-bcd2-c7b262605968.target. 2024-08-25T23:52:38.702 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mon.a 2024-08-25T23:52:38.702 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mon.a.service: Unit ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mon.a.service not loaded. 2024-08-25T23:52:38.974 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f89d317a-633c-11ef-bcd2-c7b262605968.target.wants/ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mon.a.service → /etc/systemd/system/ceph-f89d317a-633c-11ef-bcd2-c7b262605968@.service. 2024-08-25T23:52:39.602 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:39 smithi042 podman[16833]: 2024-08-25 23:52:39.538852175 +0000 UTC m=+0.347198474 container start 58a3398c7cafe92c7df2939c7b051f019869d7705ec36f23e530ff0478409c69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-f273685, ceph=True, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-25T23:52:39.602 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:39 smithi042 ceph-mon[16852]: mkfs f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:52:39.652 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-25T23:52:39.652 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout disabled 2024-08-25T23:52:39.666 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-25T23:52:39.666 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-08-25T23:52:39.667 INFO:teuthology.orchestra.run.smithi042.stdout:firewalld.service is not enabled 2024-08-25T23:52:39.667 INFO:teuthology.orchestra.run.smithi042.stdout:Not possible to enable service . firewalld.service is not available 2024-08-25T23:52:39.667 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mon to start... 2024-08-25T23:52:39.667 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mon... 2024-08-25T23:52:39.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:39 smithi042 ceph-mon[16852]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-25T23:52:39.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:39 smithi042 bash[16833]: 58a3398c7cafe92c7df2939c7b051f019869d7705ec36f23e530ff0478409c69 2024-08-25T23:52:39.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:39 smithi042 systemd[1]: Started Ceph mon.a for f89d317a-633c-11ef-bcd2-c7b262605968. 2024-08-25T23:52:41.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:40 smithi042 ceph-mon[16852]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-25T23:52:41.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:40 smithi042 ceph-mon[16852]: monmap epoch 1 2024-08-25T23:52:41.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:40 smithi042 ceph-mon[16852]: fsid f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:52:41.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:40 smithi042 ceph-mon[16852]: last_changed 2024-08-25T23:52:35.852236+0000 2024-08-25T23:52:41.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:40 smithi042 ceph-mon[16852]: created 2024-08-25T23:52:35.852236+0000 2024-08-25T23:52:41.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:40 smithi042 ceph-mon[16852]: min_mon_release 19 (squid) 2024-08-25T23:52:41.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:40 smithi042 ceph-mon[16852]: election_strategy: 1 2024-08-25T23:52:41.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:40 smithi042 ceph-mon[16852]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-08-25T23:52:41.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:40 smithi042 ceph-mon[16852]: fsmap 2024-08-25T23:52:41.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:40 smithi042 ceph-mon[16852]: osdmap e1: 0 total, 0 up, 0 in 2024-08-25T23:52:41.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:40 smithi042 ceph-mon[16852]: mgrmap e1: no daemons active 2024-08-25T23:52:41.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:40 smithi042 ceph-mon[16852]: from='client.? 172.21.15.42:0/2070890948' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-08-25T23:52:41.073 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout cluster: 2024-08-25T23:52:41.073 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout id: f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:52:41.073 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-08-25T23:52:41.074 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-08-25T23:52:41.074 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout services: 2024-08-25T23:52:41.074 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.641132s) 2024-08-25T23:52:41.074 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-08-25T23:52:41.074 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-08-25T23:52:41.074 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-08-25T23:52:41.074 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout data: 2024-08-25T23:52:41.074 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-08-25T23:52:41.079 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-08-25T23:52:41.079 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-08-25T23:52:41.079 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout pgs: 2024-08-25T23:52:41.079 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-08-25T23:52:41.079 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.160+0000 7f3e78a00640 1 Processor -- start 2024-08-25T23:52:41.079 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.160+0000 7f3e78a00640 1 -- start start 2024-08-25T23:52:41.080 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.161+0000 7f3e78a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e7407de40 0x7f3e7407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:52:41.080 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.161+0000 7f3e78a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7407c830 con 0x7f3e7407de40 2024-08-25T23:52:41.080 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.161+0000 7f3e71e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e7407de40 0x7f3e7407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:52:41.080 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.162+0000 7f3e71e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e7407de40 0x7f3e7407c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60750/0 (socket says 172.21.15.42:60750) 2024-08-25T23:52:41.080 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.162+0000 7f3e71e00640 1 -- 172.21.15.42:0/3163790701 learned_addr learned my addr 172.21.15.42:0/3163790701 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:52:41.080 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.162+0000 7f3e71e00640 1 -- 172.21.15.42:0/3163790701 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e7407c9b0 con 0x7f3e7407de40 2024-08-25T23:52:41.080 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.165+0000 7f3e71e00640 1 --2- 172.21.15.42:0/3163790701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e7407de40 0x7f3e7407c2f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009820 tx=0x7f3e6402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7faa72e520e1a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:52:41.080 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.165+0000 7f3e70a00640 1 -- 172.21.15.42:0/3163790701 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e64037070 con 0x7f3e7407de40 2024-08-25T23:52:41.080 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.165+0000 7f3e70a00640 1 -- 172.21.15.42:0/3163790701 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e64032440 con 0x7f3e7407de40 2024-08-25T23:52:41.080 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.165+0000 7f3e70a00640 1 -- 172.21.15.42:0/3163790701 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e64032740 con 0x7f3e7407de40 2024-08-25T23:52:41.080 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.165+0000 7f3e78a00640 1 -- 172.21.15.42:0/3163790701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e7407de40 msgr2=0x7f3e7407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:52:41.080 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.165+0000 7f3e78a00640 1 --2- 172.21.15.42:0/3163790701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e7407de40 0x7f3e7407c2f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009820 tx=0x7f3e6402a270 comp rx=0 tx=0).stop 2024-08-25T23:52:41.081 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.166+0000 7f3e78a00640 1 -- 172.21.15.42:0/3163790701 shutdown_connections 2024-08-25T23:52:41.081 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.166+0000 7f3e78a00640 1 --2- 172.21.15.42:0/3163790701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e7407de40 0x7f3e7407c2f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:52:41.081 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.166+0000 7f3e78a00640 1 -- 172.21.15.42:0/3163790701 >> 172.21.15.42:0/3163790701 conn(0x7f3e74102ca0 msgr2=0x7f3e741050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:52:41.081 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.166+0000 7f3e78a00640 1 -- 172.21.15.42:0/3163790701 shutdown_connections 2024-08-25T23:52:41.081 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.166+0000 7f3e78a00640 1 -- 172.21.15.42:0/3163790701 wait complete. 2024-08-25T23:52:41.081 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.167+0000 7f3e78a00640 1 Processor -- start 2024-08-25T23:52:41.081 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.167+0000 7f3e78a00640 1 -- start start 2024-08-25T23:52:41.081 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.167+0000 7f3e78a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e7407de40 0x7f3e7419d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:52:41.081 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.167+0000 7f3e78a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7407cee0 con 0x7f3e7407de40 2024-08-25T23:52:41.081 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.167+0000 7f3e71e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e7407de40 0x7f3e7419d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:52:41.081 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.167+0000 7f3e71e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e7407de40 0x7f3e7419d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60756/0 (socket says 172.21.15.42:60756) 2024-08-25T23:52:41.081 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.168+0000 7f3e71e00640 1 -- 172.21.15.42:0/2070890948 learned_addr learned my addr 172.21.15.42:0/2070890948 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:52:41.082 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.168+0000 7f3e71e00640 1 -- 172.21.15.42:0/2070890948 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e7419d660 con 0x7f3e7407de40 2024-08-25T23:52:41.082 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.168+0000 7f3e71e00640 1 --2- 172.21.15.42:0/2070890948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e7407de40 0x7f3e7419d120 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3e640090b0 tx=0x7f3e640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:52:41.082 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.169+0000 7f3e6aa00640 1 -- 172.21.15.42:0/2070890948 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e64041070 con 0x7f3e7407de40 2024-08-25T23:52:41.082 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.169+0000 7f3e6aa00640 1 -- 172.21.15.42:0/2070890948 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e6403c7a0 con 0x7f3e7407de40 2024-08-25T23:52:41.082 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.169+0000 7f3e6aa00640 1 -- 172.21.15.42:0/2070890948 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e64037040 con 0x7f3e7407de40 2024-08-25T23:52:41.082 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.169+0000 7f3e78a00640 1 -- 172.21.15.42:0/2070890948 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e7419d8f0 con 0x7f3e7407de40 2024-08-25T23:52:41.082 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.169+0000 7f3e78a00640 1 -- 172.21.15.42:0/2070890948 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e741a05e0 con 0x7f3e7407de40 2024-08-25T23:52:41.082 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.169+0000 7f3e6aa00640 1 -- 172.21.15.42:0/2070890948 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3e64044070 con 0x7f3e7407de40 2024-08-25T23:52:41.082 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.169+0000 7f3e6aa00640 1 -- 172.21.15.42:0/2070890948 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3e6403d3f0 con 0x7f3e7407de40 2024-08-25T23:52:41.082 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.170+0000 7f3e78a00640 1 -- 172.21.15.42:0/2070890948 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e7407c370 con 0x7f3e7407de40 2024-08-25T23:52:41.082 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.173+0000 7f3e6aa00640 1 -- 172.21.15.42:0/2070890948 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f3e64046450 con 0x7f3e7407de40 2024-08-25T23:52:41.082 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.237+0000 7f3e78a00640 1 -- 172.21.15.42:0/2070890948 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f3e7402d6a0 con 0x7f3e7407de40 2024-08-25T23:52:41.083 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.237+0000 7f3e6aa00640 1 -- 172.21.15.42:0/2070890948 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f3e64046630 con 0x7f3e7407de40 2024-08-25T23:52:41.083 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.238+0000 7f3e78a00640 1 -- 172.21.15.42:0/2070890948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e7407de40 msgr2=0x7f3e7419d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:52:41.083 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.238+0000 7f3e78a00640 1 --2- 172.21.15.42:0/2070890948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e7407de40 0x7f3e7419d120 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3e640090b0 tx=0x7f3e640046c0 comp rx=0 tx=0).stop 2024-08-25T23:52:41.083 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.238+0000 7f3e78a00640 1 -- 172.21.15.42:0/2070890948 shutdown_connections 2024-08-25T23:52:41.083 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.238+0000 7f3e78a00640 1 --2- 172.21.15.42:0/2070890948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e7407de40 0x7f3e7419d120 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:52:41.083 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.238+0000 7f3e78a00640 1 -- 172.21.15.42:0/2070890948 >> 172.21.15.42:0/2070890948 conn(0x7f3e74102ca0 msgr2=0x7f3e74104070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:52:41.083 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.238+0000 7f3e78a00640 1 -- 172.21.15.42:0/2070890948 shutdown_connections 2024-08-25T23:52:41.083 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:40.238+0000 7f3e78a00640 1 -- 172.21.15.42:0/2070890948 wait complete. 2024-08-25T23:52:41.083 INFO:teuthology.orchestra.run.smithi042.stdout:mon is available 2024-08-25T23:52:41.084 INFO:teuthology.orchestra.run.smithi042.stdout:Assimilating anything we can from ceph.conf... 2024-08-25T23:52:41.994 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:41 smithi042 ceph-mon[16852]: from='client.? 172.21.15.42:0/3825334817' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-08-25T23:52:41.994 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:41 smithi042 ceph-mon[16852]: from='client.? 172.21.15.42:0/3825334817' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-08-25T23:52:42.301 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-08-25T23:52:42.308 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [global] 2024-08-25T23:52:42.308 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout fsid = f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:52:42.308 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.42:3300,v1:172.21.15.42:6789] 2024-08-25T23:52:42.308 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-25T23:52:42.308 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-25T23:52:42.308 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-25T23:52:42.308 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-25T23:52:42.308 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-08-25T23:52:42.308 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-25T23:52:42.309 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-25T23:52:42.309 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-08-25T23:52:42.309 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [osd] 2024-08-25T23:52:42.309 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-25T23:52:42.309 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-25T23:52:42.309 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-25T23:52:42.309 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-25T23:52:42.309 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-25T23:52:42.309 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.596+0000 7fc00b200640 1 Processor -- start 2024-08-25T23:52:42.309 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.596+0000 7fc00b200640 1 -- start start 2024-08-25T23:52:42.309 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.596+0000 7fc00b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc00c1061c0 0x7fc00c1065c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:52:42.309 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.596+0000 7fc00b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c106b90 con 0x7fc00c1061c0 2024-08-25T23:52:42.309 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.597+0000 7fc009e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc00c1061c0 0x7fc00c1065c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:52:42.310 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.597+0000 7fc009e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc00c1061c0 0x7fc00c1065c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60766/0 (socket says 172.21.15.42:60766) 2024-08-25T23:52:42.310 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.597+0000 7fc009e00640 1 -- 172.21.15.42:0/4158643118 learned_addr learned my addr 172.21.15.42:0/4158643118 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:52:42.310 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.597+0000 7fc009e00640 1 -- 172.21.15.42:0/4158643118 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00c1073c0 con 0x7fc00c1061c0 2024-08-25T23:52:42.310 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.598+0000 7fc009e00640 1 --2- 172.21.15.42:0/4158643118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc00c1061c0 0x7fc00c1065c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00d180 tx=0x7fbffc02c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ff5a8b47264983 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:52:42.310 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.599+0000 7fc009400640 1 -- 172.21.15.42:0/4158643118 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbffc00b410 con 0x7fc00c1061c0 2024-08-25T23:52:42.310 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.599+0000 7fc009400640 1 -- 172.21.15.42:0/4158643118 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbffc009600 con 0x7fc00c1061c0 2024-08-25T23:52:42.310 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.599+0000 7fc009400640 1 -- 172.21.15.42:0/4158643118 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbffc009900 con 0x7fc00c1061c0 2024-08-25T23:52:42.310 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.599+0000 7fc00b200640 1 -- 172.21.15.42:0/4158643118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc00c1061c0 msgr2=0x7fc00c1065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:52:42.310 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.599+0000 7fc00b200640 1 --2- 172.21.15.42:0/4158643118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc00c1061c0 0x7fc00c1065c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00d180 tx=0x7fbffc02c9a0 comp rx=0 tx=0).stop 2024-08-25T23:52:42.310 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.599+0000 7fc00b200640 1 -- 172.21.15.42:0/4158643118 shutdown_connections 2024-08-25T23:52:42.310 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.599+0000 7fc00b200640 1 --2- 172.21.15.42:0/4158643118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc00c1061c0 0x7fc00c1065c0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:52:42.310 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.599+0000 7fc00b200640 1 -- 172.21.15.42:0/4158643118 >> 172.21.15.42:0/4158643118 conn(0x7fc00c1019d0 msgr2=0x7fc00c103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:52:42.311 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.599+0000 7fc00b200640 1 -- 172.21.15.42:0/4158643118 shutdown_connections 2024-08-25T23:52:42.311 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.599+0000 7fc00b200640 1 -- 172.21.15.42:0/4158643118 wait complete. 2024-08-25T23:52:42.311 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.600+0000 7fc00b200640 1 Processor -- start 2024-08-25T23:52:42.311 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.601+0000 7fc00b200640 1 -- start start 2024-08-25T23:52:42.311 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.601+0000 7fc00b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc00c1061c0 0x7fc00c19cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:52:42.311 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.601+0000 7fc00b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c107830 con 0x7fc00c1061c0 2024-08-25T23:52:42.311 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.601+0000 7fc009e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc00c1061c0 0x7fc00c19cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:52:42.311 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.601+0000 7fc009e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc00c1061c0 0x7fc00c19cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60772/0 (socket says 172.21.15.42:60772) 2024-08-25T23:52:42.311 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.601+0000 7fc009e00640 1 -- 172.21.15.42:0/3825334817 learned_addr learned my addr 172.21.15.42:0/3825334817 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:52:42.311 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.601+0000 7fc009e00640 1 -- 172.21.15.42:0/3825334817 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00c19d400 con 0x7fc00c1061c0 2024-08-25T23:52:42.311 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.602+0000 7fc009e00640 1 --2- 172.21.15.42:0/3825334817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc00c1061c0 0x7fc00c19cec0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fbffc000f80 tx=0x7fbffc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:52:42.311 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.602+0000 7fc003400640 1 -- 172.21.15.42:0/3825334817 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbffc03d750 con 0x7fc00c1061c0 2024-08-25T23:52:42.311 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.602+0000 7fc003400640 1 -- 172.21.15.42:0/3825334817 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbffc03d8f0 con 0x7fc00c1061c0 2024-08-25T23:52:42.312 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.602+0000 7fc003400640 1 -- 172.21.15.42:0/3825334817 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbffc03dbd0 con 0x7fc00c1061c0 2024-08-25T23:52:42.312 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.602+0000 7fc00b200640 1 -- 172.21.15.42:0/3825334817 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc00c19d690 con 0x7fc00c1061c0 2024-08-25T23:52:42.312 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.602+0000 7fc00b200640 1 -- 172.21.15.42:0/3825334817 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc00c1a0380 con 0x7fc00c1061c0 2024-08-25T23:52:42.312 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.602+0000 7fc003400640 1 -- 172.21.15.42:0/3825334817 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbffc045020 con 0x7fc00c1061c0 2024-08-25T23:52:42.312 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.603+0000 7fc003400640 1 -- 172.21.15.42:0/3825334817 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbffc030050 con 0x7fc00c1061c0 2024-08-25T23:52:42.312 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.604+0000 7fc00b200640 1 -- 172.21.15.42:0/3825334817 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc00c106640 con 0x7fc00c1061c0 2024-08-25T23:52:42.312 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.606+0000 7fc003400640 1 -- 172.21.15.42:0/3825334817 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7fbffc03dd70 con 0x7fc00c1061c0 2024-08-25T23:52:42.312 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.668+0000 7fc00b200640 1 -- 172.21.15.42:0/3825334817 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fc00c074370 con 0x7fc00c1061c0 2024-08-25T23:52:42.312 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.673+0000 7fc003400640 1 -- 172.21.15.42:0/3825334817 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7fbffc0474c0 con 0x7fc00c1061c0 2024-08-25T23:52:42.312 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.673+0000 7fc003400640 1 -- 172.21.15.42:0/3825334817 <== mon.0 v2:172.21.15.42:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbffc059590 con 0x7fc00c1061c0 2024-08-25T23:52:42.312 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.674+0000 7fc00b200640 1 -- 172.21.15.42:0/3825334817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc00c1061c0 msgr2=0x7fc00c19cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:52:42.312 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.674+0000 7fc00b200640 1 --2- 172.21.15.42:0/3825334817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc00c1061c0 0x7fc00c19cec0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fbffc000f80 tx=0x7fbffc004a40 comp rx=0 tx=0).stop 2024-08-25T23:52:42.313 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.674+0000 7fc00b200640 1 -- 172.21.15.42:0/3825334817 shutdown_connections 2024-08-25T23:52:42.313 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.674+0000 7fc00b200640 1 --2- 172.21.15.42:0/3825334817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc00c1061c0 0x7fc00c19cec0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:52:42.313 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.674+0000 7fc00b200640 1 -- 172.21.15.42:0/3825334817 >> 172.21.15.42:0/3825334817 conn(0x7fc00c1019d0 msgr2=0x7fc00c1938d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:52:42.313 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.675+0000 7fc00b200640 1 -- 172.21.15.42:0/3825334817 shutdown_connections 2024-08-25T23:52:42.313 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:41.675+0000 7fc00b200640 1 -- 172.21.15.42:0/3825334817 wait complete. 2024-08-25T23:52:42.313 INFO:teuthology.orchestra.run.smithi042.stdout:Generating new minimal ceph.conf... 2024-08-25T23:52:43.159 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:42 smithi042 ceph-mon[16852]: from='client.? 172.21.15.42:0/33751025' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:52:43.454 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.755+0000 7fb78f200640 1 Processor -- start 2024-08-25T23:52:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.756+0000 7fb78f200640 1 -- start start 2024-08-25T23:52:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.756+0000 7fb78f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb790109880 0x7fb790109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:52:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.756+0000 7fb78f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb79010a250 con 0x7fb790109880 2024-08-25T23:52:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.756+0000 7fb78de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb790109880 0x7fb790109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:52:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.756+0000 7fb78de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb790109880 0x7fb790109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60782/0 (socket says 172.21.15.42:60782) 2024-08-25T23:52:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.756+0000 7fb78de00640 1 -- 172.21.15.42:0/2916693141 learned_addr learned my addr 172.21.15.42:0/2916693141 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:52:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.757+0000 7fb78de00640 1 -- 172.21.15.42:0/2916693141 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79010a660 con 0x7fb790109880 2024-08-25T23:52:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.758+0000 7fb78de00640 1 --2- 172.21.15.42:0/2916693141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb790109880 0x7fb790109c80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb780009820 tx=0x7fb78002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461cce0101bf5dce server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:52:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.758+0000 7fb78d400640 1 -- 172.21.15.42:0/2916693141 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb780037070 con 0x7fb790109880 2024-08-25T23:52:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.758+0000 7fb78d400640 1 -- 172.21.15.42:0/2916693141 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb780032900 con 0x7fb790109880 2024-08-25T23:52:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.758+0000 7fb78d400640 1 -- 172.21.15.42:0/2916693141 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb780030850 con 0x7fb790109880 2024-08-25T23:52:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.758+0000 7fb78f200640 1 -- 172.21.15.42:0/2916693141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb790109880 msgr2=0x7fb790109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:52:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.758+0000 7fb78f200640 1 --2- 172.21.15.42:0/2916693141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb790109880 0x7fb790109c80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb780009820 tx=0x7fb78002a270 comp rx=0 tx=0).stop 2024-08-25T23:52:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.759+0000 7fb78f200640 1 -- 172.21.15.42:0/2916693141 shutdown_connections 2024-08-25T23:52:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.759+0000 7fb78f200640 1 --2- 172.21.15.42:0/2916693141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb790109880 0x7fb790109c80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:52:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.759+0000 7fb78f200640 1 -- 172.21.15.42:0/2916693141 >> 172.21.15.42:0/2916693141 conn(0x7fb79007cb50 msgr2=0x7fb79007cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:52:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.759+0000 7fb78f200640 1 -- 172.21.15.42:0/2916693141 shutdown_connections 2024-08-25T23:52:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.759+0000 7fb78f200640 1 -- 172.21.15.42:0/2916693141 wait complete. 2024-08-25T23:52:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.760+0000 7fb78f200640 1 Processor -- start 2024-08-25T23:52:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.760+0000 7fb78f200640 1 -- start start 2024-08-25T23:52:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.760+0000 7fb78f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb790109880 0x7fb79019d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:52:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.760+0000 7fb78f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb79010daa0 con 0x7fb790109880 2024-08-25T23:52:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.760+0000 7fb78de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb790109880 0x7fb79019d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:52:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.760+0000 7fb78de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb790109880 0x7fb79019d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60794/0 (socket says 172.21.15.42:60794) 2024-08-25T23:52:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.760+0000 7fb78de00640 1 -- 172.21.15.42:0/33751025 learned_addr learned my addr 172.21.15.42:0/33751025 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:52:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.761+0000 7fb78de00640 1 -- 172.21.15.42:0/33751025 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79019dce0 con 0x7fb790109880 2024-08-25T23:52:43.456 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.761+0000 7fb78de00640 1 --2- 172.21.15.42:0/33751025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb790109880 0x7fb79019d7a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb7800305a0 tx=0x7fb7800327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:52:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.761+0000 7fb787400640 1 -- 172.21.15.42:0/33751025 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb780042070 con 0x7fb790109880 2024-08-25T23:52:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.761+0000 7fb787400640 1 -- 172.21.15.42:0/33751025 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb78003d900 con 0x7fb790109880 2024-08-25T23:52:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.761+0000 7fb787400640 1 -- 172.21.15.42:0/33751025 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb780037070 con 0x7fb790109880 2024-08-25T23:52:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.761+0000 7fb78f200640 1 -- 172.21.15.42:0/33751025 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb79019df70 con 0x7fb790109880 2024-08-25T23:52:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.761+0000 7fb78f200640 1 -- 172.21.15.42:0/33751025 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7901a0c60 con 0x7fb790109880 2024-08-25T23:52:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.762+0000 7fb787400640 1 -- 172.21.15.42:0/33751025 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb780045070 con 0x7fb790109880 2024-08-25T23:52:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.762+0000 7fb787400640 1 -- 172.21.15.42:0/33751025 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb780047df0 con 0x7fb790109880 2024-08-25T23:52:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.763+0000 7fb78f200640 1 -- 172.21.15.42:0/33751025 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb790109d00 con 0x7fb790109880 2024-08-25T23:52:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.765+0000 7fb787400640 1 -- 172.21.15.42:0/33751025 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7fb780047440 con 0x7fb790109880 2024-08-25T23:52:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.828+0000 7fb78f200640 1 -- 172.21.15.42:0/33751025 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fb790197340 con 0x7fb790109880 2024-08-25T23:52:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.828+0000 7fb787400640 1 -- 172.21.15.42:0/33751025 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fb78003d440 con 0x7fb790109880 2024-08-25T23:52:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.830+0000 7fb78f200640 1 -- 172.21.15.42:0/33751025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb790109880 msgr2=0x7fb79019d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:52:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.830+0000 7fb78f200640 1 --2- 172.21.15.42:0/33751025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb790109880 0x7fb79019d7a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb7800305a0 tx=0x7fb7800327b0 comp rx=0 tx=0).stop 2024-08-25T23:52:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.830+0000 7fb78f200640 1 -- 172.21.15.42:0/33751025 shutdown_connections 2024-08-25T23:52:43.457 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.830+0000 7fb78f200640 1 --2- 172.21.15.42:0/33751025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb790109880 0x7fb79019d7a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:52:43.458 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.830+0000 7fb78f200640 1 -- 172.21.15.42:0/33751025 >> 172.21.15.42:0/33751025 conn(0x7fb79007cb50 msgr2=0x7fb790107720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:52:43.458 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.830+0000 7fb78f200640 1 -- 172.21.15.42:0/33751025 shutdown_connections 2024-08-25T23:52:43.458 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:42.830+0000 7fb78f200640 1 -- 172.21.15.42:0/33751025 wait complete. 2024-08-25T23:52:43.458 INFO:teuthology.orchestra.run.smithi042.stdout:Restarting the monitor... 2024-08-25T23:52:43.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:43 smithi042 systemd[1]: Stopping Ceph mon.a for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-25T23:52:44.172 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:43 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-a[16848]: 2024-08-25T23:52:43.816+0000 7f13b6000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-25T23:52:44.172 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:43 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-a[16848]: 2024-08-25T23:52:43.816+0000 7f13b6000640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-08-25T23:52:44.172 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:44 smithi042 podman[17094]: 2024-08-25 23:52:44.064417009 +0000 UTC m=+0.370618832 container died 58a3398c7cafe92c7df2939c7b051f019869d7705ec36f23e530ff0478409c69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-f273685, ceph=True, io.buildah.version=1.37.1) 2024-08-25T23:52:44.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:44 smithi042 podman[17094]: 2024-08-25 23:52:44.463260266 +0000 UTC m=+0.769462085 container cleanup 58a3398c7cafe92c7df2939c7b051f019869d7705ec36f23e530ff0478409c69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-a, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f273685, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_BRANCH=HEAD) 2024-08-25T23:52:44.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:44 smithi042 bash[17094]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-a 2024-08-25T23:52:44.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:44 smithi042 podman[17105]: 2024-08-25 23:52:44.705977798 +0000 UTC m=+0.635110972 container remove 58a3398c7cafe92c7df2939c7b051f019869d7705ec36f23e530ff0478409c69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-a, RELEASE=squid-f273685, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1) 2024-08-25T23:52:45.173 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:44 smithi042 systemd[1]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mon.a.service: Deactivated successfully. 2024-08-25T23:52:45.173 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:44 smithi042 systemd[1]: Stopped Ceph mon.a for f89d317a-633c-11ef-bcd2-c7b262605968. 2024-08-25T23:52:45.174 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:44 smithi042 systemd[1]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mon.a.service: Consumed 1.230s CPU time. 2024-08-25T23:52:45.174 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:44 smithi042 systemd[1]: Starting Ceph mon.a for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-25T23:52:45.425 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 podman[17206]: 2024-08-25 23:52:45.077917101 +0000 UTC m=+0.026962499 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 2024-08-25T23:52:45.425 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 podman[17206]: 2024-08-25 23:52:45.181956488 +0000 UTC m=+0.131001878 container create 368b9008b40ed112c93a689198ab76910296bd7fe223a274edc5848f737fa473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-f273685, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-08-25T23:52:45.425 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 podman[17206]: 2024-08-25 23:52:45.367908073 +0000 UTC m=+0.316953460 container init 368b9008b40ed112c93a689198ab76910296bd7fe223a274edc5848f737fa473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-a, GIT_CLEAN=True, io.buildah.version=1.37.1, RELEASE=squid-f273685, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-08-25T23:52:45.425 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 podman[17206]: 2024-08-25 23:52:45.374406958 +0000 UTC m=+0.323452341 container start 368b9008b40ed112c93a689198ab76910296bd7fe223a274edc5848f737fa473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-a, org.label-schema.license=GPLv2, RELEASE=squid-f273685, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-08-25T23:52:45.425 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: set uid:gid to 167:167 (ceph:ceph) 2024-08-25T23:52:45.425 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: ceph version 19.1.1-207-gf273685f (f273685f88d22802ccbd8a96b393734630028a13) squid (rc), process ceph-mon, pid 2 2024-08-25T23:52:45.425 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: pidfile_write: ignore empty --pid-file 2024-08-25T23:52:45.425 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: load: jerasure load: lrc 2024-08-25T23:52:45.426 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: RocksDB version: 7.9.2 2024-08-25T23:52:45.426 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Git sha 0 2024-08-25T23:52:45.426 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Compile date 2024-08-25 15:14:04 2024-08-25T23:52:45.426 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: DB SUMMARY 2024-08-25T23:52:45.426 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: DB Session ID: 4IOJCEA3JTEDYLR598YQ 2024-08-25T23:52:45.426 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: CURRENT file: CURRENT 2024-08-25T23:52:45.426 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: IDENTITY file: IDENTITY 2024-08-25T23:52:45.426 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-08-25T23:52:45.426 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-08-25T23:52:45.426 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105596 ; 2024-08-25T23:52:45.426 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.error_if_exists: 0 2024-08-25T23:52:45.426 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.create_if_missing: 0 2024-08-25T23:52:45.427 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.paranoid_checks: 1 2024-08-25T23:52:45.427 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-25T23:52:45.427 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-25T23:52:45.427 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-25T23:52:45.427 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.env: 0x55e67a4677a0 2024-08-25T23:52:45.427 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.fs: PosixFileSystem 2024-08-25T23:52:45.427 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.info_log: 0x55e6ab039520 2024-08-25T23:52:45.427 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_file_opening_threads: 16 2024-08-25T23:52:45.427 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.statistics: (nil) 2024-08-25T23:52:45.427 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.use_fsync: 0 2024-08-25T23:52:45.427 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_log_file_size: 0 2024-08-25T23:52:45.427 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-25T23:52:45.427 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-25T23:52:45.427 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.keep_log_file_num: 1000 2024-08-25T23:52:45.428 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.recycle_log_file_num: 0 2024-08-25T23:52:45.428 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.allow_fallocate: 1 2024-08-25T23:52:45.428 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.allow_mmap_reads: 0 2024-08-25T23:52:45.428 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.allow_mmap_writes: 0 2024-08-25T23:52:45.428 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.use_direct_reads: 0 2024-08-25T23:52:45.428 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-25T23:52:45.428 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.create_missing_column_families: 0 2024-08-25T23:52:45.428 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.db_log_dir: 2024-08-25T23:52:45.428 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.wal_dir: 2024-08-25T23:52:45.428 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-25T23:52:45.428 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-25T23:52:45.428 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-25T23:52:45.428 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-25T23:52:45.428 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-25T23:52:45.428 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-25T23:52:45.429 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.advise_random_on_open: 1 2024-08-25T23:52:45.429 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.db_write_buffer_size: 0 2024-08-25T23:52:45.429 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.write_buffer_manager: 0x55e6ab048dc0 2024-08-25T23:52:45.429 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-25T23:52:45.429 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-25T23:52:45.429 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-25T23:52:45.429 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.rate_limiter: (nil) 2024-08-25T23:52:45.429 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-25T23:52:45.429 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.wal_recovery_mode: 2 2024-08-25T23:52:45.431 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.enable_thread_tracking: 0 2024-08-25T23:52:45.431 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.enable_pipelined_write: 0 2024-08-25T23:52:45.431 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.unordered_write: 0 2024-08-25T23:52:45.431 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-25T23:52:45.431 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-25T23:52:45.431 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-25T23:52:45.431 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-25T23:52:45.431 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.row_cache: None 2024-08-25T23:52:45.431 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.wal_filter: None 2024-08-25T23:52:45.431 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-25T23:52:45.431 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.allow_ingest_behind: 0 2024-08-25T23:52:45.431 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.two_write_queues: 0 2024-08-25T23:52:45.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.manual_wal_flush: 0 2024-08-25T23:52:45.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.wal_compression: 0 2024-08-25T23:52:45.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.atomic_flush: 0 2024-08-25T23:52:45.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-25T23:52:45.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-25T23:52:45.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-25T23:52:45.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.log_readahead_size: 0 2024-08-25T23:52:45.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-25T23:52:45.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.best_efforts_recovery: 0 2024-08-25T23:52:45.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-25T23:52:45.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-25T23:52:45.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.allow_data_in_errors: 0 2024-08-25T23:52:45.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.db_host_id: __hostname__ 2024-08-25T23:52:45.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-25T23:52:45.433 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_background_jobs: 2 2024-08-25T23:52:45.433 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_background_compactions: -1 2024-08-25T23:52:45.433 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_subcompactions: 1 2024-08-25T23:52:45.433 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-25T23:52:45.433 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-25T23:52:45.433 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-25T23:52:45.433 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_total_wal_size: 0 2024-08-25T23:52:45.433 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-25T23:52:45.433 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-25T23:52:45.434 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-25T23:52:45.434 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-25T23:52:45.434 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_open_files: -1 2024-08-25T23:52:45.434 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.bytes_per_sync: 0 2024-08-25T23:52:45.434 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-25T23:52:45.434 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-25T23:52:45.434 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.compaction_readahead_size: 0 2024-08-25T23:52:45.434 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_background_flushes: -1 2024-08-25T23:52:45.434 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Compression algorithms supported: 2024-08-25T23:52:45.434 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: kZSTD supported: 0 2024-08-25T23:52:45.434 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: kXpressCompression supported: 0 2024-08-25T23:52:45.434 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: kBZip2Compression supported: 0 2024-08-25T23:52:45.434 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-25T23:52:45.434 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: kLZ4Compression supported: 1 2024-08-25T23:52:45.435 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: kZlibCompression supported: 1 2024-08-25T23:52:45.435 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: kLZ4HCCompression supported: 1 2024-08-25T23:52:45.435 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: kSnappyCompression supported: 1 2024-08-25T23:52:45.435 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-25T23:52:45.435 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-25T23:52:45.435 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-08-25T23:52:45.435 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-25T23:52:45.435 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-25T23:52:45.435 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.merge_operator: 2024-08-25T23:52:45.435 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.compaction_filter: None 2024-08-25T23:52:45.435 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.compaction_filter_factory: None 2024-08-25T23:52:45.436 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.sst_partitioner_factory: None 2024-08-25T23:52:45.436 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-25T23:52:45.436 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-25T23:52:45.436 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e6ab039140) 2024-08-25T23:52:45.436 INFO:journalctl@ceph.mon.a.smithi042.stdout: cache_index_and_filter_blocks: 1 2024-08-25T23:52:45.436 INFO:journalctl@ceph.mon.a.smithi042.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-25T23:52:45.436 INFO:journalctl@ceph.mon.a.smithi042.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-25T23:52:45.436 INFO:journalctl@ceph.mon.a.smithi042.stdout: pin_top_level_index_and_filter: 1 2024-08-25T23:52:45.436 INFO:journalctl@ceph.mon.a.smithi042.stdout: index_type: 0 2024-08-25T23:52:45.436 INFO:journalctl@ceph.mon.a.smithi042.stdout: data_block_index_type: 0 2024-08-25T23:52:45.436 INFO:journalctl@ceph.mon.a.smithi042.stdout: index_shortening: 1 2024-08-25T23:52:45.436 INFO:journalctl@ceph.mon.a.smithi042.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-25T23:52:45.436 INFO:journalctl@ceph.mon.a.smithi042.stdout: checksum: 4 2024-08-25T23:52:45.436 INFO:journalctl@ceph.mon.a.smithi042.stdout: no_block_cache: 0 2024-08-25T23:52:45.436 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_cache: 0x55e6ab02d090 2024-08-25T23:52:45.437 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_cache_name: BinnedLRUCache 2024-08-25T23:52:45.437 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_cache_options: 2024-08-25T23:52:45.437 INFO:journalctl@ceph.mon.a.smithi042.stdout: capacity : 536870912 2024-08-25T23:52:45.437 INFO:journalctl@ceph.mon.a.smithi042.stdout: num_shard_bits : 4 2024-08-25T23:52:45.437 INFO:journalctl@ceph.mon.a.smithi042.stdout: strict_capacity_limit : 0 2024-08-25T23:52:45.437 INFO:journalctl@ceph.mon.a.smithi042.stdout: high_pri_pool_ratio: 0.000 2024-08-25T23:52:45.437 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_cache_compressed: (nil) 2024-08-25T23:52:45.437 INFO:journalctl@ceph.mon.a.smithi042.stdout: persistent_cache: (nil) 2024-08-25T23:52:45.437 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_size: 4096 2024-08-25T23:52:45.437 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_size_deviation: 10 2024-08-25T23:52:45.437 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_restart_interval: 16 2024-08-25T23:52:45.437 INFO:journalctl@ceph.mon.a.smithi042.stdout: index_block_restart_interval: 1 2024-08-25T23:52:45.437 INFO:journalctl@ceph.mon.a.smithi042.stdout: metadata_block_size: 4096 2024-08-25T23:52:45.437 INFO:journalctl@ceph.mon.a.smithi042.stdout: partition_filters: 0 2024-08-25T23:52:45.437 INFO:journalctl@ceph.mon.a.smithi042.stdout: use_delta_encoding: 1 2024-08-25T23:52:45.438 INFO:journalctl@ceph.mon.a.smithi042.stdout: filter_policy: bloomfilter 2024-08-25T23:52:45.438 INFO:journalctl@ceph.mon.a.smithi042.stdout: whole_key_filtering: 1 2024-08-25T23:52:45.438 INFO:journalctl@ceph.mon.a.smithi042.stdout: verify_compression: 0 2024-08-25T23:52:45.438 INFO:journalctl@ceph.mon.a.smithi042.stdout: read_amp_bytes_per_bit: 0 2024-08-25T23:52:45.438 INFO:journalctl@ceph.mon.a.smithi042.stdout: format_version: 5 2024-08-25T23:52:45.438 INFO:journalctl@ceph.mon.a.smithi042.stdout: enable_index_compression: 1 2024-08-25T23:52:45.438 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_align: 0 2024-08-25T23:52:45.438 INFO:journalctl@ceph.mon.a.smithi042.stdout: max_auto_readahead_size: 262144 2024-08-25T23:52:45.438 INFO:journalctl@ceph.mon.a.smithi042.stdout: prepopulate_block_cache: 0 2024-08-25T23:52:45.438 INFO:journalctl@ceph.mon.a.smithi042.stdout: initial_auto_readahead_size: 8192 2024-08-25T23:52:45.438 INFO:journalctl@ceph.mon.a.smithi042.stdout: num_file_reads_for_auto_readahead: 2 2024-08-25T23:52:45.438 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.write_buffer_size: 33554432 2024-08-25T23:52:45.438 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_write_buffer_number: 2 2024-08-25T23:52:45.439 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.compression: NoCompression 2024-08-25T23:52:45.439 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.bottommost_compression: Disabled 2024-08-25T23:52:45.439 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.prefix_extractor: nullptr 2024-08-25T23:52:45.439 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-25T23:52:45.439 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.num_levels: 7 2024-08-25T23:52:45.439 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-25T23:52:45.439 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-25T23:52:45.439 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-25T23:52:45.439 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-25T23:52:45.439 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-25T23:52:45.439 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-25T23:52:45.439 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-25T23:52:45.439 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-25T23:52:45.439 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-25T23:52:45.440 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-25T23:52:45.440 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-25T23:52:45.440 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-25T23:52:45.440 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-25T23:52:45.440 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.compression_opts.level: 32767 2024-08-25T23:52:45.440 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.compression_opts.strategy: 0 2024-08-25T23:52:45.440 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-25T23:52:45.440 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-25T23:52:45.440 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-25T23:52:45.440 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-25T23:52:45.440 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.compression_opts.enabled: false 2024-08-25T23:52:45.440 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-25T23:52:45.440 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-25T23:52:45.440 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-25T23:52:45.441 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-25T23:52:45.441 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.target_file_size_base: 67108864 2024-08-25T23:52:45.441 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-25T23:52:45.441 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-25T23:52:45.441 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-25T23:52:45.441 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-25T23:52:45.441 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-25T23:52:45.441 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-25T23:52:45.441 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-25T23:52:45.441 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-25T23:52:45.441 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-25T23:52:45.441 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-25T23:52:45.441 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-25T23:52:45.441 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-25T23:52:45.442 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-25T23:52:45.442 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-25T23:52:45.442 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.arena_block_size: 1048576 2024-08-25T23:52:45.442 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-25T23:52:45.442 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-25T23:52:45.442 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.disable_auto_compactions: 0 2024-08-25T23:52:45.442 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-25T23:52:45.442 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-25T23:52:45.442 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-25T23:52:45.442 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-25T23:52:45.442 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-25T23:52:45.442 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-25T23:52:45.443 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-25T23:52:45.443 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-25T23:52:45.443 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-25T23:52:45.443 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-25T23:52:45.443 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-25T23:52:45.443 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.inplace_update_support: 0 2024-08-25T23:52:45.443 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-25T23:52:45.443 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-25T23:52:45.443 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-25T23:52:45.443 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-25T23:52:45.443 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.bloom_locality: 0 2024-08-25T23:52:45.443 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.max_successive_merges: 0 2024-08-25T23:52:45.443 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-25T23:52:45.443 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.paranoid_file_checks: 0 2024-08-25T23:52:45.443 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.force_consistency_checks: 1 2024-08-25T23:52:45.444 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.report_bg_io_stats: 0 2024-08-25T23:52:45.444 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.ttl: 2592000 2024-08-25T23:52:45.444 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-25T23:52:45.444 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-25T23:52:45.444 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-25T23:52:45.444 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.enable_blob_files: false 2024-08-25T23:52:45.444 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.min_blob_size: 0 2024-08-25T23:52:45.444 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.blob_file_size: 268435456 2024-08-25T23:52:45.444 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-25T23:52:45.444 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-25T23:52:45.444 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-25T23:52:45.445 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-25T23:52:45.445 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-25T23:52:45.445 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.blob_file_starting_level: 0 2024-08-25T23:52:45.445 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-25T23:52:45.445 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-08-25T23:52:45.445 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-08-25T23:52:45.445 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2feb1152-cd10-4cec-bcf3-16de3f09361a 2024-08-25T23:52:45.445 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724629965416770, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-08-25T23:52:45.445 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-08-25T23:52:45.445 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724629965418556, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100584, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 330, "table_properties": {"data_size": 98478, "index_size": 298, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14397, "raw_average_key_size": 49, "raw_value_size": 90724, "raw_average_value_size": 313, "num_data_blocks": 12, "num_entries": 289, "num_filter_entries": 289, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1724629965, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2feb1152-cd10-4cec-bcf3-16de3f09361a", "db_session_id": "4IOJCEA3JTEDYLR598YQ", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-08-25T23:52:45.445 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724629965418734, "job": 1, "event": "recovery_finished"} 2024-08-25T23:52:45.445 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-08-25T23:52:45.445 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-25T23:52:45.446 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e6ab05ce00 2024-08-25T23:52:45.446 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: DB pointer 0x55e6ab158000 2024-08-25T23:52:45.446 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-25T23:52:45.446 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-25T23:52:45.446 INFO:journalctl@ceph.mon.a.smithi042.stdout: ** DB Stats ** 2024-08-25T23:52:45.446 INFO:journalctl@ceph.mon.a.smithi042.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-25T23:52:45.446 INFO:journalctl@ceph.mon.a.smithi042.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-25T23:52:45.446 INFO:journalctl@ceph.mon.a.smithi042.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-25T23:52:45.446 INFO:journalctl@ceph.mon.a.smithi042.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-25T23:52:45.446 INFO:journalctl@ceph.mon.a.smithi042.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-25T23:52:45.446 INFO:journalctl@ceph.mon.a.smithi042.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-25T23:52:45.446 INFO:journalctl@ceph.mon.a.smithi042.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-25T23:52:45.447 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-08-25T23:52:45.447 INFO:journalctl@ceph.mon.a.smithi042.stdout: ** Compaction Stats [default] ** 2024-08-25T23:52:45.447 INFO:journalctl@ceph.mon.a.smithi042.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-25T23:52:45.447 INFO:journalctl@ceph.mon.a.smithi042.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-25T23:52:45.447 INFO:journalctl@ceph.mon.a.smithi042.stdout: L0 2/0 100.09 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 90.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-25T23:52:45.447 INFO:journalctl@ceph.mon.a.smithi042.stdout: Sum 2/0 100.09 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 90.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-25T23:52:45.447 INFO:journalctl@ceph.mon.a.smithi042.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 90.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-25T23:52:45.447 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-08-25T23:52:45.447 INFO:journalctl@ceph.mon.a.smithi042.stdout: ** Compaction Stats [default] ** 2024-08-25T23:52:45.447 INFO:journalctl@ceph.mon.a.smithi042.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-25T23:52:45.447 INFO:journalctl@ceph.mon.a.smithi042.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-25T23:52:45.447 INFO:journalctl@ceph.mon.a.smithi042.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 90.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-25T23:52:45.447 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-08-25T23:52:45.447 INFO:journalctl@ceph.mon.a.smithi042.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-25T23:52:45.448 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-08-25T23:52:45.448 INFO:journalctl@ceph.mon.a.smithi042.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-25T23:52:45.448 INFO:journalctl@ceph.mon.a.smithi042.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-25T23:52:45.448 INFO:journalctl@ceph.mon.a.smithi042.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-25T23:52:45.448 INFO:journalctl@ceph.mon.a.smithi042.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-25T23:52:45.448 INFO:journalctl@ceph.mon.a.smithi042.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-25T23:52:45.448 INFO:journalctl@ceph.mon.a.smithi042.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-25T23:52:45.448 INFO:journalctl@ceph.mon.a.smithi042.stdout: Cumulative compaction: 0.00 GB write, 15.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-25T23:52:45.448 INFO:journalctl@ceph.mon.a.smithi042.stdout: Interval compaction: 0.00 GB write, 15.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-25T23:52:45.448 INFO:journalctl@ceph.mon.a.smithi042.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-25T23:52:45.448 INFO:journalctl@ceph.mon.a.smithi042.stdout: Block cache BinnedLRUCache@0x55e6ab02d090#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-08-25T23:52:45.448 INFO:journalctl@ceph.mon.a.smithi042.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-08-25T23:52:45.448 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-08-25T23:52:45.448 INFO:journalctl@ceph.mon.a.smithi042.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-25T23:52:45.448 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: starting mon.a rank 0 at public addrs [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] at bind addrs [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:52:45.449 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: mon.a@-1(???) e1 preinit fsid f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:52:45.449 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: mon.a@-1(???).mds e1 new map 2024-08-25T23:52:45.449 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: mon.a@-1(???).mds e1 print_map 2024-08-25T23:52:45.449 INFO:journalctl@ceph.mon.a.smithi042.stdout: e1 2024-08-25T23:52:45.449 INFO:journalctl@ceph.mon.a.smithi042.stdout: btime 2024-08-25T23:52:39:598290+0000 2024-08-25T23:52:45.449 INFO:journalctl@ceph.mon.a.smithi042.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-25T23:52:45.449 INFO:journalctl@ceph.mon.a.smithi042.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-25T23:52:45.449 INFO:journalctl@ceph.mon.a.smithi042.stdout: legacy client fscid: -1 2024-08-25T23:52:45.449 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-08-25T23:52:45.449 INFO:journalctl@ceph.mon.a.smithi042.stdout: No filesystems configured 2024-08-25T23:52:45.449 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-25T23:52:45.449 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-25T23:52:45.449 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-25T23:52:45.449 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-25T23:52:45.450 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-08-25T23:52:45.488 INFO:teuthology.orchestra.run.smithi042.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-08-25T23:52:45.739 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 bash[17206]: 368b9008b40ed112c93a689198ab76910296bd7fe223a274edc5848f737fa473 2024-08-25T23:52:45.739 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-25T23:52:45.739 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: monmap epoch 1 2024-08-25T23:52:45.739 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: fsid f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:52:45.739 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: last_changed 2024-08-25T23:52:35.852236+0000 2024-08-25T23:52:45.739 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: created 2024-08-25T23:52:35.852236+0000 2024-08-25T23:52:45.739 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: min_mon_release 19 (squid) 2024-08-25T23:52:45.739 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: election_strategy: 1 2024-08-25T23:52:45.739 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-08-25T23:52:45.739 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: fsmap 2024-08-25T23:52:45.740 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: osdmap e1: 0 total, 0 up, 0 in 2024-08-25T23:52:45.740 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 ceph-mon[17225]: mgrmap e1: no daemons active 2024-08-25T23:52:45.740 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:45 smithi042 systemd[1]: Started Ceph mon.a for f89d317a-633c-11ef-bcd2-c7b262605968. 2024-08-25T23:52:46.575 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.984+0000 7f27c1200640 1 Processor -- start 2024-08-25T23:52:46.575 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.984+0000 7f27c1200640 1 -- start start 2024-08-25T23:52:46.575 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.984+0000 7f27c1200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27bc109550 0x7f27bc109950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:52:46.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.984+0000 7f27c1200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc109f20 con 0x7f27bc109550 2024-08-25T23:52:46.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.985+0000 7f27bb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27bc109550 0x7f27bc109950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:52:46.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.985+0000 7f27bb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27bc109550 0x7f27bc109950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37662/0 (socket says 172.21.15.42:37662) 2024-08-25T23:52:46.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.985+0000 7f27bb400640 1 -- 172.21.15.42:0/2183909760 learned_addr learned my addr 172.21.15.42:0/2183909760 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:52:46.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.985+0000 7f27bb400640 1 -- 172.21.15.42:0/2183909760 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27bc10a700 con 0x7f27bc109550 2024-08-25T23:52:46.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.988+0000 7f27bb400640 1 --2- 172.21.15.42:0/2183909760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27bc109550 0x7f27bc109950 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f27ac009820 tx=0x7f27ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6728bb36a994b350 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:52:46.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.988+0000 7f27ba000640 1 -- 172.21.15.42:0/2183909760 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27ac037070 con 0x7f27bc109550 2024-08-25T23:52:46.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.988+0000 7f27ba000640 1 -- 172.21.15.42:0/2183909760 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f27ac032900 con 0x7f27bc109550 2024-08-25T23:52:46.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.988+0000 7f27ba000640 1 -- 172.21.15.42:0/2183909760 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27ac030850 con 0x7f27bc109550 2024-08-25T23:52:46.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.989+0000 7f27c1200640 1 -- 172.21.15.42:0/2183909760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27bc109550 msgr2=0x7f27bc109950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:52:46.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.989+0000 7f27c1200640 1 --2- 172.21.15.42:0/2183909760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27bc109550 0x7f27bc109950 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f27ac009820 tx=0x7f27ac02a270 comp rx=0 tx=0).stop 2024-08-25T23:52:46.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.989+0000 7f27c1200640 1 -- 172.21.15.42:0/2183909760 shutdown_connections 2024-08-25T23:52:46.576 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.989+0000 7f27c1200640 1 --2- 172.21.15.42:0/2183909760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27bc109550 0x7f27bc109950 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:52:46.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.989+0000 7f27c1200640 1 -- 172.21.15.42:0/2183909760 >> 172.21.15.42:0/2183909760 conn(0x7f27bc07cb50 msgr2=0x7f27bc1073d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:52:46.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.989+0000 7f27c1200640 1 -- 172.21.15.42:0/2183909760 shutdown_connections 2024-08-25T23:52:46.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.989+0000 7f27c1200640 1 -- 172.21.15.42:0/2183909760 wait complete. 2024-08-25T23:52:46.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.990+0000 7f27c1200640 1 Processor -- start 2024-08-25T23:52:46.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.991+0000 7f27c1200640 1 -- start start 2024-08-25T23:52:46.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.991+0000 7f27c1200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27bc109550 0x7f27bc19d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:52:46.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.991+0000 7f27c1200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc10dab0 con 0x7f27bc109550 2024-08-25T23:52:46.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.991+0000 7f27bb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27bc109550 0x7f27bc19d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:52:46.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.991+0000 7f27bb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27bc109550 0x7f27bc19d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37672/0 (socket says 172.21.15.42:37672) 2024-08-25T23:52:46.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.991+0000 7f27bb400640 1 -- 172.21.15.42:0/3254721621 learned_addr learned my addr 172.21.15.42:0/3254721621 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:52:46.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.992+0000 7f27bb400640 1 -- 172.21.15.42:0/3254721621 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27bc19dc80 con 0x7f27bc109550 2024-08-25T23:52:46.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.992+0000 7f27bb400640 1 --2- 172.21.15.42:0/3254721621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27bc109550 0x7f27bc19d740 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f27ac0097f0 tx=0x7f27ac030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:52:46.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.992+0000 7f27b3e00640 1 -- 172.21.15.42:0/3254721621 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27ac037040 con 0x7f27bc109550 2024-08-25T23:52:46.577 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.992+0000 7f27b3e00640 1 -- 172.21.15.42:0/3254721621 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f27ac040070 con 0x7f27bc109550 2024-08-25T23:52:46.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.992+0000 7f27c1200640 1 -- 172.21.15.42:0/3254721621 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27bc19df10 con 0x7f27bc109550 2024-08-25T23:52:46.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.992+0000 7f27b3e00640 1 -- 172.21.15.42:0/3254721621 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27ac03a390 con 0x7f27bc109550 2024-08-25T23:52:46.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.993+0000 7f27c1200640 1 -- 172.21.15.42:0/3254721621 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27bc1a0c00 con 0x7f27bc109550 2024-08-25T23:52:46.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.993+0000 7f27b3e00640 1 -- 172.21.15.42:0/3254721621 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f27ac03a5e0 con 0x7f27bc109550 2024-08-25T23:52:46.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.993+0000 7f27b3e00640 1 -- 172.21.15.42:0/3254721621 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f27ac045950 con 0x7f27bc109550 2024-08-25T23:52:46.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.994+0000 7f27c1200640 1 -- 172.21.15.42:0/3254721621 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27bc1099d0 con 0x7f27bc109550 2024-08-25T23:52:46.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:45.997+0000 7f27b3e00640 1 -- 172.21.15.42:0/3254721621 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f27ac045460 con 0x7f27bc109550 2024-08-25T23:52:46.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:46.060+0000 7f27c1200640 1 -- 172.21.15.42:0/3254721621 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f27bc19e390 con 0x7f27bc109550 2024-08-25T23:52:46.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:46.062+0000 7f27b3e00640 1 -- 172.21.15.42:0/3254721621 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f27ac03b430 con 0x7f27bc109550 2024-08-25T23:52:46.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:46.062+0000 7f27c1200640 1 -- 172.21.15.42:0/3254721621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27bc109550 msgr2=0x7f27bc19d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:52:46.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:46.062+0000 7f27c1200640 1 --2- 172.21.15.42:0/3254721621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27bc109550 0x7f27bc19d740 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f27ac0097f0 tx=0x7f27ac030d80 comp rx=0 tx=0).stop 2024-08-25T23:52:46.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:46.062+0000 7f27c1200640 1 -- 172.21.15.42:0/3254721621 shutdown_connections 2024-08-25T23:52:46.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:46.062+0000 7f27c1200640 1 --2- 172.21.15.42:0/3254721621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27bc109550 0x7f27bc19d740 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:52:46.578 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:46.062+0000 7f27c1200640 1 -- 172.21.15.42:0/3254721621 >> 172.21.15.42:0/3254721621 conn(0x7f27bc07cb50 msgr2=0x7f27bc106cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:52:46.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:46.063+0000 7f27c1200640 1 -- 172.21.15.42:0/3254721621 shutdown_connections 2024-08-25T23:52:46.579 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:46.063+0000 7f27c1200640 1 -- 172.21.15.42:0/3254721621 wait complete. 2024-08-25T23:52:46.579 INFO:teuthology.orchestra.run.smithi042.stdout:Wrote config to /etc/ceph/ceph.conf 2024-08-25T23:52:46.599 INFO:teuthology.orchestra.run.smithi042.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-08-25T23:52:46.599 INFO:teuthology.orchestra.run.smithi042.stdout:Creating mgr... 2024-08-25T23:52:46.600 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying port 0.0.0.0:9283 ... 2024-08-25T23:52:46.600 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying port 0.0.0.0:8765 ... 2024-08-25T23:52:46.945 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mgr.x 2024-08-25T23:52:46.945 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mgr.x.service: Unit ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mgr.x.service not loaded. 2024-08-25T23:52:47.183 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f89d317a-633c-11ef-bcd2-c7b262605968.target.wants/ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-f89d317a-633c-11ef-bcd2-c7b262605968@.service. 2024-08-25T23:52:47.215 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:47 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/3254721621' entity='client.admin' 2024-08-25T23:52:47.529 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:47 smithi042 systemd[1]: Starting Ceph mgr.x for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-25T23:52:47.783 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:47 smithi042 podman[17436]: 2024-08-25 23:52:47.431974501 +0000 UTC m=+0.027584083 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 2024-08-25T23:52:47.783 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:47 smithi042 podman[17436]: 2024-08-25 23:52:47.534605356 +0000 UTC m=+0.130214915 container create 375b4bd2b8cbb2786152a6ea330a2b9e627c46abd4750f23e46db423444a647d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x, RELEASE=squid-f273685, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-08-25T23:52:47.784 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:47 smithi042 podman[17436]: 2024-08-25 23:52:47.728786218 +0000 UTC m=+0.324395781 container init 375b4bd2b8cbb2786152a6ea330a2b9e627c46abd4750f23e46db423444a647d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-f273685, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-25T23:52:47.784 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:47 smithi042 podman[17436]: 2024-08-25 23:52:47.73521789 +0000 UTC m=+0.330827459 container start 375b4bd2b8cbb2786152a6ea330a2b9e627c46abd4750f23e46db423444a647d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-f273685, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.license=GPLv2) 2024-08-25T23:52:47.839 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-25T23:52:47.839 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout disabled 2024-08-25T23:52:47.854 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-25T23:52:47.854 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-08-25T23:52:47.854 INFO:teuthology.orchestra.run.smithi042.stdout:firewalld.service is not enabled 2024-08-25T23:52:47.854 INFO:teuthology.orchestra.run.smithi042.stdout:Not possible to enable service . firewalld.service is not available 2024-08-25T23:52:47.875 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-25T23:52:47.876 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout disabled 2024-08-25T23:52:47.891 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-25T23:52:47.891 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-08-25T23:52:47.891 INFO:teuthology.orchestra.run.smithi042.stdout:firewalld.service is not enabled 2024-08-25T23:52:47.891 INFO:teuthology.orchestra.run.smithi042.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-08-25T23:52:47.891 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mgr to start... 2024-08-25T23:52:47.891 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mgr... 2024-08-25T23:52:48.071 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:47 smithi042 bash[17436]: 375b4bd2b8cbb2786152a6ea330a2b9e627c46abd4750f23e46db423444a647d 2024-08-25T23:52:48.071 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:47 smithi042 systemd[1]: Started Ceph mgr.x for f89d317a-633c-11ef-bcd2-c7b262605968. 2024-08-25T23:52:48.651 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:48 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/92730665' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-25T23:52:48.651 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:48 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:48.461+0000 7f4190dd4040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-25T23:52:48.651 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:48 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:48.649+0000 7f4190dd4040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-25T23:52:49.221 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:48 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:48.904+0000 7f4190dd4040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-25T23:52:49.221 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:49 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:49.101+0000 7f4190dd4040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-25T23:52:49.232 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-08-25T23:52:49.232 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-08-25T23:52:49.232 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsid": "f89d317a-633c-11ef-bcd2-c7b262605968", 2024-08-25T23:52:49.232 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "health": { 2024-08-25T23:52:49.232 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-25T23:52:49.232 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-25T23:52:49.232 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-25T23:52:49.232 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-08-25T23:52:49.232 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-25T23:52:49.232 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-25T23:52:49.232 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 0 2024-08-25T23:52:49.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-08-25T23:52:49.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-25T23:52:49.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "a" 2024-08-25T23:52:49.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-08-25T23:52:49.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-08-25T23:52:49.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-25T23:52:49.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-25T23:52:49.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-25T23:52:49.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-25T23:52:49.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-08-25T23:52:49.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-25T23:52:49.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-25T23:52:49.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-25T23:52:49.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-25T23:52:49.233 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-25T23:52:49.241 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-25T23:52:49.241 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-25T23:52:49.241 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-25T23:52:49.241 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-08-25T23:52:49.241 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-25T23:52:49.241 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-25T23:52:49.241 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-25T23:52:49.241 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-25T23:52:49.241 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-25T23:52:49.242 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-25T23:52:49.242 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-25T23:52:49.242 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-25T23:52:49.242 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-25T23:52:49.242 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-08-25T23:52:49.242 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-25T23:52:49.242 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-25T23:52:49.242 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "btime": "2024-08-25T23:52:39:598290+0000", 2024-08-25T23:52:49.242 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-25T23:52:49.242 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-25T23:52:49.242 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-08-25T23:52:49.242 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-25T23:52:49.242 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-25T23:52:49.242 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-25T23:52:49.242 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-25T23:52:49.243 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-25T23:52:49.243 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-25T23:52:49.243 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "restful" 2024-08-25T23:52:49.243 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-08-25T23:52:49.243 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-25T23:52:49.243 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-08-25T23:52:49.243 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-25T23:52:49.243 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-25T23:52:49.243 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modified": "2024-08-25T23:52:39.599033+0000", 2024-08-25T23:52:49.243 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-25T23:52:49.243 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-08-25T23:52:49.243 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-25T23:52:49.243 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-08-25T23:52:49.244 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.442+0000 7fbeedc00640 1 Processor -- start 2024-08-25T23:52:49.244 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.442+0000 7fbeedc00640 1 -- start start 2024-08-25T23:52:49.244 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.442+0000 7fbeedc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbee807cd50 0x7fbee807b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:52:49.244 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.442+0000 7fbeedc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbee807b740 con 0x7fbee807cd50 2024-08-25T23:52:49.244 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.443+0000 7fbee7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbee807cd50 0x7fbee807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:52:49.244 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.443+0000 7fbee7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbee807cd50 0x7fbee807b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37708/0 (socket says 172.21.15.42:37708) 2024-08-25T23:52:49.244 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.443+0000 7fbee7e00640 1 -- 172.21.15.42:0/3473734418 learned_addr learned my addr 172.21.15.42:0/3473734418 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:52:49.244 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.443+0000 7fbee7e00640 1 -- 172.21.15.42:0/3473734418 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee807b8c0 con 0x7fbee807cd50 2024-08-25T23:52:49.244 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.444+0000 7fbee7e00640 1 --2- 172.21.15.42:0/3473734418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbee807cd50 0x7fbee807b200 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbed8009820 tx=0x7fbed802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c473e92e19e109f server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:52:49.244 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.444+0000 7fbee7400640 1 -- 172.21.15.42:0/3473734418 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed8037070 con 0x7fbee807cd50 2024-08-25T23:52:49.244 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.444+0000 7fbee7400640 1 -- 172.21.15.42:0/3473734418 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbed8032900 con 0x7fbee807cd50 2024-08-25T23:52:49.244 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.444+0000 7fbee7400640 1 -- 172.21.15.42:0/3473734418 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed80308e0 con 0x7fbee807cd50 2024-08-25T23:52:49.244 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.445+0000 7fbeedc00640 1 -- 172.21.15.42:0/3473734418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbee807cd50 msgr2=0x7fbee807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:52:49.244 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.445+0000 7fbeedc00640 1 --2- 172.21.15.42:0/3473734418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbee807cd50 0x7fbee807b200 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbed8009820 tx=0x7fbed802a300 comp rx=0 tx=0).stop 2024-08-25T23:52:49.244 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.445+0000 7fbeedc00640 1 -- 172.21.15.42:0/3473734418 shutdown_connections 2024-08-25T23:52:49.245 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.445+0000 7fbeedc00640 1 --2- 172.21.15.42:0/3473734418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbee807cd50 0x7fbee807b200 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:52:49.245 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.445+0000 7fbeedc00640 1 -- 172.21.15.42:0/3473734418 >> 172.21.15.42:0/3473734418 conn(0x7fbee8102b20 msgr2=0x7fbee8104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:52:49.245 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.445+0000 7fbeedc00640 1 -- 172.21.15.42:0/3473734418 shutdown_connections 2024-08-25T23:52:49.245 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.445+0000 7fbeedc00640 1 -- 172.21.15.42:0/3473734418 wait complete. 2024-08-25T23:52:49.245 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.447+0000 7fbeedc00640 1 Processor -- start 2024-08-25T23:52:49.245 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.447+0000 7fbeedc00640 1 -- start start 2024-08-25T23:52:49.245 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.448+0000 7fbeedc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbee807cd50 0x7fbee819d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:52:49.245 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.448+0000 7fbeedc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbee810d840 con 0x7fbee807cd50 2024-08-25T23:52:49.245 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.448+0000 7fbee7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbee807cd50 0x7fbee819d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:52:49.245 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.448+0000 7fbee7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbee807cd50 0x7fbee819d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37712/0 (socket says 172.21.15.42:37712) 2024-08-25T23:52:49.245 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.448+0000 7fbee7e00640 1 -- 172.21.15.42:0/92730665 learned_addr learned my addr 172.21.15.42:0/92730665 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:52:49.245 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.448+0000 7fbee7e00640 1 -- 172.21.15.42:0/92730665 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee819dc40 con 0x7fbee807cd50 2024-08-25T23:52:49.245 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.449+0000 7fbee7e00640 1 --2- 172.21.15.42:0/92730665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbee807cd50 0x7fbee819d700 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbed802a820 tx=0x7fbed8030900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:52:49.245 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.449+0000 7fbee5600640 1 -- 172.21.15.42:0/92730665 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed8037040 con 0x7fbee807cd50 2024-08-25T23:52:49.245 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.449+0000 7fbee5600640 1 -- 172.21.15.42:0/92730665 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbed8040070 con 0x7fbee807cd50 2024-08-25T23:52:49.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.449+0000 7fbee5600640 1 -- 172.21.15.42:0/92730665 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed803a390 con 0x7fbee807cd50 2024-08-25T23:52:49.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.449+0000 7fbeedc00640 1 -- 172.21.15.42:0/92730665 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee819ded0 con 0x7fbee807cd50 2024-08-25T23:52:49.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.449+0000 7fbeedc00640 1 -- 172.21.15.42:0/92730665 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee81a0bc0 con 0x7fbee807cd50 2024-08-25T23:52:49.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.449+0000 7fbee5600640 1 -- 172.21.15.42:0/92730665 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbed803a650 con 0x7fbee807cd50 2024-08-25T23:52:49.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.450+0000 7fbee5600640 1 -- 172.21.15.42:0/92730665 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbed8045850 con 0x7fbee807cd50 2024-08-25T23:52:49.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.450+0000 7fbeedc00640 1 -- 172.21.15.42:0/92730665 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbee807b280 con 0x7fbee807cd50 2024-08-25T23:52:49.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.453+0000 7fbee5600640 1 -- 172.21.15.42:0/92730665 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7fbed803b430 con 0x7fbee807cd50 2024-08-25T23:52:49.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.518+0000 7fbeedc00640 1 -- 172.21.15.42:0/92730665 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fbee802d6a0 con 0x7fbee807cd50 2024-08-25T23:52:49.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.519+0000 7fbee5600640 1 -- 172.21.15.42:0/92730665 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fbed803b6a0 con 0x7fbee807cd50 2024-08-25T23:52:49.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.520+0000 7fbeedc00640 1 -- 172.21.15.42:0/92730665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbee807cd50 msgr2=0x7fbee819d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:52:49.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.520+0000 7fbeedc00640 1 --2- 172.21.15.42:0/92730665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbee807cd50 0x7fbee819d700 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbed802a820 tx=0x7fbed8030900 comp rx=0 tx=0).stop 2024-08-25T23:52:49.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.520+0000 7fbeedc00640 1 -- 172.21.15.42:0/92730665 shutdown_connections 2024-08-25T23:52:49.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.520+0000 7fbeedc00640 1 --2- 172.21.15.42:0/92730665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbee807cd50 0x7fbee819d700 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:52:49.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.520+0000 7fbeedc00640 1 -- 172.21.15.42:0/92730665 >> 172.21.15.42:0/92730665 conn(0x7fbee8102b20 msgr2=0x7fbee81037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:52:49.247 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.520+0000 7fbeedc00640 1 -- 172.21.15.42:0/92730665 shutdown_connections 2024-08-25T23:52:49.247 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:48.520+0000 7fbeedc00640 1 -- 172.21.15.42:0/92730665 wait complete. 2024-08-25T23:52:49.247 INFO:teuthology.orchestra.run.smithi042.stdout:mgr not available, waiting (1/15)... 2024-08-25T23:52:49.522 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:49 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:49.278+0000 7f4190dd4040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-25T23:52:49.783 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:49 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:49.521+0000 7f4190dd4040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-25T23:52:49.783 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:49 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:49.674+0000 7f4190dd4040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-25T23:52:49.783 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:49 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:49.754+0000 7f4190dd4040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-25T23:52:50.283 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:49 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:49.840+0000 7f4190dd4040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-25T23:52:50.283 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:50 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:50.015+0000 7f4190dd4040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-25T23:52:50.283 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:50 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:50.085+0000 7f4190dd4040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-25T23:52:51.033 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:50 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:50.677+0000 7f4190dd4040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-25T23:52:51.033 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:50 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:50.752+0000 7f4190dd4040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-25T23:52:51.033 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:50 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:50.823+0000 7f4190dd4040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-25T23:52:51.921 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:51 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2688395165' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-25T23:52:52.585 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:52 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:52.333+0000 7f4190dd4040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-25T23:52:52.585 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:52 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:52.417+0000 7f4190dd4040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-25T23:52:52.586 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:52 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:52.500+0000 7f4190dd4040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-25T23:52:52.586 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:52 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:52.583+0000 7f4190dd4040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-25T23:52:52.761 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-08-25T23:52:52.761 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-08-25T23:52:52.761 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsid": "f89d317a-633c-11ef-bcd2-c7b262605968", 2024-08-25T23:52:52.761 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "health": { 2024-08-25T23:52:52.761 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-25T23:52:52.761 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-25T23:52:52.761 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-25T23:52:52.761 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-08-25T23:52:52.761 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-25T23:52:52.761 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-25T23:52:52.761 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 0 2024-08-25T23:52:52.762 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-08-25T23:52:52.762 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-25T23:52:52.762 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "a" 2024-08-25T23:52:52.762 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-08-25T23:52:52.762 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-08-25T23:52:52.762 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-25T23:52:52.762 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-25T23:52:52.762 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-25T23:52:52.762 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-25T23:52:52.762 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-08-25T23:52:52.762 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-25T23:52:52.762 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-25T23:52:52.763 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-25T23:52:52.763 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-25T23:52:52.763 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-25T23:52:52.763 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-25T23:52:52.763 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-25T23:52:52.763 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-25T23:52:52.763 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-08-25T23:52:52.763 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-25T23:52:52.763 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-25T23:52:52.763 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-25T23:52:52.763 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-25T23:52:52.763 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-25T23:52:52.763 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-25T23:52:52.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-25T23:52:52.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-25T23:52:52.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-25T23:52:52.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-08-25T23:52:52.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-25T23:52:52.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-25T23:52:52.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "btime": "2024-08-25T23:52:39:598290+0000", 2024-08-25T23:52:52.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-25T23:52:52.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-25T23:52:52.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-08-25T23:52:52.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-25T23:52:52.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-25T23:52:52.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-25T23:52:52.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-25T23:52:52.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-25T23:52:52.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-25T23:52:52.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "restful" 2024-08-25T23:52:52.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-08-25T23:52:52.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-25T23:52:52.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-08-25T23:52:52.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-25T23:52:52.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-25T23:52:52.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modified": "2024-08-25T23:52:39.599033+0000", 2024-08-25T23:52:52.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-25T23:52:52.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-08-25T23:52:52.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-25T23:52:52.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-08-25T23:52:52.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.773+0000 7f2f6e400640 1 Processor -- start 2024-08-25T23:52:52.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.773+0000 7f2f6e400640 1 -- start start 2024-08-25T23:52:52.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.773+0000 7f2f6e400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f6810aae0 0x7f2f6810aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:52:52.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.773+0000 7f2f6e400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6810b4b0 con 0x7f2f6810aae0 2024-08-25T23:52:52.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.774+0000 7f2f67400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f6810aae0 0x7f2f6810aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:52:52.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.774+0000 7f2f67400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f6810aae0 0x7f2f6810aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37718/0 (socket says 172.21.15.42:37718) 2024-08-25T23:52:52.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.774+0000 7f2f67400640 1 -- 172.21.15.42:0/2823566330 learned_addr learned my addr 172.21.15.42:0/2823566330 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:52:52.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.774+0000 7f2f67400640 1 -- 172.21.15.42:0/2823566330 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f6810b630 con 0x7f2f6810aae0 2024-08-25T23:52:52.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.775+0000 7f2f67400640 1 --2- 172.21.15.42:0/2823566330 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f6810aae0 0x7f2f6810aee0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2f58009820 tx=0x7f2f5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701aedc0af73f661 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:52:52.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.775+0000 7f2f66000640 1 -- 172.21.15.42:0/2823566330 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f58037070 con 0x7f2f6810aae0 2024-08-25T23:52:52.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.775+0000 7f2f66000640 1 -- 172.21.15.42:0/2823566330 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f58032900 con 0x7f2f6810aae0 2024-08-25T23:52:52.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.775+0000 7f2f66000640 1 -- 172.21.15.42:0/2823566330 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f58030850 con 0x7f2f6810aae0 2024-08-25T23:52:52.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.776+0000 7f2f6e400640 1 -- 172.21.15.42:0/2823566330 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f6810aae0 msgr2=0x7f2f6810aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:52:52.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.776+0000 7f2f6e400640 1 --2- 172.21.15.42:0/2823566330 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f6810aae0 0x7f2f6810aee0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2f58009820 tx=0x7f2f5802a270 comp rx=0 tx=0).stop 2024-08-25T23:52:52.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.776+0000 7f2f6e400640 1 -- 172.21.15.42:0/2823566330 shutdown_connections 2024-08-25T23:52:52.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.776+0000 7f2f6e400640 1 --2- 172.21.15.42:0/2823566330 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f6810aae0 0x7f2f6810aee0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:52:52.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.776+0000 7f2f6e400640 1 -- 172.21.15.42:0/2823566330 >> 172.21.15.42:0/2823566330 conn(0x7f2f6807cc90 msgr2=0x7f2f6807d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:52:52.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.777+0000 7f2f6e400640 1 -- 172.21.15.42:0/2823566330 shutdown_connections 2024-08-25T23:52:52.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.777+0000 7f2f6e400640 1 -- 172.21.15.42:0/2823566330 wait complete. 2024-08-25T23:52:52.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.777+0000 7f2f6e400640 1 Processor -- start 2024-08-25T23:52:52.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.778+0000 7f2f6e400640 1 -- start start 2024-08-25T23:52:52.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.778+0000 7f2f6e400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f6810aae0 0x7f2f6819d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:52:52.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.778+0000 7f2f6e400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6810db40 con 0x7f2f6810aae0 2024-08-25T23:52:52.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.778+0000 7f2f67400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f6810aae0 0x7f2f6819d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:52:52.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.778+0000 7f2f67400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f6810aae0 0x7f2f6819d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37732/0 (socket says 172.21.15.42:37732) 2024-08-25T23:52:52.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.778+0000 7f2f67400640 1 -- 172.21.15.42:0/2688395165 learned_addr learned my addr 172.21.15.42:0/2688395165 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:52:52.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.779+0000 7f2f67400640 1 -- 172.21.15.42:0/2688395165 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f6819de80 con 0x7f2f6810aae0 2024-08-25T23:52:52.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.779+0000 7f2f67400640 1 --2- 172.21.15.42:0/2688395165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f6810aae0 0x7f2f6819d940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2f580097f0 tx=0x7f2f58030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:52:52.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.779+0000 7f2f5fe00640 1 -- 172.21.15.42:0/2688395165 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f58037040 con 0x7f2f6810aae0 2024-08-25T23:52:52.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.779+0000 7f2f5fe00640 1 -- 172.21.15.42:0/2688395165 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f58040070 con 0x7f2f6810aae0 2024-08-25T23:52:52.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.779+0000 7f2f5fe00640 1 -- 172.21.15.42:0/2688395165 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f5803a390 con 0x7f2f6810aae0 2024-08-25T23:52:52.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.779+0000 7f2f6e400640 1 -- 172.21.15.42:0/2688395165 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f6819e110 con 0x7f2f6810aae0 2024-08-25T23:52:52.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.779+0000 7f2f6e400640 1 -- 172.21.15.42:0/2688395165 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f681a0e00 con 0x7f2f6810aae0 2024-08-25T23:52:52.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.780+0000 7f2f5fe00640 1 -- 172.21.15.42:0/2688395165 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2f5803a5e0 con 0x7f2f6810aae0 2024-08-25T23:52:52.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.780+0000 7f2f5fe00640 1 -- 172.21.15.42:0/2688395165 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2f58045950 con 0x7f2f6810aae0 2024-08-25T23:52:52.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.781+0000 7f2f6e400640 1 -- 172.21.15.42:0/2688395165 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f6810af60 con 0x7f2f6810aae0 2024-08-25T23:52:52.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.783+0000 7f2f5fe00640 1 -- 172.21.15.42:0/2688395165 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f2f58045460 con 0x7f2f6810aae0 2024-08-25T23:52:52.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.867+0000 7f2f6e400640 1 -- 172.21.15.42:0/2688395165 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f2f68197450 con 0x7f2f6810aae0 2024-08-25T23:52:52.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.868+0000 7f2f5fe00640 1 -- 172.21.15.42:0/2688395165 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f2f5803b430 con 0x7f2f6810aae0 2024-08-25T23:52:52.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.869+0000 7f2f6e400640 1 -- 172.21.15.42:0/2688395165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f6810aae0 msgr2=0x7f2f6819d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:52:52.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.869+0000 7f2f6e400640 1 --2- 172.21.15.42:0/2688395165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f6810aae0 0x7f2f6819d940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2f580097f0 tx=0x7f2f58030d80 comp rx=0 tx=0).stop 2024-08-25T23:52:52.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.869+0000 7f2f6e400640 1 -- 172.21.15.42:0/2688395165 shutdown_connections 2024-08-25T23:52:52.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.869+0000 7f2f6e400640 1 --2- 172.21.15.42:0/2688395165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f6810aae0 0x7f2f6819d940 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:52:52.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.869+0000 7f2f6e400640 1 -- 172.21.15.42:0/2688395165 >> 172.21.15.42:0/2688395165 conn(0x7f2f6807cc90 msgr2=0x7f2f681076a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:52:52.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.869+0000 7f2f6e400640 1 -- 172.21.15.42:0/2688395165 shutdown_connections 2024-08-25T23:52:52.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:51.870+0000 7f2f6e400640 1 -- 172.21.15.42:0/2688395165 wait complete. 2024-08-25T23:52:52.769 INFO:teuthology.orchestra.run.smithi042.stdout:mgr not available, waiting (2/15)... 2024-08-25T23:52:52.851 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:52 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:52.776+0000 7f4190dd4040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-25T23:52:52.851 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:52 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:52.849+0000 7f4190dd4040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-25T23:52:53.283 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:53 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:52.999+0000 7f4190dd4040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-25T23:52:53.898 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:53 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:53.598+0000 7f4190dd4040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-25T23:52:53.898 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:53 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:53.674+0000 7f4190dd4040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-25T23:52:53.898 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:53 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:53.896+0000 7f4190dd4040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-25T23:52:54.213 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:53 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:53.978+0000 7f4190dd4040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-25T23:52:54.213 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:54 smithi042 ceph-mon[17225]: Activating manager daemon x 2024-08-25T23:52:54.213 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:54 smithi042 ceph-mon[17225]: mgrmap e2: x(active, starting, since 0.00397135s) 2024-08-25T23:52:54.213 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:54 smithi042 ceph-mon[17225]: from='mgr.14100 172.21.15.42:0/2128906412' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-25T23:52:54.213 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:54 smithi042 ceph-mon[17225]: from='mgr.14100 172.21.15.42:0/2128906412' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-25T23:52:54.213 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:54 smithi042 ceph-mon[17225]: from='mgr.14100 172.21.15.42:0/2128906412' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-25T23:52:54.213 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:54 smithi042 ceph-mon[17225]: from='mgr.14100 172.21.15.42:0/2128906412' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-25T23:52:54.213 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:54 smithi042 ceph-mon[17225]: from='mgr.14100 172.21.15.42:0/2128906412' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-08-25T23:52:54.214 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:54 smithi042 ceph-mon[17225]: Manager daemon x is now available 2024-08-25T23:52:54.214 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:54 smithi042 ceph-mon[17225]: from='mgr.14100 172.21.15.42:0/2128906412' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-08-25T23:52:54.214 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:54 smithi042 ceph-mon[17225]: from='mgr.14100 172.21.15.42:0/2128906412' entity='mgr.x' 2024-08-25T23:52:54.214 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:54 smithi042 ceph-mon[17225]: from='mgr.14100 172.21.15.42:0/2128906412' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-08-25T23:52:54.214 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:54 smithi042 ceph-mon[17225]: from='mgr.14100 172.21.15.42:0/2128906412' entity='mgr.x' 2024-08-25T23:52:54.214 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:54 smithi042 ceph-mon[17225]: from='mgr.14100 172.21.15.42:0/2128906412' entity='mgr.x' 2024-08-25T23:52:56.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:55 smithi042 ceph-mon[17225]: mgrmap e3: x(active, since 1.00855s) 2024-08-25T23:52:56.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:55 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/4151086345' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-25T23:52:56.349 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-08-25T23:52:56.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-08-25T23:52:56.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsid": "f89d317a-633c-11ef-bcd2-c7b262605968", 2024-08-25T23:52:56.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "health": { 2024-08-25T23:52:56.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-25T23:52:56.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-25T23:52:56.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-25T23:52:56.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-08-25T23:52:56.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-25T23:52:56.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-25T23:52:56.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 0 2024-08-25T23:52:56.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-08-25T23:52:56.350 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-25T23:52:56.351 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "a" 2024-08-25T23:52:56.351 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-08-25T23:52:56.351 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-08-25T23:52:56.351 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-25T23:52:56.351 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-25T23:52:56.351 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-25T23:52:56.351 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-25T23:52:56.351 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-08-25T23:52:56.351 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-25T23:52:56.351 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-25T23:52:56.351 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-25T23:52:56.351 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-25T23:52:56.360 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-25T23:52:56.360 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-25T23:52:56.360 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-25T23:52:56.360 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-25T23:52:56.360 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-08-25T23:52:56.360 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-25T23:52:56.360 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-25T23:52:56.360 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-25T23:52:56.360 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-25T23:52:56.360 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-25T23:52:56.360 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-25T23:52:56.361 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-25T23:52:56.361 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-25T23:52:56.361 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-25T23:52:56.361 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-08-25T23:52:56.361 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-25T23:52:56.361 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-25T23:52:56.361 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "btime": "2024-08-25T23:52:39:598290+0000", 2024-08-25T23:52:56.361 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-25T23:52:56.361 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-25T23:52:56.361 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-08-25T23:52:56.361 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-25T23:52:56.361 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-25T23:52:56.361 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-25T23:52:56.362 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-25T23:52:56.362 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-25T23:52:56.362 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-25T23:52:56.362 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "restful" 2024-08-25T23:52:56.362 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-08-25T23:52:56.362 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-25T23:52:56.362 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-08-25T23:52:56.362 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-25T23:52:56.362 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-25T23:52:56.362 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modified": "2024-08-25T23:52:39.599033+0000", 2024-08-25T23:52:56.362 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-25T23:52:56.362 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-08-25T23:52:56.362 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-25T23:52:56.362 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-08-25T23:52:56.363 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.220+0000 7fa915e00640 1 Processor -- start 2024-08-25T23:52:56.363 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.220+0000 7fa915e00640 1 -- start start 2024-08-25T23:52:56.363 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.220+0000 7fa915e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa91007de40 0x7fa91007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:52:56.363 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.220+0000 7fa915e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa91007c830 con 0x7fa91007de40 2024-08-25T23:52:56.363 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.221+0000 7fa90ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa91007de40 0x7fa91007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:52:56.363 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.221+0000 7fa90ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa91007de40 0x7fa91007c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58722/0 (socket says 172.21.15.42:58722) 2024-08-25T23:52:56.363 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.221+0000 7fa90ea00640 1 -- 172.21.15.42:0/3505449557 learned_addr learned my addr 172.21.15.42:0/3505449557 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:52:56.363 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.221+0000 7fa90ea00640 1 -- 172.21.15.42:0/3505449557 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa91007c9b0 con 0x7fa91007de40 2024-08-25T23:52:56.363 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.222+0000 7fa90ea00640 1 --2- 172.21.15.42:0/3505449557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa91007de40 0x7fa91007c2f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa900009820 tx=0x7fa90002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=630ac1eb225a451 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:52:56.363 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.222+0000 7fa90d600640 1 -- 172.21.15.42:0/3505449557 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa900037070 con 0x7fa91007de40 2024-08-25T23:52:56.363 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.223+0000 7fa90d600640 1 -- 172.21.15.42:0/3505449557 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa900032900 con 0x7fa91007de40 2024-08-25T23:52:56.363 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.223+0000 7fa90d600640 1 -- 172.21.15.42:0/3505449557 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa900030850 con 0x7fa91007de40 2024-08-25T23:52:56.363 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.223+0000 7fa915e00640 1 -- 172.21.15.42:0/3505449557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa91007de40 msgr2=0x7fa91007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:52:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.223+0000 7fa915e00640 1 --2- 172.21.15.42:0/3505449557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa91007de40 0x7fa91007c2f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa900009820 tx=0x7fa90002a270 comp rx=0 tx=0).stop 2024-08-25T23:52:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.223+0000 7fa915e00640 1 -- 172.21.15.42:0/3505449557 shutdown_connections 2024-08-25T23:52:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.223+0000 7fa915e00640 1 --2- 172.21.15.42:0/3505449557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa91007de40 0x7fa91007c2f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:52:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.223+0000 7fa915e00640 1 -- 172.21.15.42:0/3505449557 >> 172.21.15.42:0/3505449557 conn(0x7fa910102c80 msgr2=0x7fa9101050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:52:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.223+0000 7fa915e00640 1 -- 172.21.15.42:0/3505449557 shutdown_connections 2024-08-25T23:52:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.223+0000 7fa915e00640 1 -- 172.21.15.42:0/3505449557 wait complete. 2024-08-25T23:52:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.224+0000 7fa915e00640 1 Processor -- start 2024-08-25T23:52:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.224+0000 7fa915e00640 1 -- start start 2024-08-25T23:52:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.225+0000 7fa915e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa91007de40 0x7fa91019d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:52:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.225+0000 7fa915e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa91010dac0 con 0x7fa91007de40 2024-08-25T23:52:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.225+0000 7fa90ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa91007de40 0x7fa91019d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:52:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.225+0000 7fa90ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa91007de40 0x7fa91019d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58736/0 (socket says 172.21.15.42:58736) 2024-08-25T23:52:56.364 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.225+0000 7fa90ea00640 1 -- 172.21.15.42:0/4151086345 learned_addr learned my addr 172.21.15.42:0/4151086345 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:52:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.225+0000 7fa90ea00640 1 -- 172.21.15.42:0/4151086345 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa91019de40 con 0x7fa91007de40 2024-08-25T23:52:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.226+0000 7fa90ea00640 1 --2- 172.21.15.42:0/4151086345 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa91007de40 0x7fa91019d900 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa9000097f0 tx=0x7fa900030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:52:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.226+0000 7fa914a00640 1 -- 172.21.15.42:0/4151086345 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa900037040 con 0x7fa91007de40 2024-08-25T23:52:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.226+0000 7fa914a00640 1 -- 172.21.15.42:0/4151086345 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa900040070 con 0x7fa91007de40 2024-08-25T23:52:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.226+0000 7fa915e00640 1 -- 172.21.15.42:0/4151086345 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa91019e0d0 con 0x7fa91007de40 2024-08-25T23:52:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.226+0000 7fa914a00640 1 -- 172.21.15.42:0/4151086345 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa90003a390 con 0x7fa91007de40 2024-08-25T23:52:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.226+0000 7fa915e00640 1 -- 172.21.15.42:0/4151086345 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9101a0dc0 con 0x7fa91007de40 2024-08-25T23:52:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.227+0000 7fa914a00640 1 -- 172.21.15.42:0/4151086345 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7fa90003a5e0 con 0x7fa91007de40 2024-08-25T23:52:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.227+0000 7fa915e00640 1 -- 172.21.15.42:0/4151086345 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa91007c370 con 0x7fa91007de40 2024-08-25T23:52:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.227+0000 7fa914a00640 1 --2- 172.21.15.42:0/4151086345 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7fa8f4038e60 0x7fa8f403b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:52:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.227+0000 7fa914a00640 1 -- 172.21.15.42:0/4151086345 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa90006bff0 con 0x7fa91007de40 2024-08-25T23:52:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.228+0000 7fa90e000640 1 --2- 172.21.15.42:0/4151086345 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7fa8f4038e60 0x7fa8f403b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:52:56.365 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.228+0000 7fa90e000640 1 --2- 172.21.15.42:0/4151086345 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7fa8f4038e60 0x7fa8f403b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc0098c0 tx=0x7fa8fc006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:52:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.233+0000 7fa914a00640 1 -- 172.21.15.42:0/4151086345 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa900043760 con 0x7fa91007de40 2024-08-25T23:52:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.485+0000 7fa915e00640 1 -- 172.21.15.42:0/4151086345 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa91019e550 con 0x7fa91007de40 2024-08-25T23:52:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.486+0000 7fa914a00640 1 -- 172.21.15.42:0/4151086345 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fa90003a980 con 0x7fa91007de40 2024-08-25T23:52:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.488+0000 7fa915e00640 1 -- 172.21.15.42:0/4151086345 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7fa8f4038e60 msgr2=0x7fa8f403b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:52:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.488+0000 7fa915e00640 1 --2- 172.21.15.42:0/4151086345 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7fa8f4038e60 0x7fa8f403b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc0098c0 tx=0x7fa8fc006db0 comp rx=0 tx=0).stop 2024-08-25T23:52:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.488+0000 7fa915e00640 1 -- 172.21.15.42:0/4151086345 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa91007de40 msgr2=0x7fa91019d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:52:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.488+0000 7fa915e00640 1 --2- 172.21.15.42:0/4151086345 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa91007de40 0x7fa91019d900 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa9000097f0 tx=0x7fa900030d80 comp rx=0 tx=0).stop 2024-08-25T23:52:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.488+0000 7fa915e00640 1 -- 172.21.15.42:0/4151086345 shutdown_connections 2024-08-25T23:52:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.488+0000 7fa915e00640 1 --2- 172.21.15.42:0/4151086345 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7fa8f4038e60 0x7fa8f403b320 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:52:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.488+0000 7fa915e00640 1 --2- 172.21.15.42:0/4151086345 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa91007de40 0x7fa91019d900 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:52:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.488+0000 7fa915e00640 1 -- 172.21.15.42:0/4151086345 >> 172.21.15.42:0/4151086345 conn(0x7fa910102c80 msgr2=0x7fa910103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:52:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.489+0000 7fa915e00640 1 -- 172.21.15.42:0/4151086345 shutdown_connections 2024-08-25T23:52:56.366 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:55.489+0000 7fa915e00640 1 -- 172.21.15.42:0/4151086345 wait complete. 2024-08-25T23:52:56.367 INFO:teuthology.orchestra.run.smithi042.stdout:mgr is available 2024-08-25T23:52:57.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:56 smithi042 ceph-mon[17225]: mgrmap e4: x(active, since 2s) 2024-08-25T23:52:57.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-08-25T23:52:57.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [global] 2024-08-25T23:52:57.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout fsid = f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:52:57.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.42:3300,v1:172.21.15.42:6789] 2024-08-25T23:52:57.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-25T23:52:57.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-25T23:52:57.693 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-25T23:52:57.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-25T23:52:57.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-08-25T23:52:57.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-25T23:52:57.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-25T23:52:57.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-08-25T23:52:57.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [osd] 2024-08-25T23:52:57.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-25T23:52:57.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-25T23:52:57.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-25T23:52:57.694 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-25T23:52:57.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-25T23:52:57.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.862+0000 7fa5ca000640 1 Processor -- start 2024-08-25T23:52:57.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.862+0000 7fa5ca000640 1 -- start start 2024-08-25T23:52:57.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.862+0000 7fa5ca000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5c4107fe0 0x7fa5c410a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:52:57.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.862+0000 7fa5ca000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c407bde0 con 0x7fa5c4107fe0 2024-08-25T23:52:57.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.862+0000 7fa5c3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5c4107fe0 0x7fa5c410a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:52:57.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.863+0000 7fa5c3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5c4107fe0 0x7fa5c410a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58750/0 (socket says 172.21.15.42:58750) 2024-08-25T23:52:57.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.863+0000 7fa5c3400640 1 -- 172.21.15.42:0/3752879831 learned_addr learned my addr 172.21.15.42:0/3752879831 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:52:57.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.863+0000 7fa5c3400640 1 -- 172.21.15.42:0/3752879831 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c410a910 con 0x7fa5c4107fe0 2024-08-25T23:52:57.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.864+0000 7fa5c3400640 1 --2- 172.21.15.42:0/3752879831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5c4107fe0 0x7fa5c410a3d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009820 tx=0x7fa5b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4394890a8b6a45 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:52:57.695 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.864+0000 7fa5c2a00640 1 -- 172.21.15.42:0/3752879831 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b4037070 con 0x7fa5c4107fe0 2024-08-25T23:52:57.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.864+0000 7fa5c2a00640 1 -- 172.21.15.42:0/3752879831 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa5b4032900 con 0x7fa5c4107fe0 2024-08-25T23:52:57.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.864+0000 7fa5c2a00640 1 -- 172.21.15.42:0/3752879831 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b4030850 con 0x7fa5c4107fe0 2024-08-25T23:52:57.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.865+0000 7fa5ca000640 1 -- 172.21.15.42:0/3752879831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5c4107fe0 msgr2=0x7fa5c410a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:52:57.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.865+0000 7fa5ca000640 1 --2- 172.21.15.42:0/3752879831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5c4107fe0 0x7fa5c410a3d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009820 tx=0x7fa5b402a270 comp rx=0 tx=0).stop 2024-08-25T23:52:57.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.865+0000 7fa5ca000640 1 -- 172.21.15.42:0/3752879831 shutdown_connections 2024-08-25T23:52:57.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.865+0000 7fa5ca000640 1 --2- 172.21.15.42:0/3752879831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5c4107fe0 0x7fa5c410a3d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:52:57.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.865+0000 7fa5ca000640 1 -- 172.21.15.42:0/3752879831 >> 172.21.15.42:0/3752879831 conn(0x7fa5c4101b20 msgr2=0x7fa5c4103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:52:57.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.865+0000 7fa5ca000640 1 -- 172.21.15.42:0/3752879831 shutdown_connections 2024-08-25T23:52:57.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.865+0000 7fa5ca000640 1 -- 172.21.15.42:0/3752879831 wait complete. 2024-08-25T23:52:57.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.866+0000 7fa5ca000640 1 Processor -- start 2024-08-25T23:52:57.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.866+0000 7fa5ca000640 1 -- start start 2024-08-25T23:52:57.696 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.866+0000 7fa5ca000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5c4107fe0 0x7fa5c419b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:52:57.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.867+0000 7fa5ca000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c410b820 con 0x7fa5c4107fe0 2024-08-25T23:52:57.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.867+0000 7fa5c3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5c4107fe0 0x7fa5c419b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:52:57.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.867+0000 7fa5c3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5c4107fe0 0x7fa5c419b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58762/0 (socket says 172.21.15.42:58762) 2024-08-25T23:52:57.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.867+0000 7fa5c3400640 1 -- 172.21.15.42:0/1278141213 learned_addr learned my addr 172.21.15.42:0/1278141213 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:52:57.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.867+0000 7fa5c3400640 1 -- 172.21.15.42:0/1278141213 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c419bc80 con 0x7fa5c4107fe0 2024-08-25T23:52:57.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.867+0000 7fa5c3400640 1 --2- 172.21.15.42:0/1278141213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5c4107fe0 0x7fa5c419b740 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40097f0 tx=0x7fa5b4030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:52:57.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.868+0000 7fa5c0c00640 1 -- 172.21.15.42:0/1278141213 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b4037040 con 0x7fa5c4107fe0 2024-08-25T23:52:57.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.868+0000 7fa5c0c00640 1 -- 172.21.15.42:0/1278141213 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa5b4040070 con 0x7fa5c4107fe0 2024-08-25T23:52:57.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.868+0000 7fa5c0c00640 1 -- 172.21.15.42:0/1278141213 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b403a390 con 0x7fa5c4107fe0 2024-08-25T23:52:57.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.868+0000 7fa5ca000640 1 -- 172.21.15.42:0/1278141213 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c419bf10 con 0x7fa5c4107fe0 2024-08-25T23:52:57.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.868+0000 7fa5ca000640 1 -- 172.21.15.42:0/1278141213 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c419ec00 con 0x7fa5c4107fe0 2024-08-25T23:52:57.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.869+0000 7fa5c0c00640 1 -- 172.21.15.42:0/1278141213 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fa5b403b430 con 0x7fa5c4107fe0 2024-08-25T23:52:57.697 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.869+0000 7fa5ca000640 1 -- 172.21.15.42:0/1278141213 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c4108440 con 0x7fa5c4107fe0 2024-08-25T23:52:57.698 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.869+0000 7fa5c0c00640 1 --2- 172.21.15.42:0/1278141213 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7fa5a8038f20 0x7fa5a803b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:52:57.698 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.869+0000 7fa5c0c00640 1 -- 172.21.15.42:0/1278141213 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa5b406c140 con 0x7fa5c4107fe0 2024-08-25T23:52:57.698 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.870+0000 7fa5bbe00640 1 --2- 172.21.15.42:0/1278141213 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7fa5a8038f20 0x7fa5a803b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:52:57.698 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.870+0000 7fa5bbe00640 1 --2- 172.21.15.42:0/1278141213 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7fa5a8038f20 0x7fa5a803b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0098c0 tx=0x7fa5ac006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:52:57.698 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:56.875+0000 7fa5c0c00640 1 -- 172.21.15.42:0/1278141213 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa5b40371e0 con 0x7fa5c4107fe0 2024-08-25T23:52:57.698 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:57.064+0000 7fa5ca000640 1 -- 172.21.15.42:0/1278141213 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fa5c419c390 con 0x7fa5c4107fe0 2024-08-25T23:52:57.698 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:57.065+0000 7fa5c0c00640 1 -- 172.21.15.42:0/1278141213 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7fa5b4032dd0 con 0x7fa5c4107fe0 2024-08-25T23:52:57.698 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:57.067+0000 7fa5ca000640 1 -- 172.21.15.42:0/1278141213 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7fa5a8038f20 msgr2=0x7fa5a803b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:52:57.698 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:57.067+0000 7fa5ca000640 1 --2- 172.21.15.42:0/1278141213 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7fa5a8038f20 0x7fa5a803b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0098c0 tx=0x7fa5ac006db0 comp rx=0 tx=0).stop 2024-08-25T23:52:57.698 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:57.067+0000 7fa5ca000640 1 -- 172.21.15.42:0/1278141213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5c4107fe0 msgr2=0x7fa5c419b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:52:57.698 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:57.067+0000 7fa5ca000640 1 --2- 172.21.15.42:0/1278141213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5c4107fe0 0x7fa5c419b740 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40097f0 tx=0x7fa5b4030d80 comp rx=0 tx=0).stop 2024-08-25T23:52:57.699 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:57.067+0000 7fa5ca000640 1 -- 172.21.15.42:0/1278141213 shutdown_connections 2024-08-25T23:52:57.699 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:57.067+0000 7fa5ca000640 1 --2- 172.21.15.42:0/1278141213 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7fa5a8038f20 0x7fa5a803b3e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:52:57.699 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:57.067+0000 7fa5ca000640 1 --2- 172.21.15.42:0/1278141213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5c4107fe0 0x7fa5c419b740 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:52:57.699 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:57.067+0000 7fa5ca000640 1 -- 172.21.15.42:0/1278141213 >> 172.21.15.42:0/1278141213 conn(0x7fa5c4101b20 msgr2=0x7fa5c41028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:52:57.699 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:57.068+0000 7fa5ca000640 1 -- 172.21.15.42:0/1278141213 shutdown_connections 2024-08-25T23:52:57.699 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:57.068+0000 7fa5ca000640 1 -- 172.21.15.42:0/1278141213 wait complete. 2024-08-25T23:52:57.699 INFO:teuthology.orchestra.run.smithi042.stdout:Enabling cephadm module... 2024-08-25T23:52:58.191 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:57 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1278141213' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-08-25T23:52:59.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:58 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1946152323' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-08-25T23:52:59.283 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:59 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: ignoring --setuser ceph since I am not root 2024-08-25T23:52:59.283 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:59 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: ignoring --setgroup ceph since I am not root 2024-08-25T23:52:59.683 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.177+0000 7faec6600640 1 Processor -- start 2024-08-25T23:52:59.683 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.177+0000 7faec6600640 1 -- start start 2024-08-25T23:52:59.684 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.177+0000 7faec6600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec0107350 0x7faec0107750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:52:59.684 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.177+0000 7faec6600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faec0107d20 con 0x7faec0107350 2024-08-25T23:52:59.684 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.177+0000 7faec5200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec0107350 0x7faec0107750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:52:59.684 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.178+0000 7faec5200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec0107350 0x7faec0107750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58770/0 (socket says 172.21.15.42:58770) 2024-08-25T23:52:59.684 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.178+0000 7faec5200640 1 -- 172.21.15.42:0/2791482130 learned_addr learned my addr 172.21.15.42:0/2791482130 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:52:59.684 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.178+0000 7faec5200640 1 -- 172.21.15.42:0/2791482130 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec0108500 con 0x7faec0107350 2024-08-25T23:52:59.684 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.179+0000 7faec5200640 1 --2- 172.21.15.42:0/2791482130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec0107350 0x7faec0107750 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009820 tx=0x7faeb002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f6e8307034967 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:52:59.684 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.179+0000 7faebfe00640 1 -- 172.21.15.42:0/2791482130 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeb0037070 con 0x7faec0107350 2024-08-25T23:52:59.684 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.179+0000 7faebfe00640 1 -- 172.21.15.42:0/2791482130 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faeb0032900 con 0x7faec0107350 2024-08-25T23:52:59.684 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.179+0000 7faebfe00640 1 -- 172.21.15.42:0/2791482130 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeb0030850 con 0x7faec0107350 2024-08-25T23:52:59.684 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.180+0000 7faec6600640 1 -- 172.21.15.42:0/2791482130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec0107350 msgr2=0x7faec0107750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:52:59.684 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.180+0000 7faec6600640 1 --2- 172.21.15.42:0/2791482130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec0107350 0x7faec0107750 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009820 tx=0x7faeb002a270 comp rx=0 tx=0).stop 2024-08-25T23:52:59.685 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.180+0000 7faec6600640 1 -- 172.21.15.42:0/2791482130 shutdown_connections 2024-08-25T23:52:59.685 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.180+0000 7faec6600640 1 --2- 172.21.15.42:0/2791482130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec0107350 0x7faec0107750 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:52:59.685 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.180+0000 7faec6600640 1 -- 172.21.15.42:0/2791482130 >> 172.21.15.42:0/2791482130 conn(0x7faec0102b20 msgr2=0x7faec0104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:52:59.685 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.180+0000 7faec6600640 1 -- 172.21.15.42:0/2791482130 shutdown_connections 2024-08-25T23:52:59.685 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.180+0000 7faec6600640 1 -- 172.21.15.42:0/2791482130 wait complete. 2024-08-25T23:52:59.685 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.181+0000 7faec6600640 1 Processor -- start 2024-08-25T23:52:59.685 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.181+0000 7faec6600640 1 -- start start 2024-08-25T23:52:59.685 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.181+0000 7faec6600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec0107350 0x7faec019b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:52:59.685 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.181+0000 7faec6600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faec010b8b0 con 0x7faec0107350 2024-08-25T23:52:59.685 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.182+0000 7faec5200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec0107350 0x7faec019b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:52:59.685 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.182+0000 7faec5200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec0107350 0x7faec019b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58786/0 (socket says 172.21.15.42:58786) 2024-08-25T23:52:59.685 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.182+0000 7faec5200640 1 -- 172.21.15.42:0/1946152323 learned_addr learned my addr 172.21.15.42:0/1946152323 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:52:59.685 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.182+0000 7faec5200640 1 -- 172.21.15.42:0/1946152323 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec019ba80 con 0x7faec0107350 2024-08-25T23:52:59.686 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.182+0000 7faec5200640 1 --2- 172.21.15.42:0/1946152323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec0107350 0x7faec019b540 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faeb00097f0 tx=0x7faeb0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:52:59.686 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.183+0000 7faebe000640 1 -- 172.21.15.42:0/1946152323 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeb0037040 con 0x7faec0107350 2024-08-25T23:52:59.686 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.183+0000 7faebe000640 1 -- 172.21.15.42:0/1946152323 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faeb0040070 con 0x7faec0107350 2024-08-25T23:52:59.686 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.183+0000 7faebe000640 1 -- 172.21.15.42:0/1946152323 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeb003a390 con 0x7faec0107350 2024-08-25T23:52:59.686 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.183+0000 7faec6600640 1 -- 172.21.15.42:0/1946152323 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec019bd10 con 0x7faec0107350 2024-08-25T23:52:59.686 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.183+0000 7faec6600640 1 -- 172.21.15.42:0/1946152323 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec019ea00 con 0x7faec0107350 2024-08-25T23:52:59.686 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.184+0000 7faebe000640 1 -- 172.21.15.42:0/1946152323 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7faeb0032900 con 0x7faec0107350 2024-08-25T23:52:59.686 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.184+0000 7faec6600640 1 -- 172.21.15.42:0/1946152323 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec01077d0 con 0x7faec0107350 2024-08-25T23:52:59.686 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.185+0000 7faebe000640 1 --2- 172.21.15.42:0/1946152323 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7faea4038fc0 0x7faea403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:52:59.686 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.185+0000 7faebe000640 1 -- 172.21.15.42:0/1946152323 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faeb006c070 con 0x7faec0107350 2024-08-25T23:52:59.686 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.185+0000 7faeb7e00640 1 --2- 172.21.15.42:0/1946152323 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7faea4038fc0 0x7faea403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:52:59.686 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.186+0000 7faeb7e00640 1 --2- 172.21.15.42:0/1946152323 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7faea4038fc0 0x7faea403b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faea80098c0 tx=0x7faea8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:52:59.686 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.189+0000 7faebe000640 1 -- 172.21.15.42:0/1946152323 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7faeb0032bf0 con 0x7faec0107350 2024-08-25T23:52:59.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.427+0000 7faec6600640 1 -- 172.21.15.42:0/1946152323 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7faec019c190 con 0x7faec0107350 2024-08-25T23:52:59.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.993+0000 7faebe000640 1 -- 172.21.15.42:0/1946152323 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7faeb0040cc0 con 0x7faec0107350 2024-08-25T23:52:59.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.995+0000 7faebe000640 1 -- 172.21.15.42:0/1946152323 <== mon.0 v2:172.21.15.42:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7faeb0044ca0 con 0x7faec0107350 2024-08-25T23:52:59.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.997+0000 7faec6600640 1 -- 172.21.15.42:0/1946152323 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7faea4038fc0 msgr2=0x7faea403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:52:59.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.997+0000 7faec6600640 1 --2- 172.21.15.42:0/1946152323 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7faea4038fc0 0x7faea403b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faea80098c0 tx=0x7faea8006db0 comp rx=0 tx=0).stop 2024-08-25T23:52:59.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.997+0000 7faec6600640 1 -- 172.21.15.42:0/1946152323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec0107350 msgr2=0x7faec019b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:52:59.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.997+0000 7faec6600640 1 --2- 172.21.15.42:0/1946152323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec0107350 0x7faec019b540 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faeb00097f0 tx=0x7faeb0030d80 comp rx=0 tx=0).stop 2024-08-25T23:52:59.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.997+0000 7faec6600640 1 -- 172.21.15.42:0/1946152323 shutdown_connections 2024-08-25T23:52:59.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.997+0000 7faec6600640 1 --2- 172.21.15.42:0/1946152323 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7faea4038fc0 0x7faea403b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:52:59.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.997+0000 7faec6600640 1 --2- 172.21.15.42:0/1946152323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec0107350 0x7faec019b540 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:52:59.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.997+0000 7faec6600640 1 -- 172.21.15.42:0/1946152323 >> 172.21.15.42:0/1946152323 conn(0x7faec0102b20 msgr2=0x7faec01037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:52:59.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.998+0000 7faec6600640 1 -- 172.21.15.42:0/1946152323 shutdown_connections 2024-08-25T23:52:59.687 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:52:58.998+0000 7faec6600640 1 -- 172.21.15.42:0/1946152323 wait complete. 2024-08-25T23:52:59.938 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:59 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:59.704+0000 7f92fb010040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-25T23:52:59.938 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:52:59 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:52:59.888+0000 7f92fb010040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-25T23:53:00.188 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:59 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1946152323' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-08-25T23:53:00.188 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:52:59 smithi042 ceph-mon[17225]: mgrmap e5: x(active, since 5s) 2024-08-25T23:53:00.189 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:00 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:00.140+0000 7f92fb010040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-25T23:53:00.444 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:00 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:00.336+0000 7f92fb010040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-25T23:53:00.759 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:00 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:00.512+0000 7f92fb010040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-25T23:53:01.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:00 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2080681114' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-08-25T23:53:01.033 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:00 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:00.757+0000 7f92fb010040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-25T23:53:01.033 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:00 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:00.912+0000 7f92fb010040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-25T23:53:01.033 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:00 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:00.992+0000 7f92fb010040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-25T23:53:01.138 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-08-25T23:53:01.138 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-08-25T23:53:01.138 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-25T23:53:01.138 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-25T23:53:01.138 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-25T23:53:01.138 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-08-25T23:53:01.138 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.180+0000 7f3ae0200640 1 Processor -- start 2024-08-25T23:53:01.138 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.180+0000 7f3ae0200640 1 -- start start 2024-08-25T23:53:01.138 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.181+0000 7f3ae0200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ad810aae0 0x7f3ad810aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:01.138 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.181+0000 7f3ae0200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad810b4b0 con 0x7f3ad810aae0 2024-08-25T23:53:01.139 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.181+0000 7f3add800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ad810aae0 0x7f3ad810aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:01.139 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.181+0000 7f3add800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ad810aae0 0x7f3ad810aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58808/0 (socket says 172.21.15.42:58808) 2024-08-25T23:53:01.139 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.181+0000 7f3add800640 1 -- 172.21.15.42:0/3891213832 learned_addr learned my addr 172.21.15.42:0/3891213832 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:01.139 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.181+0000 7f3add800640 1 -- 172.21.15.42:0/3891213832 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad810b630 con 0x7f3ad810aae0 2024-08-25T23:53:01.139 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.183+0000 7f3add800640 1 --2- 172.21.15.42:0/3891213832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ad810aae0 0x7f3ad810aee0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009820 tx=0x7f3acc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a5919aef61c515 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:01.139 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.183+0000 7f3ad7e00640 1 -- 172.21.15.42:0/3891213832 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3acc037070 con 0x7f3ad810aae0 2024-08-25T23:53:01.139 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.183+0000 7f3ad7e00640 1 -- 172.21.15.42:0/3891213832 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3acc032900 con 0x7f3ad810aae0 2024-08-25T23:53:01.139 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.183+0000 7f3ad7e00640 1 -- 172.21.15.42:0/3891213832 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3acc030850 con 0x7f3ad810aae0 2024-08-25T23:53:01.139 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.184+0000 7f3ae0200640 1 -- 172.21.15.42:0/3891213832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ad810aae0 msgr2=0x7f3ad810aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:01.139 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.184+0000 7f3ae0200640 1 --2- 172.21.15.42:0/3891213832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ad810aae0 0x7f3ad810aee0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009820 tx=0x7f3acc02a270 comp rx=0 tx=0).stop 2024-08-25T23:53:01.139 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.184+0000 7f3ae0200640 1 -- 172.21.15.42:0/3891213832 shutdown_connections 2024-08-25T23:53:01.139 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.184+0000 7f3ae0200640 1 --2- 172.21.15.42:0/3891213832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ad810aae0 0x7f3ad810aee0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:01.139 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.184+0000 7f3ae0200640 1 -- 172.21.15.42:0/3891213832 >> 172.21.15.42:0/3891213832 conn(0x7f3ad807cc90 msgr2=0x7f3ad807d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:01.139 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.184+0000 7f3ae0200640 1 -- 172.21.15.42:0/3891213832 shutdown_connections 2024-08-25T23:53:01.140 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.184+0000 7f3ae0200640 1 -- 172.21.15.42:0/3891213832 wait complete. 2024-08-25T23:53:01.140 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.185+0000 7f3ae0200640 1 Processor -- start 2024-08-25T23:53:01.140 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.185+0000 7f3ae0200640 1 -- start start 2024-08-25T23:53:01.140 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.185+0000 7f3ae0200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ad810aae0 0x7f3ad819d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:01.140 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.185+0000 7f3ae0200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad810db40 con 0x7f3ad810aae0 2024-08-25T23:53:01.140 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.186+0000 7f3add800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ad810aae0 0x7f3ad819d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:01.140 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.186+0000 7f3add800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ad810aae0 0x7f3ad819d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58822/0 (socket says 172.21.15.42:58822) 2024-08-25T23:53:01.140 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.186+0000 7f3add800640 1 -- 172.21.15.42:0/2080681114 learned_addr learned my addr 172.21.15.42:0/2080681114 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:01.140 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.186+0000 7f3add800640 1 -- 172.21.15.42:0/2080681114 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad819dec0 con 0x7f3ad810aae0 2024-08-25T23:53:01.140 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.186+0000 7f3add800640 1 --2- 172.21.15.42:0/2080681114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ad810aae0 0x7f3ad819d980 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0097f0 tx=0x7f3acc030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:01.140 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.187+0000 7f3ad6000640 1 -- 172.21.15.42:0/2080681114 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3acc037040 con 0x7f3ad810aae0 2024-08-25T23:53:01.140 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.187+0000 7f3ad6000640 1 -- 172.21.15.42:0/2080681114 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3acc040070 con 0x7f3ad810aae0 2024-08-25T23:53:01.140 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.187+0000 7f3ad6000640 1 -- 172.21.15.42:0/2080681114 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3acc03a390 con 0x7f3ad810aae0 2024-08-25T23:53:01.141 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.187+0000 7f3ae0200640 1 -- 172.21.15.42:0/2080681114 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad819e150 con 0x7f3ad810aae0 2024-08-25T23:53:01.141 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.187+0000 7f3ae0200640 1 -- 172.21.15.42:0/2080681114 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad81a0e40 con 0x7f3ad810aae0 2024-08-25T23:53:01.141 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.188+0000 7f3ad6000640 1 -- 172.21.15.42:0/2080681114 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f3acc03b430 con 0x7f3ad810aae0 2024-08-25T23:53:01.141 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.188+0000 7f3ae0200640 1 -- 172.21.15.42:0/2080681114 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ad810af60 con 0x7f3ad810aae0 2024-08-25T23:53:01.141 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.189+0000 7f3ad6000640 1 --2- 172.21.15.42:0/2080681114 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7f3ac0038fc0 0x7f3ac003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:01.141 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.189+0000 7f3ad6000640 1 -- 172.21.15.42:0/2080681114 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3acc06c170 con 0x7f3ad810aae0 2024-08-25T23:53:01.141 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.189+0000 7f3adce00640 1 -- 172.21.15.42:0/2080681114 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7f3ac0038fc0 msgr2=0x7f3ac003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/1517739376 2024-08-25T23:53:01.141 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.189+0000 7f3adce00640 1 --2- 172.21.15.42:0/2080681114 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7f3ac0038fc0 0x7f3ac003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-25T23:53:01.141 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.194+0000 7f3ad6000640 1 -- 172.21.15.42:0/2080681114 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f3acc0371e0 con 0x7f3ad810aae0 2024-08-25T23:53:01.141 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.390+0000 7f3adce00640 1 -- 172.21.15.42:0/2080681114 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7f3ac0038fc0 msgr2=0x7f3ac003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/1517739376 2024-08-25T23:53:01.141 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.390+0000 7f3adce00640 1 --2- 172.21.15.42:0/2080681114 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7f3ac0038fc0 0x7f3ac003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-25T23:53:01.141 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.428+0000 7f3ae0200640 1 -- 172.21.15.42:0/2080681114 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f3ad802d6a0 con 0x7f3ad810aae0 2024-08-25T23:53:01.141 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.428+0000 7f3ad6000640 1 -- 172.21.15.42:0/2080681114 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f3acc06bed0 con 0x7f3ad810aae0 2024-08-25T23:53:01.141 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.430+0000 7f3ae0200640 1 -- 172.21.15.42:0/2080681114 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7f3ac0038fc0 msgr2=0x7f3ac003b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-25T23:53:01.142 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.430+0000 7f3ae0200640 1 --2- 172.21.15.42:0/2080681114 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7f3ac0038fc0 0x7f3ac003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:01.142 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.430+0000 7f3ae0200640 1 -- 172.21.15.42:0/2080681114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ad810aae0 msgr2=0x7f3ad819d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:01.142 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.430+0000 7f3ae0200640 1 --2- 172.21.15.42:0/2080681114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ad810aae0 0x7f3ad819d980 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0097f0 tx=0x7f3acc030d80 comp rx=0 tx=0).stop 2024-08-25T23:53:01.142 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.430+0000 7f3ae0200640 1 -- 172.21.15.42:0/2080681114 shutdown_connections 2024-08-25T23:53:01.142 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.430+0000 7f3ae0200640 1 --2- 172.21.15.42:0/2080681114 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7f3ac0038fc0 0x7f3ac003b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:01.142 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.430+0000 7f3ae0200640 1 --2- 172.21.15.42:0/2080681114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ad810aae0 0x7f3ad819d980 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:01.142 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.430+0000 7f3ae0200640 1 -- 172.21.15.42:0/2080681114 >> 172.21.15.42:0/2080681114 conn(0x7f3ad807cc90 msgr2=0x7f3ad8107700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:01.142 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.431+0000 7f3ae0200640 1 -- 172.21.15.42:0/2080681114 shutdown_connections 2024-08-25T23:53:01.142 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:00.431+0000 7f3ae0200640 1 -- 172.21.15.42:0/2080681114 wait complete. 2024-08-25T23:53:01.142 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for the mgr to restart... 2024-08-25T23:53:01.142 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mgr epoch 5... 2024-08-25T23:53:01.333 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:01 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:01.077+0000 7f92fb010040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-25T23:53:01.333 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:01 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:01.258+0000 7f92fb010040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-25T23:53:01.333 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:01 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:01.331+0000 7f92fb010040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-25T23:53:02.283 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:01 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:01.937+0000 7f92fb010040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-25T23:53:02.283 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:02 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:02.012+0000 7f92fb010040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-25T23:53:02.283 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:02 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:02.082+0000 7f92fb010040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-25T23:53:03.583 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:03 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:03.501+0000 7f92fb010040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-25T23:53:03.583 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:03 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:03.581+0000 7f92fb010040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-25T23:53:03.935 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:03 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:03.663+0000 7f92fb010040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-25T23:53:03.935 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:03 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:03.745+0000 7f92fb010040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-25T23:53:03.935 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:03 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:03.933+0000 7f92fb010040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-25T23:53:04.283 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:04 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:04.006+0000 7f92fb010040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-25T23:53:04.283 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:04 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:04.153+0000 7f92fb010040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-25T23:53:05.033 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:04 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:04.745+0000 7f92fb010040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-25T23:53:05.033 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:04 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:04.820+0000 7f92fb010040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-25T23:53:05.311 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:05 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:05.038+0000 7f92fb010040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-25T23:53:05.312 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:05 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:05.120+0000 7f92fb010040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-25T23:53:05.312 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:05 smithi042 ceph-mon[17225]: Active manager daemon x restarted 2024-08-25T23:53:05.312 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:05 smithi042 ceph-mon[17225]: Activating manager daemon x 2024-08-25T23:53:05.312 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:05 smithi042 ceph-mon[17225]: osdmap e2: 0 total, 0 up, 0 in 2024-08-25T23:53:05.312 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:05 smithi042 ceph-mon[17225]: mgrmap e6: x(active, starting, since 0.0039479s) 2024-08-25T23:53:05.312 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:05 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-25T23:53:05.312 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:05 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-08-25T23:53:05.312 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:05 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-25T23:53:05.312 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:05 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-25T23:53:05.312 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:05 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-25T23:53:05.312 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:05 smithi042 ceph-mon[17225]: Manager daemon x is now available 2024-08-25T23:53:05.313 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:05 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' 2024-08-25T23:53:05.313 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:05 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' 2024-08-25T23:53:05.313 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:05 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:53:05.313 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:05 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:53:06.509 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:06 smithi042 ceph-mon[17225]: Found migration_current of "None". Setting to last migration. 2024-08-25T23:53:06.510 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:06 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-08-25T23:53:06.510 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:06 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-08-25T23:53:06.510 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:06 smithi042 ceph-mon[17225]: mgrmap e7: x(active, since 1.00778s) 2024-08-25T23:53:06.824 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-08-25T23:53:06.824 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-08-25T23:53:06.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-25T23:53:06.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-08-25T23:53:06.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.916+0000 7ff7f1400640 1 Processor -- start 2024-08-25T23:53:06.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.916+0000 7ff7f1400640 1 -- start start 2024-08-25T23:53:06.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.916+0000 7ff7f1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7ec107db0 0x7ff7ec10a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:06.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.916+0000 7ff7f1400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec063230 con 0x7ff7ec107db0 2024-08-25T23:53:06.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.917+0000 7ff7ebe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7ec107db0 0x7ff7ec10a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:06.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.917+0000 7ff7ebe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7ec107db0 0x7ff7ec10a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58826/0 (socket says 172.21.15.42:58826) 2024-08-25T23:53:06.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.917+0000 7ff7ebe00640 1 -- 172.21.15.42:0/2786442903 learned_addr learned my addr 172.21.15.42:0/2786442903 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:06.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.917+0000 7ff7ebe00640 1 -- 172.21.15.42:0/2786442903 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ec10a6e0 con 0x7ff7ec107db0 2024-08-25T23:53:06.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.918+0000 7ff7ebe00640 1 --2- 172.21.15.42:0/2786442903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7ec107db0 0x7ff7ec10a1a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009820 tx=0x7ff7dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7156ce542ee685d server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:06.825 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.918+0000 7ff7eb400640 1 -- 172.21.15.42:0/2786442903 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7dc037070 con 0x7ff7ec107db0 2024-08-25T23:53:06.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.919+0000 7ff7eb400640 1 -- 172.21.15.42:0/2786442903 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff7dc032900 con 0x7ff7ec107db0 2024-08-25T23:53:06.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.919+0000 7ff7eb400640 1 -- 172.21.15.42:0/2786442903 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7dc030850 con 0x7ff7ec107db0 2024-08-25T23:53:06.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.919+0000 7ff7f1400640 1 -- 172.21.15.42:0/2786442903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7ec107db0 msgr2=0x7ff7ec10a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:06.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.919+0000 7ff7f1400640 1 --2- 172.21.15.42:0/2786442903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7ec107db0 0x7ff7ec10a1a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009820 tx=0x7ff7dc02a270 comp rx=0 tx=0).stop 2024-08-25T23:53:06.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.919+0000 7ff7f1400640 1 -- 172.21.15.42:0/2786442903 shutdown_connections 2024-08-25T23:53:06.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.919+0000 7ff7f1400640 1 --2- 172.21.15.42:0/2786442903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7ec107db0 0x7ff7ec10a1a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:06.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.919+0000 7ff7f1400640 1 -- 172.21.15.42:0/2786442903 >> 172.21.15.42:0/2786442903 conn(0x7ff7ec1019d0 msgr2=0x7ff7ec103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:06.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.919+0000 7ff7f1400640 1 -- 172.21.15.42:0/2786442903 shutdown_connections 2024-08-25T23:53:06.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.920+0000 7ff7f1400640 1 -- 172.21.15.42:0/2786442903 wait complete. 2024-08-25T23:53:06.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.920+0000 7ff7f1400640 1 Processor -- start 2024-08-25T23:53:06.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.921+0000 7ff7f1400640 1 -- start start 2024-08-25T23:53:06.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.921+0000 7ff7f1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7ec107db0 0x7ff7ec19d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:06.826 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.921+0000 7ff7f1400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec10b650 con 0x7ff7ec107db0 2024-08-25T23:53:06.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.921+0000 7ff7ebe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7ec107db0 0x7ff7ec19d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:06.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.921+0000 7ff7ebe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7ec107db0 0x7ff7ec19d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58828/0 (socket says 172.21.15.42:58828) 2024-08-25T23:53:06.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.921+0000 7ff7ebe00640 1 -- 172.21.15.42:0/85369568 learned_addr learned my addr 172.21.15.42:0/85369568 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:06.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.922+0000 7ff7ebe00640 1 -- 172.21.15.42:0/85369568 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ec19dca0 con 0x7ff7ec107db0 2024-08-25T23:53:06.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.922+0000 7ff7ebe00640 1 --2- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7ec107db0 0x7ff7ec19d760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc0097f0 tx=0x7ff7dc030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:06.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.922+0000 7ff7e9600640 1 -- 172.21.15.42:0/85369568 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7dc037040 con 0x7ff7ec107db0 2024-08-25T23:53:06.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.922+0000 7ff7e9600640 1 -- 172.21.15.42:0/85369568 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff7dc040070 con 0x7ff7ec107db0 2024-08-25T23:53:06.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.922+0000 7ff7f1400640 1 -- 172.21.15.42:0/85369568 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7ec19df30 con 0x7ff7ec107db0 2024-08-25T23:53:06.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.922+0000 7ff7e9600640 1 -- 172.21.15.42:0/85369568 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7dc03a390 con 0x7ff7ec107db0 2024-08-25T23:53:06.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.922+0000 7ff7f1400640 1 -- 172.21.15.42:0/85369568 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7ec1a0c20 con 0x7ff7ec107db0 2024-08-25T23:53:06.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.923+0000 7ff7e9600640 1 -- 172.21.15.42:0/85369568 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7ff7dc03a5e0 con 0x7ff7ec107db0 2024-08-25T23:53:06.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.924+0000 7ff7e9600640 1 --2- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7ff7d0038fc0 0x7ff7d003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:06.827 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.924+0000 7ff7e9600640 1 -- 172.21.15.42:0/85369568 --> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff7d003bb90 con 0x7ff7d0038fc0 2024-08-25T23:53:06.828 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.924+0000 7ff7e9600640 1 -- 172.21.15.42:0/85369568 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff7dc06c130 con 0x7ff7ec107db0 2024-08-25T23:53:06.828 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.924+0000 7ff7e3e00640 1 -- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7ff7d0038fc0 msgr2=0x7ff7d003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/1517739376 2024-08-25T23:53:06.828 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:01.924+0000 7ff7e3e00640 1 --2- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7ff7d0038fc0 0x7ff7d003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-25T23:53:06.828 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:02.125+0000 7ff7e3e00640 1 -- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7ff7d0038fc0 msgr2=0x7ff7d003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/1517739376 2024-08-25T23:53:06.828 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:02.125+0000 7ff7e3e00640 1 --2- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7ff7d0038fc0 0x7ff7d003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-25T23:53:06.828 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:02.526+0000 7ff7e3e00640 1 -- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7ff7d0038fc0 msgr2=0x7ff7d003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/1517739376 2024-08-25T23:53:06.828 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:02.526+0000 7ff7e3e00640 1 --2- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7ff7d0038fc0 0x7ff7d003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-25T23:53:06.828 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:03.327+0000 7ff7e3e00640 1 -- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7ff7d0038fc0 msgr2=0x7ff7d003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/1517739376 2024-08-25T23:53:06.828 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:03.327+0000 7ff7e3e00640 1 --2- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7ff7d0038fc0 0x7ff7d003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-25T23:53:06.828 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:04.928+0000 7ff7e3e00640 1 -- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7ff7d0038fc0 msgr2=0x7ff7d003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/1517739376 2024-08-25T23:53:06.828 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:04.929+0000 7ff7e3e00640 1 --2- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7ff7d0038fc0 0x7ff7d003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-08-25T23:53:06.828 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:05.124+0000 7ff7e9600640 1 -- 172.21.15.42:0/85369568 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7ff7dc02fd40 con 0x7ff7ec107db0 2024-08-25T23:53:06.828 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:05.124+0000 7ff7e9600640 1 -- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7ff7d0038fc0 msgr2=0x7ff7d003b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-25T23:53:06.828 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:05.124+0000 7ff7e9600640 1 --2- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7ff7d0038fc0 0x7ff7d003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:06.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:06.127+0000 7ff7e9600640 1 -- 172.21.15.42:0/85369568 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7ff7dc06de70 con 0x7ff7ec107db0 2024-08-25T23:53:06.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:06.127+0000 7ff7e9600640 1 --2- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7ff7d003c8f0 0x7ff7d003ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:06.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:06.127+0000 7ff7e9600640 1 -- 172.21.15.42:0/85369568 --> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff7dc032e30 con 0x7ff7d003c8f0 2024-08-25T23:53:06.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:06.128+0000 7ff7e3e00640 1 --2- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7ff7d003c8f0 0x7ff7d003ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:06.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:06.129+0000 7ff7e3e00640 1 --2- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7ff7d003c8f0 0x7ff7d003ece0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4003980 tx=0x7ff7d40092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:06.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:06.130+0000 7ff7e9600640 1 -- 172.21.15.42:0/85369568 <== mgr.14118 v2:172.21.15.42:6800/723045064 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7ff7dc032e30 con 0x7ff7d003c8f0 2024-08-25T23:53:06.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:06.138+0000 7ff7f1400640 1 -- 172.21.15.42:0/85369568 --> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7ff7ec108210 con 0x7ff7d003c8f0 2024-08-25T23:53:06.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:06.138+0000 7ff7e9600640 1 -- 172.21.15.42:0/85369568 <== mgr.14118 v2:172.21.15.42:6800/723045064 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7ff7ec108210 con 0x7ff7d003c8f0 2024-08-25T23:53:06.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:06.138+0000 7ff7f1400640 1 -- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7ff7d003c8f0 msgr2=0x7ff7d003ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:06.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:06.138+0000 7ff7f1400640 1 --2- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7ff7d003c8f0 0x7ff7d003ece0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4003980 tx=0x7ff7d40092b0 comp rx=0 tx=0).stop 2024-08-25T23:53:06.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:06.138+0000 7ff7f1400640 1 -- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7ec107db0 msgr2=0x7ff7ec19d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:06.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:06.138+0000 7ff7f1400640 1 --2- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7ec107db0 0x7ff7ec19d760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc0097f0 tx=0x7ff7dc030d80 comp rx=0 tx=0).stop 2024-08-25T23:53:06.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:06.139+0000 7ff7f1400640 1 -- 172.21.15.42:0/85369568 shutdown_connections 2024-08-25T23:53:06.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:06.139+0000 7ff7f1400640 1 --2- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7ff7d003c8f0 0x7ff7d003ece0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:06.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:06.139+0000 7ff7f1400640 1 --2- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:6800/1517739376,v1:172.21.15.42:6801/1517739376] conn(0x7ff7d0038fc0 0x7ff7d003b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:06.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:06.139+0000 7ff7f1400640 1 --2- 172.21.15.42:0/85369568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7ec107db0 0x7ff7ec19d760 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:06.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:06.139+0000 7ff7f1400640 1 -- 172.21.15.42:0/85369568 >> 172.21.15.42:0/85369568 conn(0x7ff7ec1019d0 msgr2=0x7ff7ec1025f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:06.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:06.139+0000 7ff7f1400640 1 -- 172.21.15.42:0/85369568 shutdown_connections 2024-08-25T23:53:06.830 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:06.139+0000 7ff7f1400640 1 -- 172.21.15.42:0/85369568 wait complete. 2024-08-25T23:53:06.830 INFO:teuthology.orchestra.run.smithi042.stdout:mgr epoch 5 is available 2024-08-25T23:53:06.830 INFO:teuthology.orchestra.run.smithi042.stdout:Setting orchestrator backend to cephadm... 2024-08-25T23:53:07.343 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-mon[17225]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-25T23:53:07.343 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-mon[17225]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-25T23:53:07.344 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' 2024-08-25T23:53:07.344 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' 2024-08-25T23:53:08.182 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:07.789+0000 7f925a600640 -1 log_channel(cephadm) log [ERR] : [25/Aug/2024:23:53:07] ENGINE Error in HTTPServer.serve 2024-08-25T23:53:08.182 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: Traceback (most recent call last): 2024-08-25T23:53:08.183 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-25T23:53:08.183 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: self._connections.run(self.expiration_interval) 2024-08-25T23:53:08.183 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-25T23:53:08.183 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: self._run(expiration_interval) 2024-08-25T23:53:08.183 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-25T23:53:08.183 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: new_conn = self._from_server_socket(self.server.socket) 2024-08-25T23:53:08.183 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-25T23:53:08.183 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-25T23:53:08.183 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-25T23:53:08.183 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: s = self.context.wrap_socket( 2024-08-25T23:53:08.183 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-25T23:53:08.184 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: return self.sslsocket_class._create( 2024-08-25T23:53:08.184 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-25T23:53:08.184 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: self.do_handshake() 2024-08-25T23:53:08.184 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-25T23:53:08.185 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: self._sslobj.do_handshake() 2024-08-25T23:53:08.185 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-25T23:53:08.186 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:07 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:08.192 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.341+0000 7fe8abe00640 1 Processor -- start 2024-08-25T23:53:08.192 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.341+0000 7fe8abe00640 1 -- start start 2024-08-25T23:53:08.192 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.341+0000 7fe8abe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8a410aae0 0x7fe8a410aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:08.192 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.341+0000 7fe8abe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a410b4b0 con 0x7fe8a410aae0 2024-08-25T23:53:08.192 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.342+0000 7fe8a9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8a410aae0 0x7fe8a410aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:08.193 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.342+0000 7fe8a9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8a410aae0 0x7fe8a410aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58154/0 (socket says 172.21.15.42:58154) 2024-08-25T23:53:08.193 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.342+0000 7fe8a9400640 1 -- 172.21.15.42:0/1792419346 learned_addr learned my addr 172.21.15.42:0/1792419346 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:08.193 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.342+0000 7fe8a9400640 1 -- 172.21.15.42:0/1792419346 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a410b630 con 0x7fe8a410aae0 2024-08-25T23:53:08.193 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.343+0000 7fe8a9400640 1 --2- 172.21.15.42:0/1792419346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8a410aae0 0x7fe8a410aee0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe898009820 tx=0x7fe89802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307e251991737ae9 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:08.193 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.343+0000 7fe8a3e00640 1 -- 172.21.15.42:0/1792419346 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe898037070 con 0x7fe8a410aae0 2024-08-25T23:53:08.193 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.344+0000 7fe8a3e00640 1 -- 172.21.15.42:0/1792419346 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe898032900 con 0x7fe8a410aae0 2024-08-25T23:53:08.193 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.344+0000 7fe8a3e00640 1 -- 172.21.15.42:0/1792419346 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe898030850 con 0x7fe8a410aae0 2024-08-25T23:53:08.193 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.344+0000 7fe8abe00640 1 -- 172.21.15.42:0/1792419346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8a410aae0 msgr2=0x7fe8a410aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:08.193 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.344+0000 7fe8abe00640 1 --2- 172.21.15.42:0/1792419346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8a410aae0 0x7fe8a410aee0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe898009820 tx=0x7fe89802a270 comp rx=0 tx=0).stop 2024-08-25T23:53:08.193 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.344+0000 7fe8abe00640 1 -- 172.21.15.42:0/1792419346 shutdown_connections 2024-08-25T23:53:08.193 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.344+0000 7fe8abe00640 1 --2- 172.21.15.42:0/1792419346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8a410aae0 0x7fe8a410aee0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:08.193 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.344+0000 7fe8abe00640 1 -- 172.21.15.42:0/1792419346 >> 172.21.15.42:0/1792419346 conn(0x7fe8a407cc90 msgr2=0x7fe8a407d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:08.194 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.344+0000 7fe8abe00640 1 -- 172.21.15.42:0/1792419346 shutdown_connections 2024-08-25T23:53:08.194 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.344+0000 7fe8abe00640 1 -- 172.21.15.42:0/1792419346 wait complete. 2024-08-25T23:53:08.194 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.345+0000 7fe8abe00640 1 Processor -- start 2024-08-25T23:53:08.194 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.345+0000 7fe8abe00640 1 -- start start 2024-08-25T23:53:08.194 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.346+0000 7fe8abe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8a410aae0 0x7fe8a419d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:08.194 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.346+0000 7fe8abe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a410db40 con 0x7fe8a410aae0 2024-08-25T23:53:08.194 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.346+0000 7fe8a9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8a410aae0 0x7fe8a419d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:08.194 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.346+0000 7fe8a9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8a410aae0 0x7fe8a419d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58170/0 (socket says 172.21.15.42:58170) 2024-08-25T23:53:08.194 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.346+0000 7fe8a9400640 1 -- 172.21.15.42:0/2267621751 learned_addr learned my addr 172.21.15.42:0/2267621751 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:08.194 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.346+0000 7fe8a9400640 1 -- 172.21.15.42:0/2267621751 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a419de80 con 0x7fe8a410aae0 2024-08-25T23:53:08.195 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.347+0000 7fe8a9400640 1 --2- 172.21.15.42:0/2267621751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8a410aae0 0x7fe8a419d940 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe898032ce0 tx=0x7fe898032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:08.195 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.347+0000 7fe8a2000640 1 -- 172.21.15.42:0/2267621751 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe898042070 con 0x7fe8a410aae0 2024-08-25T23:53:08.195 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.347+0000 7fe8a2000640 1 -- 172.21.15.42:0/2267621751 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe8980308c0 con 0x7fe8a410aae0 2024-08-25T23:53:08.195 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.347+0000 7fe8abe00640 1 -- 172.21.15.42:0/2267621751 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8a419e110 con 0x7fe8a410aae0 2024-08-25T23:53:08.195 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.347+0000 7fe8a2000640 1 -- 172.21.15.42:0/2267621751 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe898037040 con 0x7fe8a410aae0 2024-08-25T23:53:08.195 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.347+0000 7fe8abe00640 1 -- 172.21.15.42:0/2267621751 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8a41a0e00 con 0x7fe8a410aae0 2024-08-25T23:53:08.195 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.348+0000 7fe8abe00640 1 -- 172.21.15.42:0/2267621751 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8a410dcc0 con 0x7fe8a410aae0 2024-08-25T23:53:08.195 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.348+0000 7fe8a2000640 1 -- 172.21.15.42:0/2267621751 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fe898045070 con 0x7fe8a410aae0 2024-08-25T23:53:08.195 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.349+0000 7fe8a2000640 1 --2- 172.21.15.42:0/2267621751 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7fe88c038fc0 0x7fe88c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:08.195 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.349+0000 7fe8a2000640 1 -- 172.21.15.42:0/2267621751 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe89806c0b0 con 0x7fe8a410aae0 2024-08-25T23:53:08.195 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.349+0000 7fe8a8a00640 1 --2- 172.21.15.42:0/2267621751 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7fe88c038fc0 0x7fe88c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:08.196 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.350+0000 7fe8a8a00640 1 --2- 172.21.15.42:0/2267621751 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7fe88c038fc0 0x7fe88c03b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe8900098c0 tx=0x7fe890006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:08.196 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.354+0000 7fe8a2000640 1 -- 172.21.15.42:0/2267621751 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe89804b170 con 0x7fe8a410aae0 2024-08-25T23:53:08.196 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.555+0000 7fe8abe00640 1 -- 172.21.15.42:0/2267621751 --> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fe8a4074940 con 0x7fe88c038fc0 2024-08-25T23:53:08.196 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.561+0000 7fe8a2000640 1 -- 172.21.15.42:0/2267621751 <== mgr.14118 v2:172.21.15.42:6800/723045064 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe8a4074940 con 0x7fe88c038fc0 2024-08-25T23:53:08.196 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.563+0000 7fe8abe00640 1 -- 172.21.15.42:0/2267621751 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7fe88c038fc0 msgr2=0x7fe88c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:08.196 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.563+0000 7fe8abe00640 1 --2- 172.21.15.42:0/2267621751 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7fe88c038fc0 0x7fe88c03b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe8900098c0 tx=0x7fe890006db0 comp rx=0 tx=0).stop 2024-08-25T23:53:08.196 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.563+0000 7fe8abe00640 1 -- 172.21.15.42:0/2267621751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8a410aae0 msgr2=0x7fe8a419d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:08.196 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.563+0000 7fe8abe00640 1 --2- 172.21.15.42:0/2267621751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8a410aae0 0x7fe8a419d940 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe898032ce0 tx=0x7fe898032d10 comp rx=0 tx=0).stop 2024-08-25T23:53:08.196 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.563+0000 7fe8abe00640 1 -- 172.21.15.42:0/2267621751 shutdown_connections 2024-08-25T23:53:08.196 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.563+0000 7fe8abe00640 1 --2- 172.21.15.42:0/2267621751 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7fe88c038fc0 0x7fe88c03b480 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:08.196 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.563+0000 7fe8abe00640 1 --2- 172.21.15.42:0/2267621751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8a410aae0 0x7fe8a419d940 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:08.196 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.563+0000 7fe8abe00640 1 -- 172.21.15.42:0/2267621751 >> 172.21.15.42:0/2267621751 conn(0x7fe8a407cc90 msgr2=0x7fe8a4107730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:08.197 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.564+0000 7fe8abe00640 1 -- 172.21.15.42:0/2267621751 shutdown_connections 2024-08-25T23:53:08.197 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:07.564+0000 7fe8abe00640 1 -- 172.21.15.42:0/2267621751 wait complete. 2024-08-25T23:53:08.449 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:08 smithi042 ceph-mon[17225]: mgrmap e8: x(active, since 2s) 2024-08-25T23:53:08.450 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:08 smithi042 ceph-mon[17225]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:53:08.450 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:08 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' 2024-08-25T23:53:08.450 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:08 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:53:08.450 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:08 smithi042 ceph-mon[17225]: [25/Aug/2024:23:53:07] ENGINE Bus STARTING 2024-08-25T23:53:08.450 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:08 smithi042 ceph-mon[17225]: [25/Aug/2024:23:53:07] ENGINE Serving on https://172.21.15.42:7150 2024-08-25T23:53:08.450 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:08 smithi042 ceph-mon[17225]: [25/Aug/2024:23:53:07] ENGINE Error in HTTPServer.serve 2024-08-25T23:53:08.450 INFO:journalctl@ceph.mon.a.smithi042.stdout: Traceback (most recent call last): 2024-08-25T23:53:08.450 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-25T23:53:08.450 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._connections.run(self.expiration_interval) 2024-08-25T23:53:08.450 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-25T23:53:08.450 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._run(expiration_interval) 2024-08-25T23:53:08.450 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-25T23:53:08.451 INFO:journalctl@ceph.mon.a.smithi042.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-25T23:53:08.451 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-25T23:53:08.451 INFO:journalctl@ceph.mon.a.smithi042.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-25T23:53:08.451 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-25T23:53:08.451 INFO:journalctl@ceph.mon.a.smithi042.stdout: s = self.context.wrap_socket( 2024-08-25T23:53:08.451 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-25T23:53:08.451 INFO:journalctl@ceph.mon.a.smithi042.stdout: return self.sslsocket_class._create( 2024-08-25T23:53:08.451 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-25T23:53:08.451 INFO:journalctl@ceph.mon.a.smithi042.stdout: self.do_handshake() 2024-08-25T23:53:08.451 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-25T23:53:08.452 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._sslobj.do_handshake() 2024-08-25T23:53:08.452 INFO:journalctl@ceph.mon.a.smithi042.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-25T23:53:08.452 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:08 smithi042 ceph-mon[17225]: [25/Aug/2024:23:53:07] ENGINE Serving on http://172.21.15.42:8765 2024-08-25T23:53:08.452 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:08 smithi042 ceph-mon[17225]: [25/Aug/2024:23:53:07] ENGINE Bus STARTED 2024-08-25T23:53:08.452 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:08 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:53:09.518 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:09 smithi042 ceph-mon[17225]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:53:09.528 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout value unchanged 2024-08-25T23:53:09.528 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.692+0000 7f737a800640 1 Processor -- start 2024-08-25T23:53:09.528 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.692+0000 7f737a800640 1 -- start start 2024-08-25T23:53:09.529 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.693+0000 7f737a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7374107f80 0x7f737410a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:09.529 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.693+0000 7f737a800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f737407be40 con 0x7f7374107f80 2024-08-25T23:53:09.529 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.693+0000 7f7373400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7374107f80 0x7f737410a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:09.529 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.693+0000 7f7373400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7374107f80 0x7f737410a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58186/0 (socket says 172.21.15.42:58186) 2024-08-25T23:53:09.529 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.693+0000 7f7373400640 1 -- 172.21.15.42:0/3996821008 learned_addr learned my addr 172.21.15.42:0/3996821008 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:09.529 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.694+0000 7f7373400640 1 -- 172.21.15.42:0/3996821008 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f737410a8b0 con 0x7f7374107f80 2024-08-25T23:53:09.529 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.695+0000 7f7373400640 1 --2- 172.21.15.42:0/3996821008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7374107f80 0x7f737410a370 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7364009820 tx=0x7f736402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c85af15e754b42 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:09.529 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.695+0000 7f7372000640 1 -- 172.21.15.42:0/3996821008 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7364037070 con 0x7f7374107f80 2024-08-25T23:53:09.529 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.695+0000 7f7372000640 1 -- 172.21.15.42:0/3996821008 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7364032900 con 0x7f7374107f80 2024-08-25T23:53:09.529 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.695+0000 7f7372000640 1 -- 172.21.15.42:0/3996821008 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7364030850 con 0x7f7374107f80 2024-08-25T23:53:09.529 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.695+0000 7f737a800640 1 -- 172.21.15.42:0/3996821008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7374107f80 msgr2=0x7f737410a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:09.529 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.695+0000 7f737a800640 1 --2- 172.21.15.42:0/3996821008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7374107f80 0x7f737410a370 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7364009820 tx=0x7f736402a270 comp rx=0 tx=0).stop 2024-08-25T23:53:09.530 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.696+0000 7f737a800640 1 -- 172.21.15.42:0/3996821008 shutdown_connections 2024-08-25T23:53:09.530 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.696+0000 7f737a800640 1 --2- 172.21.15.42:0/3996821008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7374107f80 0x7f737410a370 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:09.530 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.696+0000 7f737a800640 1 -- 172.21.15.42:0/3996821008 >> 172.21.15.42:0/3996821008 conn(0x7f7374101b20 msgr2=0x7f7374103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:09.530 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.696+0000 7f737a800640 1 -- 172.21.15.42:0/3996821008 shutdown_connections 2024-08-25T23:53:09.530 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.696+0000 7f737a800640 1 -- 172.21.15.42:0/3996821008 wait complete. 2024-08-25T23:53:09.530 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.697+0000 7f737a800640 1 Processor -- start 2024-08-25T23:53:09.530 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.697+0000 7f737a800640 1 -- start start 2024-08-25T23:53:09.530 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.697+0000 7f737a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7374107f80 0x7f7374107800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:09.530 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.697+0000 7f737a800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f737410b820 con 0x7f7374107f80 2024-08-25T23:53:09.530 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.697+0000 7f7373400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7374107f80 0x7f7374107800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:09.530 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.697+0000 7f7373400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7374107f80 0x7f7374107800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58190/0 (socket says 172.21.15.42:58190) 2024-08-25T23:53:09.530 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.697+0000 7f7373400640 1 -- 172.21.15.42:0/1037870660 learned_addr learned my addr 172.21.15.42:0/1037870660 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:09.530 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.698+0000 7f7373400640 1 -- 172.21.15.42:0/1037870660 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7374107d40 con 0x7f7374107f80 2024-08-25T23:53:09.531 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.698+0000 7f7373400640 1 --2- 172.21.15.42:0/1037870660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7374107f80 0x7f7374107800 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f73640097f0 tx=0x7f7364030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:09.531 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.698+0000 7f736be00640 1 -- 172.21.15.42:0/1037870660 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7364037040 con 0x7f7374107f80 2024-08-25T23:53:09.531 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.698+0000 7f736be00640 1 -- 172.21.15.42:0/1037870660 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7364040070 con 0x7f7374107f80 2024-08-25T23:53:09.531 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.698+0000 7f737a800640 1 -- 172.21.15.42:0/1037870660 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7374105f30 con 0x7f7374107f80 2024-08-25T23:53:09.531 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.698+0000 7f736be00640 1 -- 172.21.15.42:0/1037870660 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f736403a390 con 0x7f7374107f80 2024-08-25T23:53:09.531 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.698+0000 7f737a800640 1 -- 172.21.15.42:0/1037870660 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7374106410 con 0x7f7374107f80 2024-08-25T23:53:09.531 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.699+0000 7f736be00640 1 -- 172.21.15.42:0/1037870660 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f7364032900 con 0x7f7374107f80 2024-08-25T23:53:09.531 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.700+0000 7f737a800640 1 -- 172.21.15.42:0/1037870660 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73741083e0 con 0x7f7374107f80 2024-08-25T23:53:09.531 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.700+0000 7f736be00640 1 --2- 172.21.15.42:0/1037870660 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f7358038fc0 0x7f735803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:09.531 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.700+0000 7f736be00640 1 -- 172.21.15.42:0/1037870660 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f736406c4e0 con 0x7f7374107f80 2024-08-25T23:53:09.532 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.700+0000 7f7372a00640 1 --2- 172.21.15.42:0/1037870660 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f7358038fc0 0x7f735803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:09.532 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.701+0000 7f7372a00640 1 --2- 172.21.15.42:0/1037870660 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f7358038fc0 0x7f735803b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f73600098c0 tx=0x7f7360006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:09.532 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.705+0000 7f736be00640 1 -- 172.21.15.42:0/1037870660 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f736406be30 con 0x7f7374107f80 2024-08-25T23:53:09.532 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.891+0000 7f737a800640 1 -- 172.21.15.42:0/1037870660 --> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f7374194f00 con 0x7f7358038fc0 2024-08-25T23:53:09.532 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.892+0000 7f736be00640 1 -- 172.21.15.42:0/1037870660 <== mgr.14118 v2:172.21.15.42:6800/723045064 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f7374194f00 con 0x7f7358038fc0 2024-08-25T23:53:09.532 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.894+0000 7f737a800640 1 -- 172.21.15.42:0/1037870660 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f7358038fc0 msgr2=0x7f735803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:09.532 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.894+0000 7f737a800640 1 --2- 172.21.15.42:0/1037870660 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f7358038fc0 0x7f735803b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f73600098c0 tx=0x7f7360006db0 comp rx=0 tx=0).stop 2024-08-25T23:53:09.532 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.894+0000 7f737a800640 1 -- 172.21.15.42:0/1037870660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7374107f80 msgr2=0x7f7374107800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:09.532 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.894+0000 7f737a800640 1 --2- 172.21.15.42:0/1037870660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7374107f80 0x7f7374107800 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f73640097f0 tx=0x7f7364030d80 comp rx=0 tx=0).stop 2024-08-25T23:53:09.532 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.894+0000 7f737a800640 1 -- 172.21.15.42:0/1037870660 shutdown_connections 2024-08-25T23:53:09.532 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.894+0000 7f737a800640 1 --2- 172.21.15.42:0/1037870660 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f7358038fc0 0x7f735803b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:09.532 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.894+0000 7f737a800640 1 --2- 172.21.15.42:0/1037870660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7374107f80 0x7f7374107800 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:09.532 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.894+0000 7f737a800640 1 -- 172.21.15.42:0/1037870660 >> 172.21.15.42:0/1037870660 conn(0x7f7374101b20 msgr2=0x7f7374102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:09.533 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.894+0000 7f737a800640 1 -- 172.21.15.42:0/1037870660 shutdown_connections 2024-08-25T23:53:09.533 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:08.894+0000 7f737a800640 1 -- 172.21.15.42:0/1037870660 wait complete. 2024-08-25T23:53:09.533 INFO:teuthology.orchestra.run.smithi042.stdout:Generating ssh key... 2024-08-25T23:53:10.783 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:10 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: Generating public/private rsa key pair. 2024-08-25T23:53:10.783 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:10 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: Your identification has been saved in /tmp/tmpcra2meyk/key 2024-08-25T23:53:10.783 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:10 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: Your public key has been saved in /tmp/tmpcra2meyk/key.pub 2024-08-25T23:53:10.784 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:10 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: The key fingerprint is: 2024-08-25T23:53:10.784 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:10 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: SHA256:fOu2n4sf6czLh5l6tvBE6PT6eaGLsSYiVjgJujfHZL4 ceph-f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:53:10.784 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:10 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: The key's randomart image is: 2024-08-25T23:53:10.784 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:10 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: +---[RSA 3072]----+ 2024-08-25T23:53:10.784 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:10 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: | | 2024-08-25T23:53:10.784 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:10 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: | | 2024-08-25T23:53:10.784 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:10 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: | | 2024-08-25T23:53:10.784 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:10 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: | . . . | 2024-08-25T23:53:10.784 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:10 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: | . . o S + . | 2024-08-25T23:53:10.784 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:10 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: |. * . + + .. | 2024-08-25T23:53:10.784 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:10 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: | . = o = == . | 2024-08-25T23:53:10.784 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:10 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: |. o * . ..o#B+o | 2024-08-25T23:53:10.784 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:10 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: | . +Eo . +OO^B | 2024-08-25T23:53:10.784 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:10 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: +----[SHA256]-----+ 2024-08-25T23:53:11.153 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.994+0000 7fe5c6600640 1 Processor -- start 2024-08-25T23:53:11.153 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.994+0000 7fe5c6600640 1 -- start start 2024-08-25T23:53:11.153 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.994+0000 7fe5c6600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5c010aae0 0x7fe5c010aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:11.153 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.994+0000 7fe5c6600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c010b4b0 con 0x7fe5c010aae0 2024-08-25T23:53:11.153 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.994+0000 7fe5bf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5c010aae0 0x7fe5c010aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:11.153 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.995+0000 7fe5bf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5c010aae0 0x7fe5c010aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58204/0 (socket says 172.21.15.42:58204) 2024-08-25T23:53:11.153 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.995+0000 7fe5bf400640 1 -- 172.21.15.42:0/1805829824 learned_addr learned my addr 172.21.15.42:0/1805829824 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:11.153 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.995+0000 7fe5bf400640 1 -- 172.21.15.42:0/1805829824 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c010b630 con 0x7fe5c010aae0 2024-08-25T23:53:11.153 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.996+0000 7fe5bf400640 1 --2- 172.21.15.42:0/1805829824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5c010aae0 0x7fe5c010aee0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009820 tx=0x7fe5b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dbdc8db36a4c21c server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:11.153 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.996+0000 7fe5be000640 1 -- 172.21.15.42:0/1805829824 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5b0037070 con 0x7fe5c010aae0 2024-08-25T23:53:11.153 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.996+0000 7fe5be000640 1 -- 172.21.15.42:0/1805829824 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe5b0032900 con 0x7fe5c010aae0 2024-08-25T23:53:11.154 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.996+0000 7fe5be000640 1 -- 172.21.15.42:0/1805829824 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5b0030850 con 0x7fe5c010aae0 2024-08-25T23:53:11.154 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.997+0000 7fe5c6600640 1 -- 172.21.15.42:0/1805829824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5c010aae0 msgr2=0x7fe5c010aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:11.154 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.997+0000 7fe5c6600640 1 --2- 172.21.15.42:0/1805829824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5c010aae0 0x7fe5c010aee0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009820 tx=0x7fe5b002a270 comp rx=0 tx=0).stop 2024-08-25T23:53:11.154 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.997+0000 7fe5c6600640 1 -- 172.21.15.42:0/1805829824 shutdown_connections 2024-08-25T23:53:11.154 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.997+0000 7fe5c6600640 1 --2- 172.21.15.42:0/1805829824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5c010aae0 0x7fe5c010aee0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:11.154 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.997+0000 7fe5c6600640 1 -- 172.21.15.42:0/1805829824 >> 172.21.15.42:0/1805829824 conn(0x7fe5c007cc90 msgr2=0x7fe5c007d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:11.154 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.997+0000 7fe5c6600640 1 -- 172.21.15.42:0/1805829824 shutdown_connections 2024-08-25T23:53:11.154 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.997+0000 7fe5c6600640 1 -- 172.21.15.42:0/1805829824 wait complete. 2024-08-25T23:53:11.154 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.998+0000 7fe5c6600640 1 Processor -- start 2024-08-25T23:53:11.154 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.998+0000 7fe5c6600640 1 -- start start 2024-08-25T23:53:11.154 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.998+0000 7fe5c6600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5c010aae0 0x7fe5c019d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:11.154 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.998+0000 7fe5c6600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c010db40 con 0x7fe5c010aae0 2024-08-25T23:53:11.154 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.999+0000 7fe5bf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5c010aae0 0x7fe5c019d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:11.154 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.999+0000 7fe5bf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5c010aae0 0x7fe5c019d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58216/0 (socket says 172.21.15.42:58216) 2024-08-25T23:53:11.155 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.999+0000 7fe5bf400640 1 -- 172.21.15.42:0/1034463283 learned_addr learned my addr 172.21.15.42:0/1034463283 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:11.155 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.999+0000 7fe5bf400640 1 -- 172.21.15.42:0/1034463283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c019de80 con 0x7fe5c010aae0 2024-08-25T23:53:11.155 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.999+0000 7fe5bf400640 1 --2- 172.21.15.42:0/1034463283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5c010aae0 0x7fe5c019d940 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe5b00097f0 tx=0x7fe5b0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:11.155 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.999+0000 7fe5b7e00640 1 -- 172.21.15.42:0/1034463283 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5b0037040 con 0x7fe5c010aae0 2024-08-25T23:53:11.155 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.999+0000 7fe5b7e00640 1 -- 172.21.15.42:0/1034463283 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe5b0040070 con 0x7fe5c010aae0 2024-08-25T23:53:11.155 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:09.999+0000 7fe5c6600640 1 -- 172.21.15.42:0/1034463283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c019e110 con 0x7fe5c010aae0 2024-08-25T23:53:11.155 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:10.000+0000 7fe5b7e00640 1 -- 172.21.15.42:0/1034463283 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5b003a390 con 0x7fe5c010aae0 2024-08-25T23:53:11.155 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:10.000+0000 7fe5c6600640 1 -- 172.21.15.42:0/1034463283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c01a0e00 con 0x7fe5c010aae0 2024-08-25T23:53:11.155 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:10.001+0000 7fe5b7e00640 1 -- 172.21.15.42:0/1034463283 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fe5b0032900 con 0x7fe5c010aae0 2024-08-25T23:53:11.155 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:10.001+0000 7fe5c6600640 1 -- 172.21.15.42:0/1034463283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5c010af60 con 0x7fe5c010aae0 2024-08-25T23:53:11.155 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:10.001+0000 7fe5b7e00640 1 --2- 172.21.15.42:0/1034463283 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7fe5a4038fc0 0x7fe5a403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:11.155 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:10.001+0000 7fe5b7e00640 1 -- 172.21.15.42:0/1034463283 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe5b006c520 con 0x7fe5c010aae0 2024-08-25T23:53:11.155 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:10.001+0000 7fe5bea00640 1 --2- 172.21.15.42:0/1034463283 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7fe5a4038fc0 0x7fe5a403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:11.155 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:10.002+0000 7fe5bea00640 1 --2- 172.21.15.42:0/1034463283 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7fe5a4038fc0 0x7fe5a403b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac0098c0 tx=0x7fe5ac006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:11.156 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:10.006+0000 7fe5b7e00640 1 -- 172.21.15.42:0/1034463283 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe5b006be70 con 0x7fe5c010aae0 2024-08-25T23:53:11.156 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:10.194+0000 7fe5c6600640 1 -- 172.21.15.42:0/1034463283 --> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fe5c002d710 con 0x7fe5a4038fc0 2024-08-25T23:53:11.156 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:10.492+0000 7fe5b7e00640 1 -- 172.21.15.42:0/1034463283 <== mgr.14118 v2:172.21.15.42:6800/723045064 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe5c002d710 con 0x7fe5a4038fc0 2024-08-25T23:53:11.156 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:10.495+0000 7fe5c6600640 1 -- 172.21.15.42:0/1034463283 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7fe5a4038fc0 msgr2=0x7fe5a403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:11.156 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:10.495+0000 7fe5c6600640 1 --2- 172.21.15.42:0/1034463283 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7fe5a4038fc0 0x7fe5a403b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac0098c0 tx=0x7fe5ac006db0 comp rx=0 tx=0).stop 2024-08-25T23:53:11.156 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:10.495+0000 7fe5c6600640 1 -- 172.21.15.42:0/1034463283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5c010aae0 msgr2=0x7fe5c019d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:11.156 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:10.495+0000 7fe5c6600640 1 --2- 172.21.15.42:0/1034463283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5c010aae0 0x7fe5c019d940 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe5b00097f0 tx=0x7fe5b0030d80 comp rx=0 tx=0).stop 2024-08-25T23:53:11.156 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:10.495+0000 7fe5c6600640 1 -- 172.21.15.42:0/1034463283 shutdown_connections 2024-08-25T23:53:11.156 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:10.495+0000 7fe5c6600640 1 --2- 172.21.15.42:0/1034463283 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7fe5a4038fc0 0x7fe5a403b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:11.156 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:10.495+0000 7fe5c6600640 1 --2- 172.21.15.42:0/1034463283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5c010aae0 0x7fe5c019d940 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:11.156 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:10.495+0000 7fe5c6600640 1 -- 172.21.15.42:0/1034463283 >> 172.21.15.42:0/1034463283 conn(0x7fe5c007cc90 msgr2=0x7fe5c0107730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:11.156 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:10.495+0000 7fe5c6600640 1 -- 172.21.15.42:0/1034463283 shutdown_connections 2024-08-25T23:53:11.156 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:10.495+0000 7fe5c6600640 1 -- 172.21.15.42:0/1034463283 wait complete. 2024-08-25T23:53:11.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:11 smithi042 ceph-mon[17225]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:53:11.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:11 smithi042 ceph-mon[17225]: Generating ssh key... 2024-08-25T23:53:11.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:11 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' 2024-08-25T23:53:11.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:11 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' 2024-08-25T23:53:12.543 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCc6H2xrq43AbbGD7ydWJWnCEDzsSM6ubxngy7mH2CBm07Aqhw3kt8gaK9hbveE60Ic5wr1VTUly53Y3aqgufrJK9AbpZMR47UCZOvbCXuZlXI6Bo5JgjHvW2rhx5DA3OFbzVjMiIt3zgt0/as/DIG8LDKcyYvw7U7oYUn2cQpTgYHZKWdjWS95j7sJrEwjvPsjxEAQT9vcnckJsYyASYx1EgRBSUmN34w0cT+DSE0iKn6g1qK6D2X7glcGhzZYXhcZHpYaHyLEw4ynNRp7ih73icGpOt1zCRDAfkF4d/Yox9LPF20S6xYxT2Ph0h9Vh0zmdbdqy3e9HzD2eB898s/VUStExxtXTHQfqvR0IXrtY98oHd7N31evbhNVaN4FxL/WFoCGhqw3GAuXuk4VvyZSG0jJSmvrXSq26Nl0gKkIC0bIucXVUrEVY3nIffyZcURwnAKDRqPUGWYFgaBQd1YEkP2A3GR7TMUFSdkyuZotsp7otkr7KaGBuS5fR76/f4E= ceph-f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:53:12.543 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.622+0000 7f667b600640 1 Processor -- start 2024-08-25T23:53:12.543 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.622+0000 7f667b600640 1 -- start start 2024-08-25T23:53:12.543 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.623+0000 7f667b600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66741074f0 0x7f66741078f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:12.543 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.623+0000 7f667b600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6674107ec0 con 0x7f66741074f0 2024-08-25T23:53:12.543 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.623+0000 7f6678c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66741074f0 0x7f66741078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:12.543 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.623+0000 7f6678c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66741074f0 0x7f66741078f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58230/0 (socket says 172.21.15.42:58230) 2024-08-25T23:53:12.544 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.623+0000 7f6678c00640 1 -- 172.21.15.42:0/1631645506 learned_addr learned my addr 172.21.15.42:0/1631645506 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:12.544 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.623+0000 7f6678c00640 1 -- 172.21.15.42:0/1631645506 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66741086a0 con 0x7f66741074f0 2024-08-25T23:53:12.544 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.624+0000 7f6678c00640 1 --2- 172.21.15.42:0/1631645506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66741074f0 0x7f66741078f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6664009820 tx=0x7f666402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2d3d7a2189e2da server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:12.544 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.625+0000 7f6673e00640 1 -- 172.21.15.42:0/1631645506 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6664037070 con 0x7f66741074f0 2024-08-25T23:53:12.544 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.625+0000 7f6673e00640 1 -- 172.21.15.42:0/1631645506 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6664032900 con 0x7f66741074f0 2024-08-25T23:53:12.544 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.625+0000 7f6673e00640 1 -- 172.21.15.42:0/1631645506 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6664030850 con 0x7f66741074f0 2024-08-25T23:53:12.544 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.625+0000 7f667b600640 1 -- 172.21.15.42:0/1631645506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66741074f0 msgr2=0x7f66741078f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:12.544 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.625+0000 7f667b600640 1 --2- 172.21.15.42:0/1631645506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66741074f0 0x7f66741078f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6664009820 tx=0x7f666402a270 comp rx=0 tx=0).stop 2024-08-25T23:53:12.544 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.625+0000 7f667b600640 1 -- 172.21.15.42:0/1631645506 shutdown_connections 2024-08-25T23:53:12.544 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.625+0000 7f667b600640 1 --2- 172.21.15.42:0/1631645506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66741074f0 0x7f66741078f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:12.544 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.625+0000 7f667b600640 1 -- 172.21.15.42:0/1631645506 >> 172.21.15.42:0/1631645506 conn(0x7f6674102c80 msgr2=0x7f66741050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:12.544 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.626+0000 7f667b600640 1 -- 172.21.15.42:0/1631645506 shutdown_connections 2024-08-25T23:53:12.544 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.626+0000 7f667b600640 1 -- 172.21.15.42:0/1631645506 wait complete. 2024-08-25T23:53:12.544 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.627+0000 7f667b600640 1 Processor -- start 2024-08-25T23:53:12.545 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.627+0000 7f667b600640 1 -- start start 2024-08-25T23:53:12.545 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.627+0000 7f667b600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66741074f0 0x7f667407db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:12.545 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.627+0000 7f667b600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f667410ba50 con 0x7f66741074f0 2024-08-25T23:53:12.545 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.627+0000 7f6678c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66741074f0 0x7f667407db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:12.545 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.627+0000 7f6678c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66741074f0 0x7f667407db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58234/0 (socket says 172.21.15.42:58234) 2024-08-25T23:53:12.545 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.627+0000 7f6678c00640 1 -- 172.21.15.42:0/2104471204 learned_addr learned my addr 172.21.15.42:0/2104471204 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:12.545 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.628+0000 7f6678c00640 1 -- 172.21.15.42:0/2104471204 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f667407e0c0 con 0x7f66741074f0 2024-08-25T23:53:12.545 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.628+0000 7f6678c00640 1 --2- 172.21.15.42:0/2104471204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66741074f0 0x7f667407db80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f66640097f0 tx=0x7f6664030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:12.545 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.628+0000 7f6672000640 1 -- 172.21.15.42:0/2104471204 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6664037040 con 0x7f66741074f0 2024-08-25T23:53:12.545 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.628+0000 7f6672000640 1 -- 172.21.15.42:0/2104471204 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6664040070 con 0x7f66741074f0 2024-08-25T23:53:12.545 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.628+0000 7f667b600640 1 -- 172.21.15.42:0/2104471204 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f667407c2b0 con 0x7f66741074f0 2024-08-25T23:53:12.545 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.628+0000 7f6672000640 1 -- 172.21.15.42:0/2104471204 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f666403a390 con 0x7f66741074f0 2024-08-25T23:53:12.545 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.628+0000 7f667b600640 1 -- 172.21.15.42:0/2104471204 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f667407c790 con 0x7f66741074f0 2024-08-25T23:53:12.545 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.629+0000 7f667b600640 1 -- 172.21.15.42:0/2104471204 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6674107970 con 0x7f66741074f0 2024-08-25T23:53:12.545 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.629+0000 7f6672000640 1 -- 172.21.15.42:0/2104471204 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f666403b430 con 0x7f66741074f0 2024-08-25T23:53:12.546 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.630+0000 7f6672000640 1 --2- 172.21.15.42:0/2104471204 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f6658038fc0 0x7f665803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:12.546 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.630+0000 7f6672000640 1 -- 172.21.15.42:0/2104471204 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f666406c4d0 con 0x7f66741074f0 2024-08-25T23:53:12.546 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.630+0000 7f666be00640 1 --2- 172.21.15.42:0/2104471204 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f6658038fc0 0x7f665803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:12.546 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.631+0000 7f666be00640 1 --2- 172.21.15.42:0/2104471204 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f6658038fc0 0x7f665803b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f665c0098c0 tx=0x7f665c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:12.546 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.635+0000 7f6672000640 1 -- 172.21.15.42:0/2104471204 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f66640371e0 con 0x7f66741074f0 2024-08-25T23:53:12.546 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.823+0000 7f667b600640 1 -- 172.21.15.42:0/2104471204 --> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f6674194f30 con 0x7f6658038fc0 2024-08-25T23:53:12.546 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.824+0000 7f6672000640 1 -- 172.21.15.42:0/2104471204 <== mgr.14118 v2:172.21.15.42:6800/723045064 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f6674194f30 con 0x7f6658038fc0 2024-08-25T23:53:12.546 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.827+0000 7f667b600640 1 -- 172.21.15.42:0/2104471204 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f6658038fc0 msgr2=0x7f665803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:12.546 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.827+0000 7f667b600640 1 --2- 172.21.15.42:0/2104471204 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f6658038fc0 0x7f665803b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f665c0098c0 tx=0x7f665c006db0 comp rx=0 tx=0).stop 2024-08-25T23:53:12.546 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.827+0000 7f667b600640 1 -- 172.21.15.42:0/2104471204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66741074f0 msgr2=0x7f667407db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:12.546 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.827+0000 7f667b600640 1 --2- 172.21.15.42:0/2104471204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66741074f0 0x7f667407db80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f66640097f0 tx=0x7f6664030d80 comp rx=0 tx=0).stop 2024-08-25T23:53:12.547 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.827+0000 7f667b600640 1 -- 172.21.15.42:0/2104471204 shutdown_connections 2024-08-25T23:53:12.547 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.827+0000 7f667b600640 1 --2- 172.21.15.42:0/2104471204 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f6658038fc0 0x7f665803b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:12.547 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.827+0000 7f667b600640 1 --2- 172.21.15.42:0/2104471204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66741074f0 0x7f667407db80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:12.547 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.827+0000 7f667b600640 1 -- 172.21.15.42:0/2104471204 >> 172.21.15.42:0/2104471204 conn(0x7f6674102c80 msgr2=0x7f66741039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:12.547 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.827+0000 7f667b600640 1 -- 172.21.15.42:0/2104471204 shutdown_connections 2024-08-25T23:53:12.547 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:11.827+0000 7f667b600640 1 -- 172.21.15.42:0/2104471204 wait complete. 2024-08-25T23:53:12.547 INFO:teuthology.orchestra.run.smithi042.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-08-25T23:53:12.547 INFO:teuthology.orchestra.run.smithi042.stdout:Adding key to root@localhost authorized_keys... 2024-08-25T23:53:12.547 INFO:teuthology.orchestra.run.smithi042.stdout:Adding host smithi042... 2024-08-25T23:53:12.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:12 smithi042 ceph-mon[17225]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:53:14.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:14 smithi042 ceph-mon[17225]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi042", "addr": "172.21.15.42", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:53:15.491 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:15 smithi042 ceph-mon[17225]: Deploying cephadm binary to smithi042 2024-08-25T23:53:18.426 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout Added host 'smithi042' with addr '172.21.15.42' 2024-08-25T23:53:18.426 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.020+0000 7f5e7ea00640 1 Processor -- start 2024-08-25T23:53:18.426 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.020+0000 7f5e7ea00640 1 -- start start 2024-08-25T23:53:18.426 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.020+0000 7f5e7ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7810aae0 0x7f5e7810aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:18.426 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.020+0000 7f5e7ea00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7810b4b0 con 0x7f5e7810aae0 2024-08-25T23:53:18.426 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.021+0000 7f5e77e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7810aae0 0x7f5e7810aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:18.426 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.021+0000 7f5e77e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7810aae0 0x7f5e7810aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58250/0 (socket says 172.21.15.42:58250) 2024-08-25T23:53:18.427 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.021+0000 7f5e77e00640 1 -- 172.21.15.42:0/2770008412 learned_addr learned my addr 172.21.15.42:0/2770008412 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:18.427 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.021+0000 7f5e77e00640 1 -- 172.21.15.42:0/2770008412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e7810b630 con 0x7f5e7810aae0 2024-08-25T23:53:18.427 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.022+0000 7f5e77e00640 1 --2- 172.21.15.42:0/2770008412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7810aae0 0x7f5e7810aee0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009820 tx=0x7f5e6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4974d79f861e448d server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:18.427 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.022+0000 7f5e76a00640 1 -- 172.21.15.42:0/2770008412 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e68037070 con 0x7f5e7810aae0 2024-08-25T23:53:18.427 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.022+0000 7f5e76a00640 1 -- 172.21.15.42:0/2770008412 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5e68032900 con 0x7f5e7810aae0 2024-08-25T23:53:18.427 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.022+0000 7f5e76a00640 1 -- 172.21.15.42:0/2770008412 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e68030850 con 0x7f5e7810aae0 2024-08-25T23:53:18.427 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.023+0000 7f5e7ea00640 1 -- 172.21.15.42:0/2770008412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7810aae0 msgr2=0x7f5e7810aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:18.427 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.023+0000 7f5e7ea00640 1 --2- 172.21.15.42:0/2770008412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7810aae0 0x7f5e7810aee0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009820 tx=0x7f5e6802a270 comp rx=0 tx=0).stop 2024-08-25T23:53:18.427 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.023+0000 7f5e7ea00640 1 -- 172.21.15.42:0/2770008412 shutdown_connections 2024-08-25T23:53:18.427 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.023+0000 7f5e7ea00640 1 --2- 172.21.15.42:0/2770008412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7810aae0 0x7f5e7810aee0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:18.427 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.023+0000 7f5e7ea00640 1 -- 172.21.15.42:0/2770008412 >> 172.21.15.42:0/2770008412 conn(0x7f5e7807cc90 msgr2=0x7f5e7807d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:18.427 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.023+0000 7f5e7ea00640 1 -- 172.21.15.42:0/2770008412 shutdown_connections 2024-08-25T23:53:18.428 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.023+0000 7f5e7ea00640 1 -- 172.21.15.42:0/2770008412 wait complete. 2024-08-25T23:53:18.428 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.024+0000 7f5e7ea00640 1 Processor -- start 2024-08-25T23:53:18.428 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.024+0000 7f5e7ea00640 1 -- start start 2024-08-25T23:53:18.428 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.025+0000 7f5e7ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7810aae0 0x7f5e7819d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:18.428 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.025+0000 7f5e7ea00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7810db40 con 0x7f5e7810aae0 2024-08-25T23:53:18.428 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.025+0000 7f5e77e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7810aae0 0x7f5e7819d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:18.428 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.025+0000 7f5e77e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7810aae0 0x7f5e7819d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58266/0 (socket says 172.21.15.42:58266) 2024-08-25T23:53:18.428 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.025+0000 7f5e77e00640 1 -- 172.21.15.42:0/2359183474 learned_addr learned my addr 172.21.15.42:0/2359183474 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:18.428 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.025+0000 7f5e77e00640 1 -- 172.21.15.42:0/2359183474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e7819de80 con 0x7f5e7810aae0 2024-08-25T23:53:18.428 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.025+0000 7f5e77e00640 1 --2- 172.21.15.42:0/2359183474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7810aae0 0x7f5e7819d940 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5e680097f0 tx=0x7f5e68030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:18.428 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.026+0000 7f5e74c00640 1 -- 172.21.15.42:0/2359183474 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e68037040 con 0x7f5e7810aae0 2024-08-25T23:53:18.428 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.026+0000 7f5e74c00640 1 -- 172.21.15.42:0/2359183474 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5e68040070 con 0x7f5e7810aae0 2024-08-25T23:53:18.428 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.026+0000 7f5e74c00640 1 -- 172.21.15.42:0/2359183474 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e6803a390 con 0x7f5e7810aae0 2024-08-25T23:53:18.428 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.026+0000 7f5e7ea00640 1 -- 172.21.15.42:0/2359183474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e7819e110 con 0x7f5e7810aae0 2024-08-25T23:53:18.429 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.026+0000 7f5e7ea00640 1 -- 172.21.15.42:0/2359183474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e781a0e00 con 0x7f5e7810aae0 2024-08-25T23:53:18.429 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.027+0000 7f5e74c00640 1 -- 172.21.15.42:0/2359183474 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f5e6803b430 con 0x7f5e7810aae0 2024-08-25T23:53:18.429 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.027+0000 7f5e7ea00640 1 -- 172.21.15.42:0/2359183474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e7810dcc0 con 0x7f5e7810aae0 2024-08-25T23:53:18.429 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.027+0000 7f5e74c00640 1 --2- 172.21.15.42:0/2359183474 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f5e5c038fc0 0x7f5e5c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:18.429 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.027+0000 7f5e74c00640 1 -- 172.21.15.42:0/2359183474 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5e6806c500 con 0x7f5e7810aae0 2024-08-25T23:53:18.429 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.028+0000 7f5e77400640 1 --2- 172.21.15.42:0/2359183474 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f5e5c038fc0 0x7f5e5c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:18.429 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.028+0000 7f5e77400640 1 --2- 172.21.15.42:0/2359183474 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f5e5c038fc0 0x7f5e5c03b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5e640098c0 tx=0x7f5e64006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:18.429 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.032+0000 7f5e74c00640 1 -- 172.21.15.42:0/2359183474 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5e680371e0 con 0x7f5e7810aae0 2024-08-25T23:53:18.429 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:13.227+0000 7f5e7ea00640 1 -- 172.21.15.42:0/2359183474 --> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi042", "addr": "172.21.15.42", "target": ["mon-mgr", ""]}) -- 0x7f5e7802d710 con 0x7f5e5c038fc0 2024-08-25T23:53:18.429 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:17.759+0000 7f5e74c00640 1 -- 172.21.15.42:0/2359183474 <== mgr.14118 v2:172.21.15.42:6800/723045064 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f5e7802d710 con 0x7f5e5c038fc0 2024-08-25T23:53:18.429 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:17.762+0000 7f5e7ea00640 1 -- 172.21.15.42:0/2359183474 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f5e5c038fc0 msgr2=0x7f5e5c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:18.429 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:17.762+0000 7f5e7ea00640 1 --2- 172.21.15.42:0/2359183474 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f5e5c038fc0 0x7f5e5c03b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5e640098c0 tx=0x7f5e64006db0 comp rx=0 tx=0).stop 2024-08-25T23:53:18.430 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:17.762+0000 7f5e7ea00640 1 -- 172.21.15.42:0/2359183474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7810aae0 msgr2=0x7f5e7819d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:18.430 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:17.762+0000 7f5e7ea00640 1 --2- 172.21.15.42:0/2359183474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7810aae0 0x7f5e7819d940 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5e680097f0 tx=0x7f5e68030d80 comp rx=0 tx=0).stop 2024-08-25T23:53:18.430 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:17.762+0000 7f5e7ea00640 1 -- 172.21.15.42:0/2359183474 shutdown_connections 2024-08-25T23:53:18.430 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:17.762+0000 7f5e7ea00640 1 --2- 172.21.15.42:0/2359183474 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f5e5c038fc0 0x7f5e5c03b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:18.430 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:17.762+0000 7f5e7ea00640 1 --2- 172.21.15.42:0/2359183474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7810aae0 0x7f5e7819d940 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:18.430 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:17.762+0000 7f5e7ea00640 1 -- 172.21.15.42:0/2359183474 >> 172.21.15.42:0/2359183474 conn(0x7f5e7807cc90 msgr2=0x7f5e78107730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:18.430 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:17.763+0000 7f5e7ea00640 1 -- 172.21.15.42:0/2359183474 shutdown_connections 2024-08-25T23:53:18.430 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:17.763+0000 7f5e7ea00640 1 -- 172.21.15.42:0/2359183474 wait complete. 2024-08-25T23:53:18.430 INFO:teuthology.orchestra.run.smithi042.stdout:Deploying unmanaged mon service... 2024-08-25T23:53:18.967 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:18 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' 2024-08-25T23:53:18.967 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:18 smithi042 ceph-mon[17225]: Added host smithi042 2024-08-25T23:53:18.967 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:18 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:53:19.842 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-08-25T23:53:19.843 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.965+0000 7f1e4dc00640 1 Processor -- start 2024-08-25T23:53:19.843 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.965+0000 7f1e4dc00640 1 -- start start 2024-08-25T23:53:19.843 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.966+0000 7f1e4dc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4810aae0 0x7f1e4810aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:19.843 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.966+0000 7f1e4dc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4810b4b0 con 0x7f1e4810aae0 2024-08-25T23:53:19.843 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.966+0000 7f1e46a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4810aae0 0x7f1e4810aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:19.843 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.966+0000 7f1e46a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4810aae0 0x7f1e4810aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36162/0 (socket says 172.21.15.42:36162) 2024-08-25T23:53:19.843 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.966+0000 7f1e46a00640 1 -- 172.21.15.42:0/2265073364 learned_addr learned my addr 172.21.15.42:0/2265073364 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:19.843 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.966+0000 7f1e46a00640 1 -- 172.21.15.42:0/2265073364 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4810b630 con 0x7f1e4810aae0 2024-08-25T23:53:19.843 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.968+0000 7f1e46a00640 1 --2- 172.21.15.42:0/2265073364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4810aae0 0x7f1e4810aee0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009820 tx=0x7f1e3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b22277a52147cfd server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:19.843 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.968+0000 7f1e46000640 1 -- 172.21.15.42:0/2265073364 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e38037070 con 0x7f1e4810aae0 2024-08-25T23:53:19.843 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.968+0000 7f1e46000640 1 -- 172.21.15.42:0/2265073364 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1e38032900 con 0x7f1e4810aae0 2024-08-25T23:53:19.843 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.968+0000 7f1e46000640 1 -- 172.21.15.42:0/2265073364 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e38030850 con 0x7f1e4810aae0 2024-08-25T23:53:19.844 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.969+0000 7f1e4dc00640 1 -- 172.21.15.42:0/2265073364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4810aae0 msgr2=0x7f1e4810aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:19.844 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.969+0000 7f1e4dc00640 1 --2- 172.21.15.42:0/2265073364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4810aae0 0x7f1e4810aee0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009820 tx=0x7f1e3802a270 comp rx=0 tx=0).stop 2024-08-25T23:53:19.844 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.969+0000 7f1e4dc00640 1 -- 172.21.15.42:0/2265073364 shutdown_connections 2024-08-25T23:53:19.844 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.969+0000 7f1e4dc00640 1 --2- 172.21.15.42:0/2265073364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4810aae0 0x7f1e4810aee0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:19.844 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.969+0000 7f1e4dc00640 1 -- 172.21.15.42:0/2265073364 >> 172.21.15.42:0/2265073364 conn(0x7f1e4807cc90 msgr2=0x7f1e4807d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:19.844 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.969+0000 7f1e4dc00640 1 -- 172.21.15.42:0/2265073364 shutdown_connections 2024-08-25T23:53:19.844 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.969+0000 7f1e4dc00640 1 -- 172.21.15.42:0/2265073364 wait complete. 2024-08-25T23:53:19.844 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.970+0000 7f1e4dc00640 1 Processor -- start 2024-08-25T23:53:19.844 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.970+0000 7f1e4dc00640 1 -- start start 2024-08-25T23:53:19.844 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.970+0000 7f1e4dc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4810aae0 0x7f1e4819d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:19.844 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.970+0000 7f1e4dc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4810db40 con 0x7f1e4810aae0 2024-08-25T23:53:19.844 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.970+0000 7f1e46a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4810aae0 0x7f1e4819d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:19.844 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.970+0000 7f1e46a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4810aae0 0x7f1e4819d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36170/0 (socket says 172.21.15.42:36170) 2024-08-25T23:53:19.844 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.970+0000 7f1e46a00640 1 -- 172.21.15.42:0/3054007942 learned_addr learned my addr 172.21.15.42:0/3054007942 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:19.845 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.971+0000 7f1e46a00640 1 -- 172.21.15.42:0/3054007942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4819de80 con 0x7f1e4810aae0 2024-08-25T23:53:19.845 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.971+0000 7f1e46a00640 1 --2- 172.21.15.42:0/3054007942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4810aae0 0x7f1e4819d940 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1e380097f0 tx=0x7f1e38030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:19.845 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.971+0000 7f1e3f400640 1 -- 172.21.15.42:0/3054007942 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e38037040 con 0x7f1e4810aae0 2024-08-25T23:53:19.845 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.971+0000 7f1e3f400640 1 -- 172.21.15.42:0/3054007942 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1e38040070 con 0x7f1e4810aae0 2024-08-25T23:53:19.845 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.971+0000 7f1e3f400640 1 -- 172.21.15.42:0/3054007942 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e3803a390 con 0x7f1e4810aae0 2024-08-25T23:53:19.845 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.971+0000 7f1e4dc00640 1 -- 172.21.15.42:0/3054007942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4819e110 con 0x7f1e4810aae0 2024-08-25T23:53:19.845 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.972+0000 7f1e4dc00640 1 -- 172.21.15.42:0/3054007942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e481a0e00 con 0x7f1e4810aae0 2024-08-25T23:53:19.845 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.973+0000 7f1e4dc00640 1 -- 172.21.15.42:0/3054007942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e4810af60 con 0x7f1e4810aae0 2024-08-25T23:53:19.845 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.973+0000 7f1e3f400640 1 -- 172.21.15.42:0/3054007942 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f1e3803b430 con 0x7f1e4810aae0 2024-08-25T23:53:19.845 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.973+0000 7f1e3f400640 1 --2- 172.21.15.42:0/3054007942 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f1e2c038fc0 0x7f1e2c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:19.845 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.973+0000 7f1e3f400640 1 -- 172.21.15.42:0/3054007942 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1e3806c510 con 0x7f1e4810aae0 2024-08-25T23:53:19.845 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.974+0000 7f1e3fe00640 1 --2- 172.21.15.42:0/3054007942 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f1e2c038fc0 0x7f1e2c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:19.845 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.974+0000 7f1e3fe00640 1 --2- 172.21.15.42:0/3054007942 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f1e2c038fc0 0x7f1e2c03b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1e300098c0 tx=0x7f1e30006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:19.845 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:18.978+0000 7f1e3f400640 1 -- 172.21.15.42:0/3054007942 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f1e3806be60 con 0x7f1e4810aae0 2024-08-25T23:53:19.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:19.179+0000 7f1e4dc00640 1 -- 172.21.15.42:0/3054007942 --> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f1e4802d710 con 0x7f1e2c038fc0 2024-08-25T23:53:19.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:19.185+0000 7f1e3f400640 1 -- 172.21.15.42:0/3054007942 <== mgr.14118 v2:172.21.15.42:6800/723045064 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1e4802d710 con 0x7f1e2c038fc0 2024-08-25T23:53:19.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:19.187+0000 7f1e4dc00640 1 -- 172.21.15.42:0/3054007942 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f1e2c038fc0 msgr2=0x7f1e2c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:19.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:19.187+0000 7f1e4dc00640 1 --2- 172.21.15.42:0/3054007942 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f1e2c038fc0 0x7f1e2c03b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1e300098c0 tx=0x7f1e30006db0 comp rx=0 tx=0).stop 2024-08-25T23:53:19.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:19.187+0000 7f1e4dc00640 1 -- 172.21.15.42:0/3054007942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4810aae0 msgr2=0x7f1e4819d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:19.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:19.187+0000 7f1e4dc00640 1 --2- 172.21.15.42:0/3054007942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4810aae0 0x7f1e4819d940 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1e380097f0 tx=0x7f1e38030d80 comp rx=0 tx=0).stop 2024-08-25T23:53:19.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:19.187+0000 7f1e4dc00640 1 -- 172.21.15.42:0/3054007942 shutdown_connections 2024-08-25T23:53:19.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:19.187+0000 7f1e4dc00640 1 --2- 172.21.15.42:0/3054007942 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f1e2c038fc0 0x7f1e2c03b480 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:19.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:19.187+0000 7f1e4dc00640 1 --2- 172.21.15.42:0/3054007942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e4810aae0 0x7f1e4819d940 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:19.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:19.187+0000 7f1e4dc00640 1 -- 172.21.15.42:0/3054007942 >> 172.21.15.42:0/3054007942 conn(0x7f1e4807cc90 msgr2=0x7f1e48107730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:19.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:19.187+0000 7f1e4dc00640 1 -- 172.21.15.42:0/3054007942 shutdown_connections 2024-08-25T23:53:19.846 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:19.187+0000 7f1e4dc00640 1 -- 172.21.15.42:0/3054007942 wait complete. 2024-08-25T23:53:19.846 INFO:teuthology.orchestra.run.smithi042.stdout:Deploying unmanaged mgr service... 2024-08-25T23:53:20.333 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:20 smithi042 ceph-mon[17225]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:53:20.333 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:20 smithi042 ceph-mon[17225]: Saving service mon spec with placement count:5 2024-08-25T23:53:20.333 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:20 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' 2024-08-25T23:53:21.477 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-08-25T23:53:21.477 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.498+0000 7f45ff200640 1 Processor -- start 2024-08-25T23:53:21.477 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.499+0000 7f45ff200640 1 -- start start 2024-08-25T23:53:21.477 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.499+0000 7f45ff200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f810aae0 0x7f45f810aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:21.477 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.499+0000 7f45ff200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f45f810b4b0 con 0x7f45f810aae0 2024-08-25T23:53:21.477 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.499+0000 7f45f7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f810aae0 0x7f45f810aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:21.477 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.499+0000 7f45f7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f810aae0 0x7f45f810aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36182/0 (socket says 172.21.15.42:36182) 2024-08-25T23:53:21.478 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.499+0000 7f45f7e00640 1 -- 172.21.15.42:0/2496472106 learned_addr learned my addr 172.21.15.42:0/2496472106 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:21.478 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.500+0000 7f45f7e00640 1 -- 172.21.15.42:0/2496472106 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f810b630 con 0x7f45f810aae0 2024-08-25T23:53:21.478 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.501+0000 7f45f7e00640 1 --2- 172.21.15.42:0/2496472106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f810aae0 0x7f45f810aee0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f45e8009820 tx=0x7f45e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c7beb9da58b0d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:21.478 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.501+0000 7f45f6a00640 1 -- 172.21.15.42:0/2496472106 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e8037070 con 0x7f45f810aae0 2024-08-25T23:53:21.478 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.501+0000 7f45f6a00640 1 -- 172.21.15.42:0/2496472106 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f45e8032900 con 0x7f45f810aae0 2024-08-25T23:53:21.478 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.501+0000 7f45f6a00640 1 -- 172.21.15.42:0/2496472106 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e8030850 con 0x7f45f810aae0 2024-08-25T23:53:21.478 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.502+0000 7f45ff200640 1 -- 172.21.15.42:0/2496472106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f810aae0 msgr2=0x7f45f810aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:21.478 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.502+0000 7f45ff200640 1 --2- 172.21.15.42:0/2496472106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f810aae0 0x7f45f810aee0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f45e8009820 tx=0x7f45e802a270 comp rx=0 tx=0).stop 2024-08-25T23:53:21.478 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.502+0000 7f45ff200640 1 -- 172.21.15.42:0/2496472106 shutdown_connections 2024-08-25T23:53:21.478 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.502+0000 7f45ff200640 1 --2- 172.21.15.42:0/2496472106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f810aae0 0x7f45f810aee0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:21.478 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.502+0000 7f45ff200640 1 -- 172.21.15.42:0/2496472106 >> 172.21.15.42:0/2496472106 conn(0x7f45f807cc90 msgr2=0x7f45f807d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:21.478 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.502+0000 7f45ff200640 1 -- 172.21.15.42:0/2496472106 shutdown_connections 2024-08-25T23:53:21.479 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.502+0000 7f45ff200640 1 -- 172.21.15.42:0/2496472106 wait complete. 2024-08-25T23:53:21.479 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.503+0000 7f45ff200640 1 Processor -- start 2024-08-25T23:53:21.479 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.503+0000 7f45ff200640 1 -- start start 2024-08-25T23:53:21.479 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.503+0000 7f45ff200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f810aae0 0x7f45f819d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:21.479 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.503+0000 7f45ff200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f45f810db40 con 0x7f45f810aae0 2024-08-25T23:53:21.479 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.504+0000 7f45f7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f810aae0 0x7f45f819d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:21.479 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.504+0000 7f45f7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f810aae0 0x7f45f819d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36192/0 (socket says 172.21.15.42:36192) 2024-08-25T23:53:21.479 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.504+0000 7f45f7e00640 1 -- 172.21.15.42:0/989537759 learned_addr learned my addr 172.21.15.42:0/989537759 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:21.479 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.504+0000 7f45f7e00640 1 -- 172.21.15.42:0/989537759 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f819dea0 con 0x7f45f810aae0 2024-08-25T23:53:21.479 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.504+0000 7f45f7e00640 1 --2- 172.21.15.42:0/989537759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f810aae0 0x7f45f819d960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f45e80097f0 tx=0x7f45e8030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:21.479 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.505+0000 7f45f4c00640 1 -- 172.21.15.42:0/989537759 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e8037040 con 0x7f45f810aae0 2024-08-25T23:53:21.479 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.505+0000 7f45f4c00640 1 -- 172.21.15.42:0/989537759 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f45e8040070 con 0x7f45f810aae0 2024-08-25T23:53:21.479 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.505+0000 7f45ff200640 1 -- 172.21.15.42:0/989537759 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f819e130 con 0x7f45f810aae0 2024-08-25T23:53:21.480 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.505+0000 7f45f4c00640 1 -- 172.21.15.42:0/989537759 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e803a390 con 0x7f45f810aae0 2024-08-25T23:53:21.480 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.505+0000 7f45ff200640 1 -- 172.21.15.42:0/989537759 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f81a0e20 con 0x7f45f810aae0 2024-08-25T23:53:21.480 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.506+0000 7f45ff200640 1 -- 172.21.15.42:0/989537759 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f810af60 con 0x7f45f810aae0 2024-08-25T23:53:21.480 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.506+0000 7f45f4c00640 1 -- 172.21.15.42:0/989537759 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f45e803a630 con 0x7f45f810aae0 2024-08-25T23:53:21.480 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.507+0000 7f45f4c00640 1 --2- 172.21.15.42:0/989537759 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f45dc038f70 0x7f45dc03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:21.480 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.507+0000 7f45f4c00640 1 -- 172.21.15.42:0/989537759 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f45e806c6b0 con 0x7f45f810aae0 2024-08-25T23:53:21.480 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.507+0000 7f45f7400640 1 --2- 172.21.15.42:0/989537759 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f45dc038f70 0x7f45dc03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:21.480 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.508+0000 7f45f7400640 1 --2- 172.21.15.42:0/989537759 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f45dc038f70 0x7f45dc03b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f45e40098c0 tx=0x7f45e4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:21.480 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.512+0000 7f45f4c00640 1 -- 172.21.15.42:0/989537759 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f45e806c000 con 0x7f45f810aae0 2024-08-25T23:53:21.480 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.713+0000 7f45ff200640 1 -- 172.21.15.42:0/989537759 --> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f45f802d710 con 0x7f45dc038f70 2024-08-25T23:53:21.480 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.718+0000 7f45f4c00640 1 -- 172.21.15.42:0/989537759 <== mgr.14118 v2:172.21.15.42:6800/723045064 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f45f802d710 con 0x7f45dc038f70 2024-08-25T23:53:21.480 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.721+0000 7f45ff200640 1 -- 172.21.15.42:0/989537759 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f45dc038f70 msgr2=0x7f45dc03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:21.480 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.721+0000 7f45ff200640 1 --2- 172.21.15.42:0/989537759 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f45dc038f70 0x7f45dc03b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f45e40098c0 tx=0x7f45e4006db0 comp rx=0 tx=0).stop 2024-08-25T23:53:21.480 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.721+0000 7f45ff200640 1 -- 172.21.15.42:0/989537759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f810aae0 msgr2=0x7f45f819d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:21.481 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.721+0000 7f45ff200640 1 --2- 172.21.15.42:0/989537759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f810aae0 0x7f45f819d960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f45e80097f0 tx=0x7f45e8030d80 comp rx=0 tx=0).stop 2024-08-25T23:53:21.481 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.721+0000 7f45ff200640 1 -- 172.21.15.42:0/989537759 shutdown_connections 2024-08-25T23:53:21.481 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.721+0000 7f45ff200640 1 --2- 172.21.15.42:0/989537759 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f45dc038f70 0x7f45dc03b430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:21.481 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.721+0000 7f45ff200640 1 --2- 172.21.15.42:0/989537759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45f810aae0 0x7f45f819d960 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:21.481 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.721+0000 7f45ff200640 1 -- 172.21.15.42:0/989537759 >> 172.21.15.42:0/989537759 conn(0x7f45f807cc90 msgr2=0x7f45f8107730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:21.481 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.722+0000 7f45ff200640 1 -- 172.21.15.42:0/989537759 shutdown_connections 2024-08-25T23:53:21.481 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:20.722+0000 7f45ff200640 1 -- 172.21.15.42:0/989537759 wait complete. 2024-08-25T23:53:22.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:21 smithi042 ceph-mon[17225]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:53:22.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:21 smithi042 ceph-mon[17225]: Saving service mgr spec with placement count:2 2024-08-25T23:53:22.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:21 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' 2024-08-25T23:53:23.235 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:22 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' 2024-08-25T23:53:23.235 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:22 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' 2024-08-25T23:53:23.236 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:22 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2720272528' entity='client.admin' 2024-08-25T23:53:23.245 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.444+0000 7fbe27c00640 1 Processor -- start 2024-08-25T23:53:23.245 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.444+0000 7fbe27c00640 1 -- start start 2024-08-25T23:53:23.245 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.445+0000 7fbe27c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe201074f0 0x7fbe201078f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:23.245 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.445+0000 7fbe27c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbe20107ec0 con 0x7fbe201074f0 2024-08-25T23:53:23.245 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.445+0000 7fbe25200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe201074f0 0x7fbe201078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:23.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.445+0000 7fbe25200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe201074f0 0x7fbe201078f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36198/0 (socket says 172.21.15.42:36198) 2024-08-25T23:53:23.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.445+0000 7fbe25200640 1 -- 172.21.15.42:0/3316451479 learned_addr learned my addr 172.21.15.42:0/3316451479 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:23.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.446+0000 7fbe25200640 1 -- 172.21.15.42:0/3316451479 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe201086a0 con 0x7fbe201074f0 2024-08-25T23:53:23.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.447+0000 7fbe25200640 1 --2- 172.21.15.42:0/3316451479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe201074f0 0x7fbe201078f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009820 tx=0x7fbe1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929ade3b207ecffa server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:23.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.447+0000 7fbe1f400640 1 -- 172.21.15.42:0/3316451479 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe14037070 con 0x7fbe201074f0 2024-08-25T23:53:23.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.447+0000 7fbe1f400640 1 -- 172.21.15.42:0/3316451479 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe14032920 con 0x7fbe201074f0 2024-08-25T23:53:23.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.447+0000 7fbe1f400640 1 -- 172.21.15.42:0/3316451479 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe14030810 con 0x7fbe201074f0 2024-08-25T23:53:23.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.448+0000 7fbe27c00640 1 -- 172.21.15.42:0/3316451479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe201074f0 msgr2=0x7fbe201078f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:23.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.448+0000 7fbe27c00640 1 --2- 172.21.15.42:0/3316451479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe201074f0 0x7fbe201078f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009820 tx=0x7fbe1402a270 comp rx=0 tx=0).stop 2024-08-25T23:53:23.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.448+0000 7fbe27c00640 1 -- 172.21.15.42:0/3316451479 shutdown_connections 2024-08-25T23:53:23.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.448+0000 7fbe27c00640 1 --2- 172.21.15.42:0/3316451479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe201074f0 0x7fbe201078f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:23.246 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.448+0000 7fbe27c00640 1 -- 172.21.15.42:0/3316451479 >> 172.21.15.42:0/3316451479 conn(0x7fbe20102c80 msgr2=0x7fbe201050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:23.247 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.448+0000 7fbe27c00640 1 -- 172.21.15.42:0/3316451479 shutdown_connections 2024-08-25T23:53:23.247 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.448+0000 7fbe27c00640 1 -- 172.21.15.42:0/3316451479 wait complete. 2024-08-25T23:53:23.247 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.449+0000 7fbe27c00640 1 Processor -- start 2024-08-25T23:53:23.247 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.449+0000 7fbe27c00640 1 -- start start 2024-08-25T23:53:23.247 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.450+0000 7fbe27c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe201074f0 0x7fbe2019d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:23.247 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.450+0000 7fbe27c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2010ba50 con 0x7fbe201074f0 2024-08-25T23:53:23.247 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.450+0000 7fbe25200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe201074f0 0x7fbe2019d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:23.247 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.450+0000 7fbe25200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe201074f0 0x7fbe2019d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36208/0 (socket says 172.21.15.42:36208) 2024-08-25T23:53:23.247 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.450+0000 7fbe25200640 1 -- 172.21.15.42:0/2720272528 learned_addr learned my addr 172.21.15.42:0/2720272528 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:23.247 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.450+0000 7fbe25200640 1 -- 172.21.15.42:0/2720272528 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2019ded0 con 0x7fbe201074f0 2024-08-25T23:53:23.247 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.451+0000 7fbe25200640 1 --2- 172.21.15.42:0/2720272528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe201074f0 0x7fbe2019d990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbe14030560 tx=0x7fbe14032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:23.248 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.451+0000 7fbe1d600640 1 -- 172.21.15.42:0/2720272528 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe14037040 con 0x7fbe201074f0 2024-08-25T23:53:23.248 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.451+0000 7fbe1d600640 1 -- 172.21.15.42:0/2720272528 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe14040070 con 0x7fbe201074f0 2024-08-25T23:53:23.248 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.451+0000 7fbe27c00640 1 -- 172.21.15.42:0/2720272528 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe2019e160 con 0x7fbe201074f0 2024-08-25T23:53:23.248 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.451+0000 7fbe27c00640 1 -- 172.21.15.42:0/2720272528 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe201a0e50 con 0x7fbe201074f0 2024-08-25T23:53:23.248 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.451+0000 7fbe1d600640 1 -- 172.21.15.42:0/2720272528 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe1403a740 con 0x7fbe201074f0 2024-08-25T23:53:23.248 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.452+0000 7fbe27c00640 1 -- 172.21.15.42:0/2720272528 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe00005290 con 0x7fbe201074f0 2024-08-25T23:53:23.248 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.453+0000 7fbe1d600640 1 -- 172.21.15.42:0/2720272528 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fbe1403bb90 con 0x7fbe201074f0 2024-08-25T23:53:23.248 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.454+0000 7fbe1d600640 1 --2- 172.21.15.42:0/2720272528 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7fbe08038fc0 0x7fbe0803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:23.248 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.454+0000 7fbe1d600640 1 -- 172.21.15.42:0/2720272528 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbe1406cbc0 con 0x7fbe201074f0 2024-08-25T23:53:23.248 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.454+0000 7fbe1fe00640 1 --2- 172.21.15.42:0/2720272528 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7fbe08038fc0 0x7fbe0803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:23.249 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.455+0000 7fbe1fe00640 1 --2- 172.21.15.42:0/2720272528 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7fbe08038fc0 0x7fbe0803b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0098c0 tx=0x7fbe0c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:23.249 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.460+0000 7fbe1d600640 1 -- 172.21.15.42:0/2720272528 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fbe1403b4d0 con 0x7fbe201074f0 2024-08-25T23:53:23.249 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.647+0000 7fbe27c00640 1 -- 172.21.15.42:0/2720272528 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fbe00005580 con 0x7fbe201074f0 2024-08-25T23:53:23.249 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.650+0000 7fbe1d600640 1 -- 172.21.15.42:0/2720272528 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fbe14031e50 con 0x7fbe201074f0 2024-08-25T23:53:23.249 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.653+0000 7fbe27c00640 1 -- 172.21.15.42:0/2720272528 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7fbe08038fc0 msgr2=0x7fbe0803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:23.249 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.653+0000 7fbe27c00640 1 --2- 172.21.15.42:0/2720272528 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7fbe08038fc0 0x7fbe0803b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0098c0 tx=0x7fbe0c006db0 comp rx=0 tx=0).stop 2024-08-25T23:53:23.249 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.653+0000 7fbe27c00640 1 -- 172.21.15.42:0/2720272528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe201074f0 msgr2=0x7fbe2019d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:23.249 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.653+0000 7fbe27c00640 1 --2- 172.21.15.42:0/2720272528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe201074f0 0x7fbe2019d990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbe14030560 tx=0x7fbe14032670 comp rx=0 tx=0).stop 2024-08-25T23:53:23.249 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.653+0000 7fbe27c00640 1 -- 172.21.15.42:0/2720272528 shutdown_connections 2024-08-25T23:53:23.249 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.653+0000 7fbe27c00640 1 --2- 172.21.15.42:0/2720272528 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7fbe08038fc0 0x7fbe0803b480 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:23.249 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.653+0000 7fbe27c00640 1 --2- 172.21.15.42:0/2720272528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe201074f0 0x7fbe2019d990 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:23.249 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.653+0000 7fbe27c00640 1 -- 172.21.15.42:0/2720272528 >> 172.21.15.42:0/2720272528 conn(0x7fbe20102c80 msgr2=0x7fbe20103970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:23.249 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.654+0000 7fbe27c00640 1 -- 172.21.15.42:0/2720272528 shutdown_connections 2024-08-25T23:53:23.249 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:22.654+0000 7fbe27c00640 1 -- 172.21.15.42:0/2720272528 wait complete. 2024-08-25T23:53:25.072 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.725+0000 7f381c400640 1 Processor -- start 2024-08-25T23:53:25.072 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.725+0000 7f381c400640 1 -- start start 2024-08-25T23:53:25.072 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.725+0000 7f381c400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38141074a0 0x7f38141078a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:25.072 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.725+0000 7f381c400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3814107e70 con 0x7f38141074a0 2024-08-25T23:53:25.073 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.726+0000 7f3819a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38141074a0 0x7f38141078a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:25.073 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.726+0000 7f3819a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38141074a0 0x7f38141078a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36216/0 (socket says 172.21.15.42:36216) 2024-08-25T23:53:25.073 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.726+0000 7f3819a00640 1 -- 172.21.15.42:0/1939257433 learned_addr learned my addr 172.21.15.42:0/1939257433 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:25.073 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.726+0000 7f3819a00640 1 -- 172.21.15.42:0/1939257433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38141086a0 con 0x7f38141074a0 2024-08-25T23:53:25.073 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.727+0000 7f3819a00640 1 --2- 172.21.15.42:0/1939257433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38141074a0 0x7f38141078a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3808009820 tx=0x7f380802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74b4a3de2c4ada9 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:25.073 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.727+0000 7f3813e00640 1 -- 172.21.15.42:0/1939257433 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3808037070 con 0x7f38141074a0 2024-08-25T23:53:25.073 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.728+0000 7f3813e00640 1 -- 172.21.15.42:0/1939257433 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3808032920 con 0x7f38141074a0 2024-08-25T23:53:25.073 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.728+0000 7f3813e00640 1 -- 172.21.15.42:0/1939257433 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3808030810 con 0x7f38141074a0 2024-08-25T23:53:25.073 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.728+0000 7f381c400640 1 -- 172.21.15.42:0/1939257433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38141074a0 msgr2=0x7f38141078a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:25.074 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.728+0000 7f381c400640 1 --2- 172.21.15.42:0/1939257433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38141074a0 0x7f38141078a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3808009820 tx=0x7f380802a270 comp rx=0 tx=0).stop 2024-08-25T23:53:25.074 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.728+0000 7f381c400640 1 -- 172.21.15.42:0/1939257433 shutdown_connections 2024-08-25T23:53:25.074 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.728+0000 7f381c400640 1 --2- 172.21.15.42:0/1939257433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38141074a0 0x7f38141078a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:25.074 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.728+0000 7f381c400640 1 -- 172.21.15.42:0/1939257433 >> 172.21.15.42:0/1939257433 conn(0x7f3814102c30 msgr2=0x7f3814105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:25.074 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.728+0000 7f381c400640 1 -- 172.21.15.42:0/1939257433 shutdown_connections 2024-08-25T23:53:25.074 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.729+0000 7f381c400640 1 -- 172.21.15.42:0/1939257433 wait complete. 2024-08-25T23:53:25.074 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.730+0000 7f381c400640 1 Processor -- start 2024-08-25T23:53:25.074 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.730+0000 7f381c400640 1 -- start start 2024-08-25T23:53:25.074 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.730+0000 7f381c400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38141074a0 0x7f381419d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:25.074 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.730+0000 7f381c400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f381410ba50 con 0x7f38141074a0 2024-08-25T23:53:25.074 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.730+0000 7f3819a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38141074a0 0x7f381419d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:25.075 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.730+0000 7f3819a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38141074a0 0x7f381419d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36226/0 (socket says 172.21.15.42:36226) 2024-08-25T23:53:25.075 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.730+0000 7f3819a00640 1 -- 172.21.15.42:0/1413492797 learned_addr learned my addr 172.21.15.42:0/1413492797 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:25.075 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.731+0000 7f3819a00640 1 -- 172.21.15.42:0/1413492797 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f381419dec0 con 0x7f38141074a0 2024-08-25T23:53:25.075 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.731+0000 7f3819a00640 1 --2- 172.21.15.42:0/1413492797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38141074a0 0x7f381419d980 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3808030560 tx=0x7f3808032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:25.075 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.731+0000 7f3812000640 1 -- 172.21.15.42:0/1413492797 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3808037040 con 0x7f38141074a0 2024-08-25T23:53:25.075 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.731+0000 7f381c400640 1 -- 172.21.15.42:0/1413492797 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f381419e150 con 0x7f38141074a0 2024-08-25T23:53:25.075 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.731+0000 7f3812000640 1 -- 172.21.15.42:0/1413492797 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3808040070 con 0x7f38141074a0 2024-08-25T23:53:25.075 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.731+0000 7f3812000640 1 -- 172.21.15.42:0/1413492797 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f380803a740 con 0x7f38141074a0 2024-08-25T23:53:25.075 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.732+0000 7f381c400640 1 -- 172.21.15.42:0/1413492797 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38141a0e40 con 0x7f38141074a0 2024-08-25T23:53:25.075 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.733+0000 7f3812000640 1 -- 172.21.15.42:0/1413492797 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f380803a9b0 con 0x7f38141074a0 2024-08-25T23:53:25.075 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.733+0000 7f3807400640 1 -- 172.21.15.42:0/1413492797 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37f0005290 con 0x7f38141074a0 2024-08-25T23:53:25.076 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.733+0000 7f3812000640 1 --2- 172.21.15.42:0/1413492797 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f37fc038f70 0x7f37fc03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:25.076 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.733+0000 7f3812000640 1 -- 172.21.15.42:0/1413492797 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f380806c640 con 0x7f38141074a0 2024-08-25T23:53:25.076 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.733+0000 7f3819000640 1 --2- 172.21.15.42:0/1413492797 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f37fc038f70 0x7f37fc03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:25.076 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.734+0000 7f3819000640 1 --2- 172.21.15.42:0/1413492797 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f37fc038f70 0x7f37fc03b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f38000098c0 tx=0x7f3800006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:25.076 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.740+0000 7f3812000640 1 -- 172.21.15.42:0/1413492797 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f380806bf90 con 0x7f38141074a0 2024-08-25T23:53:25.076 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.927+0000 7f3807400640 1 -- 172.21.15.42:0/1413492797 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f37f0005580 con 0x7f38141074a0 2024-08-25T23:53:25.076 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.930+0000 7f3812000640 1 -- 172.21.15.42:0/1413492797 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f3808031560 con 0x7f38141074a0 2024-08-25T23:53:25.076 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.933+0000 7f3807400640 1 -- 172.21.15.42:0/1413492797 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f37fc038f70 msgr2=0x7f37fc03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:25.076 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.933+0000 7f3807400640 1 --2- 172.21.15.42:0/1413492797 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f37fc038f70 0x7f37fc03b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f38000098c0 tx=0x7f3800006db0 comp rx=0 tx=0).stop 2024-08-25T23:53:25.077 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.933+0000 7f3807400640 1 -- 172.21.15.42:0/1413492797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38141074a0 msgr2=0x7f381419d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:25.077 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.933+0000 7f3807400640 1 --2- 172.21.15.42:0/1413492797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38141074a0 0x7f381419d980 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3808030560 tx=0x7f3808032670 comp rx=0 tx=0).stop 2024-08-25T23:53:25.077 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.933+0000 7f3807400640 1 -- 172.21.15.42:0/1413492797 shutdown_connections 2024-08-25T23:53:25.077 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.933+0000 7f3807400640 1 --2- 172.21.15.42:0/1413492797 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f37fc038f70 0x7f37fc03b430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:25.077 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.933+0000 7f3807400640 1 --2- 172.21.15.42:0/1413492797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38141074a0 0x7f381419d980 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:25.077 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.933+0000 7f3807400640 1 -- 172.21.15.42:0/1413492797 >> 172.21.15.42:0/1413492797 conn(0x7f3814102c30 msgr2=0x7f38141038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:25.077 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.933+0000 7f3807400640 1 -- 172.21.15.42:0/1413492797 shutdown_connections 2024-08-25T23:53:25.077 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:23.933+0000 7f3807400640 1 -- 172.21.15.42:0/1413492797 wait complete. 2024-08-25T23:53:25.077 INFO:teuthology.orchestra.run.smithi042.stdout:Enabling the dashboard module... 2024-08-25T23:53:25.108 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:24 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1413492797' entity='client.admin' 2024-08-25T23:53:25.108 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:24 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' 2024-08-25T23:53:26.137 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:26 smithi042 ceph-mon[17225]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:53:26.137 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:26 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1364547607' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-08-25T23:53:26.137 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:26 smithi042 ceph-mon[17225]: from='mgr.14118 172.21.15.42:0/900822230' entity='mgr.x' 2024-08-25T23:53:26.533 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:26 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: ignoring --setuser ceph since I am not root 2024-08-25T23:53:26.533 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:26 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: ignoring --setgroup ceph since I am not root 2024-08-25T23:53:26.812 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.636+0000 7f0f75000640 1 Processor -- start 2024-08-25T23:53:26.812 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.636+0000 7f0f75000640 1 -- start start 2024-08-25T23:53:26.812 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.636+0000 7f0f75000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f701061c0 0x7f0f701065c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:26.812 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.636+0000 7f0f75000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0f70106b90 con 0x7f0f701061c0 2024-08-25T23:53:26.812 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.637+0000 7f0f6f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f701061c0 0x7f0f701065c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:26.812 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.637+0000 7f0f6f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f701061c0 0x7f0f701065c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54468/0 (socket says 172.21.15.42:54468) 2024-08-25T23:53:26.812 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.637+0000 7f0f6f400640 1 -- 172.21.15.42:0/1663456863 learned_addr learned my addr 172.21.15.42:0/1663456863 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:26.812 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.637+0000 7f0f6f400640 1 -- 172.21.15.42:0/1663456863 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f701073c0 con 0x7f0f701061c0 2024-08-25T23:53:26.812 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.638+0000 7f0f6f400640 1 --2- 172.21.15.42:0/1663456863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f701061c0 0x7f0f701065c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0f60009820 tx=0x7f0f6002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5bef1695ebddead server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:26.812 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.638+0000 7f0f6e000640 1 -- 172.21.15.42:0/1663456863 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f60037070 con 0x7f0f701061c0 2024-08-25T23:53:26.813 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.639+0000 7f0f6e000640 1 -- 172.21.15.42:0/1663456863 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f60032920 con 0x7f0f701061c0 2024-08-25T23:53:26.813 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.639+0000 7f0f6e000640 1 -- 172.21.15.42:0/1663456863 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f60030810 con 0x7f0f701061c0 2024-08-25T23:53:26.813 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.639+0000 7f0f75000640 1 -- 172.21.15.42:0/1663456863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f701061c0 msgr2=0x7f0f701065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:26.813 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.639+0000 7f0f75000640 1 --2- 172.21.15.42:0/1663456863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f701061c0 0x7f0f701065c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0f60009820 tx=0x7f0f6002a270 comp rx=0 tx=0).stop 2024-08-25T23:53:26.813 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.639+0000 7f0f75000640 1 -- 172.21.15.42:0/1663456863 shutdown_connections 2024-08-25T23:53:26.813 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.639+0000 7f0f75000640 1 --2- 172.21.15.42:0/1663456863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f701061c0 0x7f0f701065c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:26.813 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.639+0000 7f0f75000640 1 -- 172.21.15.42:0/1663456863 >> 172.21.15.42:0/1663456863 conn(0x7f0f701019d0 msgr2=0x7f0f70103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:26.813 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.639+0000 7f0f75000640 1 -- 172.21.15.42:0/1663456863 shutdown_connections 2024-08-25T23:53:26.813 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.640+0000 7f0f75000640 1 -- 172.21.15.42:0/1663456863 wait complete. 2024-08-25T23:53:26.813 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.640+0000 7f0f75000640 1 Processor -- start 2024-08-25T23:53:26.813 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.641+0000 7f0f75000640 1 -- start start 2024-08-25T23:53:26.813 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.641+0000 7f0f75000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f701061c0 0x7f0f7019d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:26.813 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.641+0000 7f0f75000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7010a770 con 0x7f0f701061c0 2024-08-25T23:53:26.814 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.641+0000 7f0f6f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f701061c0 0x7f0f7019d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:26.814 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.641+0000 7f0f6f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f701061c0 0x7f0f7019d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54478/0 (socket says 172.21.15.42:54478) 2024-08-25T23:53:26.814 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.641+0000 7f0f6f400640 1 -- 172.21.15.42:0/1364547607 learned_addr learned my addr 172.21.15.42:0/1364547607 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:26.814 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.642+0000 7f0f6f400640 1 -- 172.21.15.42:0/1364547607 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7019dd10 con 0x7f0f701061c0 2024-08-25T23:53:26.814 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.642+0000 7f0f6f400640 1 --2- 172.21.15.42:0/1364547607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f701061c0 0x7f0f7019d7d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0f60030560 tx=0x7f0f60032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:26.814 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.642+0000 7f0f67e00640 1 -- 172.21.15.42:0/1364547607 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f60037040 con 0x7f0f701061c0 2024-08-25T23:53:26.814 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.642+0000 7f0f75000640 1 -- 172.21.15.42:0/1364547607 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f7019dfa0 con 0x7f0f701061c0 2024-08-25T23:53:26.814 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.642+0000 7f0f67e00640 1 -- 172.21.15.42:0/1364547607 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f60040070 con 0x7f0f701061c0 2024-08-25T23:53:26.814 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.642+0000 7f0f75000640 1 -- 172.21.15.42:0/1364547607 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f701a0c90 con 0x7f0f701061c0 2024-08-25T23:53:26.814 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.642+0000 7f0f67e00640 1 -- 172.21.15.42:0/1364547607 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f6003a740 con 0x7f0f701061c0 2024-08-25T23:53:26.814 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.644+0000 7f0f65600640 1 -- 172.21.15.42:0/1364547607 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f70106640 con 0x7f0f701061c0 2024-08-25T23:53:26.814 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.644+0000 7f0f67e00640 1 -- 172.21.15.42:0/1364547607 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f0f6003b420 con 0x7f0f701061c0 2024-08-25T23:53:26.814 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.644+0000 7f0f67e00640 1 --2- 172.21.15.42:0/1364547607 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f0f54038fc0 0x7f0f5403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:26.815 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.644+0000 7f0f67e00640 1 -- 172.21.15.42:0/1364547607 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0f6006c630 con 0x7f0f701061c0 2024-08-25T23:53:26.815 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.645+0000 7f0f6ea00640 1 --2- 172.21.15.42:0/1364547607 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f0f54038fc0 0x7f0f5403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:26.815 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.645+0000 7f0f6ea00640 1 --2- 172.21.15.42:0/1364547607 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f0f54038fc0 0x7f0f5403b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0098c0 tx=0x7f0f5c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:26.815 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.650+0000 7f0f67e00640 1 -- 172.21.15.42:0/1364547607 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f0f60038280 con 0x7f0f701061c0 2024-08-25T23:53:26.815 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:25.883+0000 7f0f65600640 1 -- 172.21.15.42:0/1364547607 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f0f70074220 con 0x7f0f701061c0 2024-08-25T23:53:26.815 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:26.135+0000 7f0f67e00640 1 -- 172.21.15.42:0/1364547607 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f0f6006bf80 con 0x7f0f701061c0 2024-08-25T23:53:26.815 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:26.137+0000 7f0f67e00640 1 -- 172.21.15.42:0/1364547607 <== mon.0 v2:172.21.15.42:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f0f6003a8e0 con 0x7f0f701061c0 2024-08-25T23:53:26.815 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:26.138+0000 7f0f65600640 1 -- 172.21.15.42:0/1364547607 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f0f54038fc0 msgr2=0x7f0f5403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:26.815 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:26.138+0000 7f0f65600640 1 --2- 172.21.15.42:0/1364547607 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f0f54038fc0 0x7f0f5403b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0098c0 tx=0x7f0f5c006db0 comp rx=0 tx=0).stop 2024-08-25T23:53:26.815 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:26.138+0000 7f0f65600640 1 -- 172.21.15.42:0/1364547607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f701061c0 msgr2=0x7f0f7019d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:26.815 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:26.138+0000 7f0f65600640 1 --2- 172.21.15.42:0/1364547607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f701061c0 0x7f0f7019d7d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0f60030560 tx=0x7f0f60032670 comp rx=0 tx=0).stop 2024-08-25T23:53:26.815 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:26.139+0000 7f0f65600640 1 -- 172.21.15.42:0/1364547607 shutdown_connections 2024-08-25T23:53:26.816 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:26.139+0000 7f0f65600640 1 --2- 172.21.15.42:0/1364547607 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f0f54038fc0 0x7f0f5403b480 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:26.816 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:26.139+0000 7f0f65600640 1 --2- 172.21.15.42:0/1364547607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f701061c0 0x7f0f7019d7d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:26.816 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:26.139+0000 7f0f65600640 1 -- 172.21.15.42:0/1364547607 >> 172.21.15.42:0/1364547607 conn(0x7f0f701019d0 msgr2=0x7f0f701028f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:26.816 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:26.139+0000 7f0f65600640 1 -- 172.21.15.42:0/1364547607 shutdown_connections 2024-08-25T23:53:26.816 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:26.139+0000 7f0f65600640 1 -- 172.21.15.42:0/1364547607 wait complete. 2024-08-25T23:53:27.083 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:26 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:26.904+0000 7f142b026040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-25T23:53:27.343 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:27 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:27.084+0000 7f142b026040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-25T23:53:27.344 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:27 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1364547607' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-08-25T23:53:27.344 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:27 smithi042 ceph-mon[17225]: mgrmap e9: x(active, since 21s) 2024-08-25T23:53:27.617 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:27 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:27.343+0000 7f142b026040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-25T23:53:27.749 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:27 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:27.545+0000 7f142b026040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-25T23:53:27.975 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:27 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:27.725+0000 7f142b026040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-25T23:53:27.975 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:27 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:27.973+0000 7f142b026040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-25T23:53:28.238 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:28 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:28.129+0000 7f142b026040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-25T23:53:28.238 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:28 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:28.212+0000 7f142b026040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-25T23:53:28.238 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:28 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/3100166277' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-08-25T23:53:28.533 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:28 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:28.300+0000 7f142b026040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-25T23:53:28.533 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:28 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:28.476+0000 7f142b026040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-25T23:53:28.608 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-08-25T23:53:28.608 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-08-25T23:53:28.608 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-25T23:53:28.608 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-25T23:53:28.608 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-25T23:53:28.609 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-08-25T23:53:28.609 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.534+0000 7f1fa2600640 1 Processor -- start 2024-08-25T23:53:28.609 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.535+0000 7f1fa2600640 1 -- start start 2024-08-25T23:53:28.609 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.535+0000 7f1fa2600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f9c109550 0x7f1f9c109950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:28.609 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.535+0000 7f1fa2600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c109f20 con 0x7f1f9c109550 2024-08-25T23:53:28.609 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.536+0000 7f1fa1200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f9c109550 0x7f1f9c109950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:28.609 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.536+0000 7f1fa1200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f9c109550 0x7f1f9c109950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54500/0 (socket says 172.21.15.42:54500) 2024-08-25T23:53:28.609 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.536+0000 7f1fa1200640 1 -- 172.21.15.42:0/3390140714 learned_addr learned my addr 172.21.15.42:0/3390140714 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:28.609 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.536+0000 7f1fa1200640 1 -- 172.21.15.42:0/3390140714 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9c10a700 con 0x7f1f9c109550 2024-08-25T23:53:28.609 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.537+0000 7f1fa1200640 1 --2- 172.21.15.42:0/3390140714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f9c109550 0x7f1f9c109950 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1f90009820 tx=0x7f1f9002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122fc44fb343c1c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:28.609 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.537+0000 7f1f9b400640 1 -- 172.21.15.42:0/3390140714 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f90037070 con 0x7f1f9c109550 2024-08-25T23:53:28.609 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.538+0000 7f1f9b400640 1 -- 172.21.15.42:0/3390140714 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f90032920 con 0x7f1f9c109550 2024-08-25T23:53:28.609 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.538+0000 7f1f9b400640 1 -- 172.21.15.42:0/3390140714 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f90030810 con 0x7f1f9c109550 2024-08-25T23:53:28.609 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.538+0000 7f1fa2600640 1 -- 172.21.15.42:0/3390140714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f9c109550 msgr2=0x7f1f9c109950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:28.610 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.538+0000 7f1fa2600640 1 --2- 172.21.15.42:0/3390140714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f9c109550 0x7f1f9c109950 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1f90009820 tx=0x7f1f9002a270 comp rx=0 tx=0).stop 2024-08-25T23:53:28.610 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.538+0000 7f1fa2600640 1 -- 172.21.15.42:0/3390140714 shutdown_connections 2024-08-25T23:53:28.610 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.538+0000 7f1fa2600640 1 --2- 172.21.15.42:0/3390140714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f9c109550 0x7f1f9c109950 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:28.610 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.538+0000 7f1fa2600640 1 -- 172.21.15.42:0/3390140714 >> 172.21.15.42:0/3390140714 conn(0x7f1f9c07cb50 msgr2=0x7f1f9c1073d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:28.610 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.539+0000 7f1fa2600640 1 -- 172.21.15.42:0/3390140714 shutdown_connections 2024-08-25T23:53:28.610 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.539+0000 7f1fa2600640 1 -- 172.21.15.42:0/3390140714 wait complete. 2024-08-25T23:53:28.610 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.539+0000 7f1fa2600640 1 Processor -- start 2024-08-25T23:53:28.610 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.540+0000 7f1fa2600640 1 -- start start 2024-08-25T23:53:28.610 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.540+0000 7f1fa2600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f9c109550 0x7f1f9c19d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:28.610 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.540+0000 7f1fa2600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c10dab0 con 0x7f1f9c109550 2024-08-25T23:53:28.610 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.540+0000 7f1fa1200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f9c109550 0x7f1f9c19d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:28.610 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.540+0000 7f1fa1200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f9c109550 0x7f1f9c19d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54510/0 (socket says 172.21.15.42:54510) 2024-08-25T23:53:28.610 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.540+0000 7f1fa1200640 1 -- 172.21.15.42:0/3100166277 learned_addr learned my addr 172.21.15.42:0/3100166277 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:28.610 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.541+0000 7f1fa1200640 1 -- 172.21.15.42:0/3100166277 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9c19dca0 con 0x7f1f9c109550 2024-08-25T23:53:28.611 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.541+0000 7f1fa1200640 1 --2- 172.21.15.42:0/3100166277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f9c109550 0x7f1f9c19d760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1f900097f0 tx=0x7f1f900327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:28.611 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.541+0000 7f1f99600640 1 -- 172.21.15.42:0/3100166277 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f90037040 con 0x7f1f9c109550 2024-08-25T23:53:28.611 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.541+0000 7f1f99600640 1 -- 172.21.15.42:0/3100166277 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f90030cc0 con 0x7f1f9c109550 2024-08-25T23:53:28.611 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.541+0000 7f1f99600640 1 -- 172.21.15.42:0/3100166277 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f9003a640 con 0x7f1f9c109550 2024-08-25T23:53:28.611 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.541+0000 7f1fa2600640 1 -- 172.21.15.42:0/3100166277 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f9c19df30 con 0x7f1f9c109550 2024-08-25T23:53:28.611 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.541+0000 7f1fa2600640 1 -- 172.21.15.42:0/3100166277 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f9c1a0c20 con 0x7f1f9c109550 2024-08-25T23:53:28.611 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.543+0000 7f1fa2600640 1 -- 172.21.15.42:0/3100166277 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f9c1099d0 con 0x7f1f9c109550 2024-08-25T23:53:28.611 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.543+0000 7f1f99600640 1 -- 172.21.15.42:0/3100166277 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f1f9003b3f0 con 0x7f1f9c109550 2024-08-25T23:53:28.611 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.544+0000 7f1f99600640 1 --2- 172.21.15.42:0/3100166277 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f1f84038fc0 0x7f1f8403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:28.611 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.544+0000 7f1f99600640 1 -- 172.21.15.42:0/3100166277 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1f9006c5f0 con 0x7f1f9c109550 2024-08-25T23:53:28.611 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.544+0000 7f1f9be00640 1 -- 172.21.15.42:0/3100166277 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f1f84038fc0 msgr2=0x7f1f8403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/723045064 2024-08-25T23:53:28.612 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.544+0000 7f1f9be00640 1 --2- 172.21.15.42:0/3100166277 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f1f84038fc0 0x7f1f8403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-25T23:53:28.612 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.549+0000 7f1f99600640 1 -- 172.21.15.42:0/3100166277 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f1f900328c0 con 0x7f1f9c109550 2024-08-25T23:53:28.612 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.745+0000 7f1f9be00640 1 -- 172.21.15.42:0/3100166277 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f1f84038fc0 msgr2=0x7f1f8403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/723045064 2024-08-25T23:53:28.612 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.745+0000 7f1f9be00640 1 --2- 172.21.15.42:0/3100166277 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f1f84038fc0 0x7f1f8403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-25T23:53:28.612 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.793+0000 7f1fa2600640 1 -- 172.21.15.42:0/3100166277 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f1f9c02d6a0 con 0x7f1f9c109550 2024-08-25T23:53:28.612 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.794+0000 7f1f99600640 1 -- 172.21.15.42:0/3100166277 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f1f90042dc0 con 0x7f1f9c109550 2024-08-25T23:53:28.612 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.796+0000 7f1fa2600640 1 -- 172.21.15.42:0/3100166277 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f1f84038fc0 msgr2=0x7f1f8403b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-25T23:53:28.612 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.796+0000 7f1fa2600640 1 --2- 172.21.15.42:0/3100166277 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f1f84038fc0 0x7f1f8403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:28.612 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.796+0000 7f1fa2600640 1 -- 172.21.15.42:0/3100166277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f9c109550 msgr2=0x7f1f9c19d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:28.612 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.796+0000 7f1fa2600640 1 --2- 172.21.15.42:0/3100166277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f9c109550 0x7f1f9c19d760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1f900097f0 tx=0x7f1f900327b0 comp rx=0 tx=0).stop 2024-08-25T23:53:28.612 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.796+0000 7f1fa2600640 1 -- 172.21.15.42:0/3100166277 shutdown_connections 2024-08-25T23:53:28.612 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.796+0000 7f1fa2600640 1 --2- 172.21.15.42:0/3100166277 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f1f84038fc0 0x7f1f8403b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:28.612 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.796+0000 7f1fa2600640 1 --2- 172.21.15.42:0/3100166277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f9c109550 0x7f1f9c19d760 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:28.613 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.796+0000 7f1fa2600640 1 -- 172.21.15.42:0/3100166277 >> 172.21.15.42:0/3100166277 conn(0x7f1f9c07cb50 msgr2=0x7f1f9c106d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:28.613 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.796+0000 7f1fa2600640 1 -- 172.21.15.42:0/3100166277 shutdown_connections 2024-08-25T23:53:28.613 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:27.796+0000 7f1fa2600640 1 -- 172.21.15.42:0/3100166277 wait complete. 2024-08-25T23:53:28.613 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for the mgr to restart... 2024-08-25T23:53:28.613 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mgr epoch 9... 2024-08-25T23:53:28.799 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:28 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:28.547+0000 7f142b026040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-25T23:53:29.529 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:29 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:29.154+0000 7f142b026040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-25T23:53:29.529 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:29 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:29.233+0000 7f142b026040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-25T23:53:29.529 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:29 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:29.306+0000 7f142b026040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-25T23:53:31.017 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:30 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:30.760+0000 7f142b026040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-25T23:53:31.017 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:30 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:30.850+0000 7f142b026040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-25T23:53:31.018 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:30 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:30.933+0000 7f142b026040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-25T23:53:31.018 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:31 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:31.016+0000 7f142b026040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-25T23:53:31.281 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:31 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:31.206+0000 7f142b026040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-25T23:53:31.281 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:31 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:31.279+0000 7f142b026040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-25T23:53:31.533 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:31 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:31.428+0000 7f142b026040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-25T23:53:32.283 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:32 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:32.026+0000 7f142b026040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-25T23:53:32.283 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:32 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:32.101+0000 7f142b026040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-25T23:53:32.644 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:32 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:32.320+0000 7f142b026040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-25T23:53:32.644 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:32 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:32.403+0000 7f142b026040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-25T23:53:32.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:32 smithi042 ceph-mon[17225]: Active manager daemon x restarted 2024-08-25T23:53:32.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:32 smithi042 ceph-mon[17225]: Activating manager daemon x 2024-08-25T23:53:32.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:32 smithi042 ceph-mon[17225]: osdmap e3: 0 total, 0 up, 0 in 2024-08-25T23:53:32.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:32 smithi042 ceph-mon[17225]: mgrmap e10: x(active, starting, since 0.00415984s) 2024-08-25T23:53:32.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-25T23:53:32.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-08-25T23:53:32.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-25T23:53:32.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-25T23:53:32.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-25T23:53:32.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:32 smithi042 ceph-mon[17225]: Manager daemon x is now available 2024-08-25T23:53:32.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:53:33.694 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:33 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-08-25T23:53:33.694 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:33 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-08-25T23:53:33.694 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:33 smithi042 ceph-mon[17225]: mgrmap e11: x(active, since 1.00753s) 2024-08-25T23:53:34.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-08-25T23:53:34.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-08-25T23:53:34.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-25T23:53:34.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-08-25T23:53:34.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.637+0000 7f88ed000640 1 Processor -- start 2024-08-25T23:53:34.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.638+0000 7f88ed000640 1 -- start start 2024-08-25T23:53:34.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.638+0000 7f88ed000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88e8107350 0x7f88e8107750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:34.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.638+0000 7f88ed000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f88e8107d20 con 0x7f88e8107350 2024-08-25T23:53:34.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.639+0000 7f88e7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88e8107350 0x7f88e8107750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:34.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.639+0000 7f88e7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88e8107350 0x7f88e8107750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54518/0 (socket says 172.21.15.42:54518) 2024-08-25T23:53:34.764 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.639+0000 7f88e7400640 1 -- 172.21.15.42:0/360841360 learned_addr learned my addr 172.21.15.42:0/360841360 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:34.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.639+0000 7f88e7400640 1 -- 172.21.15.42:0/360841360 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e8108500 con 0x7f88e8107350 2024-08-25T23:53:34.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.640+0000 7f88e7400640 1 --2- 172.21.15.42:0/360841360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88e8107350 0x7f88e8107750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f88d8009820 tx=0x7f88d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8db429ba285287 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:34.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.640+0000 7f88e6a00640 1 -- 172.21.15.42:0/360841360 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88d8037070 con 0x7f88e8107350 2024-08-25T23:53:34.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.640+0000 7f88e6a00640 1 -- 172.21.15.42:0/360841360 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88d8032920 con 0x7f88e8107350 2024-08-25T23:53:34.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.640+0000 7f88e6a00640 1 -- 172.21.15.42:0/360841360 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88d8030810 con 0x7f88e8107350 2024-08-25T23:53:34.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.641+0000 7f88ed000640 1 -- 172.21.15.42:0/360841360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88e8107350 msgr2=0x7f88e8107750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:34.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.641+0000 7f88ed000640 1 --2- 172.21.15.42:0/360841360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88e8107350 0x7f88e8107750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f88d8009820 tx=0x7f88d802a270 comp rx=0 tx=0).stop 2024-08-25T23:53:34.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.641+0000 7f88ed000640 1 -- 172.21.15.42:0/360841360 shutdown_connections 2024-08-25T23:53:34.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.641+0000 7f88ed000640 1 --2- 172.21.15.42:0/360841360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88e8107350 0x7f88e8107750 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:34.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.641+0000 7f88ed000640 1 -- 172.21.15.42:0/360841360 >> 172.21.15.42:0/360841360 conn(0x7f88e8102b20 msgr2=0x7f88e8104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:34.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.641+0000 7f88ed000640 1 -- 172.21.15.42:0/360841360 shutdown_connections 2024-08-25T23:53:34.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.641+0000 7f88ed000640 1 -- 172.21.15.42:0/360841360 wait complete. 2024-08-25T23:53:34.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.642+0000 7f88ed000640 1 Processor -- start 2024-08-25T23:53:34.765 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.642+0000 7f88ed000640 1 -- start start 2024-08-25T23:53:34.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.643+0000 7f88ed000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88e8107350 0x7f88e819b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:34.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.643+0000 7f88ed000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f88e810b8b0 con 0x7f88e8107350 2024-08-25T23:53:34.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.643+0000 7f88e7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88e8107350 0x7f88e819b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:34.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.643+0000 7f88e7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88e8107350 0x7f88e819b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54526/0 (socket says 172.21.15.42:54526) 2024-08-25T23:53:34.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.643+0000 7f88e7400640 1 -- 172.21.15.42:0/2541713651 learned_addr learned my addr 172.21.15.42:0/2541713651 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:34.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.643+0000 7f88e7400640 1 -- 172.21.15.42:0/2541713651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e819ba80 con 0x7f88e8107350 2024-08-25T23:53:34.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.644+0000 7f88e7400640 1 --2- 172.21.15.42:0/2541713651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88e8107350 0x7f88e819b540 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f88d80097f0 tx=0x7f88d80327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:34.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.644+0000 7f88e4c00640 1 -- 172.21.15.42:0/2541713651 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88d8037040 con 0x7f88e8107350 2024-08-25T23:53:34.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.644+0000 7f88e4c00640 1 -- 172.21.15.42:0/2541713651 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88d8030cc0 con 0x7f88e8107350 2024-08-25T23:53:34.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.644+0000 7f88e4c00640 1 -- 172.21.15.42:0/2541713651 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88d803a640 con 0x7f88e8107350 2024-08-25T23:53:34.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.644+0000 7f88ed000640 1 -- 172.21.15.42:0/2541713651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88e819bd10 con 0x7f88e8107350 2024-08-25T23:53:34.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.644+0000 7f88ed000640 1 -- 172.21.15.42:0/2541713651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88e819ea00 con 0x7f88e8107350 2024-08-25T23:53:34.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.645+0000 7f88e4c00640 1 -- 172.21.15.42:0/2541713651 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f88d803b3f0 con 0x7f88e8107350 2024-08-25T23:53:34.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.646+0000 7f88e4c00640 1 --2- 172.21.15.42:0/2541713651 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f88cc039020 0x7f88cc03b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:34.766 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.646+0000 7f88e4c00640 1 -- 172.21.15.42:0/2541713651 --> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f88cc03bbf0 con 0x7f88cc039020 2024-08-25T23:53:34.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.646+0000 7f88e4c00640 1 -- 172.21.15.42:0/2541713651 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f88d806c500 con 0x7f88e8107350 2024-08-25T23:53:34.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.646+0000 7f88dfe00640 1 -- 172.21.15.42:0/2541713651 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f88cc039020 msgr2=0x7f88cc03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/723045064 2024-08-25T23:53:34.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.646+0000 7f88dfe00640 1 --2- 172.21.15.42:0/2541713651 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f88cc039020 0x7f88cc03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-25T23:53:34.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.847+0000 7f88dfe00640 1 -- 172.21.15.42:0/2541713651 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f88cc039020 msgr2=0x7f88cc03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/723045064 2024-08-25T23:53:34.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:29.847+0000 7f88dfe00640 1 --2- 172.21.15.42:0/2541713651 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f88cc039020 0x7f88cc03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-25T23:53:34.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:30.248+0000 7f88dfe00640 1 -- 172.21.15.42:0/2541713651 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f88cc039020 msgr2=0x7f88cc03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/723045064 2024-08-25T23:53:34.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:30.248+0000 7f88dfe00640 1 --2- 172.21.15.42:0/2541713651 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f88cc039020 0x7f88cc03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-25T23:53:34.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:31.049+0000 7f88dfe00640 1 -- 172.21.15.42:0/2541713651 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f88cc039020 msgr2=0x7f88cc03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.42:6800/723045064 2024-08-25T23:53:34.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:31.049+0000 7f88dfe00640 1 --2- 172.21.15.42:0/2541713651 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f88cc039020 0x7f88cc03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-25T23:53:34.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:32.407+0000 7f88e4c00640 1 -- 172.21.15.42:0/2541713651 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f88d806afb0 con 0x7f88e8107350 2024-08-25T23:53:34.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:32.407+0000 7f88e4c00640 1 -- 172.21.15.42:0/2541713651 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f88cc039020 msgr2=0x7f88cc03b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-25T23:53:34.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:32.407+0000 7f88e4c00640 1 --2- 172.21.15.42:0/2541713651 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f88cc039020 0x7f88cc03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:34.767 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:33.409+0000 7f88e4c00640 1 -- 172.21.15.42:0/2541713651 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f88d802e850 con 0x7f88e8107350 2024-08-25T23:53:34.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:33.410+0000 7f88e4c00640 1 --2- 172.21.15.42:0/2541713651 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f88cc03cae0 0x7f88cc03eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:34.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:33.410+0000 7f88e4c00640 1 -- 172.21.15.42:0/2541713651 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f88d803eec0 con 0x7f88cc03cae0 2024-08-25T23:53:34.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:33.410+0000 7f88dfe00640 1 --2- 172.21.15.42:0/2541713651 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f88cc03cae0 0x7f88cc03eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:34.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:33.411+0000 7f88dfe00640 1 --2- 172.21.15.42:0/2541713651 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f88cc03cae0 0x7f88cc03eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f88d0003980 tx=0x7f88d00092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:34.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:33.412+0000 7f88e4c00640 1 -- 172.21.15.42:0/2541713651 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f88d803eec0 con 0x7f88cc03cae0 2024-08-25T23:53:34.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:33.420+0000 7f88ed000640 1 -- 172.21.15.42:0/2541713651 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f88e81077d0 con 0x7f88cc03cae0 2024-08-25T23:53:34.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:33.420+0000 7f88e4c00640 1 -- 172.21.15.42:0/2541713651 <== mgr.14150 v2:172.21.15.42:6800/22448279 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f88e81077d0 con 0x7f88cc03cae0 2024-08-25T23:53:34.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:33.421+0000 7f88ed000640 1 -- 172.21.15.42:0/2541713651 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f88cc03cae0 msgr2=0x7f88cc03eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:34.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:33.421+0000 7f88ed000640 1 --2- 172.21.15.42:0/2541713651 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f88cc03cae0 0x7f88cc03eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f88d0003980 tx=0x7f88d00092b0 comp rx=0 tx=0).stop 2024-08-25T23:53:34.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:33.421+0000 7f88ed000640 1 -- 172.21.15.42:0/2541713651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88e8107350 msgr2=0x7f88e819b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:34.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:33.421+0000 7f88ed000640 1 --2- 172.21.15.42:0/2541713651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88e8107350 0x7f88e819b540 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f88d80097f0 tx=0x7f88d80327b0 comp rx=0 tx=0).stop 2024-08-25T23:53:34.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:33.421+0000 7f88ed000640 1 -- 172.21.15.42:0/2541713651 shutdown_connections 2024-08-25T23:53:34.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:33.421+0000 7f88ed000640 1 --2- 172.21.15.42:0/2541713651 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f88cc03cae0 0x7f88cc03eed0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:34.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:33.421+0000 7f88ed000640 1 --2- 172.21.15.42:0/2541713651 >> [v2:172.21.15.42:6800/723045064,v1:172.21.15.42:6801/723045064] conn(0x7f88cc039020 0x7f88cc03b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:34.768 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:33.421+0000 7f88ed000640 1 --2- 172.21.15.42:0/2541713651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88e8107350 0x7f88e819b540 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:34.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:33.421+0000 7f88ed000640 1 -- 172.21.15.42:0/2541713651 >> 172.21.15.42:0/2541713651 conn(0x7f88e8102b20 msgr2=0x7f88e81037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:34.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:33.421+0000 7f88ed000640 1 -- 172.21.15.42:0/2541713651 shutdown_connections 2024-08-25T23:53:34.769 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:33.421+0000 7f88ed000640 1 -- 172.21.15.42:0/2541713651 wait complete. 2024-08-25T23:53:34.769 INFO:teuthology.orchestra.run.smithi042.stdout:mgr epoch 9 is available 2024-08-25T23:53:34.769 INFO:teuthology.orchestra.run.smithi042.stdout:Generating a dashboard self-signed certificate... 2024-08-25T23:53:35.271 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:35 smithi042 ceph-mon[17225]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-25T23:53:35.271 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:35 smithi042 ceph-mon[17225]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-25T23:53:35.271 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:35 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:35.272 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:35.136+0000 7f1388800640 -1 log_channel(cephadm) log [ERR] : [25/Aug/2024:23:53:35] ENGINE Error in HTTPServer.serve 2024-08-25T23:53:35.272 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: Traceback (most recent call last): 2024-08-25T23:53:35.272 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-25T23:53:35.272 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: self._connections.run(self.expiration_interval) 2024-08-25T23:53:35.272 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-25T23:53:35.272 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: self._run(expiration_interval) 2024-08-25T23:53:35.272 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-25T23:53:35.272 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: new_conn = self._from_server_socket(self.server.socket) 2024-08-25T23:53:35.272 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-25T23:53:35.272 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-25T23:53:35.273 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-25T23:53:35.273 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: s = self.context.wrap_socket( 2024-08-25T23:53:35.273 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-25T23:53:35.273 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: return self.sslsocket_class._create( 2024-08-25T23:53:35.273 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-25T23:53:35.273 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: self.do_handshake() 2024-08-25T23:53:35.273 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-25T23:53:35.273 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: self._sslobj.do_handshake() 2024-08-25T23:53:35.273 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-25T23:53:35.273 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:53:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:53:36.216 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-08-25T23:53:36.216 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.268+0000 7fb508e00640 1 Processor -- start 2024-08-25T23:53:36.216 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.269+0000 7fb508e00640 1 -- start start 2024-08-25T23:53:36.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.269+0000 7fb508e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb504107350 0x7fb504107750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:36.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.269+0000 7fb508e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb504107d20 con 0x7fb504107350 2024-08-25T23:53:36.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.270+0000 7fb503400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb504107350 0x7fb504107750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:36.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.270+0000 7fb503400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb504107350 0x7fb504107750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35604/0 (socket says 172.21.15.42:35604) 2024-08-25T23:53:36.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.270+0000 7fb503400640 1 -- 172.21.15.42:0/1997415830 learned_addr learned my addr 172.21.15.42:0/1997415830 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:36.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.271+0000 7fb503400640 1 -- 172.21.15.42:0/1997415830 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb504108500 con 0x7fb504107350 2024-08-25T23:53:36.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.272+0000 7fb503400640 1 --2- 172.21.15.42:0/1997415830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb504107350 0x7fb504107750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4009820 tx=0x7fb4f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83bba455995793e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:36.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.272+0000 7fb502000640 1 -- 172.21.15.42:0/1997415830 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4f4037070 con 0x7fb504107350 2024-08-25T23:53:36.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.272+0000 7fb502000640 1 -- 172.21.15.42:0/1997415830 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4f4032920 con 0x7fb504107350 2024-08-25T23:53:36.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.272+0000 7fb502000640 1 -- 172.21.15.42:0/1997415830 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4f4030810 con 0x7fb504107350 2024-08-25T23:53:36.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.273+0000 7fb508e00640 1 -- 172.21.15.42:0/1997415830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb504107350 msgr2=0x7fb504107750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:36.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.273+0000 7fb508e00640 1 --2- 172.21.15.42:0/1997415830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb504107350 0x7fb504107750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4009820 tx=0x7fb4f402a270 comp rx=0 tx=0).stop 2024-08-25T23:53:36.217 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.273+0000 7fb508e00640 1 -- 172.21.15.42:0/1997415830 shutdown_connections 2024-08-25T23:53:36.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.273+0000 7fb508e00640 1 --2- 172.21.15.42:0/1997415830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb504107350 0x7fb504107750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:36.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.273+0000 7fb508e00640 1 -- 172.21.15.42:0/1997415830 >> 172.21.15.42:0/1997415830 conn(0x7fb504102b20 msgr2=0x7fb504104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:36.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.273+0000 7fb508e00640 1 -- 172.21.15.42:0/1997415830 shutdown_connections 2024-08-25T23:53:36.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.273+0000 7fb508e00640 1 -- 172.21.15.42:0/1997415830 wait complete. 2024-08-25T23:53:36.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.275+0000 7fb508e00640 1 Processor -- start 2024-08-25T23:53:36.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.275+0000 7fb508e00640 1 -- start start 2024-08-25T23:53:36.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.275+0000 7fb508e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb504107350 0x7fb50419d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:36.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.275+0000 7fb508e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb50410b8b0 con 0x7fb504107350 2024-08-25T23:53:36.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.276+0000 7fb503400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb504107350 0x7fb50419d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:36.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.276+0000 7fb503400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb504107350 0x7fb50419d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35608/0 (socket says 172.21.15.42:35608) 2024-08-25T23:53:36.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.276+0000 7fb503400640 1 -- 172.21.15.42:0/1111953622 learned_addr learned my addr 172.21.15.42:0/1111953622 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:36.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.276+0000 7fb503400640 1 -- 172.21.15.42:0/1111953622 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50419dc90 con 0x7fb504107350 2024-08-25T23:53:36.218 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.277+0000 7fb503400640 1 --2- 172.21.15.42:0/1111953622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb504107350 0x7fb50419d750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40097f0 tx=0x7fb4f40327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:36.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.278+0000 7fb4fbe00640 1 -- 172.21.15.42:0/1111953622 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4f4037040 con 0x7fb504107350 2024-08-25T23:53:36.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.278+0000 7fb4fbe00640 1 -- 172.21.15.42:0/1111953622 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4f4030cc0 con 0x7fb504107350 2024-08-25T23:53:36.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.278+0000 7fb4fbe00640 1 -- 172.21.15.42:0/1111953622 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4f403a640 con 0x7fb504107350 2024-08-25T23:53:36.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.278+0000 7fb508e00640 1 -- 172.21.15.42:0/1111953622 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb50419df20 con 0x7fb504107350 2024-08-25T23:53:36.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.278+0000 7fb508e00640 1 -- 172.21.15.42:0/1111953622 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5041a0c10 con 0x7fb504107350 2024-08-25T23:53:36.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.279+0000 7fb4fbe00640 1 -- 172.21.15.42:0/1111953622 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fb4f403b3f0 con 0x7fb504107350 2024-08-25T23:53:36.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.280+0000 7fb508e00640 1 -- 172.21.15.42:0/1111953622 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5041077d0 con 0x7fb504107350 2024-08-25T23:53:36.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.280+0000 7fb4fbe00640 1 --2- 172.21.15.42:0/1111953622 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb4e8039070 0x7fb4e803b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:36.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.280+0000 7fb4fbe00640 1 -- 172.21.15.42:0/1111953622 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb4f406c660 con 0x7fb504107350 2024-08-25T23:53:36.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.281+0000 7fb502a00640 1 --2- 172.21.15.42:0/1111953622 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb4e8039070 0x7fb4e803b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:36.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.281+0000 7fb502a00640 1 --2- 172.21.15.42:0/1111953622 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb4e8039070 0x7fb4e803b530 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00098c0 tx=0x7fb4f0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:36.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.286+0000 7fb4fbe00640 1 -- 172.21.15.42:0/1111953622 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb4f4040210 con 0x7fb504107350 2024-08-25T23:53:36.219 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.478+0000 7fb508e00640 1 -- 172.21.15.42:0/1111953622 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fb504103ee0 con 0x7fb4e8039070 2024-08-25T23:53:36.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.545+0000 7fb4fbe00640 1 -- 172.21.15.42:0/1111953622 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fb504103ee0 con 0x7fb4e8039070 2024-08-25T23:53:36.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.547+0000 7fb508e00640 1 -- 172.21.15.42:0/1111953622 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb4e8039070 msgr2=0x7fb4e803b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:36.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.547+0000 7fb508e00640 1 --2- 172.21.15.42:0/1111953622 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb4e8039070 0x7fb4e803b530 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00098c0 tx=0x7fb4f0006db0 comp rx=0 tx=0).stop 2024-08-25T23:53:36.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.548+0000 7fb508e00640 1 -- 172.21.15.42:0/1111953622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb504107350 msgr2=0x7fb50419d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:36.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.548+0000 7fb508e00640 1 --2- 172.21.15.42:0/1111953622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb504107350 0x7fb50419d750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40097f0 tx=0x7fb4f40327b0 comp rx=0 tx=0).stop 2024-08-25T23:53:36.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.548+0000 7fb508e00640 1 -- 172.21.15.42:0/1111953622 shutdown_connections 2024-08-25T23:53:36.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.548+0000 7fb508e00640 1 --2- 172.21.15.42:0/1111953622 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb4e8039070 0x7fb4e803b530 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:36.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.548+0000 7fb508e00640 1 --2- 172.21.15.42:0/1111953622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb504107350 0x7fb50419d750 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:36.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.548+0000 7fb508e00640 1 -- 172.21.15.42:0/1111953622 >> 172.21.15.42:0/1111953622 conn(0x7fb504102b20 msgr2=0x7fb5041037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:36.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.548+0000 7fb508e00640 1 -- 172.21.15.42:0/1111953622 shutdown_connections 2024-08-25T23:53:36.220 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:35.548+0000 7fb508e00640 1 -- 172.21.15.42:0/1111953622 wait complete. 2024-08-25T23:53:36.220 INFO:teuthology.orchestra.run.smithi042.stdout:Creating initial admin user... 2024-08-25T23:53:36.491 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:36 smithi042 ceph-mon[17225]: [25/Aug/2024:23:53:34] ENGINE Bus STARTING 2024-08-25T23:53:36.491 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:36 smithi042 ceph-mon[17225]: [25/Aug/2024:23:53:35] ENGINE Serving on https://172.21.15.42:7150 2024-08-25T23:53:36.491 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:36 smithi042 ceph-mon[17225]: [25/Aug/2024:23:53:35] ENGINE Error in HTTPServer.serve 2024-08-25T23:53:36.491 INFO:journalctl@ceph.mon.a.smithi042.stdout: Traceback (most recent call last): 2024-08-25T23:53:36.491 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-25T23:53:36.491 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._connections.run(self.expiration_interval) 2024-08-25T23:53:36.491 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-25T23:53:36.492 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._run(expiration_interval) 2024-08-25T23:53:36.492 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-25T23:53:36.492 INFO:journalctl@ceph.mon.a.smithi042.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-25T23:53:36.492 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-25T23:53:36.492 INFO:journalctl@ceph.mon.a.smithi042.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-25T23:53:36.492 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-25T23:53:36.492 INFO:journalctl@ceph.mon.a.smithi042.stdout: s = self.context.wrap_socket( 2024-08-25T23:53:36.492 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-25T23:53:36.492 INFO:journalctl@ceph.mon.a.smithi042.stdout: return self.sslsocket_class._create( 2024-08-25T23:53:36.492 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-25T23:53:36.492 INFO:journalctl@ceph.mon.a.smithi042.stdout: self.do_handshake() 2024-08-25T23:53:36.493 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-25T23:53:36.493 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._sslobj.do_handshake() 2024-08-25T23:53:36.493 INFO:journalctl@ceph.mon.a.smithi042.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-25T23:53:36.493 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:36 smithi042 ceph-mon[17225]: mgrmap e12: x(active, since 2s) 2024-08-25T23:53:36.493 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:36 smithi042 ceph-mon[17225]: [25/Aug/2024:23:53:35] ENGINE Serving on http://172.21.15.42:8765 2024-08-25T23:53:36.493 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:36 smithi042 ceph-mon[17225]: [25/Aug/2024:23:53:35] ENGINE Bus STARTED 2024-08-25T23:53:36.493 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:36 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:36.493 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:36 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:36.493 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:36 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:37.406 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:37 smithi042 ceph-mon[17225]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:53:38.169 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$fUTo0XAPn8gEEVjt4A4TVeGYPEMCJXbCSEORxl8OVJnkkIm40nKoG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1724630017, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-08-25T23:53:38.169 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.741+0000 7f48c6800640 1 Processor -- start 2024-08-25T23:53:38.170 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.741+0000 7f48c6800640 1 -- start start 2024-08-25T23:53:38.170 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.742+0000 7f48c6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c007de40 0x7f48c007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:38.170 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.742+0000 7f48c6800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f48c007c830 con 0x7f48c007de40 2024-08-25T23:53:38.170 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.742+0000 7f48bf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c007de40 0x7f48c007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:38.170 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.742+0000 7f48bf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c007de40 0x7f48c007c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35612/0 (socket says 172.21.15.42:35612) 2024-08-25T23:53:38.170 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.742+0000 7f48bf400640 1 -- 172.21.15.42:0/1516831728 learned_addr learned my addr 172.21.15.42:0/1516831728 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:38.170 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.743+0000 7f48bf400640 1 -- 172.21.15.42:0/1516831728 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c007c9b0 con 0x7f48c007de40 2024-08-25T23:53:38.170 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.744+0000 7f48bf400640 1 --2- 172.21.15.42:0/1516831728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c007de40 0x7f48c007c2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009820 tx=0x7f48b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14f5e6b7e4562c server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:38.170 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.744+0000 7f48bea00640 1 -- 172.21.15.42:0/1516831728 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48b0037070 con 0x7f48c007de40 2024-08-25T23:53:38.170 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.744+0000 7f48bea00640 1 -- 172.21.15.42:0/1516831728 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48b0032920 con 0x7f48c007de40 2024-08-25T23:53:38.170 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.744+0000 7f48bea00640 1 -- 172.21.15.42:0/1516831728 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48b0030810 con 0x7f48c007de40 2024-08-25T23:53:38.170 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.745+0000 7f48c6800640 1 -- 172.21.15.42:0/1516831728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c007de40 msgr2=0x7f48c007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:38.170 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.745+0000 7f48c6800640 1 --2- 172.21.15.42:0/1516831728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c007de40 0x7f48c007c2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009820 tx=0x7f48b002a270 comp rx=0 tx=0).stop 2024-08-25T23:53:38.171 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.745+0000 7f48c6800640 1 -- 172.21.15.42:0/1516831728 shutdown_connections 2024-08-25T23:53:38.171 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.745+0000 7f48c6800640 1 --2- 172.21.15.42:0/1516831728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c007de40 0x7f48c007c2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:38.171 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.745+0000 7f48c6800640 1 -- 172.21.15.42:0/1516831728 >> 172.21.15.42:0/1516831728 conn(0x7f48c0102c80 msgr2=0x7f48c01050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:38.171 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.745+0000 7f48c6800640 1 -- 172.21.15.42:0/1516831728 shutdown_connections 2024-08-25T23:53:38.171 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.745+0000 7f48c6800640 1 -- 172.21.15.42:0/1516831728 wait complete. 2024-08-25T23:53:38.171 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.746+0000 7f48c6800640 1 Processor -- start 2024-08-25T23:53:38.171 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.747+0000 7f48c6800640 1 -- start start 2024-08-25T23:53:38.171 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.747+0000 7f48c6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c007de40 0x7f48c019d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:38.171 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.747+0000 7f48c6800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f48c010dab0 con 0x7f48c007de40 2024-08-25T23:53:38.171 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.747+0000 7f48bf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c007de40 0x7f48c019d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:38.171 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.747+0000 7f48bf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c007de40 0x7f48c019d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35618/0 (socket says 172.21.15.42:35618) 2024-08-25T23:53:38.171 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.747+0000 7f48bf400640 1 -- 172.21.15.42:0/883961347 learned_addr learned my addr 172.21.15.42:0/883961347 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:38.171 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.748+0000 7f48bf400640 1 -- 172.21.15.42:0/883961347 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c019de70 con 0x7f48c007de40 2024-08-25T23:53:38.172 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.748+0000 7f48bf400640 1 --2- 172.21.15.42:0/883961347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c007de40 0x7f48c019d930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f48b00097f0 tx=0x7f48b00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:38.172 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.748+0000 7f48bcc00640 1 -- 172.21.15.42:0/883961347 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48b0037040 con 0x7f48c007de40 2024-08-25T23:53:38.172 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.748+0000 7f48bcc00640 1 -- 172.21.15.42:0/883961347 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48b0030cc0 con 0x7f48c007de40 2024-08-25T23:53:38.172 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.748+0000 7f48c6800640 1 -- 172.21.15.42:0/883961347 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48c019e100 con 0x7f48c007de40 2024-08-25T23:53:38.172 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.748+0000 7f48bcc00640 1 -- 172.21.15.42:0/883961347 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48b003a6b0 con 0x7f48c007de40 2024-08-25T23:53:38.172 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.748+0000 7f48c6800640 1 -- 172.21.15.42:0/883961347 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48c01a0df0 con 0x7f48c007de40 2024-08-25T23:53:38.172 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.750+0000 7f48bcc00640 1 -- 172.21.15.42:0/883961347 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f48b003a850 con 0x7f48c007de40 2024-08-25T23:53:38.172 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.750+0000 7f48c6800640 1 -- 172.21.15.42:0/883961347 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48c007c370 con 0x7f48c007de40 2024-08-25T23:53:38.172 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.750+0000 7f48bcc00640 1 --2- 172.21.15.42:0/883961347 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48a4039020 0x7f48a403b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:38.172 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.750+0000 7f48bcc00640 1 -- 172.21.15.42:0/883961347 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f48b006c780 con 0x7f48c007de40 2024-08-25T23:53:38.172 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.751+0000 7f48b7e00640 1 --2- 172.21.15.42:0/883961347 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48a4039020 0x7f48a403b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:38.172 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.751+0000 7f48b7e00640 1 --2- 172.21.15.42:0/883961347 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48a4039020 0x7f48a403b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f48a80098c0 tx=0x7f48a8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:38.172 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.757+0000 7f48bcc00640 1 -- 172.21.15.42:0/883961347 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f48b0044920 con 0x7f48c007de40 2024-08-25T23:53:38.172 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:36.960+0000 7f48c6800640 1 -- 172.21.15.42:0/883961347 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f48c019e5e0 con 0x7f48a4039020 2024-08-25T23:53:38.173 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:37.210+0000 7f48bcc00640 1 -- 172.21.15.42:0/883961347 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f48c019e5e0 con 0x7f48a4039020 2024-08-25T23:53:38.173 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:37.213+0000 7f48c6800640 1 -- 172.21.15.42:0/883961347 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48a4039020 msgr2=0x7f48a403b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:38.173 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:37.213+0000 7f48c6800640 1 --2- 172.21.15.42:0/883961347 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48a4039020 0x7f48a403b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f48a80098c0 tx=0x7f48a8006db0 comp rx=0 tx=0).stop 2024-08-25T23:53:38.173 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:37.213+0000 7f48c6800640 1 -- 172.21.15.42:0/883961347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c007de40 msgr2=0x7f48c019d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:38.173 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:37.213+0000 7f48c6800640 1 --2- 172.21.15.42:0/883961347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c007de40 0x7f48c019d930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f48b00097f0 tx=0x7f48b00327b0 comp rx=0 tx=0).stop 2024-08-25T23:53:38.173 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:37.213+0000 7f48c6800640 1 -- 172.21.15.42:0/883961347 shutdown_connections 2024-08-25T23:53:38.173 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:37.213+0000 7f48c6800640 1 --2- 172.21.15.42:0/883961347 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48a4039020 0x7f48a403b4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:38.173 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:37.213+0000 7f48c6800640 1 --2- 172.21.15.42:0/883961347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c007de40 0x7f48c019d930 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:38.173 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:37.213+0000 7f48c6800640 1 -- 172.21.15.42:0/883961347 >> 172.21.15.42:0/883961347 conn(0x7f48c0102c80 msgr2=0x7f48c01039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:38.173 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:37.213+0000 7f48c6800640 1 -- 172.21.15.42:0/883961347 shutdown_connections 2024-08-25T23:53:38.173 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:37.213+0000 7f48c6800640 1 -- 172.21.15.42:0/883961347 wait complete. 2024-08-25T23:53:38.173 INFO:teuthology.orchestra.run.smithi042.stdout:Fetching dashboard port number... 2024-08-25T23:53:38.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:38 smithi042 ceph-mon[17225]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:53:38.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:39.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:39 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/84809974' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-08-25T23:53:39.663 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 8443 2024-08-25T23:53:39.663 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.873+0000 7f297e600640 1 Processor -- start 2024-08-25T23:53:39.663 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.873+0000 7f297e600640 1 -- start start 2024-08-25T23:53:39.663 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.874+0000 7f297e600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978107500 0x7f2978107900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:39.663 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.874+0000 7f297e600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2978107ed0 con 0x7f2978107500 2024-08-25T23:53:39.663 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.874+0000 7f2977400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978107500 0x7f2978107900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:39.663 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.874+0000 7f2977400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978107500 0x7f2978107900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35620/0 (socket says 172.21.15.42:35620) 2024-08-25T23:53:39.663 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.874+0000 7f2977400640 1 -- 172.21.15.42:0/332511363 learned_addr learned my addr 172.21.15.42:0/332511363 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:39.663 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.875+0000 7f2977400640 1 -- 172.21.15.42:0/332511363 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2978108700 con 0x7f2978107500 2024-08-25T23:53:39.664 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.876+0000 7f2977400640 1 --2- 172.21.15.42:0/332511363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978107500 0x7f2978107900 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2968009820 tx=0x7f296802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe5ceaf51350362 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:39.664 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.876+0000 7f2976a00640 1 -- 172.21.15.42:0/332511363 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2968037070 con 0x7f2978107500 2024-08-25T23:53:39.664 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.876+0000 7f2976a00640 1 -- 172.21.15.42:0/332511363 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2968032920 con 0x7f2978107500 2024-08-25T23:53:39.664 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.876+0000 7f2976a00640 1 -- 172.21.15.42:0/332511363 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2968030810 con 0x7f2978107500 2024-08-25T23:53:39.664 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.877+0000 7f297e600640 1 -- 172.21.15.42:0/332511363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978107500 msgr2=0x7f2978107900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:39.664 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.877+0000 7f297e600640 1 --2- 172.21.15.42:0/332511363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978107500 0x7f2978107900 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2968009820 tx=0x7f296802a270 comp rx=0 tx=0).stop 2024-08-25T23:53:39.664 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.877+0000 7f297e600640 1 -- 172.21.15.42:0/332511363 shutdown_connections 2024-08-25T23:53:39.665 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.877+0000 7f297e600640 1 --2- 172.21.15.42:0/332511363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978107500 0x7f2978107900 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:39.665 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.877+0000 7f297e600640 1 -- 172.21.15.42:0/332511363 >> 172.21.15.42:0/332511363 conn(0x7f2978102cd0 msgr2=0x7f29781050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:39.665 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.877+0000 7f297e600640 1 -- 172.21.15.42:0/332511363 shutdown_connections 2024-08-25T23:53:39.665 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.877+0000 7f297e600640 1 -- 172.21.15.42:0/332511363 wait complete. 2024-08-25T23:53:39.665 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.878+0000 7f297e600640 1 Processor -- start 2024-08-25T23:53:39.665 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.878+0000 7f297e600640 1 -- start start 2024-08-25T23:53:39.665 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.878+0000 7f297e600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978107500 0x7f297807db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:39.665 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.878+0000 7f297e600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f297810bab0 con 0x7f2978107500 2024-08-25T23:53:39.665 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.879+0000 7f2977400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978107500 0x7f297807db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:39.665 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.879+0000 7f2977400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978107500 0x7f297807db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35624/0 (socket says 172.21.15.42:35624) 2024-08-25T23:53:39.665 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.879+0000 7f2977400640 1 -- 172.21.15.42:0/84809974 learned_addr learned my addr 172.21.15.42:0/84809974 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:39.665 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.879+0000 7f2977400640 1 -- 172.21.15.42:0/84809974 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297807e0c0 con 0x7f2978107500 2024-08-25T23:53:39.665 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.879+0000 7f2977400640 1 --2- 172.21.15.42:0/84809974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978107500 0x7f297807db80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2968030560 tx=0x7f2968032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:39.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.880+0000 7f2974c00640 1 -- 172.21.15.42:0/84809974 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2968037040 con 0x7f2978107500 2024-08-25T23:53:39.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.880+0000 7f2974c00640 1 -- 172.21.15.42:0/84809974 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2968040070 con 0x7f2978107500 2024-08-25T23:53:39.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.880+0000 7f297e600640 1 -- 172.21.15.42:0/84809974 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f297807c2b0 con 0x7f2978107500 2024-08-25T23:53:39.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.880+0000 7f2974c00640 1 -- 172.21.15.42:0/84809974 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f296803a740 con 0x7f2978107500 2024-08-25T23:53:39.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.880+0000 7f297e600640 1 -- 172.21.15.42:0/84809974 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f297807c7f0 con 0x7f2978107500 2024-08-25T23:53:39.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.881+0000 7f2974c00640 1 -- 172.21.15.42:0/84809974 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f296803bb90 con 0x7f2978107500 2024-08-25T23:53:39.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.881+0000 7f297e600640 1 -- 172.21.15.42:0/84809974 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2978107980 con 0x7f2978107500 2024-08-25T23:53:39.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.881+0000 7f2974c00640 1 --2- 172.21.15.42:0/84809974 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f295c039020 0x7f295c03b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:39.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.881+0000 7f2974c00640 1 -- 172.21.15.42:0/84809974 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f296806c720 con 0x7f2978107500 2024-08-25T23:53:39.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.882+0000 7f296ea00640 1 --2- 172.21.15.42:0/84809974 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f295c039020 0x7f295c03b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:39.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.882+0000 7f296ea00640 1 --2- 172.21.15.42:0/84809974 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f295c039020 0x7f295c03b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f29600098c0 tx=0x7f2960006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:39.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:38.886+0000 7f2974c00640 1 -- 172.21.15.42:0/84809974 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f296804a200 con 0x7f2978107500 2024-08-25T23:53:39.667 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:39.072+0000 7f297e600640 1 -- 172.21.15.42:0/84809974 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f2978194ea0 con 0x7f2978107500 2024-08-25T23:53:39.667 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:39.072+0000 7f2974c00640 1 -- 172.21.15.42:0/84809974 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f2968031e80 con 0x7f2978107500 2024-08-25T23:53:39.667 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:39.074+0000 7f297e600640 1 -- 172.21.15.42:0/84809974 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f295c039020 msgr2=0x7f295c03b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:39.667 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:39.074+0000 7f297e600640 1 --2- 172.21.15.42:0/84809974 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f295c039020 0x7f295c03b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f29600098c0 tx=0x7f2960006db0 comp rx=0 tx=0).stop 2024-08-25T23:53:39.667 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:39.074+0000 7f297e600640 1 -- 172.21.15.42:0/84809974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978107500 msgr2=0x7f297807db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:39.667 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:39.074+0000 7f297e600640 1 --2- 172.21.15.42:0/84809974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978107500 0x7f297807db80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2968030560 tx=0x7f2968032670 comp rx=0 tx=0).stop 2024-08-25T23:53:39.667 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:39.075+0000 7f297e600640 1 -- 172.21.15.42:0/84809974 shutdown_connections 2024-08-25T23:53:39.667 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:39.075+0000 7f297e600640 1 --2- 172.21.15.42:0/84809974 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f295c039020 0x7f295c03b4e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:39.667 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:39.075+0000 7f297e600640 1 --2- 172.21.15.42:0/84809974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978107500 0x7f297807db80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:39.667 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:39.075+0000 7f297e600640 1 -- 172.21.15.42:0/84809974 >> 172.21.15.42:0/84809974 conn(0x7f2978102cd0 msgr2=0x7f2978103a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:39.667 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:39.075+0000 7f297e600640 1 -- 172.21.15.42:0/84809974 shutdown_connections 2024-08-25T23:53:39.667 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:39.075+0000 7f297e600640 1 -- 172.21.15.42:0/84809974 wait complete. 2024-08-25T23:53:39.678 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-25T23:53:39.678 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout disabled 2024-08-25T23:53:39.692 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-25T23:53:39.692 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-08-25T23:53:39.692 INFO:teuthology.orchestra.run.smithi042.stdout:firewalld.service is not enabled 2024-08-25T23:53:39.692 INFO:teuthology.orchestra.run.smithi042.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-08-25T23:53:39.695 INFO:teuthology.orchestra.run.smithi042.stdout:Ceph Dashboard is now available at: 2024-08-25T23:53:39.695 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:53:39.695 INFO:teuthology.orchestra.run.smithi042.stdout: URL: https://smithi042.front.sepia.ceph.com:8443/ 2024-08-25T23:53:39.695 INFO:teuthology.orchestra.run.smithi042.stdout: User: admin 2024-08-25T23:53:39.695 INFO:teuthology.orchestra.run.smithi042.stdout: Password: ker7xb4969 2024-08-25T23:53:39.695 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:53:39.696 INFO:teuthology.orchestra.run.smithi042.stdout:Saving cluster configuration to /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/config directory 2024-08-25T23:53:40.453 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:40 smithi042 ceph-mon[17225]: mgrmap e13: x(active, since 6s) 2024-08-25T23:53:41.060 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.162+0000 7ff5a9800640 1 Processor -- start 2024-08-25T23:53:41.060 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.162+0000 7ff5a9800640 1 -- start start 2024-08-25T23:53:41.060 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.163+0000 7ff5a9800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5a41074d0 0x7ff5a41078d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:41.060 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.163+0000 7ff5a9800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a4107ea0 con 0x7ff5a41074d0 2024-08-25T23:53:41.060 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.163+0000 7ff5a2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5a41074d0 0x7ff5a41078d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:41.060 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.163+0000 7ff5a2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5a41074d0 0x7ff5a41078d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35632/0 (socket says 172.21.15.42:35632) 2024-08-25T23:53:41.060 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.163+0000 7ff5a2a00640 1 -- 172.21.15.42:0/19529496 learned_addr learned my addr 172.21.15.42:0/19529496 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:41.061 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.164+0000 7ff5a2a00640 1 -- 172.21.15.42:0/19529496 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a4108680 con 0x7ff5a41074d0 2024-08-25T23:53:41.061 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.164+0000 7ff5a2a00640 1 --2- 172.21.15.42:0/19529496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5a41074d0 0x7ff5a41078d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff594009820 tx=0x7ff59402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a42467de1688a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:41.061 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.165+0000 7ff5a2000640 1 -- 172.21.15.42:0/19529496 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff594037070 con 0x7ff5a41074d0 2024-08-25T23:53:41.061 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.165+0000 7ff5a2000640 1 -- 172.21.15.42:0/19529496 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff594032920 con 0x7ff5a41074d0 2024-08-25T23:53:41.061 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.165+0000 7ff5a2000640 1 -- 172.21.15.42:0/19529496 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff594030810 con 0x7ff5a41074d0 2024-08-25T23:53:41.061 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.165+0000 7ff5a9800640 1 -- 172.21.15.42:0/19529496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5a41074d0 msgr2=0x7ff5a41078d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:41.061 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.165+0000 7ff5a9800640 1 --2- 172.21.15.42:0/19529496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5a41074d0 0x7ff5a41078d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff594009820 tx=0x7ff59402a270 comp rx=0 tx=0).stop 2024-08-25T23:53:41.061 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.166+0000 7ff5a9800640 1 -- 172.21.15.42:0/19529496 shutdown_connections 2024-08-25T23:53:41.061 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.166+0000 7ff5a9800640 1 --2- 172.21.15.42:0/19529496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5a41074d0 0x7ff5a41078d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:41.061 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.166+0000 7ff5a9800640 1 -- 172.21.15.42:0/19529496 >> 172.21.15.42:0/19529496 conn(0x7ff5a4102ca0 msgr2=0x7ff5a41050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:41.061 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.166+0000 7ff5a9800640 1 -- 172.21.15.42:0/19529496 shutdown_connections 2024-08-25T23:53:41.062 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.166+0000 7ff5a9800640 1 -- 172.21.15.42:0/19529496 wait complete. 2024-08-25T23:53:41.062 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.167+0000 7ff5a9800640 1 Processor -- start 2024-08-25T23:53:41.062 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.167+0000 7ff5a9800640 1 -- start start 2024-08-25T23:53:41.062 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.167+0000 7ff5a9800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5a41074d0 0x7ff5a419b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:41.062 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.167+0000 7ff5a9800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a410ba30 con 0x7ff5a41074d0 2024-08-25T23:53:41.062 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.167+0000 7ff5a2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5a41074d0 0x7ff5a419b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:41.062 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.167+0000 7ff5a2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5a41074d0 0x7ff5a419b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35634/0 (socket says 172.21.15.42:35634) 2024-08-25T23:53:41.062 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.167+0000 7ff5a2a00640 1 -- 172.21.15.42:0/680620708 learned_addr learned my addr 172.21.15.42:0/680620708 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:41.062 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.168+0000 7ff5a2a00640 1 -- 172.21.15.42:0/680620708 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a419bcb0 con 0x7ff5a41074d0 2024-08-25T23:53:41.062 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.168+0000 7ff5a2a00640 1 --2- 172.21.15.42:0/680620708 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5a41074d0 0x7ff5a419b770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff5940097f0 tx=0x7ff5940327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:41.062 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.168+0000 7ff59b400640 1 -- 172.21.15.42:0/680620708 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff594037040 con 0x7ff5a41074d0 2024-08-25T23:53:41.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.168+0000 7ff59b400640 1 -- 172.21.15.42:0/680620708 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff594030cc0 con 0x7ff5a41074d0 2024-08-25T23:53:41.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.168+0000 7ff59b400640 1 -- 172.21.15.42:0/680620708 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff59403a640 con 0x7ff5a41074d0 2024-08-25T23:53:41.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.168+0000 7ff5a9800640 1 -- 172.21.15.42:0/680620708 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a419bf40 con 0x7ff5a41074d0 2024-08-25T23:53:41.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.168+0000 7ff5a9800640 1 -- 172.21.15.42:0/680620708 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a419ec30 con 0x7ff5a41074d0 2024-08-25T23:53:41.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.169+0000 7ff59b400640 1 -- 172.21.15.42:0/680620708 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff59403b3f0 con 0x7ff5a41074d0 2024-08-25T23:53:41.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.169+0000 7ff5a9800640 1 -- 172.21.15.42:0/680620708 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5a4107950 con 0x7ff5a41074d0 2024-08-25T23:53:41.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.170+0000 7ff59b400640 1 --2- 172.21.15.42:0/680620708 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff5880390c0 0x7ff58803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:41.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.170+0000 7ff59b400640 1 -- 172.21.15.42:0/680620708 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff59406c6d0 con 0x7ff5a41074d0 2024-08-25T23:53:41.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.170+0000 7ff59be00640 1 --2- 172.21.15.42:0/680620708 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff5880390c0 0x7ff58803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:41.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.171+0000 7ff59be00640 1 --2- 172.21.15.42:0/680620708 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff5880390c0 0x7ff58803b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0098c0 tx=0x7ff58c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:41.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.175+0000 7ff59b400640 1 -- 172.21.15.42:0/680620708 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff5940313a0 con 0x7ff5a41074d0 2024-08-25T23:53:41.063 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.452+0000 7ff5a9800640 1 -- 172.21.15.42:0/680620708 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7ff5a402d6a0 con 0x7ff5a41074d0 2024-08-25T23:53:41.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.454+0000 7ff59b400640 1 -- 172.21.15.42:0/680620708 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7ff594038250 con 0x7ff5a41074d0 2024-08-25T23:53:41.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-08-25T23:53:41.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.457+0000 7ff5a9800640 1 -- 172.21.15.42:0/680620708 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff5880390c0 msgr2=0x7ff58803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:41.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.457+0000 7ff5a9800640 1 --2- 172.21.15.42:0/680620708 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff5880390c0 0x7ff58803b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0098c0 tx=0x7ff58c006db0 comp rx=0 tx=0).stop 2024-08-25T23:53:41.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.457+0000 7ff5a9800640 1 -- 172.21.15.42:0/680620708 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5a41074d0 msgr2=0x7ff5a419b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:41.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.457+0000 7ff5a9800640 1 --2- 172.21.15.42:0/680620708 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5a41074d0 0x7ff5a419b770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff5940097f0 tx=0x7ff5940327b0 comp rx=0 tx=0).stop 2024-08-25T23:53:41.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.457+0000 7ff5a9800640 1 -- 172.21.15.42:0/680620708 shutdown_connections 2024-08-25T23:53:41.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.457+0000 7ff5a9800640 1 --2- 172.21.15.42:0/680620708 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff5880390c0 0x7ff58803b580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:41.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.457+0000 7ff5a9800640 1 --2- 172.21.15.42:0/680620708 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5a41074d0 0x7ff5a419b770 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:41.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.457+0000 7ff5a9800640 1 -- 172.21.15.42:0/680620708 >> 172.21.15.42:0/680620708 conn(0x7ff5a4102ca0 msgr2=0x7ff5a4103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:41.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.457+0000 7ff5a9800640 1 -- 172.21.15.42:0/680620708 shutdown_connections 2024-08-25T23:53:41.064 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr 2024-08-25T23:53:40.457+0000 7ff5a9800640 1 -- 172.21.15.42:0/680620708 wait complete. 2024-08-25T23:53:41.065 INFO:teuthology.orchestra.run.smithi042.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-08-25T23:53:41.065 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:53:41.065 INFO:teuthology.orchestra.run.smithi042.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-08-25T23:53:41.065 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:53:41.065 INFO:teuthology.orchestra.run.smithi042.stdout:Or, if you are only running a single cluster on this host: 2024-08-25T23:53:41.065 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:53:41.065 INFO:teuthology.orchestra.run.smithi042.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-08-25T23:53:41.065 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:53:41.065 INFO:teuthology.orchestra.run.smithi042.stdout:Please consider enabling telemetry to help improve Ceph: 2024-08-25T23:53:41.065 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:53:41.065 INFO:teuthology.orchestra.run.smithi042.stdout: ceph telemetry on 2024-08-25T23:53:41.065 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:53:41.065 INFO:teuthology.orchestra.run.smithi042.stdout:For more information see: 2024-08-25T23:53:41.066 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:53:41.066 INFO:teuthology.orchestra.run.smithi042.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-08-25T23:53:41.066 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:53:41.066 INFO:teuthology.orchestra.run.smithi042.stdout:Bootstrap complete. 2024-08-25T23:53:41.116 INFO:tasks.cephadm:Fetching config... 2024-08-25T23:53:41.116 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-25T23:53:41.116 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-08-25T23:53:41.152 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-08-25T23:53:41.152 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-25T23:53:41.152 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-08-25T23:53:41.229 INFO:tasks.cephadm:Fetching mon keyring... 2024-08-25T23:53:41.229 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-25T23:53:41.229 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/keyring of=/dev/stdout 2024-08-25T23:53:41.329 INFO:tasks.cephadm:Fetching pub ssh key... 2024-08-25T23:53:41.330 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-25T23:53:41.330 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-08-25T23:53:41.405 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-08-25T23:53:41.405 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCc6H2xrq43AbbGD7ydWJWnCEDzsSM6ubxngy7mH2CBm07Aqhw3kt8gaK9hbveE60Ic5wr1VTUly53Y3aqgufrJK9AbpZMR47UCZOvbCXuZlXI6Bo5JgjHvW2rhx5DA3OFbzVjMiIt3zgt0/as/DIG8LDKcyYvw7U7oYUn2cQpTgYHZKWdjWS95j7sJrEwjvPsjxEAQT9vcnckJsYyASYx1EgRBSUmN34w0cT+DSE0iKn6g1qK6D2X7glcGhzZYXhcZHpYaHyLEw4ynNRp7ih73icGpOt1zCRDAfkF4d/Yox9LPF20S6xYxT2Ph0h9Vh0zmdbdqy3e9HzD2eB898s/VUStExxtXTHQfqvR0IXrtY98oHd7N31evbhNVaN4FxL/WFoCGhqw3GAuXuk4VvyZSG0jJSmvrXSq26Nl0gKkIC0bIucXVUrEVY3nIffyZcURwnAKDRqPUGWYFgaBQd1YEkP2A3GR7TMUFSdkyuZotsp7otkr7KaGBuS5fR76/f4E= ceph-f89d317a-633c-11ef-bcd2-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-25T23:53:41.526 INFO:teuthology.orchestra.run.smithi042.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCc6H2xrq43AbbGD7ydWJWnCEDzsSM6ubxngy7mH2CBm07Aqhw3kt8gaK9hbveE60Ic5wr1VTUly53Y3aqgufrJK9AbpZMR47UCZOvbCXuZlXI6Bo5JgjHvW2rhx5DA3OFbzVjMiIt3zgt0/as/DIG8LDKcyYvw7U7oYUn2cQpTgYHZKWdjWS95j7sJrEwjvPsjxEAQT9vcnckJsYyASYx1EgRBSUmN34w0cT+DSE0iKn6g1qK6D2X7glcGhzZYXhcZHpYaHyLEw4ynNRp7ih73icGpOt1zCRDAfkF4d/Yox9LPF20S6xYxT2Ph0h9Vh0zmdbdqy3e9HzD2eB898s/VUStExxtXTHQfqvR0IXrtY98oHd7N31evbhNVaN4FxL/WFoCGhqw3GAuXuk4VvyZSG0jJSmvrXSq26Nl0gKkIC0bIucXVUrEVY3nIffyZcURwnAKDRqPUGWYFgaBQd1YEkP2A3GR7TMUFSdkyuZotsp7otkr7KaGBuS5fR76/f4E= ceph-f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:53:41.551 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCc6H2xrq43AbbGD7ydWJWnCEDzsSM6ubxngy7mH2CBm07Aqhw3kt8gaK9hbveE60Ic5wr1VTUly53Y3aqgufrJK9AbpZMR47UCZOvbCXuZlXI6Bo5JgjHvW2rhx5DA3OFbzVjMiIt3zgt0/as/DIG8LDKcyYvw7U7oYUn2cQpTgYHZKWdjWS95j7sJrEwjvPsjxEAQT9vcnckJsYyASYx1EgRBSUmN34w0cT+DSE0iKn6g1qK6D2X7glcGhzZYXhcZHpYaHyLEw4ynNRp7ih73icGpOt1zCRDAfkF4d/Yox9LPF20S6xYxT2Ph0h9Vh0zmdbdqy3e9HzD2eB898s/VUStExxtXTHQfqvR0IXrtY98oHd7N31evbhNVaN4FxL/WFoCGhqw3GAuXuk4VvyZSG0jJSmvrXSq26Nl0gKkIC0bIucXVUrEVY3nIffyZcURwnAKDRqPUGWYFgaBQd1YEkP2A3GR7TMUFSdkyuZotsp7otkr7KaGBuS5fR76/f4E= ceph-f89d317a-633c-11ef-bcd2-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-25T23:53:41.592 INFO:teuthology.orchestra.run.smithi043.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCc6H2xrq43AbbGD7ydWJWnCEDzsSM6ubxngy7mH2CBm07Aqhw3kt8gaK9hbveE60Ic5wr1VTUly53Y3aqgufrJK9AbpZMR47UCZOvbCXuZlXI6Bo5JgjHvW2rhx5DA3OFbzVjMiIt3zgt0/as/DIG8LDKcyYvw7U7oYUn2cQpTgYHZKWdjWS95j7sJrEwjvPsjxEAQT9vcnckJsYyASYx1EgRBSUmN34w0cT+DSE0iKn6g1qK6D2X7glcGhzZYXhcZHpYaHyLEw4ynNRp7ih73icGpOt1zCRDAfkF4d/Yox9LPF20S6xYxT2Ph0h9Vh0zmdbdqy3e9HzD2eB898s/VUStExxtXTHQfqvR0IXrtY98oHd7N31evbhNVaN4FxL/WFoCGhqw3GAuXuk4VvyZSG0jJSmvrXSq26Nl0gKkIC0bIucXVUrEVY3nIffyZcURwnAKDRqPUGWYFgaBQd1YEkP2A3GR7TMUFSdkyuZotsp7otkr7KaGBuS5fR76/f4E= ceph-f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:53:41.604 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCc6H2xrq43AbbGD7ydWJWnCEDzsSM6ubxngy7mH2CBm07Aqhw3kt8gaK9hbveE60Ic5wr1VTUly53Y3aqgufrJK9AbpZMR47UCZOvbCXuZlXI6Bo5JgjHvW2rhx5DA3OFbzVjMiIt3zgt0/as/DIG8LDKcyYvw7U7oYUn2cQpTgYHZKWdjWS95j7sJrEwjvPsjxEAQT9vcnckJsYyASYx1EgRBSUmN34w0cT+DSE0iKn6g1qK6D2X7glcGhzZYXhcZHpYaHyLEw4ynNRp7ih73icGpOt1zCRDAfkF4d/Yox9LPF20S6xYxT2Ph0h9Vh0zmdbdqy3e9HzD2eB898s/VUStExxtXTHQfqvR0IXrtY98oHd7N31evbhNVaN4FxL/WFoCGhqw3GAuXuk4VvyZSG0jJSmvrXSq26Nl0gKkIC0bIucXVUrEVY3nIffyZcURwnAKDRqPUGWYFgaBQd1YEkP2A3GR7TMUFSdkyuZotsp7otkr7KaGBuS5fR76/f4E= ceph-f89d317a-633c-11ef-bcd2-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-25T23:53:41.647 INFO:teuthology.orchestra.run.smithi181.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCc6H2xrq43AbbGD7ydWJWnCEDzsSM6ubxngy7mH2CBm07Aqhw3kt8gaK9hbveE60Ic5wr1VTUly53Y3aqgufrJK9AbpZMR47UCZOvbCXuZlXI6Bo5JgjHvW2rhx5DA3OFbzVjMiIt3zgt0/as/DIG8LDKcyYvw7U7oYUn2cQpTgYHZKWdjWS95j7sJrEwjvPsjxEAQT9vcnckJsYyASYx1EgRBSUmN34w0cT+DSE0iKn6g1qK6D2X7glcGhzZYXhcZHpYaHyLEw4ynNRp7ih73icGpOt1zCRDAfkF4d/Yox9LPF20S6xYxT2Ph0h9Vh0zmdbdqy3e9HzD2eB898s/VUStExxtXTHQfqvR0IXrtY98oHd7N31evbhNVaN4FxL/WFoCGhqw3GAuXuk4VvyZSG0jJSmvrXSq26Nl0gKkIC0bIucXVUrEVY3nIffyZcURwnAKDRqPUGWYFgaBQd1YEkP2A3GR7TMUFSdkyuZotsp7otkr7KaGBuS5fR76/f4E= ceph-f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:53:41.659 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-08-25T23:53:41.707 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:41 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/680620708' entity='client.admin' 2024-08-25T23:53:42.045 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:53:42.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.625+0000 7eff44800640 1 -- 172.21.15.42:0/1731372420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff3c103590 msgr2=0x7eff3c103990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:42.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.625+0000 7eff44800640 1 --2- 172.21.15.42:0/1731372420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff3c103590 0x7eff3c103990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7eff30009880 tx=0x7eff3002a5d0 comp rx=0 tx=0).stop 2024-08-25T23:53:42.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.625+0000 7eff44800640 1 -- 172.21.15.42:0/1731372420 shutdown_connections 2024-08-25T23:53:42.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.625+0000 7eff44800640 1 --2- 172.21.15.42:0/1731372420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff3c103590 0x7eff3c103990 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:42.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.625+0000 7eff44800640 1 -- 172.21.15.42:0/1731372420 >> 172.21.15.42:0/1731372420 conn(0x7eff3c0fed60 msgr2=0x7eff3c1011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:42.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.625+0000 7eff44800640 1 -- 172.21.15.42:0/1731372420 shutdown_connections 2024-08-25T23:53:42.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.625+0000 7eff44800640 1 -- 172.21.15.42:0/1731372420 wait complete. 2024-08-25T23:53:42.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.626+0000 7eff44800640 1 Processor -- start 2024-08-25T23:53:42.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.626+0000 7eff44800640 1 -- start start 2024-08-25T23:53:42.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.626+0000 7eff44800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff3c103590 0x7eff3c198cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:42.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.626+0000 7eff44800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7eff3c1096a0 con 0x7eff3c103590 2024-08-25T23:53:42.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.627+0000 7eff41e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff3c103590 0x7eff3c198cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:42.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.627+0000 7eff41e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff3c103590 0x7eff3c198cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35646/0 (socket says 172.21.15.42:35646) 2024-08-25T23:53:42.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.627+0000 7eff41e00640 1 -- 172.21.15.42:0/1450023651 learned_addr learned my addr 172.21.15.42:0/1450023651 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:42.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.627+0000 7eff41e00640 1 -- 172.21.15.42:0/1450023651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3c199210 con 0x7eff3c103590 2024-08-25T23:53:42.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.627+0000 7eff41e00640 1 --2- 172.21.15.42:0/1450023651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff3c103590 0x7eff3c198cd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7eff30004f60 tx=0x7eff300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:42.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.628+0000 7eff36a00640 1 -- 172.21.15.42:0/1450023651 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff3003f070 con 0x7eff3c103590 2024-08-25T23:53:42.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.628+0000 7eff44800640 1 -- 172.21.15.42:0/1450023651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff3c1994a0 con 0x7eff3c103590 2024-08-25T23:53:42.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.628+0000 7eff44800640 1 -- 172.21.15.42:0/1450023651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff3c19c180 con 0x7eff3c103590 2024-08-25T23:53:42.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.628+0000 7eff36a00640 1 -- 172.21.15.42:0/1450023651 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff30004d40 con 0x7eff3c103590 2024-08-25T23:53:42.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.628+0000 7eff36a00640 1 -- 172.21.15.42:0/1450023651 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff30049060 con 0x7eff3c103590 2024-08-25T23:53:42.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.629+0000 7eff36a00640 1 -- 172.21.15.42:0/1450023651 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7eff30042070 con 0x7eff3c103590 2024-08-25T23:53:42.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.630+0000 7eff36a00640 1 --2- 172.21.15.42:0/1450023651 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7eff240390c0 0x7eff2403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:42.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.629+0000 7eff44800640 1 -- 172.21.15.42:0/1450023651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff200052c0 con 0x7eff3c103590 2024-08-25T23:53:42.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.630+0000 7eff36a00640 1 -- 172.21.15.42:0/1450023651 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7eff3006cda0 con 0x7eff3c103590 2024-08-25T23:53:42.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.630+0000 7eff41400640 1 --2- 172.21.15.42:0/1450023651 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7eff240390c0 0x7eff2403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:42.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.631+0000 7eff41400640 1 --2- 172.21.15.42:0/1450023651 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7eff240390c0 0x7eff2403b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0098c0 tx=0x7eff2c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:42.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.635+0000 7eff36a00640 1 -- 172.21.15.42:0/1450023651 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7eff30039b70 con 0x7eff3c103590 2024-08-25T23:53:42.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.834+0000 7eff44800640 1 -- 172.21.15.42:0/1450023651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7eff200055b0 con 0x7eff3c103590 2024-08-25T23:53:42.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.837+0000 7eff36a00640 1 -- 172.21.15.42:0/1450023651 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7eff30042360 con 0x7eff3c103590 2024-08-25T23:53:42.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.839+0000 7eff44800640 1 -- 172.21.15.42:0/1450023651 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7eff240390c0 msgr2=0x7eff2403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:42.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.839+0000 7eff44800640 1 --2- 172.21.15.42:0/1450023651 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7eff240390c0 0x7eff2403b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0098c0 tx=0x7eff2c006db0 comp rx=0 tx=0).stop 2024-08-25T23:53:42.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.839+0000 7eff44800640 1 -- 172.21.15.42:0/1450023651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff3c103590 msgr2=0x7eff3c198cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:42.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.839+0000 7eff44800640 1 --2- 172.21.15.42:0/1450023651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff3c103590 0x7eff3c198cd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7eff30004f60 tx=0x7eff300048f0 comp rx=0 tx=0).stop 2024-08-25T23:53:42.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.839+0000 7eff44800640 1 -- 172.21.15.42:0/1450023651 shutdown_connections 2024-08-25T23:53:42.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.839+0000 7eff44800640 1 --2- 172.21.15.42:0/1450023651 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7eff240390c0 0x7eff2403b580 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:42.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.840+0000 7eff44800640 1 --2- 172.21.15.42:0/1450023651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff3c103590 0x7eff3c198cd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:42.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.840+0000 7eff44800640 1 -- 172.21.15.42:0/1450023651 >> 172.21.15.42:0/1450023651 conn(0x7eff3c0fed60 msgr2=0x7eff3c0ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:42.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.840+0000 7eff44800640 1 -- 172.21.15.42:0/1450023651 shutdown_connections 2024-08-25T23:53:42.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:42.840+0000 7eff44800640 1 -- 172.21.15.42:0/1450023651 wait complete. 2024-08-25T23:53:43.458 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-08-25T23:53:43.458 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-08-25T23:53:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:53:44.182 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:43 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1450023651' entity='client.admin' 2024-08-25T23:53:44.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.879+0000 7fccfda00640 1 -- 172.21.15.42:0/19787089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccf81033e0 msgr2=0x7fccf81037e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:44.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.879+0000 7fccfda00640 1 --2- 172.21.15.42:0/19787089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccf81033e0 0x7fccf81037e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcce8009880 tx=0x7fcce802a5d0 comp rx=0 tx=0).stop 2024-08-25T23:53:44.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.879+0000 7fccfda00640 1 -- 172.21.15.42:0/19787089 shutdown_connections 2024-08-25T23:53:44.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.879+0000 7fccfda00640 1 --2- 172.21.15.42:0/19787089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccf81033e0 0x7fccf81037e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:44.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.879+0000 7fccfda00640 1 -- 172.21.15.42:0/19787089 >> 172.21.15.42:0/19787089 conn(0x7fccf80feb70 msgr2=0x7fccf8100fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:44.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.879+0000 7fccfda00640 1 -- 172.21.15.42:0/19787089 shutdown_connections 2024-08-25T23:53:44.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.879+0000 7fccfda00640 1 -- 172.21.15.42:0/19787089 wait complete. 2024-08-25T23:53:44.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.880+0000 7fccfda00640 1 Processor -- start 2024-08-25T23:53:44.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.880+0000 7fccfda00640 1 -- start start 2024-08-25T23:53:44.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.881+0000 7fccfda00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccf81033e0 0x7fccf8198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:44.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.881+0000 7fccfda00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fccf81094f0 con 0x7fccf81033e0 2024-08-25T23:53:44.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.881+0000 7fccf7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccf81033e0 0x7fccf8198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:44.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.881+0000 7fccf7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccf81033e0 0x7fccf8198ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50238/0 (socket says 172.21.15.42:50238) 2024-08-25T23:53:44.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.881+0000 7fccf7e00640 1 -- 172.21.15.42:0/436140146 learned_addr learned my addr 172.21.15.42:0/436140146 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:44.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.881+0000 7fccf7e00640 1 -- 172.21.15.42:0/436140146 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf81990e0 con 0x7fccf81033e0 2024-08-25T23:53:44.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.882+0000 7fccf7e00640 1 --2- 172.21.15.42:0/436140146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccf81033e0 0x7fccf8198ba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcce8004f60 tx=0x7fcce80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:44.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.882+0000 7fccf4c00640 1 -- 172.21.15.42:0/436140146 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce803f070 con 0x7fccf81033e0 2024-08-25T23:53:44.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.882+0000 7fccf4c00640 1 -- 172.21.15.42:0/436140146 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcce8004cc0 con 0x7fccf81033e0 2024-08-25T23:53:44.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.882+0000 7fccfda00640 1 -- 172.21.15.42:0/436140146 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf8199370 con 0x7fccf81033e0 2024-08-25T23:53:44.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.882+0000 7fccf4c00640 1 -- 172.21.15.42:0/436140146 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce8035030 con 0x7fccf81033e0 2024-08-25T23:53:44.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.882+0000 7fccfda00640 1 -- 172.21.15.42:0/436140146 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf819c060 con 0x7fccf81033e0 2024-08-25T23:53:44.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.883+0000 7fccf4c00640 1 -- 172.21.15.42:0/436140146 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fcce8042070 con 0x7fccf81033e0 2024-08-25T23:53:44.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.883+0000 7fccfda00640 1 -- 172.21.15.42:0/436140146 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccf8109c70 con 0x7fccf81033e0 2024-08-25T23:53:44.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.883+0000 7fccf4c00640 1 --2- 172.21.15.42:0/436140146 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fccdc0390c0 0x7fccdc03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:44.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.884+0000 7fccf4c00640 1 -- 172.21.15.42:0/436140146 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcce806ce20 con 0x7fccf81033e0 2024-08-25T23:53:44.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.884+0000 7fccf7400640 1 --2- 172.21.15.42:0/436140146 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fccdc0390c0 0x7fccdc03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:44.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.884+0000 7fccf7400640 1 --2- 172.21.15.42:0/436140146 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fccdc0390c0 0x7fccdc03b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcce40098c0 tx=0x7fcce4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:44.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:44.889+0000 7fccf4c00640 1 -- 172.21.15.42:0/436140146 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fcce80433b0 con 0x7fccf81033e0 2024-08-25T23:53:45.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:45.080+0000 7fccfda00640 1 -- 172.21.15.42:0/436140146 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fccf802d710 con 0x7fccdc0390c0 2024-08-25T23:53:45.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:45.084+0000 7fccf4c00640 1 -- 172.21.15.42:0/436140146 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fccf802d710 con 0x7fccdc0390c0 2024-08-25T23:53:45.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:45.086+0000 7fccfda00640 1 -- 172.21.15.42:0/436140146 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fccdc0390c0 msgr2=0x7fccdc03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:45.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:45.086+0000 7fccfda00640 1 --2- 172.21.15.42:0/436140146 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fccdc0390c0 0x7fccdc03b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcce40098c0 tx=0x7fcce4006db0 comp rx=0 tx=0).stop 2024-08-25T23:53:45.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:45.086+0000 7fccfda00640 1 -- 172.21.15.42:0/436140146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccf81033e0 msgr2=0x7fccf8198ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:45.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:45.086+0000 7fccfda00640 1 --2- 172.21.15.42:0/436140146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccf81033e0 0x7fccf8198ba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcce8004f60 tx=0x7fcce80048f0 comp rx=0 tx=0).stop 2024-08-25T23:53:45.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:45.086+0000 7fccfda00640 1 -- 172.21.15.42:0/436140146 shutdown_connections 2024-08-25T23:53:45.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:45.086+0000 7fccfda00640 1 --2- 172.21.15.42:0/436140146 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fccdc0390c0 0x7fccdc03b580 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:45.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:45.086+0000 7fccfda00640 1 --2- 172.21.15.42:0/436140146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccf81033e0 0x7fccf8198ba0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:45.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:45.086+0000 7fccfda00640 1 -- 172.21.15.42:0/436140146 >> 172.21.15.42:0/436140146 conn(0x7fccf80feb70 msgr2=0x7fccf80ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:45.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:45.087+0000 7fccfda00640 1 -- 172.21.15.42:0/436140146 shutdown_connections 2024-08-25T23:53:45.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:45.087+0000 7fccfda00640 1 -- 172.21.15.42:0/436140146 wait complete. 2024-08-25T23:53:45.797 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi043 2024-08-25T23:53:45.797 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-08-25T23:53:45.798 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/etc/ceph/ceph.conf 2024-08-25T23:53:45.817 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-08-25T23:53:45.817 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-25T23:53:45.875 INFO:tasks.cephadm:Adding host smithi043 to orchestrator... 2024-08-25T23:53:45.875 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph orch host add smithi043 2024-08-25T23:53:46.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:46 smithi042 ceph-mon[17225]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:53:46.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:46 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:46.435 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:53:47.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.049+0000 7f83d4600640 1 -- 172.21.15.42:0/2546519404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83cc1013a0 msgr2=0x7f83cc1017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:47.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.049+0000 7f83d4600640 1 --2- 172.21.15.42:0/2546519404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83cc1013a0 0x7f83cc1017a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009880 tx=0x7f83c002a5d0 comp rx=0 tx=0).stop 2024-08-25T23:53:47.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.049+0000 7f83d4600640 1 -- 172.21.15.42:0/2546519404 shutdown_connections 2024-08-25T23:53:47.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.049+0000 7f83d4600640 1 --2- 172.21.15.42:0/2546519404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83cc1013a0 0x7f83cc1017a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:47.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.049+0000 7f83d4600640 1 -- 172.21.15.42:0/2546519404 >> 172.21.15.42:0/2546519404 conn(0x7f83cc0fcb50 msgr2=0x7f83cc0fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:47.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.050+0000 7f83d4600640 1 -- 172.21.15.42:0/2546519404 shutdown_connections 2024-08-25T23:53:47.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.050+0000 7f83d4600640 1 -- 172.21.15.42:0/2546519404 wait complete. 2024-08-25T23:53:47.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.051+0000 7f83d4600640 1 Processor -- start 2024-08-25T23:53:47.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.051+0000 7f83d4600640 1 -- start start 2024-08-25T23:53:47.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.051+0000 7f83d4600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83cc1013a0 0x7f83cc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:47.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.051+0000 7f83d4600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc1074b0 con 0x7f83cc1013a0 2024-08-25T23:53:47.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.051+0000 7f83d1c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83cc1013a0 0x7f83cc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:47.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.051+0000 7f83d1c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83cc1013a0 0x7f83cc075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50252/0 (socket says 172.21.15.42:50252) 2024-08-25T23:53:47.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.051+0000 7f83d1c00640 1 -- 172.21.15.42:0/3009148910 learned_addr learned my addr 172.21.15.42:0/3009148910 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:47.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.052+0000 7f83d1c00640 1 -- 172.21.15.42:0/3009148910 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83cc076190 con 0x7f83cc1013a0 2024-08-25T23:53:47.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.052+0000 7f83d1c00640 1 --2- 172.21.15.42:0/3009148910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83cc1013a0 0x7f83cc075c50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f83c0004f60 tx=0x7f83c00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:47.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.052+0000 7f83ca000640 1 -- 172.21.15.42:0/3009148910 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c003f070 con 0x7f83cc1013a0 2024-08-25T23:53:47.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.052+0000 7f83ca000640 1 -- 172.21.15.42:0/3009148910 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83c0004cc0 con 0x7f83cc1013a0 2024-08-25T23:53:47.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.052+0000 7f83ca000640 1 -- 172.21.15.42:0/3009148910 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c0035030 con 0x7f83cc1013a0 2024-08-25T23:53:47.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.052+0000 7f83d4600640 1 -- 172.21.15.42:0/3009148910 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83cc074380 con 0x7f83cc1013a0 2024-08-25T23:53:47.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.053+0000 7f83d4600640 1 -- 172.21.15.42:0/3009148910 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83cc0748c0 con 0x7f83cc1013a0 2024-08-25T23:53:47.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.054+0000 7f83ca000640 1 -- 172.21.15.42:0/3009148910 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f83c0042070 con 0x7f83cc1013a0 2024-08-25T23:53:47.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.054+0000 7f83d4600640 1 -- 172.21.15.42:0/3009148910 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83cc107c30 con 0x7f83cc1013a0 2024-08-25T23:53:47.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.054+0000 7f83ca000640 1 --2- 172.21.15.42:0/3009148910 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f83b40390c0 0x7f83b403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:47.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.054+0000 7f83ca000640 1 -- 172.21.15.42:0/3009148910 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f83c006cd10 con 0x7f83cc1013a0 2024-08-25T23:53:47.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.055+0000 7f83d1200640 1 --2- 172.21.15.42:0/3009148910 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f83b40390c0 0x7f83b403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:47.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.055+0000 7f83d1200640 1 --2- 172.21.15.42:0/3009148910 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f83b40390c0 0x7f83b403b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f83b80098c0 tx=0x7f83b8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:47.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.060+0000 7f83ca000640 1 -- 172.21.15.42:0/3009148910 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f83c0040260 con 0x7f83cc1013a0 2024-08-25T23:53:47.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:47.254+0000 7f83d4600640 1 -- 172.21.15.42:0/3009148910 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi043", "target": ["mon-mgr", ""]}) -- 0x7f83cc18ff50 con 0x7f83b40390c0 2024-08-25T23:53:47.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:47 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:47.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:47 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:47.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:47 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi042", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:53:47.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:47 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:53:47.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:47 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:53:47.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:47 smithi042 ceph-mon[17225]: Updating smithi042:/etc/ceph/ceph.conf 2024-08-25T23:53:47.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:47 smithi042 ceph-mon[17225]: Updating smithi042:/var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/config/ceph.conf 2024-08-25T23:53:47.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:47 smithi042 ceph-mon[17225]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi043", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:53:49.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:49 smithi042 ceph-mon[17225]: Updating smithi042:/etc/ceph/ceph.client.admin.keyring 2024-08-25T23:53:49.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:49 smithi042 ceph-mon[17225]: Updating smithi042:/var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/config/ceph.client.admin.keyring 2024-08-25T23:53:49.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:49 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:49.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:49 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:49.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:49 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:49.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:49 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:53:49.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:49 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:53:49.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:49 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:53:49.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:49 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:50.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:50 smithi042 ceph-mon[17225]: Deploying cephadm binary to smithi043 2024-08-25T23:53:51.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:51.174+0000 7f83ca000640 1 -- 172.21.15.42:0/3009148910 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f83cc18ff50 con 0x7f83b40390c0 2024-08-25T23:53:51.176 INFO:teuthology.orchestra.run.smithi042.stdout:Added host 'smithi043' with addr '172.21.15.43' 2024-08-25T23:53:51.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:51.178+0000 7f83d4600640 1 -- 172.21.15.42:0/3009148910 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f83b40390c0 msgr2=0x7f83b403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:51.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:51.178+0000 7f83d4600640 1 --2- 172.21.15.42:0/3009148910 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f83b40390c0 0x7f83b403b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f83b80098c0 tx=0x7f83b8006db0 comp rx=0 tx=0).stop 2024-08-25T23:53:51.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:51.178+0000 7f83d4600640 1 -- 172.21.15.42:0/3009148910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83cc1013a0 msgr2=0x7f83cc075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:51.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:51.178+0000 7f83d4600640 1 --2- 172.21.15.42:0/3009148910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83cc1013a0 0x7f83cc075c50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f83c0004f60 tx=0x7f83c00048f0 comp rx=0 tx=0).stop 2024-08-25T23:53:51.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:51.178+0000 7f83d4600640 1 -- 172.21.15.42:0/3009148910 shutdown_connections 2024-08-25T23:53:51.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:51.178+0000 7f83d4600640 1 --2- 172.21.15.42:0/3009148910 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f83b40390c0 0x7f83b403b580 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:51.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:51.178+0000 7f83d4600640 1 --2- 172.21.15.42:0/3009148910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83cc1013a0 0x7f83cc075c50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:51.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:51.178+0000 7f83d4600640 1 -- 172.21.15.42:0/3009148910 >> 172.21.15.42:0/3009148910 conn(0x7f83cc0fcb50 msgr2=0x7f83cc0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:51.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:51.178+0000 7f83d4600640 1 -- 172.21.15.42:0/3009148910 shutdown_connections 2024-08-25T23:53:51.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:51.178+0000 7f83d4600640 1 -- 172.21.15.42:0/3009148910 wait complete. 2024-08-25T23:53:51.800 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph orch host ls --format=json 2024-08-25T23:53:52.164 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:53:52.427 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:52 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:52.427 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:52 smithi042 ceph-mon[17225]: Added host smithi043 2024-08-25T23:53:52.427 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:52 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:53:52.427 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:52 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:52.427 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:52 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:52.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.669+0000 7ff19ce00640 1 -- 172.21.15.42:0/1881804373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1981013a0 msgr2=0x7ff198101780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:52.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.669+0000 7ff19ce00640 1 --2- 172.21.15.42:0/1881804373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1981013a0 0x7ff198101780 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff188009880 tx=0x7ff18802a5d0 comp rx=0 tx=0).stop 2024-08-25T23:53:52.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.670+0000 7ff19ce00640 1 -- 172.21.15.42:0/1881804373 shutdown_connections 2024-08-25T23:53:52.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.670+0000 7ff19ce00640 1 --2- 172.21.15.42:0/1881804373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1981013a0 0x7ff198101780 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:52.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.670+0000 7ff19ce00640 1 -- 172.21.15.42:0/1881804373 >> 172.21.15.42:0/1881804373 conn(0x7ff198078010 msgr2=0x7ff1980ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:52.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.670+0000 7ff19ce00640 1 -- 172.21.15.42:0/1881804373 shutdown_connections 2024-08-25T23:53:52.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.670+0000 7ff19ce00640 1 -- 172.21.15.42:0/1881804373 wait complete. 2024-08-25T23:53:52.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.671+0000 7ff19ce00640 1 Processor -- start 2024-08-25T23:53:52.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.671+0000 7ff19ce00640 1 -- start start 2024-08-25T23:53:52.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.671+0000 7ff19ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1981013a0 0x7ff198196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:52.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.671+0000 7ff19ce00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff19810b900 con 0x7ff1981013a0 2024-08-25T23:53:52.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.671+0000 7ff197400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1981013a0 0x7ff198196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:52.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.671+0000 7ff197400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1981013a0 0x7ff198196ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50262/0 (socket says 172.21.15.42:50262) 2024-08-25T23:53:52.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.671+0000 7ff197400640 1 -- 172.21.15.42:0/27131880 learned_addr learned my addr 172.21.15.42:0/27131880 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:52.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.672+0000 7ff197400640 1 -- 172.21.15.42:0/27131880 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff198197400 con 0x7ff1981013a0 2024-08-25T23:53:52.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.672+0000 7ff197400640 1 --2- 172.21.15.42:0/27131880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1981013a0 0x7ff198196ec0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff188009230 tx=0x7ff188003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:52.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.672+0000 7ff18fe00640 1 -- 172.21.15.42:0/27131880 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff18803f070 con 0x7ff1981013a0 2024-08-25T23:53:52.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.672+0000 7ff18fe00640 1 -- 172.21.15.42:0/27131880 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff18803bc80 con 0x7ff1981013a0 2024-08-25T23:53:52.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.672+0000 7ff18fe00640 1 -- 172.21.15.42:0/27131880 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff188035030 con 0x7ff1981013a0 2024-08-25T23:53:52.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.672+0000 7ff19ce00640 1 -- 172.21.15.42:0/27131880 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1981976f0 con 0x7ff1981013a0 2024-08-25T23:53:52.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.673+0000 7ff19ce00640 1 -- 172.21.15.42:0/27131880 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff19819b790 con 0x7ff1981013a0 2024-08-25T23:53:52.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.674+0000 7ff18fe00640 1 -- 172.21.15.42:0/27131880 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff188042070 con 0x7ff1981013a0 2024-08-25T23:53:52.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.674+0000 7ff19ce00640 1 -- 172.21.15.42:0/27131880 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff198102880 con 0x7ff1981013a0 2024-08-25T23:53:52.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.674+0000 7ff18fe00640 1 --2- 172.21.15.42:0/27131880 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff17c0390c0 0x7ff17c03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:52.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.674+0000 7ff18fe00640 1 -- 172.21.15.42:0/27131880 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff18806cd00 con 0x7ff1981013a0 2024-08-25T23:53:52.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.674+0000 7ff196a00640 1 --2- 172.21.15.42:0/27131880 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff17c0390c0 0x7ff17c03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:52.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.675+0000 7ff196a00640 1 --2- 172.21.15.42:0/27131880 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff17c0390c0 0x7ff17c03b580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff1840098c0 tx=0x7ff184006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:52.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.679+0000 7ff18fe00640 1 -- 172.21.15.42:0/27131880 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff1880372d0 con 0x7ff1981013a0 2024-08-25T23:53:52.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.871+0000 7ff19ce00640 1 -- 172.21.15.42:0/27131880 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff198101800 con 0x7ff17c0390c0 2024-08-25T23:53:52.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.872+0000 7ff18fe00640 1 -- 172.21.15.42:0/27131880 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7ff198101800 con 0x7ff17c0390c0 2024-08-25T23:53:52.874 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:53:52.874 INFO:teuthology.orchestra.run.smithi042.stdout:[{"addr": "172.21.15.42", "hostname": "smithi042", "labels": [], "status": ""}, {"addr": "172.21.15.43", "hostname": "smithi043", "labels": [], "status": ""}] 2024-08-25T23:53:52.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.875+0000 7ff19ce00640 1 -- 172.21.15.42:0/27131880 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff17c0390c0 msgr2=0x7ff17c03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:52.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.875+0000 7ff19ce00640 1 --2- 172.21.15.42:0/27131880 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff17c0390c0 0x7ff17c03b580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff1840098c0 tx=0x7ff184006db0 comp rx=0 tx=0).stop 2024-08-25T23:53:52.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.875+0000 7ff19ce00640 1 -- 172.21.15.42:0/27131880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1981013a0 msgr2=0x7ff198196ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:52.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.875+0000 7ff19ce00640 1 --2- 172.21.15.42:0/27131880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1981013a0 0x7ff198196ec0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff188009230 tx=0x7ff188003d40 comp rx=0 tx=0).stop 2024-08-25T23:53:52.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.875+0000 7ff19ce00640 1 -- 172.21.15.42:0/27131880 shutdown_connections 2024-08-25T23:53:52.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.875+0000 7ff19ce00640 1 --2- 172.21.15.42:0/27131880 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff17c0390c0 0x7ff17c03b580 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:52.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.875+0000 7ff19ce00640 1 --2- 172.21.15.42:0/27131880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1981013a0 0x7ff198196ec0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:52.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.875+0000 7ff19ce00640 1 -- 172.21.15.42:0/27131880 >> 172.21.15.42:0/27131880 conn(0x7ff198078010 msgr2=0x7ff198108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:52.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.875+0000 7ff19ce00640 1 -- 172.21.15.42:0/27131880 shutdown_connections 2024-08-25T23:53:52.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:52.875+0000 7ff19ce00640 1 -- 172.21.15.42:0/27131880 wait complete. 2024-08-25T23:53:53.533 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi181 2024-08-25T23:53:53.533 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-25T23:53:53.533 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/etc/ceph/ceph.conf 2024-08-25T23:53:53.552 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-25T23:53:53.552 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-25T23:53:53.610 INFO:tasks.cephadm:Adding host smithi181 to orchestrator... 2024-08-25T23:53:53.610 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph orch host add smithi181 2024-08-25T23:53:53.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:53 smithi042 ceph-mon[17225]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:53:53.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:53 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:53.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:53 smithi042 ceph-mon[17225]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-25T23:53:53.984 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:53:54.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.509+0000 7f2a5c200640 1 -- 172.21.15.42:0/2452567392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a54101570 msgr2=0x7f2a54101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:54.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.509+0000 7f2a5c200640 1 --2- 172.21.15.42:0/2452567392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a54101570 0x7f2a54101950 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2a48009880 tx=0x7f2a4802a5d0 comp rx=0 tx=0).stop 2024-08-25T23:53:54.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.509+0000 7f2a5c200640 1 -- 172.21.15.42:0/2452567392 shutdown_connections 2024-08-25T23:53:54.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.509+0000 7f2a5c200640 1 --2- 172.21.15.42:0/2452567392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a54101570 0x7f2a54101950 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:54.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.509+0000 7f2a5c200640 1 -- 172.21.15.42:0/2452567392 >> 172.21.15.42:0/2452567392 conn(0x7f2a540fcfd0 msgr2=0x7f2a540ff3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:54.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.509+0000 7f2a5c200640 1 -- 172.21.15.42:0/2452567392 shutdown_connections 2024-08-25T23:53:54.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.509+0000 7f2a5c200640 1 -- 172.21.15.42:0/2452567392 wait complete. 2024-08-25T23:53:54.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.510+0000 7f2a5c200640 1 Processor -- start 2024-08-25T23:53:54.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.510+0000 7f2a5c200640 1 -- start start 2024-08-25T23:53:54.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.510+0000 7f2a5c200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a54101570 0x7f2a54199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:54.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.510+0000 7f2a5c200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5410b9c0 con 0x7f2a54101570 2024-08-25T23:53:54.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.511+0000 7f2a59800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a54101570 0x7f2a54199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:54.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.511+0000 7f2a59800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a54101570 0x7f2a54199130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50280/0 (socket says 172.21.15.42:50280) 2024-08-25T23:53:54.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.511+0000 7f2a59800640 1 -- 172.21.15.42:0/317731171 learned_addr learned my addr 172.21.15.42:0/317731171 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:53:54.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.511+0000 7f2a59800640 1 -- 172.21.15.42:0/317731171 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a54199670 con 0x7f2a54101570 2024-08-25T23:53:54.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.511+0000 7f2a59800640 1 --2- 172.21.15.42:0/317731171 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a54101570 0x7f2a54199130 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2a48009230 tx=0x7f2a48003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:54.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.512+0000 7f2a52000640 1 -- 172.21.15.42:0/317731171 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a4803f070 con 0x7f2a54101570 2024-08-25T23:53:54.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.512+0000 7f2a52000640 1 -- 172.21.15.42:0/317731171 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a4803bd40 con 0x7f2a54101570 2024-08-25T23:53:54.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.512+0000 7f2a5c200640 1 -- 172.21.15.42:0/317731171 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a54199960 con 0x7f2a54101570 2024-08-25T23:53:54.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.512+0000 7f2a52000640 1 -- 172.21.15.42:0/317731171 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a48035030 con 0x7f2a54101570 2024-08-25T23:53:54.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.512+0000 7f2a5c200640 1 -- 172.21.15.42:0/317731171 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a5419da00 con 0x7f2a54101570 2024-08-25T23:53:54.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.513+0000 7f2a52000640 1 -- 172.21.15.42:0/317731171 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f2a48042070 con 0x7f2a54101570 2024-08-25T23:53:54.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.513+0000 7f2a5c200640 1 -- 172.21.15.42:0/317731171 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a54102a50 con 0x7f2a54101570 2024-08-25T23:53:54.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.513+0000 7f2a52000640 1 --2- 172.21.15.42:0/317731171 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f2a3c039060 0x7f2a3c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:53:54.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.513+0000 7f2a52000640 1 -- 172.21.15.42:0/317731171 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2a4806cc60 con 0x7f2a54101570 2024-08-25T23:53:54.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.514+0000 7f2a58e00640 1 --2- 172.21.15.42:0/317731171 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f2a3c039060 0x7f2a3c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:53:54.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.515+0000 7f2a58e00640 1 --2- 172.21.15.42:0/317731171 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f2a3c039060 0x7f2a3c03b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2a400098c0 tx=0x7f2a40006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:53:54.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.519+0000 7f2a52000640 1 -- 172.21.15.42:0/317731171 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f2a48041e50 con 0x7f2a54101570 2024-08-25T23:53:54.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:54.711+0000 7f2a5c200640 1 -- 172.21.15.42:0/317731171 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi181", "target": ["mon-mgr", ""]}) -- 0x7f2a54101a30 con 0x7f2a3c039060 2024-08-25T23:53:56.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:56 smithi042 ceph-mon[17225]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:53:56.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:56 smithi042 ceph-mon[17225]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi181", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:53:56.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:56.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:56.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:56.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:56.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi043", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:53:56.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:53:56.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:53:56.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:56.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:56.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:57.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:57 smithi042 ceph-mon[17225]: Updating smithi043:/etc/ceph/ceph.conf 2024-08-25T23:53:57.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:57 smithi042 ceph-mon[17225]: Updating smithi043:/var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/config/ceph.conf 2024-08-25T23:53:57.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:57 smithi042 ceph-mon[17225]: Updating smithi043:/etc/ceph/ceph.client.admin.keyring 2024-08-25T23:53:57.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:57 smithi042 ceph-mon[17225]: Deploying cephadm binary to smithi181 2024-08-25T23:53:57.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:57 smithi042 ceph-mon[17225]: Updating smithi043:/var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/config/ceph.client.admin.keyring 2024-08-25T23:53:58.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:58 smithi042 ceph-mon[17225]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:53:58.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:58.621+0000 7f2a52000640 1 -- 172.21.15.42:0/317731171 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f2a54101a30 con 0x7f2a3c039060 2024-08-25T23:53:58.622 INFO:teuthology.orchestra.run.smithi042.stdout:Added host 'smithi181' with addr '172.21.15.181' 2024-08-25T23:53:58.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:58.624+0000 7f2a5c200640 1 -- 172.21.15.42:0/317731171 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f2a3c039060 msgr2=0x7f2a3c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:58.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:58.624+0000 7f2a5c200640 1 --2- 172.21.15.42:0/317731171 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f2a3c039060 0x7f2a3c03b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2a400098c0 tx=0x7f2a40006db0 comp rx=0 tx=0).stop 2024-08-25T23:53:58.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:58.624+0000 7f2a5c200640 1 -- 172.21.15.42:0/317731171 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a54101570 msgr2=0x7f2a54199130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:53:58.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:58.624+0000 7f2a5c200640 1 --2- 172.21.15.42:0/317731171 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a54101570 0x7f2a54199130 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2a48009230 tx=0x7f2a48003d80 comp rx=0 tx=0).stop 2024-08-25T23:53:58.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:58.625+0000 7f2a5c200640 1 -- 172.21.15.42:0/317731171 shutdown_connections 2024-08-25T23:53:58.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:58.625+0000 7f2a5c200640 1 --2- 172.21.15.42:0/317731171 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f2a3c039060 0x7f2a3c03b520 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:58.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:58.625+0000 7f2a5c200640 1 --2- 172.21.15.42:0/317731171 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a54101570 0x7f2a54199130 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:53:58.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:58.625+0000 7f2a5c200640 1 -- 172.21.15.42:0/317731171 >> 172.21.15.42:0/317731171 conn(0x7f2a540fcfd0 msgr2=0x7f2a54075c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:53:58.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:58.625+0000 7f2a5c200640 1 -- 172.21.15.42:0/317731171 shutdown_connections 2024-08-25T23:53:58.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:53:58.625+0000 7f2a5c200640 1 -- 172.21.15.42:0/317731171 wait complete. 2024-08-25T23:53:59.285 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph orch host ls --format=json 2024-08-25T23:53:59.650 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:53:59.886 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:59 smithi042 ceph-mon[17225]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:53:59.886 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:59 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:59.887 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:59 smithi042 ceph-mon[17225]: Added host smithi181 2024-08-25T23:53:59.887 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:59 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:53:59.887 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:59 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:53:59.887 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:53:59 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:00.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.167+0000 7fe3fe800640 1 -- 172.21.15.42:0/2954942144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3f8101590 msgr2=0x7fe3f8101970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:00.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.167+0000 7fe3fe800640 1 --2- 172.21.15.42:0/2954942144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3f8101590 0x7fe3f8101970 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009880 tx=0x7fe3e802a5d0 comp rx=0 tx=0).stop 2024-08-25T23:54:00.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.168+0000 7fe3fe800640 1 -- 172.21.15.42:0/2954942144 shutdown_connections 2024-08-25T23:54:00.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.168+0000 7fe3fe800640 1 --2- 172.21.15.42:0/2954942144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3f8101590 0x7fe3f8101970 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:00.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.168+0000 7fe3fe800640 1 -- 172.21.15.42:0/2954942144 >> 172.21.15.42:0/2954942144 conn(0x7fe3f80fd030 msgr2=0x7fe3f80ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:54:00.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.168+0000 7fe3fe800640 1 -- 172.21.15.42:0/2954942144 shutdown_connections 2024-08-25T23:54:00.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.168+0000 7fe3fe800640 1 -- 172.21.15.42:0/2954942144 wait complete. 2024-08-25T23:54:00.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.169+0000 7fe3fe800640 1 Processor -- start 2024-08-25T23:54:00.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.169+0000 7fe3fe800640 1 -- start start 2024-08-25T23:54:00.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.170+0000 7fe3fe800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3f8101590 0x7fe3f81990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:00.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.170+0000 7fe3fe800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f810b9e0 con 0x7fe3f8101590 2024-08-25T23:54:00.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.170+0000 7fe3f7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3f8101590 0x7fe3f81990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:00.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.170+0000 7fe3f7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3f8101590 0x7fe3f81990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43136/0 (socket says 172.21.15.42:43136) 2024-08-25T23:54:00.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.170+0000 7fe3f7400640 1 -- 172.21.15.42:0/2519794224 learned_addr learned my addr 172.21.15.42:0/2519794224 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:54:00.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.170+0000 7fe3f7400640 1 -- 172.21.15.42:0/2519794224 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f81995e0 con 0x7fe3f8101590 2024-08-25T23:54:00.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.171+0000 7fe3f7400640 1 --2- 172.21.15.42:0/2519794224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3f8101590 0x7fe3f81990a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009230 tx=0x7fe3e8003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:54:00.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.171+0000 7fe3f4c00640 1 -- 172.21.15.42:0/2519794224 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e803f070 con 0x7fe3f8101590 2024-08-25T23:54:00.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.171+0000 7fe3f4c00640 1 -- 172.21.15.42:0/2519794224 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3e803bd40 con 0x7fe3f8101590 2024-08-25T23:54:00.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.171+0000 7fe3fe800640 1 -- 172.21.15.42:0/2519794224 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f81998d0 con 0x7fe3f8101590 2024-08-25T23:54:00.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.171+0000 7fe3f4c00640 1 -- 172.21.15.42:0/2519794224 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e8035030 con 0x7fe3f8101590 2024-08-25T23:54:00.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.171+0000 7fe3fe800640 1 -- 172.21.15.42:0/2519794224 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f819d970 con 0x7fe3f8101590 2024-08-25T23:54:00.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.172+0000 7fe3f4c00640 1 -- 172.21.15.42:0/2519794224 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fe3e8042070 con 0x7fe3f8101590 2024-08-25T23:54:00.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.172+0000 7fe3fe800640 1 -- 172.21.15.42:0/2519794224 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3f8102a70 con 0x7fe3f8101590 2024-08-25T23:54:00.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.173+0000 7fe3f4c00640 1 --2- 172.21.15.42:0/2519794224 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe3dc039060 0x7fe3dc03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:00.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.173+0000 7fe3f4c00640 1 -- 172.21.15.42:0/2519794224 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe3e806c910 con 0x7fe3f8101590 2024-08-25T23:54:00.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.173+0000 7fe3eea00640 1 --2- 172.21.15.42:0/2519794224 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe3dc039060 0x7fe3dc03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:00.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.174+0000 7fe3eea00640 1 --2- 172.21.15.42:0/2519794224 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe3dc039060 0x7fe3dc03b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00098c0 tx=0x7fe3e0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:54:00.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.178+0000 7fe3f4c00640 1 -- 172.21.15.42:0/2519794224 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe3e8044e10 con 0x7fe3f8101590 2024-08-25T23:54:00.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.367+0000 7fe3fe800640 1 -- 172.21.15.42:0/2519794224 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe3f81019f0 con 0x7fe3dc039060 2024-08-25T23:54:00.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.369+0000 7fe3f4c00640 1 -- 172.21.15.42:0/2519794224 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7fe3f81019f0 con 0x7fe3dc039060 2024-08-25T23:54:00.369 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:54:00.369 INFO:teuthology.orchestra.run.smithi042.stdout:[{"addr": "172.21.15.42", "hostname": "smithi042", "labels": [], "status": ""}, {"addr": "172.21.15.43", "hostname": "smithi043", "labels": [], "status": ""}, {"addr": "172.21.15.181", "hostname": "smithi181", "labels": [], "status": ""}] 2024-08-25T23:54:00.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.371+0000 7fe3fe800640 1 -- 172.21.15.42:0/2519794224 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe3dc039060 msgr2=0x7fe3dc03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:00.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.371+0000 7fe3fe800640 1 --2- 172.21.15.42:0/2519794224 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe3dc039060 0x7fe3dc03b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00098c0 tx=0x7fe3e0006db0 comp rx=0 tx=0).stop 2024-08-25T23:54:00.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.371+0000 7fe3fe800640 1 -- 172.21.15.42:0/2519794224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3f8101590 msgr2=0x7fe3f81990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:00.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.371+0000 7fe3fe800640 1 --2- 172.21.15.42:0/2519794224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3f8101590 0x7fe3f81990a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009230 tx=0x7fe3e8003d80 comp rx=0 tx=0).stop 2024-08-25T23:54:00.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.371+0000 7fe3fe800640 1 -- 172.21.15.42:0/2519794224 shutdown_connections 2024-08-25T23:54:00.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.371+0000 7fe3fe800640 1 --2- 172.21.15.42:0/2519794224 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe3dc039060 0x7fe3dc03b520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:00.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.371+0000 7fe3fe800640 1 --2- 172.21.15.42:0/2519794224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3f8101590 0x7fe3f81990a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:00.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.371+0000 7fe3fe800640 1 -- 172.21.15.42:0/2519794224 >> 172.21.15.42:0/2519794224 conn(0x7fe3f80fd030 msgr2=0x7fe3f81093f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:54:00.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.371+0000 7fe3fe800640 1 -- 172.21.15.42:0/2519794224 shutdown_connections 2024-08-25T23:54:00.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:00.371+0000 7fe3fe800640 1 -- 172.21.15.42:0/2519794224 wait complete. 2024-08-25T23:54:01.043 INFO:tasks.cephadm:Setting crush tunables to default 2024-08-25T23:54:01.044 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd crush tunables default 2024-08-25T23:54:01.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:00 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:01.408 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:54:02.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.050+0000 7f2865400640 1 -- 172.21.15.42:0/951078849 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28601095e0 msgr2=0x7f28601099c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:02.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.050+0000 7f2865400640 1 --2- 172.21.15.42:0/951078849 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28601095e0 0x7f28601099c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2850009880 tx=0x7f285002a5d0 comp rx=0 tx=0).stop 2024-08-25T23:54:02.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.050+0000 7f2865400640 1 -- 172.21.15.42:0/951078849 shutdown_connections 2024-08-25T23:54:02.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.050+0000 7f2865400640 1 --2- 172.21.15.42:0/951078849 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28601095e0 0x7f28601099c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:02.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.050+0000 7f2865400640 1 -- 172.21.15.42:0/951078849 >> 172.21.15.42:0/951078849 conn(0x7f28600ff1f0 msgr2=0x7f2860101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:54:02.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.050+0000 7f2865400640 1 -- 172.21.15.42:0/951078849 shutdown_connections 2024-08-25T23:54:02.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.050+0000 7f2865400640 1 -- 172.21.15.42:0/951078849 wait complete. 2024-08-25T23:54:02.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.051+0000 7f2865400640 1 Processor -- start 2024-08-25T23:54:02.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.051+0000 7f2865400640 1 -- start start 2024-08-25T23:54:02.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.051+0000 7f2865400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28601095e0 0x7f286019d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:02.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.051+0000 7f2865400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f286010dc10 con 0x7f28601095e0 2024-08-25T23:54:02.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.052+0000 7f285e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28601095e0 0x7f286019d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:02.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.052+0000 7f285e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28601095e0 0x7f286019d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43146/0 (socket says 172.21.15.42:43146) 2024-08-25T23:54:02.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.052+0000 7f285e800640 1 -- 172.21.15.42:0/2810319876 learned_addr learned my addr 172.21.15.42:0/2810319876 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:54:02.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.052+0000 7f285e800640 1 -- 172.21.15.42:0/2810319876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286019da10 con 0x7f28601095e0 2024-08-25T23:54:02.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.052+0000 7f285e800640 1 --2- 172.21.15.42:0/2810319876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28601095e0 0x7f286019d4d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2850009230 tx=0x7f2850003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:54:02.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.053+0000 7f2857400640 1 -- 172.21.15.42:0/2810319876 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f285003f070 con 0x7f28601095e0 2024-08-25T23:54:02.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.053+0000 7f2857400640 1 -- 172.21.15.42:0/2810319876 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f285003bd40 con 0x7f28601095e0 2024-08-25T23:54:02.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.053+0000 7f2865400640 1 -- 172.21.15.42:0/2810319876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f286019dca0 con 0x7f28601095e0 2024-08-25T23:54:02.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.053+0000 7f2857400640 1 -- 172.21.15.42:0/2810319876 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2850035030 con 0x7f28601095e0 2024-08-25T23:54:02.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.053+0000 7f2865400640 1 -- 172.21.15.42:0/2810319876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28601a1da0 con 0x7f28601095e0 2024-08-25T23:54:02.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.054+0000 7f2857400640 1 -- 172.21.15.42:0/2810319876 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f2850042070 con 0x7f28601095e0 2024-08-25T23:54:02.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.054+0000 7f2865400640 1 -- 172.21.15.42:0/2810319876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2860104c50 con 0x7f28601095e0 2024-08-25T23:54:02.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.054+0000 7f2857400640 1 --2- 172.21.15.42:0/2810319876 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f28440390c0 0x7f284403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:02.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.054+0000 7f2857400640 1 -- 172.21.15.42:0/2810319876 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f285006cc90 con 0x7f28601095e0 2024-08-25T23:54:02.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.055+0000 7f285de00640 1 --2- 172.21.15.42:0/2810319876 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f28440390c0 0x7f284403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:02.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.055+0000 7f285de00640 1 --2- 172.21.15.42:0/2810319876 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f28440390c0 0x7f284403b580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f284c0098c0 tx=0x7f284c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:54:02.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.060+0000 7f2857400640 1 -- 172.21.15.42:0/2810319876 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f2850036df0 con 0x7f28601095e0 2024-08-25T23:54:02.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.248+0000 7f2865400640 1 -- 172.21.15.42:0/2810319876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f286019e830 con 0x7f28601095e0 2024-08-25T23:54:02.249 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:01 smithi042 ceph-mon[17225]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-25T23:54:02.249 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:01 smithi042 ceph-mon[17225]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:02.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.990+0000 7f2857400640 1 -- 172.21.15.42:0/2810319876 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f2850030d60 con 0x7f28601095e0 2024-08-25T23:54:02.991 INFO:teuthology.orchestra.run.smithi042.stderr:adjusted tunables profile to default 2024-08-25T23:54:02.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.992+0000 7f2865400640 1 -- 172.21.15.42:0/2810319876 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f28440390c0 msgr2=0x7f284403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:02.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.992+0000 7f2865400640 1 --2- 172.21.15.42:0/2810319876 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f28440390c0 0x7f284403b580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f284c0098c0 tx=0x7f284c006db0 comp rx=0 tx=0).stop 2024-08-25T23:54:02.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.992+0000 7f2865400640 1 -- 172.21.15.42:0/2810319876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28601095e0 msgr2=0x7f286019d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:02.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.992+0000 7f2865400640 1 --2- 172.21.15.42:0/2810319876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28601095e0 0x7f286019d4d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2850009230 tx=0x7f2850003d80 comp rx=0 tx=0).stop 2024-08-25T23:54:02.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.992+0000 7f2865400640 1 -- 172.21.15.42:0/2810319876 shutdown_connections 2024-08-25T23:54:02.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.992+0000 7f2865400640 1 --2- 172.21.15.42:0/2810319876 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f28440390c0 0x7f284403b580 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:02.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.992+0000 7f2865400640 1 --2- 172.21.15.42:0/2810319876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28601095e0 0x7f286019d4d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:02.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.992+0000 7f2865400640 1 -- 172.21.15.42:0/2810319876 >> 172.21.15.42:0/2810319876 conn(0x7f28600ff1f0 msgr2=0x7f28600ff5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:54:02.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.993+0000 7f2865400640 1 -- 172.21.15.42:0/2810319876 shutdown_connections 2024-08-25T23:54:02.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:02.993+0000 7f2865400640 1 -- 172.21.15.42:0/2810319876 wait complete. 2024-08-25T23:54:03.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:02 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2810319876' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-08-25T23:54:03.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:03.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:03.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:03.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:03.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:54:03.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:03.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:54:03.640 INFO:tasks.cephadm:Adding mon.a on smithi042 2024-08-25T23:54:03.640 INFO:tasks.cephadm:Adding mon.b on smithi043 2024-08-25T23:54:03.640 INFO:tasks.cephadm:Adding mon.c on smithi181 2024-08-25T23:54:03.640 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph orch apply mon '3;smithi042:172.21.15.42=a;smithi043:172.21.15.43=b;smithi181:172.21.15.181=c' 2024-08-25T23:54:03.876 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/config/ceph.conf 2024-08-25T23:54:04.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.263+0000 7f5e42333640 1 -- 172.21.15.181:0/644800352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e3c1059b0 msgr2=0x7f5e3c105d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:04.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.263+0000 7f5e42333640 1 --2- 172.21.15.181:0/644800352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e3c1059b0 0x7f5e3c105d90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009880 tx=0x7f5e2c02a5d0 comp rx=0 tx=0).stop 2024-08-25T23:54:04.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.263+0000 7f5e42333640 1 -- 172.21.15.181:0/644800352 shutdown_connections 2024-08-25T23:54:04.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.263+0000 7f5e42333640 1 --2- 172.21.15.181:0/644800352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e3c1059b0 0x7f5e3c105d90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:04.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.263+0000 7f5e42333640 1 -- 172.21.15.181:0/644800352 >> 172.21.15.181:0/644800352 conn(0x7f5e3c0fb6d0 msgr2=0x7f5e3c0fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:54:04.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.263+0000 7f5e42333640 1 -- 172.21.15.181:0/644800352 shutdown_connections 2024-08-25T23:54:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.263+0000 7f5e42333640 1 -- 172.21.15.181:0/644800352 wait complete. 2024-08-25T23:54:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.263+0000 7f5e42333640 1 Processor -- start 2024-08-25T23:54:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.264+0000 7f5e42333640 1 -- start start 2024-08-25T23:54:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.264+0000 7f5e42333640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e3c1059b0 0x7f5e3c195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.264+0000 7f5e42333640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c10a070 con 0x7f5e3c1059b0 2024-08-25T23:54:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.264+0000 7f5e3bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e3c1059b0 0x7f5e3c195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.264+0000 7f5e3bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e3c1059b0 0x7f5e3c195e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.181:51682/0 (socket says 172.21.15.181:51682) 2024-08-25T23:54:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.264+0000 7f5e3bfff640 1 -- 172.21.15.181:0/3195592301 learned_addr learned my addr 172.21.15.181:0/3195592301 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-08-25T23:54:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.264+0000 7f5e3bfff640 1 -- 172.21.15.181:0/3195592301 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3c196380 con 0x7f5e3c1059b0 2024-08-25T23:54:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.265+0000 7f5e3bfff640 1 --2- 172.21.15.181:0/3195592301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e3c1059b0 0x7f5e3c195e40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009230 tx=0x7f5e2c003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:54:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.265+0000 7f5e39ffb640 1 -- 172.21.15.181:0/3195592301 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e2c03f070 con 0x7f5e3c1059b0 2024-08-25T23:54:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.265+0000 7f5e42333640 1 -- 172.21.15.181:0/3195592301 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e3c196670 con 0x7f5e3c1059b0 2024-08-25T23:54:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.265+0000 7f5e39ffb640 1 -- 172.21.15.181:0/3195592301 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e2c03bd40 con 0x7f5e3c1059b0 2024-08-25T23:54:04.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.265+0000 7f5e39ffb640 1 -- 172.21.15.181:0/3195592301 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e2c035030 con 0x7f5e3c1059b0 2024-08-25T23:54:04.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.265+0000 7f5e42333640 1 -- 172.21.15.181:0/3195592301 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e3c19a6c0 con 0x7f5e3c1059b0 2024-08-25T23:54:04.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.266+0000 7f5e42333640 1 -- 172.21.15.181:0/3195592301 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e3c1010f0 con 0x7f5e3c1059b0 2024-08-25T23:54:04.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.266+0000 7f5e39ffb640 1 -- 172.21.15.181:0/3195592301 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f5e2c042070 con 0x7f5e3c1059b0 2024-08-25T23:54:04.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.267+0000 7f5e39ffb640 1 --2- 172.21.15.181:0/3195592301 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5e28039060 0x7f5e2803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:04.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.267+0000 7f5e39ffb640 1 -- 172.21.15.181:0/3195592301 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5e2c06cc70 con 0x7f5e3c1059b0 2024-08-25T23:54:04.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.267+0000 7f5e33fff640 1 --2- 172.21.15.181:0/3195592301 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5e28039060 0x7f5e2803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:04.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.267+0000 7f5e33fff640 1 --2- 172.21.15.181:0/3195592301 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5e28039060 0x7f5e2803b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5e240098c0 tx=0x7f5e24006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:54:04.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.271+0000 7f5e39ffb640 1 -- 172.21.15.181:0/3195592301 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5e2c036df0 con 0x7f5e3c1059b0 2024-08-25T23:54:04.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:03 smithi042 ceph-mon[17225]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:04.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:03 smithi042 ceph-mon[17225]: Updating smithi181:/etc/ceph/ceph.conf 2024-08-25T23:54:04.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:03 smithi042 ceph-mon[17225]: Updating smithi181:/var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/config/ceph.conf 2024-08-25T23:54:04.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:03 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2810319876' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-25T23:54:04.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:03 smithi042 ceph-mon[17225]: osdmap e4: 0 total, 0 up, 0 in 2024-08-25T23:54:04.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:03 smithi042 ceph-mon[17225]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-08-25T23:54:04.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:03 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:04.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:03 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:04.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:03 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:04.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.456+0000 7f5e42333640 1 -- 172.21.15.181:0/3195592301 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi042:172.21.15.42=a;smithi043:172.21.15.43=b;smithi181:172.21.15.181=c", "target": ["mon-mgr", ""]}) -- 0x7f5e3c197150 con 0x7f5e28039060 2024-08-25T23:54:04.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.463+0000 7f5e39ffb640 1 -- 172.21.15.181:0/3195592301 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f5e3c197150 con 0x7f5e28039060 2024-08-25T23:54:04.464 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled mon update... 2024-08-25T23:54:04.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.465+0000 7f5e42333640 1 -- 172.21.15.181:0/3195592301 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5e28039060 msgr2=0x7f5e2803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:04.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.465+0000 7f5e42333640 1 --2- 172.21.15.181:0/3195592301 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5e28039060 0x7f5e2803b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5e240098c0 tx=0x7f5e24006db0 comp rx=0 tx=0).stop 2024-08-25T23:54:04.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.465+0000 7f5e42333640 1 -- 172.21.15.181:0/3195592301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e3c1059b0 msgr2=0x7f5e3c195e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:04.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.465+0000 7f5e42333640 1 --2- 172.21.15.181:0/3195592301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e3c1059b0 0x7f5e3c195e40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009230 tx=0x7f5e2c003d80 comp rx=0 tx=0).stop 2024-08-25T23:54:04.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.465+0000 7f5e42333640 1 -- 172.21.15.181:0/3195592301 shutdown_connections 2024-08-25T23:54:04.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.465+0000 7f5e42333640 1 --2- 172.21.15.181:0/3195592301 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5e28039060 0x7f5e2803b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:04.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.465+0000 7f5e42333640 1 --2- 172.21.15.181:0/3195592301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e3c1059b0 0x7f5e3c195e40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:04.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.465+0000 7f5e42333640 1 -- 172.21.15.181:0/3195592301 >> 172.21.15.181:0/3195592301 conn(0x7f5e3c0fb6d0 msgr2=0x7f5e3c0fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:54:04.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.466+0000 7f5e42333640 1 -- 172.21.15.181:0/3195592301 shutdown_connections 2024-08-25T23:54:04.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:04.466+0000 7f5e42333640 1 -- 172.21.15.181:0/3195592301 wait complete. 2024-08-25T23:54:05.015 DEBUG:teuthology.orchestra.run.smithi043:mon.b> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mon.b.service 2024-08-25T23:54:05.017 DEBUG:teuthology.orchestra.run.smithi181:mon.c> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mon.c.service 2024-08-25T23:54:05.020 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-25T23:54:05.020 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph mon dump -f json 2024-08-25T23:54:05.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:04 smithi042 ceph-mon[17225]: Updating smithi181:/var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/config/ceph.client.admin.keyring 2024-08-25T23:54:05.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:04 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:05.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:04 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:54:05.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:04 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:05.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:04 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:54:05.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:04 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:05.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:04 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-25T23:54:05.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:04 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:06.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:05 smithi042 ceph-mon[17225]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:06.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:05 smithi042 ceph-mon[17225]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi042:172.21.15.42=a;smithi043:172.21.15.43=b;smithi181:172.21.15.181=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:54:06.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:05 smithi042 ceph-mon[17225]: Saving service mon spec with placement smithi042:172.21.15.42=a;smithi043:172.21.15.43=b;smithi181:172.21.15.181=c;count:3 2024-08-25T23:54:06.035 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:05 smithi042 ceph-mon[17225]: Deploying daemon mon.c on smithi181 2024-08-25T23:54:06.581 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/config/ceph.conf 2024-08-25T23:54:06.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.969+0000 7feb89daf640 1 -- 172.21.15.181:0/1630837184 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb84102530 msgr2=0x7feb84102910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:06.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.969+0000 7feb89daf640 1 --2- 172.21.15.181:0/1630837184 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb84102530 0x7feb84102910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feb74009c10 tx=0x7feb7402aa10 comp rx=0 tx=0).stop 2024-08-25T23:54:06.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.969+0000 7feb89daf640 1 -- 172.21.15.181:0/1630837184 shutdown_connections 2024-08-25T23:54:06.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.969+0000 7feb89daf640 1 --2- 172.21.15.181:0/1630837184 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb84102530 0x7feb84102910 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:06.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.969+0000 7feb89daf640 1 -- 172.21.15.181:0/1630837184 >> 172.21.15.181:0/1630837184 conn(0x7feb840770b0 msgr2=0x7feb840fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:54:06.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.969+0000 7feb89daf640 1 -- 172.21.15.181:0/1630837184 shutdown_connections 2024-08-25T23:54:06.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.969+0000 7feb89daf640 1 -- 172.21.15.181:0/1630837184 wait complete. 2024-08-25T23:54:06.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.970+0000 7feb89daf640 1 Processor -- start 2024-08-25T23:54:06.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.970+0000 7feb89daf640 1 -- start start 2024-08-25T23:54:06.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.970+0000 7feb89daf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb84102530 0x7feb84196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:06.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.970+0000 7feb89daf640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7feb8410ba20 con 0x7feb84102530 2024-08-25T23:54:06.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.971+0000 7feb837fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb84102530 0x7feb84196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:06.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.971+0000 7feb837fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb84102530 0x7feb84196f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.181:51698/0 (socket says 172.21.15.181:51698) 2024-08-25T23:54:06.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.971+0000 7feb837fe640 1 -- 172.21.15.181:0/613076901 learned_addr learned my addr 172.21.15.181:0/613076901 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-08-25T23:54:06.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.971+0000 7feb837fe640 1 -- 172.21.15.181:0/613076901 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb84197490 con 0x7feb84102530 2024-08-25T23:54:06.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.971+0000 7feb837fe640 1 --2- 172.21.15.181:0/613076901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb84102530 0x7feb84196f50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feb74005dd0 tx=0x7feb74030c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:54:06.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.972+0000 7feb80ff9640 1 -- 172.21.15.181:0/613076901 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb74034070 con 0x7feb84102530 2024-08-25T23:54:06.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.972+0000 7feb89daf640 1 -- 172.21.15.181:0/613076901 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb84197720 con 0x7feb84102530 2024-08-25T23:54:06.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.972+0000 7feb80ff9640 1 -- 172.21.15.181:0/613076901 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb7402f8c0 con 0x7feb84102530 2024-08-25T23:54:06.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.972+0000 7feb80ff9640 1 -- 172.21.15.181:0/613076901 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb74004520 con 0x7feb84102530 2024-08-25T23:54:06.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.972+0000 7feb89daf640 1 -- 172.21.15.181:0/613076901 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb84197ac0 con 0x7feb84102530 2024-08-25T23:54:06.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.973+0000 7feb80ff9640 1 -- 172.21.15.181:0/613076901 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7feb74037020 con 0x7feb84102530 2024-08-25T23:54:06.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.973+0000 7feb89daf640 1 -- 172.21.15.181:0/613076901 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb84069cd0 con 0x7feb84102530 2024-08-25T23:54:06.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.973+0000 7feb80ff9640 1 --2- 172.21.15.181:0/613076901 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7feb70039060 0x7feb7003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:06.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.973+0000 7feb80ff9640 1 -- 172.21.15.181:0/613076901 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7feb7406d030 con 0x7feb84102530 2024-08-25T23:54:06.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.973+0000 7feb82ffd640 1 --2- 172.21.15.181:0/613076901 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7feb70039060 0x7feb7003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:06.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.974+0000 7feb82ffd640 1 --2- 172.21.15.181:0/613076901 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7feb70039060 0x7feb7003b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0098c0 tx=0x7feb6c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:54:06.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:06.978+0000 7feb80ff9640 1 -- 172.21.15.181:0/613076901 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7feb7403f070 con 0x7feb84102530 2024-08-25T23:54:07.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:07.212+0000 7feb89daf640 1 -- 172.21.15.181:0/613076901 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7feb841982b0 con 0x7feb84102530 2024-08-25T23:54:07.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:07.213+0000 7feb80ff9640 1 -- 172.21.15.181:0/613076901 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7feb7402c040 con 0x7feb84102530 2024-08-25T23:54:07.214 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-25T23:54:07.214 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":1,"fsid":"f89d317a-633c-11ef-bcd2-c7b262605968","modified":"2024-08-25T23:52:35.852236Z","created":"2024-08-25T23:52:35.852236Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:3300","nonce":0},{"type":"v1","addr":"172.21.15.42:6789","nonce":0}]},"addr":"172.21.15.42:6789/0","public_addr":"172.21.15.42:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-25T23:54:07.214 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 1 2024-08-25T23:54:07.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:07.215+0000 7feb89daf640 1 -- 172.21.15.181:0/613076901 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7feb70039060 msgr2=0x7feb7003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:07.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:07.215+0000 7feb89daf640 1 --2- 172.21.15.181:0/613076901 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7feb70039060 0x7feb7003b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0098c0 tx=0x7feb6c006db0 comp rx=0 tx=0).stop 2024-08-25T23:54:07.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:07.215+0000 7feb89daf640 1 -- 172.21.15.181:0/613076901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb84102530 msgr2=0x7feb84196f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:07.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:07.215+0000 7feb89daf640 1 --2- 172.21.15.181:0/613076901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb84102530 0x7feb84196f50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feb74005dd0 tx=0x7feb74030c30 comp rx=0 tx=0).stop 2024-08-25T23:54:07.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:07.215+0000 7feb89daf640 1 -- 172.21.15.181:0/613076901 shutdown_connections 2024-08-25T23:54:07.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:07.215+0000 7feb89daf640 1 --2- 172.21.15.181:0/613076901 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7feb70039060 0x7feb7003b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:07.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:07.215+0000 7feb89daf640 1 --2- 172.21.15.181:0/613076901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb84102530 0x7feb84196f50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:07.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:07.215+0000 7feb89daf640 1 -- 172.21.15.181:0/613076901 >> 172.21.15.181:0/613076901 conn(0x7feb840770b0 msgr2=0x7feb841032b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:54:07.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:07.215+0000 7feb89daf640 1 -- 172.21.15.181:0/613076901 shutdown_connections 2024-08-25T23:54:07.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:07.215+0000 7feb89daf640 1 -- 172.21.15.181:0/613076901 wait complete. 2024-08-25T23:54:08.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:07 smithi042 ceph-mon[17225]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:08.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:07 smithi042 ceph-mon[17225]: from='client.? 172.21.15.181:0/613076901' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-25T23:54:09.144 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-25T23:54:09.144 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph mon dump -f json 2024-08-25T23:54:09.167 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:08 smithi181 systemd[1]: Started Ceph mon.c for f89d317a-633c-11ef-bcd2-c7b262605968. 2024-08-25T23:54:09.388 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.c/config 2024-08-25T23:54:14.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.196+0000 7fa300ad1640 1 -- 172.21.15.181:0/2632520855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2e4003530 msgr2=0x7fa2e40059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:14.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.196+0000 7fa300ad1640 1 --2- 172.21.15.181:0/2632520855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2e4003530 0x7fa2e40059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc102890 tx=0x7fa2ec02c490 comp rx=0 tx=0).stop 2024-08-25T23:54:14.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.196+0000 7fa300ad1640 1 -- 172.21.15.181:0/2632520855 shutdown_connections 2024-08-25T23:54:14.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.196+0000 7fa300ad1640 1 --2- 172.21.15.181:0/2632520855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2e4003530 0x7fa2e40059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:14.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.196+0000 7fa300ad1640 1 -- 172.21.15.181:0/2632520855 >> 172.21.15.181:0/2632520855 conn(0x7fa2fc0fd0c0 msgr2=0x7fa2fc0ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:54:14.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.196+0000 7fa300ad1640 1 -- 172.21.15.181:0/2632520855 shutdown_connections 2024-08-25T23:54:14.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.197+0000 7fa300ad1640 1 -- 172.21.15.181:0/2632520855 wait complete. 2024-08-25T23:54:14.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.198+0000 7fa300ad1640 1 Processor -- start 2024-08-25T23:54:14.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.198+0000 7fa300ad1640 1 -- start start 2024-08-25T23:54:14.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.198+0000 7fa300ad1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2e4003530 0x7fa2fc197050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:14.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.198+0000 7fa300ad1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2fc197590 0x7fa2fc19b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:14.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.198+0000 7fa300ad1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc109520 con 0x7fa2e4003530 2024-08-25T23:54:14.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.198+0000 7fa300ad1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc1093a0 con 0x7fa2fc197590 2024-08-25T23:54:14.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.198+0000 7fa2f9d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2fc197590 0x7fa2fc19b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:14.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.198+0000 7fa2f9d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2fc197590 0x7fa2fc19b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39208/0 (socket says 172.21.15.181:39208) 2024-08-25T23:54:14.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.198+0000 7fa2f9d9b640 1 -- 172.21.15.181:0/582754320 learned_addr learned my addr 172.21.15.181:0/582754320 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-08-25T23:54:14.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.199+0000 7fa2fa59c640 1 --2- 172.21.15.181:0/582754320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2e4003530 0x7fa2fc197050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:14.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.199+0000 7fa2f9d9b640 1 -- 172.21.15.181:0/582754320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2fc197590 msgr2=0x7fa2fc19b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-08-25T23:54:14.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.199+0000 7fa2f9d9b640 1 -- 172.21.15.181:0/582754320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2fc197590 msgr2=0x7fa2fc19b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-25T23:54:14.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.199+0000 7fa2f9d9b640 1 --2- 172.21.15.181:0/582754320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2fc197590 0x7fa2fc19b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-25T23:54:14.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.199+0000 7fa2f9d9b640 1 --2- 172.21.15.181:0/582754320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2fc197590 0x7fa2fc19b920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-25T23:54:14.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.199+0000 7fa2fa59c640 1 -- 172.21.15.181:0/582754320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2fc197590 msgr2=0x7fa2fc19b920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-25T23:54:14.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.199+0000 7fa2fa59c640 1 --2- 172.21.15.181:0/582754320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2fc197590 0x7fa2fc19b920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:14.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.199+0000 7fa2fa59c640 1 -- 172.21.15.181:0/582754320 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2fc197bb0 con 0x7fa2e4003530 2024-08-25T23:54:14.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.199+0000 7fa2fa59c640 1 --2- 172.21.15.181:0/582754320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2e4003530 0x7fa2fc197050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec012c10 tx=0x7fa2ec032b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:54:14.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.199+0000 7fa2eb7fe640 1 -- 172.21.15.181:0/582754320 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fa2ec038040 con 0x7fa2e4003530 2024-08-25T23:54:14.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.200+0000 7fa300ad1640 1 -- 172.21.15.181:0/582754320 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2fc19be60 con 0x7fa2e4003530 2024-08-25T23:54:14.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.200+0000 7fa2eb7fe640 1 -- 172.21.15.181:0/582754320 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2ec03c410 con 0x7fa2e4003530 2024-08-25T23:54:14.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.200+0000 7fa2eb7fe640 1 -- 172.21.15.181:0/582754320 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fa2ec03b370 con 0x7fa2e4003530 2024-08-25T23:54:14.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.200+0000 7fa300ad1640 1 -- 172.21.15.181:0/582754320 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2fc19c3a0 con 0x7fa2e4003530 2024-08-25T23:54:14.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.201+0000 7fa2eb7fe640 1 -- 172.21.15.181:0/582754320 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fa2ec043070 con 0x7fa2e4003530 2024-08-25T23:54:14.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.201+0000 7fa2eb7fe640 1 --2- 172.21.15.181:0/582754320 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa2dc038e00 0x7fa2dc03b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:14.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.201+0000 7fa2eb7fe640 1 -- 172.21.15.181:0/582754320 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa2ec06e3a0 con 0x7fa2e4003530 2024-08-25T23:54:14.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.201+0000 7fa300ad1640 1 -- 172.21.15.181:0/582754320 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2fc102b40 con 0x7fa2e4003530 2024-08-25T23:54:14.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.201+0000 7fa2f9d9b640 1 --2- 172.21.15.181:0/582754320 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa2dc038e00 0x7fa2dc03b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:14.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.202+0000 7fa2f9d9b640 1 --2- 172.21.15.181:0/582754320 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa2dc038e00 0x7fa2dc03b2c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009100 tx=0x7fa2f0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:54:14.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.206+0000 7fa2eb7fe640 1 -- 172.21.15.181:0/582754320 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa2ec044570 con 0x7fa2e4003530 2024-08-25T23:54:14.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:14.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-25T23:54:14.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:14.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: mon.a calling monitor election 2024-08-25T23:54:14.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:14.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:14.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:14.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: mon.c calling monitor election 2024-08-25T23:54:14.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:14.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:14.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:14.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:14.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-25T23:54:14.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: monmap epoch 2 2024-08-25T23:54:14.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: fsid f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:54:14.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: last_changed 2024-08-25T23:54:08.904622+0000 2024-08-25T23:54:14.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: created 2024-08-25T23:52:35.852236+0000 2024-08-25T23:54:14.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: min_mon_release 19 (squid) 2024-08-25T23:54:14.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: election_strategy: 1 2024-08-25T23:54:14.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-08-25T23:54:14.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-08-25T23:54:14.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: fsmap 2024-08-25T23:54:14.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: osdmap e4: 0 total, 0 up, 0 in 2024-08-25T23:54:14.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: mgrmap e13: x(active, since 41s) 2024-08-25T23:54:14.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: overall HEALTH_OK 2024-08-25T23:54:14.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:14.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:14.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:14.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-25T23:54:14.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:14.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:14.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-25T23:54:14.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:14.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: mon.a calling monitor election 2024-08-25T23:54:14.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:14.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:14.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:14.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: mon.c calling monitor election 2024-08-25T23:54:14.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:14.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:14.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:14.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:14.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-25T23:54:14.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: monmap epoch 2 2024-08-25T23:54:14.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: fsid f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:54:14.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: last_changed 2024-08-25T23:54:08.904622+0000 2024-08-25T23:54:14.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: created 2024-08-25T23:52:35.852236+0000 2024-08-25T23:54:14.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: min_mon_release 19 (squid) 2024-08-25T23:54:14.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: election_strategy: 1 2024-08-25T23:54:14.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-08-25T23:54:14.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-08-25T23:54:14.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: fsmap 2024-08-25T23:54:14.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: osdmap e4: 0 total, 0 up, 0 in 2024-08-25T23:54:14.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: mgrmap e13: x(active, since 41s) 2024-08-25T23:54:14.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: overall HEALTH_OK 2024-08-25T23:54:14.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:14.288 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:14.288 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:14.288 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-25T23:54:14.288 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:14.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.445+0000 7fa300ad1640 1 -- 172.21.15.181:0/582754320 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa2fc190d00 con 0x7fa2e4003530 2024-08-25T23:54:14.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.446+0000 7fa2eb7fe640 1 -- 172.21.15.181:0/582754320 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fa2ec0447d0 con 0x7fa2e4003530 2024-08-25T23:54:14.447 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-25T23:54:14.447 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":2,"fsid":"f89d317a-633c-11ef-bcd2-c7b262605968","modified":"2024-08-25T23:54:08.904622Z","created":"2024-08-25T23:52:35.852236Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:3300","nonce":0},{"type":"v1","addr":"172.21.15.42:6789","nonce":0}]},"addr":"172.21.15.42:6789/0","public_addr":"172.21.15.42:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:3300","nonce":0},{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-25T23:54:14.447 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 2 2024-08-25T23:54:14.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.448+0000 7fa300ad1640 1 -- 172.21.15.181:0/582754320 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa2dc038e00 msgr2=0x7fa2dc03b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:14.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.448+0000 7fa300ad1640 1 --2- 172.21.15.181:0/582754320 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa2dc038e00 0x7fa2dc03b2c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009100 tx=0x7fa2f0008040 comp rx=0 tx=0).stop 2024-08-25T23:54:14.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.448+0000 7fa300ad1640 1 -- 172.21.15.181:0/582754320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2e4003530 msgr2=0x7fa2fc197050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:14.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.448+0000 7fa300ad1640 1 --2- 172.21.15.181:0/582754320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2e4003530 0x7fa2fc197050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec012c10 tx=0x7fa2ec032b50 comp rx=0 tx=0).stop 2024-08-25T23:54:14.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.448+0000 7fa300ad1640 1 -- 172.21.15.181:0/582754320 shutdown_connections 2024-08-25T23:54:14.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.448+0000 7fa300ad1640 1 --2- 172.21.15.181:0/582754320 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa2dc038e00 0x7fa2dc03b2c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:14.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.448+0000 7fa300ad1640 1 --2- 172.21.15.181:0/582754320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2fc197590 0x7fa2fc19b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:14.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.448+0000 7fa300ad1640 1 --2- 172.21.15.181:0/582754320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2e4003530 0x7fa2fc197050 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:14.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.448+0000 7fa300ad1640 1 -- 172.21.15.181:0/582754320 >> 172.21.15.181:0/582754320 conn(0x7fa2fc0fd0c0 msgr2=0x7fa2fc0ff0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:54:14.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.448+0000 7fa300ad1640 1 -- 172.21.15.181:0/582754320 shutdown_connections 2024-08-25T23:54:14.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:14.448+0000 7fa300ad1640 1 -- 172.21.15.181:0/582754320 wait complete. 2024-08-25T23:54:15.008 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:14 smithi181 ceph-mon[22102]: Deploying daemon mon.b on smithi043 2024-08-25T23:54:15.008 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:14 smithi181 ceph-mon[22102]: from='client.? 172.21.15.181:0/582754320' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-25T23:54:15.008 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:14 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:15.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:14 smithi042 ceph-mon[17225]: Deploying daemon mon.b on smithi043 2024-08-25T23:54:15.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:14 smithi042 ceph-mon[17225]: from='client.? 172.21.15.181:0/582754320' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-25T23:54:15.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:14 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:16.036 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-25T23:54:16.037 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph mon dump -f json 2024-08-25T23:54:16.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:15 smithi042 ceph-mon[17225]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:16.283 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 25 23:54:15 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-25T23:54:15.905+0000 7f13c8e00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-25T23:54:16.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:15 smithi181 ceph-mon[22102]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:16.287 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.c/config 2024-08-25T23:54:16.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.756+0000 7f86b0d8f640 1 -- 172.21.15.181:0/3572658092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86ac107490 msgr2=0x7f86ac107870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:16.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.756+0000 7f86b0d8f640 1 --2- 172.21.15.181:0/3572658092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86ac107490 0x7f86ac107870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f869c009880 tx=0x7f869c02a5d0 comp rx=0 tx=0).stop 2024-08-25T23:54:16.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.756+0000 7f86b0d8f640 1 -- 172.21.15.181:0/3572658092 shutdown_connections 2024-08-25T23:54:16.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.756+0000 7f86b0d8f640 1 --2- 172.21.15.181:0/3572658092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86ac107490 0x7f86ac107870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:16.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.756+0000 7f86b0d8f640 1 -- 172.21.15.181:0/3572658092 >> 172.21.15.181:0/3572658092 conn(0x7f86ac0fd0c0 msgr2=0x7f86ac0ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:54:16.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.756+0000 7f86b0d8f640 1 -- 172.21.15.181:0/3572658092 shutdown_connections 2024-08-25T23:54:16.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.756+0000 7f86b0d8f640 1 -- 172.21.15.181:0/3572658092 wait complete. 2024-08-25T23:54:16.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.757+0000 7f86b0d8f640 1 Processor -- start 2024-08-25T23:54:16.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.757+0000 7f86b0d8f640 1 -- start start 2024-08-25T23:54:16.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.757+0000 7f86b0d8f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86ac107490 0x7f86ac074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:16.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.757+0000 7f86b0d8f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86ac0747d0 0x7f86ac074c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:16.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.757+0000 7f86b0d8f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f86ac10bac0 con 0x7f86ac0747d0 2024-08-25T23:54:16.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.757+0000 7f86b0d8f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f86ac10b940 con 0x7f86ac107490 2024-08-25T23:54:16.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.758+0000 7f86aa59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86ac107490 0x7f86ac074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:16.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.758+0000 7f86aa59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86ac107490 0x7f86ac074290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39216/0 (socket says 172.21.15.181:39216) 2024-08-25T23:54:16.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.758+0000 7f86aa59c640 1 -- 172.21.15.181:0/1307103517 learned_addr learned my addr 172.21.15.181:0/1307103517 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-08-25T23:54:16.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.758+0000 7f86aa59c640 1 -- 172.21.15.181:0/1307103517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86ac107490 msgr2=0x7f86ac074290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-08-25T23:54:16.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.758+0000 7f86aa59c640 1 -- 172.21.15.181:0/1307103517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86ac107490 msgr2=0x7f86ac074290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-25T23:54:16.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.758+0000 7f86aa59c640 1 --2- 172.21.15.181:0/1307103517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86ac107490 0x7f86ac074290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-25T23:54:16.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.758+0000 7f86aa59c640 1 --2- 172.21.15.181:0/1307103517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86ac107490 0x7f86ac074290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-25T23:54:16.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.758+0000 7f86a3fff640 1 --2- 172.21.15.181:0/1307103517 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86ac0747d0 0x7f86ac074c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:16.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.758+0000 7f86a3fff640 1 -- 172.21.15.181:0/1307103517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86ac107490 msgr2=0x7f86ac074290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-25T23:54:16.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.758+0000 7f86a3fff640 1 --2- 172.21.15.181:0/1307103517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86ac107490 0x7f86ac074290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:16.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.758+0000 7f86a3fff640 1 -- 172.21.15.181:0/1307103517 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86ac076180 con 0x7f86ac0747d0 2024-08-25T23:54:16.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.758+0000 7f86a3fff640 1 --2- 172.21.15.181:0/1307103517 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86ac0747d0 0x7f86ac074c30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f869400b400 tx=0x7f869400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:54:16.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.759+0000 7f86a37fe640 1 -- 172.21.15.181:0/1307103517 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f8694011630 con 0x7f86ac0747d0 2024-08-25T23:54:16.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.759+0000 7f86a37fe640 1 -- 172.21.15.181:0/1307103517 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8694011cb0 con 0x7f86ac0747d0 2024-08-25T23:54:16.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.759+0000 7f86b0d8f640 1 -- 172.21.15.181:0/1307103517 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86ac1a33f0 con 0x7f86ac0747d0 2024-08-25T23:54:16.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.759+0000 7f86a37fe640 1 -- 172.21.15.181:0/1307103517 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f8694010d80 con 0x7f86ac0747d0 2024-08-25T23:54:16.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.759+0000 7f86b0d8f640 1 -- 172.21.15.181:0/1307103517 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86ac1a3980 con 0x7f86ac0747d0 2024-08-25T23:54:16.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.760+0000 7f86a37fe640 1 -- 172.21.15.181:0/1307103517 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f8694018020 con 0x7f86ac0747d0 2024-08-25T23:54:16.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.760+0000 7f86b0d8f640 1 -- 172.21.15.181:0/1307103517 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86ac102b40 con 0x7f86ac0747d0 2024-08-25T23:54:16.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.760+0000 7f86a37fe640 1 --2- 172.21.15.181:0/1307103517 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f8698038e00 0x7f869803b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:16.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.760+0000 7f86a37fe640 1 -- 172.21.15.181:0/1307103517 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f869404bdc0 con 0x7f86ac0747d0 2024-08-25T23:54:16.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.760+0000 7f86aa59c640 1 --2- 172.21.15.181:0/1307103517 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f8698038e00 0x7f869803b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:16.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.761+0000 7f86aa59c640 1 --2- 172.21.15.181:0/1307103517 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f8698038e00 0x7f869803b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f869c0096c0 tx=0x7f869c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:54:16.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.765+0000 7f86a37fe640 1 -- 172.21.15.181:0/1307103517 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f869401f020 con 0x7f86ac0747d0 2024-08-25T23:54:16.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.994+0000 7f86b0d8f640 1 -- 172.21.15.181:0/1307103517 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f86ac1a3c90 con 0x7f86ac0747d0 2024-08-25T23:54:16.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.994+0000 7f86a37fe640 1 -- 172.21.15.181:0/1307103517 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f8694017d40 con 0x7f86ac0747d0 2024-08-25T23:54:16.995 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-25T23:54:16.995 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":2,"fsid":"f89d317a-633c-11ef-bcd2-c7b262605968","modified":"2024-08-25T23:54:08.904622Z","created":"2024-08-25T23:52:35.852236Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:3300","nonce":0},{"type":"v1","addr":"172.21.15.42:6789","nonce":0}]},"addr":"172.21.15.42:6789/0","public_addr":"172.21.15.42:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:3300","nonce":0},{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-25T23:54:16.996 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 2 2024-08-25T23:54:16.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.997+0000 7f86b0d8f640 1 -- 172.21.15.181:0/1307103517 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f8698038e00 msgr2=0x7f869803b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:16.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.997+0000 7f86b0d8f640 1 --2- 172.21.15.181:0/1307103517 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f8698038e00 0x7f869803b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f869c0096c0 tx=0x7f869c031400 comp rx=0 tx=0).stop 2024-08-25T23:54:16.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.997+0000 7f86b0d8f640 1 -- 172.21.15.181:0/1307103517 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86ac0747d0 msgr2=0x7f86ac074c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:16.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.997+0000 7f86b0d8f640 1 --2- 172.21.15.181:0/1307103517 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86ac0747d0 0x7f86ac074c30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f869400b400 tx=0x7f869400b8c0 comp rx=0 tx=0).stop 2024-08-25T23:54:16.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.997+0000 7f86b0d8f640 1 -- 172.21.15.181:0/1307103517 shutdown_connections 2024-08-25T23:54:16.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.997+0000 7f86b0d8f640 1 --2- 172.21.15.181:0/1307103517 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f8698038e00 0x7f869803b2c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:16.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.997+0000 7f86b0d8f640 1 --2- 172.21.15.181:0/1307103517 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86ac0747d0 0x7f86ac074c30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:16.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.997+0000 7f86b0d8f640 1 --2- 172.21.15.181:0/1307103517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86ac107490 0x7f86ac074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:16.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.997+0000 7f86b0d8f640 1 -- 172.21.15.181:0/1307103517 >> 172.21.15.181:0/1307103517 conn(0x7f86ac0fd0c0 msgr2=0x7f86ac0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:54:16.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.997+0000 7f86b0d8f640 1 -- 172.21.15.181:0/1307103517 shutdown_connections 2024-08-25T23:54:16.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:16.997+0000 7f86b0d8f640 1 -- 172.21.15.181:0/1307103517 wait complete. 2024-08-25T23:54:17.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 podman[22072]: 2024-08-25 23:54:17.371258651 +0000 UTC m=+0.015921882 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34 2024-08-25T23:54:18.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 podman[22072]: 2024-08-25 23:54:17.668383151 +0000 UTC m=+0.313046382 container init 61c98c271844fb487bb0fb32c1b2f4151d6b2539d807ee03e82228f86caaae48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-b, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f273685, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-08-25T23:54:18.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 podman[22072]: 2024-08-25 23:54:17.671457033 +0000 UTC m=+0.316120253 container start 61c98c271844fb487bb0fb32c1b2f4151d6b2539d807ee03e82228f86caaae48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-f273685, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-25T23:54:18.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: set uid:gid to 167:167 (ceph:ceph) 2024-08-25T23:54:18.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: ceph version 19.1.1-207-gf273685f (f273685f88d22802ccbd8a96b393734630028a13) squid (rc), process ceph-mon, pid 2 2024-08-25T23:54:18.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: pidfile_write: ignore empty --pid-file 2024-08-25T23:54:18.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: load: jerasure load: lrc 2024-08-25T23:54:18.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: RocksDB version: 7.9.2 2024-08-25T23:54:18.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Git sha 0 2024-08-25T23:54:18.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Compile date 2024-08-25 15:14:04 2024-08-25T23:54:18.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: DB SUMMARY 2024-08-25T23:54:18.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: DB Session ID: XJNW96WWI6FYNXDB5T4Q 2024-08-25T23:54:18.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: CURRENT file: CURRENT 2024-08-25T23:54:18.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: IDENTITY file: IDENTITY 2024-08-25T23:54:18.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-08-25T23:54:18.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-08-25T23:54:18.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-08-25T23:54:18.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.error_if_exists: 0 2024-08-25T23:54:18.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.create_if_missing: 0 2024-08-25T23:54:18.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.paranoid_checks: 1 2024-08-25T23:54:18.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-25T23:54:18.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-25T23:54:18.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-25T23:54:18.013 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.env: 0x560ba10377a0 2024-08-25T23:54:18.013 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.fs: PosixFileSystem 2024-08-25T23:54:18.013 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.info_log: 0x560ba2607560 2024-08-25T23:54:18.013 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_file_opening_threads: 16 2024-08-25T23:54:18.013 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.statistics: (nil) 2024-08-25T23:54:18.013 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.use_fsync: 0 2024-08-25T23:54:18.013 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_log_file_size: 0 2024-08-25T23:54:18.013 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-25T23:54:18.013 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-25T23:54:18.013 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.keep_log_file_num: 1000 2024-08-25T23:54:18.013 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.recycle_log_file_num: 0 2024-08-25T23:54:18.013 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.allow_fallocate: 1 2024-08-25T23:54:18.013 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.allow_mmap_reads: 0 2024-08-25T23:54:18.014 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.allow_mmap_writes: 0 2024-08-25T23:54:18.014 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.use_direct_reads: 0 2024-08-25T23:54:18.014 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-25T23:54:18.014 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.create_missing_column_families: 0 2024-08-25T23:54:18.014 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.db_log_dir: 2024-08-25T23:54:18.014 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.wal_dir: 2024-08-25T23:54:18.014 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-25T23:54:18.014 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-25T23:54:18.014 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-25T23:54:18.014 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-25T23:54:18.014 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-25T23:54:18.014 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-25T23:54:18.014 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.advise_random_on_open: 1 2024-08-25T23:54:18.015 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.db_write_buffer_size: 0 2024-08-25T23:54:18.015 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.write_buffer_manager: 0x560ba2616dc0 2024-08-25T23:54:18.015 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-25T23:54:18.015 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-25T23:54:18.015 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-25T23:54:18.015 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.rate_limiter: (nil) 2024-08-25T23:54:18.015 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-25T23:54:18.015 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.wal_recovery_mode: 2 2024-08-25T23:54:18.015 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.enable_thread_tracking: 0 2024-08-25T23:54:18.015 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.enable_pipelined_write: 0 2024-08-25T23:54:18.015 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.unordered_write: 0 2024-08-25T23:54:18.015 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-25T23:54:18.015 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-25T23:54:18.015 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-25T23:54:18.016 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-25T23:54:18.016 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.row_cache: None 2024-08-25T23:54:18.016 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.wal_filter: None 2024-08-25T23:54:18.017 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-25T23:54:18.017 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.allow_ingest_behind: 0 2024-08-25T23:54:18.017 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.two_write_queues: 0 2024-08-25T23:54:18.017 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.manual_wal_flush: 0 2024-08-25T23:54:18.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.wal_compression: 0 2024-08-25T23:54:18.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.atomic_flush: 0 2024-08-25T23:54:18.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-25T23:54:18.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-25T23:54:18.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-25T23:54:18.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.log_readahead_size: 0 2024-08-25T23:54:18.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-25T23:54:18.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.best_efforts_recovery: 0 2024-08-25T23:54:18.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-25T23:54:18.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-25T23:54:18.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.allow_data_in_errors: 0 2024-08-25T23:54:18.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.db_host_id: __hostname__ 2024-08-25T23:54:18.018 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-25T23:54:18.019 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_background_jobs: 2 2024-08-25T23:54:18.019 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_background_compactions: -1 2024-08-25T23:54:18.019 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_subcompactions: 1 2024-08-25T23:54:18.019 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-25T23:54:18.019 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-25T23:54:18.019 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-25T23:54:18.019 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_total_wal_size: 0 2024-08-25T23:54:18.019 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-25T23:54:18.019 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-25T23:54:18.019 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-25T23:54:18.019 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-25T23:54:18.019 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_open_files: -1 2024-08-25T23:54:18.019 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.bytes_per_sync: 0 2024-08-25T23:54:18.020 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-25T23:54:18.020 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-25T23:54:18.020 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.compaction_readahead_size: 0 2024-08-25T23:54:18.020 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_background_flushes: -1 2024-08-25T23:54:18.020 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Compression algorithms supported: 2024-08-25T23:54:18.020 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: kZSTD supported: 0 2024-08-25T23:54:18.020 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: kXpressCompression supported: 0 2024-08-25T23:54:18.020 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: kBZip2Compression supported: 0 2024-08-25T23:54:18.020 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-25T23:54:18.020 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: kLZ4Compression supported: 1 2024-08-25T23:54:18.020 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: kZlibCompression supported: 1 2024-08-25T23:54:18.020 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: kLZ4HCCompression supported: 1 2024-08-25T23:54:18.020 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: kSnappyCompression supported: 1 2024-08-25T23:54:18.020 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-25T23:54:18.020 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-25T23:54:18.021 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-08-25T23:54:18.021 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-25T23:54:18.021 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-25T23:54:18.021 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.merge_operator: 2024-08-25T23:54:18.021 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.compaction_filter: None 2024-08-25T23:54:18.021 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.compaction_filter_factory: None 2024-08-25T23:54:18.021 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.sst_partitioner_factory: None 2024-08-25T23:54:18.021 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-25T23:54:18.021 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-25T23:54:18.021 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560ba2607180) 2024-08-25T23:54:18.021 INFO:journalctl@ceph.mon.b.smithi043.stdout: cache_index_and_filter_blocks: 1 2024-08-25T23:54:18.021 INFO:journalctl@ceph.mon.b.smithi043.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-25T23:54:18.021 INFO:journalctl@ceph.mon.b.smithi043.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-25T23:54:18.021 INFO:journalctl@ceph.mon.b.smithi043.stdout: pin_top_level_index_and_filter: 1 2024-08-25T23:54:18.022 INFO:journalctl@ceph.mon.b.smithi043.stdout: index_type: 0 2024-08-25T23:54:18.022 INFO:journalctl@ceph.mon.b.smithi043.stdout: data_block_index_type: 0 2024-08-25T23:54:18.022 INFO:journalctl@ceph.mon.b.smithi043.stdout: index_shortening: 1 2024-08-25T23:54:18.022 INFO:journalctl@ceph.mon.b.smithi043.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-25T23:54:18.022 INFO:journalctl@ceph.mon.b.smithi043.stdout: checksum: 4 2024-08-25T23:54:18.022 INFO:journalctl@ceph.mon.b.smithi043.stdout: no_block_cache: 0 2024-08-25T23:54:18.022 INFO:journalctl@ceph.mon.b.smithi043.stdout: block_cache: 0x560ba25fb090 2024-08-25T23:54:18.022 INFO:journalctl@ceph.mon.b.smithi043.stdout: block_cache_name: BinnedLRUCache 2024-08-25T23:54:18.022 INFO:journalctl@ceph.mon.b.smithi043.stdout: block_cache_options: 2024-08-25T23:54:18.022 INFO:journalctl@ceph.mon.b.smithi043.stdout: capacity : 536870912 2024-08-25T23:54:18.022 INFO:journalctl@ceph.mon.b.smithi043.stdout: num_shard_bits : 4 2024-08-25T23:54:18.022 INFO:journalctl@ceph.mon.b.smithi043.stdout: strict_capacity_limit : 0 2024-08-25T23:54:18.022 INFO:journalctl@ceph.mon.b.smithi043.stdout: high_pri_pool_ratio: 0.000 2024-08-25T23:54:18.023 INFO:journalctl@ceph.mon.b.smithi043.stdout: block_cache_compressed: (nil) 2024-08-25T23:54:18.023 INFO:journalctl@ceph.mon.b.smithi043.stdout: persistent_cache: (nil) 2024-08-25T23:54:18.023 INFO:journalctl@ceph.mon.b.smithi043.stdout: block_size: 4096 2024-08-25T23:54:18.023 INFO:journalctl@ceph.mon.b.smithi043.stdout: block_size_deviation: 10 2024-08-25T23:54:18.023 INFO:journalctl@ceph.mon.b.smithi043.stdout: block_restart_interval: 16 2024-08-25T23:54:18.023 INFO:journalctl@ceph.mon.b.smithi043.stdout: index_block_restart_interval: 1 2024-08-25T23:54:18.023 INFO:journalctl@ceph.mon.b.smithi043.stdout: metadata_block_size: 4096 2024-08-25T23:54:18.023 INFO:journalctl@ceph.mon.b.smithi043.stdout: partition_filters: 0 2024-08-25T23:54:18.023 INFO:journalctl@ceph.mon.b.smithi043.stdout: use_delta_encoding: 1 2024-08-25T23:54:18.023 INFO:journalctl@ceph.mon.b.smithi043.stdout: filter_policy: bloomfilter 2024-08-25T23:54:18.023 INFO:journalctl@ceph.mon.b.smithi043.stdout: whole_key_filtering: 1 2024-08-25T23:54:18.023 INFO:journalctl@ceph.mon.b.smithi043.stdout: verify_compression: 0 2024-08-25T23:54:18.023 INFO:journalctl@ceph.mon.b.smithi043.stdout: read_amp_bytes_per_bit: 0 2024-08-25T23:54:18.023 INFO:journalctl@ceph.mon.b.smithi043.stdout: format_version: 5 2024-08-25T23:54:18.024 INFO:journalctl@ceph.mon.b.smithi043.stdout: enable_index_compression: 1 2024-08-25T23:54:18.024 INFO:journalctl@ceph.mon.b.smithi043.stdout: block_align: 0 2024-08-25T23:54:18.024 INFO:journalctl@ceph.mon.b.smithi043.stdout: max_auto_readahead_size: 262144 2024-08-25T23:54:18.024 INFO:journalctl@ceph.mon.b.smithi043.stdout: prepopulate_block_cache: 0 2024-08-25T23:54:18.024 INFO:journalctl@ceph.mon.b.smithi043.stdout: initial_auto_readahead_size: 8192 2024-08-25T23:54:18.024 INFO:journalctl@ceph.mon.b.smithi043.stdout: num_file_reads_for_auto_readahead: 2 2024-08-25T23:54:18.024 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.write_buffer_size: 33554432 2024-08-25T23:54:18.024 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_write_buffer_number: 2 2024-08-25T23:54:18.024 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.compression: NoCompression 2024-08-25T23:54:18.024 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.bottommost_compression: Disabled 2024-08-25T23:54:18.024 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.prefix_extractor: nullptr 2024-08-25T23:54:18.024 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-25T23:54:18.025 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.num_levels: 7 2024-08-25T23:54:18.025 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-25T23:54:18.025 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-25T23:54:18.025 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-25T23:54:18.025 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-25T23:54:18.025 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-25T23:54:18.025 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-25T23:54:18.025 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-25T23:54:18.025 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-25T23:54:18.025 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-25T23:54:18.025 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-25T23:54:18.025 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-25T23:54:18.025 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-25T23:54:18.025 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-25T23:54:18.025 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.compression_opts.level: 32767 2024-08-25T23:54:18.026 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.compression_opts.strategy: 0 2024-08-25T23:54:18.026 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-25T23:54:18.026 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-25T23:54:18.026 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-25T23:54:18.026 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-25T23:54:18.026 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.compression_opts.enabled: false 2024-08-25T23:54:18.026 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-25T23:54:18.026 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-25T23:54:18.026 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-25T23:54:18.026 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-25T23:54:18.026 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.target_file_size_base: 67108864 2024-08-25T23:54:18.026 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-25T23:54:18.026 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-25T23:54:18.026 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-25T23:54:18.027 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-25T23:54:18.027 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-25T23:54:18.027 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-25T23:54:18.027 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-25T23:54:18.027 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-25T23:54:18.027 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-25T23:54:18.027 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-25T23:54:18.027 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-25T23:54:18.027 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-25T23:54:18.027 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-25T23:54:18.027 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-25T23:54:18.027 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.arena_block_size: 1048576 2024-08-25T23:54:18.027 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-25T23:54:18.027 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-25T23:54:18.027 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.disable_auto_compactions: 0 2024-08-25T23:54:18.027 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-25T23:54:18.028 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-25T23:54:18.028 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-25T23:54:18.028 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-25T23:54:18.028 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-25T23:54:18.028 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-25T23:54:18.028 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-25T23:54:18.028 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-25T23:54:18.028 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-25T23:54:18.028 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-25T23:54:18.028 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-25T23:54:18.028 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.inplace_update_support: 0 2024-08-25T23:54:18.028 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-25T23:54:18.028 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-25T23:54:18.028 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-25T23:54:18.028 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-25T23:54:18.029 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.bloom_locality: 0 2024-08-25T23:54:18.029 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.max_successive_merges: 0 2024-08-25T23:54:18.029 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-25T23:54:18.029 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.paranoid_file_checks: 0 2024-08-25T23:54:18.029 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.force_consistency_checks: 1 2024-08-25T23:54:18.029 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.report_bg_io_stats: 0 2024-08-25T23:54:18.029 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.ttl: 2592000 2024-08-25T23:54:18.029 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-25T23:54:18.029 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-25T23:54:18.029 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-25T23:54:18.029 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.enable_blob_files: false 2024-08-25T23:54:18.029 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.min_blob_size: 0 2024-08-25T23:54:18.029 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.blob_file_size: 268435456 2024-08-25T23:54:18.029 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-25T23:54:18.030 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-25T23:54:18.030 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-25T23:54:18.030 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-25T23:54:18.030 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-25T23:54:18.030 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.blob_file_starting_level: 0 2024-08-25T23:54:18.030 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-25T23:54:18.030 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-25T23:54:18.030 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-08-25T23:54:18.030 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6b973b01-92af-4115-961a-674071642437 2024-08-25T23:54:18.030 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724630057698531, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-08-25T23:54:18.030 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-08-25T23:54:18.030 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724630057698946, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1724630057, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6b973b01-92af-4115-961a-674071642437", "db_session_id": "XJNW96WWI6FYNXDB5T4Q", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-08-25T23:54:18.030 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724630057699041, "job": 1, "event": "recovery_finished"} 2024-08-25T23:54:18.031 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-08-25T23:54:18.031 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-25T23:54:18.031 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x560ba2628e00 2024-08-25T23:54:18.031 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: DB pointer 0x560ba2724000 2024-08-25T23:54:18.031 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-25T23:54:18.031 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-25T23:54:18.031 INFO:journalctl@ceph.mon.b.smithi043.stdout: ** DB Stats ** 2024-08-25T23:54:18.031 INFO:journalctl@ceph.mon.b.smithi043.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-25T23:54:18.031 INFO:journalctl@ceph.mon.b.smithi043.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-25T23:54:18.031 INFO:journalctl@ceph.mon.b.smithi043.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-25T23:54:18.031 INFO:journalctl@ceph.mon.b.smithi043.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-25T23:54:18.032 INFO:journalctl@ceph.mon.b.smithi043.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-25T23:54:18.032 INFO:journalctl@ceph.mon.b.smithi043.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-25T23:54:18.032 INFO:journalctl@ceph.mon.b.smithi043.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-25T23:54:18.032 INFO:journalctl@ceph.mon.b.smithi043.stdout: 2024-08-25T23:54:18.032 INFO:journalctl@ceph.mon.b.smithi043.stdout: ** Compaction Stats [default] ** 2024-08-25T23:54:18.032 INFO:journalctl@ceph.mon.b.smithi043.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-25T23:54:18.032 INFO:journalctl@ceph.mon.b.smithi043.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-25T23:54:18.032 INFO:journalctl@ceph.mon.b.smithi043.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-25T23:54:18.032 INFO:journalctl@ceph.mon.b.smithi043.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-25T23:54:18.032 INFO:journalctl@ceph.mon.b.smithi043.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-25T23:54:18.032 INFO:journalctl@ceph.mon.b.smithi043.stdout: 2024-08-25T23:54:18.032 INFO:journalctl@ceph.mon.b.smithi043.stdout: ** Compaction Stats [default] ** 2024-08-25T23:54:18.032 INFO:journalctl@ceph.mon.b.smithi043.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-25T23:54:18.032 INFO:journalctl@ceph.mon.b.smithi043.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-25T23:54:18.032 INFO:journalctl@ceph.mon.b.smithi043.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-25T23:54:18.033 INFO:journalctl@ceph.mon.b.smithi043.stdout: 2024-08-25T23:54:18.033 INFO:journalctl@ceph.mon.b.smithi043.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-25T23:54:18.033 INFO:journalctl@ceph.mon.b.smithi043.stdout: 2024-08-25T23:54:18.033 INFO:journalctl@ceph.mon.b.smithi043.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-25T23:54:18.033 INFO:journalctl@ceph.mon.b.smithi043.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-25T23:54:18.033 INFO:journalctl@ceph.mon.b.smithi043.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-25T23:54:18.033 INFO:journalctl@ceph.mon.b.smithi043.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-25T23:54:18.033 INFO:journalctl@ceph.mon.b.smithi043.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-25T23:54:18.033 INFO:journalctl@ceph.mon.b.smithi043.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-25T23:54:18.033 INFO:journalctl@ceph.mon.b.smithi043.stdout: Cumulative compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-25T23:54:18.033 INFO:journalctl@ceph.mon.b.smithi043.stdout: Interval compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-25T23:54:18.033 INFO:journalctl@ceph.mon.b.smithi043.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-25T23:54:18.033 INFO:journalctl@ceph.mon.b.smithi043.stdout: Block cache BinnedLRUCache@0x560ba25fb090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-08-25T23:54:18.033 INFO:journalctl@ceph.mon.b.smithi043.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-08-25T23:54:18.034 INFO:journalctl@ceph.mon.b.smithi043.stdout: 2024-08-25T23:54:18.034 INFO:journalctl@ceph.mon.b.smithi043.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-25T23:54:18.034 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-08-25T23:54:18.034 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: using public_addr v2:172.21.15.43:0/0 -> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-08-25T23:54:18.034 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: starting mon.b rank -1 at public addrs [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] at bind addrs [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:54:18.034 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: mon.b@-1(???) e0 preinit fsid f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:54:18.034 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: mon.b@-1(synchronizing).mds e1 new map 2024-08-25T23:54:18.034 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: mon.b@-1(synchronizing).mds e1 print_map 2024-08-25T23:54:18.034 INFO:journalctl@ceph.mon.b.smithi043.stdout: e1 2024-08-25T23:54:18.034 INFO:journalctl@ceph.mon.b.smithi043.stdout: btime 2024-08-25T23:52:39:598290+0000 2024-08-25T23:54:18.034 INFO:journalctl@ceph.mon.b.smithi043.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-25T23:54:18.034 INFO:journalctl@ceph.mon.b.smithi043.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-25T23:54:18.034 INFO:journalctl@ceph.mon.b.smithi043.stdout: legacy client fscid: -1 2024-08-25T23:54:18.034 INFO:journalctl@ceph.mon.b.smithi043.stdout: 2024-08-25T23:54:18.035 INFO:journalctl@ceph.mon.b.smithi043.stdout: No filesystems configured 2024-08-25T23:54:18.035 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-08-25T23:54:18.035 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-08-25T23:54:18.035 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-08-25T23:54:18.035 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-08-25T23:54:18.035 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-08-25T23:54:18.035 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-08-25T23:54:18.035 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-25T23:54:18.035 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-25T23:54:18.035 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-25T23:54:18.035 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-25T23:54:18.035 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:18.036 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:18.036 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:18.036 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: Added host smithi181 2024-08-25T23:54:18.036 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:54:18.036 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:18.036 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:18.036 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:18.036 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-25T23:54:18.036 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:18.036 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/2810319876' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-08-25T23:54:18.036 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:18.036 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:18.036 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:18.037 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:18.037 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:54:18.037 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:18.037 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:54:18.037 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:18.037 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: Updating smithi181:/etc/ceph/ceph.conf 2024-08-25T23:54:18.037 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: Updating smithi181:/var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/config/ceph.conf 2024-08-25T23:54:18.037 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/2810319876' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-25T23:54:18.037 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: osdmap e4: 0 total, 0 up, 0 in 2024-08-25T23:54:18.037 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-08-25T23:54:18.037 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:18.037 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:18.037 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:18.038 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: Updating smithi181:/var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/config/ceph.client.admin.keyring 2024-08-25T23:54:18.038 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:18.038 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:54:18.038 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:18.038 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:54:18.038 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:18.038 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-25T23:54:18.038 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:18.038 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:18.038 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi042:172.21.15.42=a;smithi043:172.21.15.43=b;smithi181:172.21.15.181=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:54:18.038 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: Saving service mon spec with placement smithi042:172.21.15.42=a;smithi043:172.21.15.43=b;smithi181:172.21.15.181=c;count:3 2024-08-25T23:54:18.038 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: Deploying daemon mon.c on smithi181 2024-08-25T23:54:18.038 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:18.038 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='client.? 172.21.15.181:0/613076901' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-25T23:54:18.038 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:18.039 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-25T23:54:18.039 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:18.039 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: mon.a calling monitor election 2024-08-25T23:54:18.039 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:18.039 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:18.039 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:18.039 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: mon.c calling monitor election 2024-08-25T23:54:18.039 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:18.039 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:18.039 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:18.039 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:18.039 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-25T23:54:18.039 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: monmap epoch 2 2024-08-25T23:54:18.039 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: fsid f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:54:18.039 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: last_changed 2024-08-25T23:54:08.904622+0000 2024-08-25T23:54:18.040 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: created 2024-08-25T23:52:35.852236+0000 2024-08-25T23:54:18.040 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: min_mon_release 19 (squid) 2024-08-25T23:54:18.040 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: election_strategy: 1 2024-08-25T23:54:18.040 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-08-25T23:54:18.040 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-08-25T23:54:18.040 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: fsmap 2024-08-25T23:54:18.040 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: osdmap e4: 0 total, 0 up, 0 in 2024-08-25T23:54:18.040 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: mgrmap e13: x(active, since 41s) 2024-08-25T23:54:18.040 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: overall HEALTH_OK 2024-08-25T23:54:18.040 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:18.040 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:18.040 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:18.040 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-25T23:54:18.040 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:18.040 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: Deploying daemon mon.b on smithi043 2024-08-25T23:54:18.040 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='client.? 172.21.15.181:0/582754320' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-25T23:54:18.041 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:18.041 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:18.041 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 ceph-mon[22091]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-08-25T23:54:18.041 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 bash[22072]: 61c98c271844fb487bb0fb32c1b2f4151d6b2539d807ee03e82228f86caaae48 2024-08-25T23:54:18.041 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:17 smithi043 systemd[1]: Started Ceph mon.b for f89d317a-633c-11ef-bcd2-c7b262605968. 2024-08-25T23:54:18.492 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-25T23:54:18.493 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph mon dump -f json 2024-08-25T23:54:18.743 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.c/config 2024-08-25T23:54:22.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.798+0000 7f94260ea640 1 -- 172.21.15.181:0/1181992487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f940c005740 msgr2=0x7f940c007bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:22.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.798+0000 7f94260ea640 1 --2- 172.21.15.181:0/1181992487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f940c005740 0x7f940c007bd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f94201017b0 tx=0x7f941002c3f0 comp rx=0 tx=0).stop 2024-08-25T23:54:22.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.799+0000 7f94260ea640 1 -- 172.21.15.181:0/1181992487 shutdown_connections 2024-08-25T23:54:22.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.799+0000 7f94260ea640 1 --2- 172.21.15.181:0/1181992487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f940c005740 0x7f940c007bd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:22.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.799+0000 7f94260ea640 1 -- 172.21.15.181:0/1181992487 >> 172.21.15.181:0/1181992487 conn(0x7f94200fc020 msgr2=0x7f94200fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:54:22.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.799+0000 7f94260ea640 1 -- 172.21.15.181:0/1181992487 shutdown_connections 2024-08-25T23:54:22.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.799+0000 7f94260ea640 1 -- 172.21.15.181:0/1181992487 wait complete. 2024-08-25T23:54:22.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.799+0000 7f94260ea640 1 Processor -- start 2024-08-25T23:54:22.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.799+0000 7f94260ea640 1 -- start start 2024-08-25T23:54:22.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f94260ea640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f940c005740 0x7f9420195020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:22.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f94260ea640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9420195560 0x7f9420199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:22.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f94260ea640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9420199d90 0x7f942019a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:22.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f94260ea640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9420107380 con 0x7f9420199d90 2024-08-25T23:54:22.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f94260ea640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9420107200 con 0x7f9420195560 2024-08-25T23:54:22.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f94260ea640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9420107500 con 0x7f940c005740 2024-08-25T23:54:22.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f941f7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f940c005740 0x7f9420195020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:22.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f941f7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f940c005740 0x7f9420195020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57962/0 (socket says 172.21.15.181:57962) 2024-08-25T23:54:22.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f941f7fe640 1 -- 172.21.15.181:0/3088321353 learned_addr learned my addr 172.21.15.181:0/3088321353 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-08-25T23:54:22.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f941f7fe640 1 -- 172.21.15.181:0/3088321353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f940c005740 msgr2=0x7f9420195020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-08-25T23:54:22.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f941ffff640 1 --2- 172.21.15.181:0/3088321353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9420199d90 0x7f942019a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:22.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f941f7fe640 1 -- 172.21.15.181:0/3088321353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f940c005740 msgr2=0x7f9420195020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-25T23:54:22.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f941f7fe640 1 --2- 172.21.15.181:0/3088321353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f940c005740 0x7f9420195020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-25T23:54:22.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f941f7fe640 1 --2- 172.21.15.181:0/3088321353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f940c005740 0x7f9420195020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-25T23:54:22.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f9417fff640 1 --2- 172.21.15.181:0/3088321353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9420195560 0x7f9420199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:22.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f9417fff640 1 -- 172.21.15.181:0/3088321353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9420195560 msgr2=0x7f9420199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-08-25T23:54:22.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f9417fff640 1 -- 172.21.15.181:0/3088321353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9420195560 msgr2=0x7f9420199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-25T23:54:22.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f9417fff640 1 --2- 172.21.15.181:0/3088321353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9420195560 0x7f9420199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-25T23:54:22.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f941ffff640 1 -- 172.21.15.181:0/3088321353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f940c005740 msgr2=0x7f9420195020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-25T23:54:22.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f941ffff640 1 --2- 172.21.15.181:0/3088321353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f940c005740 0x7f9420195020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:22.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f9417fff640 1 --2- 172.21.15.181:0/3088321353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9420195560 0x7f9420199850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-25T23:54:22.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f941ffff640 1 -- 172.21.15.181:0/3088321353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9420195560 msgr2=0x7f9420199850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-25T23:54:22.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f941ffff640 1 --2- 172.21.15.181:0/3088321353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9420195560 0x7f9420199850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:22.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.800+0000 7f941ffff640 1 -- 172.21.15.181:0/3088321353 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94201a1b00 con 0x7f9420199d90 2024-08-25T23:54:22.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.801+0000 7f941ffff640 1 --2- 172.21.15.181:0/3088321353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9420199d90 0x7f942019a240 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f941800bd50 tx=0x7f941800be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:54:22.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.801+0000 7f941d7fa640 1 -- 172.21.15.181:0/3088321353 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9418019070 con 0x7f9420199d90 2024-08-25T23:54:22.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.801+0000 7f941d7fa640 1 -- 172.21.15.181:0/3088321353 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9418014920 con 0x7f9420199d90 2024-08-25T23:54:22.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.801+0000 7f94260ea640 1 -- 172.21.15.181:0/3088321353 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94201a1d30 con 0x7f9420199d90 2024-08-25T23:54:22.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.801+0000 7f941d7fa640 1 -- 172.21.15.181:0/3088321353 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9418012990 con 0x7f9420199d90 2024-08-25T23:54:22.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.801+0000 7f94260ea640 1 -- 172.21.15.181:0/3088321353 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94201a21e0 con 0x7f9420199d90 2024-08-25T23:54:22.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.802+0000 7f941d7fa640 1 -- 172.21.15.181:0/3088321353 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f941801c070 con 0x7f9420199d90 2024-08-25T23:54:22.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.802+0000 7f94260ea640 1 -- 172.21.15.181:0/3088321353 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9420108400 con 0x7f9420199d90 2024-08-25T23:54:22.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.802+0000 7f941d7fa640 1 --2- 172.21.15.181:0/3088321353 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f94000394f0 0x7f940003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:22.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.802+0000 7f941d7fa640 1 -- 172.21.15.181:0/3088321353 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f941804bff0 con 0x7f9420199d90 2024-08-25T23:54:22.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.803+0000 7f941f7fe640 1 --2- 172.21.15.181:0/3088321353 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f94000394f0 0x7f940003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:22.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.803+0000 7f941f7fe640 1 --2- 172.21.15.181:0/3088321353 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f94000394f0 0x7f940003b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9410014a90 tx=0x7f9410005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:54:22.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:22.808+0000 7f941d7fa640 1 -- 172.21.15.181:0/3088321353 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f94180139f0 con 0x7f9420199d90 2024-08-25T23:54:23.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:23.050+0000 7f94260ea640 1 -- 172.21.15.181:0/3088321353 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f942018e4a0 con 0x7f9420199d90 2024-08-25T23:54:23.051 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-25T23:54:23.051 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: mon.a calling monitor election 2024-08-25T23:54:23.051 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: mon.c calling monitor election 2024-08-25T23:54:23.052 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:23.052 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:23.052 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:23.052 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:23.052 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:23.052 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:23.052 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:23.052 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:23.052 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:23.052 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-25T23:54:23.052 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: monmap epoch 3 2024-08-25T23:54:23.052 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: fsid f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:54:23.052 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: last_changed 2024-08-25T23:54:17.723650+0000 2024-08-25T23:54:23.052 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: created 2024-08-25T23:52:35.852236+0000 2024-08-25T23:54:23.053 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: min_mon_release 19 (squid) 2024-08-25T23:54:23.053 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: election_strategy: 1 2024-08-25T23:54:23.053 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-08-25T23:54:23.053 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-08-25T23:54:23.053 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: 2: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.b 2024-08-25T23:54:23.053 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: fsmap 2024-08-25T23:54:23.053 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: osdmap e4: 0 total, 0 up, 0 in 2024-08-25T23:54:23.053 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: mgrmap e13: x(active, since 50s) 2024-08-25T23:54:23.053 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: overall HEALTH_OK 2024-08-25T23:54:23.053 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:23.053 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:23.053 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:23.053 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:22 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:23.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:23.051+0000 7f941d7fa640 1 -- 172.21.15.181:0/3088321353 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7f9418013c50 con 0x7f9420199d90 2024-08-25T23:54:23.054 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-25T23:54:23.054 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":3,"fsid":"f89d317a-633c-11ef-bcd2-c7b262605968","modified":"2024-08-25T23:54:17.723650Z","created":"2024-08-25T23:52:35.852236Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:3300","nonce":0},{"type":"v1","addr":"172.21.15.42:6789","nonce":0}]},"addr":"172.21.15.42:6789/0","public_addr":"172.21.15.42:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:3300","nonce":0},{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-25T23:54:23.055 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 3 2024-08-25T23:54:23.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:23.053+0000 7f94260ea640 1 -- 172.21.15.181:0/3088321353 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f94000394f0 msgr2=0x7f940003b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:23.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:23.053+0000 7f94260ea640 1 --2- 172.21.15.181:0/3088321353 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f94000394f0 0x7f940003b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9410014a90 tx=0x7f9410005f60 comp rx=0 tx=0).stop 2024-08-25T23:54:23.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:23.053+0000 7f94260ea640 1 -- 172.21.15.181:0/3088321353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9420199d90 msgr2=0x7f942019a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:23.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:23.053+0000 7f94260ea640 1 --2- 172.21.15.181:0/3088321353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9420199d90 0x7f942019a240 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f941800bd50 tx=0x7f941800be40 comp rx=0 tx=0).stop 2024-08-25T23:54:23.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:23.053+0000 7f94260ea640 1 -- 172.21.15.181:0/3088321353 shutdown_connections 2024-08-25T23:54:23.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:23.053+0000 7f94260ea640 1 --2- 172.21.15.181:0/3088321353 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f94000394f0 0x7f940003b9b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:23.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:23.053+0000 7f94260ea640 1 --2- 172.21.15.181:0/3088321353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9420199d90 0x7f942019a240 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:23.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:23.053+0000 7f94260ea640 1 --2- 172.21.15.181:0/3088321353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9420195560 0x7f9420199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:23.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:23.053+0000 7f94260ea640 1 --2- 172.21.15.181:0/3088321353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f940c005740 0x7f9420195020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:23.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:23.053+0000 7f94260ea640 1 -- 172.21.15.181:0/3088321353 >> 172.21.15.181:0/3088321353 conn(0x7f94200fc020 msgr2=0x7f94200fd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:54:23.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:23.053+0000 7f94260ea640 1 -- 172.21.15.181:0/3088321353 shutdown_connections 2024-08-25T23:54:23.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:23.053+0000 7f94260ea640 1 -- 172.21.15.181:0/3088321353 wait complete. 2024-08-25T23:54:23.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-25T23:54:23.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: mon.a calling monitor election 2024-08-25T23:54:23.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: mon.c calling monitor election 2024-08-25T23:54:23.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:23.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:23.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:23.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:23.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:23.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:23.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:23.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:23.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:23.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-25T23:54:23.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: monmap epoch 3 2024-08-25T23:54:23.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: fsid f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:54:23.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: last_changed 2024-08-25T23:54:17.723650+0000 2024-08-25T23:54:23.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: created 2024-08-25T23:52:35.852236+0000 2024-08-25T23:54:23.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: min_mon_release 19 (squid) 2024-08-25T23:54:23.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: election_strategy: 1 2024-08-25T23:54:23.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-08-25T23:54:23.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-08-25T23:54:23.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: 2: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.b 2024-08-25T23:54:23.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: fsmap 2024-08-25T23:54:23.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: osdmap e4: 0 total, 0 up, 0 in 2024-08-25T23:54:23.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: mgrmap e13: x(active, since 50s) 2024-08-25T23:54:23.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: overall HEALTH_OK 2024-08-25T23:54:23.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:23.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:23.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:23.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:22 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:23.706 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-08-25T23:54:23.706 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph config generate-minimal-conf 2024-08-25T23:54:23.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:23 smithi181 ceph-mon[22102]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:23.982 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:23 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:54:23.982 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:23 smithi181 ceph-mon[22102]: from='client.? 172.21.15.181:0/3088321353' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-25T23:54:23.982 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:23 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:24.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:23 smithi042 ceph-mon[17225]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:24.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:23 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:54:24.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:23 smithi042 ceph-mon[17225]: from='client.? 172.21.15.181:0/3088321353' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-25T23:54:24.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:23 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:24.088 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:54:24.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.702+0000 7fae4ca00640 1 -- 172.21.15.42:0/2035499691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae4810b8e0 msgr2=0x7fae4810bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:24.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.702+0000 7fae4ca00640 1 --2- 172.21.15.42:0/2035499691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae4810b8e0 0x7fae4810bcc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fae38009880 tx=0x7fae3802a5d0 comp rx=0 tx=0).stop 2024-08-25T23:54:24.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.702+0000 7fae4ca00640 1 -- 172.21.15.42:0/2035499691 shutdown_connections 2024-08-25T23:54:24.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.702+0000 7fae4ca00640 1 --2- 172.21.15.42:0/2035499691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae4810b8e0 0x7fae4810bcc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:24.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.702+0000 7fae4ca00640 1 -- 172.21.15.42:0/2035499691 >> 172.21.15.42:0/2035499691 conn(0x7fae4806c8f0 msgr2=0x7fae4806cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:54:24.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.702+0000 7fae4ca00640 1 -- 172.21.15.42:0/2035499691 shutdown_connections 2024-08-25T23:54:24.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.702+0000 7fae4ca00640 1 -- 172.21.15.42:0/2035499691 wait complete. 2024-08-25T23:54:24.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.703+0000 7fae4ca00640 1 Processor -- start 2024-08-25T23:54:24.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.704+0000 7fae4ca00640 1 -- start start 2024-08-25T23:54:24.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.704+0000 7fae4ca00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae4810b8e0 0x7fae481a7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:24.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.704+0000 7fae4ca00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae481a7b80 0x7fae481a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:24.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.704+0000 7fae4ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae481a1d00 0x7fae481a2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:24.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.704+0000 7fae4ca00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fae48116280 con 0x7fae481a1d00 2024-08-25T23:54:24.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.704+0000 7fae4ca00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fae48116100 con 0x7fae481a7b80 2024-08-25T23:54:24.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.704+0000 7fae4ca00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fae48116400 con 0x7fae4810b8e0 2024-08-25T23:54:24.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.704+0000 7fae46800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae4810b8e0 0x7fae481a7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:24.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.704+0000 7fae45e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae481a7b80 0x7fae481a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:24.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.704+0000 7fae46800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae4810b8e0 0x7fae481a7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:56476/0 (socket says 172.21.15.42:56476) 2024-08-25T23:54:24.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.704+0000 7fae46800640 1 -- 172.21.15.42:0/1099223326 learned_addr learned my addr 172.21.15.42:0/1099223326 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:54:24.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.704+0000 7fae47200640 1 --2- 172.21.15.42:0/1099223326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae481a1d00 0x7fae481a2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:24.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.705+0000 7fae45e00640 1 -- 172.21.15.42:0/1099223326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae481a7b80 msgr2=0x7fae481a17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-08-25T23:54:24.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.705+0000 7fae45e00640 1 -- 172.21.15.42:0/1099223326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae481a7b80 msgr2=0x7fae481a17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-25T23:54:24.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.705+0000 7fae45e00640 1 --2- 172.21.15.42:0/1099223326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae481a7b80 0x7fae481a17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-25T23:54:24.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.705+0000 7fae45e00640 1 --2- 172.21.15.42:0/1099223326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae481a7b80 0x7fae481a17c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-25T23:54:24.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.705+0000 7fae46800640 1 -- 172.21.15.42:0/1099223326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae481a7b80 msgr2=0x7fae481a17c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-25T23:54:24.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.705+0000 7fae46800640 1 --2- 172.21.15.42:0/1099223326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae481a7b80 0x7fae481a17c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:24.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.705+0000 7fae46800640 1 -- 172.21.15.42:0/1099223326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae481a1d00 msgr2=0x7fae481a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:24.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.705+0000 7fae46800640 1 --2- 172.21.15.42:0/1099223326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae481a1d00 0x7fae481a2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:24.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.705+0000 7fae46800640 1 -- 172.21.15.42:0/1099223326 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae481ae4a0 con 0x7fae4810b8e0 2024-08-25T23:54:24.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.705+0000 7fae46800640 1 --2- 172.21.15.42:0/1099223326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae4810b8e0 0x7fae481a7640 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fae38006010 tx=0x7fae38003c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:54:24.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.706+0000 7fae3f400640 1 -- 172.21.15.42:0/1099223326 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3803f070 con 0x7fae4810b8e0 2024-08-25T23:54:24.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.706+0000 7fae3f400640 1 -- 172.21.15.42:0/1099223326 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae3803b460 con 0x7fae4810b8e0 2024-08-25T23:54:24.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.706+0000 7fae3f400640 1 -- 172.21.15.42:0/1099223326 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae38035030 con 0x7fae4810b8e0 2024-08-25T23:54:24.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.706+0000 7fae4ca00640 1 -- 172.21.15.42:0/1099223326 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae481ae6d0 con 0x7fae4810b8e0 2024-08-25T23:54:24.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.706+0000 7fae4ca00640 1 -- 172.21.15.42:0/1099223326 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae481aec60 con 0x7fae4810b8e0 2024-08-25T23:54:24.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.707+0000 7fae4ca00640 1 -- 172.21.15.42:0/1099223326 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae48108f90 con 0x7fae4810b8e0 2024-08-25T23:54:24.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.707+0000 7fae3f400640 1 -- 172.21.15.42:0/1099223326 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fae38042070 con 0x7fae4810b8e0 2024-08-25T23:54:24.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.708+0000 7fae3f400640 1 --2- 172.21.15.42:0/1099223326 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fae2c0394f0 0x7fae2c03b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:24.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.708+0000 7fae3f400640 1 -- 172.21.15.42:0/1099223326 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fae3806cda0 con 0x7fae4810b8e0 2024-08-25T23:54:24.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.708+0000 7fae45e00640 1 --2- 172.21.15.42:0/1099223326 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fae2c0394f0 0x7fae2c03b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:24.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.709+0000 7fae45e00640 1 --2- 172.21.15.42:0/1099223326 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fae2c0394f0 0x7fae2c03b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fae34006fd0 tx=0x7fae34008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:54:24.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.713+0000 7fae3f400640 1 -- 172.21.15.42:0/1099223326 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fae38039350 con 0x7fae4810b8e0 2024-08-25T23:54:24.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.913+0000 7fae4ca00640 1 -- 172.21.15.42:0/1099223326 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fae481a2d90 con 0x7fae4810b8e0 2024-08-25T23:54:24.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.914+0000 7fae3f400640 1 -- 172.21.15.42:0/1099223326 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7fae38030d60 con 0x7fae4810b8e0 2024-08-25T23:54:24.915 INFO:teuthology.orchestra.run.smithi042.stdout:# minimal ceph.conf for f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:54:24.915 INFO:teuthology.orchestra.run.smithi042.stdout:[global] 2024-08-25T23:54:24.916 INFO:teuthology.orchestra.run.smithi042.stdout: fsid = f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:54:24.916 INFO:teuthology.orchestra.run.smithi042.stdout: mon_host = [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-25T23:54:24.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.916+0000 7fae4ca00640 1 -- 172.21.15.42:0/1099223326 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fae2c0394f0 msgr2=0x7fae2c03b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:24.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.916+0000 7fae4ca00640 1 --2- 172.21.15.42:0/1099223326 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fae2c0394f0 0x7fae2c03b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fae34006fd0 tx=0x7fae34008040 comp rx=0 tx=0).stop 2024-08-25T23:54:24.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.916+0000 7fae4ca00640 1 -- 172.21.15.42:0/1099223326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae4810b8e0 msgr2=0x7fae481a7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:24.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.916+0000 7fae4ca00640 1 --2- 172.21.15.42:0/1099223326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae4810b8e0 0x7fae481a7640 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fae38006010 tx=0x7fae38003c00 comp rx=0 tx=0).stop 2024-08-25T23:54:24.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.916+0000 7fae4ca00640 1 -- 172.21.15.42:0/1099223326 shutdown_connections 2024-08-25T23:54:24.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.916+0000 7fae4ca00640 1 --2- 172.21.15.42:0/1099223326 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fae2c0394f0 0x7fae2c03b9b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:24.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.916+0000 7fae4ca00640 1 --2- 172.21.15.42:0/1099223326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae481a1d00 0x7fae481a2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:24.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.916+0000 7fae4ca00640 1 --2- 172.21.15.42:0/1099223326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae481a7b80 0x7fae481a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:24.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.916+0000 7fae4ca00640 1 --2- 172.21.15.42:0/1099223326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae4810b8e0 0x7fae481a7640 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:24.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.917+0000 7fae4ca00640 1 -- 172.21.15.42:0/1099223326 >> 172.21.15.42:0/1099223326 conn(0x7fae4806c8f0 msgr2=0x7fae480701e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:54:24.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.917+0000 7fae4ca00640 1 -- 172.21.15.42:0/1099223326 shutdown_connections 2024-08-25T23:54:24.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:24.917+0000 7fae4ca00640 1 -- 172.21.15.42:0/1099223326 wait complete. 2024-08-25T23:54:25.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-25T23:54:25.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: mon.a calling monitor election 2024-08-25T23:54:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: mon.c calling monitor election 2024-08-25T23:54:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:54:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-25T23:54:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: monmap epoch 3 2024-08-25T23:54:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: fsid f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:54:25.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: last_changed 2024-08-25T23:54:17.723650+0000 2024-08-25T23:54:25.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: created 2024-08-25T23:52:35.852236+0000 2024-08-25T23:54:25.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: min_mon_release 19 (squid) 2024-08-25T23:54:25.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: election_strategy: 1 2024-08-25T23:54:25.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-08-25T23:54:25.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-08-25T23:54:25.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: 2: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.b 2024-08-25T23:54:25.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: fsmap 2024-08-25T23:54:25.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: osdmap e4: 0 total, 0 up, 0 in 2024-08-25T23:54:25.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: mgrmap e13: x(active, since 50s) 2024-08-25T23:54:25.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: overall HEALTH_OK 2024-08-25T23:54:25.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:25.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:25.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:25.013 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:25.013 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:25.013 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:54:25.013 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: from='client.? 172.21.15.181:0/3088321353' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-25T23:54:25.013 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:24 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:25.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: mon.b calling monitor election 2024-08-25T23:54:25.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: Updating smithi042:/etc/ceph/ceph.conf 2024-08-25T23:54:25.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: Updating smithi043:/etc/ceph/ceph.conf 2024-08-25T23:54:25.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: Updating smithi181:/etc/ceph/ceph.conf 2024-08-25T23:54:25.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:25.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: Updating smithi181:/var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/config/ceph.conf 2024-08-25T23:54:25.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: Updating smithi043:/var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/config/ceph.conf 2024-08-25T23:54:25.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: mon.b calling monitor election 2024-08-25T23:54:25.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: mon.c calling monitor election 2024-08-25T23:54:25.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: mon.a calling monitor election 2024-08-25T23:54:25.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-25T23:54:25.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: monmap epoch 3 2024-08-25T23:54:25.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: fsid f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:54:25.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: last_changed 2024-08-25T23:54:17.723650+0000 2024-08-25T23:54:25.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: created 2024-08-25T23:52:35.852236+0000 2024-08-25T23:54:25.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: min_mon_release 19 (squid) 2024-08-25T23:54:25.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: election_strategy: 1 2024-08-25T23:54:25.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-08-25T23:54:25.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-08-25T23:54:25.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: 2: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.b 2024-08-25T23:54:25.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: fsmap 2024-08-25T23:54:25.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: osdmap e4: 0 total, 0 up, 0 in 2024-08-25T23:54:25.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: mgrmap e13: x(active, since 52s) 2024-08-25T23:54:25.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: overall HEALTH_OK 2024-08-25T23:54:25.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:25.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:25.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:25.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:25.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1099223326' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:25.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: Updating smithi042:/var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/config/ceph.conf 2024-08-25T23:54:25.513 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:25.513 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:25 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:25.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: mon.b calling monitor election 2024-08-25T23:54:25.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: Updating smithi042:/etc/ceph/ceph.conf 2024-08-25T23:54:25.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: Updating smithi043:/etc/ceph/ceph.conf 2024-08-25T23:54:25.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: Updating smithi181:/etc/ceph/ceph.conf 2024-08-25T23:54:25.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:25.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: Updating smithi181:/var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/config/ceph.conf 2024-08-25T23:54:25.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: Updating smithi043:/var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/config/ceph.conf 2024-08-25T23:54:25.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: mon.b calling monitor election 2024-08-25T23:54:25.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: mon.c calling monitor election 2024-08-25T23:54:25.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: mon.a calling monitor election 2024-08-25T23:54:25.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-25T23:54:25.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: monmap epoch 3 2024-08-25T23:54:25.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: fsid f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:54:25.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: last_changed 2024-08-25T23:54:17.723650+0000 2024-08-25T23:54:25.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: created 2024-08-25T23:52:35.852236+0000 2024-08-25T23:54:25.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: min_mon_release 19 (squid) 2024-08-25T23:54:25.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: election_strategy: 1 2024-08-25T23:54:25.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-08-25T23:54:25.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-08-25T23:54:25.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: 2: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.b 2024-08-25T23:54:25.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: fsmap 2024-08-25T23:54:25.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: osdmap e4: 0 total, 0 up, 0 in 2024-08-25T23:54:25.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: mgrmap e13: x(active, since 52s) 2024-08-25T23:54:25.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: overall HEALTH_OK 2024-08-25T23:54:25.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:25.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:25.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:25.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:25.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1099223326' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:25.536 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: Updating smithi042:/var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/config/ceph.conf 2024-08-25T23:54:25.536 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:25.536 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:25 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:25.671 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-08-25T23:54:25.672 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-25T23:54:25.672 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.conf 2024-08-25T23:54:25.734 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-25T23:54:25.735 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-25T23:54:25.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: mon.b calling monitor election 2024-08-25T23:54:25.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: Updating smithi042:/etc/ceph/ceph.conf 2024-08-25T23:54:25.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: Updating smithi043:/etc/ceph/ceph.conf 2024-08-25T23:54:25.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: Updating smithi181:/etc/ceph/ceph.conf 2024-08-25T23:54:25.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:25.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: Updating smithi181:/var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/config/ceph.conf 2024-08-25T23:54:25.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: Updating smithi043:/var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/config/ceph.conf 2024-08-25T23:54:25.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: mon.b calling monitor election 2024-08-25T23:54:25.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: mon.c calling monitor election 2024-08-25T23:54:25.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: mon.a calling monitor election 2024-08-25T23:54:25.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-25T23:54:25.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: monmap epoch 3 2024-08-25T23:54:25.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: fsid f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-25T23:54:25.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: last_changed 2024-08-25T23:54:17.723650+0000 2024-08-25T23:54:25.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: created 2024-08-25T23:52:35.852236+0000 2024-08-25T23:54:25.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: min_mon_release 19 (squid) 2024-08-25T23:54:25.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: election_strategy: 1 2024-08-25T23:54:25.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: 0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-08-25T23:54:25.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-08-25T23:54:25.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: 2: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.b 2024-08-25T23:54:25.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: fsmap 2024-08-25T23:54:25.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: osdmap e4: 0 total, 0 up, 0 in 2024-08-25T23:54:25.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: mgrmap e13: x(active, since 52s) 2024-08-25T23:54:25.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: overall HEALTH_OK 2024-08-25T23:54:25.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:25.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:25.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:25.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:25.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1099223326' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:25.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: Updating smithi042:/var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/config/ceph.conf 2024-08-25T23:54:25.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:25.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:25 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:25.833 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-08-25T23:54:25.833 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.conf 2024-08-25T23:54:25.861 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-08-25T23:54:25.861 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-25T23:54:25.926 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-25T23:54:25.926 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.conf 2024-08-25T23:54:25.954 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-25T23:54:25.955 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-25T23:54:26.020 INFO:tasks.cephadm:Adding mgr.x on smithi042 2024-08-25T23:54:26.020 INFO:tasks.cephadm:Adding mgr.y on smithi043 2024-08-25T23:54:26.020 INFO:tasks.cephadm:Adding mgr.z on smithi181 2024-08-25T23:54:26.020 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph orch apply mgr '3;smithi042=x;smithi043=y;smithi181=z' 2024-08-25T23:54:26.294 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.c/config 2024-08-25T23:54:26.695 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:26 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:26.695 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:26 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:26.695 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:26 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:26.695 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:26 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:26.695 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:26 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:26.695 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:26 smithi181 ceph-mon[22102]: Reconfiguring mon.a (unknown last config time)... 2024-08-25T23:54:26.695 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:26 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-25T23:54:26.696 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:26 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-25T23:54:26.696 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:26 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:26.696 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:26 smithi181 ceph-mon[22102]: Reconfiguring daemon mon.a on smithi042 2024-08-25T23:54:26.696 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:26 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:26.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.701+0000 7f7ef8a62640 1 -- 172.21.15.181:0/103829766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ef4100390 msgr2=0x7f7ef4100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:26.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.701+0000 7f7ef8a62640 1 --2- 172.21.15.181:0/103829766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ef4100390 0x7f7ef4100790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009880 tx=0x7f7ee402a5d0 comp rx=0 tx=0).stop 2024-08-25T23:54:26.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.701+0000 7f7ef8a62640 1 -- 172.21.15.181:0/103829766 shutdown_connections 2024-08-25T23:54:26.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.701+0000 7f7ef8a62640 1 --2- 172.21.15.181:0/103829766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ef4100390 0x7f7ef4100790 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:26.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.701+0000 7f7ef8a62640 1 -- 172.21.15.181:0/103829766 >> 172.21.15.181:0/103829766 conn(0x7f7ef40fbb40 msgr2=0x7f7ef40fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:54:26.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.701+0000 7f7ef8a62640 1 -- 172.21.15.181:0/103829766 shutdown_connections 2024-08-25T23:54:26.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.701+0000 7f7ef8a62640 1 -- 172.21.15.181:0/103829766 wait complete. 2024-08-25T23:54:26.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.702+0000 7f7ef8a62640 1 Processor -- start 2024-08-25T23:54:26.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.702+0000 7f7ef8a62640 1 -- start start 2024-08-25T23:54:26.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.703+0000 7f7ef8a62640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ef4100390 0x7f7ef406ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.703+0000 7f7ef8a62640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ef4199ab0 0x7f7ef419bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.703+0000 7f7ef8a62640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ef419c3e0 0x7f7ef419e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.703+0000 7f7ef8a62640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef41064a0 con 0x7f7ef4100390 2024-08-25T23:54:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.703+0000 7f7ef8a62640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef4106320 con 0x7f7ef4199ab0 2024-08-25T23:54:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.703+0000 7f7ef8a62640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef4106620 con 0x7f7ef419c3e0 2024-08-25T23:54:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.703+0000 7f7ef2d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ef419c3e0 0x7f7ef419e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.703+0000 7f7ef2d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ef419c3e0 0x7f7ef419e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57972/0 (socket says 172.21.15.181:57972) 2024-08-25T23:54:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.703+0000 7f7ef2d9d640 1 -- 172.21.15.181:0/2080902469 learned_addr learned my addr 172.21.15.181:0/2080902469 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-08-25T23:54:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.703+0000 7f7ef259c640 1 --2- 172.21.15.181:0/2080902469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ef4100390 0x7f7ef406ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.703+0000 7f7ee9d9b640 1 --2- 172.21.15.181:0/2080902469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ef4199ab0 0x7f7ef419bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.703+0000 7f7ef2d9d640 1 -- 172.21.15.181:0/2080902469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ef4199ab0 msgr2=0x7f7ef419bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.703+0000 7f7ef2d9d640 1 --2- 172.21.15.181:0/2080902469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ef4199ab0 0x7f7ef419bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.703+0000 7f7ef2d9d640 1 -- 172.21.15.181:0/2080902469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ef4100390 msgr2=0x7f7ef406ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.703+0000 7f7ef2d9d640 1 --2- 172.21.15.181:0/2080902469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ef4100390 0x7f7ef406ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.703+0000 7f7ef2d9d640 1 -- 172.21.15.181:0/2080902469 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef419f1b0 con 0x7f7ef419c3e0 2024-08-25T23:54:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.703+0000 7f7ef2d9d640 1 --2- 172.21.15.181:0/2080902469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ef419c3e0 0x7f7ef419e8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00ba50 tx=0x7f7eec00bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:54:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.703+0000 7f7eebfff640 1 -- 172.21.15.181:0/2080902469 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec019070 con 0x7f7ef419c3e0 2024-08-25T23:54:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.703+0000 7f7eebfff640 1 -- 172.21.15.181:0/2080902469 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7eec00cbe0 con 0x7f7ef419c3e0 2024-08-25T23:54:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.703+0000 7f7ef8a62640 1 -- 172.21.15.181:0/2080902469 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef419f440 con 0x7f7ef419c3e0 2024-08-25T23:54:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.704+0000 7f7eebfff640 1 -- 172.21.15.181:0/2080902469 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec0076a0 con 0x7f7ef419c3e0 2024-08-25T23:54:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.704+0000 7f7ef8a62640 1 -- 172.21.15.181:0/2080902469 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef419fa00 con 0x7f7ef419c3e0 2024-08-25T23:54:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.704+0000 7f7eebfff640 1 -- 172.21.15.181:0/2080902469 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f7eec01c070 con 0x7f7ef419c3e0 2024-08-25T23:54:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.705+0000 7f7ef8a62640 1 -- 172.21.15.181:0/2080902469 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ef418f260 con 0x7f7ef419c3e0 2024-08-25T23:54:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.705+0000 7f7eebfff640 1 --2- 172.21.15.181:0/2080902469 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7ee00394f0 0x7f7ee003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.705+0000 7f7eebfff640 1 -- 172.21.15.181:0/2080902469 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7eec04ba70 con 0x7f7ef419c3e0 2024-08-25T23:54:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.705+0000 7f7ef259c640 1 --2- 172.21.15.181:0/2080902469 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7ee00394f0 0x7f7ee003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.705+0000 7f7ef259c640 1 --2- 172.21.15.181:0/2080902469 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7ee00394f0 0x7f7ee003b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4005ab0 tx=0x7f7ee40315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:54:26.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.709+0000 7f7eebfff640 1 -- 172.21.15.181:0/2080902469 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f7eec0112a0 con 0x7f7ef419c3e0 2024-08-25T23:54:26.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:26 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:26.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:26 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:26.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:26 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:26.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:26 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:26.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:26 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:26.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:26 smithi043 ceph-mon[22091]: Reconfiguring mon.a (unknown last config time)... 2024-08-25T23:54:26.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:26 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-25T23:54:26.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:26 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-25T23:54:26.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:26 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:26.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:26 smithi043 ceph-mon[22091]: Reconfiguring daemon mon.a on smithi042 2024-08-25T23:54:26.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:26 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:26.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:26 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:26.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:26 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:26.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:26 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:26.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:26 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:26.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:26 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:26.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:26 smithi042 ceph-mon[17225]: Reconfiguring mon.a (unknown last config time)... 2024-08-25T23:54:26.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:26 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-25T23:54:26.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:26 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-25T23:54:26.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:26 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:26.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:26 smithi042 ceph-mon[17225]: Reconfiguring daemon mon.a on smithi042 2024-08-25T23:54:26.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:26 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:54:26.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.888+0000 7f7ef8a62640 1 -- 172.21.15.181:0/2080902469 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi042=x;smithi043=y;smithi181=z", "target": ["mon-mgr", ""]}) -- 0x7f7ef4062460 con 0x7f7ee00394f0 2024-08-25T23:54:26.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.895+0000 7f7eebfff640 1 -- 172.21.15.181:0/2080902469 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f7ef4062460 con 0x7f7ee00394f0 2024-08-25T23:54:26.895 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled mgr update... 2024-08-25T23:54:26.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.897+0000 7f7ef8a62640 1 -- 172.21.15.181:0/2080902469 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7ee00394f0 msgr2=0x7f7ee003b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:26.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.897+0000 7f7ef8a62640 1 --2- 172.21.15.181:0/2080902469 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7ee00394f0 0x7f7ee003b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4005ab0 tx=0x7f7ee40315d0 comp rx=0 tx=0).stop 2024-08-25T23:54:26.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.897+0000 7f7ef8a62640 1 -- 172.21.15.181:0/2080902469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ef419c3e0 msgr2=0x7f7ef419e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:26.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.897+0000 7f7ef8a62640 1 --2- 172.21.15.181:0/2080902469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ef419c3e0 0x7f7ef419e8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00ba50 tx=0x7f7eec00bf10 comp rx=0 tx=0).stop 2024-08-25T23:54:26.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.897+0000 7f7ef8a62640 1 -- 172.21.15.181:0/2080902469 shutdown_connections 2024-08-25T23:54:26.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.897+0000 7f7ef8a62640 1 --2- 172.21.15.181:0/2080902469 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7ee00394f0 0x7f7ee003b9b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:26.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.897+0000 7f7ef8a62640 1 --2- 172.21.15.181:0/2080902469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ef419c3e0 0x7f7ef419e8a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:26.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.897+0000 7f7ef8a62640 1 --2- 172.21.15.181:0/2080902469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ef4199ab0 0x7f7ef419bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:26.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.897+0000 7f7ef8a62640 1 --2- 172.21.15.181:0/2080902469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ef4100390 0x7f7ef406ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:26.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.897+0000 7f7ef8a62640 1 -- 172.21.15.181:0/2080902469 >> 172.21.15.181:0/2080902469 conn(0x7f7ef40fbb40 msgr2=0x7f7ef40fc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:54:26.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.897+0000 7f7ef8a62640 1 -- 172.21.15.181:0/2080902469 shutdown_connections 2024-08-25T23:54:26.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:54:26.897+0000 7f7ef8a62640 1 -- 172.21.15.181:0/2080902469 wait complete. 2024-08-25T23:54:27.487 DEBUG:teuthology.orchestra.run.smithi043:mgr.y> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mgr.y.service 2024-08-25T23:54:27.490 DEBUG:teuthology.orchestra.run.smithi181:mgr.z> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mgr.z.service 2024-08-25T23:54:27.493 INFO:tasks.cephadm:Deploying OSDs... 2024-08-25T23:54:27.493 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-25T23:54:27.493 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/scratch_devs of=/dev/stdout 2024-08-25T23:54:27.529 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-25T23:54:27.529 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_1 2024-08-25T23:54:27.606 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-25T23:54:27.606 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-25T23:54:27.607 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 639 Links: 1 2024-08-25T23:54:27.607 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-25T23:54:27.607 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-08-25T23:54:27.607 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-08-25 23:53:45.386326044 +0000 2024-08-25T23:54:27.607 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-08-25 23:49:19.219343765 +0000 2024-08-25T23:54:27.607 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-08-25 23:49:19.219343765 +0000 2024-08-25T23:54:27.607 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-08-25 23:49:19.219343765 +0000 2024-08-25T23:54:27.607 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-25T23:54:27.703 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-08-25T23:54:27.704 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-08-25T23:54:27.704 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000186128 s, 2.8 MB/s 2024-08-25T23:54:27.706 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-25T23:54:27.746 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_2 2024-08-25T23:54:27.823 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-25T23:54:27.823 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-25T23:54:27.823 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 658 Links: 1 2024-08-25T23:54:27.823 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-25T23:54:27.823 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-08-25T23:54:27.823 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-08-25 23:53:45.438325602 +0000 2024-08-25T23:54:27.823 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-08-25 23:49:19.709339726 +0000 2024-08-25T23:54:27.824 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-08-25 23:49:19.709339726 +0000 2024-08-25T23:54:27.824 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-08-25 23:49:19.709339726 +0000 2024-08-25T23:54:27.824 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-25T23:54:27.921 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-08-25T23:54:27.921 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-08-25T23:54:27.921 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000162195 s, 3.2 MB/s 2024-08-25T23:54:27.923 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-25T23:54:27.960 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_3 2024-08-25T23:54:28.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:27 smithi042 ceph-mon[17225]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:28.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:27 smithi042 ceph-mon[17225]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi042=x;smithi043=y;smithi181=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:54:28.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:27 smithi042 ceph-mon[17225]: Saving service mgr spec with placement smithi042=x;smithi043=y;smithi181=z;count:3 2024-08-25T23:54:28.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:27 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:28.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:27 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:28.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:27 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:28.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:27 smithi042 ceph-mon[17225]: Reconfiguring mgr.x (unknown last config time)... 2024-08-25T23:54:28.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:27 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-25T23:54:28.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:27 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-25T23:54:28.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:27 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:28.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:27 smithi042 ceph-mon[17225]: Reconfiguring daemon mgr.x on smithi042 2024-08-25T23:54:28.035 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:27 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:28.037 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-25T23:54:28.037 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-25T23:54:28.037 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 677 Links: 1 2024-08-25T23:54:28.037 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-25T23:54:28.037 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-08-25T23:54:28.037 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-08-25 23:53:45.492325142 +0000 2024-08-25T23:54:28.037 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-08-25 23:49:20.169335936 +0000 2024-08-25T23:54:28.037 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-08-25 23:49:20.169335936 +0000 2024-08-25T23:54:28.037 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-08-25 23:49:20.169335936 +0000 2024-08-25T23:54:28.038 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-25T23:54:28.131 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-08-25T23:54:28.131 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-08-25T23:54:28.132 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000174225 s, 2.9 MB/s 2024-08-25T23:54:28.134 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-25T23:54:28.171 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_4 2024-08-25T23:54:28.247 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-25T23:54:28.247 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-25T23:54:28.248 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 696 Links: 1 2024-08-25T23:54:28.248 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-25T23:54:28.248 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-08-25T23:54:28.248 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-08-25 23:53:45.542324717 +0000 2024-08-25T23:54:28.248 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-08-25 23:49:20.640332054 +0000 2024-08-25T23:54:28.248 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-08-25 23:49:20.640332054 +0000 2024-08-25T23:54:28.249 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-08-25 23:49:20.640332054 +0000 2024-08-25T23:54:28.249 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-25T23:54:28.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:27 smithi043 ceph-mon[22091]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:28.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:27 smithi043 ceph-mon[22091]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi042=x;smithi043=y;smithi181=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:54:28.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:27 smithi043 ceph-mon[22091]: Saving service mgr spec with placement smithi042=x;smithi043=y;smithi181=z;count:3 2024-08-25T23:54:28.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:27 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:28.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:27 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:28.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:27 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:28.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:27 smithi043 ceph-mon[22091]: Reconfiguring mgr.x (unknown last config time)... 2024-08-25T23:54:28.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:27 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-25T23:54:28.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:27 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-25T23:54:28.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:27 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:28.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:27 smithi043 ceph-mon[22091]: Reconfiguring daemon mgr.x on smithi042 2024-08-25T23:54:28.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:27 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:28.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:27 smithi181 ceph-mon[22102]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:28.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:27 smithi181 ceph-mon[22102]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi042=x;smithi043=y;smithi181=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:54:28.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:27 smithi181 ceph-mon[22102]: Saving service mgr spec with placement smithi042=x;smithi043=y;smithi181=z;count:3 2024-08-25T23:54:28.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:27 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:28.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:27 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:28.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:27 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:28.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:27 smithi181 ceph-mon[22102]: Reconfiguring mgr.x (unknown last config time)... 2024-08-25T23:54:28.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:27 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-25T23:54:28.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:27 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-25T23:54:28.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:27 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:28.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:27 smithi181 ceph-mon[22102]: Reconfiguring daemon mgr.x on smithi042 2024-08-25T23:54:28.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:27 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:28.340 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-08-25T23:54:28.340 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-08-25T23:54:28.340 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.00017229 s, 3.0 MB/s 2024-08-25T23:54:28.343 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-25T23:54:28.380 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-08-25T23:54:28.381 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/scratch_devs of=/dev/stdout 2024-08-25T23:54:28.400 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-25T23:54:28.400 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_1 2024-08-25T23:54:28.459 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-25T23:54:28.459 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-25T23:54:28.459 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-08-25T23:54:28.459 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-25T23:54:28.459 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-08-25T23:54:28.459 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-08-25 23:54:17.173364248 +0000 2024-08-25T23:54:28.459 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-08-25 23:49:20.108384600 +0000 2024-08-25T23:54:28.459 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-08-25 23:49:20.108384600 +0000 2024-08-25T23:54:28.459 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-08-25 23:49:20.108384600 +0000 2024-08-25T23:54:28.459 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-25T23:54:28.527 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-08-25T23:54:28.527 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-08-25T23:54:28.527 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000117695 s, 4.4 MB/s 2024-08-25T23:54:28.528 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-25T23:54:28.587 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_2 2024-08-25T23:54:28.644 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-25T23:54:28.644 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-25T23:54:28.644 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-08-25T23:54:28.645 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-25T23:54:28.645 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-08-25T23:54:28.645 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-08-25 23:54:17.174364237 +0000 2024-08-25T23:54:28.645 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-08-25 23:49:20.434380883 +0000 2024-08-25T23:54:28.645 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-08-25 23:49:20.434380883 +0000 2024-08-25T23:54:28.645 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-08-25 23:49:20.434380883 +0000 2024-08-25T23:54:28.646 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-25T23:54:28.711 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-08-25T23:54:28.711 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-08-25T23:54:28.711 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000118636 s, 4.3 MB/s 2024-08-25T23:54:28.712 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-25T23:54:28.770 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_3 2024-08-25T23:54:28.827 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-25T23:54:28.827 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-25T23:54:28.827 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-08-25T23:54:28.827 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-25T23:54:28.827 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-08-25T23:54:28.827 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-08-25 23:54:17.174364237 +0000 2024-08-25T23:54:28.827 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-08-25 23:49:20.759377178 +0000 2024-08-25T23:54:28.827 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-08-25 23:49:20.759377178 +0000 2024-08-25T23:54:28.827 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-08-25 23:49:20.759377178 +0000 2024-08-25T23:54:28.828 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-25T23:54:28.893 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-08-25T23:54:28.894 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-08-25T23:54:28.894 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000114077 s, 4.5 MB/s 2024-08-25T23:54:28.895 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-25T23:54:28.952 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_4 2024-08-25T23:54:29.022 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-25T23:54:29.022 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-25T23:54:29.023 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-08-25T23:54:29.023 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-25T23:54:29.023 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-08-25T23:54:29.023 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-08-25 23:54:17.174364237 +0000 2024-08-25T23:54:29.023 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-08-25 23:49:21.095373329 +0000 2024-08-25T23:54:29.023 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-08-25 23:49:21.095373329 +0000 2024-08-25T23:54:29.023 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-08-25 23:49:21.095373329 +0000 2024-08-25T23:54:29.023 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-25T23:54:29.085 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-08-25T23:54:29.085 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-08-25T23:54:29.086 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 9.8916e-05 s, 5.2 MB/s 2024-08-25T23:54:29.087 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-25T23:54:29.146 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-25T23:54:29.146 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/scratch_devs of=/dev/stdout 2024-08-25T23:54:29.165 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-25T23:54:29.166 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_1 2024-08-25T23:54:29.224 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-25T23:54:29.224 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-25T23:54:29.224 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-08-25T23:54:29.224 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-25T23:54:29.224 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-08-25T23:54:29.224 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-08-25 23:54:08.395541465 +0000 2024-08-25T23:54:29.224 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-08-25 23:49:19.071929037 +0000 2024-08-25T23:54:29.224 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-08-25 23:49:19.071929037 +0000 2024-08-25T23:54:29.224 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-08-25 23:49:19.071929037 +0000 2024-08-25T23:54:29.225 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-25T23:54:29.291 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-08-25T23:54:29.291 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-08-25T23:54:29.291 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.00022881 s, 2.2 MB/s 2024-08-25T23:54:29.293 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-25T23:54:29.352 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_2 2024-08-25T23:54:29.409 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-25T23:54:29.409 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-25T23:54:29.409 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-08-25T23:54:29.409 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-25T23:54:29.409 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-08-25T23:54:29.409 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-08-25 23:54:08.395541465 +0000 2024-08-25T23:54:29.409 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-08-25 23:49:19.403922057 +0000 2024-08-25T23:54:29.409 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-08-25 23:49:19.403922057 +0000 2024-08-25T23:54:29.410 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-08-25 23:49:19.403922057 +0000 2024-08-25T23:54:29.410 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-25T23:54:29.475 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-08-25T23:54:29.475 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-08-25T23:54:29.475 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000198316 s, 2.6 MB/s 2024-08-25T23:54:29.476 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-25T23:54:29.533 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_3 2024-08-25T23:54:29.589 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-25T23:54:29.589 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-25T23:54:29.589 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-08-25T23:54:29.590 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-25T23:54:29.590 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-08-25T23:54:29.590 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-08-25 23:54:08.396541445 +0000 2024-08-25T23:54:29.590 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-08-25 23:49:19.734915098 +0000 2024-08-25T23:54:29.590 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-08-25 23:49:19.734915098 +0000 2024-08-25T23:54:29.590 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-08-25 23:49:19.734915098 +0000 2024-08-25T23:54:29.590 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-25T23:54:29.654 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-08-25T23:54:29.654 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-08-25T23:54:29.654 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000193531 s, 2.6 MB/s 2024-08-25T23:54:29.655 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-25T23:54:29.712 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_4 2024-08-25T23:54:29.769 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-25T23:54:29.769 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-25T23:54:29.769 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-08-25T23:54:29.769 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-25T23:54:29.769 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-08-25T23:54:29.769 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-08-25 23:54:08.396541445 +0000 2024-08-25T23:54:29.769 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-08-25 23:49:20.064908159 +0000 2024-08-25T23:54:29.769 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-08-25 23:49:20.064908159 +0000 2024-08-25T23:54:29.769 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-08-25 23:49:20.064908159 +0000 2024-08-25T23:54:29.770 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-25T23:54:29.833 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-08-25T23:54:29.833 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-08-25T23:54:29.833 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000193867 s, 2.6 MB/s 2024-08-25T23:54:29.834 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-25T23:54:29.891 INFO:tasks.cephadm:Deploying osd.0 on smithi042 with /dev/vg_nvme/lv_4... 2024-08-25T23:54:29.891 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-25T23:54:30.194 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:29 smithi043 ceph-mon[22091]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:30.195 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:29 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:30.195 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:29 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:30.195 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:29 smithi043 ceph-mon[22091]: Reconfiguring mon.b (monmap changed)... 2024-08-25T23:54:30.195 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:29 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-25T23:54:30.195 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:29 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-25T23:54:30.195 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:29 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:30.195 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:29 smithi043 ceph-mon[22091]: Reconfiguring daemon mon.b on smithi043 2024-08-25T23:54:30.268 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:54:30.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:29 smithi042 ceph-mon[17225]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:30.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:29 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:30.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:29 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:30.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:29 smithi042 ceph-mon[17225]: Reconfiguring mon.b (monmap changed)... 2024-08-25T23:54:30.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:29 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-25T23:54:30.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:29 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-25T23:54:30.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:29 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:30.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:29 smithi042 ceph-mon[17225]: Reconfiguring daemon mon.b on smithi043 2024-08-25T23:54:30.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:29 smithi181 ceph-mon[22102]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:30.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:29 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:30.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:29 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:30.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:29 smithi181 ceph-mon[22102]: Reconfiguring mon.b (monmap changed)... 2024-08-25T23:54:30.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:29 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-25T23:54:30.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:29 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-25T23:54:30.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:29 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:30.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:29 smithi181 ceph-mon[22102]: Reconfiguring daemon mon.b on smithi043 2024-08-25T23:54:31.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:31 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:31.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:31 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:31.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:31 smithi042 ceph-mon[17225]: Reconfiguring mon.c (monmap changed)... 2024-08-25T23:54:31.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:31 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-25T23:54:31.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:31 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-25T23:54:31.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:31 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:31.417 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:31 smithi042 ceph-mon[17225]: Reconfiguring daemon mon.c on smithi181 2024-08-25T23:54:31.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:31 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:31.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:31 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:31.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:31 smithi043 ceph-mon[22091]: Reconfiguring mon.c (monmap changed)... 2024-08-25T23:54:31.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:31 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-25T23:54:31.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:31 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-25T23:54:31.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:31 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:31.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:31 smithi043 ceph-mon[22091]: Reconfiguring daemon mon.c on smithi181 2024-08-25T23:54:31.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:31 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:31.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:31 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:31.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:31 smithi181 ceph-mon[22102]: Reconfiguring mon.c (monmap changed)... 2024-08-25T23:54:31.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:31 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-25T23:54:31.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:31 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-25T23:54:31.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:31 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:31.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:31 smithi181 ceph-mon[22102]: Reconfiguring daemon mon.c on smithi181 2024-08-25T23:54:32.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:32 smithi043 ceph-mon[22091]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:32.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:32.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:32.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:54:32.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:32.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:54:32.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:32.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-25T23:54:32.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-25T23:54:32.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-25T23:54:32.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:32.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:32 smithi042 ceph-mon[17225]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:32.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:32.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:32.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:54:32.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:32.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:54:32.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:32.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-25T23:54:32.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-25T23:54:32.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-25T23:54:32.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:32.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:32 smithi181 ceph-mon[22102]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:32.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:32.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:32.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:54:32.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:32.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:54:32.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:32.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-25T23:54:32.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-25T23:54:32.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-25T23:54:32.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:33.142 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:54:33.173 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph orch daemon add osd smithi042:vg_nvme/lv_4 2024-08-25T23:54:33.224 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:33 smithi181 systemd[1]: Starting Ceph mgr.z for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-25T23:54:33.490 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:33 smithi181 ceph-mon[22102]: Deploying daemon mgr.z on smithi181 2024-08-25T23:54:33.491 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:33 smithi181 podman[23890]: 2024-08-25 23:54:33.126663642 +0000 UTC m=+0.015650587 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34 2024-08-25T23:54:33.491 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:33 smithi181 podman[23890]: 2024-08-25 23:54:33.229796555 +0000 UTC m=+0.118783499 container create 89be3d7353b3aa529ff3b7f72f93a9d5a4120c1c68986719ac919da1d1f6e4cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f273685, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-08-25T23:54:33.491 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:33 smithi181 podman[23890]: 2024-08-25 23:54:33.41573256 +0000 UTC m=+0.304719505 container init 89be3d7353b3aa529ff3b7f72f93a9d5a4120c1c68986719ac919da1d1f6e4cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f273685, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-25T23:54:33.491 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:33 smithi181 podman[23890]: 2024-08-25 23:54:33.418708645 +0000 UTC m=+0.307695599 container start 89be3d7353b3aa529ff3b7f72f93a9d5a4120c1c68986719ac919da1d1f6e4cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-f273685, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-25T23:54:33.491 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:33 smithi181 ceph-mgr[23908]: -- 172.21.15.181:0/546798905 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b7c711b0e0 con 0x55b7c70f8800 2024-08-25T23:54:33.491 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:33 smithi181 bash[23890]: 89be3d7353b3aa529ff3b7f72f93a9d5a4120c1c68986719ac919da1d1f6e4cd 2024-08-25T23:54:33.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:33 smithi043 ceph-mon[22091]: Deploying daemon mgr.z on smithi181 2024-08-25T23:54:33.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:33 smithi042 ceph-mon[17225]: Deploying daemon mgr.z on smithi181 2024-08-25T23:54:33.541 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:54:33.783 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:33 smithi181 systemd[1]: Started Ceph mgr.z for f89d317a-633c-11ef-bcd2-c7b262605968. 2024-08-25T23:54:34.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.028+0000 7f1062400640 1 -- 172.21.15.42:0/1538399037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f105c104da0 msgr2=0x7f105c105220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:34.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.028+0000 7f1062400640 1 --2- 172.21.15.42:0/1538399037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f105c104da0 0x7f105c105220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1048009860 tx=0x7f104802a340 comp rx=0 tx=0).stop 2024-08-25T23:54:34.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.029+0000 7f1062400640 1 -- 172.21.15.42:0/1538399037 shutdown_connections 2024-08-25T23:54:34.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.029+0000 7f1062400640 1 --2- 172.21.15.42:0/1538399037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f105c105760 0x7f105c10bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:34.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.029+0000 7f1062400640 1 --2- 172.21.15.42:0/1538399037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f105c104da0 0x7f105c105220 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:34.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.029+0000 7f1062400640 1 --2- 172.21.15.42:0/1538399037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f105c103ba0 0x7f105c103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:34.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.029+0000 7f1062400640 1 -- 172.21.15.42:0/1538399037 >> 172.21.15.42:0/1538399037 conn(0x7f105c0ff350 msgr2=0x7f105c101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:54:34.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.029+0000 7f1062400640 1 -- 172.21.15.42:0/1538399037 shutdown_connections 2024-08-25T23:54:34.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.029+0000 7f1062400640 1 -- 172.21.15.42:0/1538399037 wait complete. 2024-08-25T23:54:34.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.030+0000 7f1062400640 1 Processor -- start 2024-08-25T23:54:34.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.030+0000 7f1062400640 1 -- start start 2024-08-25T23:54:34.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.030+0000 7f1062400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f105c103ba0 0x7f105c199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:34.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.030+0000 7f1062400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f105c104da0 0x7f105c19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:34.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.030+0000 7f1062400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f105c105760 0x7f105c1a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:34.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.030+0000 7f1062400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f105c10f820 con 0x7f105c103ba0 2024-08-25T23:54:34.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.030+0000 7f1062400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f105c10f6a0 con 0x7f105c104da0 2024-08-25T23:54:34.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.030+0000 7f1062400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f105c10f9a0 con 0x7f105c105760 2024-08-25T23:54:34.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.030+0000 7f105be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f105c105760 0x7f105c1a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:34.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.030+0000 7f105b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f105c103ba0 0x7f105c199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:34.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.030+0000 7f105be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f105c105760 0x7f105c1a1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:44378/0 (socket says 172.21.15.42:44378) 2024-08-25T23:54:34.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.030+0000 7f105be00640 1 -- 172.21.15.42:0/1085989356 learned_addr learned my addr 172.21.15.42:0/1085989356 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:54:34.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.030+0000 7f105aa00640 1 --2- 172.21.15.42:0/1085989356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f105c104da0 0x7f105c19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:34.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.031+0000 7f105aa00640 1 -- 172.21.15.42:0/1085989356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f105c105760 msgr2=0x7f105c1a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:34.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.031+0000 7f105aa00640 1 --2- 172.21.15.42:0/1085989356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f105c105760 0x7f105c1a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:34.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.031+0000 7f105aa00640 1 -- 172.21.15.42:0/1085989356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f105c103ba0 msgr2=0x7f105c199ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:34.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.031+0000 7f105aa00640 1 --2- 172.21.15.42:0/1085989356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f105c103ba0 0x7f105c199ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:34.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.031+0000 7f105aa00640 1 -- 172.21.15.42:0/1085989356 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f105c1a1ad0 con 0x7f105c104da0 2024-08-25T23:54:34.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.031+0000 7f105be00640 1 --2- 172.21.15.42:0/1085989356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f105c105760 0x7f105c1a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-25T23:54:34.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.031+0000 7f105aa00640 1 --2- 172.21.15.42:0/1085989356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f105c104da0 0x7f105c19a3e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1048035040 tx=0x7f1048033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:54:34.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.031+0000 7f1053e00640 1 -- 172.21.15.42:0/1085989356 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1048037040 con 0x7f105c104da0 2024-08-25T23:54:34.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.032+0000 7f1053e00640 1 -- 172.21.15.42:0/1085989356 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1048030850 con 0x7f105c104da0 2024-08-25T23:54:34.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.032+0000 7f1062400640 1 -- 172.21.15.42:0/1085989356 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f105c1a1d60 con 0x7f105c104da0 2024-08-25T23:54:34.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.032+0000 7f1053e00640 1 -- 172.21.15.42:0/1085989356 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1048004920 con 0x7f105c104da0 2024-08-25T23:54:34.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.032+0000 7f1062400640 1 -- 172.21.15.42:0/1085989356 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f105c1a21c0 con 0x7f105c104da0 2024-08-25T23:54:34.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.033+0000 7f1062400640 1 -- 172.21.15.42:0/1085989356 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f105c10afc0 con 0x7f105c104da0 2024-08-25T23:54:34.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.033+0000 7f1053e00640 1 -- 172.21.15.42:0/1085989356 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f1048004050 con 0x7f105c104da0 2024-08-25T23:54:34.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.033+0000 7f1053e00640 1 --2- 172.21.15.42:0/1085989356 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f10400392c0 0x7f104003b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:54:34.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.033+0000 7f1053e00640 1 -- 172.21.15.42:0/1085989356 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f104806c240 con 0x7f105c104da0 2024-08-25T23:54:34.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.034+0000 7f105b400640 1 --2- 172.21.15.42:0/1085989356 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f10400392c0 0x7f104003b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:54:34.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.034+0000 7f105b400640 1 --2- 172.21.15.42:0/1085989356 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f10400392c0 0x7f104003b780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f105c104c00 tx=0x7f104c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:54:34.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.039+0000 7f1053e00640 1 -- 172.21.15.42:0/1085989356 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f104803f1c0 con 0x7f105c104da0 2024-08-25T23:54:34.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:34.232+0000 7f1062400640 1 -- 172.21.15.42:0/1085989356 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f105c0623d0 con 0x7f10400392c0 2024-08-25T23:54:34.260 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:33.917+0000 7fafd5693040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-25T23:54:34.261 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:34.060+0000 7fafd5693040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-25T23:54:34.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:34 smithi043 ceph-mon[22091]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:34.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:34.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:34.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:34.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-25T23:54:34.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-25T23:54:34.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-25T23:54:34.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:34.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:54:34.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:54:34.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:34.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:34 smithi042 ceph-mon[17225]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:34.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:34.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:34.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:34.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-25T23:54:34.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-25T23:54:34.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-25T23:54:34.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:34.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:54:34.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:54:34.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:34.534 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:34.264+0000 7fafd5693040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-25T23:54:34.535 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:34.412+0000 7fafd5693040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-25T23:54:34.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:34 smithi181 ceph-mon[22102]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:34.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:34.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:34.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:34.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-25T23:54:34.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-25T23:54:34.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-25T23:54:34.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:34.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:54:34.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:54:34.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:34.875 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:34.555+0000 7fafd5693040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-25T23:54:34.875 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:34.751+0000 7fafd5693040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-25T23:54:34.875 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:34.874+0000 7fafd5693040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-25T23:54:35.151 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:34.938+0000 7fafd5693040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-25T23:54:35.151 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:35 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:35.006+0000 7fafd5693040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-25T23:54:35.151 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:35 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:35.150+0000 7fafd5693040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-25T23:54:35.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:35 smithi043 ceph-mon[22091]: Deploying daemon mgr.y on smithi043 2024-08-25T23:54:35.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:35 smithi043 ceph-mon[22091]: from='client.24107 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:54:35.511 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:35 smithi043 systemd[1]: Starting Ceph mgr.y for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-25T23:54:35.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:35 smithi042 ceph-mon[17225]: Deploying daemon mgr.y on smithi043 2024-08-25T23:54:35.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:35 smithi042 ceph-mon[17225]: from='client.24107 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:54:35.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:35 smithi181 ceph-mon[22102]: Deploying daemon mgr.y on smithi043 2024-08-25T23:54:35.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:35 smithi181 ceph-mon[22102]: from='client.24107 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:54:35.534 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:35 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:35.206+0000 7fafd5693040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-25T23:54:35.896 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:35 smithi043 podman[23442]: 2024-08-25 23:54:35.610007224 +0000 UTC m=+0.104115492 container create 676365bc2567502b3c9fe0231a55c44b9a0da27e91a8b356676c1d2ad0d4edc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-f273685, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-08-25T23:54:35.896 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:35 smithi043 podman[23442]: 2024-08-25 23:54:35.521768869 +0000 UTC m=+0.015877105 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34 2024-08-25T23:54:35.896 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:35 smithi043 podman[23442]: 2024-08-25 23:54:35.820610314 +0000 UTC m=+0.314718541 container init 676365bc2567502b3c9fe0231a55c44b9a0da27e91a8b356676c1d2ad0d4edc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f273685, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-25T23:54:35.896 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:35 smithi043 podman[23442]: 2024-08-25 23:54:35.823199257 +0000 UTC m=+0.317307483 container start 676365bc2567502b3c9fe0231a55c44b9a0da27e91a8b356676c1d2ad0d4edc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y, ceph=True, RELEASE=squid-f273685, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-08-25T23:54:35.896 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:35 smithi043 ceph-mgr[23461]: -- 172.21.15.43:0/1414102954 <== mon.2 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55adb1acb0e0 con 0x55adb1aa9400 2024-08-25T23:54:35.896 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:35 smithi043 bash[23442]: 676365bc2567502b3c9fe0231a55c44b9a0da27e91a8b356676c1d2ad0d4edc8 2024-08-25T23:54:36.034 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:35 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:35.646+0000 7fafd5693040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-25T23:54:36.034 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:35 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:35.707+0000 7fafd5693040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-25T23:54:36.034 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:35 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:35.764+0000 7fafd5693040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-25T23:54:36.260 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:35 smithi043 systemd[1]: Started Ceph mgr.y for f89d317a-633c-11ef-bcd2-c7b262605968. 2024-08-25T23:54:36.519 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:36 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:36.342+0000 7f080cbb6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-25T23:54:36.519 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:36 smithi043 ceph-mon[22091]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:36.519 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:36 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:36.519 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:36 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:36.520 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:36 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:36.520 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:36 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:36.520 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:36 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:54:36.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:36 smithi042 ceph-mon[17225]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:36.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:36 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:36.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:36 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:36.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:36 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:36.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:36 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:36.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:36 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:54:36.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:36 smithi181 ceph-mon[22102]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:36.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:36 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:36.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:36 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:36.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:36 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:36.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:36 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:36.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:36 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:54:36.843 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:36 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:36.518+0000 7f080cbb6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-25T23:54:36.843 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:36 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:36.734+0000 7f080cbb6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-25T23:54:37.020 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:36 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:36.952+0000 7fafd5693040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-25T23:54:37.021 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:37 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:37.018+0000 7fafd5693040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-25T23:54:37.258 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:36 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:36.894+0000 7f080cbb6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-25T23:54:37.258 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:37 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:37.044+0000 7f080cbb6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-25T23:54:37.258 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:37 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:37.257+0000 7f080cbb6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-25T23:54:37.283 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:37 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:37.088+0000 7fafd5693040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-25T23:54:37.284 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:37 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:37.161+0000 7fafd5693040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-25T23:54:37.510 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:37 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:37.387+0000 7f080cbb6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-25T23:54:37.510 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:37 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:37.454+0000 7f080cbb6040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-25T23:54:37.783 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:37 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:37.323+0000 7fafd5693040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-25T23:54:37.784 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:37 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:37.382+0000 7fafd5693040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-25T23:54:37.784 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:37 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:37.505+0000 7fafd5693040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-25T23:54:38.011 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:37 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:37.525+0000 7f080cbb6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-25T23:54:38.011 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:37 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:37.675+0000 7f080cbb6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-25T23:54:38.011 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:37 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:37.734+0000 7f080cbb6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-25T23:54:38.284 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:37 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:37.989+0000 7fafd5693040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-25T23:54:38.284 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:38 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:38.050+0000 7fafd5693040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-25T23:54:38.284 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:38 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:38.235+0000 7fafd5693040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-25T23:54:38.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:38 smithi181 ceph-mon[22102]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:38.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:38.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:38.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:38.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:38.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:38.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:54:38.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:38.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:38 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/998220675' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "980d8635-bca1-4c5a-b78e-4b44f9315d68"}]: dispatch 2024-08-25T23:54:38.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:38 smithi181 ceph-mon[22102]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "980d8635-bca1-4c5a-b78e-4b44f9315d68"}]: dispatch 2024-08-25T23:54:38.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:38 smithi181 ceph-mon[22102]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "980d8635-bca1-4c5a-b78e-4b44f9315d68"}]': finished 2024-08-25T23:54:38.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:38 smithi181 ceph-mon[22102]: osdmap e5: 1 total, 0 up, 1 in 2024-08-25T23:54:38.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-25T23:54:38.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:54:38.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:38.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:54:38.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:38.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:38.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:38 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/855028096' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:54:38.510 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:38 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:38.195+0000 7f080cbb6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-25T23:54:38.510 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:38 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:38.257+0000 7f080cbb6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-25T23:54:38.510 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:38 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:38.316+0000 7f080cbb6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-25T23:54:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:38 smithi043 ceph-mon[22091]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:54:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:38 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/998220675' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "980d8635-bca1-4c5a-b78e-4b44f9315d68"}]: dispatch 2024-08-25T23:54:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:38 smithi043 ceph-mon[22091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "980d8635-bca1-4c5a-b78e-4b44f9315d68"}]: dispatch 2024-08-25T23:54:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:38 smithi043 ceph-mon[22091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "980d8635-bca1-4c5a-b78e-4b44f9315d68"}]': finished 2024-08-25T23:54:38.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:38 smithi043 ceph-mon[22091]: osdmap e5: 1 total, 0 up, 1 in 2024-08-25T23:54:38.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-25T23:54:38.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:54:38.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:38.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:54:38.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:38.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:38.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:38 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/855028096' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:54:38.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:38 smithi042 ceph-mon[17225]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:38.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:38.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:38.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:38.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:54:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:38 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/998220675' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "980d8635-bca1-4c5a-b78e-4b44f9315d68"}]: dispatch 2024-08-25T23:54:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:38 smithi042 ceph-mon[17225]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "980d8635-bca1-4c5a-b78e-4b44f9315d68"}]: dispatch 2024-08-25T23:54:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:38 smithi042 ceph-mon[17225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "980d8635-bca1-4c5a-b78e-4b44f9315d68"}]': finished 2024-08-25T23:54:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:38 smithi042 ceph-mon[17225]: osdmap e5: 1 total, 0 up, 1 in 2024-08-25T23:54:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-25T23:54:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:54:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:54:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:38 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/855028096' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:54:38.784 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 25 23:54:38 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z[23904]: 2024-08-25T23:54:38.301+0000 7fafd5693040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-25T23:54:39.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:39.146+0000 7f1053e00640 1 -- 172.21.15.42:0/1085989356 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7f1048004fe0 con 0x7f105c104da0 2024-08-25T23:54:39.497 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:39 smithi043 ceph-mon[22091]: Standby manager daemon z started 2024-08-25T23:54:39.497 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:39 smithi043 ceph-mon[22091]: from='mgr.? 172.21.15.181:0/2646479712' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-08-25T23:54:39.497 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:39 smithi043 ceph-mon[22091]: from='mgr.? 172.21.15.181:0/2646479712' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-25T23:54:39.497 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:39 smithi043 ceph-mon[22091]: from='mgr.? 172.21.15.181:0/2646479712' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-08-25T23:54:39.497 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:39 smithi043 ceph-mon[22091]: from='mgr.? 172.21.15.181:0/2646479712' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-25T23:54:39.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:39 smithi042 ceph-mon[17225]: Standby manager daemon z started 2024-08-25T23:54:39.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:39 smithi042 ceph-mon[17225]: from='mgr.? 172.21.15.181:0/2646479712' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-08-25T23:54:39.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:39 smithi042 ceph-mon[17225]: from='mgr.? 172.21.15.181:0/2646479712' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-25T23:54:39.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:39 smithi042 ceph-mon[17225]: from='mgr.? 172.21.15.181:0/2646479712' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-08-25T23:54:39.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:39 smithi042 ceph-mon[17225]: from='mgr.? 172.21.15.181:0/2646479712' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-25T23:54:39.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:39 smithi181 ceph-mon[22102]: Standby manager daemon z started 2024-08-25T23:54:39.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:39 smithi181 ceph-mon[22102]: from='mgr.? 172.21.15.181:0/2646479712' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-08-25T23:54:39.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:39 smithi181 ceph-mon[22102]: from='mgr.? 172.21.15.181:0/2646479712' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-25T23:54:39.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:39 smithi181 ceph-mon[22102]: from='mgr.? 172.21.15.181:0/2646479712' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-08-25T23:54:39.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:39 smithi181 ceph-mon[22102]: from='mgr.? 172.21.15.181:0/2646479712' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-25T23:54:39.760 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:39 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:39.496+0000 7f080cbb6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-25T23:54:39.760 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:39 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:39.564+0000 7f080cbb6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-25T23:54:39.760 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:39 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:39.632+0000 7f080cbb6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-25T23:54:39.760 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:39 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:39.702+0000 7f080cbb6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-25T23:54:40.147 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:39 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:39.867+0000 7f080cbb6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-25T23:54:40.147 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:39 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:39.928+0000 7f080cbb6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-25T23:54:40.147 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:40 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:40.052+0000 7f080cbb6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-25T23:54:40.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:40 smithi043 ceph-mon[22091]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:40.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:40 smithi043 ceph-mon[22091]: mgrmap e14: x(active, since 66s), standbys: z 2024-08-25T23:54:40.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:40 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-08-25T23:54:40.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:40 smithi042 ceph-mon[17225]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:40.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:40 smithi042 ceph-mon[17225]: mgrmap e14: x(active, since 66s), standbys: z 2024-08-25T23:54:40.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:40 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-08-25T23:54:40.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:40 smithi181 ceph-mon[22102]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:40.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:40 smithi181 ceph-mon[22102]: mgrmap e14: x(active, since 66s), standbys: z 2024-08-25T23:54:40.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:40 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-08-25T23:54:40.816 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:40 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:40.559+0000 7f080cbb6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-25T23:54:40.816 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:40 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:40.623+0000 7f080cbb6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-25T23:54:40.816 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:40 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:40.815+0000 7f080cbb6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-25T23:54:41.148 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 25 23:54:40 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y[23457]: 2024-08-25T23:54:40.885+0000 7f080cbb6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-25T23:54:41.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:41.157+0000 7f1053e00640 1 -- 172.21.15.42:0/1085989356 <== mon.2 v2:172.21.15.43:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f104803ac90 con 0x7f105c104da0 2024-08-25T23:54:41.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:41 smithi043 ceph-mon[22091]: Standby manager daemon y started 2024-08-25T23:54:41.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:41 smithi043 ceph-mon[22091]: from='mgr.? 172.21.15.43:0/4047751117' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-08-25T23:54:41.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:41 smithi043 ceph-mon[22091]: from='mgr.? 172.21.15.43:0/4047751117' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-25T23:54:41.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:41 smithi043 ceph-mon[22091]: from='mgr.? 172.21.15.43:0/4047751117' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-08-25T23:54:41.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:41 smithi043 ceph-mon[22091]: from='mgr.? 172.21.15.43:0/4047751117' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-25T23:54:41.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:41 smithi042 ceph-mon[17225]: Standby manager daemon y started 2024-08-25T23:54:41.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:41 smithi042 ceph-mon[17225]: from='mgr.? 172.21.15.43:0/4047751117' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-08-25T23:54:41.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:41 smithi042 ceph-mon[17225]: from='mgr.? 172.21.15.43:0/4047751117' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-25T23:54:41.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:41 smithi042 ceph-mon[17225]: from='mgr.? 172.21.15.43:0/4047751117' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-08-25T23:54:41.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:41 smithi042 ceph-mon[17225]: from='mgr.? 172.21.15.43:0/4047751117' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-25T23:54:41.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:41 smithi181 ceph-mon[22102]: Standby manager daemon y started 2024-08-25T23:54:41.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:41 smithi181 ceph-mon[22102]: from='mgr.? 172.21.15.43:0/4047751117' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-08-25T23:54:41.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:41 smithi181 ceph-mon[22102]: from='mgr.? 172.21.15.43:0/4047751117' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-25T23:54:41.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:41 smithi181 ceph-mon[22102]: from='mgr.? 172.21.15.43:0/4047751117' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-08-25T23:54:41.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:41 smithi181 ceph-mon[22102]: from='mgr.? 172.21.15.43:0/4047751117' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-25T23:54:42.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:42 smithi043 ceph-mon[22091]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:42.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:42 smithi043 ceph-mon[22091]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-08-25T23:54:42.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:42 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-08-25T23:54:42.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:42 smithi042 ceph-mon[17225]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:42.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:42 smithi042 ceph-mon[17225]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-08-25T23:54:42.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:42 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-08-25T23:54:42.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:42 smithi181 ceph-mon[22102]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:42.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:42 smithi181 ceph-mon[22102]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-08-25T23:54:42.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:42 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-08-25T23:54:44.204 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:44 smithi042 ceph-mon[17225]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:44.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:44 smithi043 ceph-mon[22091]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:44.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:44 smithi181 ceph-mon[22102]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:46.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:46 smithi042 ceph-mon[17225]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:46.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:46 smithi043 ceph-mon[22091]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:46.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:46 smithi181 ceph-mon[22102]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:47.221 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:47 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-25T23:54:47.222 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:47 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:47.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:47 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-25T23:54:47.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:47 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:47.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:47 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-25T23:54:47.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:47 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:48.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:48 smithi042 ceph-mon[17225]: Deploying daemon osd.0 on smithi042 2024-08-25T23:54:48.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:48 smithi042 ceph-mon[17225]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:48.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:48 smithi043 ceph-mon[22091]: Deploying daemon osd.0 on smithi042 2024-08-25T23:54:48.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:48 smithi043 ceph-mon[22091]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:48.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:48 smithi181 ceph-mon[22102]: Deploying daemon osd.0 on smithi042 2024-08-25T23:54:48.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:48 smithi181 ceph-mon[22102]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:50.349 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:50 smithi042 ceph-mon[17225]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:50.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:50 smithi043 ceph-mon[22091]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:50.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:50 smithi181 ceph-mon[22102]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:52.243 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:52 smithi042 ceph-mon[17225]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:52.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:52 smithi043 ceph-mon[22091]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:52.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:52 smithi181 ceph-mon[22102]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:54.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:54 smithi043 ceph-mon[22091]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:54.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:54 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:54:54.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:54 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:54.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:54 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:54.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:54 smithi042 ceph-mon[17225]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:54.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:54 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:54:54.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:54 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:54.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:54 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:54.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:54 smithi181 ceph-mon[22102]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:54.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:54 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:54:54.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:54 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:54.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:54 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:56.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:56 smithi043 ceph-mon[22091]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:56.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:56 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:56.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:56 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:56.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:56 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:56.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:56 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:54:56.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:56 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:56.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:56 smithi042 ceph-mon[17225]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:56.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:56.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:56.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:56.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:54:56.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:56.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:56 smithi181 ceph-mon[22102]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:56.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:56 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:56.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:56 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:56.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:56 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:54:56.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:56 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:54:56.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:56 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:58.263 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:58 smithi042 ceph-mon[17225]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:58.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:58.312+0000 7f1053e00640 1 -- 172.21.15.42:0/1085989356 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f105c0623d0 con 0x7f10400392c0 2024-08-25T23:54:58.315 INFO:teuthology.orchestra.run.smithi042.stdout:Created osd(s) 0 on host 'smithi042' 2024-08-25T23:54:58.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:58.314+0000 7f1062400640 1 -- 172.21.15.42:0/1085989356 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f10400392c0 msgr2=0x7f104003b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:58.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:58.314+0000 7f1062400640 1 --2- 172.21.15.42:0/1085989356 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f10400392c0 0x7f104003b780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f105c104c00 tx=0x7f104c005f90 comp rx=0 tx=0).stop 2024-08-25T23:54:58.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:58.315+0000 7f1062400640 1 -- 172.21.15.42:0/1085989356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f105c104da0 msgr2=0x7f105c19a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:54:58.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:58.315+0000 7f1062400640 1 --2- 172.21.15.42:0/1085989356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f105c104da0 0x7f105c19a3e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1048035040 tx=0x7f1048033d90 comp rx=0 tx=0).stop 2024-08-25T23:54:58.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:58.315+0000 7f1062400640 1 -- 172.21.15.42:0/1085989356 shutdown_connections 2024-08-25T23:54:58.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:58.315+0000 7f1062400640 1 --2- 172.21.15.42:0/1085989356 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f10400392c0 0x7f104003b780 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:58.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:58.315+0000 7f1062400640 1 --2- 172.21.15.42:0/1085989356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f105c105760 0x7f105c1a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:58.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:58.315+0000 7f1062400640 1 --2- 172.21.15.42:0/1085989356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f105c104da0 0x7f105c19a3e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:58.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:58.315+0000 7f1062400640 1 --2- 172.21.15.42:0/1085989356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f105c103ba0 0x7f105c199ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:54:58.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:58.315+0000 7f1062400640 1 -- 172.21.15.42:0/1085989356 >> 172.21.15.42:0/1085989356 conn(0x7f105c0ff350 msgr2=0x7f105c108190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:54:58.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:58.315+0000 7f1062400640 1 -- 172.21.15.42:0/1085989356 shutdown_connections 2024-08-25T23:54:58.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:54:58.315+0000 7f1062400640 1 -- 172.21.15.42:0/1085989356 wait complete. 2024-08-25T23:54:58.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:58 smithi043 ceph-mon[22091]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:58.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:58 smithi181 ceph-mon[22102]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:54:59.003 DEBUG:teuthology.orchestra.run.smithi042:osd.0> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.0.service 2024-08-25T23:54:59.007 INFO:tasks.cephadm:Deploying osd.1 on smithi043 with /dev/vg_nvme/lv_4... 2024-08-25T23:54:59.007 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-25T23:54:59.256 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:59 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:54:59.256 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:59 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:59.256 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:54:59 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:59.265 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.b/config 2024-08-25T23:54:59.386 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:59 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:54:59.386 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:59 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:59.386 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:54:59 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:59.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:59 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:54:59.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:59 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:59.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:54:59 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:54:59.783 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 25 23:54:59 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-0[31013]: 2024-08-25T23:54:59.620+0000 7ff73bc48640 -1 osd.0 0 log_to_monitors true 2024-08-25T23:55:00.272 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:00 smithi042 ceph-mon[17225]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:55:00.272 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:00 smithi042 ceph-mon[17225]: from='osd.0 [v2:172.21.15.42:6802/2657450248,v1:172.21.15.42:6803/2657450248]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-25T23:55:00.438 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:00 smithi043 ceph-mon[22091]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:55:00.438 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:00 smithi043 ceph-mon[22091]: from='osd.0 [v2:172.21.15.42:6802/2657450248,v1:172.21.15.42:6803/2657450248]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-25T23:55:00.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:00 smithi181 ceph-mon[22102]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:55:00.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:00 smithi181 ceph-mon[22102]: from='osd.0 [v2:172.21.15.42:6802/2657450248,v1:172.21.15.42:6803/2657450248]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-25T23:55:01.513 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-08-25T23:55:01.539 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph orch daemon add osd smithi043:vg_nvme/lv_4 2024-08-25T23:55:01.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:01 smithi043 ceph-mon[22091]: from='osd.0 [v2:172.21.15.42:6802/2657450248,v1:172.21.15.42:6803/2657450248]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-25T23:55:01.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:01 smithi043 ceph-mon[22091]: osdmap e6: 1 total, 0 up, 1 in 2024-08-25T23:55:01.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:01 smithi043 ceph-mon[22091]: from='osd.0 [v2:172.21.15.42:6802/2657450248,v1:172.21.15.42:6803/2657450248]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-08-25T23:55:01.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:01 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-25T23:55:01.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:01 smithi043 ceph-mon[22091]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:55:01.766 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:01 smithi042 ceph-mon[17225]: from='osd.0 [v2:172.21.15.42:6802/2657450248,v1:172.21.15.42:6803/2657450248]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-25T23:55:01.766 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:01 smithi042 ceph-mon[17225]: osdmap e6: 1 total, 0 up, 1 in 2024-08-25T23:55:01.766 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:01 smithi042 ceph-mon[17225]: from='osd.0 [v2:172.21.15.42:6802/2657450248,v1:172.21.15.42:6803/2657450248]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-08-25T23:55:01.766 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:01 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-25T23:55:01.766 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:01 smithi042 ceph-mon[17225]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:55:01.766 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 25 23:55:01 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-0[31013]: 2024-08-25T23:55:01.340+0000 7ff735e00640 -1 osd.0 0 waiting for initial osdmap 2024-08-25T23:55:01.766 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 25 23:55:01 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-0[31013]: 2024-08-25T23:55:01.343+0000 7ff731800640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-25T23:55:01.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:01 smithi181 ceph-mon[22102]: from='osd.0 [v2:172.21.15.42:6802/2657450248,v1:172.21.15.42:6803/2657450248]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-25T23:55:01.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:01 smithi181 ceph-mon[22102]: osdmap e6: 1 total, 0 up, 1 in 2024-08-25T23:55:01.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:01 smithi181 ceph-mon[22102]: from='osd.0 [v2:172.21.15.42:6802/2657450248,v1:172.21.15.42:6803/2657450248]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-08-25T23:55:01.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:01 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-25T23:55:01.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:01 smithi181 ceph-mon[22102]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-25T23:55:01.786 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.b/config 2024-08-25T23:55:02.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.238+0000 7f17c3446640 1 -- 172.21.15.43:0/2199698384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17bc102ba0 msgr2=0x7f17bc103020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:55:02.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.238+0000 7f17c3446640 1 --2- 172.21.15.43:0/2199698384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17bc102ba0 0x7f17bc103020 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f17ac009900 tx=0x7f17ac02a410 comp rx=0 tx=0).stop 2024-08-25T23:55:02.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.238+0000 7f17c3446640 1 -- 172.21.15.43:0/2199698384 shutdown_connections 2024-08-25T23:55:02.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.238+0000 7f17c3446640 1 --2- 172.21.15.43:0/2199698384 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17bc103560 0x7f17bc109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:55:02.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.238+0000 7f17c3446640 1 --2- 172.21.15.43:0/2199698384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17bc102ba0 0x7f17bc103020 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:55:02.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.238+0000 7f17c3446640 1 --2- 172.21.15.43:0/2199698384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17bc1019a0 0x7f17bc101da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:55:02.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.239+0000 7f17c3446640 1 -- 172.21.15.43:0/2199698384 >> 172.21.15.43:0/2199698384 conn(0x7f17bc0fd130 msgr2=0x7f17bc0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:55:02.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.239+0000 7f17c3446640 1 -- 172.21.15.43:0/2199698384 shutdown_connections 2024-08-25T23:55:02.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.239+0000 7f17c3446640 1 -- 172.21.15.43:0/2199698384 wait complete. 2024-08-25T23:55:02.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.239+0000 7f17c3446640 1 Processor -- start 2024-08-25T23:55:02.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.239+0000 7f17c3446640 1 -- start start 2024-08-25T23:55:02.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.239+0000 7f17c3446640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17bc1019a0 0x7f17bc197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:55:02.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.239+0000 7f17c3446640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17bc102ba0 0x7f17bc198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:55:02.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.239+0000 7f17c3446640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17bc103560 0x7f17bc19f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:55:02.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.239+0000 7f17c3446640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc10d720 con 0x7f17bc103560 2024-08-25T23:55:02.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.239+0000 7f17c3446640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc10d5a0 con 0x7f17bc1019a0 2024-08-25T23:55:02.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.239+0000 7f17c3446640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc10d8a0 con 0x7f17bc102ba0 2024-08-25T23:55:02.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.239+0000 7f17c11e2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17bc1019a0 0x7f17bc197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:55:02.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.240+0000 7f17c11e2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17bc1019a0 0x7f17bc197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59332/0 (socket says 172.21.15.43:59332) 2024-08-25T23:55:02.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.240+0000 7f17c11e2640 1 -- 172.21.15.43:0/4267242334 learned_addr learned my addr 172.21.15.43:0/4267242334 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-08-25T23:55:02.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.240+0000 7f17c09e1640 1 --2- 172.21.15.43:0/4267242334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17bc102ba0 0x7f17bc198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:55:02.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.240+0000 7f17c11e2640 1 -- 172.21.15.43:0/4267242334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17bc102ba0 msgr2=0x7f17bc198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:55:02.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.240+0000 7f17c11e2640 1 --2- 172.21.15.43:0/4267242334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17bc102ba0 0x7f17bc198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:55:02.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.240+0000 7f17c11e2640 1 -- 172.21.15.43:0/4267242334 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17bc103560 msgr2=0x7f17bc19f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:55:02.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.240+0000 7f17c11e2640 1 --2- 172.21.15.43:0/4267242334 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17bc103560 0x7f17bc19f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:55:02.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.240+0000 7f17c11e2640 1 -- 172.21.15.43:0/4267242334 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17bc19fa60 con 0x7f17bc1019a0 2024-08-25T23:55:02.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.240+0000 7f17c11e2640 1 --2- 172.21.15.43:0/4267242334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17bc1019a0 0x7f17bc197e30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f17b800b450 tx=0x7f17b800b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:55:02.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.240+0000 7f17b27fc640 1 -- 172.21.15.43:0/4267242334 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b8015020 con 0x7f17bc1019a0 2024-08-25T23:55:02.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.240+0000 7f17b27fc640 1 -- 172.21.15.43:0/4267242334 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17b8011d70 con 0x7f17bc1019a0 2024-08-25T23:55:02.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.240+0000 7f17c3446640 1 -- 172.21.15.43:0/4267242334 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17bc19fd50 con 0x7f17bc1019a0 2024-08-25T23:55:02.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.240+0000 7f17b27fc640 1 -- 172.21.15.43:0/4267242334 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b800f340 con 0x7f17bc1019a0 2024-08-25T23:55:02.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.240+0000 7f17c3446640 1 -- 172.21.15.43:0/4267242334 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17bc1a0230 con 0x7f17bc1019a0 2024-08-25T23:55:02.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.241+0000 7f17c3446640 1 -- 172.21.15.43:0/4267242334 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17bc108e10 con 0x7f17bc1019a0 2024-08-25T23:55:02.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.242+0000 7f17b27fc640 1 -- 172.21.15.43:0/4267242334 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f17b8018020 con 0x7f17bc1019a0 2024-08-25T23:55:02.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.243+0000 7f17b27fc640 1 --2- 172.21.15.43:0/4267242334 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f17a80a2b20 0x7f17a80a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:55:02.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.243+0000 7f17b27fc640 1 -- 172.21.15.43:0/4267242334 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f17b80ccfe0 con 0x7f17bc1019a0 2024-08-25T23:55:02.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.243+0000 7f17c09e1640 1 --2- 172.21.15.43:0/4267242334 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f17a80a2b20 0x7f17a80a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:55:02.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.244+0000 7f17c09e1640 1 --2- 172.21.15.43:0/4267242334 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f17a80a2b20 0x7f17a80a4fe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f17ac000c00 tx=0x7f17ac031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:55:02.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.248+0000 7f17b27fc640 1 -- 172.21.15.43:0/4267242334 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f17b801f020 con 0x7f17bc1019a0 2024-08-25T23:55:02.429 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:02 smithi042 ceph-mon[17225]: from='osd.0 [v2:172.21.15.42:6802/2657450248,v1:172.21.15.42:6803/2657450248]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-08-25T23:55:02.429 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:02 smithi042 ceph-mon[17225]: osdmap e7: 1 total, 0 up, 1 in 2024-08-25T23:55:02.429 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-25T23:55:02.430 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-25T23:55:02.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:02.432+0000 7f17c3446640 1 -- 172.21.15.43:0/4267242334 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f17bc0623d0 con 0x7f17a80a2b20 2024-08-25T23:55:02.433 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:02 smithi043 ceph-mon[22091]: from='osd.0 [v2:172.21.15.42:6802/2657450248,v1:172.21.15.42:6803/2657450248]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-08-25T23:55:02.433 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:02 smithi043 ceph-mon[22091]: osdmap e7: 1 total, 0 up, 1 in 2024-08-25T23:55:02.433 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:02 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-25T23:55:02.433 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:02 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-25T23:55:02.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:02 smithi181 ceph-mon[22102]: from='osd.0 [v2:172.21.15.42:6802/2657450248,v1:172.21.15.42:6803/2657450248]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-08-25T23:55:02.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:02 smithi181 ceph-mon[22102]: osdmap e7: 1 total, 0 up, 1 in 2024-08-25T23:55:02.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:02 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-25T23:55:02.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:02 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-25T23:55:03.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:03 smithi043 ceph-mon[22091]: purged_snaps scrub starts 2024-08-25T23:55:03.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:03 smithi043 ceph-mon[22091]: purged_snaps scrub ok 2024-08-25T23:55:03.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:03 smithi043 ceph-mon[22091]: osd.0 [v2:172.21.15.42:6802/2657450248,v1:172.21.15.42:6803/2657450248] boot 2024-08-25T23:55:03.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:03 smithi043 ceph-mon[22091]: osdmap e8: 1 total, 1 up, 1 in 2024-08-25T23:55:03.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:03 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-25T23:55:03.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:03 smithi043 ceph-mon[22091]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:03.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:03 smithi043 ceph-mon[22091]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:55:03.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:03 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:55:03.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:03 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:55:03.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:03 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:03.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:03 smithi043 ceph-mon[22091]: Detected new or changed devices on smithi042 2024-08-25T23:55:03.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:03 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:03.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:03 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:03.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:03 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:55:03.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:03 smithi043 ceph-mon[22091]: Adjusting osd_memory_target on smithi042 to 17094M 2024-08-25T23:55:03.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:03 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:03.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:03 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:03.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:03 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:55:03.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:03 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:03.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:03 smithi042 ceph-mon[17225]: purged_snaps scrub starts 2024-08-25T23:55:03.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:03 smithi042 ceph-mon[17225]: purged_snaps scrub ok 2024-08-25T23:55:03.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:03 smithi042 ceph-mon[17225]: osd.0 [v2:172.21.15.42:6802/2657450248,v1:172.21.15.42:6803/2657450248] boot 2024-08-25T23:55:03.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:03 smithi042 ceph-mon[17225]: osdmap e8: 1 total, 1 up, 1 in 2024-08-25T23:55:03.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:03 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-25T23:55:03.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:03 smithi042 ceph-mon[17225]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:03.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:03 smithi042 ceph-mon[17225]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:55:03.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:03 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:55:03.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:03 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:55:03.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:03 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:03.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:03 smithi042 ceph-mon[17225]: Detected new or changed devices on smithi042 2024-08-25T23:55:03.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:03 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:03.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:03 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:03.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:03 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:55:03.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:03 smithi042 ceph-mon[17225]: Adjusting osd_memory_target on smithi042 to 17094M 2024-08-25T23:55:03.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:03 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:03.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:03 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:03.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:03 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:55:03.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:03 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:03.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:03 smithi181 ceph-mon[22102]: purged_snaps scrub starts 2024-08-25T23:55:03.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:03 smithi181 ceph-mon[22102]: purged_snaps scrub ok 2024-08-25T23:55:03.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:03 smithi181 ceph-mon[22102]: osd.0 [v2:172.21.15.42:6802/2657450248,v1:172.21.15.42:6803/2657450248] boot 2024-08-25T23:55:03.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:03 smithi181 ceph-mon[22102]: osdmap e8: 1 total, 1 up, 1 in 2024-08-25T23:55:03.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:03 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-25T23:55:03.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:03 smithi181 ceph-mon[22102]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:03.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:03 smithi181 ceph-mon[22102]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:55:03.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:03 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:55:03.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:03 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:55:03.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:03 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:03.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:03 smithi181 ceph-mon[22102]: Detected new or changed devices on smithi042 2024-08-25T23:55:03.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:03 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:03.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:03 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:03.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:03 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:55:03.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:03 smithi181 ceph-mon[22102]: Adjusting osd_memory_target on smithi042 to 17094M 2024-08-25T23:55:03.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:03 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:03.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:03 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:03.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:03 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:55:03.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:03 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:04.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:04 smithi043 ceph-mon[22091]: osdmap e9: 1 total, 1 up, 1 in 2024-08-25T23:55:04.795 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:04 smithi042 ceph-mon[17225]: osdmap e9: 1 total, 1 up, 1 in 2024-08-25T23:55:04.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:04 smithi181 ceph-mon[22102]: osdmap e9: 1 total, 1 up, 1 in 2024-08-25T23:55:05.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:05 smithi043 ceph-mon[22091]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:05.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:05 smithi043 ceph-mon[22091]: from='client.? 172.21.15.43:0/1793256736' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5f8dc3b-876a-4bdd-b6b0-b0d99d098d95"}]: dispatch 2024-08-25T23:55:05.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:05 smithi043 ceph-mon[22091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5f8dc3b-876a-4bdd-b6b0-b0d99d098d95"}]: dispatch 2024-08-25T23:55:05.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:05 smithi043 ceph-mon[22091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e5f8dc3b-876a-4bdd-b6b0-b0d99d098d95"}]': finished 2024-08-25T23:55:05.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:05 smithi043 ceph-mon[22091]: osdmap e10: 2 total, 1 up, 2 in 2024-08-25T23:55:05.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:05 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-25T23:55:05.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:05 smithi043 ceph-mon[22091]: from='client.? 172.21.15.43:0/2963733590' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:55:05.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:05 smithi042 ceph-mon[17225]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:05.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:05 smithi042 ceph-mon[17225]: from='client.? 172.21.15.43:0/1793256736' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5f8dc3b-876a-4bdd-b6b0-b0d99d098d95"}]: dispatch 2024-08-25T23:55:05.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:05 smithi042 ceph-mon[17225]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5f8dc3b-876a-4bdd-b6b0-b0d99d098d95"}]: dispatch 2024-08-25T23:55:05.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:05 smithi042 ceph-mon[17225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e5f8dc3b-876a-4bdd-b6b0-b0d99d098d95"}]': finished 2024-08-25T23:55:05.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:05 smithi042 ceph-mon[17225]: osdmap e10: 2 total, 1 up, 2 in 2024-08-25T23:55:05.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:05 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-25T23:55:05.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:05 smithi042 ceph-mon[17225]: from='client.? 172.21.15.43:0/2963733590' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:55:05.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:05 smithi181 ceph-mon[22102]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:05.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:05 smithi181 ceph-mon[22102]: from='client.? 172.21.15.43:0/1793256736' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5f8dc3b-876a-4bdd-b6b0-b0d99d098d95"}]: dispatch 2024-08-25T23:55:05.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:05 smithi181 ceph-mon[22102]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5f8dc3b-876a-4bdd-b6b0-b0d99d098d95"}]: dispatch 2024-08-25T23:55:05.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:05 smithi181 ceph-mon[22102]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e5f8dc3b-876a-4bdd-b6b0-b0d99d098d95"}]': finished 2024-08-25T23:55:05.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:05 smithi181 ceph-mon[22102]: osdmap e10: 2 total, 1 up, 2 in 2024-08-25T23:55:05.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:05 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-25T23:55:05.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:05 smithi181 ceph-mon[22102]: from='client.? 172.21.15.43:0/2963733590' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:55:07.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:07 smithi043 ceph-mon[22091]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:07.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:07 smithi042 ceph-mon[17225]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:07.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:07 smithi181 ceph-mon[22102]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:09.636 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:09 smithi043 ceph-mon[22091]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:09.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:09 smithi042 ceph-mon[17225]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:09.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:09 smithi181 ceph-mon[22102]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:11.624 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:11 smithi043 ceph-mon[22091]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:11.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:11 smithi042 ceph-mon[17225]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:11.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:11 smithi181 ceph-mon[22102]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:12.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:12 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-25T23:55:12.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:12 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:12.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:12 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-25T23:55:12.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:12 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:12.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:12 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-25T23:55:12.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:12 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:13.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:13 smithi043 ceph-mon[22091]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:13.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:13 smithi043 ceph-mon[22091]: Deploying daemon osd.1 on smithi043 2024-08-25T23:55:13.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:13 smithi042 ceph-mon[17225]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:13.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:13 smithi042 ceph-mon[17225]: Deploying daemon osd.1 on smithi043 2024-08-25T23:55:13.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:13 smithi181 ceph-mon[22102]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:13.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:13 smithi181 ceph-mon[22102]: Deploying daemon osd.1 on smithi043 2024-08-25T23:55:15.639 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:15 smithi043 ceph-mon[22091]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:15.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:15 smithi042 ceph-mon[17225]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:15.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:15 smithi181 ceph-mon[22102]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:17.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:17 smithi042 ceph-mon[17225]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:17.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:17 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:55:17.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:17 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:17.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:17 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:17.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:17 smithi181 ceph-mon[22102]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:17.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:17 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:55:17.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:17 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:17.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:17 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:17.857 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:17 smithi043 ceph-mon[22091]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:17.858 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:55:17.858 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:17.858 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:19.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:19 smithi043 ceph-mon[22091]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:19.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:19 smithi042 ceph-mon[17225]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:19.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:19 smithi181 ceph-mon[22102]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:20.820 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:20 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:20.820 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:20 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:20.820 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:20 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:20.820 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:20 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:55:20.820 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:20 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:20.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:20.818+0000 7f17b27fc640 1 -- 172.21.15.43:0/4267242334 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f17bc0623d0 con 0x7f17a80a2b20 2024-08-25T23:55:20.821 INFO:teuthology.orchestra.run.smithi043.stdout:Created osd(s) 1 on host 'smithi043' 2024-08-25T23:55:20.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:20.820+0000 7f17c3446640 1 -- 172.21.15.43:0/4267242334 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f17a80a2b20 msgr2=0x7f17a80a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:55:20.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:20.820+0000 7f17c3446640 1 --2- 172.21.15.43:0/4267242334 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f17a80a2b20 0x7f17a80a4fe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f17ac000c00 tx=0x7f17ac031400 comp rx=0 tx=0).stop 2024-08-25T23:55:20.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:20.820+0000 7f17c3446640 1 -- 172.21.15.43:0/4267242334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17bc1019a0 msgr2=0x7f17bc197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:55:20.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:20.820+0000 7f17c3446640 1 --2- 172.21.15.43:0/4267242334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17bc1019a0 0x7f17bc197e30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f17b800b450 tx=0x7f17b800b910 comp rx=0 tx=0).stop 2024-08-25T23:55:20.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:20.820+0000 7f17c3446640 1 -- 172.21.15.43:0/4267242334 shutdown_connections 2024-08-25T23:55:20.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:20.820+0000 7f17c3446640 1 --2- 172.21.15.43:0/4267242334 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f17a80a2b20 0x7f17a80a4fe0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:55:20.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:20.820+0000 7f17c3446640 1 --2- 172.21.15.43:0/4267242334 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17bc103560 0x7f17bc19f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:55:20.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:20.820+0000 7f17c3446640 1 --2- 172.21.15.43:0/4267242334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17bc102ba0 0x7f17bc198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:55:20.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:20.820+0000 7f17c3446640 1 --2- 172.21.15.43:0/4267242334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17bc1019a0 0x7f17bc197e30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:55:20.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:20.820+0000 7f17c3446640 1 -- 172.21.15.43:0/4267242334 >> 172.21.15.43:0/4267242334 conn(0x7f17bc0fd130 msgr2=0x7f17bc105fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:55:20.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:20.820+0000 7f17c3446640 1 -- 172.21.15.43:0/4267242334 shutdown_connections 2024-08-25T23:55:20.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:55:20.820+0000 7f17c3446640 1 -- 172.21.15.43:0/4267242334 wait complete. 2024-08-25T23:55:21.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:20 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:21.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:20 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:21.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:20 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:21.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:20 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:55:21.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:20 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:21.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:20 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:21.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:20 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:21.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:20 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:21.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:20 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:55:21.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:20 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:21.376 DEBUG:teuthology.orchestra.run.smithi043:osd.1> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.1.service 2024-08-25T23:55:21.378 INFO:tasks.cephadm:Deploying osd.2 on smithi181 with /dev/vg_nvme/lv_4... 2024-08-25T23:55:21.378 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-25T23:55:21.630 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.c/config 2024-08-25T23:55:22.002 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:21 smithi181 ceph-mon[22102]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:22.002 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:21 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:55:22.003 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:21 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:22.003 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:21 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:22.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:21 smithi043 ceph-mon[22091]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:22.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:21 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:55:22.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:21 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:22.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:21 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:22.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:21 smithi042 ceph-mon[17225]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:22.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:21 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:55:22.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:21 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:22.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:21 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:23.741 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 25 23:55:23 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-1[26524]: 2024-08-25T23:55:23.643+0000 7fa0f5c9f640 -1 osd.1 0 log_to_monitors true 2024-08-25T23:55:23.857 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-25T23:55:23.882 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph orch daemon add osd smithi181:vg_nvme/lv_4 2024-08-25T23:55:24.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:23 smithi043 ceph-mon[22091]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:24.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:23 smithi043 ceph-mon[22091]: from='osd.1 [v2:172.21.15.43:6800/2396081001,v1:172.21.15.43:6801/2396081001]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-25T23:55:24.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:23 smithi043 ceph-mon[22091]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-25T23:55:24.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:23 smithi042 ceph-mon[17225]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:24.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:23 smithi042 ceph-mon[17225]: from='osd.1 [v2:172.21.15.43:6800/2396081001,v1:172.21.15.43:6801/2396081001]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-25T23:55:24.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:23 smithi042 ceph-mon[17225]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-25T23:55:24.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:23 smithi181 ceph-mon[22102]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:24.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:23 smithi181 ceph-mon[22102]: from='osd.1 [v2:172.21.15.43:6800/2396081001,v1:172.21.15.43:6801/2396081001]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-25T23:55:24.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:23 smithi181 ceph-mon[22102]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-25T23:55:24.128 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.c/config 2024-08-25T23:55:24.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.573+0000 7f004692d640 1 -- 172.21.15.181:0/2564974592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0040102470 msgr2=0x7f0040108d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:55:24.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.573+0000 7f004692d640 1 --2- 172.21.15.181:0/2564974592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0040102470 0x7f0040108d00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0038009ca0 tx=0x7f003802a8c0 comp rx=0 tx=0).stop 2024-08-25T23:55:24.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.573+0000 7f004692d640 1 -- 172.21.15.181:0/2564974592 shutdown_connections 2024-08-25T23:55:24.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.573+0000 7f004692d640 1 --2- 172.21.15.181:0/2564974592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0040102470 0x7f0040108d00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:55:24.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.573+0000 7f004692d640 1 --2- 172.21.15.181:0/2564974592 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0040101ab0 0x7f0040101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:55:24.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.573+0000 7f004692d640 1 --2- 172.21.15.181:0/2564974592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00401008b0 0x7f0040100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:55:24.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.573+0000 7f004692d640 1 -- 172.21.15.181:0/2564974592 >> 172.21.15.181:0/2564974592 conn(0x7f00400fc040 msgr2=0x7f00400fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:55:24.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.573+0000 7f004692d640 1 -- 172.21.15.181:0/2564974592 shutdown_connections 2024-08-25T23:55:24.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.573+0000 7f004692d640 1 -- 172.21.15.181:0/2564974592 wait complete. 2024-08-25T23:55:24.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.574+0000 7f004692d640 1 Processor -- start 2024-08-25T23:55:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.574+0000 7f004692d640 1 -- start start 2024-08-25T23:55:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.574+0000 7f004692d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00401008b0 0x7f0040197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:55:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.574+0000 7f004692d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0040101ab0 0x7f0040198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:55:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.574+0000 7f004692d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0040102470 0x7f004019f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:55:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.574+0000 7f004692d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f004010c5b0 con 0x7f00401008b0 2024-08-25T23:55:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.574+0000 7f004692d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f004010c430 con 0x7f0040101ab0 2024-08-25T23:55:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.574+0000 7f004692d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f004010c730 con 0x7f0040102470 2024-08-25T23:55:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.574+0000 7f0044eca640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0040102470 0x7f004019f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:55:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.574+0000 7f0044eca640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0040102470 0x7f004019f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:45786/0 (socket says 172.21.15.181:45786) 2024-08-25T23:55:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.574+0000 7f0044eca640 1 -- 172.21.15.181:0/3122829225 learned_addr learned my addr 172.21.15.181:0/3122829225 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-08-25T23:55:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.574+0000 7f003f7fe640 1 --2- 172.21.15.181:0/3122829225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0040101ab0 0x7f0040198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:55:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.575+0000 7f0044eca640 1 -- 172.21.15.181:0/3122829225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0040101ab0 msgr2=0x7f0040198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:55:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.575+0000 7f0044eca640 1 --2- 172.21.15.181:0/3122829225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0040101ab0 0x7f0040198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:55:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.575+0000 7f0044eca640 1 -- 172.21.15.181:0/3122829225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00401008b0 msgr2=0x7f0040197ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:55:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.575+0000 7f003ffff640 1 --2- 172.21.15.181:0/3122829225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00401008b0 0x7f0040197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:55:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.575+0000 7f0044eca640 1 --2- 172.21.15.181:0/3122829225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00401008b0 0x7f0040197ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:55:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.575+0000 7f0044eca640 1 -- 172.21.15.181:0/3122829225 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f004019f900 con 0x7f0040102470 2024-08-25T23:55:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.575+0000 7f003f7fe640 1 --2- 172.21.15.181:0/3122829225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0040101ab0 0x7f0040198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-25T23:55:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.575+0000 7f003ffff640 1 --2- 172.21.15.181:0/3122829225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00401008b0 0x7f0040197ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-25T23:55:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.575+0000 7f0044eca640 1 --2- 172.21.15.181:0/3122829225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0040102470 0x7f004019f260 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f00380098d0 tx=0x7f003802f840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:55:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.575+0000 7f003d7fa640 1 -- 172.21.15.181:0/3122829225 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003802fc30 con 0x7f0040102470 2024-08-25T23:55:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.575+0000 7f003d7fa640 1 -- 172.21.15.181:0/3122829225 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0038003e50 con 0x7f0040102470 2024-08-25T23:55:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.575+0000 7f004692d640 1 -- 172.21.15.181:0/3122829225 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f004019fb90 con 0x7f0040102470 2024-08-25T23:55:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.575+0000 7f003d7fa640 1 -- 172.21.15.181:0/3122829225 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00380305c0 con 0x7f0040102470 2024-08-25T23:55:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.575+0000 7f004692d640 1 -- 172.21.15.181:0/3122829225 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00401a0120 con 0x7f0040102470 2024-08-25T23:55:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.576+0000 7f004692d640 1 -- 172.21.15.181:0/3122829225 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00401087a0 con 0x7f0040102470 2024-08-25T23:55:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.577+0000 7f003d7fa640 1 -- 172.21.15.181:0/3122829225 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f0038003970 con 0x7f0040102470 2024-08-25T23:55:24.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.578+0000 7f003d7fa640 1 --2- 172.21.15.181:0/3122829225 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f00280a2b70 0x7f00280a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:55:24.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.578+0000 7f003d7fa640 1 -- 172.21.15.181:0/3122829225 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1903+0+0 (secure 0 0 0) 0x7f00380eec50 con 0x7f0040102470 2024-08-25T23:55:24.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.578+0000 7f003ffff640 1 --2- 172.21.15.181:0/3122829225 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f00280a2b70 0x7f00280a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:55:24.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.579+0000 7f003ffff640 1 --2- 172.21.15.181:0/3122829225 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f00280a2b70 0x7f00280a5030 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f00300058c0 tx=0x7f0030005d70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:55:24.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.582+0000 7f003d7fa640 1 -- 172.21.15.181:0/3122829225 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f00380bd500 con 0x7f0040102470 2024-08-25T23:55:24.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:24.759+0000 7f004692d640 1 -- 172.21.15.181:0/3122829225 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f00400623d0 con 0x7f00280a2b70 2024-08-25T23:55:25.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:24 smithi043 ceph-mon[22091]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-25T23:55:25.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:24 smithi043 ceph-mon[22091]: from='osd.1 [v2:172.21.15.43:6800/2396081001,v1:172.21.15.43:6801/2396081001]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:55:25.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:24 smithi043 ceph-mon[22091]: osdmap e11: 2 total, 1 up, 2 in 2024-08-25T23:55:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:24 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-25T23:55:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:24 smithi043 ceph-mon[22091]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:55:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:24 smithi043 ceph-mon[22091]: Detected new or changed devices on smithi043 2024-08-25T23:55:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:24 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:24 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:24 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:55:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:24 smithi043 ceph-mon[22091]: Adjusting osd_memory_target on smithi043 to 17092M 2024-08-25T23:55:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:24 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:24 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:24 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:55:25.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:24 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:25.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:24 smithi042 ceph-mon[17225]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-25T23:55:25.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:24 smithi042 ceph-mon[17225]: from='osd.1 [v2:172.21.15.43:6800/2396081001,v1:172.21.15.43:6801/2396081001]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:55:25.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:24 smithi042 ceph-mon[17225]: osdmap e11: 2 total, 1 up, 2 in 2024-08-25T23:55:25.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:24 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-25T23:55:25.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:24 smithi042 ceph-mon[17225]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:55:25.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:24 smithi042 ceph-mon[17225]: Detected new or changed devices on smithi043 2024-08-25T23:55:25.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:24 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:25.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:24 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:25.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:24 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:55:25.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:24 smithi042 ceph-mon[17225]: Adjusting osd_memory_target on smithi043 to 17092M 2024-08-25T23:55:25.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:24 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:25.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:24 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:25.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:24 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:55:25.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:24 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:25.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:24 smithi181 ceph-mon[22102]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-25T23:55:25.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:24 smithi181 ceph-mon[22102]: from='osd.1 [v2:172.21.15.43:6800/2396081001,v1:172.21.15.43:6801/2396081001]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:55:25.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:24 smithi181 ceph-mon[22102]: osdmap e11: 2 total, 1 up, 2 in 2024-08-25T23:55:25.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:24 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-25T23:55:25.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:24 smithi181 ceph-mon[22102]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:55:25.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:24 smithi181 ceph-mon[22102]: Detected new or changed devices on smithi043 2024-08-25T23:55:25.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:24 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:25.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:24 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:25.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:24 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:55:25.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:24 smithi181 ceph-mon[22102]: Adjusting osd_memory_target on smithi043 to 17092M 2024-08-25T23:55:25.036 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:24 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:25.036 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:24 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:25.036 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:24 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:55:25.036 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:24 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:25.753 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 25 23:55:25 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-1[26524]: 2024-08-25T23:55:25.442+0000 7fa0f13ff640 -1 osd.1 0 waiting for initial osdmap 2024-08-25T23:55:25.754 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 25 23:55:25 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-1[26524]: 2024-08-25T23:55:25.445+0000 7fa0e9a31640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-25T23:55:26.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:25 smithi043 ceph-mon[22091]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:26.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:25 smithi043 ceph-mon[22091]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-08-25T23:55:26.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:25 smithi043 ceph-mon[22091]: osdmap e12: 2 total, 1 up, 2 in 2024-08-25T23:55:26.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:25 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-25T23:55:26.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:25 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-25T23:55:26.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:25 smithi043 ceph-mon[22091]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:55:26.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:25 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:55:26.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:25 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:55:26.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:25 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:26.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:25 smithi043 ceph-mon[22091]: from='osd.1 ' entity='osd.1' 2024-08-25T23:55:26.032 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:25 smithi181 ceph-mon[22102]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:26.032 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:25 smithi181 ceph-mon[22102]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-08-25T23:55:26.032 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:25 smithi181 ceph-mon[22102]: osdmap e12: 2 total, 1 up, 2 in 2024-08-25T23:55:26.032 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:25 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-25T23:55:26.032 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:25 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-25T23:55:26.032 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:25 smithi181 ceph-mon[22102]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:55:26.032 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:25 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:55:26.032 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:25 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:55:26.032 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:25 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:26.032 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:25 smithi181 ceph-mon[22102]: from='osd.1 ' entity='osd.1' 2024-08-25T23:55:26.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:25 smithi042 ceph-mon[17225]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:26.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:25 smithi042 ceph-mon[17225]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-08-25T23:55:26.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:25 smithi042 ceph-mon[17225]: osdmap e12: 2 total, 1 up, 2 in 2024-08-25T23:55:26.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:25 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-25T23:55:26.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:25 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-25T23:55:26.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:25 smithi042 ceph-mon[17225]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:55:26.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:25 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:55:26.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:25 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:55:26.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:25 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:26.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:25 smithi042 ceph-mon[17225]: from='osd.1 ' entity='osd.1' 2024-08-25T23:55:27.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:26 smithi043 ceph-mon[22091]: purged_snaps scrub starts 2024-08-25T23:55:27.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:26 smithi043 ceph-mon[22091]: purged_snaps scrub ok 2024-08-25T23:55:27.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:26 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-25T23:55:27.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:26 smithi043 ceph-mon[22091]: osd.1 [v2:172.21.15.43:6800/2396081001,v1:172.21.15.43:6801/2396081001] boot 2024-08-25T23:55:27.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:26 smithi043 ceph-mon[22091]: osdmap e13: 2 total, 2 up, 2 in 2024-08-25T23:55:27.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:26 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-25T23:55:27.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:26 smithi042 ceph-mon[17225]: purged_snaps scrub starts 2024-08-25T23:55:27.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:26 smithi042 ceph-mon[17225]: purged_snaps scrub ok 2024-08-25T23:55:27.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:26 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-25T23:55:27.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:26 smithi042 ceph-mon[17225]: osd.1 [v2:172.21.15.43:6800/2396081001,v1:172.21.15.43:6801/2396081001] boot 2024-08-25T23:55:27.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:26 smithi042 ceph-mon[17225]: osdmap e13: 2 total, 2 up, 2 in 2024-08-25T23:55:27.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:26 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-25T23:55:27.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:26 smithi181 ceph-mon[22102]: purged_snaps scrub starts 2024-08-25T23:55:27.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:26 smithi181 ceph-mon[22102]: purged_snaps scrub ok 2024-08-25T23:55:27.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:26 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-25T23:55:27.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:26 smithi181 ceph-mon[22102]: osd.1 [v2:172.21.15.43:6800/2396081001,v1:172.21.15.43:6801/2396081001] boot 2024-08-25T23:55:27.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:26 smithi181 ceph-mon[22102]: osdmap e13: 2 total, 2 up, 2 in 2024-08-25T23:55:27.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:26 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-25T23:55:28.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:27 smithi042 ceph-mon[17225]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:28.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:27 smithi042 ceph-mon[17225]: from='client.? 172.21.15.181:0/2129652537' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06eb25af-8e3d-4f90-bc24-28a9bc224c0a"}]: dispatch 2024-08-25T23:55:28.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:27 smithi042 ceph-mon[17225]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06eb25af-8e3d-4f90-bc24-28a9bc224c0a"}]: dispatch 2024-08-25T23:55:28.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:27 smithi042 ceph-mon[17225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "06eb25af-8e3d-4f90-bc24-28a9bc224c0a"}]': finished 2024-08-25T23:55:28.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:27 smithi042 ceph-mon[17225]: osdmap e14: 3 total, 2 up, 3 in 2024-08-25T23:55:28.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:27 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-25T23:55:28.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:27 smithi042 ceph-mon[17225]: from='client.? 172.21.15.181:0/2485067053' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:55:28.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:27 smithi043 ceph-mon[22091]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:28.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:27 smithi043 ceph-mon[22091]: from='client.? 172.21.15.181:0/2129652537' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06eb25af-8e3d-4f90-bc24-28a9bc224c0a"}]: dispatch 2024-08-25T23:55:28.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:27 smithi043 ceph-mon[22091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06eb25af-8e3d-4f90-bc24-28a9bc224c0a"}]: dispatch 2024-08-25T23:55:28.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:27 smithi043 ceph-mon[22091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "06eb25af-8e3d-4f90-bc24-28a9bc224c0a"}]': finished 2024-08-25T23:55:28.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:27 smithi043 ceph-mon[22091]: osdmap e14: 3 total, 2 up, 3 in 2024-08-25T23:55:28.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:27 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-25T23:55:28.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:27 smithi043 ceph-mon[22091]: from='client.? 172.21.15.181:0/2485067053' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:55:28.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:27 smithi181 ceph-mon[22102]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-25T23:55:28.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:27 smithi181 ceph-mon[22102]: from='client.? 172.21.15.181:0/2129652537' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06eb25af-8e3d-4f90-bc24-28a9bc224c0a"}]: dispatch 2024-08-25T23:55:28.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:27 smithi181 ceph-mon[22102]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06eb25af-8e3d-4f90-bc24-28a9bc224c0a"}]: dispatch 2024-08-25T23:55:28.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:27 smithi181 ceph-mon[22102]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "06eb25af-8e3d-4f90-bc24-28a9bc224c0a"}]': finished 2024-08-25T23:55:28.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:27 smithi181 ceph-mon[22102]: osdmap e14: 3 total, 2 up, 3 in 2024-08-25T23:55:28.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:27 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-25T23:55:28.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:27 smithi181 ceph-mon[22102]: from='client.? 172.21.15.181:0/2485067053' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:55:30.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:29 smithi043 ceph-mon[22091]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:30.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:29 smithi042 ceph-mon[17225]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:30.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:29 smithi181 ceph-mon[22102]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:32.238 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:31 smithi181 ceph-mon[22102]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:32.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:31 smithi043 ceph-mon[22091]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:32.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:31 smithi042 ceph-mon[17225]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:34.011 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:33 smithi181 ceph-mon[22102]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:34.085 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:33 smithi042 ceph-mon[17225]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:34.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:33 smithi043 ceph-mon[22091]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:35.946 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:35 smithi181 ceph-mon[22102]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:35.946 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:35 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-25T23:55:35.946 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:35 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:35.946 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:35 smithi181 ceph-mon[22102]: Deploying daemon osd.2 on smithi181 2024-08-25T23:55:36.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:35 smithi043 ceph-mon[22091]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:36.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:35 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-25T23:55:36.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:35 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:36.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:35 smithi043 ceph-mon[22091]: Deploying daemon osd.2 on smithi181 2024-08-25T23:55:36.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:35 smithi042 ceph-mon[17225]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:36.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:35 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-25T23:55:36.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:35 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:36.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:35 smithi042 ceph-mon[17225]: Deploying daemon osd.2 on smithi181 2024-08-25T23:55:37.883 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:37 smithi181 ceph-mon[22102]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:38.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:37 smithi043 ceph-mon[22091]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:38.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:37 smithi042 ceph-mon[17225]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:39.825 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:39 smithi181 ceph-mon[22102]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:40.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:39 smithi043 ceph-mon[22091]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:40.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:39 smithi042 ceph-mon[17225]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:40.996 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:40 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:55:40.997 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:40 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:40.997 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:40 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:41.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:40 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:55:41.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:40 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:41.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:40 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:41.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:40 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:55:41.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:40 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:41.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:40 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:42.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:42 smithi043 ceph-mon[22091]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:42.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:42 smithi042 ceph-mon[17225]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:42.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:42 smithi181 ceph-mon[22102]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:44.009 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:43 smithi181 ceph-mon[22102]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:44.010 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:43 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:44.010 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:43 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:44.010 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:43 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:44.010 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:43 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:55:44.010 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:43 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:44.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:43 smithi043 ceph-mon[22091]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:44.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:43 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:44.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:43 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:44.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:43 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:44.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:43 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:55:44.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:43 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:44.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:43 smithi042 ceph-mon[17225]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:44.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:43 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:44.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:43 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:44.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:43 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:44.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:43 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:55:44.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:43 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:44.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:44.232+0000 7f003d7fa640 1 -- 172.21.15.181:0/3122829225 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f00400623d0 con 0x7f00280a2b70 2024-08-25T23:55:44.233 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 2 on host 'smithi181' 2024-08-25T23:55:44.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:44.234+0000 7f004692d640 1 -- 172.21.15.181:0/3122829225 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f00280a2b70 msgr2=0x7f00280a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:55:44.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:44.234+0000 7f004692d640 1 --2- 172.21.15.181:0/3122829225 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f00280a2b70 0x7f00280a5030 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f00300058c0 tx=0x7f0030005d70 comp rx=0 tx=0).stop 2024-08-25T23:55:44.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:44.234+0000 7f004692d640 1 -- 172.21.15.181:0/3122829225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0040102470 msgr2=0x7f004019f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:55:44.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:44.234+0000 7f004692d640 1 --2- 172.21.15.181:0/3122829225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0040102470 0x7f004019f260 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f00380098d0 tx=0x7f003802f840 comp rx=0 tx=0).stop 2024-08-25T23:55:44.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:44.234+0000 7f004692d640 1 -- 172.21.15.181:0/3122829225 shutdown_connections 2024-08-25T23:55:44.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:44.234+0000 7f004692d640 1 --2- 172.21.15.181:0/3122829225 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f00280a2b70 0x7f00280a5030 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:55:44.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:44.234+0000 7f004692d640 1 --2- 172.21.15.181:0/3122829225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0040102470 0x7f004019f260 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:55:44.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:44.234+0000 7f004692d640 1 --2- 172.21.15.181:0/3122829225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0040101ab0 0x7f0040198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:55:44.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:44.234+0000 7f004692d640 1 --2- 172.21.15.181:0/3122829225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00401008b0 0x7f0040197ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:55:44.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:44.234+0000 7f004692d640 1 -- 172.21.15.181:0/3122829225 >> 172.21.15.181:0/3122829225 conn(0x7f00400fc040 msgr2=0x7f00400fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:55:44.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:44.234+0000 7f004692d640 1 -- 172.21.15.181:0/3122829225 shutdown_connections 2024-08-25T23:55:44.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:55:44.235+0000 7f004692d640 1 -- 172.21.15.181:0/3122829225 wait complete. 2024-08-25T23:55:44.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:44 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:55:44.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:44 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:44.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:44 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:44.822 DEBUG:teuthology.orchestra.run.smithi181:osd.2> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.2.service 2024-08-25T23:55:44.824 INFO:tasks.cephadm:Deploying osd.3 on smithi042 with /dev/vg_nvme/lv_3... 2024-08-25T23:55:44.824 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-25T23:55:44.879 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:44 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:55:44.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:44 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:44.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:44 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:45.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:44 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:55:45.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:44 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:45.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:44 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:45.203 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:55:46.356 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:46 smithi181 ceph-mon[22102]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:46.409 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:46 smithi042 ceph-mon[17225]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:46.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:46 smithi043 ceph-mon[22091]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:46.669 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 25 23:55:46 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-2[27056]: 2024-08-25T23:55:46.581+0000 7fe244b5e640 -1 osd.2 0 log_to_monitors true 2024-08-25T23:55:47.237 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:47 smithi042 ceph-mon[17225]: from='osd.2 [v2:172.21.15.181:6800/189987070,v1:172.21.15.181:6801/189987070]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-25T23:55:47.238 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:47 smithi042 ceph-mon[17225]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-25T23:55:47.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:47 smithi181 ceph-mon[22102]: from='osd.2 [v2:172.21.15.181:6800/189987070,v1:172.21.15.181:6801/189987070]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-25T23:55:47.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:47 smithi181 ceph-mon[22102]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-25T23:55:47.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:47 smithi043 ceph-mon[22091]: from='osd.2 [v2:172.21.15.181:6800/189987070,v1:172.21.15.181:6801/189987070]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-25T23:55:47.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:47 smithi043 ceph-mon[22091]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-25T23:55:48.148 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:55:48.180 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph orch daemon add osd smithi042:vg_nvme/lv_3 2024-08-25T23:55:48.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:48 smithi043 ceph-mon[22091]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:48 smithi043 ceph-mon[22091]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-25T23:55:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:48 smithi043 ceph-mon[22091]: osdmap e15: 3 total, 2 up, 3 in 2024-08-25T23:55:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:48 smithi043 ceph-mon[22091]: from='osd.2 [v2:172.21.15.181:6800/189987070,v1:172.21.15.181:6801/189987070]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:55:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:48 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-25T23:55:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:48 smithi043 ceph-mon[22091]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:55:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:48 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:48 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:48 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:55:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:48 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:48 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:48 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:55:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:48 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:48.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:48 smithi042 ceph-mon[17225]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:48.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:48 smithi042 ceph-mon[17225]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-25T23:55:48.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:48 smithi042 ceph-mon[17225]: osdmap e15: 3 total, 2 up, 3 in 2024-08-25T23:55:48.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:48 smithi042 ceph-mon[17225]: from='osd.2 [v2:172.21.15.181:6800/189987070,v1:172.21.15.181:6801/189987070]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:55:48.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:48 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-25T23:55:48.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:48 smithi042 ceph-mon[17225]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:55:48.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:48 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:48.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:48 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:48.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:48 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:55:48.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:48 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:48.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:48 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:48.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:48 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:55:48.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:48 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:48.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:48 smithi181 ceph-mon[22102]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:48.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:48 smithi181 ceph-mon[22102]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-25T23:55:48.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:48 smithi181 ceph-mon[22102]: osdmap e15: 3 total, 2 up, 3 in 2024-08-25T23:55:48.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:48 smithi181 ceph-mon[22102]: from='osd.2 [v2:172.21.15.181:6800/189987070,v1:172.21.15.181:6801/189987070]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:55:48.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:48 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-25T23:55:48.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:48 smithi181 ceph-mon[22102]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:55:48.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:48 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:48.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:48 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:48.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:48 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:55:48.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:48 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:48.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:48 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:48.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:48 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:55:48.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:48 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:48.549 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:55:49.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.025+0000 7fe447c00640 1 -- 172.21.15.42:0/2266347050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe440102ba0 msgr2=0x7fe440103020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:55:49.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.025+0000 7fe447c00640 1 --2- 172.21.15.42:0/2266347050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe440102ba0 0x7fe440103020 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe42c009900 tx=0x7fe42c02a410 comp rx=0 tx=0).stop 2024-08-25T23:55:49.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.025+0000 7fe447c00640 1 -- 172.21.15.42:0/2266347050 shutdown_connections 2024-08-25T23:55:49.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.025+0000 7fe447c00640 1 --2- 172.21.15.42:0/2266347050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe440103560 0x7fe440109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:55:49.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.025+0000 7fe447c00640 1 --2- 172.21.15.42:0/2266347050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe440102ba0 0x7fe440103020 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:55:49.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.025+0000 7fe447c00640 1 --2- 172.21.15.42:0/2266347050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4401019a0 0x7fe440101da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:55:49.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.026+0000 7fe447c00640 1 -- 172.21.15.42:0/2266347050 >> 172.21.15.42:0/2266347050 conn(0x7fe4400fd130 msgr2=0x7fe4400ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:55:49.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.026+0000 7fe447c00640 1 -- 172.21.15.42:0/2266347050 shutdown_connections 2024-08-25T23:55:49.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.026+0000 7fe447c00640 1 -- 172.21.15.42:0/2266347050 wait complete. 2024-08-25T23:55:49.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.027+0000 7fe447c00640 1 Processor -- start 2024-08-25T23:55:49.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.027+0000 7fe447c00640 1 -- start start 2024-08-25T23:55:49.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.027+0000 7fe447c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4401019a0 0x7fe440199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:55:49.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.027+0000 7fe447c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe440102ba0 0x7fe44019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:55:49.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.027+0000 7fe447c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe440103560 0x7fe4401a1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:55:49.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.027+0000 7fe447c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe44010d600 con 0x7fe440103560 2024-08-25T23:55:49.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.027+0000 7fe447c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe44010d480 con 0x7fe440102ba0 2024-08-25T23:55:49.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.027+0000 7fe447c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe44010d780 con 0x7fe4401019a0 2024-08-25T23:55:49.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.027+0000 7fe445200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4401019a0 0x7fe440199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:55:49.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.027+0000 7fe445200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4401019a0 0x7fe440199eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:36000/0 (socket says 172.21.15.42:36000) 2024-08-25T23:55:49.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.027+0000 7fe445200640 1 -- 172.21.15.42:0/1356728252 learned_addr learned my addr 172.21.15.42:0/1356728252 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:55:49.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.027+0000 7fe445c00640 1 --2- 172.21.15.42:0/1356728252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe440103560 0x7fe4401a1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:55:49.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.027+0000 7fe43fe00640 1 --2- 172.21.15.42:0/1356728252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe440102ba0 0x7fe44019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:55:49.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.028+0000 7fe445200640 1 -- 172.21.15.42:0/1356728252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe440102ba0 msgr2=0x7fe44019a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:55:49.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.028+0000 7fe445200640 1 --2- 172.21.15.42:0/1356728252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe440102ba0 0x7fe44019a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:55:49.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.028+0000 7fe445200640 1 -- 172.21.15.42:0/1356728252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe440103560 msgr2=0x7fe4401a1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:55:49.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.028+0000 7fe445200640 1 --2- 172.21.15.42:0/1356728252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe440103560 0x7fe4401a1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:55:49.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.028+0000 7fe445200640 1 -- 172.21.15.42:0/1356728252 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4401a1ae0 con 0x7fe4401019a0 2024-08-25T23:55:49.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.028+0000 7fe43fe00640 1 --2- 172.21.15.42:0/1356728252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe440102ba0 0x7fe44019a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-25T23:55:49.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.028+0000 7fe445c00640 1 --2- 172.21.15.42:0/1356728252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe440103560 0x7fe4401a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-25T23:55:49.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.028+0000 7fe445200640 1 --2- 172.21.15.42:0/1356728252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4401019a0 0x7fe440199eb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe43400e9c0 tx=0x7fe43400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:55:49.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.028+0000 7fe43d600640 1 -- 172.21.15.42:0/1356728252 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43400cde0 con 0x7fe4401019a0 2024-08-25T23:55:49.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.028+0000 7fe43d600640 1 -- 172.21.15.42:0/1356728252 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe434010910 con 0x7fe4401019a0 2024-08-25T23:55:49.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.028+0000 7fe43d600640 1 -- 172.21.15.42:0/1356728252 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe434018a00 con 0x7fe4401019a0 2024-08-25T23:55:49.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.028+0000 7fe447c00640 1 -- 172.21.15.42:0/1356728252 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4401a1dd0 con 0x7fe4401019a0 2024-08-25T23:55:49.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.029+0000 7fe447c00640 1 -- 172.21.15.42:0/1356728252 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4401a2220 con 0x7fe4401019a0 2024-08-25T23:55:49.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.030+0000 7fe447c00640 1 -- 172.21.15.42:0/1356728252 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4401a2450 con 0x7fe4401019a0 2024-08-25T23:55:49.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.031+0000 7fe43d600640 1 -- 172.21.15.42:0/1356728252 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fe43401f020 con 0x7fe4401019a0 2024-08-25T23:55:49.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.033+0000 7fe43d600640 1 --2- 172.21.15.42:0/1356728252 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe4280a2b20 0x7fe4280a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:55:49.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.033+0000 7fe43d600640 1 -- 172.21.15.42:0/1356728252 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7fe4340cdc60 con 0x7fe4401019a0 2024-08-25T23:55:49.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.033+0000 7fe43fe00640 1 --2- 172.21.15.42:0/1356728252 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe4280a2b20 0x7fe4280a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:55:49.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.034+0000 7fe43fe00640 1 --2- 172.21.15.42:0/1356728252 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe4280a2b20 0x7fe4280a4fe0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe42c000c00 tx=0x7fe42c0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:55:49.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.037+0000 7fe43d600640 1 -- 172.21.15.42:0/1356728252 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe43401e2c0 con 0x7fe4401019a0 2024-08-25T23:55:49.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:49.235+0000 7fe447c00640 1 -- 172.21.15.42:0/1356728252 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe440109a90 con 0x7fe4280a2b20 2024-08-25T23:55:49.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:49 smithi042 ceph-mon[17225]: Detected new or changed devices on smithi181 2024-08-25T23:55:49.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:49 smithi042 ceph-mon[17225]: Adjusting osd_memory_target on smithi181 to 17088M 2024-08-25T23:55:49.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:49 smithi042 ceph-mon[17225]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-08-25T23:55:49.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:49 smithi042 ceph-mon[17225]: osdmap e16: 3 total, 2 up, 3 in 2024-08-25T23:55:49.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:49 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-25T23:55:49.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:49 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-25T23:55:49.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:49 smithi042 ceph-mon[17225]: from='osd.2 ' entity='osd.2' 2024-08-25T23:55:49.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:49 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:55:49.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:49 smithi043 ceph-mon[22091]: Detected new or changed devices on smithi181 2024-08-25T23:55:49.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:49 smithi043 ceph-mon[22091]: Adjusting osd_memory_target on smithi181 to 17088M 2024-08-25T23:55:49.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:49 smithi043 ceph-mon[22091]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-08-25T23:55:49.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:49 smithi043 ceph-mon[22091]: osdmap e16: 3 total, 2 up, 3 in 2024-08-25T23:55:49.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:49 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-25T23:55:49.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:49 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-25T23:55:49.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:49 smithi043 ceph-mon[22091]: from='osd.2 ' entity='osd.2' 2024-08-25T23:55:49.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:49 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:55:49.534 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 25 23:55:49 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-2[27056]: 2024-08-25T23:55:49.111+0000 7fe2402be640 -1 osd.2 0 waiting for initial osdmap 2024-08-25T23:55:49.534 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 25 23:55:49 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-2[27056]: 2024-08-25T23:55:49.119+0000 7fe2388f0640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-25T23:55:49.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:49 smithi181 ceph-mon[22102]: Detected new or changed devices on smithi181 2024-08-25T23:55:49.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:49 smithi181 ceph-mon[22102]: Adjusting osd_memory_target on smithi181 to 17088M 2024-08-25T23:55:49.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:49 smithi181 ceph-mon[22102]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-08-25T23:55:49.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:49 smithi181 ceph-mon[22102]: osdmap e16: 3 total, 2 up, 3 in 2024-08-25T23:55:49.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:49 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-25T23:55:49.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:49 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-25T23:55:49.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:49 smithi181 ceph-mon[22102]: from='osd.2 ' entity='osd.2' 2024-08-25T23:55:49.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:49 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:55:50.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:50 smithi043 ceph-mon[22091]: purged_snaps scrub starts 2024-08-25T23:55:50.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:50 smithi043 ceph-mon[22091]: purged_snaps scrub ok 2024-08-25T23:55:50.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:50 smithi043 ceph-mon[22091]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:50.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:50 smithi043 ceph-mon[22091]: from='client.24193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:55:50.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:50 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:55:50.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:50 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:50.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:50 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-25T23:55:50.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:50 smithi043 ceph-mon[22091]: osd.2 [v2:172.21.15.181:6800/189987070,v1:172.21.15.181:6801/189987070] boot 2024-08-25T23:55:50.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:50 smithi043 ceph-mon[22091]: osdmap e17: 3 total, 3 up, 3 in 2024-08-25T23:55:50.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:50 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-25T23:55:50.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:50 smithi042 ceph-mon[17225]: purged_snaps scrub starts 2024-08-25T23:55:50.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:50 smithi042 ceph-mon[17225]: purged_snaps scrub ok 2024-08-25T23:55:50.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:50 smithi042 ceph-mon[17225]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:50.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:50 smithi042 ceph-mon[17225]: from='client.24193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:55:50.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:50 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:55:50.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:50 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:50.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:50 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-25T23:55:50.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:50 smithi042 ceph-mon[17225]: osd.2 [v2:172.21.15.181:6800/189987070,v1:172.21.15.181:6801/189987070] boot 2024-08-25T23:55:50.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:50 smithi042 ceph-mon[17225]: osdmap e17: 3 total, 3 up, 3 in 2024-08-25T23:55:50.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:50 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-25T23:55:50.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:50 smithi181 ceph-mon[22102]: purged_snaps scrub starts 2024-08-25T23:55:50.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:50 smithi181 ceph-mon[22102]: purged_snaps scrub ok 2024-08-25T23:55:50.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:50 smithi181 ceph-mon[22102]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-25T23:55:50.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:50 smithi181 ceph-mon[22102]: from='client.24193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:55:50.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:50 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:55:50.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:50 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:55:50.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:50 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-25T23:55:50.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:50 smithi181 ceph-mon[22102]: osd.2 [v2:172.21.15.181:6800/189987070,v1:172.21.15.181:6801/189987070] boot 2024-08-25T23:55:50.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:50 smithi181 ceph-mon[22102]: osdmap e17: 3 total, 3 up, 3 in 2024-08-25T23:55:50.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:50 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-25T23:55:51.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:51 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-08-25T23:55:51.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:51 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-08-25T23:55:51.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:51 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-08-25T23:55:52.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:52 smithi043 ceph-mon[22091]: pgmap v76: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-08-25T23:55:52.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:52 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-25T23:55:52.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:52 smithi043 ceph-mon[22091]: osdmap e18: 3 total, 3 up, 3 in 2024-08-25T23:55:52.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:52 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-08-25T23:55:52.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:52 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/4057397934' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c78dbc49-b5c7-4f82-be36-c76a89496520"}]: dispatch 2024-08-25T23:55:52.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:52 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-25T23:55:52.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:52 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/4057397934' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c78dbc49-b5c7-4f82-be36-c76a89496520"}]': finished 2024-08-25T23:55:52.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:52 smithi043 ceph-mon[22091]: osdmap e19: 4 total, 3 up, 4 in 2024-08-25T23:55:52.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:52 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-25T23:55:52.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:52 smithi042 ceph-mon[17225]: pgmap v76: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-08-25T23:55:52.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:52 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-25T23:55:52.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:52 smithi042 ceph-mon[17225]: osdmap e18: 3 total, 3 up, 3 in 2024-08-25T23:55:52.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:52 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-08-25T23:55:52.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:52 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/4057397934' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c78dbc49-b5c7-4f82-be36-c76a89496520"}]: dispatch 2024-08-25T23:55:52.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:52 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-25T23:55:52.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:52 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/4057397934' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c78dbc49-b5c7-4f82-be36-c76a89496520"}]': finished 2024-08-25T23:55:52.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:52 smithi042 ceph-mon[17225]: osdmap e19: 4 total, 3 up, 4 in 2024-08-25T23:55:52.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:52 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-25T23:55:52.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:52 smithi181 ceph-mon[22102]: pgmap v76: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-08-25T23:55:52.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:52 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-25T23:55:52.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:52 smithi181 ceph-mon[22102]: osdmap e18: 3 total, 3 up, 3 in 2024-08-25T23:55:52.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:52 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-08-25T23:55:52.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:52 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/4057397934' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c78dbc49-b5c7-4f82-be36-c76a89496520"}]: dispatch 2024-08-25T23:55:52.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:52 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-25T23:55:52.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:52 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/4057397934' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c78dbc49-b5c7-4f82-be36-c76a89496520"}]': finished 2024-08-25T23:55:52.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:52 smithi181 ceph-mon[22102]: osdmap e19: 4 total, 3 up, 4 in 2024-08-25T23:55:52.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:52 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-25T23:55:53.263 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 25 23:55:52 smithi042 sudo[35466]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-25T23:55:53.263 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 25 23:55:52 smithi042 sudo[35466]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-25T23:55:53.263 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 25 23:55:52 smithi042 sudo[35466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-25T23:55:53.263 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 25 23:55:52 smithi042 sudo[35466]: pam_unix(sudo:session): session closed for user root 2024-08-25T23:55:53.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:55:53.269+0000 7fe43d600640 1 -- 172.21.15.42:0/1356728252 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe4340981e0 con 0x7fe4401019a0 2024-08-25T23:55:53.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:53 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2575004305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:55:53.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:53 smithi042 ceph-mon[17225]: osdmap e20: 4 total, 3 up, 4 in 2024-08-25T23:55:53.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:53 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-25T23:55:53.533 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 25 23:55:53 smithi042 sudo[35516]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-25T23:55:53.534 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 25 23:55:53 smithi042 sudo[35516]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-25T23:55:53.534 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 25 23:55:53 smithi042 sudo[35516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-25T23:55:53.534 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 25 23:55:53 smithi042 sudo[35516]: pam_unix(sudo:session): session closed for user root 2024-08-25T23:55:53.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:53 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/2575004305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:55:53.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:53 smithi181 ceph-mon[22102]: osdmap e20: 4 total, 3 up, 4 in 2024-08-25T23:55:53.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:53 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-25T23:55:53.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:53 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/2575004305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:55:53.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:53 smithi043 ceph-mon[22091]: osdmap e20: 4 total, 3 up, 4 in 2024-08-25T23:55:53.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:53 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-25T23:55:54.045 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 25 23:55:53 smithi043 sudo[30702]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-25T23:55:54.045 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 25 23:55:53 smithi043 sudo[30702]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-25T23:55:54.045 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 25 23:55:53 smithi043 sudo[30702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-25T23:55:54.045 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 25 23:55:53 smithi043 sudo[30702]: pam_unix(sudo:session): session closed for user root 2024-08-25T23:55:54.046 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 25 23:55:54 smithi043 sudo[30705]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-25T23:55:54.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:54 smithi043 ceph-mon[22091]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-08-25T23:55:54.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:54 smithi043 ceph-mon[22091]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-25T23:55:54.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:54 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:54.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:54 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:54.511 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 25 23:55:54 smithi043 sudo[30705]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-25T23:55:54.511 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 25 23:55:54 smithi043 sudo[30705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-25T23:55:54.511 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 25 23:55:54 smithi043 sudo[30705]: pam_unix(sudo:session): session closed for user root 2024-08-25T23:55:54.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:54 smithi042 ceph-mon[17225]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-08-25T23:55:54.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:54 smithi042 ceph-mon[17225]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-25T23:55:54.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:54 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:54.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:54 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:54.534 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 25 23:55:54 smithi181 sudo[30991]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-25T23:55:54.534 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 25 23:55:54 smithi181 sudo[30991]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-25T23:55:54.534 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 25 23:55:54 smithi181 sudo[30991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-25T23:55:54.534 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 25 23:55:54 smithi181 sudo[30991]: pam_unix(sudo:session): session closed for user root 2024-08-25T23:55:54.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:54 smithi181 ceph-mon[22102]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-08-25T23:55:54.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:54 smithi181 ceph-mon[22102]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-25T23:55:54.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:54 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:54.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:54 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:55.033 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 25 23:55:54 smithi181 sudo[30994]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-25T23:55:55.034 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 25 23:55:54 smithi181 sudo[30994]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-25T23:55:55.034 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 25 23:55:54 smithi181 sudo[30994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-25T23:55:55.034 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 25 23:55:54 smithi181 sudo[30994]: pam_unix(sudo:session): session closed for user root 2024-08-25T23:55:55.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:55 smithi042 sudo[35912]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-25T23:55:55.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:55 smithi042 sudo[35912]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-25T23:55:55.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:55 smithi042 sudo[35912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-25T23:55:55.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:55 smithi042 sudo[35912]: pam_unix(sudo:session): session closed for user root 2024-08-25T23:55:56.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:55 smithi042 sudo[36287]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-25T23:55:56.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:55 smithi042 sudo[36287]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-25T23:55:56.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:55 smithi042 sudo[36287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-25T23:55:56.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:55 smithi042 sudo[36287]: pam_unix(sudo:session): session closed for user root 2024-08-25T23:55:56.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:55 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:56.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:55 smithi042 ceph-mon[17225]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-25T23:55:56.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:55 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:56.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:55 smithi181 ceph-mon[22102]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-25T23:55:56.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:56 smithi181 sudo[30997]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-25T23:55:56.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:56 smithi181 sudo[30997]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-25T23:55:56.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:56 smithi181 sudo[30997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-25T23:55:56.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:55 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:55:56.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:55 smithi043 ceph-mon[22091]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-25T23:55:56.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:56 smithi181 sudo[30997]: pam_unix(sudo:session): session closed for user root 2024-08-25T23:55:56.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:56 smithi181 sudo[31000]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-25T23:55:56.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:56 smithi181 sudo[31000]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-25T23:55:56.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:56 smithi181 sudo[31000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-25T23:55:56.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:56 smithi181 sudo[31000]: pam_unix(sudo:session): session closed for user root 2024-08-25T23:55:56.795 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:56 smithi043 sudo[30708]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-25T23:55:56.795 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:56 smithi043 sudo[30708]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-25T23:55:56.795 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:56 smithi043 sudo[30708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-25T23:55:56.795 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:56 smithi043 sudo[30708]: pam_unix(sudo:session): session closed for user root 2024-08-25T23:55:57.222 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:56 smithi042 ceph-mon[17225]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-08-25T23:55:57.223 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:56 smithi042 ceph-mon[17225]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-25T23:55:57.223 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-25T23:55:57.223 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:55:57.223 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:55:57.223 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:56 smithi042 ceph-mon[17225]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-25T23:55:57.223 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-25T23:55:57.223 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:55:57.223 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:55:57.223 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:56 smithi042 ceph-mon[17225]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-25T23:55:57.223 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-25T23:55:57.223 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:55:57.223 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:55:57.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:56 smithi043 sudo[30711]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-25T23:55:57.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:56 smithi043 sudo[30711]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-25T23:55:57.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:56 smithi043 sudo[30711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-25T23:55:57.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:56 smithi043 sudo[30711]: pam_unix(sudo:session): session closed for user root 2024-08-25T23:55:57.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:56 smithi043 ceph-mon[22091]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-08-25T23:55:57.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:56 smithi043 ceph-mon[22091]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-25T23:55:57.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:56 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-25T23:55:57.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:56 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:55:57.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:56 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:55:57.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:56 smithi043 ceph-mon[22091]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-25T23:55:57.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:56 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-25T23:55:57.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:56 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:55:57.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:56 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:55:57.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:56 smithi043 ceph-mon[22091]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-25T23:55:57.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:56 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-25T23:55:57.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:56 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:55:57.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:56 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:55:57.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:56 smithi181 ceph-mon[22102]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-08-25T23:55:57.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:56 smithi181 ceph-mon[22102]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-25T23:55:57.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:56 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-25T23:55:57.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:56 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:55:57.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:56 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:55:57.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:56 smithi181 ceph-mon[22102]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-25T23:55:57.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:56 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-25T23:55:57.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:56 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:55:57.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:56 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:55:57.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:56 smithi181 ceph-mon[22102]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-25T23:55:57.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:56 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-25T23:55:57.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:56 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-25T23:55:57.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:56 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-25T23:55:58.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:57 smithi042 ceph-mon[17225]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-25T23:55:58.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:57 smithi042 ceph-mon[17225]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 101 MiB used, 268 GiB / 268 GiB avail 2024-08-25T23:55:58.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:57 smithi042 ceph-mon[17225]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-25T23:55:58.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:57 smithi043 ceph-mon[22091]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-25T23:55:58.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:57 smithi043 ceph-mon[22091]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 101 MiB used, 268 GiB / 268 GiB avail 2024-08-25T23:55:58.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:57 smithi043 ceph-mon[22091]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-25T23:55:58.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:57 smithi181 ceph-mon[22102]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-25T23:55:58.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:57 smithi181 ceph-mon[22102]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 101 MiB used, 268 GiB / 268 GiB avail 2024-08-25T23:55:58.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:57 smithi181 ceph-mon[22102]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-25T23:55:59.964 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:55:59 smithi042 ceph-mon[17225]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-08-25T23:56:00.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:55:59 smithi043 ceph-mon[22091]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-08-25T23:56:00.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:55:59 smithi181 ceph-mon[22102]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-08-25T23:56:02.106 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:01 smithi042 ceph-mon[17225]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-08-25T23:56:02.106 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:01 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-25T23:56:02.106 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:01 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:02.107 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:01 smithi042 ceph-mon[17225]: Deploying daemon osd.3 on smithi042 2024-08-25T23:56:02.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:01 smithi043 ceph-mon[22091]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-08-25T23:56:02.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:01 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-25T23:56:02.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:01 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:02.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:01 smithi043 ceph-mon[22091]: Deploying daemon osd.3 on smithi042 2024-08-25T23:56:02.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:01 smithi181 ceph-mon[22102]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-08-25T23:56:02.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:01 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-25T23:56:02.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:01 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:02.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:01 smithi181 ceph-mon[22102]: Deploying daemon osd.3 on smithi042 2024-08-25T23:56:04.142 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:03 smithi042 ceph-mon[17225]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-08-25T23:56:04.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:03 smithi043 ceph-mon[22091]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-08-25T23:56:04.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:03 smithi181 ceph-mon[22102]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-08-25T23:56:05.876 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:05 smithi042 ceph-mon[17225]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-08-25T23:56:06.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:05 smithi043 ceph-mon[22091]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-08-25T23:56:06.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:05 smithi181 ceph-mon[22102]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-08-25T23:56:08.251 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:07 smithi042 ceph-mon[17225]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-08-25T23:56:08.251 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:07 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:56:08.251 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:07 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:08.251 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:07 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:08.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:07 smithi043 ceph-mon[22091]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-08-25T23:56:08.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:07 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:56:08.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:07 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:08.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:07 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:08.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:07 smithi181 ceph-mon[22102]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-08-25T23:56:08.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:07 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:56:08.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:07 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:08.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:07 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:10.108 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:09 smithi042 ceph-mon[17225]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-08-25T23:56:10.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:09 smithi043 ceph-mon[22091]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-08-25T23:56:10.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:09 smithi181 ceph-mon[22102]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-08-25T23:56:11.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:11 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:11.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:11 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:11.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:11 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:11.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:11 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:56:11.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:11 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:11.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:11 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:11.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:11 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:11.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:11 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:11.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:11 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:56:11.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:11 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:11.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:11 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:11.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:11 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:11.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:11 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:11.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:11 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:56:11.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:11 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:12.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:56:12.093+0000 7fe43d600640 1 -- 172.21.15.42:0/1356728252 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe440109a90 con 0x7fe4280a2b20 2024-08-25T23:56:12.094 INFO:teuthology.orchestra.run.smithi042.stdout:Created osd(s) 3 on host 'smithi042' 2024-08-25T23:56:12.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:56:12.096+0000 7fe447c00640 1 -- 172.21.15.42:0/1356728252 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe4280a2b20 msgr2=0x7fe4280a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:56:12.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:56:12.096+0000 7fe447c00640 1 --2- 172.21.15.42:0/1356728252 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe4280a2b20 0x7fe4280a4fe0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe42c000c00 tx=0x7fe42c0095f0 comp rx=0 tx=0).stop 2024-08-25T23:56:12.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:56:12.096+0000 7fe447c00640 1 -- 172.21.15.42:0/1356728252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4401019a0 msgr2=0x7fe440199eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:56:12.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:56:12.096+0000 7fe447c00640 1 --2- 172.21.15.42:0/1356728252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4401019a0 0x7fe440199eb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe43400e9c0 tx=0x7fe43400ee80 comp rx=0 tx=0).stop 2024-08-25T23:56:12.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:56:12.096+0000 7fe447c00640 1 -- 172.21.15.42:0/1356728252 shutdown_connections 2024-08-25T23:56:12.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:56:12.096+0000 7fe447c00640 1 --2- 172.21.15.42:0/1356728252 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe4280a2b20 0x7fe4280a4fe0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:56:12.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:56:12.096+0000 7fe447c00640 1 --2- 172.21.15.42:0/1356728252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe440103560 0x7fe4401a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:56:12.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:56:12.096+0000 7fe447c00640 1 --2- 172.21.15.42:0/1356728252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe440102ba0 0x7fe44019a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:56:12.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:56:12.096+0000 7fe447c00640 1 --2- 172.21.15.42:0/1356728252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4401019a0 0x7fe440199eb0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:56:12.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:56:12.096+0000 7fe447c00640 1 -- 172.21.15.42:0/1356728252 >> 172.21.15.42:0/1356728252 conn(0x7fe4400fd130 msgr2=0x7fe440108370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:56:12.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:56:12.097+0000 7fe447c00640 1 -- 172.21.15.42:0/1356728252 shutdown_connections 2024-08-25T23:56:12.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:56:12.097+0000 7fe447c00640 1 -- 172.21.15.42:0/1356728252 wait complete. 2024-08-25T23:56:12.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:12 smithi042 ceph-mon[17225]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-08-25T23:56:12.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:12 smithi181 ceph-mon[22102]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-08-25T23:56:12.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:12 smithi043 ceph-mon[22091]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-08-25T23:56:12.809 DEBUG:teuthology.orchestra.run.smithi042:osd.3> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.3.service 2024-08-25T23:56:12.814 INFO:tasks.cephadm:Deploying osd.4 on smithi043 with /dev/vg_nvme/lv_3... 2024-08-25T23:56:12.814 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-25T23:56:13.071 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.b/config 2024-08-25T23:56:13.174 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:13 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:56:13.174 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:13 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:13.174 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:13 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:13.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:56:13.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:13.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:13.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:56:13.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:13.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:14.098 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 25 23:56:14 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-3[37508]: 2024-08-25T23:56:14.019+0000 7f919c25f640 -1 osd.3 0 log_to_monitors true 2024-08-25T23:56:14.368 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:14 smithi043 ceph-mon[22091]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-08-25T23:56:14.368 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:14 smithi043 ceph-mon[22091]: from='osd.3 [v2:172.21.15.42:6810/251017896,v1:172.21.15.42:6811/251017896]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-25T23:56:14.434 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:14 smithi042 ceph-mon[17225]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-08-25T23:56:14.435 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:14 smithi042 ceph-mon[17225]: from='osd.3 [v2:172.21.15.42:6810/251017896,v1:172.21.15.42:6811/251017896]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-25T23:56:14.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:14 smithi181 ceph-mon[22102]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-08-25T23:56:14.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:14 smithi181 ceph-mon[22102]: from='osd.3 [v2:172.21.15.42:6810/251017896,v1:172.21.15.42:6811/251017896]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-25T23:56:15.313 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:15 smithi181 ceph-mon[22102]: from='osd.3 [v2:172.21.15.42:6810/251017896,v1:172.21.15.42:6811/251017896]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-25T23:56:15.313 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:15 smithi181 ceph-mon[22102]: osdmap e21: 4 total, 3 up, 4 in 2024-08-25T23:56:15.313 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:15 smithi181 ceph-mon[22102]: from='osd.3 [v2:172.21.15.42:6810/251017896,v1:172.21.15.42:6811/251017896]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-08-25T23:56:15.313 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:15 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-25T23:56:15.314 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:15 smithi181 ceph-mon[22102]: from='osd.3 [v2:172.21.15.42:6810/251017896,v1:172.21.15.42:6811/251017896]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-08-25T23:56:15.314 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:15 smithi181 ceph-mon[22102]: osdmap e22: 4 total, 3 up, 4 in 2024-08-25T23:56:15.401 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:15 smithi043 ceph-mon[22091]: from='osd.3 [v2:172.21.15.42:6810/251017896,v1:172.21.15.42:6811/251017896]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-25T23:56:15.402 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:15 smithi043 ceph-mon[22091]: osdmap e21: 4 total, 3 up, 4 in 2024-08-25T23:56:15.402 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:15 smithi043 ceph-mon[22091]: from='osd.3 [v2:172.21.15.42:6810/251017896,v1:172.21.15.42:6811/251017896]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-08-25T23:56:15.402 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:15 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-25T23:56:15.402 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:15 smithi043 ceph-mon[22091]: from='osd.3 [v2:172.21.15.42:6810/251017896,v1:172.21.15.42:6811/251017896]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-08-25T23:56:15.402 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:15 smithi043 ceph-mon[22091]: osdmap e22: 4 total, 3 up, 4 in 2024-08-25T23:56:15.405 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-08-25T23:56:15.430 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph orch daemon add osd smithi043:vg_nvme/lv_3 2024-08-25T23:56:15.533 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 25 23:56:15 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-3[37508]: 2024-08-25T23:56:15.111+0000 7f9196400640 -1 osd.3 0 waiting for initial osdmap 2024-08-25T23:56:15.533 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 25 23:56:15 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-3[37508]: 2024-08-25T23:56:15.116+0000 7f9191e00640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-25T23:56:15.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:15 smithi042 ceph-mon[17225]: from='osd.3 [v2:172.21.15.42:6810/251017896,v1:172.21.15.42:6811/251017896]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-25T23:56:15.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:15 smithi042 ceph-mon[17225]: osdmap e21: 4 total, 3 up, 4 in 2024-08-25T23:56:15.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:15 smithi042 ceph-mon[17225]: from='osd.3 [v2:172.21.15.42:6810/251017896,v1:172.21.15.42:6811/251017896]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-08-25T23:56:15.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:15 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-25T23:56:15.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:15 smithi042 ceph-mon[17225]: from='osd.3 [v2:172.21.15.42:6810/251017896,v1:172.21.15.42:6811/251017896]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-08-25T23:56:15.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:15 smithi042 ceph-mon[17225]: osdmap e22: 4 total, 3 up, 4 in 2024-08-25T23:56:15.679 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.b/config 2024-08-25T23:56:16.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.074+0000 7ff6a1b86640 1 -- 172.21.15.43:0/3929273832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff69c103560 msgr2=0x7ff69c109df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:56:16.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.074+0000 7ff6a1b86640 1 --2- 172.21.15.43:0/3929273832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff69c103560 0x7ff69c109df0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff694009ca0 tx=0x7ff69402a8c0 comp rx=0 tx=0).stop 2024-08-25T23:56:16.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.074+0000 7ff6a1b86640 1 -- 172.21.15.43:0/3929273832 shutdown_connections 2024-08-25T23:56:16.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.074+0000 7ff6a1b86640 1 --2- 172.21.15.43:0/3929273832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff69c103560 0x7ff69c109df0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:56:16.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.074+0000 7ff6a1b86640 1 --2- 172.21.15.43:0/3929273832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff69c102ba0 0x7ff69c103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:56:16.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.074+0000 7ff6a1b86640 1 --2- 172.21.15.43:0/3929273832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff69c1019a0 0x7ff69c101da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:56:16.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.074+0000 7ff6a1b86640 1 -- 172.21.15.43:0/3929273832 >> 172.21.15.43:0/3929273832 conn(0x7ff69c0fd130 msgr2=0x7ff69c0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:56:16.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.074+0000 7ff6a1b86640 1 -- 172.21.15.43:0/3929273832 shutdown_connections 2024-08-25T23:56:16.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.074+0000 7ff6a1b86640 1 -- 172.21.15.43:0/3929273832 wait complete. 2024-08-25T23:56:16.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.074+0000 7ff6a1b86640 1 Processor -- start 2024-08-25T23:56:16.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.074+0000 7ff6a1b86640 1 -- start start 2024-08-25T23:56:16.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.075+0000 7ff6a1b86640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff69c1019a0 0x7ff69c199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:56:16.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.075+0000 7ff6a1b86640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff69c102ba0 0x7ff69c19a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:56:16.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.075+0000 7ff6a1b86640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff69c103560 0x7ff69c1a1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:56:16.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.075+0000 7ff6a1b86640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c10f860 con 0x7ff69c103560 2024-08-25T23:56:16.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.075+0000 7ff6a1b86640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c10f6e0 con 0x7ff69c1019a0 2024-08-25T23:56:16.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.075+0000 7ff6a1b86640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c10f9e0 con 0x7ff69c102ba0 2024-08-25T23:56:16.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.075+0000 7ff69b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff69c1019a0 0x7ff69c199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:56:16.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.075+0000 7ff69b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff69c1019a0 0x7ff69c199e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:45884/0 (socket says 172.21.15.43:45884) 2024-08-25T23:56:16.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.075+0000 7ff69b7fe640 1 -- 172.21.15.43:0/3813996000 learned_addr learned my addr 172.21.15.43:0/3813996000 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-08-25T23:56:16.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.075+0000 7ff69affd640 1 --2- 172.21.15.43:0/3813996000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff69c102ba0 0x7ff69c19a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:56:16.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.075+0000 7ff69b7fe640 1 -- 172.21.15.43:0/3813996000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff69c102ba0 msgr2=0x7ff69c19a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:56:16.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.075+0000 7ff69b7fe640 1 --2- 172.21.15.43:0/3813996000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff69c102ba0 0x7ff69c19a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:56:16.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.075+0000 7ff69b7fe640 1 -- 172.21.15.43:0/3813996000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff69c103560 msgr2=0x7ff69c1a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:56:16.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.075+0000 7ff69b7fe640 1 --2- 172.21.15.43:0/3813996000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff69c103560 0x7ff69c1a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:56:16.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.075+0000 7ff69b7fe640 1 -- 172.21.15.43:0/3813996000 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69c1a1a70 con 0x7ff69c1019a0 2024-08-25T23:56:16.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.075+0000 7ff69b7fe640 1 --2- 172.21.15.43:0/3813996000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff69c1019a0 0x7ff69c199e40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00e9c0 tx=0x7ff68c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:56:16.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.075+0000 7ff698ff9640 1 -- 172.21.15.43:0/3813996000 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c00cd80 con 0x7ff69c1019a0 2024-08-25T23:56:16.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.075+0000 7ff6a1b86640 1 -- 172.21.15.43:0/3813996000 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff69c1a1d60 con 0x7ff69c1019a0 2024-08-25T23:56:16.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.076+0000 7ff698ff9640 1 -- 172.21.15.43:0/3813996000 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff68c0035f0 con 0x7ff69c1019a0 2024-08-25T23:56:16.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.076+0000 7ff698ff9640 1 -- 172.21.15.43:0/3813996000 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c010690 con 0x7ff69c1019a0 2024-08-25T23:56:16.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.076+0000 7ff6a1b86640 1 -- 172.21.15.43:0/3813996000 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff69c1a21e0 con 0x7ff69c1019a0 2024-08-25T23:56:16.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.077+0000 7ff6a1b86640 1 -- 172.21.15.43:0/3813996000 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff69c108d50 con 0x7ff69c1019a0 2024-08-25T23:56:16.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.078+0000 7ff698ff9640 1 -- 172.21.15.43:0/3813996000 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff68c004030 con 0x7ff69c1019a0 2024-08-25T23:56:16.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.079+0000 7ff698ff9640 1 --2- 172.21.15.43:0/3813996000 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff6840a2bb0 0x7ff6840a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:56:16.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.079+0000 7ff698ff9640 1 -- 172.21.15.43:0/3813996000 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3702+0+0 (secure 0 0 0) 0x7ff68c0ce310 con 0x7ff69c1019a0 2024-08-25T23:56:16.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.079+0000 7ff69affd640 1 --2- 172.21.15.43:0/3813996000 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff6840a2bb0 0x7ff6840a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:56:16.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.080+0000 7ff69affd640 1 --2- 172.21.15.43:0/3813996000 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff6840a2bb0 0x7ff6840a5070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff69c19b360 tx=0x7ff69000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:56:16.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.083+0000 7ff698ff9640 1 -- 172.21.15.43:0/3813996000 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff68c09c3d0 con 0x7ff69c1019a0 2024-08-25T23:56:16.191 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:16 smithi042 ceph-mon[17225]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-08-25T23:56:16.191 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:16 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-25T23:56:16.191 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:16 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-25T23:56:16.191 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:16 smithi042 ceph-mon[17225]: osd.3 [v2:172.21.15.42:6810/251017896,v1:172.21.15.42:6811/251017896] boot 2024-08-25T23:56:16.191 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:16 smithi042 ceph-mon[17225]: osdmap e23: 4 total, 4 up, 4 in 2024-08-25T23:56:16.191 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:16 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-25T23:56:16.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:16 smithi043 ceph-mon[22091]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-08-25T23:56:16.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:16 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-25T23:56:16.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:16 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-25T23:56:16.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:16 smithi043 ceph-mon[22091]: osd.3 [v2:172.21.15.42:6810/251017896,v1:172.21.15.42:6811/251017896] boot 2024-08-25T23:56:16.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:16 smithi043 ceph-mon[22091]: osdmap e23: 4 total, 4 up, 4 in 2024-08-25T23:56:16.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:16 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-25T23:56:16.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:16.274+0000 7ff6a1b86640 1 -- 172.21.15.43:0/3813996000 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7ff69c0623d0 con 0x7ff6840a2bb0 2024-08-25T23:56:16.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:16 smithi181 ceph-mon[22102]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-08-25T23:56:16.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:16 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-25T23:56:16.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:16 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-25T23:56:16.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:16 smithi181 ceph-mon[22102]: osd.3 [v2:172.21.15.42:6810/251017896,v1:172.21.15.42:6811/251017896] boot 2024-08-25T23:56:16.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:16 smithi181 ceph-mon[22102]: osdmap e23: 4 total, 4 up, 4 in 2024-08-25T23:56:16.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:16 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-25T23:56:17.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:17 smithi042 ceph-mon[17225]: purged_snaps scrub starts 2024-08-25T23:56:17.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:17 smithi042 ceph-mon[17225]: purged_snaps scrub ok 2024-08-25T23:56:17.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:17 smithi042 ceph-mon[17225]: Detected new or changed devices on smithi042 2024-08-25T23:56:17.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:17 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:17.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:17 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:17.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:17 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:56:17.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:17 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:56:17.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:17 smithi042 ceph-mon[17225]: Adjusting osd_memory_target on smithi042 to 8547M 2024-08-25T23:56:17.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:17 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:17.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:17 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:17.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:17 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:56:17.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:17 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:17.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:17 smithi042 ceph-mon[17225]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:56:17.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:17 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:56:17.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:17 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:56:17.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:17 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:17.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:17 smithi042 ceph-mon[17225]: osdmap e24: 4 total, 4 up, 4 in 2024-08-25T23:56:17.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:17 smithi043 ceph-mon[22091]: purged_snaps scrub starts 2024-08-25T23:56:17.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:17 smithi043 ceph-mon[22091]: purged_snaps scrub ok 2024-08-25T23:56:17.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:17 smithi043 ceph-mon[22091]: Detected new or changed devices on smithi042 2024-08-25T23:56:17.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:17.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:17.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:56:17.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:56:17.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:17 smithi043 ceph-mon[22091]: Adjusting osd_memory_target on smithi042 to 8547M 2024-08-25T23:56:17.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:17.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:17.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:56:17.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:17.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:17 smithi043 ceph-mon[22091]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:56:17.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:56:17.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:56:17.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:17.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:17 smithi043 ceph-mon[22091]: osdmap e24: 4 total, 4 up, 4 in 2024-08-25T23:56:17.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:17 smithi181 ceph-mon[22102]: purged_snaps scrub starts 2024-08-25T23:56:17.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:17 smithi181 ceph-mon[22102]: purged_snaps scrub ok 2024-08-25T23:56:17.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:17 smithi181 ceph-mon[22102]: Detected new or changed devices on smithi042 2024-08-25T23:56:17.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:17 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:17.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:17 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:17.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:17 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:56:17.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:17 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:56:17.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:17 smithi181 ceph-mon[22102]: Adjusting osd_memory_target on smithi042 to 8547M 2024-08-25T23:56:17.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:17 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:17.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:17 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:17.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:17 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:56:17.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:17 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:17.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:17 smithi181 ceph-mon[22102]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:56:17.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:17 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:56:17.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:17 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:56:17.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:17 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:17.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:17 smithi181 ceph-mon[22102]: osdmap e24: 4 total, 4 up, 4 in 2024-08-25T23:56:18.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:18 smithi043 ceph-mon[22091]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-08-25T23:56:18.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:18 smithi043 ceph-mon[22091]: osdmap e25: 4 total, 4 up, 4 in 2024-08-25T23:56:18.513 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:18 smithi042 ceph-mon[17225]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-08-25T23:56:18.513 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:18 smithi042 ceph-mon[17225]: osdmap e25: 4 total, 4 up, 4 in 2024-08-25T23:56:18.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:18 smithi181 ceph-mon[22102]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-08-25T23:56:18.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:18 smithi181 ceph-mon[22102]: osdmap e25: 4 total, 4 up, 4 in 2024-08-25T23:56:19.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:19 smithi043 ceph-mon[22091]: from='client.? 172.21.15.43:0/4114282813' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba633f66-25af-492f-bbf2-76032a4cd3d5"}]: dispatch 2024-08-25T23:56:19.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:19 smithi043 ceph-mon[22091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba633f66-25af-492f-bbf2-76032a4cd3d5"}]: dispatch 2024-08-25T23:56:19.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:19 smithi043 ceph-mon[22091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba633f66-25af-492f-bbf2-76032a4cd3d5"}]': finished 2024-08-25T23:56:19.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:19 smithi043 ceph-mon[22091]: osdmap e26: 5 total, 4 up, 5 in 2024-08-25T23:56:19.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:19 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-25T23:56:19.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:19 smithi043 ceph-mon[22091]: from='client.? 172.21.15.43:0/3028946031' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:56:19.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:19 smithi042 ceph-mon[17225]: from='client.? 172.21.15.43:0/4114282813' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba633f66-25af-492f-bbf2-76032a4cd3d5"}]: dispatch 2024-08-25T23:56:19.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:19 smithi042 ceph-mon[17225]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba633f66-25af-492f-bbf2-76032a4cd3d5"}]: dispatch 2024-08-25T23:56:19.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:19 smithi042 ceph-mon[17225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba633f66-25af-492f-bbf2-76032a4cd3d5"}]': finished 2024-08-25T23:56:19.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:19 smithi042 ceph-mon[17225]: osdmap e26: 5 total, 4 up, 5 in 2024-08-25T23:56:19.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:19 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-25T23:56:19.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:19 smithi042 ceph-mon[17225]: from='client.? 172.21.15.43:0/3028946031' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:56:19.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:19 smithi181 ceph-mon[22102]: from='client.? 172.21.15.43:0/4114282813' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba633f66-25af-492f-bbf2-76032a4cd3d5"}]: dispatch 2024-08-25T23:56:19.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:19 smithi181 ceph-mon[22102]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba633f66-25af-492f-bbf2-76032a4cd3d5"}]: dispatch 2024-08-25T23:56:19.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:19 smithi181 ceph-mon[22102]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba633f66-25af-492f-bbf2-76032a4cd3d5"}]': finished 2024-08-25T23:56:19.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:19 smithi181 ceph-mon[22102]: osdmap e26: 5 total, 4 up, 5 in 2024-08-25T23:56:19.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:19 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-25T23:56:19.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:19 smithi181 ceph-mon[22102]: from='client.? 172.21.15.43:0/3028946031' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:56:20.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:20 smithi043 ceph-mon[22091]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-25T23:56:20.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:20 smithi043 ceph-mon[22091]: osdmap e27: 5 total, 4 up, 5 in 2024-08-25T23:56:20.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:20 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-25T23:56:20.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:20 smithi042 ceph-mon[17225]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-25T23:56:20.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:20 smithi042 ceph-mon[17225]: osdmap e27: 5 total, 4 up, 5 in 2024-08-25T23:56:20.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:20 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-25T23:56:20.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:20 smithi181 ceph-mon[22102]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-25T23:56:20.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:20 smithi181 ceph-mon[22102]: osdmap e27: 5 total, 4 up, 5 in 2024-08-25T23:56:20.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:20 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-25T23:56:22.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:22 smithi042 ceph-mon[17225]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-25T23:56:22.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:22 smithi181 ceph-mon[22102]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-25T23:56:22.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:22 smithi043 ceph-mon[22091]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-25T23:56:24.403 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:24 smithi043 ceph-mon[22091]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-08-25T23:56:24.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:24 smithi042 ceph-mon[17225]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-08-25T23:56:24.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:24 smithi181 ceph-mon[22102]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-08-25T23:56:26.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:26 smithi042 ceph-mon[17225]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-08-25T23:56:26.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:26 smithi181 ceph-mon[22102]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-08-25T23:56:26.751 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:26 smithi043 ceph-mon[22091]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-08-25T23:56:27.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:27 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-25T23:56:27.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:27 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:27.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:27 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-25T23:56:27.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:27 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:27.543 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:27 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-25T23:56:27.543 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:27 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:28.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:28 smithi042 ceph-mon[17225]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-25T23:56:28.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:28 smithi042 ceph-mon[17225]: Deploying daemon osd.4 on smithi043 2024-08-25T23:56:28.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:28 smithi181 ceph-mon[22102]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-25T23:56:28.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:28 smithi181 ceph-mon[22102]: Deploying daemon osd.4 on smithi043 2024-08-25T23:56:28.549 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:28 smithi043 ceph-mon[22091]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-25T23:56:28.549 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:28 smithi043 ceph-mon[22091]: Deploying daemon osd.4 on smithi043 2024-08-25T23:56:30.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:30 smithi042 ceph-mon[17225]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-25T23:56:30.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:30 smithi181 ceph-mon[22102]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-25T23:56:30.643 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:30 smithi043 ceph-mon[22091]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-25T23:56:32.374 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:32 smithi043 ceph-mon[22091]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-25T23:56:32.375 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:56:32.375 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:32.375 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:32.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:32 smithi042 ceph-mon[17225]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-25T23:56:32.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:56:32.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:32.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:32.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:32 smithi181 ceph-mon[22102]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-25T23:56:32.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:56:32.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:32.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:34.379 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:34 smithi043 ceph-mon[22091]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-25T23:56:34.379 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:34.379 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:34.379 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:34.379 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:56:34.379 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:34.643 INFO:teuthology.orchestra.run.smithi043.stdout:Created osd(s) 4 on host 'smithi043' 2024-08-25T23:56:34.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:34.642+0000 7ff698ff9640 1 -- 172.21.15.43:0/3813996000 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff69c0623d0 con 0x7ff6840a2bb0 2024-08-25T23:56:34.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:34.644+0000 7ff6a1b86640 1 -- 172.21.15.43:0/3813996000 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff6840a2bb0 msgr2=0x7ff6840a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:56:34.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:34.644+0000 7ff6a1b86640 1 --2- 172.21.15.43:0/3813996000 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff6840a2bb0 0x7ff6840a5070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff69c19b360 tx=0x7ff69000b390 comp rx=0 tx=0).stop 2024-08-25T23:56:34.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:34.644+0000 7ff6a1b86640 1 -- 172.21.15.43:0/3813996000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff69c1019a0 msgr2=0x7ff69c199e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:56:34.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:34.644+0000 7ff6a1b86640 1 --2- 172.21.15.43:0/3813996000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff69c1019a0 0x7ff69c199e40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00e9c0 tx=0x7ff68c00ee80 comp rx=0 tx=0).stop 2024-08-25T23:56:34.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:34.644+0000 7ff6a1b86640 1 -- 172.21.15.43:0/3813996000 shutdown_connections 2024-08-25T23:56:34.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:34.644+0000 7ff6a1b86640 1 --2- 172.21.15.43:0/3813996000 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff6840a2bb0 0x7ff6840a5070 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:56:34.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:34.644+0000 7ff6a1b86640 1 --2- 172.21.15.43:0/3813996000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff69c103560 0x7ff69c1a1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:56:34.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:34.644+0000 7ff6a1b86640 1 --2- 172.21.15.43:0/3813996000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff69c102ba0 0x7ff69c19a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:56:34.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:34.644+0000 7ff6a1b86640 1 --2- 172.21.15.43:0/3813996000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff69c1019a0 0x7ff69c199e40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:56:34.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:34.644+0000 7ff6a1b86640 1 -- 172.21.15.43:0/3813996000 >> 172.21.15.43:0/3813996000 conn(0x7ff69c0fd130 msgr2=0x7ff69c105f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:56:34.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:34.644+0000 7ff6a1b86640 1 -- 172.21.15.43:0/3813996000 shutdown_connections 2024-08-25T23:56:34.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:56:34.644+0000 7ff6a1b86640 1 -- 172.21.15.43:0/3813996000 wait complete. 2024-08-25T23:56:34.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:34 smithi042 ceph-mon[17225]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-25T23:56:34.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:34.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:34.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:34.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:56:34.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:34.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:34 smithi181 ceph-mon[22102]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-25T23:56:34.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:34.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:34.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:34.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:56:34.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:35.233 DEBUG:teuthology.orchestra.run.smithi043:osd.4> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.4.service 2024-08-25T23:56:35.235 INFO:tasks.cephadm:Deploying osd.5 on smithi181 with /dev/vg_nvme/lv_3... 2024-08-25T23:56:35.235 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-25T23:56:35.489 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.c/config 2024-08-25T23:56:35.497 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:35 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:56:35.498 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:35 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:35.498 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:35 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:35.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:35 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:56:35.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:35 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:35.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:35 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:35.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:35 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:56:35.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:35 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:35.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:35 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:36.575 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:36 smithi043 ceph-mon[22091]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-25T23:56:36.618 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:36 smithi181 ceph-mon[22102]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-25T23:56:36.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:36 smithi042 ceph-mon[17225]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-25T23:56:37.908 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-25T23:56:37.938 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph orch daemon add osd smithi181:vg_nvme/lv_3 2024-08-25T23:56:38.183 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.c/config 2024-08-25T23:56:38.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:38 smithi043 ceph-mon[22091]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-25T23:56:38.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:38.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:56:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:56:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:56:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:38 smithi043 ceph-mon[22091]: from='osd.4 [v2:172.21.15.43:6808/1315420796,v1:172.21.15.43:6809/1315420796]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-25T23:56:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:38 smithi043 ceph-mon[22091]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-25T23:56:38.511 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 25 23:56:38 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-4[33459]: 2024-08-25T23:56:38.072+0000 7fcc6e080640 -1 osd.4 0 log_to_monitors true 2024-08-25T23:56:38.616 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:38 smithi181 ceph-mon[22102]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-25T23:56:38.616 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:38.616 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:38.616 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:56:38.616 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:56:38.616 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:38.616 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:38.616 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:56:38.617 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:38.617 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:38 smithi181 ceph-mon[22102]: from='osd.4 [v2:172.21.15.43:6808/1315420796,v1:172.21.15.43:6809/1315420796]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-25T23:56:38.617 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:38 smithi181 ceph-mon[22102]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-25T23:56:38.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.614+0000 7f15cc706640 1 -- 172.21.15.181:0/2885806296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15c41008b0 msgr2=0x7f15c4100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:56:38.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.614+0000 7f15cc706640 1 --2- 172.21.15.181:0/2885806296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15c41008b0 0x7f15c4100cb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009900 tx=0x7f15c002a410 comp rx=0 tx=0).stop 2024-08-25T23:56:38.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.614+0000 7f15cc706640 1 -- 172.21.15.181:0/2885806296 shutdown_connections 2024-08-25T23:56:38.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.614+0000 7f15cc706640 1 --2- 172.21.15.181:0/2885806296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c4102470 0x7f15c4108d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:56:38.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.614+0000 7f15cc706640 1 --2- 172.21.15.181:0/2885806296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f15c4101ab0 0x7f15c4101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:56:38.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.614+0000 7f15cc706640 1 --2- 172.21.15.181:0/2885806296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15c41008b0 0x7f15c4100cb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:56:38.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.614+0000 7f15cc706640 1 -- 172.21.15.181:0/2885806296 >> 172.21.15.181:0/2885806296 conn(0x7f15c40fc040 msgr2=0x7f15c40fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:56:38.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.614+0000 7f15cc706640 1 -- 172.21.15.181:0/2885806296 shutdown_connections 2024-08-25T23:56:38.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.614+0000 7f15cc706640 1 -- 172.21.15.181:0/2885806296 wait complete. 2024-08-25T23:56:38.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.615+0000 7f15cc706640 1 Processor -- start 2024-08-25T23:56:38.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.615+0000 7f15cc706640 1 -- start start 2024-08-25T23:56:38.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.615+0000 7f15cc706640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c41008b0 0x7f15c4197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:56:38.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.615+0000 7f15cc706640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f15c4101ab0 0x7f15c4198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:56:38.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.615+0000 7f15cc706640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15c4102470 0x7f15c419f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:56:38.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.615+0000 7f15cc706640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f15c410d6a0 con 0x7f15c4101ab0 2024-08-25T23:56:38.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.615+0000 7f15cc706640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f15c410d520 con 0x7f15c41008b0 2024-08-25T23:56:38.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.615+0000 7f15cc706640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f15c410d820 con 0x7f15c4102470 2024-08-25T23:56:38.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.615+0000 7f15caca3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15c4102470 0x7f15c419f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:56:38.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.615+0000 7f15caca3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15c4102470 0x7f15c419f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:51588/0 (socket says 172.21.15.181:51588) 2024-08-25T23:56:38.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.615+0000 7f15caca3640 1 -- 172.21.15.181:0/1782328238 learned_addr learned my addr 172.21.15.181:0/1782328238 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-08-25T23:56:38.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.615+0000 7f15ca4a2640 1 --2- 172.21.15.181:0/1782328238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c41008b0 0x7f15c4197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:56:38.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.615+0000 7f15c9ca1640 1 --2- 172.21.15.181:0/1782328238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f15c4101ab0 0x7f15c4198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:56:38.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.616+0000 7f15caca3640 1 -- 172.21.15.181:0/1782328238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c41008b0 msgr2=0x7f15c4197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:56:38.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.616+0000 7f15caca3640 1 --2- 172.21.15.181:0/1782328238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c41008b0 0x7f15c4197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:56:38.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.616+0000 7f15caca3640 1 -- 172.21.15.181:0/1782328238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f15c4101ab0 msgr2=0x7f15c4198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:56:38.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.616+0000 7f15caca3640 1 --2- 172.21.15.181:0/1782328238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f15c4101ab0 0x7f15c4198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:56:38.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.616+0000 7f15caca3640 1 -- 172.21.15.181:0/1782328238 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c419f970 con 0x7f15c4102470 2024-08-25T23:56:38.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.616+0000 7f15caca3640 1 --2- 172.21.15.181:0/1782328238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15c4102470 0x7f15c419f300 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00eaa0 tx=0x7f15bc00eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:56:38.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.616+0000 7f15bb7fe640 1 -- 172.21.15.181:0/1782328238 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc004d20 con 0x7f15c4102470 2024-08-25T23:56:38.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.616+0000 7f15bb7fe640 1 -- 172.21.15.181:0/1782328238 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15bc005020 con 0x7f15c4102470 2024-08-25T23:56:38.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.616+0000 7f15cc706640 1 -- 172.21.15.181:0/1782328238 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15c419fc60 con 0x7f15c4102470 2024-08-25T23:56:38.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.616+0000 7f15bb7fe640 1 -- 172.21.15.181:0/1782328238 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc0116d0 con 0x7f15c4102470 2024-08-25T23:56:38.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.616+0000 7f15cc706640 1 -- 172.21.15.181:0/1782328238 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15c41a0150 con 0x7f15c4102470 2024-08-25T23:56:38.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.617+0000 7f15cc706640 1 -- 172.21.15.181:0/1782328238 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15c4107cb0 con 0x7f15c4102470 2024-08-25T23:56:38.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.618+0000 7f15bb7fe640 1 -- 172.21.15.181:0/1782328238 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f15bc0051d0 con 0x7f15c4102470 2024-08-25T23:56:38.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.619+0000 7f15bb7fe640 1 --2- 172.21.15.181:0/1782328238 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f15b00a2bb0 0x7f15b00a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:56:38.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.619+0000 7f15bb7fe640 1 -- 172.21.15.181:0/1782328238 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3784+0+0 (secure 0 0 0) 0x7f15bc0cdff0 con 0x7f15c4102470 2024-08-25T23:56:38.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.619+0000 7f15ca4a2640 1 --2- 172.21.15.181:0/1782328238 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f15b00a2bb0 0x7f15b00a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:56:38.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.620+0000 7f15ca4a2640 1 --2- 172.21.15.181:0/1782328238 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f15b00a2bb0 0x7f15b00a5070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f15c0005ab0 tx=0x7f15c0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:56:38.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.624+0000 7f15bb7fe640 1 -- 172.21.15.181:0/1782328238 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f15bc016030 con 0x7f15c4102470 2024-08-25T23:56:38.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:38 smithi042 ceph-mon[17225]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-25T23:56:38.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:38.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:38.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:56:38.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:56:38.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:38.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:38.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:56:38.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:38.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:38 smithi042 ceph-mon[17225]: from='osd.4 [v2:172.21.15.43:6808/1315420796,v1:172.21.15.43:6809/1315420796]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-25T23:56:38.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:38 smithi042 ceph-mon[17225]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-25T23:56:38.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:38.802+0000 7f15cc706640 1 -- 172.21.15.181:0/1782328238 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f15c40623d0 con 0x7f15b00a2bb0 2024-08-25T23:56:39.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:39 smithi181 ceph-mon[22102]: Detected new or changed devices on smithi043 2024-08-25T23:56:39.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:39 smithi181 ceph-mon[22102]: Adjusting osd_memory_target on smithi043 to 8546M 2024-08-25T23:56:39.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:39 smithi181 ceph-mon[22102]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-25T23:56:39.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:39 smithi181 ceph-mon[22102]: osdmap e28: 5 total, 4 up, 5 in 2024-08-25T23:56:39.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:39 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-25T23:56:39.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:39 smithi181 ceph-mon[22102]: from='osd.4 [v2:172.21.15.43:6808/1315420796,v1:172.21.15.43:6809/1315420796]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:56:39.519 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:39 smithi181 ceph-mon[22102]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:56:39.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:39 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:56:39.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:39 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:56:39.520 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:39 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:39.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:39 smithi043 ceph-mon[22091]: Detected new or changed devices on smithi043 2024-08-25T23:56:39.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:39 smithi043 ceph-mon[22091]: Adjusting osd_memory_target on smithi043 to 8546M 2024-08-25T23:56:39.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:39 smithi043 ceph-mon[22091]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-25T23:56:39.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:39 smithi043 ceph-mon[22091]: osdmap e28: 5 total, 4 up, 5 in 2024-08-25T23:56:39.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:39 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-25T23:56:39.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:39 smithi043 ceph-mon[22091]: from='osd.4 [v2:172.21.15.43:6808/1315420796,v1:172.21.15.43:6809/1315420796]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:56:39.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:39 smithi043 ceph-mon[22091]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:56:39.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:39 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:56:39.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:39 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:56:39.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:39 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:39.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:39 smithi042 ceph-mon[17225]: Detected new or changed devices on smithi043 2024-08-25T23:56:39.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:39 smithi042 ceph-mon[17225]: Adjusting osd_memory_target on smithi043 to 8546M 2024-08-25T23:56:39.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:39 smithi042 ceph-mon[17225]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-25T23:56:39.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:39 smithi042 ceph-mon[17225]: osdmap e28: 5 total, 4 up, 5 in 2024-08-25T23:56:39.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:39 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-25T23:56:39.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:39 smithi042 ceph-mon[17225]: from='osd.4 [v2:172.21.15.43:6808/1315420796,v1:172.21.15.43:6809/1315420796]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:56:39.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:39 smithi042 ceph-mon[17225]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:56:39.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:39 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:56:39.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:39 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:56:39.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:39 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:40.260 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 25 23:56:39 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-4[33459]: 2024-08-25T23:56:39.791+0000 7fcc697e0640 -1 osd.4 0 waiting for initial osdmap 2024-08-25T23:56:40.260 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 25 23:56:39 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-4[33459]: 2024-08-25T23:56:39.798+0000 7fcc65e1a640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-25T23:56:40.391 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:40 smithi181 ceph-mon[22102]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-25T23:56:40.391 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:40 smithi181 ceph-mon[22102]: from='client.24253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:56:40.391 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:40 smithi181 ceph-mon[22102]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-08-25T23:56:40.391 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:40 smithi181 ceph-mon[22102]: osdmap e29: 5 total, 4 up, 5 in 2024-08-25T23:56:40.391 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:40 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-25T23:56:40.391 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:40 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-25T23:56:40.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:40 smithi043 ceph-mon[22091]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-25T23:56:40.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:40 smithi043 ceph-mon[22091]: from='client.24253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:56:40.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:40 smithi043 ceph-mon[22091]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-08-25T23:56:40.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:40 smithi043 ceph-mon[22091]: osdmap e29: 5 total, 4 up, 5 in 2024-08-25T23:56:40.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:40 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-25T23:56:40.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:40 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-25T23:56:40.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:40 smithi042 ceph-mon[17225]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-25T23:56:40.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:40 smithi042 ceph-mon[17225]: from='client.24253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:56:40.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:40 smithi042 ceph-mon[17225]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-08-25T23:56:40.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:40 smithi042 ceph-mon[17225]: osdmap e29: 5 total, 4 up, 5 in 2024-08-25T23:56:40.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:40 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-25T23:56:40.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:40 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-25T23:56:42.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:41 smithi181 ceph-mon[22102]: purged_snaps scrub starts 2024-08-25T23:56:42.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:41 smithi181 ceph-mon[22102]: purged_snaps scrub ok 2024-08-25T23:56:42.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:41 smithi181 ceph-mon[22102]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-25T23:56:42.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:41 smithi181 ceph-mon[22102]: osd.4 [v2:172.21.15.43:6808/1315420796,v1:172.21.15.43:6809/1315420796] boot 2024-08-25T23:56:42.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:41 smithi181 ceph-mon[22102]: osdmap e30: 5 total, 5 up, 5 in 2024-08-25T23:56:42.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:41 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-25T23:56:42.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:41 smithi181 ceph-mon[22102]: from='client.? 172.21.15.181:0/1618874230' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04e47ad9-21ba-43da-9793-d5cf83150dc4"}]: dispatch 2024-08-25T23:56:42.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:41 smithi181 ceph-mon[22102]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04e47ad9-21ba-43da-9793-d5cf83150dc4"}]: dispatch 2024-08-25T23:56:42.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:41 smithi181 ceph-mon[22102]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04e47ad9-21ba-43da-9793-d5cf83150dc4"}]': finished 2024-08-25T23:56:42.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:41 smithi181 ceph-mon[22102]: osdmap e31: 6 total, 5 up, 6 in 2024-08-25T23:56:42.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:41 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-25T23:56:42.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:41 smithi181 ceph-mon[22102]: from='client.? 172.21.15.181:0/4028603101' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:56:42.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:41 smithi043 ceph-mon[22091]: purged_snaps scrub starts 2024-08-25T23:56:42.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:41 smithi043 ceph-mon[22091]: purged_snaps scrub ok 2024-08-25T23:56:42.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:41 smithi043 ceph-mon[22091]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-25T23:56:42.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:41 smithi043 ceph-mon[22091]: osd.4 [v2:172.21.15.43:6808/1315420796,v1:172.21.15.43:6809/1315420796] boot 2024-08-25T23:56:42.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:41 smithi043 ceph-mon[22091]: osdmap e30: 5 total, 5 up, 5 in 2024-08-25T23:56:42.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:41 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-25T23:56:42.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:41 smithi043 ceph-mon[22091]: from='client.? 172.21.15.181:0/1618874230' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04e47ad9-21ba-43da-9793-d5cf83150dc4"}]: dispatch 2024-08-25T23:56:42.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:41 smithi043 ceph-mon[22091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04e47ad9-21ba-43da-9793-d5cf83150dc4"}]: dispatch 2024-08-25T23:56:42.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:41 smithi043 ceph-mon[22091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04e47ad9-21ba-43da-9793-d5cf83150dc4"}]': finished 2024-08-25T23:56:42.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:41 smithi043 ceph-mon[22091]: osdmap e31: 6 total, 5 up, 6 in 2024-08-25T23:56:42.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:41 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-25T23:56:42.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:41 smithi043 ceph-mon[22091]: from='client.? 172.21.15.181:0/4028603101' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:56:42.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:41 smithi042 ceph-mon[17225]: purged_snaps scrub starts 2024-08-25T23:56:42.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:41 smithi042 ceph-mon[17225]: purged_snaps scrub ok 2024-08-25T23:56:42.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:41 smithi042 ceph-mon[17225]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-25T23:56:42.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:41 smithi042 ceph-mon[17225]: osd.4 [v2:172.21.15.43:6808/1315420796,v1:172.21.15.43:6809/1315420796] boot 2024-08-25T23:56:42.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:41 smithi042 ceph-mon[17225]: osdmap e30: 5 total, 5 up, 5 in 2024-08-25T23:56:42.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:41 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-25T23:56:42.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:41 smithi042 ceph-mon[17225]: from='client.? 172.21.15.181:0/1618874230' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04e47ad9-21ba-43da-9793-d5cf83150dc4"}]: dispatch 2024-08-25T23:56:42.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:41 smithi042 ceph-mon[17225]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04e47ad9-21ba-43da-9793-d5cf83150dc4"}]: dispatch 2024-08-25T23:56:42.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:41 smithi042 ceph-mon[17225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04e47ad9-21ba-43da-9793-d5cf83150dc4"}]': finished 2024-08-25T23:56:42.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:41 smithi042 ceph-mon[17225]: osdmap e31: 6 total, 5 up, 6 in 2024-08-25T23:56:42.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:41 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-25T23:56:42.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:41 smithi042 ceph-mon[17225]: from='client.? 172.21.15.181:0/4028603101' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:56:43.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:43 smithi043 ceph-mon[22091]: osdmap e32: 6 total, 5 up, 6 in 2024-08-25T23:56:43.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:43 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-25T23:56:43.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:43 smithi042 ceph-mon[17225]: osdmap e32: 6 total, 5 up, 6 in 2024-08-25T23:56:43.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:43 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-25T23:56:43.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:43 smithi181 ceph-mon[22102]: osdmap e32: 6 total, 5 up, 6 in 2024-08-25T23:56:43.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:43 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-25T23:56:44.411 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:44 smithi043 ceph-mon[22091]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:44.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:44 smithi042 ceph-mon[17225]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:44.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:44 smithi181 ceph-mon[22102]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:46.481 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:46 smithi181 ceph-mon[22102]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:46.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:46 smithi043 ceph-mon[22091]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:46.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:46 smithi042 ceph-mon[17225]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:48.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:48 smithi181 ceph-mon[22102]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:48.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:48 smithi043 ceph-mon[22091]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:48.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:48 smithi042 ceph-mon[17225]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:50.468 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:50 smithi181 ceph-mon[22102]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:50.469 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:50 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-25T23:56:50.469 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:50 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:50.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:50 smithi043 ceph-mon[22091]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:50.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:50 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-25T23:56:50.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:50 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:50.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:50 smithi042 ceph-mon[17225]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:50.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:50 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-25T23:56:50.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:50 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:51.435 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:51 smithi181 ceph-mon[22102]: Deploying daemon osd.5 on smithi181 2024-08-25T23:56:51.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:51 smithi043 ceph-mon[22091]: Deploying daemon osd.5 on smithi181 2024-08-25T23:56:51.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:51 smithi042 ceph-mon[17225]: Deploying daemon osd.5 on smithi181 2024-08-25T23:56:52.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:52 smithi181 ceph-mon[22102]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:52.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:52 smithi043 ceph-mon[22091]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:52.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:52 smithi042 ceph-mon[17225]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:54.282 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:54 smithi181 ceph-mon[22102]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:54.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:54 smithi043 ceph-mon[22091]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:54.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:54 smithi042 ceph-mon[17225]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:55.447 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:55 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:56:55.447 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:55 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:55.447 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:55 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:55.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:55 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:56:55.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:55 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:55.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:55 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:55.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:55 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:56:55.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:55 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:55.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:55 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:56.426 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:56 smithi181 ceph-mon[22102]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:56.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:56 smithi043 ceph-mon[22091]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:56.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:56 smithi042 ceph-mon[17225]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:58.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:58 smithi181 ceph-mon[22102]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:58.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:58 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:58.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:58 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:58.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:58 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:58.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:58 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:56:58.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:58 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:58.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:58 smithi043 ceph-mon[22091]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:58.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:58 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:58.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:58 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:58.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:58 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:58.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:58 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:56:58.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:58 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:58.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:58 smithi042 ceph-mon[17225]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:56:58.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:58 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:58.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:58 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:58.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:58 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:56:58.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:58 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:56:58.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:58 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:58.636 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 5 on host 'smithi181' 2024-08-25T23:56:58.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:58.635+0000 7f15bb7fe640 1 -- 172.21.15.181:0/1782328238 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f15c40623d0 con 0x7f15b00a2bb0 2024-08-25T23:56:58.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:58.637+0000 7f15cc706640 1 -- 172.21.15.181:0/1782328238 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f15b00a2bb0 msgr2=0x7f15b00a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:56:58.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:58.637+0000 7f15cc706640 1 --2- 172.21.15.181:0/1782328238 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f15b00a2bb0 0x7f15b00a5070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f15c0005ab0 tx=0x7f15c0000bc0 comp rx=0 tx=0).stop 2024-08-25T23:56:58.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:58.637+0000 7f15cc706640 1 -- 172.21.15.181:0/1782328238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15c4102470 msgr2=0x7f15c419f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:56:58.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:58.637+0000 7f15cc706640 1 --2- 172.21.15.181:0/1782328238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15c4102470 0x7f15c419f300 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00eaa0 tx=0x7f15bc00eea0 comp rx=0 tx=0).stop 2024-08-25T23:56:58.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:58.637+0000 7f15cc706640 1 -- 172.21.15.181:0/1782328238 shutdown_connections 2024-08-25T23:56:58.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:58.637+0000 7f15cc706640 1 --2- 172.21.15.181:0/1782328238 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f15b00a2bb0 0x7f15b00a5070 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:56:58.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:58.637+0000 7f15cc706640 1 --2- 172.21.15.181:0/1782328238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15c4102470 0x7f15c419f300 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:56:58.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:58.637+0000 7f15cc706640 1 --2- 172.21.15.181:0/1782328238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f15c4101ab0 0x7f15c4198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:56:58.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:58.637+0000 7f15cc706640 1 --2- 172.21.15.181:0/1782328238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c41008b0 0x7f15c4197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:56:58.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:58.637+0000 7f15cc706640 1 -- 172.21.15.181:0/1782328238 >> 172.21.15.181:0/1782328238 conn(0x7f15c40fc040 msgr2=0x7f15c4104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:56:58.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:58.637+0000 7f15cc706640 1 -- 172.21.15.181:0/1782328238 shutdown_connections 2024-08-25T23:56:58.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:56:58.638+0000 7f15cc706640 1 -- 172.21.15.181:0/1782328238 wait complete. 2024-08-25T23:56:59.264 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:59 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:56:59.264 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:59 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:59.264 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:56:59 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:59.292 DEBUG:teuthology.orchestra.run.smithi181:osd.5> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.5.service 2024-08-25T23:56:59.294 INFO:tasks.cephadm:Deploying osd.6 on smithi042 with /dev/vg_nvme/lv_2... 2024-08-25T23:56:59.294 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-25T23:56:59.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:59 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:56:59.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:59 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:59.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:56:59 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:59.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:59 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:56:59.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:59 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:59.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:56:59 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:56:59.674 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:57:00.370 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:00 smithi181 ceph-mon[22102]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:57:00.391 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:00 smithi042 ceph-mon[17225]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:57:00.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:00 smithi043 ceph-mon[22091]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:57:01.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:01 smithi181 ceph-mon[22102]: from='osd.5 [v2:172.21.15.181:6808/246971403,v1:172.21.15.181:6809/246971403]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-25T23:57:01.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:01 smithi181 ceph-mon[22102]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-25T23:57:01.284 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 25 23:57:00 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-25T23:57:00.950+0000 7f65c8b61640 -1 osd.5 0 log_to_monitors true 2024-08-25T23:57:01.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:01 smithi043 ceph-mon[22091]: from='osd.5 [v2:172.21.15.181:6808/246971403,v1:172.21.15.181:6809/246971403]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-25T23:57:01.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:01 smithi043 ceph-mon[22091]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-25T23:57:01.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:01 smithi042 ceph-mon[17225]: from='osd.5 [v2:172.21.15.181:6808/246971403,v1:172.21.15.181:6809/246971403]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-25T23:57:01.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:01 smithi042 ceph-mon[17225]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-25T23:57:02.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:02 smithi042 ceph-mon[17225]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:57:02.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:02 smithi042 ceph-mon[17225]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-25T23:57:02.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:02 smithi042 ceph-mon[17225]: osdmap e33: 6 total, 5 up, 6 in 2024-08-25T23:57:02.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-25T23:57:02.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:02 smithi042 ceph-mon[17225]: from='osd.5 [v2:172.21.15.181:6808/246971403,v1:172.21.15.181:6809/246971403]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:57:02.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:02 smithi042 ceph-mon[17225]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:57:02.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:02.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:02.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:02.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:02.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:02.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:02.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:57:02.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:02.285 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 25 23:57:02 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-25T23:57:02.178+0000 7f65c42c1640 -1 osd.5 0 waiting for initial osdmap 2024-08-25T23:57:02.285 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 25 23:57:02 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-25T23:57:02.186+0000 7f65c08fb640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-25T23:57:02.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:02 smithi181 ceph-mon[22102]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:57:02.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:02 smithi181 ceph-mon[22102]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-25T23:57:02.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:02 smithi181 ceph-mon[22102]: osdmap e33: 6 total, 5 up, 6 in 2024-08-25T23:57:02.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:02 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-25T23:57:02.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:02 smithi181 ceph-mon[22102]: from='osd.5 [v2:172.21.15.181:6808/246971403,v1:172.21.15.181:6809/246971403]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:57:02.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:02 smithi181 ceph-mon[22102]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:57:02.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:02 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:02.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:02 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:02.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:02 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:02.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:02 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:02.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:02 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:02.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:02 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:02.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:02 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:57:02.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:02 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:02.314 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:57:02.354 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph orch daemon add osd smithi042:vg_nvme/lv_2 2024-08-25T23:57:02.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:02 smithi043 ceph-mon[22091]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:57:02.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:02 smithi043 ceph-mon[22091]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-25T23:57:02.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:02 smithi043 ceph-mon[22091]: osdmap e33: 6 total, 5 up, 6 in 2024-08-25T23:57:02.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:02 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-25T23:57:02.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:02 smithi043 ceph-mon[22091]: from='osd.5 [v2:172.21.15.181:6808/246971403,v1:172.21.15.181:6809/246971403]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:57:02.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:02 smithi043 ceph-mon[22091]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:57:02.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:02 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:02.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:02 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:02.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:02 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:02.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:02 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:02.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:02 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:02.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:02 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:02.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:02 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:57:02.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:02 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:02.746 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:57:03.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.264+0000 7fb0a0000640 1 -- 172.21.15.42:0/3311132208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0981019a0 msgr2=0x7fb098101da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:57:03.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.264+0000 7fb0a0000640 1 --2- 172.21.15.42:0/3311132208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0981019a0 0x7fb098101da0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009900 tx=0x7fb08c02a3f0 comp rx=0 tx=0).stop 2024-08-25T23:57:03.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.264+0000 7fb0a0000640 1 -- 172.21.15.42:0/3311132208 shutdown_connections 2024-08-25T23:57:03.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.264+0000 7fb0a0000640 1 --2- 172.21.15.42:0/3311132208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb098103560 0x7fb098109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:57:03.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.264+0000 7fb0a0000640 1 --2- 172.21.15.42:0/3311132208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb098102ba0 0x7fb098103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:57:03.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.264+0000 7fb0a0000640 1 --2- 172.21.15.42:0/3311132208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0981019a0 0x7fb098101da0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:57:03.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.265+0000 7fb0a0000640 1 -- 172.21.15.42:0/3311132208 >> 172.21.15.42:0/3311132208 conn(0x7fb0980fd130 msgr2=0x7fb0980ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:57:03.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.265+0000 7fb0a0000640 1 -- 172.21.15.42:0/3311132208 shutdown_connections 2024-08-25T23:57:03.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.265+0000 7fb0a0000640 1 -- 172.21.15.42:0/3311132208 wait complete. 2024-08-25T23:57:03.267 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:03 smithi042 ceph-mon[17225]: Detected new or changed devices on smithi181 2024-08-25T23:57:03.268 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:03 smithi042 ceph-mon[17225]: Adjusting osd_memory_target on smithi181 to 8544M 2024-08-25T23:57:03.268 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:03 smithi042 ceph-mon[17225]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-08-25T23:57:03.268 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:03 smithi042 ceph-mon[17225]: osdmap e34: 6 total, 5 up, 6 in 2024-08-25T23:57:03.268 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:03 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-25T23:57:03.268 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:03 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-25T23:57:03.268 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:03 smithi042 ceph-mon[17225]: osd.5 [v2:172.21.15.181:6808/246971403,v1:172.21.15.181:6809/246971403] boot 2024-08-25T23:57:03.268 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:03 smithi042 ceph-mon[17225]: osdmap e35: 6 total, 6 up, 6 in 2024-08-25T23:57:03.268 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:03 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-25T23:57:03.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.266+0000 7fb0a0000640 1 Processor -- start 2024-08-25T23:57:03.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.266+0000 7fb0a0000640 1 -- start start 2024-08-25T23:57:03.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.266+0000 7fb0a0000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0981019a0 0x7fb098199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:57:03.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.266+0000 7fb0a0000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb098102ba0 0x7fb09819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:57:03.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.266+0000 7fb0a0000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb098103560 0x7fb0981a1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:57:03.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.266+0000 7fb0a0000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb09810d670 con 0x7fb0981019a0 2024-08-25T23:57:03.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.266+0000 7fb0a0000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb09810d4f0 con 0x7fb098103560 2024-08-25T23:57:03.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.266+0000 7fb0a0000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb09810d7f0 con 0x7fb098102ba0 2024-08-25T23:57:03.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.266+0000 7fb09d600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0981019a0 0x7fb098199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:57:03.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.267+0000 7fb09d600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0981019a0 0x7fb098199ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33474/0 (socket says 172.21.15.42:33474) 2024-08-25T23:57:03.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.267+0000 7fb09d600640 1 -- 172.21.15.42:0/3268710519 learned_addr learned my addr 172.21.15.42:0/3268710519 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:57:03.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.267+0000 7fb09cc00640 1 --2- 172.21.15.42:0/3268710519 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb098102ba0 0x7fb09819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:57:03.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.267+0000 7fb09e000640 1 --2- 172.21.15.42:0/3268710519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb098103560 0x7fb0981a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:57:03.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.267+0000 7fb09cc00640 1 -- 172.21.15.42:0/3268710519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb098103560 msgr2=0x7fb0981a1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:57:03.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.267+0000 7fb09cc00640 1 --2- 172.21.15.42:0/3268710519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb098103560 0x7fb0981a1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:57:03.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.267+0000 7fb09cc00640 1 -- 172.21.15.42:0/3268710519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0981019a0 msgr2=0x7fb098199ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:57:03.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.267+0000 7fb09cc00640 1 --2- 172.21.15.42:0/3268710519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0981019a0 0x7fb098199ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:57:03.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.267+0000 7fb09cc00640 1 -- 172.21.15.42:0/3268710519 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0981a1b00 con 0x7fb098102ba0 2024-08-25T23:57:03.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.268+0000 7fb09cc00640 1 --2- 172.21.15.42:0/3268710519 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb098102ba0 0x7fb09819a410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb08400e9f0 tx=0x7fb08400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:57:03.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.268+0000 7fb096000640 1 -- 172.21.15.42:0/3268710519 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08400ccc0 con 0x7fb098102ba0 2024-08-25T23:57:03.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.268+0000 7fb096000640 1 -- 172.21.15.42:0/3268710519 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb084005020 con 0x7fb098102ba0 2024-08-25T23:57:03.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.268+0000 7fb096000640 1 -- 172.21.15.42:0/3268710519 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0840049e0 con 0x7fb098102ba0 2024-08-25T23:57:03.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.268+0000 7fb0a0000640 1 -- 172.21.15.42:0/3268710519 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0981a1df0 con 0x7fb098102ba0 2024-08-25T23:57:03.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.268+0000 7fb0a0000640 1 -- 172.21.15.42:0/3268710519 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0981a2250 con 0x7fb098102ba0 2024-08-25T23:57:03.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.270+0000 7fb0a0000640 1 -- 172.21.15.42:0/3268710519 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0981a2540 con 0x7fb098102ba0 2024-08-25T23:57:03.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.272+0000 7fb096000640 1 -- 172.21.15.42:0/3268710519 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb084005560 con 0x7fb098102ba0 2024-08-25T23:57:03.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.273+0000 7fb096000640 1 --2- 172.21.15.42:0/3268710519 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb0800a2bb0 0x7fb0800a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:57:03.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.273+0000 7fb096000640 1 -- 172.21.15.42:0/3268710519 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4566+0+0 (secure 0 0 0) 0x7fb0840ce120 con 0x7fb098102ba0 2024-08-25T23:57:03.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.274+0000 7fb09d600640 1 --2- 172.21.15.42:0/3268710519 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb0800a2bb0 0x7fb0800a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:57:03.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.274+0000 7fb09d600640 1 --2- 172.21.15.42:0/3268710519 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb0800a2bb0 0x7fb0800a5070 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb08c000c00 tx=0x7fb08c0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:57:03.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.277+0000 7fb096000640 1 -- 172.21.15.42:0/3268710519 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb0840051d0 con 0x7fb098102ba0 2024-08-25T23:57:03.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:03.474+0000 7fb0a0000640 1 -- 172.21.15.42:0/3268710519 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fb0981a2710 con 0x7fb0800a2bb0 2024-08-25T23:57:03.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:03 smithi043 ceph-mon[22091]: Detected new or changed devices on smithi181 2024-08-25T23:57:03.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:03 smithi043 ceph-mon[22091]: Adjusting osd_memory_target on smithi181 to 8544M 2024-08-25T23:57:03.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:03 smithi043 ceph-mon[22091]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-08-25T23:57:03.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:03 smithi043 ceph-mon[22091]: osdmap e34: 6 total, 5 up, 6 in 2024-08-25T23:57:03.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:03 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-25T23:57:03.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:03 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-25T23:57:03.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:03 smithi043 ceph-mon[22091]: osd.5 [v2:172.21.15.181:6808/246971403,v1:172.21.15.181:6809/246971403] boot 2024-08-25T23:57:03.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:03 smithi043 ceph-mon[22091]: osdmap e35: 6 total, 6 up, 6 in 2024-08-25T23:57:03.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:03 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-25T23:57:03.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:03 smithi181 ceph-mon[22102]: Detected new or changed devices on smithi181 2024-08-25T23:57:03.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:03 smithi181 ceph-mon[22102]: Adjusting osd_memory_target on smithi181 to 8544M 2024-08-25T23:57:03.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:03 smithi181 ceph-mon[22102]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-08-25T23:57:03.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:03 smithi181 ceph-mon[22102]: osdmap e34: 6 total, 5 up, 6 in 2024-08-25T23:57:03.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:03 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-25T23:57:03.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:03 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-25T23:57:03.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:03 smithi181 ceph-mon[22102]: osd.5 [v2:172.21.15.181:6808/246971403,v1:172.21.15.181:6809/246971403] boot 2024-08-25T23:57:03.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:03 smithi181 ceph-mon[22102]: osdmap e35: 6 total, 6 up, 6 in 2024-08-25T23:57:03.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:03 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-25T23:57:04.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:04 smithi042 ceph-mon[17225]: purged_snaps scrub starts 2024-08-25T23:57:04.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:04 smithi042 ceph-mon[17225]: purged_snaps scrub ok 2024-08-25T23:57:04.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:04 smithi042 ceph-mon[17225]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:57:04.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:04 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:57:04.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:04 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:57:04.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:04 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:04.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:04 smithi042 ceph-mon[17225]: osdmap e36: 6 total, 6 up, 6 in 2024-08-25T23:57:04.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:04 smithi043 ceph-mon[22091]: purged_snaps scrub starts 2024-08-25T23:57:04.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:04 smithi043 ceph-mon[22091]: purged_snaps scrub ok 2024-08-25T23:57:04.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:04 smithi043 ceph-mon[22091]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:57:04.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:04 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:57:04.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:04 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:57:04.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:04 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:04.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:04 smithi043 ceph-mon[22091]: osdmap e36: 6 total, 6 up, 6 in 2024-08-25T23:57:04.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:04 smithi181 ceph-mon[22102]: purged_snaps scrub starts 2024-08-25T23:57:04.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:04 smithi181 ceph-mon[22102]: purged_snaps scrub ok 2024-08-25T23:57:04.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:04 smithi181 ceph-mon[22102]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-25T23:57:04.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:04 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:57:04.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:04 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:57:04.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:04 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:04.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:04 smithi181 ceph-mon[22102]: osdmap e36: 6 total, 6 up, 6 in 2024-08-25T23:57:05.392 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:05 smithi042 ceph-mon[17225]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:57:05.392 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:05 smithi042 ceph-mon[17225]: osdmap e37: 6 total, 6 up, 6 in 2024-08-25T23:57:05.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:05 smithi043 ceph-mon[22091]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:57:05.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:05 smithi043 ceph-mon[22091]: osdmap e37: 6 total, 6 up, 6 in 2024-08-25T23:57:05.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:05 smithi181 ceph-mon[22102]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:57:05.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:05 smithi181 ceph-mon[22102]: osdmap e37: 6 total, 6 up, 6 in 2024-08-25T23:57:06.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:06 smithi042 ceph-mon[17225]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:06.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:06 smithi042 ceph-mon[17225]: osdmap e38: 6 total, 6 up, 6 in 2024-08-25T23:57:06.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:06 smithi043 ceph-mon[22091]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:06.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:06 smithi043 ceph-mon[22091]: osdmap e38: 6 total, 6 up, 6 in 2024-08-25T23:57:06.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:06 smithi181 ceph-mon[22102]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:06.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:06 smithi181 ceph-mon[22102]: osdmap e38: 6 total, 6 up, 6 in 2024-08-25T23:57:07.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:07 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/4265104981' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f48161cd-bc44-4d99-8248-1bb845111129"}]: dispatch 2024-08-25T23:57:07.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:07 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/4265104981' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f48161cd-bc44-4d99-8248-1bb845111129"}]': finished 2024-08-25T23:57:07.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:07 smithi043 ceph-mon[22091]: osdmap e39: 7 total, 6 up, 7 in 2024-08-25T23:57:07.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:07 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-25T23:57:07.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:07 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/2308007235' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:57:07.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:07 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/4265104981' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f48161cd-bc44-4d99-8248-1bb845111129"}]: dispatch 2024-08-25T23:57:07.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:07 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/4265104981' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f48161cd-bc44-4d99-8248-1bb845111129"}]': finished 2024-08-25T23:57:07.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:07 smithi042 ceph-mon[17225]: osdmap e39: 7 total, 6 up, 7 in 2024-08-25T23:57:07.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:07 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-25T23:57:07.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:07 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2308007235' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:57:07.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:07 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/4265104981' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f48161cd-bc44-4d99-8248-1bb845111129"}]: dispatch 2024-08-25T23:57:07.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:07 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/4265104981' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f48161cd-bc44-4d99-8248-1bb845111129"}]': finished 2024-08-25T23:57:07.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:07 smithi181 ceph-mon[22102]: osdmap e39: 7 total, 6 up, 7 in 2024-08-25T23:57:07.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:07 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-25T23:57:07.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:07 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/2308007235' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:57:08.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:08 smithi043 ceph-mon[22091]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:08.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:08 smithi042 ceph-mon[17225]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:08.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:08 smithi181 ceph-mon[22102]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:10.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:10 smithi043 ceph-mon[22091]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-08-25T23:57:10.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:10 smithi042 ceph-mon[17225]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-08-25T23:57:10.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:10 smithi181 ceph-mon[22102]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-08-25T23:57:12.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:12 smithi043 ceph-mon[22091]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-25T23:57:12.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:12 smithi042 ceph-mon[17225]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-25T23:57:12.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:12 smithi181 ceph-mon[22102]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-25T23:57:14.349 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:14 smithi042 ceph-mon[17225]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-08-25T23:57:14.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:14 smithi043 ceph-mon[22091]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-08-25T23:57:14.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:14 smithi181 ceph-mon[22102]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-08-25T23:57:16.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:16 smithi043 ceph-mon[22091]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-08-25T23:57:16.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:16 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-08-25T23:57:16.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:16 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:16.512 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:16 smithi042 ceph-mon[17225]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-08-25T23:57:16.512 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:16 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-08-25T23:57:16.512 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:16 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:16.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:16 smithi181 ceph-mon[22102]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-08-25T23:57:16.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:16 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-08-25T23:57:16.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:16 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:17.402 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:17 smithi042 ceph-mon[17225]: Deploying daemon osd.6 on smithi042 2024-08-25T23:57:17.491 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:17 smithi181 ceph-mon[22102]: Deploying daemon osd.6 on smithi042 2024-08-25T23:57:17.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:17 smithi043 ceph-mon[22091]: Deploying daemon osd.6 on smithi042 2024-08-25T23:57:18.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:18 smithi042 ceph-mon[17225]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-08-25T23:57:18.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:18 smithi043 ceph-mon[22091]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-08-25T23:57:18.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:18 smithi181 ceph-mon[22102]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-08-25T23:57:20.466 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:20 smithi042 ceph-mon[17225]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-25T23:57:20.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:20 smithi043 ceph-mon[22091]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-25T23:57:20.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:20 smithi181 ceph-mon[22102]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-25T23:57:22.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:22 smithi043 ceph-mon[22091]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:22.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:22 smithi042 ceph-mon[17225]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:22.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:22 smithi181 ceph-mon[22102]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:23.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:23 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:57:23.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:23 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:23.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:23 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:23.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:23 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:57:23.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:23 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:23.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:23 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:23.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:23 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:57:23.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:23 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:23.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:23 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:24.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:24 smithi042 ceph-mon[17225]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:24.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:24 smithi181 ceph-mon[22102]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:24.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:24 smithi043 ceph-mon[22091]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:26.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:26.257+0000 7fb096000640 1 -- 172.21.15.42:0/3268710519 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb0981a2710 con 0x7fb0800a2bb0 2024-08-25T23:57:26.259 INFO:teuthology.orchestra.run.smithi042.stdout:Created osd(s) 6 on host 'smithi042' 2024-08-25T23:57:26.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:26.259+0000 7fb0a0000640 1 -- 172.21.15.42:0/3268710519 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb0800a2bb0 msgr2=0x7fb0800a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:57:26.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:26.259+0000 7fb0a0000640 1 --2- 172.21.15.42:0/3268710519 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb0800a2bb0 0x7fb0800a5070 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb08c000c00 tx=0x7fb08c0315b0 comp rx=0 tx=0).stop 2024-08-25T23:57:26.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:26.259+0000 7fb0a0000640 1 -- 172.21.15.42:0/3268710519 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb098102ba0 msgr2=0x7fb09819a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:57:26.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:26.259+0000 7fb0a0000640 1 --2- 172.21.15.42:0/3268710519 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb098102ba0 0x7fb09819a410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb08400e9f0 tx=0x7fb08400eeb0 comp rx=0 tx=0).stop 2024-08-25T23:57:26.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:26.260+0000 7fb0a0000640 1 -- 172.21.15.42:0/3268710519 shutdown_connections 2024-08-25T23:57:26.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:26.260+0000 7fb0a0000640 1 --2- 172.21.15.42:0/3268710519 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb0800a2bb0 0x7fb0800a5070 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:57:26.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:26.260+0000 7fb0a0000640 1 --2- 172.21.15.42:0/3268710519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb098103560 0x7fb0981a1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:57:26.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:26.260+0000 7fb0a0000640 1 --2- 172.21.15.42:0/3268710519 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb098102ba0 0x7fb09819a410 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:57:26.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:26.260+0000 7fb0a0000640 1 --2- 172.21.15.42:0/3268710519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0981019a0 0x7fb098199ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:57:26.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:26.260+0000 7fb0a0000640 1 -- 172.21.15.42:0/3268710519 >> 172.21.15.42:0/3268710519 conn(0x7fb0980fd130 msgr2=0x7fb0980741c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:57:26.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:26.260+0000 7fb0a0000640 1 -- 172.21.15.42:0/3268710519 shutdown_connections 2024-08-25T23:57:26.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:57:26.260+0000 7fb0a0000640 1 -- 172.21.15.42:0/3268710519 wait complete. 2024-08-25T23:57:26.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:26 smithi043 ceph-mon[22091]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:26.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:26 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:26.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:26 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:26.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:26 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:26.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:26 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:57:26.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:26 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:26.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:26 smithi042 ceph-mon[17225]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:26.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:26 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:26.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:26 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:26.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:26 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:26.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:26 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:57:26.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:26 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:26.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:26 smithi181 ceph-mon[22102]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:26.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:26 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:26.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:26 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:26.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:26 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:26.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:26 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:57:26.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:26 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:27.106 DEBUG:teuthology.orchestra.run.smithi042:osd.6> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.6.service 2024-08-25T23:57:27.110 INFO:tasks.cephadm:Deploying osd.7 on smithi043 with /dev/vg_nvme/lv_2... 2024-08-25T23:57:27.111 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-25T23:57:27.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:27 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:57:27.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:27 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:27.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:27 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:27.372 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.b/config 2024-08-25T23:57:27.420 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:27 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:57:27.420 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:27 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:27.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:27 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:27.467 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:27 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:57:27.467 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:27 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:27.467 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:27 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:28.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:28 smithi043 ceph-mon[22091]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:28.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:28 smithi042 ceph-mon[17225]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:28.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:28 smithi181 ceph-mon[22102]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:28.805 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 25 23:57:28 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-25T23:57:28.723+0000 7f4fe721c640 -1 osd.6 0 log_to_monitors true 2024-08-25T23:57:29.503 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:29 smithi043 ceph-mon[22091]: from='osd.6 [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-08-25T23:57:29.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:29 smithi042 ceph-mon[17225]: from='osd.6 [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-08-25T23:57:29.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:29 smithi181 ceph-mon[22102]: from='osd.6 [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-08-25T23:57:29.950 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-08-25T23:57:29.975 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph orch daemon add osd smithi043:vg_nvme/lv_2 2024-08-25T23:57:30.226 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.b/config 2024-08-25T23:57:30.272 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:30 smithi042 ceph-mon[17225]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:30.272 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:30 smithi042 ceph-mon[17225]: from='osd.6 [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-25T23:57:30.272 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:30 smithi042 ceph-mon[17225]: osdmap e40: 7 total, 6 up, 7 in 2024-08-25T23:57:30.272 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:30 smithi042 ceph-mon[17225]: from='osd.6 [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-08-25T23:57:30.272 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:30 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-25T23:57:30.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:30 smithi181 ceph-mon[22102]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:30.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:30 smithi181 ceph-mon[22102]: from='osd.6 [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-25T23:57:30.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:30 smithi181 ceph-mon[22102]: osdmap e40: 7 total, 6 up, 7 in 2024-08-25T23:57:30.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:30 smithi181 ceph-mon[22102]: from='osd.6 [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-08-25T23:57:30.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:30 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-25T23:57:30.566 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:30 smithi043 ceph-mon[22091]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:30.566 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:30 smithi043 ceph-mon[22091]: from='osd.6 [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-25T23:57:30.567 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:30 smithi043 ceph-mon[22091]: osdmap e40: 7 total, 6 up, 7 in 2024-08-25T23:57:30.567 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:30 smithi043 ceph-mon[22091]: from='osd.6 [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-08-25T23:57:30.567 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:30 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-25T23:57:30.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.651+0000 7fc91f75b640 1 -- 172.21.15.43:0/4139016069 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc918075f60 msgr2=0x7fc9180743c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:57:30.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.651+0000 7fc91f75b640 1 --2- 172.21.15.43:0/4139016069 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc918075f60 0x7fc9180743c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc914009900 tx=0x7fc91402a480 comp rx=0 tx=0).stop 2024-08-25T23:57:30.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.651+0000 7fc91f75b640 1 -- 172.21.15.43:0/4139016069 shutdown_connections 2024-08-25T23:57:30.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.651+0000 7fc91f75b640 1 --2- 172.21.15.43:0/4139016069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc918109850 0x7fc91810bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:57:30.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.651+0000 7fc91f75b640 1 --2- 172.21.15.43:0/4139016069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc918074990 0x7fc918074df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:57:30.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.651+0000 7fc91f75b640 1 --2- 172.21.15.43:0/4139016069 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc918075f60 0x7fc9180743c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:57:30.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.651+0000 7fc91f75b640 1 -- 172.21.15.43:0/4139016069 >> 172.21.15.43:0/4139016069 conn(0x7fc9180fd160 msgr2=0x7fc9180ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:57:30.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.651+0000 7fc91f75b640 1 -- 172.21.15.43:0/4139016069 shutdown_connections 2024-08-25T23:57:30.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.651+0000 7fc91f75b640 1 -- 172.21.15.43:0/4139016069 wait complete. 2024-08-25T23:57:30.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.652+0000 7fc91f75b640 1 Processor -- start 2024-08-25T23:57:30.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.652+0000 7fc91f75b640 1 -- start start 2024-08-25T23:57:30.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.652+0000 7fc91f75b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc918074990 0x7fc918199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:57:30.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.652+0000 7fc91f75b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc918075f60 0x7fc91819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:57:30.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.652+0000 7fc91f75b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc918109850 0x7fc9181a1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:57:30.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.652+0000 7fc91f75b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc91810f830 con 0x7fc918074990 2024-08-25T23:57:30.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.652+0000 7fc91f75b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc91810f6b0 con 0x7fc918075f60 2024-08-25T23:57:30.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.652+0000 7fc91f75b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc91810f9b0 con 0x7fc918109850 2024-08-25T23:57:30.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.652+0000 7fc91ccf6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc918075f60 0x7fc91819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:57:30.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.652+0000 7fc91ccf6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc918075f60 0x7fc91819a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:45858/0 (socket says 172.21.15.43:45858) 2024-08-25T23:57:30.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.652+0000 7fc91ccf6640 1 -- 172.21.15.43:0/258447331 learned_addr learned my addr 172.21.15.43:0/258447331 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-08-25T23:57:30.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.652+0000 7fc91d4f7640 1 --2- 172.21.15.43:0/258447331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc918074990 0x7fc918199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:57:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.652+0000 7fc91dcf8640 1 --2- 172.21.15.43:0/258447331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc918109850 0x7fc9181a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:57:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.652+0000 7fc91ccf6640 1 -- 172.21.15.43:0/258447331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc918109850 msgr2=0x7fc9181a1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:57:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.652+0000 7fc91ccf6640 1 --2- 172.21.15.43:0/258447331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc918109850 0x7fc9181a1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:57:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.652+0000 7fc91ccf6640 1 -- 172.21.15.43:0/258447331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc918074990 msgr2=0x7fc918199ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:57:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.652+0000 7fc91ccf6640 1 --2- 172.21.15.43:0/258447331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc918074990 0x7fc918199ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:57:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.652+0000 7fc91ccf6640 1 -- 172.21.15.43:0/258447331 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9181a1b00 con 0x7fc918075f60 2024-08-25T23:57:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.652+0000 7fc91dcf8640 1 --2- 172.21.15.43:0/258447331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc918109850 0x7fc9181a1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-25T23:57:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.653+0000 7fc91ccf6640 1 --2- 172.21.15.43:0/258447331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc918075f60 0x7fc91819a410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc90800c970 tx=0x7fc90800ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:57:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.653+0000 7fc90e7fc640 1 -- 172.21.15.43:0/258447331 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908007bb0 con 0x7fc918075f60 2024-08-25T23:57:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.653+0000 7fc91f75b640 1 -- 172.21.15.43:0/258447331 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9181a1df0 con 0x7fc918075f60 2024-08-25T23:57:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.653+0000 7fc90e7fc640 1 -- 172.21.15.43:0/258447331 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc908007d50 con 0x7fc918075f60 2024-08-25T23:57:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.653+0000 7fc90e7fc640 1 -- 172.21.15.43:0/258447331 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90800f450 con 0x7fc918075f60 2024-08-25T23:57:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.653+0000 7fc91f75b640 1 -- 172.21.15.43:0/258447331 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9181a2250 con 0x7fc918075f60 2024-08-25T23:57:30.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.654+0000 7fc91f75b640 1 -- 172.21.15.43:0/258447331 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc918108610 con 0x7fc918075f60 2024-08-25T23:57:30.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.655+0000 7fc90e7fc640 1 -- 172.21.15.43:0/258447331 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc908005020 con 0x7fc918075f60 2024-08-25T23:57:30.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.656+0000 7fc90e7fc640 1 --2- 172.21.15.43:0/258447331 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc9040a2bb0 0x7fc9040a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:57:30.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.656+0000 7fc90e7fc640 1 -- 172.21.15.43:0/258447331 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4685+0+0 (secure 0 0 0) 0x7fc9080ce060 con 0x7fc918075f60 2024-08-25T23:57:30.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.656+0000 7fc91d4f7640 1 --2- 172.21.15.43:0/258447331 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc9040a2bb0 0x7fc9040a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:57:30.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.657+0000 7fc91d4f7640 1 --2- 172.21.15.43:0/258447331 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc9040a2bb0 0x7fc9040a5070 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc9140314e0 tx=0x7fc914000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:57:30.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.660+0000 7fc90e7fc640 1 -- 172.21.15.43:0/258447331 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fc908014030 con 0x7fc918075f60 2024-08-25T23:57:30.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:30.849+0000 7fc91f75b640 1 -- 172.21.15.43:0/258447331 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fc9180623d0 con 0x7fc9040a2bb0 2024-08-25T23:57:31.366 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 25 23:57:31 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-25T23:57:31.099+0000 7f4fe1400640 -1 osd.6 0 waiting for initial osdmap 2024-08-25T23:57:31.366 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 25 23:57:31 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-25T23:57:31.131+0000 7f4fd7e00640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-25T23:57:31.367 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:31 smithi042 ceph-mon[17225]: from='osd.6 [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-08-25T23:57:31.367 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:31 smithi042 ceph-mon[17225]: osdmap e41: 7 total, 6 up, 7 in 2024-08-25T23:57:31.367 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:31 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-25T23:57:31.367 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:31 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-25T23:57:31.367 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:31 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:57:31.367 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:31 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:57:31.367 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:31 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:31.367 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:31 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:31.367 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:31 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:31.367 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:31 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:31.368 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:31 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:31.368 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:31 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:31.368 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:31 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:31.368 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:31 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:31.368 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:31 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:57:31.368 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:31 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:31.368 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:31 smithi042 ceph-mon[17225]: from='osd.6 [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480]' entity='osd.6' 2024-08-25T23:57:31.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:31 smithi043 ceph-mon[22091]: from='osd.6 [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-08-25T23:57:31.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:31 smithi043 ceph-mon[22091]: osdmap e41: 7 total, 6 up, 7 in 2024-08-25T23:57:31.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:31 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-25T23:57:31.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:31 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-25T23:57:31.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:31 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:57:31.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:31 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:57:31.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:31 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:31.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:31 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:31.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:31 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:31.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:31 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:31.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:31 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:31.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:31 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:31.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:31 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:31.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:31 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:31.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:31 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:57:31.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:31 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:31.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:31 smithi043 ceph-mon[22091]: from='osd.6 [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480]' entity='osd.6' 2024-08-25T23:57:31.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:31 smithi181 ceph-mon[22102]: from='osd.6 [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-08-25T23:57:31.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:31 smithi181 ceph-mon[22102]: osdmap e41: 7 total, 6 up, 7 in 2024-08-25T23:57:31.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:31 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-25T23:57:31.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:31 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-25T23:57:31.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:31 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:57:31.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:31 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:57:31.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:31 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:31.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:31 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:31.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:31 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:31.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:31 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:31.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:31 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:31.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:31 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:31.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:31 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:31.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:31 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:31.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:31 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:57:31.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:31 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:31.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:31 smithi181 ceph-mon[22102]: from='osd.6 [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480]' entity='osd.6' 2024-08-25T23:57:32.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:32 smithi042 ceph-mon[17225]: purged_snaps scrub starts 2024-08-25T23:57:32.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:32 smithi042 ceph-mon[17225]: purged_snaps scrub ok 2024-08-25T23:57:32.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:32 smithi042 ceph-mon[17225]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:32.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:32 smithi042 ceph-mon[17225]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:57:32.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:32 smithi042 ceph-mon[17225]: Detected new or changed devices on smithi042 2024-08-25T23:57:32.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:32 smithi042 ceph-mon[17225]: Adjusting osd_memory_target on smithi042 to 5698M 2024-08-25T23:57:32.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-25T23:57:32.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:32 smithi042 ceph-mon[17225]: osd.6 [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480] boot 2024-08-25T23:57:32.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:32 smithi042 ceph-mon[17225]: osdmap e42: 7 total, 7 up, 7 in 2024-08-25T23:57:32.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-25T23:57:32.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:32 smithi181 ceph-mon[22102]: purged_snaps scrub starts 2024-08-25T23:57:32.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:32 smithi181 ceph-mon[22102]: purged_snaps scrub ok 2024-08-25T23:57:32.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:32 smithi181 ceph-mon[22102]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:32.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:32 smithi181 ceph-mon[22102]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:57:32.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:32 smithi181 ceph-mon[22102]: Detected new or changed devices on smithi042 2024-08-25T23:57:32.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:32 smithi181 ceph-mon[22102]: Adjusting osd_memory_target on smithi042 to 5698M 2024-08-25T23:57:32.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-25T23:57:32.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:32 smithi181 ceph-mon[22102]: osd.6 [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480] boot 2024-08-25T23:57:32.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:32 smithi181 ceph-mon[22102]: osdmap e42: 7 total, 7 up, 7 in 2024-08-25T23:57:32.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-25T23:57:32.556 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:32 smithi043 ceph-mon[22091]: purged_snaps scrub starts 2024-08-25T23:57:32.556 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:32 smithi043 ceph-mon[22091]: purged_snaps scrub ok 2024-08-25T23:57:32.556 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:32 smithi043 ceph-mon[22091]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-08-25T23:57:32.556 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:32 smithi043 ceph-mon[22091]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:57:32.556 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:32 smithi043 ceph-mon[22091]: Detected new or changed devices on smithi042 2024-08-25T23:57:32.556 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:32 smithi043 ceph-mon[22091]: Adjusting osd_memory_target on smithi042 to 5698M 2024-08-25T23:57:32.556 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-25T23:57:32.556 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:32 smithi043 ceph-mon[22091]: osd.6 [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480] boot 2024-08-25T23:57:32.557 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:32 smithi043 ceph-mon[22091]: osdmap e42: 7 total, 7 up, 7 in 2024-08-25T23:57:32.557 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-25T23:57:33.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:33 smithi042 ceph-mon[17225]: from='client.? 172.21.15.43:0/503790055' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65470b06-b14d-4d8e-9bcb-e6927c37fda5"}]: dispatch 2024-08-25T23:57:33.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:33 smithi042 ceph-mon[17225]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65470b06-b14d-4d8e-9bcb-e6927c37fda5"}]: dispatch 2024-08-25T23:57:33.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:33 smithi042 ceph-mon[17225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65470b06-b14d-4d8e-9bcb-e6927c37fda5"}]': finished 2024-08-25T23:57:33.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:33 smithi042 ceph-mon[17225]: osdmap e43: 8 total, 7 up, 8 in 2024-08-25T23:57:33.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:33 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-25T23:57:33.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:33 smithi181 ceph-mon[22102]: from='client.? 172.21.15.43:0/503790055' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65470b06-b14d-4d8e-9bcb-e6927c37fda5"}]: dispatch 2024-08-25T23:57:33.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:33 smithi181 ceph-mon[22102]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65470b06-b14d-4d8e-9bcb-e6927c37fda5"}]: dispatch 2024-08-25T23:57:33.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:33 smithi181 ceph-mon[22102]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65470b06-b14d-4d8e-9bcb-e6927c37fda5"}]': finished 2024-08-25T23:57:33.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:33 smithi181 ceph-mon[22102]: osdmap e43: 8 total, 7 up, 8 in 2024-08-25T23:57:33.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:33 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-25T23:57:33.572 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:33 smithi043 ceph-mon[22091]: from='client.? 172.21.15.43:0/503790055' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65470b06-b14d-4d8e-9bcb-e6927c37fda5"}]: dispatch 2024-08-25T23:57:33.572 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:33 smithi043 ceph-mon[22091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65470b06-b14d-4d8e-9bcb-e6927c37fda5"}]: dispatch 2024-08-25T23:57:33.572 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:33 smithi043 ceph-mon[22091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65470b06-b14d-4d8e-9bcb-e6927c37fda5"}]': finished 2024-08-25T23:57:33.572 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:33 smithi043 ceph-mon[22091]: osdmap e43: 8 total, 7 up, 8 in 2024-08-25T23:57:33.572 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:33 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-25T23:57:34.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:34 smithi043 ceph-mon[22091]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:34.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:34 smithi043 ceph-mon[22091]: from='client.? 172.21.15.43:0/3095248292' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:57:34.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:34 smithi042 ceph-mon[17225]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:34.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:34 smithi042 ceph-mon[17225]: from='client.? 172.21.15.43:0/3095248292' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:57:34.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:34 smithi181 ceph-mon[22102]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:34.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:34 smithi181 ceph-mon[22102]: from='client.? 172.21.15.43:0/3095248292' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:57:36.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:36 smithi043 ceph-mon[22091]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:36.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:36 smithi042 ceph-mon[17225]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:36.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:36 smithi181 ceph-mon[22102]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:38.394 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:38 smithi043 ceph-mon[22091]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:38.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:38 smithi042 ceph-mon[17225]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:38.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:38 smithi181 ceph-mon[22102]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:40.703 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:40 smithi043 ceph-mon[22091]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:40.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:40 smithi042 ceph-mon[17225]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:40.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:40 smithi181 ceph-mon[22102]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:42.604 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:42 smithi043 ceph-mon[22091]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:42.604 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:42 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-08-25T23:57:42.604 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:42 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:42.606 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:42 smithi042 ceph-mon[17225]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:42.606 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:42 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-08-25T23:57:42.606 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:42 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:42.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:42 smithi181 ceph-mon[22102]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:42.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:42 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-08-25T23:57:42.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:42 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:43.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:43 smithi043 ceph-mon[22091]: Deploying daemon osd.7 on smithi043 2024-08-25T23:57:43.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:43 smithi042 ceph-mon[17225]: Deploying daemon osd.7 on smithi043 2024-08-25T23:57:43.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:43 smithi181 ceph-mon[22102]: Deploying daemon osd.7 on smithi043 2024-08-25T23:57:44.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:44 smithi043 ceph-mon[22091]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:44.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:44 smithi042 ceph-mon[17225]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:44.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:44 smithi181 ceph-mon[22102]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:46.503 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:46 smithi043 ceph-mon[22091]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:46.586 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:46 smithi181 ceph-mon[22102]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:46.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:46 smithi042 ceph-mon[17225]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:47.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:47 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:57:47.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:47 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:47.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:47 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:47.610 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:47 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:57:47.610 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:47 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:47.610 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:47 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:47.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:47 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:57:47.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:47 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:47.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:47 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:48.463 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:48 smithi043 ceph-mon[22091]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:48.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:48 smithi181 ceph-mon[22102]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:48.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:48 smithi042 ceph-mon[17225]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:49.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:49 smithi043 ceph-mon[22091]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:49.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:49 smithi042 ceph-mon[17225]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:49.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:49 smithi181 ceph-mon[22102]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:50.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:50.374+0000 7fc90e7fc640 1 -- 172.21.15.43:0/258447331 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc9180623d0 con 0x7fc9040a2bb0 2024-08-25T23:57:50.376 INFO:teuthology.orchestra.run.smithi043.stdout:Created osd(s) 7 on host 'smithi043' 2024-08-25T23:57:50.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:50.376+0000 7fc91f75b640 1 -- 172.21.15.43:0/258447331 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc9040a2bb0 msgr2=0x7fc9040a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:57:50.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:50.376+0000 7fc91f75b640 1 --2- 172.21.15.43:0/258447331 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc9040a2bb0 0x7fc9040a5070 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc9140314e0 tx=0x7fc914000bc0 comp rx=0 tx=0).stop 2024-08-25T23:57:50.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:50.376+0000 7fc91f75b640 1 -- 172.21.15.43:0/258447331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc918075f60 msgr2=0x7fc91819a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:57:50.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:50.376+0000 7fc91f75b640 1 --2- 172.21.15.43:0/258447331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc918075f60 0x7fc91819a410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc90800c970 tx=0x7fc90800ce30 comp rx=0 tx=0).stop 2024-08-25T23:57:50.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:50.376+0000 7fc91f75b640 1 -- 172.21.15.43:0/258447331 shutdown_connections 2024-08-25T23:57:50.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:50.376+0000 7fc91f75b640 1 --2- 172.21.15.43:0/258447331 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc9040a2bb0 0x7fc9040a5070 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:57:50.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:50.376+0000 7fc91f75b640 1 --2- 172.21.15.43:0/258447331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc918109850 0x7fc9181a1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:57:50.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:50.376+0000 7fc91f75b640 1 --2- 172.21.15.43:0/258447331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc918075f60 0x7fc91819a410 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:57:50.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:50.376+0000 7fc91f75b640 1 --2- 172.21.15.43:0/258447331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc918074990 0x7fc918199ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:57:50.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:50.376+0000 7fc91f75b640 1 -- 172.21.15.43:0/258447331 >> 172.21.15.43:0/258447331 conn(0x7fc9180fd160 msgr2=0x7fc9181057e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:57:50.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:50.376+0000 7fc91f75b640 1 -- 172.21.15.43:0/258447331 shutdown_connections 2024-08-25T23:57:50.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:57:50.376+0000 7fc91f75b640 1 -- 172.21.15.43:0/258447331 wait complete. 2024-08-25T23:57:50.667 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:50 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:50.667 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:50 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:50.667 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:50 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:50.667 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:50 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:57:50.667 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:50 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:50.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:50 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:50.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:50 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:50.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:50 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:50.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:50 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:57:50.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:50 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:50.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:50 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:50.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:50 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:50.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:50 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:50.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:50 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:57:50.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:50 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:50.963 DEBUG:teuthology.orchestra.run.smithi043:osd.7> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.7.service 2024-08-25T23:57:50.966 INFO:tasks.cephadm:Deploying osd.8 on smithi181 with /dev/vg_nvme/lv_2... 2024-08-25T23:57:50.966 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-25T23:57:51.221 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.c/config 2024-08-25T23:57:51.506 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:51 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:57:51.506 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:51 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:51.506 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:51 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:51.506 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:51 smithi043 ceph-mon[22091]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:51.635 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:51 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:57:51.636 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:51 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:51.636 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:51 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:51.636 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:51 smithi181 ceph-mon[22102]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:51.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:51 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:57:51.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:51 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:51.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:51 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:51.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:51 smithi042 ceph-mon[17225]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:53.499 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 25 23:57:53 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-25T23:57:53.182+0000 7f955d430640 -1 osd.7 0 log_to_monitors true 2024-08-25T23:57:53.575 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-25T23:57:53.600 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph orch daemon add osd smithi181:vg_nvme/lv_2 2024-08-25T23:57:53.622 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:53 smithi181 ceph-mon[22102]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:53.622 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:53 smithi181 ceph-mon[22102]: from='osd.7 [v2:172.21.15.43:6816/624542778,v1:172.21.15.43:6817/624542778]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-25T23:57:53.622 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:53 smithi181 ceph-mon[22102]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-25T23:57:53.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:53 smithi043 ceph-mon[22091]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:53.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:53 smithi043 ceph-mon[22091]: from='osd.7 [v2:172.21.15.43:6816/624542778,v1:172.21.15.43:6817/624542778]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-25T23:57:53.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:53 smithi043 ceph-mon[22091]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-25T23:57:53.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:53 smithi042 ceph-mon[17225]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:53.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:53 smithi042 ceph-mon[17225]: from='osd.7 [v2:172.21.15.43:6816/624542778,v1:172.21.15.43:6817/624542778]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-25T23:57:53.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:53 smithi042 ceph-mon[17225]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-25T23:57:53.841 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.c/config 2024-08-25T23:57:54.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.299+0000 7f05774a8640 1 -- 172.21.15.181:0/3728320477 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05701008b0 msgr2=0x7f0570100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:57:54.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.299+0000 7f05774a8640 1 --2- 172.21.15.181:0/3728320477 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05701008b0 0x7f0570100cb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f056c009900 tx=0x7f056c02a410 comp rx=0 tx=0).stop 2024-08-25T23:57:54.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.299+0000 7f05774a8640 1 -- 172.21.15.181:0/3728320477 shutdown_connections 2024-08-25T23:57:54.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.299+0000 7f05774a8640 1 --2- 172.21.15.181:0/3728320477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0570102470 0x7f0570108d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:57:54.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.299+0000 7f05774a8640 1 --2- 172.21.15.181:0/3728320477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0570101ab0 0x7f0570101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:57:54.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.299+0000 7f05774a8640 1 --2- 172.21.15.181:0/3728320477 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05701008b0 0x7f0570100cb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:57:54.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.299+0000 7f05774a8640 1 -- 172.21.15.181:0/3728320477 >> 172.21.15.181:0/3728320477 conn(0x7f05700fc040 msgr2=0x7f05700fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:57:54.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.299+0000 7f05774a8640 1 -- 172.21.15.181:0/3728320477 shutdown_connections 2024-08-25T23:57:54.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.299+0000 7f05774a8640 1 -- 172.21.15.181:0/3728320477 wait complete. 2024-08-25T23:57:54.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.300+0000 7f05774a8640 1 Processor -- start 2024-08-25T23:57:54.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.300+0000 7f05774a8640 1 -- start start 2024-08-25T23:57:54.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.300+0000 7f05774a8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05701008b0 0x7f0570197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:57:54.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.300+0000 7f05774a8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0570101ab0 0x7f0570198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:57:54.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.300+0000 7f05774a8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0570102470 0x7f057019f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:57:54.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.300+0000 7f05774a8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f057010c610 con 0x7f0570102470 2024-08-25T23:57:54.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.300+0000 7f05774a8640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f057010c490 con 0x7f05701008b0 2024-08-25T23:57:54.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.300+0000 7f05774a8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f057010c790 con 0x7f0570101ab0 2024-08-25T23:57:54.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.300+0000 7f0574a43640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0570101ab0 0x7f0570198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:57:54.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.300+0000 7f0574a43640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0570101ab0 0x7f0570198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:42350/0 (socket says 172.21.15.181:42350) 2024-08-25T23:57:54.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.300+0000 7f0574a43640 1 -- 172.21.15.181:0/1533027916 learned_addr learned my addr 172.21.15.181:0/1533027916 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-08-25T23:57:54.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.300+0000 7f0575244640 1 --2- 172.21.15.181:0/1533027916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05701008b0 0x7f0570197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:57:54.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.300+0000 7f0575a45640 1 --2- 172.21.15.181:0/1533027916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0570102470 0x7f057019f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:57:54.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.300+0000 7f0574a43640 1 -- 172.21.15.181:0/1533027916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05701008b0 msgr2=0x7f0570197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:57:54.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.300+0000 7f0574a43640 1 --2- 172.21.15.181:0/1533027916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05701008b0 0x7f0570197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:57:54.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.300+0000 7f0574a43640 1 -- 172.21.15.181:0/1533027916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0570102470 msgr2=0x7f057019f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:57:54.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.300+0000 7f0574a43640 1 --2- 172.21.15.181:0/1533027916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0570102470 0x7f057019f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:57:54.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.300+0000 7f0574a43640 1 -- 172.21.15.181:0/1533027916 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f057019fa40 con 0x7f0570101ab0 2024-08-25T23:57:54.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.300+0000 7f0575a45640 1 --2- 172.21.15.181:0/1533027916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0570102470 0x7f057019f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-25T23:57:54.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.301+0000 7f0574a43640 1 --2- 172.21.15.181:0/1533027916 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0570101ab0 0x7f0570198350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f056000b4a0 tx=0x7f056000b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:57:54.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.301+0000 7f05667fc640 1 -- 172.21.15.181:0/1533027916 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0560014070 con 0x7f0570101ab0 2024-08-25T23:57:54.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.301+0000 7f05667fc640 1 -- 172.21.15.181:0/1533027916 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0560010af0 con 0x7f0570101ab0 2024-08-25T23:57:54.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.301+0000 7f05774a8640 1 -- 172.21.15.181:0/1533027916 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f057019fd30 con 0x7f0570101ab0 2024-08-25T23:57:54.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.301+0000 7f05667fc640 1 -- 172.21.15.181:0/1533027916 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0560017d10 con 0x7f0570101ab0 2024-08-25T23:57:54.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.301+0000 7f05774a8640 1 -- 172.21.15.181:0/1533027916 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05701a0290 con 0x7f0570101ab0 2024-08-25T23:57:54.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.302+0000 7f05774a8640 1 -- 172.21.15.181:0/1533027916 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0570108890 con 0x7f0570101ab0 2024-08-25T23:57:54.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.303+0000 7f05667fc640 1 -- 172.21.15.181:0/1533027916 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0560017070 con 0x7f0570101ab0 2024-08-25T23:57:54.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.304+0000 7f05667fc640 1 --2- 172.21.15.181:0/1533027916 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f055c0a2bb0 0x7f055c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:57:54.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.304+0000 7f05667fc640 1 -- 172.21.15.181:0/1533027916 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5101+0+0 (secure 0 0 0) 0x7f05600cdb40 con 0x7f0570101ab0 2024-08-25T23:57:54.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.304+0000 7f0575244640 1 --2- 172.21.15.181:0/1533027916 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f055c0a2bb0 0x7f055c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:57:54.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.305+0000 7f0575244640 1 --2- 172.21.15.181:0/1533027916 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f055c0a2bb0 0x7f055c0a5070 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f056c031610 tx=0x7f056c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:57:54.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.307+0000 7f05667fc640 1 -- 172.21.15.181:0/1533027916 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f056009b730 con 0x7f0570101ab0 2024-08-25T23:57:54.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:57:54.484+0000 7f05774a8640 1 -- 172.21.15.181:0/1533027916 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f05700623d0 con 0x7f055c0a2bb0 2024-08-25T23:57:54.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:54 smithi181 ceph-mon[22102]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-25T23:57:54.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:54 smithi181 ceph-mon[22102]: from='osd.7 [v2:172.21.15.43:6816/624542778,v1:172.21.15.43:6817/624542778]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:57:54.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:54 smithi181 ceph-mon[22102]: osdmap e44: 8 total, 7 up, 8 in 2024-08-25T23:57:54.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:54 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-25T23:57:54.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:54 smithi181 ceph-mon[22102]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:57:54.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:54 smithi181 ceph-mon[22102]: Detected new or changed devices on smithi043 2024-08-25T23:57:54.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:54 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:54.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:54 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:54.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:54 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:54.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:54 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:54.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:54 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:54.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:54 smithi181 ceph-mon[22102]: Adjusting osd_memory_target on smithi043 to 5697M 2024-08-25T23:57:54.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:54 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:54.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:54 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:54.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:54 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:57:54.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:54 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:54.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:54 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:57:54.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:54 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:57:54.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:54 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:55.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:54 smithi043 ceph-mon[22091]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-25T23:57:55.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:54 smithi043 ceph-mon[22091]: from='osd.7 [v2:172.21.15.43:6816/624542778,v1:172.21.15.43:6817/624542778]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:57:55.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:54 smithi043 ceph-mon[22091]: osdmap e44: 8 total, 7 up, 8 in 2024-08-25T23:57:55.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:54 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-25T23:57:55.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:54 smithi043 ceph-mon[22091]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:57:55.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:54 smithi043 ceph-mon[22091]: Detected new or changed devices on smithi043 2024-08-25T23:57:55.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:54 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:55.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:54 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:55.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:54 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:55.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:54 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:55.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:54 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:55.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:54 smithi043 ceph-mon[22091]: Adjusting osd_memory_target on smithi043 to 5697M 2024-08-25T23:57:55.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:54 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:55.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:54 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:55.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:54 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:57:55.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:54 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:55.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:54 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:57:55.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:54 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:57:55.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:54 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:55.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:54 smithi042 ceph-mon[17225]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-25T23:57:55.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:54 smithi042 ceph-mon[17225]: from='osd.7 [v2:172.21.15.43:6816/624542778,v1:172.21.15.43:6817/624542778]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:57:55.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:54 smithi042 ceph-mon[17225]: osdmap e44: 8 total, 7 up, 8 in 2024-08-25T23:57:55.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:54 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-25T23:57:55.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:54 smithi042 ceph-mon[17225]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:57:55.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:54 smithi042 ceph-mon[17225]: Detected new or changed devices on smithi043 2024-08-25T23:57:55.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:54 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:55.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:54 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:55.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:54 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:55.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:54 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:55.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:54 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:57:55.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:54 smithi042 ceph-mon[17225]: Adjusting osd_memory_target on smithi043 to 5697M 2024-08-25T23:57:55.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:54 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:55.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:54 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:55.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:54 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:57:55.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:54 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:57:55.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:54 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:57:55.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:54 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:57:55.035 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:54 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:57:55.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 25 23:57:55 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-25T23:57:55.235+0000 7f9558b90640 -1 osd.7 0 waiting for initial osdmap 2024-08-25T23:57:55.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 25 23:57:55 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-25T23:57:55.244+0000 7f95511c2640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-25T23:57:55.898 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:55 smithi181 ceph-mon[22102]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:55.898 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:55 smithi181 ceph-mon[22102]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:57:55.899 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:55 smithi181 ceph-mon[22102]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-08-25T23:57:55.899 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:55 smithi181 ceph-mon[22102]: osdmap e45: 8 total, 7 up, 8 in 2024-08-25T23:57:55.899 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:55 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-25T23:57:55.899 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:55 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-25T23:57:55.899 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:55 smithi181 ceph-mon[22102]: from='osd.7 ' entity='osd.7' 2024-08-25T23:57:56.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:55 smithi043 ceph-mon[22091]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:56.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:55 smithi043 ceph-mon[22091]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:57:56.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:55 smithi043 ceph-mon[22091]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-08-25T23:57:56.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:55 smithi043 ceph-mon[22091]: osdmap e45: 8 total, 7 up, 8 in 2024-08-25T23:57:56.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:55 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-25T23:57:56.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:55 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-25T23:57:56.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:55 smithi043 ceph-mon[22091]: from='osd.7 ' entity='osd.7' 2024-08-25T23:57:56.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:55 smithi042 ceph-mon[17225]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:56.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:55 smithi042 ceph-mon[17225]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:57:56.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:55 smithi042 ceph-mon[17225]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-08-25T23:57:56.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:55 smithi042 ceph-mon[17225]: osdmap e45: 8 total, 7 up, 8 in 2024-08-25T23:57:56.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:55 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-25T23:57:56.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:55 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-25T23:57:56.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:55 smithi042 ceph-mon[17225]: from='osd.7 ' entity='osd.7' 2024-08-25T23:57:57.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:56 smithi043 ceph-mon[22091]: purged_snaps scrub starts 2024-08-25T23:57:57.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:56 smithi043 ceph-mon[22091]: purged_snaps scrub ok 2024-08-25T23:57:57.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:56 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-25T23:57:57.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:56 smithi043 ceph-mon[22091]: osd.7 [v2:172.21.15.43:6816/624542778,v1:172.21.15.43:6817/624542778] boot 2024-08-25T23:57:57.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:56 smithi043 ceph-mon[22091]: osdmap e46: 8 total, 8 up, 8 in 2024-08-25T23:57:57.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:56 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-25T23:57:57.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:56 smithi043 ceph-mon[22091]: osdmap e47: 8 total, 8 up, 8 in 2024-08-25T23:57:57.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:56 smithi042 ceph-mon[17225]: purged_snaps scrub starts 2024-08-25T23:57:57.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:56 smithi042 ceph-mon[17225]: purged_snaps scrub ok 2024-08-25T23:57:57.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-25T23:57:57.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:56 smithi042 ceph-mon[17225]: osd.7 [v2:172.21.15.43:6816/624542778,v1:172.21.15.43:6817/624542778] boot 2024-08-25T23:57:57.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:56 smithi042 ceph-mon[17225]: osdmap e46: 8 total, 8 up, 8 in 2024-08-25T23:57:57.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:56 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-25T23:57:57.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:56 smithi042 ceph-mon[17225]: osdmap e47: 8 total, 8 up, 8 in 2024-08-25T23:57:57.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:56 smithi181 ceph-mon[22102]: purged_snaps scrub starts 2024-08-25T23:57:57.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:56 smithi181 ceph-mon[22102]: purged_snaps scrub ok 2024-08-25T23:57:57.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:56 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-25T23:57:57.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:56 smithi181 ceph-mon[22102]: osd.7 [v2:172.21.15.43:6816/624542778,v1:172.21.15.43:6817/624542778] boot 2024-08-25T23:57:57.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:56 smithi181 ceph-mon[22102]: osdmap e46: 8 total, 8 up, 8 in 2024-08-25T23:57:57.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:56 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-25T23:57:57.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:56 smithi181 ceph-mon[22102]: osdmap e47: 8 total, 8 up, 8 in 2024-08-25T23:57:58.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:57 smithi043 ceph-mon[22091]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:58.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:57 smithi043 ceph-mon[22091]: osdmap e48: 8 total, 8 up, 8 in 2024-08-25T23:57:58.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:57 smithi043 ceph-mon[22091]: from='client.? 172.21.15.181:0/1645555853' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f4c9152-4b7c-415f-9cb9-d1e926fad5ef"}]: dispatch 2024-08-25T23:57:58.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:57 smithi043 ceph-mon[22091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f4c9152-4b7c-415f-9cb9-d1e926fad5ef"}]: dispatch 2024-08-25T23:57:58.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:57 smithi043 ceph-mon[22091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f4c9152-4b7c-415f-9cb9-d1e926fad5ef"}]': finished 2024-08-25T23:57:58.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:57 smithi043 ceph-mon[22091]: osdmap e49: 9 total, 8 up, 9 in 2024-08-25T23:57:58.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:57 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-25T23:57:58.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:57 smithi043 ceph-mon[22091]: from='client.? 172.21.15.181:0/2792511593' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:57:58.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:57 smithi042 ceph-mon[17225]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:58.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:57 smithi042 ceph-mon[17225]: osdmap e48: 8 total, 8 up, 8 in 2024-08-25T23:57:58.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:57 smithi042 ceph-mon[17225]: from='client.? 172.21.15.181:0/1645555853' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f4c9152-4b7c-415f-9cb9-d1e926fad5ef"}]: dispatch 2024-08-25T23:57:58.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:57 smithi042 ceph-mon[17225]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f4c9152-4b7c-415f-9cb9-d1e926fad5ef"}]: dispatch 2024-08-25T23:57:58.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:57 smithi042 ceph-mon[17225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f4c9152-4b7c-415f-9cb9-d1e926fad5ef"}]': finished 2024-08-25T23:57:58.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:57 smithi042 ceph-mon[17225]: osdmap e49: 9 total, 8 up, 9 in 2024-08-25T23:57:58.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:57 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-25T23:57:58.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:57 smithi042 ceph-mon[17225]: from='client.? 172.21.15.181:0/2792511593' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:57:58.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:57 smithi181 ceph-mon[22102]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-25T23:57:58.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:57 smithi181 ceph-mon[22102]: osdmap e48: 8 total, 8 up, 8 in 2024-08-25T23:57:58.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:57 smithi181 ceph-mon[22102]: from='client.? 172.21.15.181:0/1645555853' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f4c9152-4b7c-415f-9cb9-d1e926fad5ef"}]: dispatch 2024-08-25T23:57:58.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:57 smithi181 ceph-mon[22102]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f4c9152-4b7c-415f-9cb9-d1e926fad5ef"}]: dispatch 2024-08-25T23:57:58.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:57 smithi181 ceph-mon[22102]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f4c9152-4b7c-415f-9cb9-d1e926fad5ef"}]': finished 2024-08-25T23:57:58.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:57 smithi181 ceph-mon[22102]: osdmap e49: 9 total, 8 up, 9 in 2024-08-25T23:57:58.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:57 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-25T23:57:58.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:57 smithi181 ceph-mon[22102]: from='client.? 172.21.15.181:0/2792511593' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:57:59.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:58 smithi043 ceph-mon[22091]: osdmap e50: 9 total, 8 up, 9 in 2024-08-25T23:57:59.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:58 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-25T23:57:59.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:58 smithi042 ceph-mon[17225]: osdmap e50: 9 total, 8 up, 9 in 2024-08-25T23:57:59.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:58 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-25T23:57:59.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:58 smithi181 ceph-mon[22102]: osdmap e50: 9 total, 8 up, 9 in 2024-08-25T23:57:59.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:58 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-25T23:58:00.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:57:59 smithi043 ceph-mon[22091]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:00.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:57:59 smithi042 ceph-mon[17225]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:00.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:57:59 smithi181 ceph-mon[22102]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:02.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:01 smithi043 ceph-mon[22091]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:02.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:01 smithi042 ceph-mon[17225]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:02.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:01 smithi181 ceph-mon[22102]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:04.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:03 smithi181 ceph-mon[22102]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:04.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:03 smithi043 ceph-mon[22091]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:04.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:03 smithi042 ceph-mon[17225]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:06.223 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:05 smithi181 ceph-mon[22102]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:06.223 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:05 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-08-25T23:58:06.223 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:05 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:06.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:05 smithi043 ceph-mon[22091]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:06.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:05 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-08-25T23:58:06.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:05 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:06.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:05 smithi042 ceph-mon[17225]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:06.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:05 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-08-25T23:58:06.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:05 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:07.101 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:06 smithi181 ceph-mon[22102]: Deploying daemon osd.8 on smithi181 2024-08-25T23:58:07.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:06 smithi043 ceph-mon[22091]: Deploying daemon osd.8 on smithi181 2024-08-25T23:58:07.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:06 smithi042 ceph-mon[17225]: Deploying daemon osd.8 on smithi181 2024-08-25T23:58:08.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:07 smithi043 ceph-mon[22091]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:08.279 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:07 smithi181 ceph-mon[22102]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:08.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:07 smithi042 ceph-mon[17225]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:10.025 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:09 smithi181 ceph-mon[22102]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:10.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:09 smithi043 ceph-mon[22091]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:10.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:09 smithi042 ceph-mon[17225]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:11.223 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:10 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:58:11.223 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:10 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:11.223 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:10 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:11.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:10 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:58:11.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:10 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:11.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:10 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:11.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:10 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:58:11.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:10 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:11.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:10 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:12.209 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:11 smithi181 ceph-mon[22102]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:12.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:11 smithi043 ceph-mon[22091]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:12.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:11 smithi042 ceph-mon[17225]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:14.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:58:14.138+0000 7f05667fc640 1 -- 172.21.15.181:0/1533027916 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f05700623d0 con 0x7f055c0a2bb0 2024-08-25T23:58:14.143 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 8 on host 'smithi181' 2024-08-25T23:58:14.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:58:14.141+0000 7f05774a8640 1 -- 172.21.15.181:0/1533027916 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f055c0a2bb0 msgr2=0x7f055c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:58:14.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:58:14.141+0000 7f05774a8640 1 --2- 172.21.15.181:0/1533027916 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f055c0a2bb0 0x7f055c0a5070 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f056c031610 tx=0x7f056c000bc0 comp rx=0 tx=0).stop 2024-08-25T23:58:14.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:58:14.141+0000 7f05774a8640 1 -- 172.21.15.181:0/1533027916 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0570101ab0 msgr2=0x7f0570198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:58:14.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:58:14.141+0000 7f05774a8640 1 --2- 172.21.15.181:0/1533027916 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0570101ab0 0x7f0570198350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f056000b4a0 tx=0x7f056000b960 comp rx=0 tx=0).stop 2024-08-25T23:58:14.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:58:14.141+0000 7f05774a8640 1 -- 172.21.15.181:0/1533027916 shutdown_connections 2024-08-25T23:58:14.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:58:14.141+0000 7f05774a8640 1 --2- 172.21.15.181:0/1533027916 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f055c0a2bb0 0x7f055c0a5070 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:58:14.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:58:14.141+0000 7f05774a8640 1 --2- 172.21.15.181:0/1533027916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0570102470 0x7f057019f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:58:14.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:58:14.141+0000 7f05774a8640 1 --2- 172.21.15.181:0/1533027916 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0570101ab0 0x7f0570198350 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:58:14.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:58:14.141+0000 7f05774a8640 1 --2- 172.21.15.181:0/1533027916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05701008b0 0x7f0570197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:58:14.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:58:14.141+0000 7f05774a8640 1 -- 172.21.15.181:0/1533027916 >> 172.21.15.181:0/1533027916 conn(0x7f05700fc040 msgr2=0x7f05700fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:58:14.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:58:14.141+0000 7f05774a8640 1 -- 172.21.15.181:0/1533027916 shutdown_connections 2024-08-25T23:58:14.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:58:14.141+0000 7f05774a8640 1 -- 172.21.15.181:0/1533027916 wait complete. 2024-08-25T23:58:14.449 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:14 smithi181 ceph-mon[22102]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:14.449 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:14 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:14.449 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:14 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:14.449 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:14 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:14.449 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:14 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:58:14.449 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:14 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:14.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:14 smithi043 ceph-mon[22091]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:14.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:14 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:14.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:14 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:14.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:14 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:14.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:14 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:58:14.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:14 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:14.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:14 smithi042 ceph-mon[17225]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:14.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:14 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:14.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:14 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:14.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:14 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:14.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:14 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:58:14.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:14 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:14.701 DEBUG:teuthology.orchestra.run.smithi181:osd.8> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.8.service 2024-08-25T23:58:14.743 INFO:tasks.cephadm:Deploying osd.9 on smithi042 with /dev/vg_nvme/lv_1... 2024-08-25T23:58:14.744 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-25T23:58:15.132 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:58:15.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:15 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:58:15.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:15 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:15.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:15 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:15.393 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:15 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:58:15.394 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:15 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:15.394 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:15 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:15.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:15 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:58:15.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:15 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:15.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:15 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:16.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:16 smithi181 ceph-mon[22102]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:16.503 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:16 smithi042 ceph-mon[17225]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:16.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:16 smithi043 ceph-mon[22091]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:17.144 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 25 23:58:16 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-25T23:58:16.930+0000 7f3338a49640 -1 osd.8 0 log_to_monitors true 2024-08-25T23:58:17.448 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:17 smithi181 ceph-mon[22102]: from='osd.8 [v2:172.21.15.181:6816/728226568,v1:172.21.15.181:6817/728226568]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-25T23:58:17.448 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:17 smithi181 ceph-mon[22102]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-25T23:58:17.458 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:17 smithi042 ceph-mon[17225]: from='osd.8 [v2:172.21.15.181:6816/728226568,v1:172.21.15.181:6817/728226568]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-25T23:58:17.458 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:17 smithi042 ceph-mon[17225]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-25T23:58:17.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:17 smithi043 ceph-mon[22091]: from='osd.8 [v2:172.21.15.181:6816/728226568,v1:172.21.15.181:6817/728226568]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-25T23:58:17.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:17 smithi043 ceph-mon[22091]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-25T23:58:18.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:18 smithi042 ceph-mon[17225]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:18.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:18 smithi042 ceph-mon[17225]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-25T23:58:18.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:18 smithi042 ceph-mon[17225]: osdmap e51: 9 total, 8 up, 9 in 2024-08-25T23:58:18.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:18 smithi042 ceph-mon[17225]: from='osd.8 [v2:172.21.15.181:6816/728226568,v1:172.21.15.181:6817/728226568]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:58:18.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:18 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-25T23:58:18.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:18 smithi042 ceph-mon[17225]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:58:18.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:18 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:18.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:18 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:18.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:18 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:58:18.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:18 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:58:18.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:18 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:58:18.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:18 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:18.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:18 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:18.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:18 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:58:18.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:18 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:18.504 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:58:18.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:18 smithi043 ceph-mon[22091]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:18.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:18 smithi043 ceph-mon[22091]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-25T23:58:18.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:18 smithi043 ceph-mon[22091]: osdmap e51: 9 total, 8 up, 9 in 2024-08-25T23:58:18.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:18 smithi043 ceph-mon[22091]: from='osd.8 [v2:172.21.15.181:6816/728226568,v1:172.21.15.181:6817/728226568]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:58:18.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:18 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-25T23:58:18.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:18 smithi043 ceph-mon[22091]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:58:18.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:18 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:18.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:18 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:18.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:18 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:58:18.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:18 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:58:18.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:18 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:58:18.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:18 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:18.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:18 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:18.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:18 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:58:18.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:18 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:18.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:18 smithi181 ceph-mon[22102]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:18.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:18 smithi181 ceph-mon[22102]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-25T23:58:18.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:18 smithi181 ceph-mon[22102]: osdmap e51: 9 total, 8 up, 9 in 2024-08-25T23:58:18.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:18 smithi181 ceph-mon[22102]: from='osd.8 [v2:172.21.15.181:6816/728226568,v1:172.21.15.181:6817/728226568]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:58:18.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:18 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-25T23:58:18.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:18 smithi181 ceph-mon[22102]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:58:18.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:18 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:18.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:18 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:18.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:18 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:58:18.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:18 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:58:18.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:18 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:58:18.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:18 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:18.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:18 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:18.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:18 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:58:18.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:18 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:18.536 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph orch daemon add osd smithi042:vg_nvme/lv_1 2024-08-25T23:58:18.909 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:58:19.034 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 25 23:58:18 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-25T23:58:18.936+0000 7f33351e0640 -1 osd.8 0 waiting for initial osdmap 2024-08-25T23:58:19.034 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 25 23:58:18 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-25T23:58:18.949+0000 7f332c7db640 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-25T23:58:19.324 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:19 smithi042 ceph-mon[17225]: Detected new or changed devices on smithi181 2024-08-25T23:58:19.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:19 smithi042 ceph-mon[17225]: Adjusting osd_memory_target on smithi181 to 5696M 2024-08-25T23:58:19.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:19 smithi042 ceph-mon[17225]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-08-25T23:58:19.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:19 smithi042 ceph-mon[17225]: osdmap e52: 9 total, 8 up, 9 in 2024-08-25T23:58:19.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:19 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-25T23:58:19.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:19 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-25T23:58:19.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:19 smithi042 ceph-mon[17225]: from='osd.8 ' entity='osd.8' 2024-08-25T23:58:19.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.373+0000 7f90f2200640 1 -- 172.21.15.42:0/3357930908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90ec1039f0 msgr2=0x7f90ec103df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:58:19.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.373+0000 7f90f2200640 1 --2- 172.21.15.42:0/3357930908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90ec1039f0 0x7f90ec103df0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009ca0 tx=0x7f90e002a8c0 comp rx=0 tx=0).stop 2024-08-25T23:58:19.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.373+0000 7f90f2200640 1 -- 172.21.15.42:0/3357930908 shutdown_connections 2024-08-25T23:58:19.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.373+0000 7f90f2200640 1 --2- 172.21.15.42:0/3357930908 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90ec1055b0 0x7f90ec10be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:58:19.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.373+0000 7f90f2200640 1 --2- 172.21.15.42:0/3357930908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90ec104bf0 0x7f90ec105070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:58:19.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.373+0000 7f90f2200640 1 --2- 172.21.15.42:0/3357930908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90ec1039f0 0x7f90ec103df0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:58:19.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.373+0000 7f90f2200640 1 -- 172.21.15.42:0/3357930908 >> 172.21.15.42:0/3357930908 conn(0x7f90ec0ff180 msgr2=0x7f90ec1015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:58:19.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.374+0000 7f90f2200640 1 -- 172.21.15.42:0/3357930908 shutdown_connections 2024-08-25T23:58:19.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.374+0000 7f90f2200640 1 -- 172.21.15.42:0/3357930908 wait complete. 2024-08-25T23:58:19.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.375+0000 7f90f2200640 1 Processor -- start 2024-08-25T23:58:19.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.375+0000 7f90f2200640 1 -- start start 2024-08-25T23:58:19.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.375+0000 7f90f2200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90ec1039f0 0x7f90ec199cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:58:19.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.375+0000 7f90f2200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90ec104bf0 0x7f90ec19a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:58:19.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.375+0000 7f90f2200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90ec1055b0 0x7f90ec1a1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:58:19.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.375+0000 7f90f2200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec10f650 con 0x7f90ec1055b0 2024-08-25T23:58:19.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.375+0000 7f90f2200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec10f4d0 con 0x7f90ec104bf0 2024-08-25T23:58:19.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.375+0000 7f90f2200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec10f7d0 con 0x7f90ec1039f0 2024-08-25T23:58:19.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.375+0000 7f90f0e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90ec1039f0 0x7f90ec199cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:58:19.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.375+0000 7f90f0e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90ec1039f0 0x7f90ec199cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:32834/0 (socket says 172.21.15.42:32834) 2024-08-25T23:58:19.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.375+0000 7f90f0e00640 1 -- 172.21.15.42:0/1198973027 learned_addr learned my addr 172.21.15.42:0/1198973027 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:58:19.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.375+0000 7f90f1800640 1 --2- 172.21.15.42:0/1198973027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90ec1055b0 0x7f90ec1a1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:58:19.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.375+0000 7f90ebe00640 1 --2- 172.21.15.42:0/1198973027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90ec104bf0 0x7f90ec19a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:58:19.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.376+0000 7f90f0e00640 1 -- 172.21.15.42:0/1198973027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90ec104bf0 msgr2=0x7f90ec19a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:58:19.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.376+0000 7f90f0e00640 1 --2- 172.21.15.42:0/1198973027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90ec104bf0 0x7f90ec19a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:58:19.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.376+0000 7f90f0e00640 1 -- 172.21.15.42:0/1198973027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90ec1055b0 msgr2=0x7f90ec1a1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:58:19.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.376+0000 7f90f0e00640 1 --2- 172.21.15.42:0/1198973027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90ec1055b0 0x7f90ec1a1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:58:19.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.376+0000 7f90f0e00640 1 -- 172.21.15.42:0/1198973027 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ec1a1910 con 0x7f90ec1039f0 2024-08-25T23:58:19.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.376+0000 7f90f0e00640 1 --2- 172.21.15.42:0/1198973027 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90ec1039f0 0x7f90ec199cf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009bf0 tx=0x7f90e0031ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:58:19.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.376+0000 7f90e9600640 1 -- 172.21.15.42:0/1198973027 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e002fa20 con 0x7f90ec1039f0 2024-08-25T23:58:19.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.376+0000 7f90e9600640 1 -- 172.21.15.42:0/1198973027 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90e002fbc0 con 0x7f90ec1039f0 2024-08-25T23:58:19.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.376+0000 7f90e9600640 1 -- 172.21.15.42:0/1198973027 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e0046750 con 0x7f90ec1039f0 2024-08-25T23:58:19.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.376+0000 7f90f2200640 1 -- 172.21.15.42:0/1198973027 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90ec1a1ba0 con 0x7f90ec1039f0 2024-08-25T23:58:19.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.377+0000 7f90f2200640 1 -- 172.21.15.42:0/1198973027 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90ec1a2090 con 0x7f90ec1039f0 2024-08-25T23:58:19.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.378+0000 7f90f2200640 1 -- 172.21.15.42:0/1198973027 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90ec10adf0 con 0x7f90ec1039f0 2024-08-25T23:58:19.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.380+0000 7f90e9600640 1 -- 172.21.15.42:0/1198973027 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f90e002fd70 con 0x7f90ec1039f0 2024-08-25T23:58:19.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.381+0000 7f90e9600640 1 --2- 172.21.15.42:0/1198973027 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f90d40a2b80 0x7f90d40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:58:19.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.381+0000 7f90e9600640 1 -- 172.21.15.42:0/1198973027 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5862+0+0 (secure 0 0 0) 0x7f90e00efc20 con 0x7f90ec1039f0 2024-08-25T23:58:19.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.381+0000 7f90ebe00640 1 --2- 172.21.15.42:0/1198973027 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f90d40a2b80 0x7f90d40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:58:19.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.382+0000 7f90ebe00640 1 --2- 172.21.15.42:0/1198973027 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f90d40a2b80 0x7f90d40a5040 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009bd0 tx=0x7f90d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:58:19.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.383+0000 7f90e9600640 1 -- 172.21.15.42:0/1198973027 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f90e00bd470 con 0x7f90ec1039f0 2024-08-25T23:58:19.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:19 smithi043 ceph-mon[22091]: Detected new or changed devices on smithi181 2024-08-25T23:58:19.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:19 smithi043 ceph-mon[22091]: Adjusting osd_memory_target on smithi181 to 5696M 2024-08-25T23:58:19.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:19 smithi043 ceph-mon[22091]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-08-25T23:58:19.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:19 smithi043 ceph-mon[22091]: osdmap e52: 9 total, 8 up, 9 in 2024-08-25T23:58:19.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:19 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-25T23:58:19.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:19 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-25T23:58:19.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:19 smithi043 ceph-mon[22091]: from='osd.8 ' entity='osd.8' 2024-08-25T23:58:19.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:19 smithi181 ceph-mon[22102]: Detected new or changed devices on smithi181 2024-08-25T23:58:19.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:19 smithi181 ceph-mon[22102]: Adjusting osd_memory_target on smithi181 to 5696M 2024-08-25T23:58:19.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:19 smithi181 ceph-mon[22102]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-08-25T23:58:19.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:19 smithi181 ceph-mon[22102]: osdmap e52: 9 total, 8 up, 9 in 2024-08-25T23:58:19.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:19 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-25T23:58:19.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:19 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-25T23:58:19.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:19 smithi181 ceph-mon[22102]: from='osd.8 ' entity='osd.8' 2024-08-25T23:58:19.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:19.581+0000 7f90f2200640 1 -- 172.21.15.42:0/1198973027 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f90ec0623d0 con 0x7f90d40a2b80 2024-08-25T23:58:20.427 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:20 smithi042 ceph-mon[17225]: purged_snaps scrub starts 2024-08-25T23:58:20.427 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:20 smithi042 ceph-mon[17225]: purged_snaps scrub ok 2024-08-25T23:58:20.428 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:20 smithi042 ceph-mon[17225]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:20.428 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:20 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-25T23:58:20.428 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:20 smithi042 ceph-mon[17225]: osd.8 [v2:172.21.15.181:6816/728226568,v1:172.21.15.181:6817/728226568] boot 2024-08-25T23:58:20.428 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:20 smithi042 ceph-mon[17225]: osdmap e53: 9 total, 9 up, 9 in 2024-08-25T23:58:20.428 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:20 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-25T23:58:20.428 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:20 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:58:20.428 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:20 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:58:20.428 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:20 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:20.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:20 smithi043 ceph-mon[22091]: purged_snaps scrub starts 2024-08-25T23:58:20.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:20 smithi043 ceph-mon[22091]: purged_snaps scrub ok 2024-08-25T23:58:20.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:20 smithi043 ceph-mon[22091]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:20.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:20 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-25T23:58:20.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:20 smithi043 ceph-mon[22091]: osd.8 [v2:172.21.15.181:6816/728226568,v1:172.21.15.181:6817/728226568] boot 2024-08-25T23:58:20.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:20 smithi043 ceph-mon[22091]: osdmap e53: 9 total, 9 up, 9 in 2024-08-25T23:58:20.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:20 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-25T23:58:20.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:20 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:58:20.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:20 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:58:20.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:20 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:20.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:20 smithi181 ceph-mon[22102]: purged_snaps scrub starts 2024-08-25T23:58:20.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:20 smithi181 ceph-mon[22102]: purged_snaps scrub ok 2024-08-25T23:58:20.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:20 smithi181 ceph-mon[22102]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-08-25T23:58:20.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:20 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-25T23:58:20.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:20 smithi181 ceph-mon[22102]: osd.8 [v2:172.21.15.181:6816/728226568,v1:172.21.15.181:6817/728226568] boot 2024-08-25T23:58:20.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:20 smithi181 ceph-mon[22102]: osdmap e53: 9 total, 9 up, 9 in 2024-08-25T23:58:20.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:20 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-25T23:58:20.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:20 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:58:20.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:20 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:58:20.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:20 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:21.171 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:21 smithi042 ceph-mon[17225]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:58:21.171 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:21 smithi042 ceph-mon[17225]: osdmap e54: 9 total, 9 up, 9 in 2024-08-25T23:58:21.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:21 smithi043 ceph-mon[22091]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:58:21.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:21 smithi043 ceph-mon[22091]: osdmap e54: 9 total, 9 up, 9 in 2024-08-25T23:58:21.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:21 smithi181 ceph-mon[22102]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:58:21.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:21 smithi181 ceph-mon[22102]: osdmap e54: 9 total, 9 up, 9 in 2024-08-25T23:58:22.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:22 smithi043 ceph-mon[22091]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-08-25T23:58:22.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:22 smithi043 ceph-mon[22091]: osdmap e55: 9 total, 9 up, 9 in 2024-08-25T23:58:22.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:22 smithi042 ceph-mon[17225]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-08-25T23:58:22.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:22 smithi042 ceph-mon[17225]: osdmap e55: 9 total, 9 up, 9 in 2024-08-25T23:58:22.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:22 smithi181 ceph-mon[22102]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-08-25T23:58:22.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:22 smithi181 ceph-mon[22102]: osdmap e55: 9 total, 9 up, 9 in 2024-08-25T23:58:23.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:23 smithi043 ceph-mon[22091]: osdmap e56: 9 total, 9 up, 9 in 2024-08-25T23:58:23.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:23 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/3061158541' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb387fbe-19b4-4a3e-8e40-81bd1363b55c"}]: dispatch 2024-08-25T23:58:23.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:23 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/3061158541' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb387fbe-19b4-4a3e-8e40-81bd1363b55c"}]': finished 2024-08-25T23:58:23.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:23 smithi043 ceph-mon[22091]: osdmap e57: 10 total, 9 up, 10 in 2024-08-25T23:58:23.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:23 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-25T23:58:23.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:23 smithi042 ceph-mon[17225]: osdmap e56: 9 total, 9 up, 9 in 2024-08-25T23:58:23.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:23 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/3061158541' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb387fbe-19b4-4a3e-8e40-81bd1363b55c"}]: dispatch 2024-08-25T23:58:23.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:23 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/3061158541' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb387fbe-19b4-4a3e-8e40-81bd1363b55c"}]': finished 2024-08-25T23:58:23.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:23 smithi042 ceph-mon[17225]: osdmap e57: 10 total, 9 up, 10 in 2024-08-25T23:58:23.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:23 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-25T23:58:23.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:23 smithi181 ceph-mon[22102]: osdmap e56: 9 total, 9 up, 9 in 2024-08-25T23:58:23.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:23 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/3061158541' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb387fbe-19b4-4a3e-8e40-81bd1363b55c"}]: dispatch 2024-08-25T23:58:23.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:23 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/3061158541' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb387fbe-19b4-4a3e-8e40-81bd1363b55c"}]': finished 2024-08-25T23:58:23.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:23 smithi181 ceph-mon[22102]: osdmap e57: 10 total, 9 up, 10 in 2024-08-25T23:58:23.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:23 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-25T23:58:24.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:24 smithi043 ceph-mon[22091]: pgmap v191: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-08-25T23:58:24.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:24 smithi043 ceph-mon[22091]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-08-25T23:58:24.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:24 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/2211929466' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:58:24.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:24 smithi042 ceph-mon[17225]: pgmap v191: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-08-25T23:58:24.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:24 smithi042 ceph-mon[17225]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-08-25T23:58:24.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:24 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2211929466' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:58:24.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:24 smithi181 ceph-mon[22102]: pgmap v191: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-08-25T23:58:24.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:24 smithi181 ceph-mon[22102]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-08-25T23:58:24.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:24 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/2211929466' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:58:26.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:26 smithi043 ceph-mon[22091]: pgmap v193: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-08-25T23:58:26.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:26 smithi042 ceph-mon[17225]: pgmap v193: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-08-25T23:58:26.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:26 smithi181 ceph-mon[22102]: pgmap v193: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-08-25T23:58:28.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:28 smithi042 ceph-mon[17225]: pgmap v194: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-08-25T23:58:28.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:28 smithi043 ceph-mon[22091]: pgmap v194: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-08-25T23:58:28.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:28 smithi181 ceph-mon[22102]: pgmap v194: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-08-25T23:58:29.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:29 smithi043 ceph-mon[22091]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-08-25T23:58:29.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:29 smithi043 ceph-mon[22091]: Cluster is now healthy 2024-08-25T23:58:29.519 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:29 smithi042 ceph-mon[17225]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-08-25T23:58:29.519 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:29 smithi042 ceph-mon[17225]: Cluster is now healthy 2024-08-25T23:58:29.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:29 smithi181 ceph-mon[22102]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-08-25T23:58:29.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:29 smithi181 ceph-mon[22102]: Cluster is now healthy 2024-08-25T23:58:30.397 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:30 smithi042 ceph-mon[17225]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-08-25T23:58:30.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:30 smithi043 ceph-mon[22091]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-08-25T23:58:30.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:30 smithi181 ceph-mon[22102]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-08-25T23:58:32.505 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:32 smithi042 ceph-mon[17225]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-08-25T23:58:32.505 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-08-25T23:58:32.505 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:32.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:32 smithi043 ceph-mon[22091]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-08-25T23:58:32.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-08-25T23:58:32.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:32.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:32 smithi181 ceph-mon[22102]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-08-25T23:58:32.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-08-25T23:58:32.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:33.489 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:33 smithi042 ceph-mon[17225]: Deploying daemon osd.9 on smithi042 2024-08-25T23:58:33.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:33 smithi043 ceph-mon[22091]: Deploying daemon osd.9 on smithi042 2024-08-25T23:58:33.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:33 smithi181 ceph-mon[22102]: Deploying daemon osd.9 on smithi042 2024-08-25T23:58:34.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:34 smithi043 ceph-mon[22091]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-25T23:58:34.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:34 smithi042 ceph-mon[17225]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-25T23:58:34.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:34 smithi181 ceph-mon[22102]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-25T23:58:36.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:36 smithi043 ceph-mon[22091]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-25T23:58:36.528 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:36 smithi042 ceph-mon[17225]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-25T23:58:36.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:36 smithi181 ceph-mon[22102]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-25T23:58:38.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:38 smithi043 ceph-mon[22091]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-25T23:58:38.527 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:38 smithi042 ceph-mon[17225]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-25T23:58:38.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:38 smithi181 ceph-mon[22102]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-25T23:58:39.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:39 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:58:39.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:39 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:39.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:39 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:39.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:39 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:58:39.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:39 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:39.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:39 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:39.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:39 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:58:39.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:39 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:39.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:39 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:40.312 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:40 smithi042 ceph-mon[17225]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-25T23:58:40.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:40 smithi181 ceph-mon[22102]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-25T23:58:40.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:40 smithi043 ceph-mon[22091]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-25T23:58:42.497 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:42 smithi042 ceph-mon[17225]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-08-25T23:58:42.497 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:42 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:42.497 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:42 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:42.497 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:42 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:42.497 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:42 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:58:42.497 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:42 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:42.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:42 smithi181 ceph-mon[22102]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-08-25T23:58:42.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:42 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:42.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:42 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:42.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:42 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:42.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:42 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:58:42.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:42 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:42.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:42 smithi043 ceph-mon[22091]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-08-25T23:58:42.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:42 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:42.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:42 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:42.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:42 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:42.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:42 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:58:42.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:42 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:43.062 INFO:teuthology.orchestra.run.smithi042.stdout:Created osd(s) 9 on host 'smithi042' 2024-08-25T23:58:43.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:43.060+0000 7f90e9600640 1 -- 172.21.15.42:0/1198973027 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f90ec0623d0 con 0x7f90d40a2b80 2024-08-25T23:58:43.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:43.062+0000 7f90f2200640 1 -- 172.21.15.42:0/1198973027 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f90d40a2b80 msgr2=0x7f90d40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:58:43.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:43.062+0000 7f90f2200640 1 --2- 172.21.15.42:0/1198973027 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f90d40a2b80 0x7f90d40a5040 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009bd0 tx=0x7f90d8005f90 comp rx=0 tx=0).stop 2024-08-25T23:58:43.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:43.062+0000 7f90f2200640 1 -- 172.21.15.42:0/1198973027 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90ec1039f0 msgr2=0x7f90ec199cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:58:43.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:43.062+0000 7f90f2200640 1 --2- 172.21.15.42:0/1198973027 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90ec1039f0 0x7f90ec199cf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009bf0 tx=0x7f90e0031ee0 comp rx=0 tx=0).stop 2024-08-25T23:58:43.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:43.062+0000 7f90f2200640 1 -- 172.21.15.42:0/1198973027 shutdown_connections 2024-08-25T23:58:43.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:43.062+0000 7f90f2200640 1 --2- 172.21.15.42:0/1198973027 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f90d40a2b80 0x7f90d40a5040 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:58:43.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:43.062+0000 7f90f2200640 1 --2- 172.21.15.42:0/1198973027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90ec1055b0 0x7f90ec1a1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:58:43.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:43.062+0000 7f90f2200640 1 --2- 172.21.15.42:0/1198973027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90ec104bf0 0x7f90ec19a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:58:43.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:43.062+0000 7f90f2200640 1 --2- 172.21.15.42:0/1198973027 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90ec1039f0 0x7f90ec199cf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:58:43.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:43.062+0000 7f90f2200640 1 -- 172.21.15.42:0/1198973027 >> 172.21.15.42:0/1198973027 conn(0x7f90ec0ff180 msgr2=0x7f90ec107fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:58:43.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:43.062+0000 7f90f2200640 1 -- 172.21.15.42:0/1198973027 shutdown_connections 2024-08-25T23:58:43.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:58:43.062+0000 7f90f2200640 1 -- 172.21.15.42:0/1198973027 wait complete. 2024-08-25T23:58:43.276 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:43 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:58:43.276 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:43 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:43.276 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:43 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:43.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:43 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:58:43.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:43 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:43.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:43 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:43.761 DEBUG:teuthology.orchestra.run.smithi042:osd.9> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.9.service 2024-08-25T23:58:43.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:43 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:58:43.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:43 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:43.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:43 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:43.766 INFO:tasks.cephadm:Deploying osd.10 on smithi043 with /dev/vg_nvme/lv_1... 2024-08-25T23:58:43.767 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-25T23:58:44.029 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.b/config 2024-08-25T23:58:44.448 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:44 smithi043 ceph-mon[22091]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-08-25T23:58:44.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:44 smithi042 ceph-mon[17225]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-08-25T23:58:44.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:44 smithi181 ceph-mon[22102]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-08-25T23:58:45.193 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 25 23:58:45 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-25T23:58:45.148+0000 7f511a64b640 -1 osd.9 0 log_to_monitors true 2024-08-25T23:58:45.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:45 smithi043 ceph-mon[22091]: from='osd.9 [v2:172.21.15.42:6826/1052069444,v1:172.21.15.42:6827/1052069444]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-08-25T23:58:45.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:45 smithi042 ceph-mon[17225]: from='osd.9 [v2:172.21.15.42:6826/1052069444,v1:172.21.15.42:6827/1052069444]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-08-25T23:58:45.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:45 smithi181 ceph-mon[22102]: from='osd.9 [v2:172.21.15.42:6826/1052069444,v1:172.21.15.42:6827/1052069444]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-08-25T23:58:46.262 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-08-25T23:58:46.291 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph orch daemon add osd smithi043:vg_nvme/lv_1 2024-08-25T23:58:46.300 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:46 smithi042 ceph-mon[17225]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-08-25T23:58:46.300 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:46 smithi042 ceph-mon[17225]: from='osd.9 [v2:172.21.15.42:6826/1052069444,v1:172.21.15.42:6827/1052069444]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-25T23:58:46.300 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:46 smithi042 ceph-mon[17225]: osdmap e58: 10 total, 9 up, 10 in 2024-08-25T23:58:46.300 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:46 smithi042 ceph-mon[17225]: from='osd.9 [v2:172.21.15.42:6826/1052069444,v1:172.21.15.42:6827/1052069444]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-08-25T23:58:46.300 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:46 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-25T23:58:46.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:46 smithi043 ceph-mon[22091]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-08-25T23:58:46.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:46 smithi043 ceph-mon[22091]: from='osd.9 [v2:172.21.15.42:6826/1052069444,v1:172.21.15.42:6827/1052069444]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-25T23:58:46.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:46 smithi043 ceph-mon[22091]: osdmap e58: 10 total, 9 up, 10 in 2024-08-25T23:58:46.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:46 smithi043 ceph-mon[22091]: from='osd.9 [v2:172.21.15.42:6826/1052069444,v1:172.21.15.42:6827/1052069444]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-08-25T23:58:46.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:46 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-25T23:58:46.549 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:46 smithi181 ceph-mon[22102]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-08-25T23:58:46.550 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:46 smithi181 ceph-mon[22102]: from='osd.9 [v2:172.21.15.42:6826/1052069444,v1:172.21.15.42:6827/1052069444]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-25T23:58:46.550 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:46 smithi181 ceph-mon[22102]: osdmap e58: 10 total, 9 up, 10 in 2024-08-25T23:58:46.550 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:46 smithi181 ceph-mon[22102]: from='osd.9 [v2:172.21.15.42:6826/1052069444,v1:172.21.15.42:6827/1052069444]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-08-25T23:58:46.550 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:46 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-25T23:58:46.559 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.b/config 2024-08-25T23:58:46.569 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 25 23:58:46 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-25T23:58:46.298+0000 7f5114400640 -1 osd.9 0 waiting for initial osdmap 2024-08-25T23:58:46.569 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 25 23:58:46 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-25T23:58:46.312+0000 7f510fe00640 -1 osd.9 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-25T23:58:47.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.996+0000 7f014c6d4640 1 -- 172.21.15.43:0/510634891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0144102470 msgr2=0x7f0144108d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:58:47.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.996+0000 7f014c6d4640 1 --2- 172.21.15.43:0/510634891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0144102470 0x7f0144108d00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f013c009ca0 tx=0x7f013c02a8c0 comp rx=0 tx=0).stop 2024-08-25T23:58:47.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.997+0000 7f014c6d4640 1 -- 172.21.15.43:0/510634891 shutdown_connections 2024-08-25T23:58:47.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.997+0000 7f014c6d4640 1 --2- 172.21.15.43:0/510634891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0144102470 0x7f0144108d00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:58:47.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.997+0000 7f014c6d4640 1 --2- 172.21.15.43:0/510634891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0144101ab0 0x7f0144101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:58:47.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.997+0000 7f014c6d4640 1 --2- 172.21.15.43:0/510634891 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01441008b0 0x7f0144100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:58:47.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.997+0000 7f014c6d4640 1 -- 172.21.15.43:0/510634891 >> 172.21.15.43:0/510634891 conn(0x7f01440fc040 msgr2=0x7f01440fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:58:47.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.997+0000 7f014c6d4640 1 -- 172.21.15.43:0/510634891 shutdown_connections 2024-08-25T23:58:47.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.997+0000 7f014c6d4640 1 -- 172.21.15.43:0/510634891 wait complete. 2024-08-25T23:58:47.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.997+0000 7f014c6d4640 1 Processor -- start 2024-08-25T23:58:47.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.997+0000 7f014c6d4640 1 -- start start 2024-08-25T23:58:47.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.998+0000 7f014c6d4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01441008b0 0x7f014406b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:58:47.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.998+0000 7f014c6d4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0144101ab0 0x7f014419ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:58:47.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.998+0000 7f014c6d4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0144102470 0x7f01441a1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:58:47.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.998+0000 7f014c6d4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f014410c5b0 con 0x7f01441008b0 2024-08-25T23:58:47.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.998+0000 7f014c6d4640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f014410c430 con 0x7f0144101ab0 2024-08-25T23:58:47.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.998+0000 7f014c6d4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f014410c730 con 0x7f0144102470 2024-08-25T23:58:47.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.998+0000 7f0149c6f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0144101ab0 0x7f014419ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:58:47.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.998+0000 7f0149c6f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0144101ab0 0x7f014419ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50212/0 (socket says 172.21.15.43:50212) 2024-08-25T23:58:47.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.998+0000 7f0149c6f640 1 -- 172.21.15.43:0/2156075400 learned_addr learned my addr 172.21.15.43:0/2156075400 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-08-25T23:58:47.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.998+0000 7f014ac71640 1 --2- 172.21.15.43:0/2156075400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0144102470 0x7f01441a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:58:47.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.998+0000 7f014a470640 1 --2- 172.21.15.43:0/2156075400 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01441008b0 0x7f014406b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:58:47.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.998+0000 7f0149c6f640 1 -- 172.21.15.43:0/2156075400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0144102470 msgr2=0x7f01441a1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:58:47.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.998+0000 7f0149c6f640 1 --2- 172.21.15.43:0/2156075400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0144102470 0x7f01441a1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:58:47.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.998+0000 7f0149c6f640 1 -- 172.21.15.43:0/2156075400 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01441008b0 msgr2=0x7f014406b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:58:47.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.998+0000 7f0149c6f640 1 --2- 172.21.15.43:0/2156075400 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01441008b0 0x7f014406b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:58:47.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.998+0000 7f0149c6f640 1 -- 172.21.15.43:0/2156075400 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01441a1b70 con 0x7f0144101ab0 2024-08-25T23:58:47.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.998+0000 7f0149c6f640 1 --2- 172.21.15.43:0/2156075400 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0144101ab0 0x7f014419ee30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f013400b4a0 tx=0x7f013400b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:58:47.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.998+0000 7f013b7fe640 1 -- 172.21.15.43:0/2156075400 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0134014070 con 0x7f0144101ab0 2024-08-25T23:58:47.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.998+0000 7f014c6d4640 1 -- 172.21.15.43:0/2156075400 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01441a1e00 con 0x7f0144101ab0 2024-08-25T23:58:47.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.998+0000 7f013b7fe640 1 -- 172.21.15.43:0/2156075400 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0134010af0 con 0x7f0144101ab0 2024-08-25T23:58:47.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.998+0000 7f013b7fe640 1 -- 172.21.15.43:0/2156075400 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0134017d10 con 0x7f0144101ab0 2024-08-25T23:58:47.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.998+0000 7f014c6d4640 1 -- 172.21.15.43:0/2156075400 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01441a2380 con 0x7f0144101ab0 2024-08-25T23:58:47.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:46.999+0000 7f014c6d4640 1 -- 172.21.15.43:0/2156075400 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0144107c80 con 0x7f0144101ab0 2024-08-25T23:58:47.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:47.001+0000 7f013b7fe640 1 -- 172.21.15.43:0/2156075400 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0134017070 con 0x7f0144101ab0 2024-08-25T23:58:47.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:47.001+0000 7f013b7fe640 1 --2- 172.21.15.43:0/2156075400 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f01300a2bb0 0x7f01300a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:58:47.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:47.001+0000 7f013b7fe640 1 -- 172.21.15.43:0/2156075400 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5981+0+0 (secure 0 0 0) 0x7f01340cdd60 con 0x7f0144101ab0 2024-08-25T23:58:47.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:47.002+0000 7f014a470640 1 --2- 172.21.15.43:0/2156075400 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f01300a2bb0 0x7f01300a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:58:47.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:47.002+0000 7f014a470640 1 --2- 172.21.15.43:0/2156075400 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f01300a2bb0 0x7f01300a5070 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0144101910 tx=0x7f0140005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:58:47.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:47.004+0000 7f013b7fe640 1 -- 172.21.15.43:0/2156075400 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f013409af70 con 0x7f0144101ab0 2024-08-25T23:58:47.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:58:47.224+0000 7f014c6d4640 1 -- 172.21.15.43:0/2156075400 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f01440623d0 con 0x7f01300a2bb0 2024-08-25T23:58:47.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:47 smithi043 ceph-mon[22091]: from='osd.9 [v2:172.21.15.42:6826/1052069444,v1:172.21.15.42:6827/1052069444]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-08-25T23:58:47.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:47 smithi043 ceph-mon[22091]: osdmap e59: 10 total, 9 up, 10 in 2024-08-25T23:58:47.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:47 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-25T23:58:47.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:47 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-25T23:58:47.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:47 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:58:47.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:47 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:58:47.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:47 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:47.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:47 smithi042 ceph-mon[17225]: from='osd.9 [v2:172.21.15.42:6826/1052069444,v1:172.21.15.42:6827/1052069444]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-08-25T23:58:47.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:47 smithi042 ceph-mon[17225]: osdmap e59: 10 total, 9 up, 10 in 2024-08-25T23:58:47.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:47 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-25T23:58:47.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:47 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-25T23:58:47.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:47 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:58:47.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:47 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:58:47.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:47 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:47.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:47 smithi181 ceph-mon[22102]: from='osd.9 [v2:172.21.15.42:6826/1052069444,v1:172.21.15.42:6827/1052069444]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-08-25T23:58:47.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:47 smithi181 ceph-mon[22102]: osdmap e59: 10 total, 9 up, 10 in 2024-08-25T23:58:47.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:47 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-25T23:58:47.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:47 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-25T23:58:47.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:47 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:58:47.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:47 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:58:47.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:47 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:48.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:48 smithi043 ceph-mon[22091]: purged_snaps scrub starts 2024-08-25T23:58:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:48 smithi043 ceph-mon[22091]: purged_snaps scrub ok 2024-08-25T23:58:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:48 smithi043 ceph-mon[22091]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-08-25T23:58:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:48 smithi043 ceph-mon[22091]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:58:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:48 smithi043 ceph-mon[22091]: osd.9 [v2:172.21.15.42:6826/1052069444,v1:172.21.15.42:6827/1052069444] boot 2024-08-25T23:58:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:48 smithi043 ceph-mon[22091]: osdmap e60: 10 total, 10 up, 10 in 2024-08-25T23:58:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:48 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-25T23:58:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:48 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:48 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:48 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:58:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:48 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:58:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:48 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:58:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:48 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:58:48.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:48 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:48.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:48 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:48.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:48 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:58:48.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:48 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:48.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:48 smithi042 ceph-mon[17225]: purged_snaps scrub starts 2024-08-25T23:58:48.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:48 smithi042 ceph-mon[17225]: purged_snaps scrub ok 2024-08-25T23:58:48.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:48 smithi042 ceph-mon[17225]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-08-25T23:58:48.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:48 smithi042 ceph-mon[17225]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:58:48.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:48 smithi042 ceph-mon[17225]: osd.9 [v2:172.21.15.42:6826/1052069444,v1:172.21.15.42:6827/1052069444] boot 2024-08-25T23:58:48.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:48 smithi042 ceph-mon[17225]: osdmap e60: 10 total, 10 up, 10 in 2024-08-25T23:58:48.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:48 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-25T23:58:48.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:48 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:48.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:48 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:48.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:48 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:58:48.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:48 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:58:48.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:48 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:58:48.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:48 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:58:48.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:48 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:48.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:48 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:48.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:48 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:58:48.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:48 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:48.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:48 smithi181 ceph-mon[22102]: purged_snaps scrub starts 2024-08-25T23:58:48.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:48 smithi181 ceph-mon[22102]: purged_snaps scrub ok 2024-08-25T23:58:48.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:48 smithi181 ceph-mon[22102]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-08-25T23:58:48.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:48 smithi181 ceph-mon[22102]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:58:48.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:48 smithi181 ceph-mon[22102]: osd.9 [v2:172.21.15.42:6826/1052069444,v1:172.21.15.42:6827/1052069444] boot 2024-08-25T23:58:48.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:48 smithi181 ceph-mon[22102]: osdmap e60: 10 total, 10 up, 10 in 2024-08-25T23:58:48.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:48 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-25T23:58:48.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:48 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:48.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:48 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:48.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:48 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:58:48.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:48 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:58:48.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:48 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:58:48.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:48 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:58:48.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:48 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:48.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:48 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:48.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:48 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:58:48.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:48 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:58:49.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:49 smithi042 ceph-mon[17225]: Detected new or changed devices on smithi042 2024-08-25T23:58:49.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:49 smithi042 ceph-mon[17225]: Adjusting osd_memory_target on smithi042 to 4273M 2024-08-25T23:58:49.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:49 smithi042 ceph-mon[17225]: osdmap e61: 10 total, 10 up, 10 in 2024-08-25T23:58:49.624 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:49 smithi043 ceph-mon[22091]: Detected new or changed devices on smithi042 2024-08-25T23:58:49.624 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:49 smithi043 ceph-mon[22091]: Adjusting osd_memory_target on smithi042 to 4273M 2024-08-25T23:58:49.624 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:49 smithi043 ceph-mon[22091]: osdmap e61: 10 total, 10 up, 10 in 2024-08-25T23:58:49.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:49 smithi181 ceph-mon[22102]: Detected new or changed devices on smithi042 2024-08-25T23:58:49.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:49 smithi181 ceph-mon[22102]: Adjusting osd_memory_target on smithi042 to 4273M 2024-08-25T23:58:49.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:49 smithi181 ceph-mon[22102]: osdmap e61: 10 total, 10 up, 10 in 2024-08-25T23:58:50.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:50 smithi043 ceph-mon[22091]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:58:50.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:50 smithi043 ceph-mon[22091]: from='client.? 172.21.15.43:0/1154903405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fe5bbeec-2341-4ea9-97ab-cc45d738d741"}]: dispatch 2024-08-25T23:58:50.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:50 smithi043 ceph-mon[22091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fe5bbeec-2341-4ea9-97ab-cc45d738d741"}]: dispatch 2024-08-25T23:58:50.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:50 smithi043 ceph-mon[22091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fe5bbeec-2341-4ea9-97ab-cc45d738d741"}]': finished 2024-08-25T23:58:50.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:50 smithi043 ceph-mon[22091]: osdmap e62: 11 total, 10 up, 11 in 2024-08-25T23:58:50.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:50 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-25T23:58:50.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:50 smithi043 ceph-mon[22091]: from='client.? 172.21.15.43:0/3289230384' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:58:50.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:50 smithi042 ceph-mon[17225]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:58:50.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:50 smithi042 ceph-mon[17225]: from='client.? 172.21.15.43:0/1154903405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fe5bbeec-2341-4ea9-97ab-cc45d738d741"}]: dispatch 2024-08-25T23:58:50.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:50 smithi042 ceph-mon[17225]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fe5bbeec-2341-4ea9-97ab-cc45d738d741"}]: dispatch 2024-08-25T23:58:50.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:50 smithi042 ceph-mon[17225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fe5bbeec-2341-4ea9-97ab-cc45d738d741"}]': finished 2024-08-25T23:58:50.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:50 smithi042 ceph-mon[17225]: osdmap e62: 11 total, 10 up, 11 in 2024-08-25T23:58:50.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:50 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-25T23:58:50.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:50 smithi042 ceph-mon[17225]: from='client.? 172.21.15.43:0/3289230384' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:58:50.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:50 smithi181 ceph-mon[22102]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:58:50.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:50 smithi181 ceph-mon[22102]: from='client.? 172.21.15.43:0/1154903405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fe5bbeec-2341-4ea9-97ab-cc45d738d741"}]: dispatch 2024-08-25T23:58:50.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:50 smithi181 ceph-mon[22102]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fe5bbeec-2341-4ea9-97ab-cc45d738d741"}]: dispatch 2024-08-25T23:58:50.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:50 smithi181 ceph-mon[22102]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fe5bbeec-2341-4ea9-97ab-cc45d738d741"}]': finished 2024-08-25T23:58:50.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:50 smithi181 ceph-mon[22102]: osdmap e62: 11 total, 10 up, 11 in 2024-08-25T23:58:50.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:50 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-25T23:58:50.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:50 smithi181 ceph-mon[22102]: from='client.? 172.21.15.43:0/3289230384' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:58:52.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:52 smithi043 ceph-mon[22091]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:58:52.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:52 smithi042 ceph-mon[17225]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:58:52.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:52 smithi181 ceph-mon[22102]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:58:54.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:54 smithi043 ceph-mon[22091]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:58:54.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:54 smithi042 ceph-mon[17225]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:58:54.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:54 smithi181 ceph-mon[22102]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:58:56.482 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:56 smithi043 ceph-mon[22091]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:58:56.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:56 smithi042 ceph-mon[17225]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:58:56.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:56 smithi181 ceph-mon[22102]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:58:58.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:58 smithi043 ceph-mon[22091]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:58:58.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:58 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-08-25T23:58:58.616 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:58 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:58.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:58 smithi042 ceph-mon[17225]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:58:58.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:58 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-08-25T23:58:58.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:58 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:58.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:58 smithi181 ceph-mon[22102]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:58:58.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:58 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-08-25T23:58:58.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:58 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:58:59.570 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:58:59 smithi043 ceph-mon[22091]: Deploying daemon osd.10 on smithi043 2024-08-25T23:58:59.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:58:59 smithi042 ceph-mon[17225]: Deploying daemon osd.10 on smithi043 2024-08-25T23:58:59.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:58:59 smithi181 ceph-mon[22102]: Deploying daemon osd.10 on smithi043 2024-08-25T23:59:00.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:00 smithi043 ceph-mon[22091]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:59:00.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:00 smithi042 ceph-mon[17225]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:59:00.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:00 smithi181 ceph-mon[22102]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:59:02.676 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:02 smithi043 ceph-mon[22091]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:59:02.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:02 smithi042 ceph-mon[17225]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:59:02.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:02 smithi181 ceph-mon[22102]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:59:03.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:03 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:59:03.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:03 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:03.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:03 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:03.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:03 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:59:03.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:03 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:03.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:03 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:03.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:03 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:59:03.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:03 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:03.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:03 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:04.685 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:04 smithi042 ceph-mon[17225]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:59:04.691 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:04 smithi043 ceph-mon[22091]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:59:04.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:04 smithi181 ceph-mon[22102]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:59:05.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:05 smithi043 ceph-mon[22091]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:59:05.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:05 smithi042 ceph-mon[17225]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:59:05.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:05 smithi181 ceph-mon[22102]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:59:06.186 INFO:teuthology.orchestra.run.smithi043.stdout:Created osd(s) 10 on host 'smithi043' 2024-08-25T23:59:06.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:59:06.184+0000 7f013b7fe640 1 -- 172.21.15.43:0/2156075400 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f01440623d0 con 0x7f01300a2bb0 2024-08-25T23:59:06.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:59:06.187+0000 7f014c6d4640 1 -- 172.21.15.43:0/2156075400 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f01300a2bb0 msgr2=0x7f01300a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:06.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:59:06.187+0000 7f014c6d4640 1 --2- 172.21.15.43:0/2156075400 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f01300a2bb0 0x7f01300a5070 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0144101910 tx=0x7f0140005f90 comp rx=0 tx=0).stop 2024-08-25T23:59:06.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:59:06.187+0000 7f014c6d4640 1 -- 172.21.15.43:0/2156075400 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0144101ab0 msgr2=0x7f014419ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:06.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:59:06.187+0000 7f014c6d4640 1 --2- 172.21.15.43:0/2156075400 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0144101ab0 0x7f014419ee30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f013400b4a0 tx=0x7f013400b960 comp rx=0 tx=0).stop 2024-08-25T23:59:06.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:59:06.187+0000 7f014c6d4640 1 -- 172.21.15.43:0/2156075400 shutdown_connections 2024-08-25T23:59:06.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:59:06.187+0000 7f014c6d4640 1 --2- 172.21.15.43:0/2156075400 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f01300a2bb0 0x7f01300a5070 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:06.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:59:06.187+0000 7f014c6d4640 1 --2- 172.21.15.43:0/2156075400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0144102470 0x7f01441a1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:06.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:59:06.187+0000 7f014c6d4640 1 --2- 172.21.15.43:0/2156075400 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0144101ab0 0x7f014419ee30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:06.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:59:06.187+0000 7f014c6d4640 1 --2- 172.21.15.43:0/2156075400 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01441008b0 0x7f014406b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:06.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:59:06.187+0000 7f014c6d4640 1 -- 172.21.15.43:0/2156075400 >> 172.21.15.43:0/2156075400 conn(0x7f01440fc040 msgr2=0x7f0144104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:59:06.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:59:06.187+0000 7f014c6d4640 1 -- 172.21.15.43:0/2156075400 shutdown_connections 2024-08-25T23:59:06.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-08-25T23:59:06.187+0000 7f014c6d4640 1 -- 172.21.15.43:0/2156075400 wait complete. 2024-08-25T23:59:06.802 DEBUG:teuthology.orchestra.run.smithi043:osd.10> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.10.service 2024-08-25T23:59:06.804 INFO:tasks.cephadm:Deploying osd.11 on smithi181 with /dev/vg_nvme/lv_1... 2024-08-25T23:59:06.805 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-25T23:59:07.063 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.c/config 2024-08-25T23:59:07.430 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:07 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:07.430 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:07 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:07.430 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:07 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:07.430 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:07 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:07.505 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:07 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:07.505 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:07 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:07.505 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:07 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:07.506 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:07 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:07.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:07 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:07.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:07 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:07.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:07 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:07.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:07 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:08.440 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:08 smithi181 ceph-mon[22102]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:59:08.480 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:08 smithi043 ceph-mon[22091]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:59:08.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:08 smithi042 ceph-mon[17225]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:59:09.496 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-25T23:59:09.521 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph orch daemon add osd smithi181:vg_nvme/lv_1 2024-08-25T23:59:09.778 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.c/config 2024-08-25T23:59:09.870 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 25 23:59:09 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-25T23:59:09.603+0000 7f631bb48640 -1 osd.10 0 log_to_monitors true 2024-08-25T23:59:10.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.267+0000 7f47deb6f640 1 -- 172.21.15.181:0/3810576671 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47d8102430 msgr2=0x7f47d8108cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:10.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.267+0000 7f47deb6f640 1 --2- 172.21.15.181:0/3810576671 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47d8102430 0x7f47d8108cc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009900 tx=0x7f47c002a410 comp rx=0 tx=0).stop 2024-08-25T23:59:10.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.267+0000 7f47deb6f640 1 -- 172.21.15.181:0/3810576671 shutdown_connections 2024-08-25T23:59:10.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.267+0000 7f47deb6f640 1 --2- 172.21.15.181:0/3810576671 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47d8102430 0x7f47d8108cc0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:10.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.267+0000 7f47deb6f640 1 --2- 172.21.15.181:0/3810576671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47d8101a70 0x7f47d8101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:10.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.267+0000 7f47deb6f640 1 --2- 172.21.15.181:0/3810576671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47d8100870 0x7f47d8100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:10.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.267+0000 7f47deb6f640 1 -- 172.21.15.181:0/3810576671 >> 172.21.15.181:0/3810576671 conn(0x7f47d80fc020 msgr2=0x7f47d80fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:59:10.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.267+0000 7f47deb6f640 1 -- 172.21.15.181:0/3810576671 shutdown_connections 2024-08-25T23:59:10.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.267+0000 7f47deb6f640 1 -- 172.21.15.181:0/3810576671 wait complete. 2024-08-25T23:59:10.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.268+0000 7f47deb6f640 1 Processor -- start 2024-08-25T23:59:10.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.268+0000 7f47deb6f640 1 -- start start 2024-08-25T23:59:10.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.268+0000 7f47deb6f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47d8100870 0x7f47d8197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:10.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.268+0000 7f47deb6f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47d8101a70 0x7f47d8198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:10.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.268+0000 7f47deb6f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47d8102430 0x7f47d819f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:10.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.268+0000 7f47deb6f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f47d810d680 con 0x7f47d8100870 2024-08-25T23:59:10.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.268+0000 7f47deb6f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f47d810d500 con 0x7f47d8102430 2024-08-25T23:59:10.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.268+0000 7f47deb6f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f47d810d800 con 0x7f47d8101a70 2024-08-25T23:59:10.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.268+0000 7f47d7fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47d8101a70 0x7f47d8198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:10.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.268+0000 7f47d7fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47d8101a70 0x7f47d8198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:47648/0 (socket says 172.21.15.181:47648) 2024-08-25T23:59:10.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.268+0000 7f47d7fff640 1 -- 172.21.15.181:0/3712186379 learned_addr learned my addr 172.21.15.181:0/3712186379 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-08-25T23:59:10.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.268+0000 7f47dc90b640 1 --2- 172.21.15.181:0/3712186379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47d8100870 0x7f47d8197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:10.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.268+0000 7f47dd10c640 1 --2- 172.21.15.181:0/3712186379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47d8102430 0x7f47d819f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:10.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.269+0000 7f47d7fff640 1 -- 172.21.15.181:0/3712186379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47d8102430 msgr2=0x7f47d819f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:10.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.269+0000 7f47d7fff640 1 --2- 172.21.15.181:0/3712186379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47d8102430 0x7f47d819f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:10.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.269+0000 7f47d7fff640 1 -- 172.21.15.181:0/3712186379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47d8100870 msgr2=0x7f47d8197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:10.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.269+0000 7f47d7fff640 1 --2- 172.21.15.181:0/3712186379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47d8100870 0x7f47d8197cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:10.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.269+0000 7f47d7fff640 1 -- 172.21.15.181:0/3712186379 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d819f910 con 0x7f47d8101a70 2024-08-25T23:59:10.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.269+0000 7f47dd10c640 1 --2- 172.21.15.181:0/3712186379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47d8102430 0x7f47d819f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-25T23:59:10.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.269+0000 7f47dc90b640 1 --2- 172.21.15.181:0/3712186379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47d8100870 0x7f47d8197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-25T23:59:10.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.269+0000 7f47d7fff640 1 --2- 172.21.15.181:0/3712186379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47d8101a70 0x7f47d8198230 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f47c800cce0 tx=0x7f47c800a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:59:10.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.269+0000 7f47d5ffb640 1 -- 172.21.15.181:0/3712186379 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c8004b20 con 0x7f47d8101a70 2024-08-25T23:59:10.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.269+0000 7f47d5ffb640 1 -- 172.21.15.181:0/3712186379 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47c8004cc0 con 0x7f47d8101a70 2024-08-25T23:59:10.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.269+0000 7f47deb6f640 1 -- 172.21.15.181:0/3712186379 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d819fc00 con 0x7f47d8101a70 2024-08-25T23:59:10.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.269+0000 7f47d5ffb640 1 -- 172.21.15.181:0/3712186379 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c800f7d0 con 0x7f47d8101a70 2024-08-25T23:59:10.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.269+0000 7f47deb6f640 1 -- 172.21.15.181:0/3712186379 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d81a0140 con 0x7f47d8101a70 2024-08-25T23:59:10.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.270+0000 7f47deb6f640 1 -- 172.21.15.181:0/3712186379 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d8107c10 con 0x7f47d8101a70 2024-08-25T23:59:10.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.272+0000 7f47d5ffb640 1 -- 172.21.15.181:0/3712186379 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f47c800f970 con 0x7f47d8101a70 2024-08-25T23:59:10.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.272+0000 7f47d5ffb640 1 --2- 172.21.15.181:0/3712186379 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47c40a2b80 0x7f47c40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:10.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.273+0000 7f47d5ffb640 1 -- 172.21.15.181:0/3712186379 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6398+0+0 (secure 0 0 0) 0x7f47c80cee00 con 0x7f47d8101a70 2024-08-25T23:59:10.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.273+0000 7f47dc90b640 1 --2- 172.21.15.181:0/3712186379 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47c40a2b80 0x7f47c40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:10.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.273+0000 7f47dc90b640 1 --2- 172.21.15.181:0/3712186379 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47c40a2b80 0x7f47c40a5040 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f47d81991d0 tx=0x7f47d0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:59:10.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.276+0000 7f47d5ffb640 1 -- 172.21.15.181:0/3712186379 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f47c8014030 con 0x7f47d8101a70 2024-08-25T23:59:10.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:10.459+0000 7f47deb6f640 1 -- 172.21.15.181:0/3712186379 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f47d80623d0 con 0x7f47c40a2b80 2024-08-25T23:59:10.460 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:10 smithi181 ceph-mon[22102]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:59:10.460 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:10 smithi181 ceph-mon[22102]: from='osd.10 [v2:172.21.15.43:6824/3417487386,v1:172.21.15.43:6825/3417487386]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-25T23:59:10.460 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:10 smithi181 ceph-mon[22102]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-25T23:59:10.460 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:10 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:10.460 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:10 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:10.460 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:10 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:10.460 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:10 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:10.460 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:10 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:10.460 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:10 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:10.461 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:10 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:10.461 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:10 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:10.461 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:10 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:59:10.461 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:10 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:10.461 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:10 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:59:10.461 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:10 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:10.461 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:10 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:59:10.461 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:10 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:10.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:10 smithi043 ceph-mon[22091]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:59:10.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:10 smithi043 ceph-mon[22091]: from='osd.10 [v2:172.21.15.43:6824/3417487386,v1:172.21.15.43:6825/3417487386]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-25T23:59:10.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:10 smithi043 ceph-mon[22091]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-25T23:59:10.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:10 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:10.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:10 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:10.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:10 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:10.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:10 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:10.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:10 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:10.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:10 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:10.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:10 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:10.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:10 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:10.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:10 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:59:10.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:10 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:10.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:10 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:59:10.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:10 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:10.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:10 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:59:10.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:10 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:10.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:10 smithi042 ceph-mon[17225]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:59:10.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:10 smithi042 ceph-mon[17225]: from='osd.10 [v2:172.21.15.43:6824/3417487386,v1:172.21.15.43:6825/3417487386]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-25T23:59:10.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:10 smithi042 ceph-mon[17225]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-25T23:59:10.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:10 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:10.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:10 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:10.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:10 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:10.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:10 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:10.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:10 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:10.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:10 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:10.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:10 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:10.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:10 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:10.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:10 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:59:10.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:10 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:10.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:10 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:59:10.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:10 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:10.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:10 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:59:10.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:10 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:11.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:11 smithi181 ceph-mon[22102]: Detected new or changed devices on smithi043 2024-08-25T23:59:11.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:11 smithi181 ceph-mon[22102]: Adjusting osd_memory_target on smithi043 to 4273M 2024-08-25T23:59:11.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:11 smithi181 ceph-mon[22102]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-25T23:59:11.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:11 smithi181 ceph-mon[22102]: osdmap e63: 11 total, 10 up, 11 in 2024-08-25T23:59:11.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:11 smithi181 ceph-mon[22102]: from='osd.10 [v2:172.21.15.43:6824/3417487386,v1:172.21.15.43:6825/3417487386]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:59:11.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:11 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-25T23:59:11.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:11 smithi181 ceph-mon[22102]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:59:11.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:11 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:59:11.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:11 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:59:11.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:11 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:11.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:11 smithi181 ceph-mon[22102]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-08-25T23:59:11.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:11 smithi181 ceph-mon[22102]: osdmap e64: 11 total, 10 up, 11 in 2024-08-25T23:59:11.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:11 smithi043 ceph-mon[22091]: Detected new or changed devices on smithi043 2024-08-25T23:59:11.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:11 smithi043 ceph-mon[22091]: Adjusting osd_memory_target on smithi043 to 4273M 2024-08-25T23:59:11.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:11 smithi043 ceph-mon[22091]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-25T23:59:11.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:11 smithi043 ceph-mon[22091]: osdmap e63: 11 total, 10 up, 11 in 2024-08-25T23:59:11.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:11 smithi043 ceph-mon[22091]: from='osd.10 [v2:172.21.15.43:6824/3417487386,v1:172.21.15.43:6825/3417487386]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:59:11.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:11 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-25T23:59:11.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:11 smithi043 ceph-mon[22091]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:59:11.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:11 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:59:11.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:11 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:59:11.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:11 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:11.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:11 smithi043 ceph-mon[22091]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-08-25T23:59:11.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:11 smithi043 ceph-mon[22091]: osdmap e64: 11 total, 10 up, 11 in 2024-08-25T23:59:11.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:11 smithi042 ceph-mon[17225]: Detected new or changed devices on smithi043 2024-08-25T23:59:11.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:11 smithi042 ceph-mon[17225]: Adjusting osd_memory_target on smithi043 to 4273M 2024-08-25T23:59:11.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:11 smithi042 ceph-mon[17225]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-25T23:59:11.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:11 smithi042 ceph-mon[17225]: osdmap e63: 11 total, 10 up, 11 in 2024-08-25T23:59:11.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:11 smithi042 ceph-mon[17225]: from='osd.10 [v2:172.21.15.43:6824/3417487386,v1:172.21.15.43:6825/3417487386]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:59:11.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:11 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-25T23:59:11.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:11 smithi042 ceph-mon[17225]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-08-25T23:59:11.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:11 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-25T23:59:11.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:11 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-25T23:59:11.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:11 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:11.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:11 smithi042 ceph-mon[17225]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-08-25T23:59:11.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:11 smithi042 ceph-mon[17225]: osdmap e64: 11 total, 10 up, 11 in 2024-08-25T23:59:12.204 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 25 23:59:11 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-25T23:59:11.877+0000 7f63172a8640 -1 osd.10 0 waiting for initial osdmap 2024-08-25T23:59:12.204 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 25 23:59:11 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-25T23:59:11.889+0000 7f630f8da640 -1 osd.10 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-25T23:59:12.473 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:12 smithi181 ceph-mon[22102]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:59:12.473 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:12 smithi181 ceph-mon[22102]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:59:12.473 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:12 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-25T23:59:12.473 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:12 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-25T23:59:12.473 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:12 smithi181 ceph-mon[22102]: from='osd.10 ' entity='osd.10' 2024-08-25T23:59:12.473 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:12 smithi181 ceph-mon[22102]: osd.10 [v2:172.21.15.43:6824/3417487386,v1:172.21.15.43:6825/3417487386] boot 2024-08-25T23:59:12.473 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:12 smithi181 ceph-mon[22102]: osdmap e65: 11 total, 11 up, 11 in 2024-08-25T23:59:12.473 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:12 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-25T23:59:12.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:12 smithi043 ceph-mon[22091]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:59:12.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:12 smithi043 ceph-mon[22091]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:59:12.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:12 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-25T23:59:12.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:12 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-25T23:59:12.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:12 smithi043 ceph-mon[22091]: from='osd.10 ' entity='osd.10' 2024-08-25T23:59:12.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:12 smithi043 ceph-mon[22091]: osd.10 [v2:172.21.15.43:6824/3417487386,v1:172.21.15.43:6825/3417487386] boot 2024-08-25T23:59:12.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:12 smithi043 ceph-mon[22091]: osdmap e65: 11 total, 11 up, 11 in 2024-08-25T23:59:12.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:12 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-25T23:59:12.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:12 smithi042 ceph-mon[17225]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:59:12.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:12 smithi042 ceph-mon[17225]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-08-25T23:59:12.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:12 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-25T23:59:12.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:12 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-25T23:59:12.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:12 smithi042 ceph-mon[17225]: from='osd.10 ' entity='osd.10' 2024-08-25T23:59:12.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:12 smithi042 ceph-mon[17225]: osd.10 [v2:172.21.15.43:6824/3417487386,v1:172.21.15.43:6825/3417487386] boot 2024-08-25T23:59:12.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:12 smithi042 ceph-mon[17225]: osdmap e65: 11 total, 11 up, 11 in 2024-08-25T23:59:12.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:12 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-25T23:59:13.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:13 smithi181 ceph-mon[22102]: purged_snaps scrub starts 2024-08-25T23:59:13.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:13 smithi181 ceph-mon[22102]: purged_snaps scrub ok 2024-08-25T23:59:13.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:13 smithi181 ceph-mon[22102]: from='client.? 172.21.15.181:0/3276156155' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cee07741-3ab7-481e-8477-54319f4f178a"}]: dispatch 2024-08-25T23:59:13.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:13 smithi181 ceph-mon[22102]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cee07741-3ab7-481e-8477-54319f4f178a"}]: dispatch 2024-08-25T23:59:13.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:13 smithi181 ceph-mon[22102]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cee07741-3ab7-481e-8477-54319f4f178a"}]': finished 2024-08-25T23:59:13.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:13 smithi181 ceph-mon[22102]: osdmap e66: 12 total, 11 up, 12 in 2024-08-25T23:59:13.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:13.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:13 smithi043 ceph-mon[22091]: purged_snaps scrub starts 2024-08-25T23:59:13.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:13 smithi043 ceph-mon[22091]: purged_snaps scrub ok 2024-08-25T23:59:13.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:13 smithi043 ceph-mon[22091]: from='client.? 172.21.15.181:0/3276156155' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cee07741-3ab7-481e-8477-54319f4f178a"}]: dispatch 2024-08-25T23:59:13.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:13 smithi043 ceph-mon[22091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cee07741-3ab7-481e-8477-54319f4f178a"}]: dispatch 2024-08-25T23:59:13.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:13 smithi043 ceph-mon[22091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cee07741-3ab7-481e-8477-54319f4f178a"}]': finished 2024-08-25T23:59:13.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:13 smithi043 ceph-mon[22091]: osdmap e66: 12 total, 11 up, 12 in 2024-08-25T23:59:13.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:13 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:13.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:13 smithi042 ceph-mon[17225]: purged_snaps scrub starts 2024-08-25T23:59:13.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:13 smithi042 ceph-mon[17225]: purged_snaps scrub ok 2024-08-25T23:59:13.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:13 smithi042 ceph-mon[17225]: from='client.? 172.21.15.181:0/3276156155' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cee07741-3ab7-481e-8477-54319f4f178a"}]: dispatch 2024-08-25T23:59:13.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:13 smithi042 ceph-mon[17225]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cee07741-3ab7-481e-8477-54319f4f178a"}]: dispatch 2024-08-25T23:59:13.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:13 smithi042 ceph-mon[17225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cee07741-3ab7-481e-8477-54319f4f178a"}]': finished 2024-08-25T23:59:13.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:13 smithi042 ceph-mon[17225]: osdmap e66: 12 total, 11 up, 12 in 2024-08-25T23:59:13.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:14.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:14 smithi043 ceph-mon[22091]: pgmap v225: 1 pgs: 1 peering; 577 KiB data, 743 MiB used, 983 GiB / 983 GiB avail 2024-08-25T23:59:14.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:14 smithi043 ceph-mon[22091]: from='client.? 172.21.15.181:0/3239462574' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:59:14.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:14 smithi043 ceph-mon[22091]: osdmap e67: 12 total, 11 up, 12 in 2024-08-25T23:59:14.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:14 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:14.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:14 smithi042 ceph-mon[17225]: pgmap v225: 1 pgs: 1 peering; 577 KiB data, 743 MiB used, 983 GiB / 983 GiB avail 2024-08-25T23:59:14.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:14 smithi042 ceph-mon[17225]: from='client.? 172.21.15.181:0/3239462574' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:59:14.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:14 smithi042 ceph-mon[17225]: osdmap e67: 12 total, 11 up, 12 in 2024-08-25T23:59:14.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:14 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:14.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:14 smithi181 ceph-mon[22102]: pgmap v225: 1 pgs: 1 peering; 577 KiB data, 743 MiB used, 983 GiB / 983 GiB avail 2024-08-25T23:59:14.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:14 smithi181 ceph-mon[22102]: from='client.? 172.21.15.181:0/3239462574' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-25T23:59:14.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:14 smithi181 ceph-mon[22102]: osdmap e67: 12 total, 11 up, 12 in 2024-08-25T23:59:14.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:14 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:16.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:16 smithi043 ceph-mon[22091]: pgmap v228: 1 pgs: 1 peering; 577 KiB data, 743 MiB used, 983 GiB / 983 GiB avail 2024-08-25T23:59:16.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:16 smithi043 ceph-mon[22091]: osdmap e68: 12 total, 11 up, 12 in 2024-08-25T23:59:16.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:16 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:16.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:16 smithi042 ceph-mon[17225]: pgmap v228: 1 pgs: 1 peering; 577 KiB data, 743 MiB used, 983 GiB / 983 GiB avail 2024-08-25T23:59:16.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:16 smithi042 ceph-mon[17225]: osdmap e68: 12 total, 11 up, 12 in 2024-08-25T23:59:16.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:16 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:16.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:16 smithi181 ceph-mon[22102]: pgmap v228: 1 pgs: 1 peering; 577 KiB data, 743 MiB used, 983 GiB / 983 GiB avail 2024-08-25T23:59:16.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:16 smithi181 ceph-mon[22102]: osdmap e68: 12 total, 11 up, 12 in 2024-08-25T23:59:16.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:16 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:17.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:17 smithi043 ceph-mon[22091]: osdmap e69: 12 total, 11 up, 12 in 2024-08-25T23:59:17.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:17 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:17.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:17 smithi042 ceph-mon[17225]: osdmap e69: 12 total, 11 up, 12 in 2024-08-25T23:59:17.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:17 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:17.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:17 smithi181 ceph-mon[22102]: osdmap e69: 12 total, 11 up, 12 in 2024-08-25T23:59:17.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:17 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:18.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:18 smithi043 ceph-mon[22091]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 743 MiB used, 983 GiB / 983 GiB avail 2024-08-25T23:59:18.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:18 smithi042 ceph-mon[17225]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 743 MiB used, 983 GiB / 983 GiB avail 2024-08-25T23:59:18.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:18 smithi181 ceph-mon[22102]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 743 MiB used, 983 GiB / 983 GiB avail 2024-08-25T23:59:20.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:20 smithi043 ceph-mon[22091]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-08-25T23:59:20.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:20 smithi042 ceph-mon[17225]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-08-25T23:59:20.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:20 smithi181 ceph-mon[22102]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-08-25T23:59:21.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:21 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-08-25T23:59:21.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:21 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:21.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:21 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-08-25T23:59:21.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:21 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:21.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:21 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-08-25T23:59:21.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:21 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:22.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:22 smithi043 ceph-mon[22091]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-08-25T23:59:22.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:22 smithi043 ceph-mon[22091]: Deploying daemon osd.11 on smithi181 2024-08-25T23:59:22.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:22 smithi042 ceph-mon[17225]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-08-25T23:59:22.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:22 smithi042 ceph-mon[17225]: Deploying daemon osd.11 on smithi181 2024-08-25T23:59:22.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:22 smithi181 ceph-mon[22102]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-08-25T23:59:22.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:22 smithi181 ceph-mon[22102]: Deploying daemon osd.11 on smithi181 2024-08-25T23:59:24.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:24 smithi043 ceph-mon[22091]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-25T23:59:24.522 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:24 smithi181 ceph-mon[22102]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-25T23:59:24.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:24 smithi042 ceph-mon[17225]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-25T23:59:26.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:26 smithi043 ceph-mon[22091]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-25T23:59:26.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:26 smithi042 ceph-mon[17225]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-25T23:59:26.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:26 smithi181 ceph-mon[22102]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-25T23:59:27.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:27 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:59:27.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:27 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:27.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:27 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:27.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:27 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:59:27.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:27 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:27.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:27 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:27.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:27 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:59:27.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:27 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:27.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:27 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:28.464 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:28 smithi181 ceph-mon[22102]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-08-25T23:59:28.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:28 smithi043 ceph-mon[22091]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-08-25T23:59:28.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:28 smithi042 ceph-mon[17225]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-08-25T23:59:30.041 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 11 on host 'smithi181' 2024-08-25T23:59:30.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:30.039+0000 7f47d5ffb640 1 -- 172.21.15.181:0/3712186379 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f47d80623d0 con 0x7f47c40a2b80 2024-08-25T23:59:30.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:30.042+0000 7f47deb6f640 1 -- 172.21.15.181:0/3712186379 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47c40a2b80 msgr2=0x7f47c40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:30.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:30.042+0000 7f47deb6f640 1 --2- 172.21.15.181:0/3712186379 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47c40a2b80 0x7f47c40a5040 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f47d81991d0 tx=0x7f47d0008040 comp rx=0 tx=0).stop 2024-08-25T23:59:30.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:30.042+0000 7f47deb6f640 1 -- 172.21.15.181:0/3712186379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47d8101a70 msgr2=0x7f47d8198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:30.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:30.042+0000 7f47deb6f640 1 --2- 172.21.15.181:0/3712186379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47d8101a70 0x7f47d8198230 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f47c800cce0 tx=0x7f47c800a620 comp rx=0 tx=0).stop 2024-08-25T23:59:30.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:30.042+0000 7f47deb6f640 1 -- 172.21.15.181:0/3712186379 shutdown_connections 2024-08-25T23:59:30.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:30.042+0000 7f47deb6f640 1 --2- 172.21.15.181:0/3712186379 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47c40a2b80 0x7f47c40a5040 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:30.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:30.042+0000 7f47deb6f640 1 --2- 172.21.15.181:0/3712186379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47d8102430 0x7f47d819f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:30.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:30.042+0000 7f47deb6f640 1 --2- 172.21.15.181:0/3712186379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47d8101a70 0x7f47d8198230 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:30.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:30.042+0000 7f47deb6f640 1 --2- 172.21.15.181:0/3712186379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47d8100870 0x7f47d8197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:30.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:30.042+0000 7f47deb6f640 1 -- 172.21.15.181:0/3712186379 >> 172.21.15.181:0/3712186379 conn(0x7f47d80fc020 msgr2=0x7f47d8104de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:59:30.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:30.042+0000 7f47deb6f640 1 -- 172.21.15.181:0/3712186379 shutdown_connections 2024-08-25T23:59:30.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:30.043+0000 7f47deb6f640 1 -- 172.21.15.181:0/3712186379 wait complete. 2024-08-25T23:59:30.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:30 smithi043 ceph-mon[22091]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-25T23:59:30.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:30 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:30.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:30 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:30.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:30 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:30.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:30 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:59:30.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:30 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:30.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:30 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:59:30.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:30 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:30.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:30 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:30.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:30 smithi042 ceph-mon[17225]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-25T23:59:30.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:30 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:30.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:30 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:30.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:30 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:30.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:30 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:59:30.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:30 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:30.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:30 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:59:30.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:30 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:30.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:30 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:30.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:30 smithi181 ceph-mon[22102]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-25T23:59:30.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:30 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:30.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:30 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:30.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:30 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:30.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:30 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:59:30.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:30 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:30.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:30 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:59:30.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:30 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:30.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:30 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:30.726 DEBUG:teuthology.orchestra.run.smithi181:osd.11> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.11.service 2024-08-25T23:59:30.728 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-08-25T23:59:30.728 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd stat -f json 2024-08-25T23:59:31.114 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:59:31.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.657+0000 7f4431200640 1 -- 172.21.15.42:0/3743736421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f442c0749f0 msgr2=0x7f442c074e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:31.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.657+0000 7f4431200640 1 --2- 172.21.15.42:0/3743736421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f442c0749f0 0x7f442c074e50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4418009900 tx=0x7f441802a3f0 comp rx=0 tx=0).stop 2024-08-25T23:59:31.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.658+0000 7f4431200640 1 -- 172.21.15.42:0/3743736421 shutdown_connections 2024-08-25T23:59:31.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.658+0000 7f4431200640 1 --2- 172.21.15.42:0/3743736421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f442c10df80 0x7f442c110370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:31.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.658+0000 7f4431200640 1 --2- 172.21.15.42:0/3743736421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f442c0749f0 0x7f442c074e50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:31.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.658+0000 7f4431200640 1 --2- 172.21.15.42:0/3743736421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f442c075fc0 0x7f442c074420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:31.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.658+0000 7f4431200640 1 -- 172.21.15.42:0/3743736421 >> 172.21.15.42:0/3743736421 conn(0x7f442c0fd130 msgr2=0x7f442c0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:59:31.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.658+0000 7f4431200640 1 -- 172.21.15.42:0/3743736421 shutdown_connections 2024-08-25T23:59:31.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.658+0000 7f4431200640 1 -- 172.21.15.42:0/3743736421 wait complete. 2024-08-25T23:59:31.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.659+0000 7f4431200640 1 Processor -- start 2024-08-25T23:59:31.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.659+0000 7f4431200640 1 -- start start 2024-08-25T23:59:31.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.660+0000 7f4431200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f442c0749f0 0x7f442c19e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:31.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.660+0000 7f4431200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f442c075fc0 0x7f442c19e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:31.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.660+0000 7f4431200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f442c10df80 0x7f442c1a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:31.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.660+0000 7f4431200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f442c113c40 con 0x7f442c0749f0 2024-08-25T23:59:31.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.660+0000 7f4431200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f442c113ac0 con 0x7f442c075fc0 2024-08-25T23:59:31.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.660+0000 7f4431200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f442c113dc0 con 0x7f442c10df80 2024-08-25T23:59:31.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.660+0000 7f4429e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f442c0749f0 0x7f442c19e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:31.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.660+0000 7f4429e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f442c0749f0 0x7f442c19e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57946/0 (socket says 172.21.15.42:57946) 2024-08-25T23:59:31.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.660+0000 7f4429e00640 1 -- 172.21.15.42:0/1246752279 learned_addr learned my addr 172.21.15.42:0/1246752279 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:59:31.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.660+0000 7f442a800640 1 --2- 172.21.15.42:0/1246752279 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f442c10df80 0x7f442c1a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:31.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.660+0000 7f4429400640 1 --2- 172.21.15.42:0/1246752279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f442c075fc0 0x7f442c19e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:31.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.660+0000 7f4429e00640 1 -- 172.21.15.42:0/1246752279 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f442c10df80 msgr2=0x7f442c1a5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:31.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.660+0000 7f4429e00640 1 --2- 172.21.15.42:0/1246752279 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f442c10df80 0x7f442c1a5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:31.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.660+0000 7f4429e00640 1 -- 172.21.15.42:0/1246752279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f442c075fc0 msgr2=0x7f442c19e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:31.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.660+0000 7f4429e00640 1 --2- 172.21.15.42:0/1246752279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f442c075fc0 0x7f442c19e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:31.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.660+0000 7f4429e00640 1 -- 172.21.15.42:0/1246752279 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442c1a5ef0 con 0x7f442c0749f0 2024-08-25T23:59:31.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.660+0000 7f442a800640 1 --2- 172.21.15.42:0/1246752279 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f442c10df80 0x7f442c1a5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-25T23:59:31.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.661+0000 7f4429e00640 1 --2- 172.21.15.42:0/1246752279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f442c0749f0 0x7f442c19e2c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f441c00e9a0 tx=0x7f441c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:59:31.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.661+0000 7f4422a00640 1 -- 172.21.15.42:0/1246752279 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c00cd80 con 0x7f442c0749f0 2024-08-25T23:59:31.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.661+0000 7f4422a00640 1 -- 172.21.15.42:0/1246752279 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f441c0035f0 con 0x7f442c0749f0 2024-08-25T23:59:31.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.661+0000 7f4431200640 1 -- 172.21.15.42:0/1246752279 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f442c1a61e0 con 0x7f442c0749f0 2024-08-25T23:59:31.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.661+0000 7f4422a00640 1 -- 172.21.15.42:0/1246752279 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c010670 con 0x7f442c0749f0 2024-08-25T23:59:31.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.661+0000 7f4431200640 1 -- 172.21.15.42:0/1246752279 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f442c1a66f0 con 0x7f442c0749f0 2024-08-25T23:59:31.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.662+0000 7f4431200640 1 -- 172.21.15.42:0/1246752279 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f442c104150 con 0x7f442c0749f0 2024-08-25T23:59:31.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.664+0000 7f4422a00640 1 -- 172.21.15.42:0/1246752279 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f441c0037a0 con 0x7f442c0749f0 2024-08-25T23:59:31.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.666+0000 7f4422a00640 1 --2- 172.21.15.42:0/1246752279 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f44100a2bb0 0x7f44100a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:31.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.666+0000 7f4422a00640 1 -- 172.21.15.42:0/1246752279 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6809+0+0 (secure 0 0 0) 0x7f441c0ced30 con 0x7f442c0749f0 2024-08-25T23:59:31.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.666+0000 7f4429400640 1 --2- 172.21.15.42:0/1246752279 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f44100a2bb0 0x7f44100a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:31.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.667+0000 7f4429400640 1 --2- 172.21.15.42:0/1246752279 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f44100a2bb0 0x7f44100a5070 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f44180314e0 tx=0x7f4418000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:59:31.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.670+0000 7f4422a00640 1 -- 172.21.15.42:0/1246752279 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f441c09c1d0 con 0x7f442c0749f0 2024-08-25T23:59:31.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.855+0000 7f4431200640 1 -- 172.21.15.42:0/1246752279 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f442c02d6a0 con 0x7f442c0749f0 2024-08-25T23:59:31.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.856+0000 7f4422a00640 1 -- 172.21.15.42:0/1246752279 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7f441c09bad0 con 0x7f442c0749f0 2024-08-25T23:59:31.858 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:59:31.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.858+0000 7f4431200640 1 -- 172.21.15.42:0/1246752279 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f44100a2bb0 msgr2=0x7f44100a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:31.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.858+0000 7f4431200640 1 --2- 172.21.15.42:0/1246752279 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f44100a2bb0 0x7f44100a5070 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f44180314e0 tx=0x7f4418000bc0 comp rx=0 tx=0).stop 2024-08-25T23:59:31.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.858+0000 7f4431200640 1 -- 172.21.15.42:0/1246752279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f442c0749f0 msgr2=0x7f442c19e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:31.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.858+0000 7f4431200640 1 --2- 172.21.15.42:0/1246752279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f442c0749f0 0x7f442c19e2c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f441c00e9a0 tx=0x7f441c00ee60 comp rx=0 tx=0).stop 2024-08-25T23:59:31.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.858+0000 7f4431200640 1 -- 172.21.15.42:0/1246752279 shutdown_connections 2024-08-25T23:59:31.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.858+0000 7f4431200640 1 --2- 172.21.15.42:0/1246752279 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f44100a2bb0 0x7f44100a5070 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:31.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.858+0000 7f4431200640 1 --2- 172.21.15.42:0/1246752279 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f442c10df80 0x7f442c1a5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:31.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.858+0000 7f4431200640 1 --2- 172.21.15.42:0/1246752279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f442c075fc0 0x7f442c19e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:31.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.858+0000 7f4431200640 1 --2- 172.21.15.42:0/1246752279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f442c0749f0 0x7f442c19e2c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:31.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.858+0000 7f4431200640 1 -- 172.21.15.42:0/1246752279 >> 172.21.15.42:0/1246752279 conn(0x7f442c0fd130 msgr2=0x7f442c101320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:59:31.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.859+0000 7f4431200640 1 -- 172.21.15.42:0/1246752279 shutdown_connections 2024-08-25T23:59:31.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:31.859+0000 7f4431200640 1 -- 172.21.15.42:0/1246752279 wait complete. 2024-08-25T23:59:32.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:32 smithi042 ceph-mon[17225]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail 2024-08-25T23:59:32.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:32 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1246752279' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-25T23:59:32.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:32 smithi042 ceph-mon[17225]: from='osd.11 [v2:172.21.15.181:6824/3817502913,v1:172.21.15.181:6825/3817502913]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-25T23:59:32.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:32 smithi042 ceph-mon[17225]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-25T23:59:32.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:32 smithi181 ceph-mon[22102]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail 2024-08-25T23:59:32.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:32 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1246752279' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-25T23:59:32.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:32 smithi181 ceph-mon[22102]: from='osd.11 [v2:172.21.15.181:6824/3817502913,v1:172.21.15.181:6825/3817502913]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-25T23:59:32.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:32 smithi181 ceph-mon[22102]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-25T23:59:32.534 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 25 23:59:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-25T23:59:32.220+0000 7fdf53c37640 -1 osd.11 0 log_to_monitors true 2024-08-25T23:59:32.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:32 smithi043 ceph-mon[22091]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail 2024-08-25T23:59:32.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:32 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1246752279' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-25T23:59:32.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:32 smithi043 ceph-mon[22091]: from='osd.11 [v2:172.21.15.181:6824/3817502913,v1:172.21.15.181:6825/3817502913]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-25T23:59:32.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:32 smithi043 ceph-mon[22091]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-25T23:59:32.781 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":69,"num_osds":12,"num_up_osds":11,"osd_up_since":1724630352,"num_in_osds":12,"osd_in_since":1724630352,"num_remapped_pgs":0} 2024-08-25T23:59:33.497 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:33 smithi181 ceph-mon[22102]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-25T23:59:33.497 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:33 smithi181 ceph-mon[22102]: osdmap e70: 12 total, 11 up, 12 in 2024-08-25T23:59:33.497 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:33 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:33.497 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:33 smithi181 ceph-mon[22102]: from='osd.11 [v2:172.21.15.181:6824/3817502913,v1:172.21.15.181:6825/3817502913]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:59:33.497 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:33 smithi181 ceph-mon[22102]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:59:33.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:33 smithi042 ceph-mon[17225]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-25T23:59:33.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:33 smithi042 ceph-mon[17225]: osdmap e70: 12 total, 11 up, 12 in 2024-08-25T23:59:33.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:33 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:33.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:33 smithi042 ceph-mon[17225]: from='osd.11 [v2:172.21.15.181:6824/3817502913,v1:172.21.15.181:6825/3817502913]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:59:33.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:33 smithi042 ceph-mon[17225]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:59:33.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:33 smithi043 ceph-mon[22091]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-25T23:59:33.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:33 smithi043 ceph-mon[22091]: osdmap e70: 12 total, 11 up, 12 in 2024-08-25T23:59:33.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:33 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:33.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:33 smithi043 ceph-mon[22091]: from='osd.11 [v2:172.21.15.181:6824/3817502913,v1:172.21.15.181:6825/3817502913]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:59:33.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:33 smithi043 ceph-mon[22091]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-08-25T23:59:33.782 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd stat -f json 2024-08-25T23:59:34.169 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:59:34.534 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 25 23:59:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-25T23:59:34.044+0000 7fdf503ce640 -1 osd.11 0 waiting for initial osdmap 2024-08-25T23:59:34.534 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 25 23:59:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-25T23:59:34.058+0000 7fdf479c9640 -1 osd.11 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-25T23:59:34.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:34 smithi042 ceph-mon[17225]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail 2024-08-25T23:59:34.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:34 smithi042 ceph-mon[17225]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-08-25T23:59:34.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:34 smithi042 ceph-mon[17225]: osdmap e71: 12 total, 11 up, 12 in 2024-08-25T23:59:34.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:34.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:34.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:34.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:34.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:34.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:34.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:34.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:34.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:34.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:34.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:59:34.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:34 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:34.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:34 smithi042 ceph-mon[17225]: from='osd.11 ' entity='osd.11' 2024-08-25T23:59:34.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:34 smithi181 ceph-mon[22102]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail 2024-08-25T23:59:34.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:34 smithi181 ceph-mon[22102]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-08-25T23:59:34.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:34 smithi181 ceph-mon[22102]: osdmap e71: 12 total, 11 up, 12 in 2024-08-25T23:59:34.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:34.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:34.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:34.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:34.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:34.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:34.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:34.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:34.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:34.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:34.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:59:34.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:34 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:34.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:34 smithi181 ceph-mon[22102]: from='osd.11 ' entity='osd.11' 2024-08-25T23:59:34.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.752+0000 7fdceaa00640 1 -- 172.21.15.42:0/2661630952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdce41033a0 msgr2=0x7fdce4109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:34.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.752+0000 7fdceaa00640 1 --2- 172.21.15.42:0/2661630952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdce41033a0 0x7fdce4109c30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc009ca0 tx=0x7fdcdc02a8c0 comp rx=0 tx=0).stop 2024-08-25T23:59:34.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.752+0000 7fdceaa00640 1 -- 172.21.15.42:0/2661630952 shutdown_connections 2024-08-25T23:59:34.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.752+0000 7fdceaa00640 1 --2- 172.21.15.42:0/2661630952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdce41033a0 0x7fdce4109c30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:34.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.752+0000 7fdceaa00640 1 --2- 172.21.15.42:0/2661630952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdce41029e0 0x7fdce4102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:34.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.752+0000 7fdceaa00640 1 --2- 172.21.15.42:0/2661630952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce41017e0 0x7fdce4101be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:34.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.752+0000 7fdceaa00640 1 -- 172.21.15.42:0/2661630952 >> 172.21.15.42:0/2661630952 conn(0x7fdce40fcf90 msgr2=0x7fdce40ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:59:34.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.753+0000 7fdceaa00640 1 -- 172.21.15.42:0/2661630952 shutdown_connections 2024-08-25T23:59:34.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.753+0000 7fdceaa00640 1 -- 172.21.15.42:0/2661630952 wait complete. 2024-08-25T23:59:34.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.753+0000 7fdceaa00640 1 Processor -- start 2024-08-25T23:59:34.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.754+0000 7fdceaa00640 1 -- start start 2024-08-25T23:59:34.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.754+0000 7fdceaa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdce41017e0 0x7fdce4075d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:34.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.754+0000 7fdceaa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce41029e0 0x7fdce4074380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:34.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.754+0000 7fdceaa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdce41033a0 0x7fdce40748c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:34.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.754+0000 7fdceaa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdce410d440 con 0x7fdce41033a0 2024-08-25T23:59:34.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.754+0000 7fdceaa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdce410d2c0 con 0x7fdce41017e0 2024-08-25T23:59:34.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.754+0000 7fdceaa00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdce410d5c0 con 0x7fdce41029e0 2024-08-25T23:59:34.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.754+0000 7fdce8c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce41029e0 0x7fdce4074380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:34.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.754+0000 7fdce9600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdce41017e0 0x7fdce4075d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:34.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.754+0000 7fdce8c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce41029e0 0x7fdce4074380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:33238/0 (socket says 172.21.15.42:33238) 2024-08-25T23:59:34.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.754+0000 7fdcea000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdce41033a0 0x7fdce40748c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:34.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.754+0000 7fdce8c00640 1 -- 172.21.15.42:0/1013093695 learned_addr learned my addr 172.21.15.42:0/1013093695 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:59:34.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.755+0000 7fdce8c00640 1 -- 172.21.15.42:0/1013093695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdce41017e0 msgr2=0x7fdce4075d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:34.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.755+0000 7fdce8c00640 1 --2- 172.21.15.42:0/1013093695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdce41017e0 0x7fdce4075d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:34.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.755+0000 7fdce8c00640 1 -- 172.21.15.42:0/1013093695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdce41033a0 msgr2=0x7fdce40748c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:34.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.755+0000 7fdce8c00640 1 --2- 172.21.15.42:0/1013093695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdce41033a0 0x7fdce40748c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:34.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.755+0000 7fdce8c00640 1 -- 172.21.15.42:0/1013093695 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce4075180 con 0x7fdce41029e0 2024-08-25T23:59:34.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.755+0000 7fdce8c00640 1 --2- 172.21.15.42:0/1013093695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce41029e0 0x7fdce4074380 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000e9f0 tx=0x7fdcd000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:59:34.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.755+0000 7fdce2000640 1 -- 172.21.15.42:0/1013093695 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd000cd80 con 0x7fdce41029e0 2024-08-25T23:59:34.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.755+0000 7fdce2000640 1 -- 172.21.15.42:0/1013093695 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcd0010910 con 0x7fdce41029e0 2024-08-25T23:59:34.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.755+0000 7fdce2000640 1 -- 172.21.15.42:0/1013093695 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0018990 con 0x7fdce41029e0 2024-08-25T23:59:34.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.755+0000 7fdceaa00640 1 -- 172.21.15.42:0/1013093695 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdce41a1bc0 con 0x7fdce41029e0 2024-08-25T23:59:34.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.756+0000 7fdceaa00640 1 -- 172.21.15.42:0/1013093695 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdce41a2120 con 0x7fdce41029e0 2024-08-25T23:59:34.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.757+0000 7fdceaa00640 1 -- 172.21.15.42:0/1013093695 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdce4108b90 con 0x7fdce41029e0 2024-08-25T23:59:34.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.759+0000 7fdce2000640 1 -- 172.21.15.42:0/1013093695 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fdcd0010ac0 con 0x7fdce41029e0 2024-08-25T23:59:34.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:34 smithi043 ceph-mon[22091]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail 2024-08-25T23:59:34.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:34 smithi043 ceph-mon[22091]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-08-25T23:59:34.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:34 smithi043 ceph-mon[22091]: osdmap e71: 12 total, 11 up, 12 in 2024-08-25T23:59:34.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:34.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:34.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:34.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:34.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:34.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:34.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:34.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-25T23:59:34.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:34.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:34.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:59:34.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:34 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:34.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:34 smithi043 ceph-mon[22091]: from='osd.11 ' entity='osd.11' 2024-08-25T23:59:34.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.760+0000 7fdce2000640 1 --2- 172.21.15.42:0/1013093695 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fdccc0a2c00 0x7fdccc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:34.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.760+0000 7fdce2000640 1 -- 172.21.15.42:0/1013093695 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6847+0+0 (secure 0 0 0) 0x7fdcd00cf2a0 con 0x7fdce41029e0 2024-08-25T23:59:34.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.760+0000 7fdce9600640 1 --2- 172.21.15.42:0/1013093695 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fdccc0a2c00 0x7fdccc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:34.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.761+0000 7fdce9600640 1 --2- 172.21.15.42:0/1013093695 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fdccc0a2c00 0x7fdccc0a50c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdcd80095f0 tx=0x7fdcd8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:59:34.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.762+0000 7fdce2000640 1 -- 172.21.15.42:0/1013093695 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fdcd009c0d0 con 0x7fdce41029e0 2024-08-25T23:59:34.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.948+0000 7fdceaa00640 1 -- 172.21.15.42:0/1013093695 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fdce4062bc0 con 0x7fdce41029e0 2024-08-25T23:59:34.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.948+0000 7fdce2000640 1 -- 172.21.15.42:0/1013093695 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7fdcd00bc0e0 con 0x7fdce41029e0 2024-08-25T23:59:34.950 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:59:34.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.951+0000 7fdceaa00640 1 -- 172.21.15.42:0/1013093695 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fdccc0a2c00 msgr2=0x7fdccc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:34.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.951+0000 7fdceaa00640 1 --2- 172.21.15.42:0/1013093695 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fdccc0a2c00 0x7fdccc0a50c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdcd80095f0 tx=0x7fdcd8005f90 comp rx=0 tx=0).stop 2024-08-25T23:59:34.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.951+0000 7fdceaa00640 1 -- 172.21.15.42:0/1013093695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce41029e0 msgr2=0x7fdce4074380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:34.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.951+0000 7fdceaa00640 1 --2- 172.21.15.42:0/1013093695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce41029e0 0x7fdce4074380 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000e9f0 tx=0x7fdcd000eeb0 comp rx=0 tx=0).stop 2024-08-25T23:59:34.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.951+0000 7fdceaa00640 1 -- 172.21.15.42:0/1013093695 shutdown_connections 2024-08-25T23:59:34.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.951+0000 7fdceaa00640 1 --2- 172.21.15.42:0/1013093695 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fdccc0a2c00 0x7fdccc0a50c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:34.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.951+0000 7fdceaa00640 1 --2- 172.21.15.42:0/1013093695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdce41033a0 0x7fdce40748c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:34.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.951+0000 7fdceaa00640 1 --2- 172.21.15.42:0/1013093695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdce41029e0 0x7fdce4074380 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:34.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.951+0000 7fdceaa00640 1 --2- 172.21.15.42:0/1013093695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdce41017e0 0x7fdce4075d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:34.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.951+0000 7fdceaa00640 1 -- 172.21.15.42:0/1013093695 >> 172.21.15.42:0/1013093695 conn(0x7fdce40fcf90 msgr2=0x7fdce4105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:59:34.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.952+0000 7fdceaa00640 1 -- 172.21.15.42:0/1013093695 shutdown_connections 2024-08-25T23:59:34.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:34.952+0000 7fdceaa00640 1 -- 172.21.15.42:0/1013093695 wait complete. 2024-08-25T23:59:35.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:35 smithi042 ceph-mon[17225]: purged_snaps scrub starts 2024-08-25T23:59:35.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:35 smithi042 ceph-mon[17225]: purged_snaps scrub ok 2024-08-25T23:59:35.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:35 smithi042 ceph-mon[17225]: Detected new or changed devices on smithi181 2024-08-25T23:59:35.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:35 smithi042 ceph-mon[17225]: Adjusting osd_memory_target on smithi181 to 4272M 2024-08-25T23:59:35.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:35 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:35.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:35 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1013093695' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-25T23:59:35.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:35 smithi042 ceph-mon[17225]: osd.11 [v2:172.21.15.181:6824/3817502913,v1:172.21.15.181:6825/3817502913] boot 2024-08-25T23:59:35.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:35 smithi042 ceph-mon[17225]: osdmap e72: 12 total, 12 up, 12 in 2024-08-25T23:59:35.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:35 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:35.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:35 smithi181 ceph-mon[22102]: purged_snaps scrub starts 2024-08-25T23:59:35.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:35 smithi181 ceph-mon[22102]: purged_snaps scrub ok 2024-08-25T23:59:35.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:35 smithi181 ceph-mon[22102]: Detected new or changed devices on smithi181 2024-08-25T23:59:35.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:35 smithi181 ceph-mon[22102]: Adjusting osd_memory_target on smithi181 to 4272M 2024-08-25T23:59:35.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:35 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:35.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:35 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1013093695' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-25T23:59:35.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:35 smithi181 ceph-mon[22102]: osd.11 [v2:172.21.15.181:6824/3817502913,v1:172.21.15.181:6825/3817502913] boot 2024-08-25T23:59:35.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:35 smithi181 ceph-mon[22102]: osdmap e72: 12 total, 12 up, 12 in 2024-08-25T23:59:35.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:35 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:35.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:35 smithi043 ceph-mon[22091]: purged_snaps scrub starts 2024-08-25T23:59:35.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:35 smithi043 ceph-mon[22091]: purged_snaps scrub ok 2024-08-25T23:59:35.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:35 smithi043 ceph-mon[22091]: Detected new or changed devices on smithi181 2024-08-25T23:59:35.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:35 smithi043 ceph-mon[22091]: Adjusting osd_memory_target on smithi181 to 4272M 2024-08-25T23:59:35.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:35 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:35.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:35 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1013093695' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-25T23:59:35.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:35 smithi043 ceph-mon[22091]: osd.11 [v2:172.21.15.181:6824/3817502913,v1:172.21.15.181:6825/3817502913] boot 2024-08-25T23:59:35.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:35 smithi043 ceph-mon[22091]: osdmap e72: 12 total, 12 up, 12 in 2024-08-25T23:59:35.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:35 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-25T23:59:35.781 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1724630352,"num_in_osds":12,"osd_in_since":1724630352,"num_remapped_pgs":0} 2024-08-25T23:59:36.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:36 smithi042 ceph-mon[17225]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail 2024-08-25T23:59:36.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:36 smithi042 ceph-mon[17225]: osdmap e73: 12 total, 12 up, 12 in 2024-08-25T23:59:36.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:36 smithi181 ceph-mon[22102]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail 2024-08-25T23:59:36.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:36 smithi181 ceph-mon[22102]: osdmap e73: 12 total, 12 up, 12 in 2024-08-25T23:59:36.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:36 smithi043 ceph-mon[22091]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail 2024-08-25T23:59:36.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:36 smithi043 ceph-mon[22091]: osdmap e73: 12 total, 12 up, 12 in 2024-08-25T23:59:36.781 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd stat -f json 2024-08-25T23:59:37.171 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:59:37.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.821+0000 7f1059800640 1 -- 172.21.15.42:0/3550220662 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1054078530 msgr2=0x7f1054078dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:37.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.821+0000 7f1059800640 1 --2- 172.21.15.42:0/3550220662 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1054078530 0x7f1054078dd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f104c009ca0 tx=0x7f104c02a8c0 comp rx=0 tx=0).stop 2024-08-25T23:59:37.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.821+0000 7f1059800640 1 -- 172.21.15.42:0/3550220662 shutdown_connections 2024-08-25T23:59:37.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.821+0000 7f1059800640 1 --2- 172.21.15.42:0/3550220662 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1054078530 0x7f1054078dd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:37.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.821+0000 7f1059800640 1 --2- 172.21.15.42:0/3550220662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1054077b90 0x7f1054077ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:37.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.821+0000 7f1059800640 1 --2- 172.21.15.42:0/3550220662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1054076940 0x7f1054076d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:37.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.821+0000 7f1059800640 1 -- 172.21.15.42:0/3550220662 >> 172.21.15.42:0/3550220662 conn(0x7f10540ff350 msgr2=0x7f1054101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:59:37.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.822+0000 7f1059800640 1 -- 172.21.15.42:0/3550220662 shutdown_connections 2024-08-25T23:59:37.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.822+0000 7f1059800640 1 -- 172.21.15.42:0/3550220662 wait complete. 2024-08-25T23:59:37.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.823+0000 7f1059800640 1 Processor -- start 2024-08-25T23:59:37.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.823+0000 7f1059800640 1 -- start start 2024-08-25T23:59:37.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.823+0000 7f1059800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1054076940 0x7f105419e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:37.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.823+0000 7f1059800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1054077b90 0x7f105419e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:37.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.823+0000 7f1059800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1054078530 0x7f10541a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:37.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.823+0000 7f1059800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1054113cb0 con 0x7f1054077b90 2024-08-25T23:59:37.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.823+0000 7f1059800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1054113b30 con 0x7f1054076940 2024-08-25T23:59:37.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.823+0000 7f1059800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1054113e30 con 0x7f1054078530 2024-08-25T23:59:37.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.823+0000 7f1052000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1054077b90 0x7f105419e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:37.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.823+0000 7f1052a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1054076940 0x7f105419e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:37.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.824+0000 7f1053400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1054078530 0x7f10541a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:37.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.824+0000 7f1052000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1054077b90 0x7f105419e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37622/0 (socket says 172.21.15.42:37622) 2024-08-25T23:59:37.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.824+0000 7f1052000640 1 -- 172.21.15.42:0/4095591041 learned_addr learned my addr 172.21.15.42:0/4095591041 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:59:37.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.824+0000 7f1052a00640 1 -- 172.21.15.42:0/4095591041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1054078530 msgr2=0x7f10541a5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:37.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.824+0000 7f1052a00640 1 --2- 172.21.15.42:0/4095591041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1054078530 0x7f10541a5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:37.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.824+0000 7f1052a00640 1 -- 172.21.15.42:0/4095591041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1054077b90 msgr2=0x7f105419e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:37.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.824+0000 7f1052a00640 1 --2- 172.21.15.42:0/4095591041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1054077b90 0x7f105419e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:37.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.824+0000 7f1052a00640 1 -- 172.21.15.42:0/4095591041 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10541a5e80 con 0x7f1054076940 2024-08-25T23:59:37.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.824+0000 7f1052a00640 1 --2- 172.21.15.42:0/4095591041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1054076940 0x7f105419e250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1044005fd0 tx=0x7f104400dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:59:37.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.825+0000 7f104b400640 1 -- 172.21.15.42:0/4095591041 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1044009c30 con 0x7f1054076940 2024-08-25T23:59:37.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.825+0000 7f1059800640 1 -- 172.21.15.42:0/4095591041 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10541a6170 con 0x7f1054076940 2024-08-25T23:59:37.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.825+0000 7f104b400640 1 -- 172.21.15.42:0/4095591041 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1044009dd0 con 0x7f1054076940 2024-08-25T23:59:37.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.825+0000 7f104b400640 1 -- 172.21.15.42:0/4095591041 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1044010460 con 0x7f1054076940 2024-08-25T23:59:37.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.825+0000 7f1059800640 1 -- 172.21.15.42:0/4095591041 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10541a6700 con 0x7f1054076940 2024-08-25T23:59:37.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.826+0000 7f1059800640 1 -- 172.21.15.42:0/4095591041 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1054110520 con 0x7f1054076940 2024-08-25T23:59:37.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.828+0000 7f104b400640 1 -- 172.21.15.42:0/4095591041 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1044003ef0 con 0x7f1054076940 2024-08-25T23:59:37.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.829+0000 7f104b400640 1 --2- 172.21.15.42:0/4095591041 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f10380a2c30 0x7f10380a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:37.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.829+0000 7f104b400640 1 -- 172.21.15.42:0/4095591041 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f10440ce6f0 con 0x7f1054076940 2024-08-25T23:59:37.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.829+0000 7f1052000640 1 --2- 172.21.15.42:0/4095591041 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f10380a2c30 0x7f10380a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:37.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.830+0000 7f1052000640 1 --2- 172.21.15.42:0/4095591041 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f10380a2c30 0x7f10380a50f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f105419f770 tx=0x7f1040005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:59:37.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:37.834+0000 7f104b400640 1 -- 172.21.15.42:0/4095591041 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f1044017020 con 0x7f1054076940 2024-08-25T23:59:38.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:38.022+0000 7f1059800640 1 -- 172.21.15.42:0/4095591041 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f1054062b90 con 0x7f1054076940 2024-08-25T23:59:38.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:38.023+0000 7f104b400640 1 -- 172.21.15.42:0/4095591041 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f104409b400 con 0x7f1054076940 2024-08-25T23:59:38.025 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:59:38.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:38.025+0000 7f1059800640 1 -- 172.21.15.42:0/4095591041 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f10380a2c30 msgr2=0x7f10380a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:38.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:38.025+0000 7f1059800640 1 --2- 172.21.15.42:0/4095591041 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f10380a2c30 0x7f10380a50f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f105419f770 tx=0x7f1040005f90 comp rx=0 tx=0).stop 2024-08-25T23:59:38.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:38.025+0000 7f1059800640 1 -- 172.21.15.42:0/4095591041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1054076940 msgr2=0x7f105419e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:38.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:38.025+0000 7f1059800640 1 --2- 172.21.15.42:0/4095591041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1054076940 0x7f105419e250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1044005fd0 tx=0x7f104400dde0 comp rx=0 tx=0).stop 2024-08-25T23:59:38.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:38.025+0000 7f1059800640 1 -- 172.21.15.42:0/4095591041 shutdown_connections 2024-08-25T23:59:38.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:38.025+0000 7f1059800640 1 --2- 172.21.15.42:0/4095591041 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f10380a2c30 0x7f10380a50f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:38.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:38.025+0000 7f1059800640 1 --2- 172.21.15.42:0/4095591041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1054078530 0x7f10541a5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:38.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:38.025+0000 7f1059800640 1 --2- 172.21.15.42:0/4095591041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1054077b90 0x7f105419e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:38.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:38.025+0000 7f1059800640 1 --2- 172.21.15.42:0/4095591041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1054076940 0x7f105419e250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:38.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:38.025+0000 7f1059800640 1 -- 172.21.15.42:0/4095591041 >> 172.21.15.42:0/4095591041 conn(0x7f10540ff350 msgr2=0x7f1054100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:59:38.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:38.025+0000 7f1059800640 1 -- 172.21.15.42:0/4095591041 shutdown_connections 2024-08-25T23:59:38.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:38.025+0000 7f1059800640 1 -- 172.21.15.42:0/4095591041 wait complete. 2024-08-25T23:59:38.712 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:38 smithi042 ceph-mon[17225]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:38.712 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:38 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/4095591041' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-25T23:59:38.749 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":73,"num_osds":12,"num_up_osds":12,"osd_up_since":1724630375,"num_in_osds":12,"osd_in_since":1724630352,"num_remapped_pgs":0} 2024-08-25T23:59:38.749 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd dump --format=json 2024-08-25T23:59:38.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:38 smithi043 ceph-mon[22091]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:38.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:38 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/4095591041' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-25T23:59:38.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:38 smithi181 ceph-mon[22102]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:38.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:38 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/4095591041' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-25T23:59:39.122 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:59:39.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.659+0000 7fec5ce00640 1 -- 172.21.15.42:0/1561484786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec58076de0 msgr2=0x7fec58112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:39.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.659+0000 7fec5ce00640 1 --2- 172.21.15.42:0/1561484786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec58076de0 0x7fec58112290 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fec44009900 tx=0x7fec4402a3f0 comp rx=0 tx=0).stop 2024-08-25T23:59:39.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.659+0000 7fec5ce00640 1 -- 172.21.15.42:0/1561484786 shutdown_connections 2024-08-25T23:59:39.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.659+0000 7fec5ce00640 1 --2- 172.21.15.42:0/1561484786 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec581127d0 0x7fec58114bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:39.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.659+0000 7fec5ce00640 1 --2- 172.21.15.42:0/1561484786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec58076de0 0x7fec58112290 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:39.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.659+0000 7fec5ce00640 1 --2- 172.21.15.42:0/1561484786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec580764c0 0x7fec580768a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:39.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.659+0000 7fec5ce00640 1 -- 172.21.15.42:0/1561484786 >> 172.21.15.42:0/1561484786 conn(0x7fec580ff830 msgr2=0x7fec58101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:59:39.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.659+0000 7fec5ce00640 1 -- 172.21.15.42:0/1561484786 shutdown_connections 2024-08-25T23:59:39.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.659+0000 7fec5ce00640 1 -- 172.21.15.42:0/1561484786 wait complete. 2024-08-25T23:59:39.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.660+0000 7fec5ce00640 1 Processor -- start 2024-08-25T23:59:39.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.661+0000 7fec5ce00640 1 -- start start 2024-08-25T23:59:39.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.661+0000 7fec5ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec580764c0 0x7fec581a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:39.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.661+0000 7fec5ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec58076de0 0x7fec581a4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:39.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.661+0000 7fec5ce00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec581127d0 0x7fec5819e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:39.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.661+0000 7fec5ce00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fec58118340 con 0x7fec58076de0 2024-08-25T23:59:39.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.661+0000 7fec5ce00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fec581181c0 con 0x7fec580764c0 2024-08-25T23:59:39.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.661+0000 7fec5ce00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fec581184c0 con 0x7fec581127d0 2024-08-25T23:59:39.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.661+0000 7fec55400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec58076de0 0x7fec581a4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:39.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.661+0000 7fec55e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec580764c0 0x7fec581a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:39.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.661+0000 7fec55400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec58076de0 0x7fec581a4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37652/0 (socket says 172.21.15.42:37652) 2024-08-25T23:59:39.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.661+0000 7fec56800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec581127d0 0x7fec5819e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:39.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.661+0000 7fec55400640 1 -- 172.21.15.42:0/632521076 learned_addr learned my addr 172.21.15.42:0/632521076 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:59:39.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.662+0000 7fec55e00640 1 -- 172.21.15.42:0/632521076 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec581127d0 msgr2=0x7fec5819e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:39.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.662+0000 7fec55e00640 1 --2- 172.21.15.42:0/632521076 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec581127d0 0x7fec5819e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:39.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.662+0000 7fec55e00640 1 -- 172.21.15.42:0/632521076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec58076de0 msgr2=0x7fec581a4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:39.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.662+0000 7fec55e00640 1 --2- 172.21.15.42:0/632521076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec58076de0 0x7fec581a4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:39.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.662+0000 7fec55e00640 1 -- 172.21.15.42:0/632521076 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5819eec0 con 0x7fec580764c0 2024-08-25T23:59:39.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.662+0000 7fec55e00640 1 --2- 172.21.15.42:0/632521076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec580764c0 0x7fec581a4580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fec4800e9f0 tx=0x7fec4800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:59:39.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.662+0000 7fec4ea00640 1 -- 172.21.15.42:0/632521076 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4800cd80 con 0x7fec580764c0 2024-08-25T23:59:39.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.662+0000 7fec5ce00640 1 -- 172.21.15.42:0/632521076 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec5819f1b0 con 0x7fec580764c0 2024-08-25T23:59:39.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.662+0000 7fec4ea00640 1 -- 172.21.15.42:0/632521076 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec480035f0 con 0x7fec580764c0 2024-08-25T23:59:39.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.662+0000 7fec4ea00640 1 -- 172.21.15.42:0/632521076 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec48010670 con 0x7fec580764c0 2024-08-25T23:59:39.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.662+0000 7fec5ce00640 1 -- 172.21.15.42:0/632521076 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec581ab500 con 0x7fec580764c0 2024-08-25T23:59:39.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.663+0000 7fec5ce00640 1 -- 172.21.15.42:0/632521076 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec58077c00 con 0x7fec580764c0 2024-08-25T23:59:39.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.665+0000 7fec4ea00640 1 -- 172.21.15.42:0/632521076 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fec480037a0 con 0x7fec580764c0 2024-08-25T23:59:39.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.667+0000 7fec4ea00640 1 --2- 172.21.15.42:0/632521076 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fec3c0a2c00 0x7fec3c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:39.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.667+0000 7fec4ea00640 1 -- 172.21.15.42:0/632521076 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fec480cef50 con 0x7fec580764c0 2024-08-25T23:59:39.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.667+0000 7fec55400640 1 --2- 172.21.15.42:0/632521076 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fec3c0a2c00 0x7fec3c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:39.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.668+0000 7fec55400640 1 --2- 172.21.15.42:0/632521076 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fec3c0a2c00 0x7fec3c0a50c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fec44031550 tx=0x7fec44005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:59:39.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.669+0000 7fec4ea00640 1 -- 172.21.15.42:0/632521076 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fec4809c340 con 0x7fec580764c0 2024-08-25T23:59:39.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.855+0000 7fec5ce00640 1 -- 172.21.15.42:0/632521076 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec5810d960 con 0x7fec580764c0 2024-08-25T23:59:39.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.857+0000 7fec4ea00640 1 -- 172.21.15.42:0/632521076 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+18384 (secure 0 0 0) 0x7fec4809bc40 con 0x7fec580764c0 2024-08-25T23:59:39.858 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:59:39.859 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":73,"fsid":"f89d317a-633c-11ef-bcd2-c7b262605968","created":"2024-08-25T23:52:39.598509+0000","modified":"2024-08-25T23:59:36.049137+0000","last_up_change":"2024-08-25T23:59:35.047575+0000","last_in_change":"2024-08-25T23:59:12.796940+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-25T23:55:51.022219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"980d8635-bca1-4c5a-b78e-4b44f9315d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6803","nonce":2657450248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6805","nonce":2657450248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6809","nonce":2657450248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6807","nonce":2657450248}]},"public_addr":"172.21.15.42:6803/2657450248","cluster_addr":"172.21.15.42:6805/2657450248","heartbeat_back_addr":"172.21.15.42:6809/2657450248","heartbeat_front_addr":"172.21.15.42:6807/2657450248","state":["exists","up"]},{"osd":1,"uuid":"e5f8dc3b-876a-4bdd-b6b0-b0d99d098d95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6801","nonce":2396081001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6803","nonce":2396081001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6807","nonce":2396081001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6805","nonce":2396081001}]},"public_addr":"172.21.15.43:6801/2396081001","cluster_addr":"172.21.15.43:6803/2396081001","heartbeat_back_addr":"172.21.15.43:6807/2396081001","heartbeat_front_addr":"172.21.15.43:6805/2396081001","state":["exists","up"]},{"osd":2,"uuid":"06eb25af-8e3d-4f90-bc24-28a9bc224c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6801","nonce":189987070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6803","nonce":189987070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6807","nonce":189987070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6805","nonce":189987070}]},"public_addr":"172.21.15.181:6801/189987070","cluster_addr":"172.21.15.181:6803/189987070","heartbeat_back_addr":"172.21.15.181:6807/189987070","heartbeat_front_addr":"172.21.15.181:6805/189987070","state":["exists","up"]},{"osd":3,"uuid":"c78dbc49-b5c7-4f82-be36-c76a89496520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6811","nonce":251017896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6813","nonce":251017896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6817","nonce":251017896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6815","nonce":251017896}]},"public_addr":"172.21.15.42:6811/251017896","cluster_addr":"172.21.15.42:6813/251017896","heartbeat_back_addr":"172.21.15.42:6817/251017896","heartbeat_front_addr":"172.21.15.42:6815/251017896","state":["exists","up"]},{"osd":4,"uuid":"ba633f66-25af-492f-bbf2-76032a4cd3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6809","nonce":1315420796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6811","nonce":1315420796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6815","nonce":1315420796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6813","nonce":1315420796}]},"public_addr":"172.21.15.43:6809/1315420796","cluster_addr":"172.21.15.43:6811/1315420796","heartbeat_back_addr":"172.21.15.43:6815/1315420796","heartbeat_front_addr":"172.21.15.43:6813/1315420796","state":["exists","up"]},{"osd":5,"uuid":"04e47ad9-21ba-43da-9793-d5cf83150dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6809","nonce":246971403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6811","nonce":246971403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6815","nonce":246971403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6813","nonce":246971403}]},"public_addr":"172.21.15.181:6809/246971403","cluster_addr":"172.21.15.181:6811/246971403","heartbeat_back_addr":"172.21.15.181:6815/246971403","heartbeat_front_addr":"172.21.15.181:6813/246971403","state":["exists","up"]},{"osd":6,"uuid":"f48161cd-bc44-4d99-8248-1bb845111129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6819","nonce":2910656480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6821","nonce":2910656480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6825","nonce":2910656480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6823","nonce":2910656480}]},"public_addr":"172.21.15.42:6819/2910656480","cluster_addr":"172.21.15.42:6821/2910656480","heartbeat_back_addr":"172.21.15.42:6825/2910656480","heartbeat_front_addr":"172.21.15.42:6823/2910656480","state":["exists","up"]},{"osd":7,"uuid":"65470b06-b14d-4d8e-9bcb-e6927c37fda5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6817","nonce":624542778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6819","nonce":624542778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6823","nonce":624542778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6821","nonce":624542778}]},"public_addr":"172.21.15.43:6817/624542778","cluster_addr":"172.21.15.43:6819/624542778","heartbeat_back_addr":"172.21.15.43:6823/624542778","heartbeat_front_addr":"172.21.15.43:6821/624542778","state":["exists","up"]},{"osd":8,"uuid":"1f4c9152-4b7c-415f-9cb9-d1e926fad5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6817","nonce":728226568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6819","nonce":728226568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6823","nonce":728226568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6821","nonce":728226568}]},"public_addr":"172.21.15.181:6817/728226568","cluster_addr":"172.21.15.181:6819/728226568","heartbeat_back_addr":"172.21.15.181:6823/728226568","heartbeat_front_addr":"172.21.15.181:6821/728226568","state":["exists","up"]},{"osd":9,"uuid":"fb387fbe-19b4-4a3e-8e40-81bd1363b55c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6827","nonce":1052069444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6829","nonce":1052069444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6833","nonce":1052069444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6831","nonce":1052069444}]},"public_addr":"172.21.15.42:6827/1052069444","cluster_addr":"172.21.15.42:6829/1052069444","heartbeat_back_addr":"172.21.15.42:6833/1052069444","heartbeat_front_addr":"172.21.15.42:6831/1052069444","state":["exists","up"]},{"osd":10,"uuid":"fe5bbeec-2341-4ea9-97ab-cc45d738d741","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6825","nonce":3417487386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6827","nonce":3417487386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6831","nonce":3417487386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6829","nonce":3417487386}]},"public_addr":"172.21.15.43:6825/3417487386","cluster_addr":"172.21.15.43:6827/3417487386","heartbeat_back_addr":"172.21.15.43:6831/3417487386","heartbeat_front_addr":"172.21.15.43:6829/3417487386","state":["exists","up"]},{"osd":11,"uuid":"cee07741-3ab7-481e-8477-54319f4f178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6825","nonce":3817502913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6827","nonce":3817502913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6831","nonce":3817502913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6829","nonce":3817502913}]},"public_addr":"172.21.15.181:6825/3817502913","cluster_addr":"172.21.15.181:6827/3817502913","heartbeat_back_addr":"172.21.15.181:6831/3817502913","heartbeat_front_addr":"172.21.15.181:6829/3817502913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:00.603592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:24.637326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:47.587859+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:14.978783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:39.025819+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:01.965471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:29.753475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:54.162377+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:17.970871+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:46.175576+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:10.590220+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:33.216701+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/3711239085":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6801/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2983166615":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/2974122891":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2980210051":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/4227793902":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6801/1517739376":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6800/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/1775009918":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6800/1517739376":"2024-08-26T23:53:05.122858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-25T23:59:39.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.859+0000 7fec5ce00640 1 -- 172.21.15.42:0/632521076 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fec3c0a2c00 msgr2=0x7fec3c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:39.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.859+0000 7fec5ce00640 1 --2- 172.21.15.42:0/632521076 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fec3c0a2c00 0x7fec3c0a50c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fec44031550 tx=0x7fec44005a20 comp rx=0 tx=0).stop 2024-08-25T23:59:39.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.859+0000 7fec5ce00640 1 -- 172.21.15.42:0/632521076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec580764c0 msgr2=0x7fec581a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:39.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.859+0000 7fec5ce00640 1 --2- 172.21.15.42:0/632521076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec580764c0 0x7fec581a4580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fec4800e9f0 tx=0x7fec4800eeb0 comp rx=0 tx=0).stop 2024-08-25T23:59:39.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.859+0000 7fec5ce00640 1 -- 172.21.15.42:0/632521076 shutdown_connections 2024-08-25T23:59:39.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.859+0000 7fec5ce00640 1 --2- 172.21.15.42:0/632521076 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fec3c0a2c00 0x7fec3c0a50c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:39.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.859+0000 7fec5ce00640 1 --2- 172.21.15.42:0/632521076 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fec581127d0 0x7fec5819e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:39.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.859+0000 7fec5ce00640 1 --2- 172.21.15.42:0/632521076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec58076de0 0x7fec581a4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:39.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.859+0000 7fec5ce00640 1 --2- 172.21.15.42:0/632521076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec580764c0 0x7fec581a4580 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:39.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.859+0000 7fec5ce00640 1 -- 172.21.15.42:0/632521076 >> 172.21.15.42:0/632521076 conn(0x7fec580ff830 msgr2=0x7fec58101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:59:39.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.860+0000 7fec5ce00640 1 -- 172.21.15.42:0/632521076 shutdown_connections 2024-08-25T23:59:39.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:39.860+0000 7fec5ce00640 1 -- 172.21.15.42:0/632521076 wait complete. 2024-08-25T23:59:40.511 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:40 smithi042 ceph-mon[17225]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:40.511 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:40 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/632521076' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-25T23:59:40.552 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-25T23:55:51.022219+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-25T23:59:40.552 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-08-25T23:59:40.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:40 smithi043 ceph-mon[22091]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:40.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:40 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/632521076' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-25T23:59:40.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:40 smithi181 ceph-mon[22102]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:40.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:40 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/632521076' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-25T23:59:40.923 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:59:41.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.438+0000 7f00ba200640 1 -- 172.21.15.42:0/4166104514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00b4109c00 msgr2=0x7f00b4109fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:41.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.438+0000 7f00ba200640 1 --2- 172.21.15.42:0/4166104514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00b4109c00 0x7f00b4109fe0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f00a4009900 tx=0x7f00a402a410 comp rx=0 tx=0).stop 2024-08-25T23:59:41.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.438+0000 7f00ba200640 1 -- 172.21.15.42:0/4166104514 shutdown_connections 2024-08-25T23:59:41.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.438+0000 7f00ba200640 1 --2- 172.21.15.42:0/4166104514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00b41044f0 0x7f00b41109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:41.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.438+0000 7f00ba200640 1 --2- 172.21.15.42:0/4166104514 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00b4103b50 0x7f00b4103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:41.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.438+0000 7f00ba200640 1 --2- 172.21.15.42:0/4166104514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00b4109c00 0x7f00b4109fe0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:41.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.438+0000 7f00ba200640 1 -- 172.21.15.42:0/4166104514 >> 172.21.15.42:0/4166104514 conn(0x7f00b40ff830 msgr2=0x7f00b4101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:59:41.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.438+0000 7f00ba200640 1 -- 172.21.15.42:0/4166104514 shutdown_connections 2024-08-25T23:59:41.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.438+0000 7f00ba200640 1 -- 172.21.15.42:0/4166104514 wait complete. 2024-08-25T23:59:41.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.439+0000 7f00ba200640 1 Processor -- start 2024-08-25T23:59:41.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.439+0000 7f00ba200640 1 -- start start 2024-08-25T23:59:41.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.439+0000 7f00ba200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00b4103b50 0x7f00b419a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:41.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.439+0000 7f00ba200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00b41044f0 0x7f00b419a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:41.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.440+0000 7f00ba200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00b4109c00 0x7f00b419eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:41.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.440+0000 7f00ba200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4113f70 con 0x7f00b4109c00 2024-08-25T23:59:41.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.440+0000 7f00ba200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4113df0 con 0x7f00b4103b50 2024-08-25T23:59:41.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.440+0000 7f00ba200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f00b41140f0 con 0x7f00b41044f0 2024-08-25T23:59:41.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.440+0000 7f00b3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00b4109c00 0x7f00b419eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:41.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.440+0000 7f00b3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00b4109c00 0x7f00b419eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37676/0 (socket says 172.21.15.42:37676) 2024-08-25T23:59:41.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.440+0000 7f00b3e00640 1 -- 172.21.15.42:0/92554610 learned_addr learned my addr 172.21.15.42:0/92554610 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:59:41.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.440+0000 7f00b3400640 1 --2- 172.21.15.42:0/92554610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00b4103b50 0x7f00b419a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:41.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.440+0000 7f00aaa00640 1 --2- 172.21.15.42:0/92554610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00b41044f0 0x7f00b419a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:41.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.440+0000 7f00b3e00640 1 -- 172.21.15.42:0/92554610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00b41044f0 msgr2=0x7f00b419a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:41.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.440+0000 7f00b3e00640 1 --2- 172.21.15.42:0/92554610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00b41044f0 0x7f00b419a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:41.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.440+0000 7f00b3e00640 1 -- 172.21.15.42:0/92554610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00b4103b50 msgr2=0x7f00b419a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:41.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.440+0000 7f00b3e00640 1 --2- 172.21.15.42:0/92554610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00b4103b50 0x7f00b419a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:41.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.440+0000 7f00b3e00640 1 -- 172.21.15.42:0/92554610 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b419f280 con 0x7f00b4109c00 2024-08-25T23:59:41.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.440+0000 7f00aaa00640 1 --2- 172.21.15.42:0/92554610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00b41044f0 0x7f00b419a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-25T23:59:41.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.440+0000 7f00b3400640 1 --2- 172.21.15.42:0/92554610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00b4103b50 0x7f00b419a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-25T23:59:41.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.441+0000 7f00b3e00640 1 --2- 172.21.15.42:0/92554610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00b4109c00 0x7f00b419eba0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00eb10 tx=0x7f00ac00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:59:41.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.441+0000 7f00b0c00640 1 -- 172.21.15.42:0/92554610 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac004b20 con 0x7f00b4109c00 2024-08-25T23:59:41.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.441+0000 7f00b0c00640 1 -- 172.21.15.42:0/92554610 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00ac004cc0 con 0x7f00b4109c00 2024-08-25T23:59:41.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.441+0000 7f00ba200640 1 -- 172.21.15.42:0/92554610 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b419f570 con 0x7f00b4109c00 2024-08-25T23:59:41.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.441+0000 7f00b0c00640 1 -- 172.21.15.42:0/92554610 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac010760 con 0x7f00b4109c00 2024-08-25T23:59:41.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.441+0000 7f00ba200640 1 -- 172.21.15.42:0/92554610 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b41a6e50 con 0x7f00b4109c00 2024-08-25T23:59:41.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.442+0000 7f00ba200640 1 -- 172.21.15.42:0/92554610 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00b4103fb0 con 0x7f00b4109c00 2024-08-25T23:59:41.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.444+0000 7f00b0c00640 1 -- 172.21.15.42:0/92554610 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f00ac005020 con 0x7f00b4109c00 2024-08-25T23:59:41.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.446+0000 7f00b0c00640 1 --2- 172.21.15.42:0/92554610 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f00980a2c00 0x7f00980a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:41.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.446+0000 7f00b0c00640 1 -- 172.21.15.42:0/92554610 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f00ac0cf220 con 0x7f00b4109c00 2024-08-25T23:59:41.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.446+0000 7f00b3400640 1 --2- 172.21.15.42:0/92554610 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f00980a2c00 0x7f00980a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:41.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.447+0000 7f00b3400640 1 --2- 172.21.15.42:0/92554610 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f00980a2c00 0x7f00980a50c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f00a4000c00 tx=0x7f00a4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:59:41.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.450+0000 7f00b0c00640 1 -- 172.21.15.42:0/92554610 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f00ac09c580 con 0x7f00b4109c00 2024-08-25T23:59:41.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.637+0000 7f00ba200640 1 -- 172.21.15.42:0/92554610 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f00b41a7130 con 0x7f00b4109c00 2024-08-25T23:59:41.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.637+0000 7f00b0c00640 1 -- 172.21.15.42:0/92554610 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7f00ac09be80 con 0x7f00b4109c00 2024-08-25T23:59:41.639 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-08-25T23:59:41.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.639+0000 7f00ba200640 1 -- 172.21.15.42:0/92554610 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f00980a2c00 msgr2=0x7f00980a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:41.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.639+0000 7f00ba200640 1 --2- 172.21.15.42:0/92554610 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f00980a2c00 0x7f00980a50c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f00a4000c00 tx=0x7f00a4005b50 comp rx=0 tx=0).stop 2024-08-25T23:59:41.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.639+0000 7f00ba200640 1 -- 172.21.15.42:0/92554610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00b4109c00 msgr2=0x7f00b419eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:41.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.639+0000 7f00ba200640 1 --2- 172.21.15.42:0/92554610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00b4109c00 0x7f00b419eba0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00eb10 tx=0x7f00ac00c2d0 comp rx=0 tx=0).stop 2024-08-25T23:59:41.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.639+0000 7f00ba200640 1 -- 172.21.15.42:0/92554610 shutdown_connections 2024-08-25T23:59:41.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.640+0000 7f00ba200640 1 --2- 172.21.15.42:0/92554610 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f00980a2c00 0x7f00980a50c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:41.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.640+0000 7f00ba200640 1 --2- 172.21.15.42:0/92554610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00b4109c00 0x7f00b419eba0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:41.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.640+0000 7f00ba200640 1 --2- 172.21.15.42:0/92554610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00b41044f0 0x7f00b419a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:41.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.640+0000 7f00ba200640 1 --2- 172.21.15.42:0/92554610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00b4103b50 0x7f00b419a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:41.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.640+0000 7f00ba200640 1 -- 172.21.15.42:0/92554610 >> 172.21.15.42:0/92554610 conn(0x7f00b40ff830 msgr2=0x7f00b4100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:59:41.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.640+0000 7f00ba200640 1 -- 172.21.15.42:0/92554610 shutdown_connections 2024-08-25T23:59:41.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:41.640+0000 7f00ba200640 1 -- 172.21.15.42:0/92554610 wait complete. 2024-08-25T23:59:42.439 INFO:tasks.cephadm:Adding mds.a on smithi042 2024-08-25T23:59:42.439 INFO:tasks.cephadm:Adding mds.d on smithi042 2024-08-25T23:59:42.439 INFO:tasks.cephadm:Adding mds.g on smithi042 2024-08-25T23:59:42.439 INFO:tasks.cephadm:Adding mds.j on smithi042 2024-08-25T23:59:42.439 INFO:tasks.cephadm:Adding mds.b on smithi043 2024-08-25T23:59:42.439 INFO:tasks.cephadm:Adding mds.e on smithi043 2024-08-25T23:59:42.439 INFO:tasks.cephadm:Adding mds.h on smithi043 2024-08-25T23:59:42.439 INFO:tasks.cephadm:Adding mds.k on smithi043 2024-08-25T23:59:42.440 INFO:tasks.cephadm:Adding mds.c on smithi181 2024-08-25T23:59:42.440 INFO:tasks.cephadm:Adding mds.f on smithi181 2024-08-25T23:59:42.440 INFO:tasks.cephadm:Adding mds.i on smithi181 2024-08-25T23:59:42.440 INFO:tasks.cephadm:Adding mds.l on smithi181 2024-08-25T23:59:42.440 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph orch apply mds all '12;smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi043=b;smithi043=e;smithi043=h;smithi043=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l' 2024-08-25T23:59:42.698 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.c/config 2024-08-25T23:59:42.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:42 smithi043 ceph-mon[22091]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:42.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:42 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/92554610' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-25T23:59:42.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:42 smithi042 ceph-mon[17225]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:42.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:42 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/92554610' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-25T23:59:42.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:42 smithi181 ceph-mon[22102]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:42.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:42 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/92554610' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-25T23:59:43.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.100+0000 7f72b816e640 1 -- 172.21.15.181:0/428803378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72b01019a0 msgr2=0x7f72b0101da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:43.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.100+0000 7f72b816e640 1 --2- 172.21.15.181:0/428803378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72b01019a0 0x7f72b0101da0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f72ac009900 tx=0x7f72ac02a410 comp rx=0 tx=0).stop 2024-08-25T23:59:43.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.100+0000 7f72b816e640 1 -- 172.21.15.181:0/428803378 shutdown_connections 2024-08-25T23:59:43.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.100+0000 7f72b816e640 1 --2- 172.21.15.181:0/428803378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72b0103560 0x7f72b0109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:43.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.100+0000 7f72b816e640 1 --2- 172.21.15.181:0/428803378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72b0102ba0 0x7f72b0103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.100+0000 7f72b816e640 1 --2- 172.21.15.181:0/428803378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72b01019a0 0x7f72b0101da0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.100+0000 7f72b816e640 1 -- 172.21.15.181:0/428803378 >> 172.21.15.181:0/428803378 conn(0x7f72b00fd130 msgr2=0x7f72b00ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:59:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.101+0000 7f72b816e640 1 -- 172.21.15.181:0/428803378 shutdown_connections 2024-08-25T23:59:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.101+0000 7f72b816e640 1 -- 172.21.15.181:0/428803378 wait complete. 2024-08-25T23:59:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.101+0000 7f72b816e640 1 Processor -- start 2024-08-25T23:59:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.101+0000 7f72b816e640 1 -- start start 2024-08-25T23:59:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.101+0000 7f72b816e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72b01019a0 0x7f72b0197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.101+0000 7f72b816e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72b0102ba0 0x7f72b0198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.101+0000 7f72b816e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72b0103560 0x7f72b019f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.101+0000 7f72b816e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f72b010d600 con 0x7f72b01019a0 2024-08-25T23:59:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.101+0000 7f72b816e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f72b010d480 con 0x7f72b0102ba0 2024-08-25T23:59:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.101+0000 7f72b816e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f72b010d780 con 0x7f72b0103560 2024-08-25T23:59:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.102+0000 7f72b670b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72b0103560 0x7f72b019f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.102+0000 7f72b670b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72b0103560 0x7f72b019f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:57642/0 (socket says 172.21.15.181:57642) 2024-08-25T23:59:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.102+0000 7f72b5709640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72b0102ba0 0x7f72b0198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.102+0000 7f72b670b640 1 -- 172.21.15.181:0/698345913 learned_addr learned my addr 172.21.15.181:0/698345913 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-08-25T23:59:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.102+0000 7f72b5f0a640 1 --2- 172.21.15.181:0/698345913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72b01019a0 0x7f72b0197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.102+0000 7f72b670b640 1 -- 172.21.15.181:0/698345913 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72b0102ba0 msgr2=0x7f72b0198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.102+0000 7f72b670b640 1 --2- 172.21.15.181:0/698345913 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72b0102ba0 0x7f72b0198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.102+0000 7f72b670b640 1 -- 172.21.15.181:0/698345913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72b01019a0 msgr2=0x7f72b0197ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.102+0000 7f72b670b640 1 --2- 172.21.15.181:0/698345913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72b01019a0 0x7f72b0197ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.102+0000 7f72b670b640 1 -- 172.21.15.181:0/698345913 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b019f900 con 0x7f72b0103560 2024-08-25T23:59:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.102+0000 7f72b670b640 1 --2- 172.21.15.181:0/698345913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72b0103560 0x7f72b019f260 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009fd0 tx=0x7f72a800b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:59:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.102+0000 7f72a6ffd640 1 -- 172.21.15.181:0/698345913 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a8017070 con 0x7f72b0103560 2024-08-25T23:59:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.102+0000 7f72b816e640 1 -- 172.21.15.181:0/698345913 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b019fbf0 con 0x7f72b0103560 2024-08-25T23:59:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.102+0000 7f72a6ffd640 1 -- 172.21.15.181:0/698345913 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72a8003e50 con 0x7f72b0103560 2024-08-25T23:59:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.103+0000 7f72a6ffd640 1 -- 172.21.15.181:0/698345913 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a80106c0 con 0x7f72b0103560 2024-08-25T23:59:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.103+0000 7f72b816e640 1 -- 172.21.15.181:0/698345913 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b01a0130 con 0x7f72b0103560 2024-08-25T23:59:43.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.104+0000 7f72b816e640 1 -- 172.21.15.181:0/698345913 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b0108df0 con 0x7f72b0103560 2024-08-25T23:59:43.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.105+0000 7f72a6ffd640 1 -- 172.21.15.181:0/698345913 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f72a8003970 con 0x7f72b0103560 2024-08-25T23:59:43.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.106+0000 7f72a6ffd640 1 --2- 172.21.15.181:0/698345913 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f729c0a2c00 0x7f729c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:43.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.106+0000 7f72a6ffd640 1 -- 172.21.15.181:0/698345913 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f72a80ce970 con 0x7f72b0103560 2024-08-25T23:59:43.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.106+0000 7f72b5f0a640 1 --2- 172.21.15.181:0/698345913 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f729c0a2c00 0x7f729c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:43.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.107+0000 7f72b5f0a640 1 --2- 172.21.15.181:0/698345913 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f729c0a2c00 0x7f729c0a50c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f72ac0314e0 tx=0x7f72ac000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:59:43.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.110+0000 7f72a6ffd640 1 -- 172.21.15.181:0/698345913 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f72a809bcd0 con 0x7f72b0103560 2024-08-25T23:59:43.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.289+0000 7f72b816e640 1 -- 172.21.15.181:0/698345913 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi043=b;smithi043=e;smithi043=h;smithi043=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}) -- 0x7f72b0062690 con 0x7f729c0a2c00 2024-08-25T23:59:43.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.297+0000 7f72a6ffd640 1 -- 172.21.15.181:0/698345913 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f72b0062690 con 0x7f729c0a2c00 2024-08-25T23:59:43.299 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled mds.all update... 2024-08-25T23:59:43.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.300+0000 7f72b816e640 1 -- 172.21.15.181:0/698345913 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f729c0a2c00 msgr2=0x7f729c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:43.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.300+0000 7f72b816e640 1 --2- 172.21.15.181:0/698345913 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f729c0a2c00 0x7f729c0a50c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f72ac0314e0 tx=0x7f72ac000bc0 comp rx=0 tx=0).stop 2024-08-25T23:59:43.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.300+0000 7f72b816e640 1 -- 172.21.15.181:0/698345913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72b0103560 msgr2=0x7f72b019f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:43.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.300+0000 7f72b816e640 1 --2- 172.21.15.181:0/698345913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72b0103560 0x7f72b019f260 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009fd0 tx=0x7f72a800b260 comp rx=0 tx=0).stop 2024-08-25T23:59:43.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.300+0000 7f72b816e640 1 -- 172.21.15.181:0/698345913 shutdown_connections 2024-08-25T23:59:43.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.300+0000 7f72b816e640 1 --2- 172.21.15.181:0/698345913 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f729c0a2c00 0x7f729c0a50c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:43.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.300+0000 7f72b816e640 1 --2- 172.21.15.181:0/698345913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f72b0103560 0x7f72b019f260 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:43.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.300+0000 7f72b816e640 1 --2- 172.21.15.181:0/698345913 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72b0102ba0 0x7f72b0198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:43.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.300+0000 7f72b816e640 1 --2- 172.21.15.181:0/698345913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72b01019a0 0x7f72b0197ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:43.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.300+0000 7f72b816e640 1 -- 172.21.15.181:0/698345913 >> 172.21.15.181:0/698345913 conn(0x7f72b00fd130 msgr2=0x7f72b0105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:59:43.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.300+0000 7f72b816e640 1 -- 172.21.15.181:0/698345913 shutdown_connections 2024-08-25T23:59:43.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-25T23:59:43.300+0000 7f72b816e640 1 -- 172.21.15.181:0/698345913 wait complete. 2024-08-25T23:59:43.965 DEBUG:teuthology.orchestra.run.smithi042:mds.a> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.a.service 2024-08-25T23:59:43.969 DEBUG:teuthology.orchestra.run.smithi042:mds.d> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.d.service 2024-08-25T23:59:44.014 DEBUG:teuthology.orchestra.run.smithi042:mds.g> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.g.service 2024-08-25T23:59:44.059 DEBUG:teuthology.orchestra.run.smithi042:mds.j> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.j.service 2024-08-25T23:59:44.104 DEBUG:teuthology.orchestra.run.smithi043:mds.b> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.b.service 2024-08-25T23:59:44.107 DEBUG:teuthology.orchestra.run.smithi043:mds.e> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.e.service 2024-08-25T23:59:44.150 DEBUG:teuthology.orchestra.run.smithi043:mds.h> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.h.service 2024-08-25T23:59:44.193 DEBUG:teuthology.orchestra.run.smithi043:mds.k> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.k.service 2024-08-25T23:59:44.236 DEBUG:teuthology.orchestra.run.smithi181:mds.c> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.c.service 2024-08-25T23:59:44.238 DEBUG:teuthology.orchestra.run.smithi181:mds.f> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.f.service 2024-08-25T23:59:44.281 DEBUG:teuthology.orchestra.run.smithi181:mds.i> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.i.service 2024-08-25T23:59:44.324 DEBUG:teuthology.orchestra.run.smithi181:mds.l> sudo journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.l.service 2024-08-25T23:59:44.367 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-08-25T23:59:44.367 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-25T23:59:44.386 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:44 smithi181 ceph-mon[22102]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:44.386 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:44 smithi181 ceph-mon[22102]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi043=b;smithi043=e;smithi043=h;smithi043=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:59:44.386 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:44 smithi181 ceph-mon[22102]: Saving service mds.all spec with placement smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi043=b;smithi043=e;smithi043=h;smithi043=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-08-25T23:59:44.386 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:44 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:44.386 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:44 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:59:44.386 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:44 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:44.387 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:44 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:59:44.387 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:44 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:44.387 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:44 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-25T23:59:44.387 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:44 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-25T23:59:44.387 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:44 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:44.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:44 smithi043 ceph-mon[22091]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:44.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:44 smithi043 ceph-mon[22091]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi043=b;smithi043=e;smithi043=h;smithi043=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:59:44.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:44 smithi043 ceph-mon[22091]: Saving service mds.all spec with placement smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi043=b;smithi043=e;smithi043=h;smithi043=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-08-25T23:59:44.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:44 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:44.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:44 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:59:44.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:44 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:44.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:44 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:59:44.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:44 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:44.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:44 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-25T23:59:44.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:44 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-25T23:59:44.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:44 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:44.635 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:44 smithi042 ceph-mon[17225]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:44.636 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:44 smithi042 ceph-mon[17225]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi043=b;smithi043=e;smithi043=h;smithi043=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-25T23:59:44.636 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:44 smithi042 ceph-mon[17225]: Saving service mds.all spec with placement smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi043=b;smithi043=e;smithi043=h;smithi043=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-08-25T23:59:44.636 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:44 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:44.636 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:44 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-25T23:59:44.636 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:44 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:44.636 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:44 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-25T23:59:44.636 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:44 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:44.636 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:44 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-25T23:59:44.636 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:44 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-25T23:59:44.636 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:44 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:44.750 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:59:45.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.281+0000 7ff33de00640 1 -- 172.21.15.42:0/2285789702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3380743c0 msgr2=0x7ff3380747a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:45.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.281+0000 7ff33de00640 1 --2- 172.21.15.42:0/2285789702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3380743c0 0x7ff3380747a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff328009900 tx=0x7ff32802a480 comp rx=0 tx=0).stop 2024-08-25T23:59:45.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.281+0000 7ff33de00640 1 -- 172.21.15.42:0/2285789702 shutdown_connections 2024-08-25T23:59:45.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.281+0000 7ff33de00640 1 --2- 172.21.15.42:0/2285789702 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff33810e160 0x7ff3381105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:45.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.281+0000 7ff33de00640 1 --2- 172.21.15.42:0/2285789702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff338074ce0 0x7ff33810dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:45.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.281+0000 7ff33de00640 1 --2- 172.21.15.42:0/2285789702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3380743c0 0x7ff3380747a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:45.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.281+0000 7ff33de00640 1 -- 172.21.15.42:0/2285789702 >> 172.21.15.42:0/2285789702 conn(0x7ff3380fd660 msgr2=0x7ff3380ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:59:45.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.282+0000 7ff33de00640 1 -- 172.21.15.42:0/2285789702 shutdown_connections 2024-08-25T23:59:45.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.282+0000 7ff33de00640 1 -- 172.21.15.42:0/2285789702 wait complete. 2024-08-25T23:59:45.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.283+0000 7ff33de00640 1 Processor -- start 2024-08-25T23:59:45.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.283+0000 7ff33de00640 1 -- start start 2024-08-25T23:59:45.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.283+0000 7ff33de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3380743c0 0x7ff33819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:45.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.283+0000 7ff33de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff338074ce0 0x7ff33819a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:45.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.283+0000 7ff33de00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff33810e160 0x7ff33819ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:45.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.283+0000 7ff33de00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff338113f60 con 0x7ff338074ce0 2024-08-25T23:59:45.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.283+0000 7ff33de00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff338113de0 con 0x7ff3380743c0 2024-08-25T23:59:45.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.283+0000 7ff33de00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff3381140e0 con 0x7ff33810e160 2024-08-25T23:59:45.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.283+0000 7ff336a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3380743c0 0x7ff33819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:45.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.283+0000 7ff32fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff338074ce0 0x7ff33819a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:45.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.283+0000 7ff336a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3380743c0 0x7ff33819a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45068/0 (socket says 172.21.15.42:45068) 2024-08-25T23:59:45.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.283+0000 7ff336a00640 1 -- 172.21.15.42:0/2014641268 learned_addr learned my addr 172.21.15.42:0/2014641268 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:59:45.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.283+0000 7ff337400640 1 --2- 172.21.15.42:0/2014641268 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff33810e160 0x7ff33819ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:45.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.284+0000 7ff336a00640 1 -- 172.21.15.42:0/2014641268 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff33810e160 msgr2=0x7ff33819ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:45.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.284+0000 7ff336a00640 1 --2- 172.21.15.42:0/2014641268 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff33810e160 0x7ff33819ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:45.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.284+0000 7ff336a00640 1 -- 172.21.15.42:0/2014641268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff338074ce0 msgr2=0x7ff33819a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:45.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.284+0000 7ff336a00640 1 --2- 172.21.15.42:0/2014641268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff338074ce0 0x7ff33819a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:45.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.284+0000 7ff336a00640 1 -- 172.21.15.42:0/2014641268 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33819f3c0 con 0x7ff3380743c0 2024-08-25T23:59:45.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.284+0000 7ff336a00640 1 --2- 172.21.15.42:0/2014641268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3380743c0 0x7ff33819a410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff328004770 tx=0x7ff328003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:59:45.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.284+0000 7ff33ca00640 1 -- 172.21.15.42:0/2014641268 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32803f070 con 0x7ff3380743c0 2024-08-25T23:59:45.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.284+0000 7ff33ca00640 1 -- 172.21.15.42:0/2014641268 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff328031ca0 con 0x7ff3380743c0 2024-08-25T23:59:45.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.284+0000 7ff33de00640 1 -- 172.21.15.42:0/2014641268 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff33819f650 con 0x7ff3380743c0 2024-08-25T23:59:45.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.284+0000 7ff33ca00640 1 -- 172.21.15.42:0/2014641268 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328035030 con 0x7ff3380743c0 2024-08-25T23:59:45.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.285+0000 7ff33de00640 1 -- 172.21.15.42:0/2014641268 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3381a6f90 con 0x7ff3380743c0 2024-08-25T23:59:45.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.286+0000 7ff33de00640 1 -- 172.21.15.42:0/2014641268 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff338075a70 con 0x7ff3380743c0 2024-08-25T23:59:45.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.288+0000 7ff33ca00640 1 -- 172.21.15.42:0/2014641268 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff328042070 con 0x7ff3380743c0 2024-08-25T23:59:45.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.289+0000 7ff33ca00640 1 --2- 172.21.15.42:0/2014641268 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff31c0a2c00 0x7ff31c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:45.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.290+0000 7ff33ca00640 1 -- 172.21.15.42:0/2014641268 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7ff3280ef3a0 con 0x7ff3380743c0 2024-08-25T23:59:45.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.290+0000 7ff32fe00640 1 --2- 172.21.15.42:0/2014641268 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff31c0a2c00 0x7ff31c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:45.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.290+0000 7ff32fe00640 1 --2- 172.21.15.42:0/2014641268 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff31c0a2c00 0x7ff31c0a50c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff33810f550 tx=0x7ff320005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:59:45.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.291+0000 7ff33ca00640 1 -- 172.21.15.42:0/2014641268 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff3280bc170 con 0x7ff3380743c0 2024-08-25T23:59:45.469 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:45 smithi181 ceph-mon[22102]: Deploying daemon mds.l on smithi181 2024-08-25T23:59:45.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.513+0000 7ff33de00640 1 -- 172.21.15.42:0/2014641268 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3380747a0 con 0x7ff3380743c0 2024-08-25T23:59:45.515 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:45 smithi042 ceph-mon[17225]: Deploying daemon mds.l on smithi181 2024-08-25T23:59:45.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.513+0000 7ff33ca00640 1 -- 172.21.15.42:0/2014641268 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7ff3380747a0 con 0x7ff3380743c0 2024-08-25T23:59:45.515 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:59:45.515 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":1,"btime":"2024-08-25T23:52:39:598290+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-08-25T23:59:45.516 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 1 2024-08-25T23:59:45.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.516+0000 7ff33de00640 1 -- 172.21.15.42:0/2014641268 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff31c0a2c00 msgr2=0x7ff31c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:45.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.516+0000 7ff33de00640 1 --2- 172.21.15.42:0/2014641268 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff31c0a2c00 0x7ff31c0a50c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff33810f550 tx=0x7ff320005f90 comp rx=0 tx=0).stop 2024-08-25T23:59:45.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.516+0000 7ff33de00640 1 -- 172.21.15.42:0/2014641268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3380743c0 msgr2=0x7ff33819a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.516+0000 7ff33de00640 1 --2- 172.21.15.42:0/2014641268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3380743c0 0x7ff33819a410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff328004770 tx=0x7ff328003c10 comp rx=0 tx=0).stop 2024-08-25T23:59:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.516+0000 7ff33de00640 1 -- 172.21.15.42:0/2014641268 shutdown_connections 2024-08-25T23:59:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.516+0000 7ff33de00640 1 --2- 172.21.15.42:0/2014641268 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff31c0a2c00 0x7ff31c0a50c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.516+0000 7ff33de00640 1 --2- 172.21.15.42:0/2014641268 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff33810e160 0x7ff33819ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.516+0000 7ff33de00640 1 --2- 172.21.15.42:0/2014641268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff338074ce0 0x7ff33819a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.516+0000 7ff33de00640 1 --2- 172.21.15.42:0/2014641268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3380743c0 0x7ff33819a410 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.516+0000 7ff33de00640 1 -- 172.21.15.42:0/2014641268 >> 172.21.15.42:0/2014641268 conn(0x7ff3380fd660 msgr2=0x7ff3380fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:59:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.516+0000 7ff33de00640 1 -- 172.21.15.42:0/2014641268 shutdown_connections 2024-08-25T23:59:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:45.516+0000 7ff33de00640 1 -- 172.21.15.42:0/2014641268 wait complete. 2024-08-25T23:59:45.719 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:45 smithi043 ceph-mon[22091]: Deploying daemon mds.l on smithi181 2024-08-25T23:59:45.784 INFO:journalctl@ceph.mds.l.smithi181.stdout:Aug 25 23:59:45 smithi181 podman[52068]: 2024-08-25 23:59:45.698227032 +0000 UTC m=+0.131953108 container create 6e69c707ad48dc52527fd61cfb7d3d19541f163211f8505b8b294aa4712b57ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-l, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f273685, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-08-25T23:59:46.284 INFO:journalctl@ceph.mds.l.smithi181.stdout:Aug 25 23:59:45 smithi181 podman[52068]: 2024-08-25 23:59:45.925778023 +0000 UTC m=+0.359504042 container init 6e69c707ad48dc52527fd61cfb7d3d19541f163211f8505b8b294aa4712b57ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-l, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-f273685, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.1) 2024-08-25T23:59:46.284 INFO:journalctl@ceph.mds.l.smithi181.stdout:Aug 25 23:59:45 smithi181 podman[52068]: 2024-08-25 23:59:45.928589834 +0000 UTC m=+0.362315850 container start 6e69c707ad48dc52527fd61cfb7d3d19541f163211f8505b8b294aa4712b57ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, RELEASE=squid-f273685) 2024-08-25T23:59:46.284 INFO:journalctl@ceph.mds.l.smithi181.stdout:Aug 25 23:59:45 smithi181 ceph-mds[52087]: -- 172.21.15.181:0/767042629 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556d9530d860 con 0x556d952ea800 2024-08-25T23:59:46.284 INFO:journalctl@ceph.mds.l.smithi181.stdout:Aug 25 23:59:45 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-l[52083]: starting mds.l at 2024-08-25T23:59:46.284 INFO:journalctl@ceph.mds.l.smithi181.stdout:Aug 25 23:59:46 smithi181 bash[52068]: 6e69c707ad48dc52527fd61cfb7d3d19541f163211f8505b8b294aa4712b57ac 2024-08-25T23:59:46.284 INFO:journalctl@ceph.mds.l.smithi181.stdout:Aug 25 23:59:46 smithi181 systemd[1]: Started Ceph mds.l for f89d317a-633c-11ef-bcd2-c7b262605968. 2024-08-25T23:59:46.580 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:46 smithi043 ceph-mon[22091]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:46.580 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:46 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/2014641268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-25T23:59:46.580 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:46 smithi043 ceph-mon[22091]: mds.? [v2:172.21.15.181:6832/2147486121,v1:172.21.15.181:6833/2147486121] up:boot 2024-08-25T23:59:46.580 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:46 smithi043 ceph-mon[22091]: fsmap 1 up:standby 2024-08-25T23:59:46.580 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:46 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-08-25T23:59:46.580 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:46 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:46.580 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:46 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:46.580 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:46 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:46.580 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:46 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-25T23:59:46.581 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:46 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-25T23:59:46.581 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:46 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:46.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:46 smithi042 ceph-mon[17225]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:46.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:46 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2014641268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-25T23:59:46.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:46 smithi042 ceph-mon[17225]: mds.? [v2:172.21.15.181:6832/2147486121,v1:172.21.15.181:6833/2147486121] up:boot 2024-08-25T23:59:46.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:46 smithi042 ceph-mon[17225]: fsmap 1 up:standby 2024-08-25T23:59:46.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:46 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-08-25T23:59:46.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:46 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:46.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:46 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:46.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:46 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:46.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:46 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-25T23:59:46.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:46 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-25T23:59:46.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:46 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:46.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:46 smithi181 ceph-mon[22102]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:46.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:46 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/2014641268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-25T23:59:46.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:46 smithi181 ceph-mon[22102]: mds.? [v2:172.21.15.181:6832/2147486121,v1:172.21.15.181:6833/2147486121] up:boot 2024-08-25T23:59:46.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:46 smithi181 ceph-mon[22102]: fsmap 1 up:standby 2024-08-25T23:59:46.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:46 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-08-25T23:59:46.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:46 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:46.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:46 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:46.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:46 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:46.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:46 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-25T23:59:46.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:46 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-25T23:59:46.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:46 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:47.608 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:47 smithi043 ceph-mon[22091]: Deploying daemon mds.k on smithi043 2024-08-25T23:59:47.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:47 smithi042 ceph-mon[17225]: Deploying daemon mds.k on smithi043 2024-08-25T23:59:47.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:47 smithi181 ceph-mon[22102]: Deploying daemon mds.k on smithi043 2024-08-25T23:59:47.977 INFO:journalctl@ceph.mds.k.smithi043.stdout:Aug 25 23:59:47 smithi043 systemd[1]: Starting Ceph mds.k for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-25T23:59:48.260 INFO:journalctl@ceph.mds.k.smithi043.stdout:Aug 25 23:59:48 smithi043 podman[52026]: 2024-08-25 23:59:48.09017969 +0000 UTC m=+0.015895382 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34 2024-08-25T23:59:48.260 INFO:journalctl@ceph.mds.k.smithi043.stdout:Aug 25 23:59:48 smithi043 podman[52026]: 2024-08-25 23:59:48.192718584 +0000 UTC m=+0.118434263 container create 1803b8d455ffc47d34115acd4903b8c71f7ddd9f99b7acd4b3ae28d5474ca87e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-k, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f273685, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-08-25T23:59:48.343 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-25T23:59:48.747 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:59:48.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:48 smithi043 ceph-mon[22091]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:48.760 INFO:journalctl@ceph.mds.k.smithi043.stdout:Aug 25 23:59:48 smithi043 podman[52026]: 2024-08-25 23:59:48.412094922 +0000 UTC m=+0.337810602 container init 1803b8d455ffc47d34115acd4903b8c71f7ddd9f99b7acd4b3ae28d5474ca87e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-k, RELEASE=squid-f273685, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2) 2024-08-25T23:59:48.760 INFO:journalctl@ceph.mds.k.smithi043.stdout:Aug 25 23:59:48 smithi043 podman[52026]: 2024-08-25 23:59:48.415066317 +0000 UTC m=+0.340781999 container start 1803b8d455ffc47d34115acd4903b8c71f7ddd9f99b7acd4b3ae28d5474ca87e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-k, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-f273685, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-08-25T23:59:48.760 INFO:journalctl@ceph.mds.k.smithi043.stdout:Aug 25 23:59:48 smithi043 ceph-mds[52046]: -- 172.21.15.43:0/4236618411 <== mon.2 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fc678e9860 con 0x55fc678c6800 2024-08-25T23:59:48.761 INFO:journalctl@ceph.mds.k.smithi043.stdout:Aug 25 23:59:48 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-k[52041]: starting mds.k at 2024-08-25T23:59:48.761 INFO:journalctl@ceph.mds.k.smithi043.stdout:Aug 25 23:59:48 smithi043 bash[52026]: 1803b8d455ffc47d34115acd4903b8c71f7ddd9f99b7acd4b3ae28d5474ca87e 2024-08-25T23:59:48.761 INFO:journalctl@ceph.mds.k.smithi043.stdout:Aug 25 23:59:48 smithi043 systemd[1]: Started Ceph mds.k for f89d317a-633c-11ef-bcd2-c7b262605968. 2024-08-25T23:59:48.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:48 smithi042 ceph-mon[17225]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:48.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:48 smithi181 ceph-mon[22102]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:49.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.303+0000 7f5431800640 1 -- 172.21.15.42:0/1642962995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f542c109c00 msgr2=0x7f542c109fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.303+0000 7f5431800640 1 --2- 172.21.15.42:0/1642962995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f542c109c00 0x7f542c109fe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f541c009930 tx=0x7f541c02a420 comp rx=0 tx=0).stop 2024-08-25T23:59:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.303+0000 7f5431800640 1 -- 172.21.15.42:0/1642962995 shutdown_connections 2024-08-25T23:59:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.303+0000 7f5431800640 1 --2- 172.21.15.42:0/1642962995 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f542c1044f0 0x7f542c1109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.303+0000 7f5431800640 1 --2- 172.21.15.42:0/1642962995 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f542c103b50 0x7f542c103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.303+0000 7f5431800640 1 --2- 172.21.15.42:0/1642962995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f542c109c00 0x7f542c109fe0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.303+0000 7f5431800640 1 -- 172.21.15.42:0/1642962995 >> 172.21.15.42:0/1642962995 conn(0x7f542c0ff830 msgr2=0x7f542c101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:59:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.303+0000 7f5431800640 1 -- 172.21.15.42:0/1642962995 shutdown_connections 2024-08-25T23:59:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.303+0000 7f5431800640 1 -- 172.21.15.42:0/1642962995 wait complete. 2024-08-25T23:59:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.304+0000 7f5431800640 1 Processor -- start 2024-08-25T23:59:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.304+0000 7f5431800640 1 -- start start 2024-08-25T23:59:49.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.305+0000 7f5431800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f542c103b50 0x7f542c19a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:49.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.305+0000 7f5431800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f542c1044f0 0x7f542c19a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:49.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.305+0000 7f5431800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f542c109c00 0x7f542c19ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:49.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.305+0000 7f5431800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f542c113f60 con 0x7f542c109c00 2024-08-25T23:59:49.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.305+0000 7f5431800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f542c113de0 con 0x7f542c103b50 2024-08-25T23:59:49.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.305+0000 7f5431800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f542c1140e0 con 0x7f542c1044f0 2024-08-25T23:59:49.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.305+0000 7f542aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f542c103b50 0x7f542c19a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:49.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.305+0000 7f542aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f542c103b50 0x7f542c19a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45086/0 (socket says 172.21.15.42:45086) 2024-08-25T23:59:49.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.305+0000 7f542aa00640 1 -- 172.21.15.42:0/1460892596 learned_addr learned my addr 172.21.15.42:0/1460892596 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:59:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.305+0000 7f542b400640 1 --2- 172.21.15.42:0/1460892596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f542c109c00 0x7f542c19ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.305+0000 7f542a000640 1 --2- 172.21.15.42:0/1460892596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f542c1044f0 0x7f542c19a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.305+0000 7f542aa00640 1 -- 172.21.15.42:0/1460892596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f542c1044f0 msgr2=0x7f542c19a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.305+0000 7f542aa00640 1 --2- 172.21.15.42:0/1460892596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f542c1044f0 0x7f542c19a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.306+0000 7f542aa00640 1 -- 172.21.15.42:0/1460892596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f542c109c00 msgr2=0x7f542c19ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.306+0000 7f542aa00640 1 --2- 172.21.15.42:0/1460892596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f542c109c00 0x7f542c19ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.306+0000 7f542aa00640 1 -- 172.21.15.42:0/1460892596 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542c19f350 con 0x7f542c103b50 2024-08-25T23:59:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.306+0000 7f542aa00640 1 --2- 172.21.15.42:0/1460892596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f542c103b50 0x7f542c19a3a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f541c009230 tx=0x7f541c004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:59:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.306+0000 7f5423400640 1 -- 172.21.15.42:0/1460892596 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c03f030 con 0x7f542c103b50 2024-08-25T23:59:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.306+0000 7f5423400640 1 -- 172.21.15.42:0/1460892596 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f541c004440 con 0x7f542c103b50 2024-08-25T23:59:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.306+0000 7f5423400640 1 -- 172.21.15.42:0/1460892596 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c035070 con 0x7f542c103b50 2024-08-25T23:59:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.306+0000 7f5431800640 1 -- 172.21.15.42:0/1460892596 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f542c19f5e0 con 0x7f542c103b50 2024-08-25T23:59:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.306+0000 7f5431800640 1 -- 172.21.15.42:0/1460892596 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f542c19fa70 con 0x7f542c103b50 2024-08-25T23:59:49.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.307+0000 7f5431800640 1 -- 172.21.15.42:0/1460892596 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f542c103fb0 con 0x7f542c103b50 2024-08-25T23:59:49.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.310+0000 7f5423400640 1 -- 172.21.15.42:0/1460892596 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f541c042030 con 0x7f542c103b50 2024-08-25T23:59:49.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.311+0000 7f5423400640 1 --2- 172.21.15.42:0/1460892596 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f54100a2b80 0x7f54100a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:49.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.312+0000 7f5423400640 1 -- 172.21.15.42:0/1460892596 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f541c0ef2f0 con 0x7f542c103b50 2024-08-25T23:59:49.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.312+0000 7f542a000640 1 --2- 172.21.15.42:0/1460892596 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f54100a2b80 0x7f54100a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:49.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.312+0000 7f542a000640 1 --2- 172.21.15.42:0/1460892596 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f54100a2b80 0x7f54100a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f542c1091d0 tx=0x7f5418005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:59:49.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.313+0000 7f5423400640 1 -- 172.21.15.42:0/1460892596 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f541c0bc650 con 0x7f542c103b50 2024-08-25T23:59:49.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.551+0000 7f5431800640 1 -- 172.21.15.42:0/1460892596 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f542c19b700 con 0x7f542c103b50 2024-08-25T23:59:49.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.551+0000 7f5423400640 1 -- 172.21.15.42:0/1460892596 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2260 (secure 0 0 0) 0x7f542c19b700 con 0x7f542c103b50 2024-08-25T23:59:49.553 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:59:49.553 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":3,"btime":"2024-08-25T23:59:49:313382+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-25T23:59:49.553 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 3 2024-08-25T23:59:49.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.554+0000 7f5431800640 1 -- 172.21.15.42:0/1460892596 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f54100a2b80 msgr2=0x7f54100a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:49.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.554+0000 7f5431800640 1 --2- 172.21.15.42:0/1460892596 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f54100a2b80 0x7f54100a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f542c1091d0 tx=0x7f5418005f90 comp rx=0 tx=0).stop 2024-08-25T23:59:49.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.554+0000 7f5431800640 1 -- 172.21.15.42:0/1460892596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f542c103b50 msgr2=0x7f542c19a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:49.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.554+0000 7f5431800640 1 --2- 172.21.15.42:0/1460892596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f542c103b50 0x7f542c19a3a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f541c009230 tx=0x7f541c004040 comp rx=0 tx=0).stop 2024-08-25T23:59:49.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.554+0000 7f5431800640 1 -- 172.21.15.42:0/1460892596 shutdown_connections 2024-08-25T23:59:49.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.554+0000 7f5431800640 1 --2- 172.21.15.42:0/1460892596 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f54100a2b80 0x7f54100a5040 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:49.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.554+0000 7f5431800640 1 --2- 172.21.15.42:0/1460892596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f542c109c00 0x7f542c19ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:49.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.554+0000 7f5431800640 1 --2- 172.21.15.42:0/1460892596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f542c1044f0 0x7f542c19a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:49.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.554+0000 7f5431800640 1 --2- 172.21.15.42:0/1460892596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f542c103b50 0x7f542c19a3a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:49.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.554+0000 7f5431800640 1 -- 172.21.15.42:0/1460892596 >> 172.21.15.42:0/1460892596 conn(0x7f542c0ff830 msgr2=0x7f542c101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:59:49.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.554+0000 7f5431800640 1 -- 172.21.15.42:0/1460892596 shutdown_connections 2024-08-25T23:59:49.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:49.554+0000 7f5431800640 1 -- 172.21.15.42:0/1460892596 wait complete. 2024-08-25T23:59:49.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:49 smithi042 ceph-mon[17225]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:49.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:49 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:49.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:49 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:49.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:49 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:49.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:49 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-25T23:59:49.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:49 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-25T23:59:49.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:49 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:49.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:49 smithi042 ceph-mon[17225]: Deploying daemon mds.j on smithi042 2024-08-25T23:59:49.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:49 smithi042 ceph-mon[17225]: mds.? [v2:172.21.15.43:6832/368996647,v1:172.21.15.43:6833/368996647] up:boot 2024-08-25T23:59:49.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:49 smithi042 ceph-mon[17225]: fsmap 2 up:standby 2024-08-25T23:59:49.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:49 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-08-25T23:59:50.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:49 smithi043 ceph-mon[22091]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:50.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:49 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:50.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:49 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:50.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:49 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:50.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:49 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-25T23:59:50.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:49 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-25T23:59:50.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:49 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:50.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:49 smithi043 ceph-mon[22091]: Deploying daemon mds.j on smithi042 2024-08-25T23:59:50.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:49 smithi043 ceph-mon[22091]: mds.? [v2:172.21.15.43:6832/368996647,v1:172.21.15.43:6833/368996647] up:boot 2024-08-25T23:59:50.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:49 smithi043 ceph-mon[22091]: fsmap 2 up:standby 2024-08-25T23:59:50.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:49 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-08-25T23:59:50.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:49 smithi181 ceph-mon[22102]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:49 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:49 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:49 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:49 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-25T23:59:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:49 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-25T23:59:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:49 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:49 smithi181 ceph-mon[22102]: Deploying daemon mds.j on smithi042 2024-08-25T23:59:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:49 smithi181 ceph-mon[22102]: mds.? [v2:172.21.15.43:6832/368996647,v1:172.21.15.43:6833/368996647] up:boot 2024-08-25T23:59:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:49 smithi181 ceph-mon[22102]: fsmap 2 up:standby 2024-08-25T23:59:50.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:49 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-08-25T23:59:50.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:50 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1460892596' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-25T23:59:51.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:50 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1460892596' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-25T23:59:51.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:50 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1460892596' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-25T23:59:51.829 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:51 smithi042 ceph-mon[17225]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:52.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:51 smithi043 ceph-mon[22091]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:52.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:51 smithi181 ceph-mon[22102]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:52.144 INFO:journalctl@ceph.mds.j.smithi042.stdout:Aug 25 23:59:51 smithi042 systemd[1]: Starting Ceph mds.j for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-25T23:59:52.313 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-25T23:59:52.429 INFO:journalctl@ceph.mds.j.smithi042.stdout:Aug 25 23:59:52 smithi042 podman[56554]: 2024-08-25 23:59:52.048946179 +0000 UTC m=+0.028838500 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34 2024-08-25T23:59:52.429 INFO:journalctl@ceph.mds.j.smithi042.stdout:Aug 25 23:59:52 smithi042 podman[56554]: 2024-08-25 23:59:52.15541553 +0000 UTC m=+0.135307835 container create 1ec190fe0970cb091e3a3deaf4b2e27d6aaedf6551a772e8090508675a83d60a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-j, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, RELEASE=squid-f273685, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-08-25T23:59:52.429 INFO:journalctl@ceph.mds.j.smithi042.stdout:Aug 25 23:59:52 smithi042 podman[56554]: 2024-08-25 23:59:52.383335091 +0000 UTC m=+0.363227404 container init 1ec190fe0970cb091e3a3deaf4b2e27d6aaedf6551a772e8090508675a83d60a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-j, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-f273685, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux ) 2024-08-25T23:59:52.429 INFO:journalctl@ceph.mds.j.smithi042.stdout:Aug 25 23:59:52 smithi042 podman[56554]: 2024-08-25 23:59:52.389901058 +0000 UTC m=+0.369793374 container start 1ec190fe0970cb091e3a3deaf4b2e27d6aaedf6551a772e8090508675a83d60a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-j, RELEASE=squid-f273685, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-25T23:59:52.715 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:59:52.783 INFO:journalctl@ceph.mds.j.smithi042.stdout:Aug 25 23:59:52 smithi042 ceph-mds[56590]: -- 172.21.15.42:0/2788673253 <== mon.0 v2:172.21.15.42:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5636d91edc20 con 0x5636d91cb400 2024-08-25T23:59:52.783 INFO:journalctl@ceph.mds.j.smithi042.stdout:Aug 25 23:59:52 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-j[56568]: starting mds.j at 2024-08-25T23:59:52.783 INFO:journalctl@ceph.mds.j.smithi042.stdout:Aug 25 23:59:52 smithi042 bash[56554]: 1ec190fe0970cb091e3a3deaf4b2e27d6aaedf6551a772e8090508675a83d60a 2024-08-25T23:59:52.783 INFO:journalctl@ceph.mds.j.smithi042.stdout:Aug 25 23:59:52 smithi042 systemd[1]: Started Ceph mds.j for f89d317a-633c-11ef-bcd2-c7b262605968. 2024-08-25T23:59:53.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.268+0000 7f4961000640 1 -- 172.21.15.42:0/2856671278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f495c103970 msgr2=0x7f495c103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:53.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.268+0000 7f4961000640 1 --2- 172.21.15.42:0/2856671278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f495c103970 0x7f495c103dd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4948009930 tx=0x7f494802a420 comp rx=0 tx=0).stop 2024-08-25T23:59:53.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.268+0000 7f4961000640 1 -- 172.21.15.42:0/2856671278 shutdown_connections 2024-08-25T23:59:53.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.268+0000 7f4961000640 1 --2- 172.21.15.42:0/2856671278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f495c104310 0x7f495c110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:53.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.268+0000 7f4961000640 1 --2- 172.21.15.42:0/2856671278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f495c103970 0x7f495c103dd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:53.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.268+0000 7f4961000640 1 --2- 172.21.15.42:0/2856671278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f495c109970 0x7f495c109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:53.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.268+0000 7f4961000640 1 -- 172.21.15.42:0/2856671278 >> 172.21.15.42:0/2856671278 conn(0x7f495c0ff670 msgr2=0x7f495c101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:59:53.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.268+0000 7f4961000640 1 -- 172.21.15.42:0/2856671278 shutdown_connections 2024-08-25T23:59:53.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.268+0000 7f4961000640 1 -- 172.21.15.42:0/2856671278 wait complete. 2024-08-25T23:59:53.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.269+0000 7f4961000640 1 Processor -- start 2024-08-25T23:59:53.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.269+0000 7f4961000640 1 -- start start 2024-08-25T23:59:53.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.270+0000 7f4961000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f495c103970 0x7f495c19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:53.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.270+0000 7f4961000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f495c104310 0x7f495c19a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:53.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.270+0000 7f4961000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f495c109970 0x7f495c19eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:53.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.270+0000 7f4961000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f495c113dc0 con 0x7f495c103970 2024-08-25T23:59:53.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.270+0000 7f4961000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f495c113c40 con 0x7f495c109970 2024-08-25T23:59:53.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.270+0000 7f4961000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f495c113f40 con 0x7f495c104310 2024-08-25T23:59:53.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.270+0000 7f495b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f495c103970 0x7f495c19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:53.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.270+0000 7f495b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f495c103970 0x7f495c19a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49622/0 (socket says 172.21.15.42:49622) 2024-08-25T23:59:53.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.270+0000 7f495b400640 1 -- 172.21.15.42:0/4047696155 learned_addr learned my addr 172.21.15.42:0/4047696155 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:59:53.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.270+0000 7f495be00640 1 --2- 172.21.15.42:0/4047696155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f495c109970 0x7f495c19eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:53.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.270+0000 7f495aa00640 1 --2- 172.21.15.42:0/4047696155 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f495c104310 0x7f495c19a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:53.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.271+0000 7f495b400640 1 -- 172.21.15.42:0/4047696155 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f495c104310 msgr2=0x7f495c19a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:53.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.271+0000 7f495b400640 1 --2- 172.21.15.42:0/4047696155 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f495c104310 0x7f495c19a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:53.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.271+0000 7f495b400640 1 -- 172.21.15.42:0/4047696155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f495c109970 msgr2=0x7f495c19eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:53.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.271+0000 7f495b400640 1 --2- 172.21.15.42:0/4047696155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f495c109970 0x7f495c19eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:53.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.271+0000 7f495b400640 1 -- 172.21.15.42:0/4047696155 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495c19f1f0 con 0x7f495c103970 2024-08-25T23:59:53.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.271+0000 7f495be00640 1 --2- 172.21.15.42:0/4047696155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f495c109970 0x7f495c19eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-25T23:59:53.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.271+0000 7f495b400640 1 --2- 172.21.15.42:0/4047696155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f495c103970 0x7f495c19a240 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f494c00e9f0 tx=0x7f494c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:59:53.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.271+0000 7f4953e00640 1 -- 172.21.15.42:0/4047696155 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c00cd80 con 0x7f495c103970 2024-08-25T23:59:53.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.271+0000 7f4953e00640 1 -- 172.21.15.42:0/4047696155 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f494c010910 con 0x7f495c103970 2024-08-25T23:59:53.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.271+0000 7f4961000640 1 -- 172.21.15.42:0/4047696155 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f495c19f4e0 con 0x7f495c103970 2024-08-25T23:59:53.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.271+0000 7f4953e00640 1 -- 172.21.15.42:0/4047696155 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c018990 con 0x7f495c103970 2024-08-25T23:59:53.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.271+0000 7f4961000640 1 -- 172.21.15.42:0/4047696155 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f495c1a6dc0 con 0x7f495c103970 2024-08-25T23:59:53.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.273+0000 7f4961000640 1 -- 172.21.15.42:0/4047696155 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f495c103dd0 con 0x7f495c103970 2024-08-25T23:59:53.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.275+0000 7f4953e00640 1 -- 172.21.15.42:0/4047696155 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f494c010ac0 con 0x7f495c103970 2024-08-25T23:59:53.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.276+0000 7f4953e00640 1 --2- 172.21.15.42:0/4047696155 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f49400a2b80 0x7f49400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:53.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.276+0000 7f4953e00640 1 -- 172.21.15.42:0/4047696155 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f494c0ceed0 con 0x7f495c103970 2024-08-25T23:59:53.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.276+0000 7f495aa00640 1 --2- 172.21.15.42:0/4047696155 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f49400a2b80 0x7f49400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:53.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.277+0000 7f495aa00640 1 --2- 172.21.15.42:0/4047696155 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f49400a2b80 0x7f49400a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4948006010 tx=0x7f4948000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:59:53.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.281+0000 7f4953e00640 1 -- 172.21.15.42:0/4047696155 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f494c09bbe0 con 0x7f495c103970 2024-08-25T23:59:53.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.512+0000 7f4961000640 1 -- 172.21.15.42:0/4047696155 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f495c1a7120 con 0x7f495c103970 2024-08-25T23:59:53.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.512+0000 7f4953e00640 1 -- 172.21.15.42:0/4047696155 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7f494c09fee0 con 0x7f495c103970 2024-08-25T23:59:53.513 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:59:53.513 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":4,"btime":"2024-08-25T23:59:52:542710+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-25T23:59:53.513 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 4 2024-08-25T23:59:53.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.514+0000 7f4961000640 1 -- 172.21.15.42:0/4047696155 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f49400a2b80 msgr2=0x7f49400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:53.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.514+0000 7f4961000640 1 --2- 172.21.15.42:0/4047696155 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f49400a2b80 0x7f49400a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4948006010 tx=0x7f4948000bc0 comp rx=0 tx=0).stop 2024-08-25T23:59:53.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.514+0000 7f4961000640 1 -- 172.21.15.42:0/4047696155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f495c103970 msgr2=0x7f495c19a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:53.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.514+0000 7f4961000640 1 --2- 172.21.15.42:0/4047696155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f495c103970 0x7f495c19a240 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f494c00e9f0 tx=0x7f494c00eeb0 comp rx=0 tx=0).stop 2024-08-25T23:59:53.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.515+0000 7f4961000640 1 -- 172.21.15.42:0/4047696155 shutdown_connections 2024-08-25T23:59:53.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.515+0000 7f4961000640 1 --2- 172.21.15.42:0/4047696155 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f49400a2b80 0x7f49400a5040 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:53.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.515+0000 7f4961000640 1 --2- 172.21.15.42:0/4047696155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f495c109970 0x7f495c19eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:53.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.515+0000 7f4961000640 1 --2- 172.21.15.42:0/4047696155 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f495c104310 0x7f495c19a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:53.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.515+0000 7f4961000640 1 --2- 172.21.15.42:0/4047696155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f495c103970 0x7f495c19a240 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:53.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.515+0000 7f4961000640 1 -- 172.21.15.42:0/4047696155 >> 172.21.15.42:0/4047696155 conn(0x7f495c0ff670 msgr2=0x7f495c0ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:59:53.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.515+0000 7f4961000640 1 -- 172.21.15.42:0/4047696155 shutdown_connections 2024-08-25T23:59:53.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:53.515+0000 7f4961000640 1 -- 172.21.15.42:0/4047696155 wait complete. 2024-08-25T23:59:53.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:53 smithi042 ceph-mon[17225]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:53.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:53 smithi042 ceph-mon[17225]: mds.? [v2:172.21.15.42:6834/1208862457,v1:172.21.15.42:6835/1208862457] up:boot 2024-08-25T23:59:53.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:53 smithi042 ceph-mon[17225]: fsmap 3 up:standby 2024-08-25T23:59:53.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:53 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-08-25T23:59:53.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:53 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:53.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:53 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:53.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:53 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:53.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:53 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-25T23:59:53.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:53 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-25T23:59:53.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:53 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:53.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:53 smithi042 ceph-mon[17225]: Deploying daemon mds.d on smithi042 2024-08-25T23:59:53.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:53 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/4047696155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-25T23:59:54.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:53 smithi043 ceph-mon[22091]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:54.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:53 smithi043 ceph-mon[22091]: mds.? [v2:172.21.15.42:6834/1208862457,v1:172.21.15.42:6835/1208862457] up:boot 2024-08-25T23:59:54.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:53 smithi043 ceph-mon[22091]: fsmap 3 up:standby 2024-08-25T23:59:54.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:53 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-08-25T23:59:54.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:53 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:54.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:53 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:54.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:53 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:54.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:53 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-25T23:59:54.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:53 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-25T23:59:54.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:53 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:54.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:53 smithi043 ceph-mon[22091]: Deploying daemon mds.d on smithi042 2024-08-25T23:59:54.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:53 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/4047696155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-25T23:59:54.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:53 smithi181 ceph-mon[22102]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:54.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:53 smithi181 ceph-mon[22102]: mds.? [v2:172.21.15.42:6834/1208862457,v1:172.21.15.42:6835/1208862457] up:boot 2024-08-25T23:59:54.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:53 smithi181 ceph-mon[22102]: fsmap 3 up:standby 2024-08-25T23:59:54.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:53 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-08-25T23:59:54.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:53 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:54.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:53 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:54.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:53 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:54.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:53 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-25T23:59:54.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:53 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-25T23:59:54.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:53 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:54.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:53 smithi181 ceph-mon[22102]: Deploying daemon mds.d on smithi042 2024-08-25T23:59:54.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:53 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/4047696155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-25T23:59:55.765 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:55 smithi042 ceph-mon[17225]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:56.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:55 smithi043 ceph-mon[22091]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:56.034 INFO:journalctl@ceph.mds.d.smithi042.stdout:Aug 25 23:59:56 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-d[56978]: starting mds.d at 2024-08-25T23:59:56.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:55 smithi181 ceph-mon[22102]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:56.533 INFO:journalctl@ceph.mds.d.smithi042.stdout:Aug 25 23:59:56 smithi042 bash[56963]: 038bfaedb1141d0f58fd82e556eda63ddd4781f45bd8a78323e4038246a7fff9 2024-08-25T23:59:56.533 INFO:journalctl@ceph.mds.d.smithi042.stdout:Aug 25 23:59:56 smithi042 systemd[1]: Started Ceph mds.d for f89d317a-633c-11ef-bcd2-c7b262605968. 2024-08-25T23:59:57.282 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-25T23:59:57.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:57 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:57.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:57 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:57.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:57 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:57.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:57 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-25T23:59:57.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:57 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-25T23:59:57.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:57 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:57.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:57 smithi043 ceph-mon[22091]: Deploying daemon mds.e on smithi043 2024-08-25T23:59:57.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:57 smithi043 ceph-mon[22091]: mds.? [v2:172.21.15.42:6836/1832026661,v1:172.21.15.42:6837/1832026661] up:boot 2024-08-25T23:59:57.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:57 smithi043 ceph-mon[22091]: fsmap 4 up:standby 2024-08-25T23:59:57.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:57 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-08-25T23:59:57.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:57 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:57.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:57 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:57.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:57 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:57.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:57 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-25T23:59:57.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:57 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-25T23:59:57.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:57 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:57.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:57 smithi042 ceph-mon[17225]: Deploying daemon mds.e on smithi043 2024-08-25T23:59:57.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:57 smithi042 ceph-mon[17225]: mds.? [v2:172.21.15.42:6836/1832026661,v1:172.21.15.42:6837/1832026661] up:boot 2024-08-25T23:59:57.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:57 smithi042 ceph-mon[17225]: fsmap 4 up:standby 2024-08-25T23:59:57.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:57 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-08-25T23:59:57.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:57 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:57.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:57 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:57.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:57 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:57.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:57 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-25T23:59:57.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:57 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-25T23:59:57.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:57 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:57.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:57 smithi181 ceph-mon[22102]: Deploying daemon mds.e on smithi043 2024-08-25T23:59:57.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:57 smithi181 ceph-mon[22102]: mds.? [v2:172.21.15.42:6836/1832026661,v1:172.21.15.42:6837/1832026661] up:boot 2024-08-25T23:59:57.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:57 smithi181 ceph-mon[22102]: fsmap 4 up:standby 2024-08-25T23:59:57.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:57 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-08-25T23:59:57.674 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-25T23:59:58.150 INFO:journalctl@ceph.mds.e.smithi043.stdout:Aug 25 23:59:58 smithi043 systemd[1]: Starting Ceph mds.e for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-25T23:59:58.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.214+0000 7f38d3c00640 1 -- 172.21.15.42:0/1222143145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38cc10e160 msgr2=0x7f38cc1105b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:58.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.214+0000 7f38d3c00640 1 --2- 172.21.15.42:0/1222143145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38cc10e160 0x7f38cc1105b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f38c4009be0 tx=0x7f38c402a750 comp rx=0 tx=0).stop 2024-08-25T23:59:58.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.214+0000 7f38d3c00640 1 -- 172.21.15.42:0/1222143145 shutdown_connections 2024-08-25T23:59:58.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.214+0000 7f38d3c00640 1 --2- 172.21.15.42:0/1222143145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38cc10e160 0x7f38cc1105b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:58.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.214+0000 7f38d3c00640 1 --2- 172.21.15.42:0/1222143145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38cc074ce0 0x7f38cc10dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:58.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.214+0000 7f38d3c00640 1 --2- 172.21.15.42:0/1222143145 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38cc0743c0 0x7f38cc0747a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:58.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.214+0000 7f38d3c00640 1 -- 172.21.15.42:0/1222143145 >> 172.21.15.42:0/1222143145 conn(0x7f38cc0fd660 msgr2=0x7f38cc0ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:59:58.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.215+0000 7f38d3c00640 1 -- 172.21.15.42:0/1222143145 shutdown_connections 2024-08-25T23:59:58.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.215+0000 7f38d3c00640 1 -- 172.21.15.42:0/1222143145 wait complete. 2024-08-25T23:59:58.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.215+0000 7f38d3c00640 1 Processor -- start 2024-08-25T23:59:58.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.216+0000 7f38d3c00640 1 -- start start 2024-08-25T23:59:58.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.216+0000 7f38d3c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38cc0743c0 0x7f38cc19a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:58.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.216+0000 7f38d3c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38cc074ce0 0x7f38cc19a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:58.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.216+0000 7f38d3c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38cc10e160 0x7f38cc19eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:58.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.216+0000 7f38d3c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc113f10 con 0x7f38cc0743c0 2024-08-25T23:59:58.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.216+0000 7f38d3c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc113d90 con 0x7f38cc074ce0 2024-08-25T23:59:58.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.216+0000 7f38d3c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc114090 con 0x7f38cc10e160 2024-08-25T23:59:58.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.216+0000 7f38d1200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38cc0743c0 0x7f38cc19a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:58.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.216+0000 7f38d1c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38cc10e160 0x7f38cc19eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:58.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.216+0000 7f38d1c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38cc10e160 0x7f38cc19eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:44966/0 (socket says 172.21.15.42:44966) 2024-08-25T23:59:58.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.216+0000 7f38d1c00640 1 -- 172.21.15.42:0/2341983166 learned_addr learned my addr 172.21.15.42:0/2341983166 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-25T23:59:58.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.216+0000 7f38cbe00640 1 --2- 172.21.15.42:0/2341983166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38cc074ce0 0x7f38cc19a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:58.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.217+0000 7f38d1c00640 1 -- 172.21.15.42:0/2341983166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38cc074ce0 msgr2=0x7f38cc19a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:58.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.217+0000 7f38d1c00640 1 --2- 172.21.15.42:0/2341983166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38cc074ce0 0x7f38cc19a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:58.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.217+0000 7f38d1c00640 1 -- 172.21.15.42:0/2341983166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38cc0743c0 msgr2=0x7f38cc19a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:58.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.217+0000 7f38d1c00640 1 --2- 172.21.15.42:0/2341983166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38cc0743c0 0x7f38cc19a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:58.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.217+0000 7f38d1c00640 1 -- 172.21.15.42:0/2341983166 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38cc19f380 con 0x7f38cc10e160 2024-08-25T23:59:58.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.217+0000 7f38d1200640 1 --2- 172.21.15.42:0/2341983166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38cc0743c0 0x7f38cc19a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-25T23:59:58.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.217+0000 7f38d1c00640 1 --2- 172.21.15.42:0/2341983166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38cc10e160 0x7f38cc19eca0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f38c4009b30 tx=0x7f38c40305d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:59:58.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.217+0000 7f38c9600640 1 -- 172.21.15.42:0/2341983166 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c4041020 con 0x7f38cc10e160 2024-08-25T23:59:58.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.217+0000 7f38c9600640 1 -- 172.21.15.42:0/2341983166 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38c4003e50 con 0x7f38cc10e160 2024-08-25T23:59:58.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.218+0000 7f38d3c00640 1 -- 172.21.15.42:0/2341983166 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38cc19f610 con 0x7f38cc10e160 2024-08-25T23:59:58.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.218+0000 7f38c9600640 1 -- 172.21.15.42:0/2341983166 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c4036040 con 0x7f38cc10e160 2024-08-25T23:59:58.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.218+0000 7f38d3c00640 1 -- 172.21.15.42:0/2341983166 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38cc1a6f50 con 0x7f38cc10e160 2024-08-25T23:59:58.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.219+0000 7f38d3c00640 1 -- 172.21.15.42:0/2341983166 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38cc0747a0 con 0x7f38cc10e160 2024-08-25T23:59:58.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.221+0000 7f38c9600640 1 -- 172.21.15.42:0/2341983166 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f38c4044020 con 0x7f38cc10e160 2024-08-25T23:59:58.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.222+0000 7f38c9600640 1 --2- 172.21.15.42:0/2341983166 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f38b40a2c00 0x7f38b40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-25T23:59:58.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.222+0000 7f38c9600640 1 -- 172.21.15.42:0/2341983166 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f38c40ef800 con 0x7f38cc10e160 2024-08-25T23:59:58.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.222+0000 7f38d1200640 1 --2- 172.21.15.42:0/2341983166 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f38b40a2c00 0x7f38b40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-25T23:59:58.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.223+0000 7f38d1200640 1 --2- 172.21.15.42:0/2341983166 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f38b40a2c00 0x7f38b40a50c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f38c00096c0 tx=0x7f38c0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-25T23:59:58.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.224+0000 7f38c9600640 1 -- 172.21.15.42:0/2341983166 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f38c404b020 con 0x7f38cc10e160 2024-08-25T23:59:58.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.447+0000 7f38d3c00640 1 -- 172.21.15.42:0/2341983166 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38cc19b730 con 0x7f38cc10e160 2024-08-25T23:59:58.448 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:58 smithi042 ceph-mon[17225]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:58.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.448+0000 7f38c9600640 1 -- 172.21.15.42:0/2341983166 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7f38cc19b730 con 0x7f38cc10e160 2024-08-25T23:59:58.448 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-25T23:59:58.448 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":5,"btime":"2024-08-25T23:59:56:553032+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-25T23:59:58.449 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 5 2024-08-25T23:59:58.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.450+0000 7f38d3c00640 1 -- 172.21.15.42:0/2341983166 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f38b40a2c00 msgr2=0x7f38b40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:58.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.450+0000 7f38d3c00640 1 --2- 172.21.15.42:0/2341983166 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f38b40a2c00 0x7f38b40a50c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f38c00096c0 tx=0x7f38c0009260 comp rx=0 tx=0).stop 2024-08-25T23:59:58.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.450+0000 7f38d3c00640 1 -- 172.21.15.42:0/2341983166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38cc10e160 msgr2=0x7f38cc19eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-25T23:59:58.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.450+0000 7f38d3c00640 1 --2- 172.21.15.42:0/2341983166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38cc10e160 0x7f38cc19eca0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f38c4009b30 tx=0x7f38c40305d0 comp rx=0 tx=0).stop 2024-08-25T23:59:58.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.450+0000 7f38d3c00640 1 -- 172.21.15.42:0/2341983166 shutdown_connections 2024-08-25T23:59:58.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.450+0000 7f38d3c00640 1 --2- 172.21.15.42:0/2341983166 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f38b40a2c00 0x7f38b40a50c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:58.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.450+0000 7f38d3c00640 1 --2- 172.21.15.42:0/2341983166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f38cc10e160 0x7f38cc19eca0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:58.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.450+0000 7f38d3c00640 1 --2- 172.21.15.42:0/2341983166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38cc074ce0 0x7f38cc19a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:58.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.450+0000 7f38d3c00640 1 --2- 172.21.15.42:0/2341983166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38cc0743c0 0x7f38cc19a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-25T23:59:58.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.450+0000 7f38d3c00640 1 -- 172.21.15.42:0/2341983166 >> 172.21.15.42:0/2341983166 conn(0x7f38cc0fd660 msgr2=0x7f38cc0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-25T23:59:58.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.451+0000 7f38d3c00640 1 -- 172.21.15.42:0/2341983166 shutdown_connections 2024-08-25T23:59:58.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-25T23:59:58.451+0000 7f38d3c00640 1 -- 172.21.15.42:0/2341983166 wait complete. 2024-08-25T23:59:58.467 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:58 smithi043 ceph-mon[22091]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:58.467 INFO:journalctl@ceph.mds.e.smithi043.stdout:Aug 25 23:59:58 smithi043 podman[52334]: 2024-08-25 23:59:58.141991348 +0000 UTC m=+0.015854098 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34 2024-08-25T23:59:58.468 INFO:journalctl@ceph.mds.e.smithi043.stdout:Aug 25 23:59:58 smithi043 podman[52334]: 2024-08-25 23:59:58.370504054 +0000 UTC m=+0.244366843 container create 4f6ceec12568490610585362d88eb49a68264f879f4c90cb8757a6cb084d3466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-e, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-f273685, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-25T23:59:58.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:58 smithi181 ceph-mon[22102]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-25T23:59:58.760 INFO:journalctl@ceph.mds.e.smithi043.stdout:Aug 25 23:59:58 smithi043 podman[52334]: 2024-08-25 23:59:58.580897066 +0000 UTC m=+0.454759814 container init 4f6ceec12568490610585362d88eb49a68264f879f4c90cb8757a6cb084d3466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-f273685, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-08-25T23:59:58.760 INFO:journalctl@ceph.mds.e.smithi043.stdout:Aug 25 23:59:58 smithi043 podman[52334]: 2024-08-25 23:59:58.583622043 +0000 UTC m=+0.457484792 container start 4f6ceec12568490610585362d88eb49a68264f879f4c90cb8757a6cb084d3466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-e, ceph=True, RELEASE=squid-f273685, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-08-25T23:59:58.760 INFO:journalctl@ceph.mds.e.smithi043.stdout:Aug 25 23:59:58 smithi043 ceph-mds[52353]: -- 172.21.15.43:0/858886808 <== mon.2 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564d5eeb9860 con 0x564d5ee97400 2024-08-25T23:59:58.761 INFO:journalctl@ceph.mds.e.smithi043.stdout:Aug 25 23:59:58 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-e[52349]: starting mds.e at 2024-08-25T23:59:59.155 INFO:journalctl@ceph.mds.e.smithi043.stdout:Aug 25 23:59:58 smithi043 bash[52334]: 4f6ceec12568490610585362d88eb49a68264f879f4c90cb8757a6cb084d3466 2024-08-25T23:59:59.155 INFO:journalctl@ceph.mds.e.smithi043.stdout:Aug 25 23:59:58 smithi043 systemd[1]: Started Ceph mds.e for f89d317a-633c-11ef-bcd2-c7b262605968. 2024-08-25T23:59:59.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:59 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/2341983166' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-25T23:59:59.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:59 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:59.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:59 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:59.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:59 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:59.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:59 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-25T23:59:59.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:59 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-25T23:59:59.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 25 23:59:59 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:59.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:59 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/2341983166' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-25T23:59:59.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:59 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:59.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:59 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:59.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:59 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:59.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:59 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-25T23:59:59.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:59 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-25T23:59:59.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 25 23:59:59 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-25T23:59:59.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:59 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2341983166' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-25T23:59:59.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:59 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:59.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:59 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:59.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:59 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-25T23:59:59.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:59 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-25T23:59:59.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:59 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-25T23:59:59.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 25 23:59:59 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:00.495 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:00 smithi181 ceph-mon[22102]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:00.495 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:00 smithi181 ceph-mon[22102]: Deploying daemon mds.f on smithi181 2024-08-26T00:00:00.495 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:00 smithi181 ceph-mon[22102]: mds.? [v2:172.21.15.43:6834/4195804691,v1:172.21.15.43:6835/4195804691] up:boot 2024-08-26T00:00:00.495 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:00 smithi181 ceph-mon[22102]: fsmap 5 up:standby 2024-08-26T00:00:00.496 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:00 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-26T00:00:00.496 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:00 smithi181 ceph-mon[22102]: overall HEALTH_OK 2024-08-26T00:00:00.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:00 smithi043 ceph-mon[22091]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:00.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:00 smithi043 ceph-mon[22091]: Deploying daemon mds.f on smithi181 2024-08-26T00:00:00.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:00 smithi043 ceph-mon[22091]: mds.? [v2:172.21.15.43:6834/4195804691,v1:172.21.15.43:6835/4195804691] up:boot 2024-08-26T00:00:00.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:00 smithi043 ceph-mon[22091]: fsmap 5 up:standby 2024-08-26T00:00:00.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:00 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-26T00:00:00.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:00 smithi043 ceph-mon[22091]: overall HEALTH_OK 2024-08-26T00:00:00.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:00 smithi042 ceph-mon[17225]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:00.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:00 smithi042 ceph-mon[17225]: Deploying daemon mds.f on smithi181 2024-08-26T00:00:00.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:00 smithi042 ceph-mon[17225]: mds.? [v2:172.21.15.43:6834/4195804691,v1:172.21.15.43:6835/4195804691] up:boot 2024-08-26T00:00:00.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:00 smithi042 ceph-mon[17225]: fsmap 5 up:standby 2024-08-26T00:00:00.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:00 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-26T00:00:00.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:00 smithi042 ceph-mon[17225]: overall HEALTH_OK 2024-08-26T00:00:00.784 INFO:journalctl@ceph.mds.f.smithi181.stdout:Aug 26 00:00:00 smithi181 systemd[1]: Starting Ceph mds.f for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:00:01.125 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:00:01.182 INFO:journalctl@ceph.mds.f.smithi181.stdout:Aug 26 00:00:00 smithi181 podman[52378]: 2024-08-26 00:00:00.81257882 +0000 UTC m=+0.015472178 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34 2024-08-26T00:00:01.182 INFO:journalctl@ceph.mds.f.smithi181.stdout:Aug 26 00:00:00 smithi181 podman[52378]: 2024-08-26 00:00:00.935722052 +0000 UTC m=+0.138615405 container create f77e962be4bf62eb5d43d14775efb7612fee9b1303ee944de59885bfdd4cd611 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-f, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-f273685, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-08-26T00:00:01.182 INFO:journalctl@ceph.mds.f.smithi181.stdout:Aug 26 00:00:01 smithi181 podman[52378]: 2024-08-26 00:00:01.154765889 +0000 UTC m=+0.357659237 container init f77e962be4bf62eb5d43d14775efb7612fee9b1303ee944de59885bfdd4cd611 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-f, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-f273685, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-08-26T00:00:01.182 INFO:journalctl@ceph.mds.f.smithi181.stdout:Aug 26 00:00:01 smithi181 podman[52378]: 2024-08-26 00:00:01.157618837 +0000 UTC m=+0.360512184 container start f77e962be4bf62eb5d43d14775efb7612fee9b1303ee944de59885bfdd4cd611 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-f, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-f273685, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-08-26T00:00:01.523 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:01.533 INFO:journalctl@ceph.mds.f.smithi181.stdout:Aug 26 00:00:01 smithi181 ceph-mds[52397]: -- 172.21.15.181:0/3039886629 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557d7fd47860 con 0x557d7fd25400 2024-08-26T00:00:01.534 INFO:journalctl@ceph.mds.f.smithi181.stdout:Aug 26 00:00:01 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-f[52393]: starting mds.f at 2024-08-26T00:00:01.534 INFO:journalctl@ceph.mds.f.smithi181.stdout:Aug 26 00:00:01 smithi181 bash[52378]: f77e962be4bf62eb5d43d14775efb7612fee9b1303ee944de59885bfdd4cd611 2024-08-26T00:00:01.534 INFO:journalctl@ceph.mds.f.smithi181.stdout:Aug 26 00:00:01 smithi181 systemd[1]: Started Ceph mds.f for f89d317a-633c-11ef-bcd2-c7b262605968. 2024-08-26T00:00:02.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.074+0000 7f5d97600640 1 -- 172.21.15.42:0/2908833274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d900764c0 msgr2=0x7f5d900768a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:02.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.074+0000 7f5d97600640 1 --2- 172.21.15.42:0/2908833274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d900764c0 0x7f5d900768a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5d84009900 tx=0x7f5d8402a410 comp rx=0 tx=0).stop 2024-08-26T00:00:02.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.074+0000 7f5d97600640 1 -- 172.21.15.42:0/2908833274 shutdown_connections 2024-08-26T00:00:02.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.074+0000 7f5d97600640 1 --2- 172.21.15.42:0/2908833274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d901127f0 0x7f5d90114be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:02.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.074+0000 7f5d97600640 1 --2- 172.21.15.42:0/2908833274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d90076de0 0x7f5d901122b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:02.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.074+0000 7f5d97600640 1 --2- 172.21.15.42:0/2908833274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d900764c0 0x7f5d900768a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:02.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.074+0000 7f5d97600640 1 -- 172.21.15.42:0/2908833274 >> 172.21.15.42:0/2908833274 conn(0x7f5d900ff7f0 msgr2=0x7f5d90101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:02.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.074+0000 7f5d97600640 1 -- 172.21.15.42:0/2908833274 shutdown_connections 2024-08-26T00:00:02.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.074+0000 7f5d97600640 1 -- 172.21.15.42:0/2908833274 wait complete. 2024-08-26T00:00:02.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.075+0000 7f5d97600640 1 Processor -- start 2024-08-26T00:00:02.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.076+0000 7f5d97600640 1 -- start start 2024-08-26T00:00:02.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.076+0000 7f5d97600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d900764c0 0x7f5d901a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:02.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.076+0000 7f5d97600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d90076de0 0x7f5d901a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:02.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.076+0000 7f5d97600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d901127f0 0x7f5d9019e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:02.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.076+0000 7f5d97600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5d901183b0 con 0x7f5d90076de0 2024-08-26T00:00:02.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.076+0000 7f5d97600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5d90118230 con 0x7f5d900764c0 2024-08-26T00:00:02.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.076+0000 7f5d97600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5d90118530 con 0x7f5d901127f0 2024-08-26T00:00:02.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.076+0000 7f5d94c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d900764c0 0x7f5d901a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:02.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.076+0000 7f5d95600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d901127f0 0x7f5d9019e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:02.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.076+0000 7f5d8fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d90076de0 0x7f5d901a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:02.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.076+0000 7f5d94c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d900764c0 0x7f5d901a4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:41134/0 (socket says 172.21.15.42:41134) 2024-08-26T00:00:02.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.076+0000 7f5d94c00640 1 -- 172.21.15.42:0/1982484146 learned_addr learned my addr 172.21.15.42:0/1982484146 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:02.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.077+0000 7f5d95600640 1 -- 172.21.15.42:0/1982484146 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d900764c0 msgr2=0x7f5d901a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:02.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.077+0000 7f5d95600640 1 --2- 172.21.15.42:0/1982484146 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d900764c0 0x7f5d901a4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:02.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.077+0000 7f5d95600640 1 -- 172.21.15.42:0/1982484146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d90076de0 msgr2=0x7f5d901a4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:02.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.077+0000 7f5d95600640 1 --2- 172.21.15.42:0/1982484146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d90076de0 0x7f5d901a4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:02.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.077+0000 7f5d95600640 1 -- 172.21.15.42:0/1982484146 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d9019efd0 con 0x7f5d901127f0 2024-08-26T00:00:02.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.077+0000 7f5d94c00640 1 --2- 172.21.15.42:0/1982484146 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d900764c0 0x7f5d901a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:00:02.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.077+0000 7f5d95600640 1 --2- 172.21.15.42:0/1982484146 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d901127f0 0x7f5d9019e760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5d9007a7b0 tx=0x7f5d8800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:02.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.077+0000 7f5d8d600640 1 -- 172.21.15.42:0/1982484146 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8800cdf0 con 0x7f5d901127f0 2024-08-26T00:00:02.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.077+0000 7f5d8d600640 1 -- 172.21.15.42:0/1982484146 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d88005020 con 0x7f5d901127f0 2024-08-26T00:00:02.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.077+0000 7f5d8d600640 1 -- 172.21.15.42:0/1982484146 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d88010670 con 0x7f5d901127f0 2024-08-26T00:00:02.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.077+0000 7f5d97600640 1 -- 172.21.15.42:0/1982484146 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d9019f2c0 con 0x7f5d901127f0 2024-08-26T00:00:02.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.078+0000 7f5d97600640 1 -- 172.21.15.42:0/1982484146 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d901ab440 con 0x7f5d901127f0 2024-08-26T00:00:02.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.079+0000 7f5d97600640 1 -- 172.21.15.42:0/1982484146 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d90077c00 con 0x7f5d901127f0 2024-08-26T00:00:02.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.081+0000 7f5d8d600640 1 -- 172.21.15.42:0/1982484146 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5d880054d0 con 0x7f5d901127f0 2024-08-26T00:00:02.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.082+0000 7f5d8d600640 1 --2- 172.21.15.42:0/1982484146 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5d780a2b80 0x7f5d780a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:02.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.082+0000 7f5d8d600640 1 -- 172.21.15.42:0/1982484146 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f5d880cf2a0 con 0x7f5d901127f0 2024-08-26T00:00:02.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.082+0000 7f5d94c00640 1 --2- 172.21.15.42:0/1982484146 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5d780a2b80 0x7f5d780a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:02.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.083+0000 7f5d94c00640 1 --2- 172.21.15.42:0/1982484146 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5d780a2b80 0x7f5d780a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5d840096c0 tx=0x7f5d840046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:02.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.086+0000 7f5d8d600640 1 -- 172.21.15.42:0/1982484146 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5d8809c600 con 0x7f5d901127f0 2024-08-26T00:00:02.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.314+0000 7f5d97600640 1 -- 172.21.15.42:0/1982484146 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d9010d980 con 0x7f5d901127f0 2024-08-26T00:00:02.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.315+0000 7f5d8d600640 1 -- 172.21.15.42:0/1982484146 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5563 (secure 0 0 0) 0x7f5d8809bf00 con 0x7f5d901127f0 2024-08-26T00:00:02.315 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:00:02.315 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":7,"btime":"2024-08-26T00:00:02:157955+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-08-26T00:00:02.316 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 7 2024-08-26T00:00:02.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.317+0000 7f5d97600640 1 -- 172.21.15.42:0/1982484146 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5d780a2b80 msgr2=0x7f5d780a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:02.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.317+0000 7f5d97600640 1 --2- 172.21.15.42:0/1982484146 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5d780a2b80 0x7f5d780a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5d840096c0 tx=0x7f5d840046c0 comp rx=0 tx=0).stop 2024-08-26T00:00:02.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.317+0000 7f5d97600640 1 -- 172.21.15.42:0/1982484146 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d901127f0 msgr2=0x7f5d9019e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:02.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.317+0000 7f5d97600640 1 --2- 172.21.15.42:0/1982484146 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d901127f0 0x7f5d9019e760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5d9007a7b0 tx=0x7f5d8800ef10 comp rx=0 tx=0).stop 2024-08-26T00:00:02.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.317+0000 7f5d97600640 1 -- 172.21.15.42:0/1982484146 shutdown_connections 2024-08-26T00:00:02.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.317+0000 7f5d97600640 1 --2- 172.21.15.42:0/1982484146 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5d780a2b80 0x7f5d780a5040 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:02.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.317+0000 7f5d97600640 1 --2- 172.21.15.42:0/1982484146 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d901127f0 0x7f5d9019e760 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:02.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.317+0000 7f5d97600640 1 --2- 172.21.15.42:0/1982484146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d90076de0 0x7f5d901a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:02.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.317+0000 7f5d97600640 1 --2- 172.21.15.42:0/1982484146 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d900764c0 0x7f5d901a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:02.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.317+0000 7f5d97600640 1 -- 172.21.15.42:0/1982484146 >> 172.21.15.42:0/1982484146 conn(0x7f5d900ff7f0 msgr2=0x7f5d90101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:02.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.317+0000 7f5d97600640 1 -- 172.21.15.42:0/1982484146 shutdown_connections 2024-08-26T00:00:02.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:02.318+0000 7f5d97600640 1 -- 172.21.15.42:0/1982484146 wait complete. 2024-08-26T00:00:02.331 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:02 smithi042 ceph-mon[17225]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:02.331 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:02.331 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:02.331 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:02.331 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-26T00:00:02.331 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-26T00:00:02.332 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:02.332 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:02 smithi042 ceph-mon[17225]: Deploying daemon mds.c on smithi181 2024-08-26T00:00:02.332 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:02 smithi042 ceph-mon[17225]: mds.? [v2:172.21.15.181:6834/1496959020,v1:172.21.15.181:6835/1496959020] up:boot 2024-08-26T00:00:02.332 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:02 smithi042 ceph-mon[17225]: fsmap 6 up:standby 2024-08-26T00:00:02.332 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:02 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-26T00:00:02.688 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:02 smithi181 ceph-mon[22102]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:02.688 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:02 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:02.688 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:02 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:02.688 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:02 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:02.688 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:02 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-26T00:00:02.688 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:02 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-26T00:00:02.688 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:02 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:02.688 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:02 smithi181 ceph-mon[22102]: Deploying daemon mds.c on smithi181 2024-08-26T00:00:02.688 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:02 smithi181 ceph-mon[22102]: mds.? [v2:172.21.15.181:6834/1496959020,v1:172.21.15.181:6835/1496959020] up:boot 2024-08-26T00:00:02.688 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:02 smithi181 ceph-mon[22102]: fsmap 6 up:standby 2024-08-26T00:00:02.688 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:02 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-26T00:00:02.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:02 smithi043 ceph-mon[22091]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:02.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:02 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:02.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:02 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:02.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:02 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:02.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:02 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-26T00:00:02.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:02 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-26T00:00:02.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:02 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:02.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:02 smithi043 ceph-mon[22091]: Deploying daemon mds.c on smithi181 2024-08-26T00:00:02.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:02 smithi043 ceph-mon[22091]: mds.? [v2:172.21.15.181:6834/1496959020,v1:172.21.15.181:6835/1496959020] up:boot 2024-08-26T00:00:02.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:02 smithi043 ceph-mon[22091]: fsmap 6 up:standby 2024-08-26T00:00:02.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:02 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-26T00:00:03.284 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:00:03 smithi181 systemd[1]: Starting Ceph mds.c for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:00:03.550 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:03 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1982484146' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:00:03.550 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:00:03 smithi181 podman[52677]: 2024-08-26 00:00:03.22771151 +0000 UTC m=+0.015459098 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34 2024-08-26T00:00:03.550 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:00:03 smithi181 podman[52677]: 2024-08-26 00:00:03.331043705 +0000 UTC m=+0.118791333 container create 6a38a30aa9617b90121800e0a4311b513d9ef44d19fe2cb8f64a639c4914746b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f273685, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-08-26T00:00:03.550 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:00:03 smithi181 podman[52677]: 2024-08-26 00:00:03.550217914 +0000 UTC m=+0.337965500 container init 6a38a30aa9617b90121800e0a4311b513d9ef44d19fe2cb8f64a639c4914746b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-f273685, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-08-26T00:00:03.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:03 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1982484146' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:00:03.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:03 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1982484146' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:00:04.034 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:00:03 smithi181 podman[52677]: 2024-08-26 00:00:03.553187728 +0000 UTC m=+0.340935332 container start 6a38a30aa9617b90121800e0a4311b513d9ef44d19fe2cb8f64a639c4914746b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c, RELEASE=squid-f273685, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-26T00:00:04.034 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:00:03 smithi181 ceph-mds[52696]: -- 172.21.15.181:0/3998019523 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558ec0761c20 con 0x558ec073f400 2024-08-26T00:00:04.034 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:00:03 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: starting mds.c at 2024-08-26T00:00:04.034 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:00:03 smithi181 bash[52677]: 6a38a30aa9617b90121800e0a4311b513d9ef44d19fe2cb8f64a639c4914746b 2024-08-26T00:00:04.034 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:00:03 smithi181 systemd[1]: Started Ceph mds.c for f89d317a-633c-11ef-bcd2-c7b262605968. 2024-08-26T00:00:04.530 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:04 smithi042 ceph-mon[17225]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:04.530 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:04 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:04.530 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:04 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:04.530 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:04 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:04.530 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:04 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-26T00:00:04.530 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:04 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-26T00:00:04.530 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:04 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:04.687 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:04 smithi043 ceph-mon[22091]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:04.687 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:04 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:04.687 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:04 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:04.687 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:04 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:04.687 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:04 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-26T00:00:04.687 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:04 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-26T00:00:04.687 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:04 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:04.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:04 smithi181 ceph-mon[22102]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:04.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:04 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:04.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:04 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:04.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:04 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:04.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:04 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-26T00:00:04.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:04 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-26T00:00:04.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:04 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:05.188 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:00:05.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:05 smithi042 ceph-mon[17225]: Deploying daemon mds.h on smithi043 2024-08-26T00:00:05.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:05 smithi042 ceph-mon[17225]: mds.? [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] up:boot 2024-08-26T00:00:05.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:05 smithi042 ceph-mon[17225]: fsmap 7 up:standby 2024-08-26T00:00:05.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:05 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-26T00:00:05.584 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:05.700 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:05 smithi043 ceph-mon[22091]: Deploying daemon mds.h on smithi043 2024-08-26T00:00:05.700 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:05 smithi043 ceph-mon[22091]: mds.? [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] up:boot 2024-08-26T00:00:05.700 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:05 smithi043 ceph-mon[22091]: fsmap 7 up:standby 2024-08-26T00:00:05.700 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:05 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-26T00:00:05.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:05 smithi181 ceph-mon[22102]: Deploying daemon mds.h on smithi043 2024-08-26T00:00:05.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:05 smithi181 ceph-mon[22102]: mds.? [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] up:boot 2024-08-26T00:00:05.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:05 smithi181 ceph-mon[22102]: fsmap 7 up:standby 2024-08-26T00:00:05.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:05 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-26T00:00:06.010 INFO:journalctl@ceph.mds.h.smithi043.stdout:Aug 26 00:00:05 smithi043 systemd[1]: Starting Ceph mds.h for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:00:06.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.183+0000 7fbc6de00640 1 -- 172.21.15.42:0/395156652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc68109c00 msgr2=0x7fbc68109fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:06.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.183+0000 7fbc6de00640 1 --2- 172.21.15.42:0/395156652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc68109c00 0x7fbc68109fe0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009900 tx=0x7fbc5802a410 comp rx=0 tx=0).stop 2024-08-26T00:00:06.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.183+0000 7fbc6de00640 1 -- 172.21.15.42:0/395156652 shutdown_connections 2024-08-26T00:00:06.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.183+0000 7fbc6de00640 1 --2- 172.21.15.42:0/395156652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbc681044f0 0x7fbc681109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:06.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.183+0000 7fbc6de00640 1 --2- 172.21.15.42:0/395156652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc68103b50 0x7fbc68103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:06.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.183+0000 7fbc6de00640 1 --2- 172.21.15.42:0/395156652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc68109c00 0x7fbc68109fe0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:06.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.183+0000 7fbc6de00640 1 -- 172.21.15.42:0/395156652 >> 172.21.15.42:0/395156652 conn(0x7fbc680ff830 msgr2=0x7fbc68101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:06.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.184+0000 7fbc6de00640 1 -- 172.21.15.42:0/395156652 shutdown_connections 2024-08-26T00:00:06.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.184+0000 7fbc6de00640 1 -- 172.21.15.42:0/395156652 wait complete. 2024-08-26T00:00:06.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.184+0000 7fbc6de00640 1 Processor -- start 2024-08-26T00:00:06.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.185+0000 7fbc6de00640 1 -- start start 2024-08-26T00:00:06.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.185+0000 7fbc6de00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbc68103b50 0x7fbc6819a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:06.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.185+0000 7fbc6de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc681044f0 0x7fbc6819a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:06.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.185+0000 7fbc6de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc68109c00 0x7fbc6819ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:06.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.185+0000 7fbc6de00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbc68113f60 con 0x7fbc68109c00 2024-08-26T00:00:06.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.185+0000 7fbc6de00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbc68113de0 con 0x7fbc681044f0 2024-08-26T00:00:06.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.185+0000 7fbc6de00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbc681140e0 con 0x7fbc68103b50 2024-08-26T00:00:06.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.185+0000 7fbc67400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc68109c00 0x7fbc6819ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.185+0000 7fbc66a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbc68103b50 0x7fbc6819a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.185+0000 7fbc67400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc68109c00 0x7fbc6819ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39178/0 (socket says 172.21.15.42:39178) 2024-08-26T00:00:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.185+0000 7fbc67400640 1 -- 172.21.15.42:0/4073362890 learned_addr learned my addr 172.21.15.42:0/4073362890 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.185+0000 7fbc66000640 1 --2- 172.21.15.42:0/4073362890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc681044f0 0x7fbc6819a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.186+0000 7fbc67400640 1 -- 172.21.15.42:0/4073362890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbc68103b50 msgr2=0x7fbc6819a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.186+0000 7fbc67400640 1 --2- 172.21.15.42:0/4073362890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbc68103b50 0x7fbc6819a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.186+0000 7fbc67400640 1 -- 172.21.15.42:0/4073362890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc681044f0 msgr2=0x7fbc6819a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.186+0000 7fbc67400640 1 --2- 172.21.15.42:0/4073362890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc681044f0 0x7fbc6819a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.186+0000 7fbc67400640 1 -- 172.21.15.42:0/4073362890 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc6819f2b0 con 0x7fbc68109c00 2024-08-26T00:00:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.186+0000 7fbc67400640 1 --2- 172.21.15.42:0/4073362890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc68109c00 0x7fbc6819ebd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbc6000eb10 tx=0x7fbc6000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.186+0000 7fbc6ca00640 1 -- 172.21.15.42:0/4073362890 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc60004b20 con 0x7fbc68109c00 2024-08-26T00:00:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.186+0000 7fbc6ca00640 1 -- 172.21.15.42:0/4073362890 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc60004cc0 con 0x7fbc68109c00 2024-08-26T00:00:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.186+0000 7fbc6ca00640 1 -- 172.21.15.42:0/4073362890 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc60010760 con 0x7fbc68109c00 2024-08-26T00:00:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.186+0000 7fbc6de00640 1 -- 172.21.15.42:0/4073362890 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc6819f5a0 con 0x7fbc68109c00 2024-08-26T00:00:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.186+0000 7fbc6de00640 1 -- 172.21.15.42:0/4073362890 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc681a6e80 con 0x7fbc68109c00 2024-08-26T00:00:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.187+0000 7fbc6de00640 1 -- 172.21.15.42:0/4073362890 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc68103fb0 con 0x7fbc68109c00 2024-08-26T00:00:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.190+0000 7fbc6ca00640 1 -- 172.21.15.42:0/4073362890 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbc60005000 con 0x7fbc68109c00 2024-08-26T00:00:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.191+0000 7fbc6ca00640 1 --2- 172.21.15.42:0/4073362890 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fbc4c0a2b80 0x7fbc4c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.191+0000 7fbc6ca00640 1 -- 172.21.15.42:0/4073362890 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fbc600cf660 con 0x7fbc68109c00 2024-08-26T00:00:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.191+0000 7fbc66a00640 1 --2- 172.21.15.42:0/4073362890 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fbc4c0a2b80 0x7fbc4c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.192+0000 7fbc66a00640 1 --2- 172.21.15.42:0/4073362890 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fbc4c0a2b80 0x7fbc4c0a5040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009230 tx=0x7fbc580058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:06.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.193+0000 7fbc6ca00640 1 -- 172.21.15.42:0/4073362890 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fbc6009c9c0 con 0x7fbc68109c00 2024-08-26T00:00:06.394 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:06 smithi043 ceph-mon[22091]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:06.395 INFO:journalctl@ceph.mds.h.smithi043.stdout:Aug 26 00:00:06 smithi043 podman[52648]: 2024-08-26 00:00:06.005692946 +0000 UTC m=+0.015530164 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34 2024-08-26T00:00:06.395 INFO:journalctl@ceph.mds.h.smithi043.stdout:Aug 26 00:00:06 smithi043 podman[52648]: 2024-08-26 00:00:06.108628901 +0000 UTC m=+0.118466159 container create 56cb0f11a01ea10b82cd10239a7a5b8f33f787601623311d26f27de0c37070e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-h, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-f273685, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-26T00:00:06.395 INFO:journalctl@ceph.mds.h.smithi043.stdout:Aug 26 00:00:06 smithi043 podman[52648]: 2024-08-26 00:00:06.394670376 +0000 UTC m=+0.404507593 container init 56cb0f11a01ea10b82cd10239a7a5b8f33f787601623311d26f27de0c37070e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-h, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-f273685, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.1) 2024-08-26T00:00:06.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.414+0000 7fbc6de00640 1 -- 172.21.15.42:0/4073362890 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc6819b660 con 0x7fbc68109c00 2024-08-26T00:00:06.415 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:06 smithi042 ceph-mon[17225]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:06.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.415+0000 7fbc6ca00640 1 -- 172.21.15.42:0/4073362890 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6391 (secure 0 0 0) 0x7fbc6009c2c0 con 0x7fbc68109c00 2024-08-26T00:00:06.416 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:00:06.416 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":8,"btime":"2024-08-26T00:00:04:292615+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-08-26T00:00:06.416 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 8 2024-08-26T00:00:06.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.418+0000 7fbc6de00640 1 -- 172.21.15.42:0/4073362890 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fbc4c0a2b80 msgr2=0x7fbc4c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:06.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.418+0000 7fbc6de00640 1 --2- 172.21.15.42:0/4073362890 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fbc4c0a2b80 0x7fbc4c0a5040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009230 tx=0x7fbc580058d0 comp rx=0 tx=0).stop 2024-08-26T00:00:06.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.418+0000 7fbc6de00640 1 -- 172.21.15.42:0/4073362890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc68109c00 msgr2=0x7fbc6819ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:06.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.418+0000 7fbc6de00640 1 --2- 172.21.15.42:0/4073362890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc68109c00 0x7fbc6819ebd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbc6000eb10 tx=0x7fbc6000c2d0 comp rx=0 tx=0).stop 2024-08-26T00:00:06.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.418+0000 7fbc6de00640 1 -- 172.21.15.42:0/4073362890 shutdown_connections 2024-08-26T00:00:06.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.418+0000 7fbc6de00640 1 --2- 172.21.15.42:0/4073362890 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fbc4c0a2b80 0x7fbc4c0a5040 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:06.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.418+0000 7fbc6de00640 1 --2- 172.21.15.42:0/4073362890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc68109c00 0x7fbc6819ebd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:06.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.418+0000 7fbc6de00640 1 --2- 172.21.15.42:0/4073362890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc681044f0 0x7fbc6819a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:06.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.418+0000 7fbc6de00640 1 --2- 172.21.15.42:0/4073362890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbc68103b50 0x7fbc6819a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:06.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.418+0000 7fbc6de00640 1 -- 172.21.15.42:0/4073362890 >> 172.21.15.42:0/4073362890 conn(0x7fbc680ff830 msgr2=0x7fbc68100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:06.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.418+0000 7fbc6de00640 1 -- 172.21.15.42:0/4073362890 shutdown_connections 2024-08-26T00:00:06.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:06.418+0000 7fbc6de00640 1 -- 172.21.15.42:0/4073362890 wait complete. 2024-08-26T00:00:06.760 INFO:journalctl@ceph.mds.h.smithi043.stdout:Aug 26 00:00:06 smithi043 podman[52648]: 2024-08-26 00:00:06.397747869 +0000 UTC m=+0.407585086 container start 56cb0f11a01ea10b82cd10239a7a5b8f33f787601623311d26f27de0c37070e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-f273685, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1) 2024-08-26T00:00:06.760 INFO:journalctl@ceph.mds.h.smithi043.stdout:Aug 26 00:00:06 smithi043 ceph-mds[52668]: -- 172.21.15.43:0/2912008316 <== mon.2 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562149bdd860 con 0x562149bbb000 2024-08-26T00:00:06.760 INFO:journalctl@ceph.mds.h.smithi043.stdout:Aug 26 00:00:06 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-h[52664]: starting mds.h at 2024-08-26T00:00:06.761 INFO:journalctl@ceph.mds.h.smithi043.stdout:Aug 26 00:00:06 smithi043 bash[52648]: 56cb0f11a01ea10b82cd10239a7a5b8f33f787601623311d26f27de0c37070e3 2024-08-26T00:00:06.761 INFO:journalctl@ceph.mds.h.smithi043.stdout:Aug 26 00:00:06 smithi043 systemd[1]: Started Ceph mds.h for f89d317a-633c-11ef-bcd2-c7b262605968. 2024-08-26T00:00:06.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:06 smithi181 ceph-mon[22102]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:07.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:07 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/4073362890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:00:07.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:07 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:07.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:07 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:07.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:07 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:07.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:07 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-26T00:00:07.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:07 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-26T00:00:07.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:07 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:07.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:07 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/4073362890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:00:07.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:07 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:07.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:07 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:07.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:07 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:07.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:07 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-26T00:00:07.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:07 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-26T00:00:07.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:07 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:07.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:07 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/4073362890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:00:07.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:07 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:07.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:07 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:07.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:07 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:07.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:07 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-26T00:00:07.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:07 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-26T00:00:07.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:07 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:08.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:08 smithi181 ceph-mon[22102]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:08.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:08 smithi181 ceph-mon[22102]: Deploying daemon mds.i on smithi181 2024-08-26T00:00:08.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:08 smithi181 ceph-mon[22102]: mds.? [v2:172.21.15.43:6836/2817851173,v1:172.21.15.43:6837/2817851173] up:boot 2024-08-26T00:00:08.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:08 smithi181 ceph-mon[22102]: fsmap 8 up:standby 2024-08-26T00:00:08.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:08 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-26T00:00:08.535 INFO:journalctl@ceph.mds.i.smithi181.stdout:Aug 26 00:00:08 smithi181 systemd[1]: Starting Ceph mds.i for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:00:08.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:08 smithi043 ceph-mon[22091]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:08.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:08 smithi043 ceph-mon[22091]: Deploying daemon mds.i on smithi181 2024-08-26T00:00:08.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:08 smithi043 ceph-mon[22091]: mds.? [v2:172.21.15.43:6836/2817851173,v1:172.21.15.43:6837/2817851173] up:boot 2024-08-26T00:00:08.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:08 smithi043 ceph-mon[22091]: fsmap 8 up:standby 2024-08-26T00:00:08.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:08 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-26T00:00:08.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:08 smithi042 ceph-mon[17225]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:08.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:08 smithi042 ceph-mon[17225]: Deploying daemon mds.i on smithi181 2024-08-26T00:00:08.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:08 smithi042 ceph-mon[17225]: mds.? [v2:172.21.15.43:6836/2817851173,v1:172.21.15.43:6837/2817851173] up:boot 2024-08-26T00:00:08.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:08 smithi042 ceph-mon[17225]: fsmap 8 up:standby 2024-08-26T00:00:08.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:08 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-26T00:00:08.904 INFO:journalctl@ceph.mds.i.smithi181.stdout:Aug 26 00:00:08 smithi181 podman[52976]: 2024-08-26 00:00:08.536321151 +0000 UTC m=+0.016474245 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34 2024-08-26T00:00:08.904 INFO:journalctl@ceph.mds.i.smithi181.stdout:Aug 26 00:00:08 smithi181 podman[52976]: 2024-08-26 00:00:08.6340992 +0000 UTC m=+0.114252290 container create 3f20ac14b5ad905ea744d1b519de37e8d18f3a94de5a716e86ed8689cdcbc764 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-i, GIT_CLEAN=True, RELEASE=squid-f273685, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1) 2024-08-26T00:00:08.904 INFO:journalctl@ceph.mds.i.smithi181.stdout:Aug 26 00:00:08 smithi181 podman[52976]: 2024-08-26 00:00:08.820144045 +0000 UTC m=+0.300297129 container init 3f20ac14b5ad905ea744d1b519de37e8d18f3a94de5a716e86ed8689cdcbc764 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-i, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-f273685, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-08-26T00:00:08.904 INFO:journalctl@ceph.mds.i.smithi181.stdout:Aug 26 00:00:08 smithi181 podman[52976]: 2024-08-26 00:00:08.822853988 +0000 UTC m=+0.303007072 container start 3f20ac14b5ad905ea744d1b519de37e8d18f3a94de5a716e86ed8689cdcbc764 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-f273685) 2024-08-26T00:00:08.904 INFO:journalctl@ceph.mds.i.smithi181.stdout:Aug 26 00:00:08 smithi181 ceph-mds[52995]: -- 172.21.15.181:0/3064863198 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55da5d4f5860 con 0x55da5d4d3000 2024-08-26T00:00:08.904 INFO:journalctl@ceph.mds.i.smithi181.stdout:Aug 26 00:00:08 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-i[52991]: starting mds.i at 2024-08-26T00:00:08.904 INFO:journalctl@ceph.mds.i.smithi181.stdout:Aug 26 00:00:08 smithi181 bash[52976]: 3f20ac14b5ad905ea744d1b519de37e8d18f3a94de5a716e86ed8689cdcbc764 2024-08-26T00:00:09.181 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:00:09.283 INFO:journalctl@ceph.mds.i.smithi181.stdout:Aug 26 00:00:08 smithi181 systemd[1]: Started Ceph mds.i for f89d317a-633c-11ef-bcd2-c7b262605968. 2024-08-26T00:00:10.135 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:10.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:09 smithi043 ceph-mon[22091]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:10.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:09 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:10.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:09 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:10.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:09 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:10.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:09 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-26T00:00:10.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:09 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-26T00:00:10.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:09 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:10.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:09 smithi043 ceph-mon[22091]: Deploying daemon mds.g on smithi042 2024-08-26T00:00:10.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:09 smithi043 ceph-mon[22091]: mds.? [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] up:boot 2024-08-26T00:00:10.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:09 smithi043 ceph-mon[22091]: fsmap 9 up:standby 2024-08-26T00:00:10.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:09 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-26T00:00:10.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:09 smithi042 ceph-mon[17225]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:10.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:09 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:10.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:09 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:10.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:09 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:10.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:09 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-26T00:00:10.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:09 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-26T00:00:10.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:09 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:10.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:09 smithi042 ceph-mon[17225]: Deploying daemon mds.g on smithi042 2024-08-26T00:00:10.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:09 smithi042 ceph-mon[17225]: mds.? [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] up:boot 2024-08-26T00:00:10.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:09 smithi042 ceph-mon[17225]: fsmap 9 up:standby 2024-08-26T00:00:10.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:09 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-26T00:00:10.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:09 smithi181 ceph-mon[22102]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:10.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:09 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:10.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:09 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:10.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:09 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:10.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:09 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-26T00:00:10.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:09 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-26T00:00:10.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:09 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:10.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:09 smithi181 ceph-mon[22102]: Deploying daemon mds.g on smithi042 2024-08-26T00:00:10.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:09 smithi181 ceph-mon[22102]: mds.? [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] up:boot 2024-08-26T00:00:10.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:09 smithi181 ceph-mon[22102]: fsmap 9 up:standby 2024-08-26T00:00:10.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:09 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-26T00:00:11.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.653+0000 7fe354200640 1 -- 172.21.15.42:0/862170633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe34c074c50 msgr2=0x7fe34c1123f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:11.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.653+0000 7fe354200640 1 --2- 172.21.15.42:0/862170633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe34c074c50 0x7fe34c1123f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe338009900 tx=0x7fe33802a480 comp rx=0 tx=0).stop 2024-08-26T00:00:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.654+0000 7fe354200640 1 -- 172.21.15.42:0/862170633 shutdown_connections 2024-08-26T00:00:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.654+0000 7fe354200640 1 --2- 172.21.15.42:0/862170633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe34c112930 0x7fe34c114d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.654+0000 7fe354200640 1 --2- 172.21.15.42:0/862170633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe34c074c50 0x7fe34c1123f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.654+0000 7fe354200640 1 --2- 172.21.15.42:0/862170633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe34c074330 0x7fe34c074710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.654+0000 7fe354200640 1 -- 172.21.15.42:0/862170633 >> 172.21.15.42:0/862170633 conn(0x7fe34c0fd660 msgr2=0x7fe34c0ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.654+0000 7fe354200640 1 -- 172.21.15.42:0/862170633 shutdown_connections 2024-08-26T00:00:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.654+0000 7fe354200640 1 -- 172.21.15.42:0/862170633 wait complete. 2024-08-26T00:00:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.655+0000 7fe354200640 1 Processor -- start 2024-08-26T00:00:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.655+0000 7fe354200640 1 -- start start 2024-08-26T00:00:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.655+0000 7fe354200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe34c074330 0x7fe34c1a45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.655+0000 7fe354200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe34c074c50 0x7fe34c1a4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.655+0000 7fe354200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe34c112930 0x7fe34c19e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.655+0000 7fe354200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c118330 con 0x7fe34c112930 2024-08-26T00:00:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.655+0000 7fe354200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c1181b0 con 0x7fe34c074c50 2024-08-26T00:00:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.655+0000 7fe354200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c1184b0 con 0x7fe34c074330 2024-08-26T00:00:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.655+0000 7fe352200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe34c112930 0x7fe34c19e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.655+0000 7fe352200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe34c112930 0x7fe34c19e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39196/0 (socket says 172.21.15.42:39196) 2024-08-26T00:00:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.656+0000 7fe352200640 1 -- 172.21.15.42:0/862061828 learned_addr learned my addr 172.21.15.42:0/862061828 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.656+0000 7fe350e00640 1 --2- 172.21.15.42:0/862061828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe34c074c50 0x7fe34c1a4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.656+0000 7fe351800640 1 --2- 172.21.15.42:0/862061828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe34c074330 0x7fe34c1a45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.656+0000 7fe351800640 1 -- 172.21.15.42:0/862061828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe34c074c50 msgr2=0x7fe34c1a4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.656+0000 7fe351800640 1 --2- 172.21.15.42:0/862061828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe34c074c50 0x7fe34c1a4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.656+0000 7fe351800640 1 -- 172.21.15.42:0/862061828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe34c112930 msgr2=0x7fe34c19e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.656+0000 7fe351800640 1 --2- 172.21.15.42:0/862061828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe34c112930 0x7fe34c19e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.656+0000 7fe351800640 1 -- 172.21.15.42:0/862061828 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34c19eef0 con 0x7fe34c074330 2024-08-26T00:00:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.656+0000 7fe352200640 1 --2- 172.21.15.42:0/862061828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe34c112930 0x7fe34c19e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:00:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.656+0000 7fe351800640 1 --2- 172.21.15.42:0/862061828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe34c074330 0x7fe34c1a45b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe34000e9f0 tx=0x7fe34000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.657+0000 7fe34a000640 1 -- 172.21.15.42:0/862061828 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34000cd80 con 0x7fe34c074330 2024-08-26T00:00:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.657+0000 7fe34a000640 1 -- 172.21.15.42:0/862061828 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3400035f0 con 0x7fe34c074330 2024-08-26T00:00:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.657+0000 7fe34a000640 1 -- 172.21.15.42:0/862061828 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340010690 con 0x7fe34c074330 2024-08-26T00:00:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.657+0000 7fe354200640 1 -- 172.21.15.42:0/862061828 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe34c19f1e0 con 0x7fe34c074330 2024-08-26T00:00:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.657+0000 7fe354200640 1 -- 172.21.15.42:0/862061828 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe34c1ab530 con 0x7fe34c074330 2024-08-26T00:00:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.658+0000 7fe354200640 1 -- 172.21.15.42:0/862061828 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe34c075a70 con 0x7fe34c074330 2024-08-26T00:00:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.660+0000 7fe34a000640 1 -- 172.21.15.42:0/862061828 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe340003b30 con 0x7fe34c074330 2024-08-26T00:00:11.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.661+0000 7fe34a000640 1 --2- 172.21.15.42:0/862061828 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe3340a2b80 0x7fe3340a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:11.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.661+0000 7fe34a000640 1 -- 172.21.15.42:0/862061828 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fe3400ceec0 con 0x7fe34c074330 2024-08-26T00:00:11.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.661+0000 7fe350e00640 1 --2- 172.21.15.42:0/862061828 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe3340a2b80 0x7fe3340a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:11.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.662+0000 7fe350e00640 1 --2- 172.21.15.42:0/862061828 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe3340a2b80 0x7fe3340a5040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe338000c00 tx=0x7fe338005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:11.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.663+0000 7fe34a000640 1 -- 172.21.15.42:0/862061828 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe34009c220 con 0x7fe34c074330 2024-08-26T00:00:11.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.898+0000 7fe354200640 1 -- 172.21.15.42:0/862061828 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe34c104d70 con 0x7fe34c074330 2024-08-26T00:00:11.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.898+0000 7fe34a000640 1 -- 172.21.15.42:0/862061828 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8043 (secure 0 0 0) 0x7fe34009bb20 con 0x7fe34c074330 2024-08-26T00:00:11.899 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:00:11.899 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":10,"btime":"2024-08-26T00:00:09:312352+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24494,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24532,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-26T00:00:11.899 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 10 2024-08-26T00:00:11.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.901+0000 7fe354200640 1 -- 172.21.15.42:0/862061828 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe3340a2b80 msgr2=0x7fe3340a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:11.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.901+0000 7fe354200640 1 --2- 172.21.15.42:0/862061828 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe3340a2b80 0x7fe3340a5040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe338000c00 tx=0x7fe338005b50 comp rx=0 tx=0).stop 2024-08-26T00:00:11.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.901+0000 7fe354200640 1 -- 172.21.15.42:0/862061828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe34c074330 msgr2=0x7fe34c1a45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:11.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.901+0000 7fe354200640 1 --2- 172.21.15.42:0/862061828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe34c074330 0x7fe34c1a45b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe34000e9f0 tx=0x7fe34000eeb0 comp rx=0 tx=0).stop 2024-08-26T00:00:11.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.901+0000 7fe354200640 1 -- 172.21.15.42:0/862061828 shutdown_connections 2024-08-26T00:00:11.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.901+0000 7fe354200640 1 --2- 172.21.15.42:0/862061828 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe3340a2b80 0x7fe3340a5040 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:11.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.901+0000 7fe354200640 1 --2- 172.21.15.42:0/862061828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe34c112930 0x7fe34c19e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:11.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.901+0000 7fe354200640 1 --2- 172.21.15.42:0/862061828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe34c074c50 0x7fe34c1a4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:11.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.901+0000 7fe354200640 1 --2- 172.21.15.42:0/862061828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe34c074330 0x7fe34c1a45b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:11.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.901+0000 7fe354200640 1 -- 172.21.15.42:0/862061828 >> 172.21.15.42:0/862061828 conn(0x7fe34c0fd660 msgr2=0x7fe34c0fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:11.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.901+0000 7fe354200640 1 -- 172.21.15.42:0/862061828 shutdown_connections 2024-08-26T00:00:11.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:11.901+0000 7fe354200640 1 -- 172.21.15.42:0/862061828 wait complete. 2024-08-26T00:00:12.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:11 smithi043 ceph-mon[22091]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:12.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:11 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/862061828' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:00:12.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:11 smithi042 ceph-mon[17225]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:12.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:11 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/862061828' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:00:12.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:11 smithi181 ceph-mon[22102]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:12.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:11 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/862061828' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:00:13.736 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:13 smithi042 ceph-mon[17225]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:13.736 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:13.736 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:13.736 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:13.736 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-26T00:00:13.736 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-26T00:00:13.736 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:13.736 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:13 smithi042 ceph-mon[17225]: Deploying daemon mds.a on smithi042 2024-08-26T00:00:13.736 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:13 smithi042 ceph-mon[17225]: mds.? [v2:172.21.15.42:6838/3168581452,v1:172.21.15.42:6839/3168581452] up:boot 2024-08-26T00:00:13.736 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:13 smithi042 ceph-mon[17225]: fsmap 10 up:standby 2024-08-26T00:00:13.737 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-08-26T00:00:13.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:13 smithi043 ceph-mon[22091]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:13.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:13 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:13.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:13 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:13.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:13 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:13.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:13 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-26T00:00:13.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:13 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-26T00:00:13.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:13 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:13.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:13 smithi043 ceph-mon[22091]: Deploying daemon mds.a on smithi042 2024-08-26T00:00:13.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:13 smithi043 ceph-mon[22091]: mds.? [v2:172.21.15.42:6838/3168581452,v1:172.21.15.42:6839/3168581452] up:boot 2024-08-26T00:00:13.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:13 smithi043 ceph-mon[22091]: fsmap 10 up:standby 2024-08-26T00:00:13.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:13 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-08-26T00:00:13.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:13 smithi181 ceph-mon[22102]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:13.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:13.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:13.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:13.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-26T00:00:13.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-26T00:00:13.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:13.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:13 smithi181 ceph-mon[22102]: Deploying daemon mds.a on smithi042 2024-08-26T00:00:13.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:13 smithi181 ceph-mon[22102]: mds.? [v2:172.21.15.42:6838/3168581452,v1:172.21.15.42:6839/3168581452] up:boot 2024-08-26T00:00:13.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:13 smithi181 ceph-mon[22102]: fsmap 10 up:standby 2024-08-26T00:00:13.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-08-26T00:00:14.886 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:00:15.555 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:15.700 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:15 smithi042 ceph-mon[17225]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:15.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:15 smithi181 ceph-mon[22102]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:15.857 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:15 smithi043 ceph-mon[22091]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:16.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.118+0000 7f017ce00640 1 -- 172.21.15.42:0/3306109418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0178074c80 msgr2=0x7f017810dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:16.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.118+0000 7f017ce00640 1 --2- 172.21.15.42:0/3306109418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0178074c80 0x7f017810dc90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0160009900 tx=0x7f016002a480 comp rx=0 tx=0).stop 2024-08-26T00:00:16.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.118+0000 7f017ce00640 1 -- 172.21.15.42:0/3306109418 shutdown_connections 2024-08-26T00:00:16.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.118+0000 7f017ce00640 1 --2- 172.21.15.42:0/3306109418 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f017810e1d0 0x7f01781105c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:16.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.118+0000 7f017ce00640 1 --2- 172.21.15.42:0/3306109418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0178074c80 0x7f017810dc90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:16.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.118+0000 7f017ce00640 1 --2- 172.21.15.42:0/3306109418 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0178074360 0x7f0178074740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:16.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.118+0000 7f017ce00640 1 -- 172.21.15.42:0/3306109418 >> 172.21.15.42:0/3306109418 conn(0x7f01780fd650 msgr2=0x7f01780ffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:16.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.118+0000 7f017ce00640 1 -- 172.21.15.42:0/3306109418 shutdown_connections 2024-08-26T00:00:16.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.118+0000 7f017ce00640 1 -- 172.21.15.42:0/3306109418 wait complete. 2024-08-26T00:00:16.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.119+0000 7f017ce00640 1 Processor -- start 2024-08-26T00:00:16.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.119+0000 7f017ce00640 1 -- start start 2024-08-26T00:00:16.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.119+0000 7f017ce00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0178074360 0x7f017819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:16.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.119+0000 7f017ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0178074c80 0x7f017819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:16.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.119+0000 7f017ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f017810e1d0 0x7f017819ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:16.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.119+0000 7f017ce00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0178113f70 con 0x7f0178074c80 2024-08-26T00:00:16.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.119+0000 7f017ce00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0178113df0 con 0x7f017810e1d0 2024-08-26T00:00:16.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.119+0000 7f017ce00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f01781140f0 con 0x7f0178074360 2024-08-26T00:00:16.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.120+0000 7f016d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0178074c80 0x7f017819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:16.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.120+0000 7f0175e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0178074360 0x7f017819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:16.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.120+0000 7f0176800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f017810e1d0 0x7f017819ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:16.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.120+0000 7f0175e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0178074360 0x7f017819a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:43362/0 (socket says 172.21.15.42:43362) 2024-08-26T00:00:16.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.120+0000 7f0175e00640 1 -- 172.21.15.42:0/1526187716 learned_addr learned my addr 172.21.15.42:0/1526187716 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:16.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.120+0000 7f0176800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f017810e1d0 0x7f017819ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:35106/0 (socket says 172.21.15.42:35106) 2024-08-26T00:00:16.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.120+0000 7f0176800640 1 -- 172.21.15.42:0/1526187716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0178074360 msgr2=0x7f017819a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:16.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.120+0000 7f0176800640 1 --2- 172.21.15.42:0/1526187716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0178074360 0x7f017819a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:16.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.120+0000 7f0176800640 1 -- 172.21.15.42:0/1526187716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0178074c80 msgr2=0x7f017819a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:16.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.120+0000 7f0176800640 1 --2- 172.21.15.42:0/1526187716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0178074c80 0x7f017819a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:16.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.120+0000 7f0176800640 1 -- 172.21.15.42:0/1526187716 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017819f420 con 0x7f017810e1d0 2024-08-26T00:00:16.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.120+0000 7f0176800640 1 --2- 172.21.15.42:0/1526187716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f017810e1d0 0x7f017819ed40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0170005fd0 tx=0x7f017000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:16.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.121+0000 7f016f400640 1 -- 172.21.15.42:0/1526187716 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170003b70 con 0x7f017810e1d0 2024-08-26T00:00:16.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.121+0000 7f016f400640 1 -- 172.21.15.42:0/1526187716 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0170003d10 con 0x7f017810e1d0 2024-08-26T00:00:16.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.121+0000 7f016f400640 1 -- 172.21.15.42:0/1526187716 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170010830 con 0x7f017810e1d0 2024-08-26T00:00:16.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.121+0000 7f017ce00640 1 -- 172.21.15.42:0/1526187716 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f017819f710 con 0x7f017810e1d0 2024-08-26T00:00:16.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.121+0000 7f017ce00640 1 -- 172.21.15.42:0/1526187716 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01781a6ff0 con 0x7f017810e1d0 2024-08-26T00:00:16.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.122+0000 7f017ce00640 1 -- 172.21.15.42:0/1526187716 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0178074740 con 0x7f017810e1d0 2024-08-26T00:00:16.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.124+0000 7f016f400640 1 -- 172.21.15.42:0/1526187716 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0170004020 con 0x7f017810e1d0 2024-08-26T00:00:16.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.125+0000 7f016f400640 1 --2- 172.21.15.42:0/1526187716 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f015c0a2c00 0x7f015c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:16.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.125+0000 7f016f400640 1 -- 172.21.15.42:0/1526187716 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f01700cf110 con 0x7f017810e1d0 2024-08-26T00:00:16.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.125+0000 7f0175e00640 1 --2- 172.21.15.42:0/1526187716 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f015c0a2c00 0x7f015c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:16.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.126+0000 7f0175e00640 1 --2- 172.21.15.42:0/1526187716 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f015c0a2c00 0x7f015c0a50c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0168009cd0 tx=0x7f0168005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:16.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.129+0000 7f016f400640 1 -- 172.21.15.42:0/1526187716 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f017009c470 con 0x7f017810e1d0 2024-08-26T00:00:16.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.353+0000 7f017ce00640 1 -- 172.21.15.42:0/1526187716 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f017802d6a0 con 0x7f017810e1d0 2024-08-26T00:00:16.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.354+0000 7f016f400640 1 -- 172.21.15.42:0/1526187716 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9695 (secure 0 0 0) 0x7f017009bd70 con 0x7f017810e1d0 2024-08-26T00:00:16.355 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:00:16.355 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":12,"btime":"2024-08-26T00:00:15:510862+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3168581452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3168581452},{"type":"v1","addr":"172.21.15.42:6839","nonce":3168581452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/3533492491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":3533492491},{"type":"v1","addr":"172.21.15.42:6841","nonce":3533492491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24494,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24532,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-26T00:00:16.355 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 12 2024-08-26T00:00:16.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.356+0000 7f017ce00640 1 -- 172.21.15.42:0/1526187716 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f015c0a2c00 msgr2=0x7f015c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:16.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.356+0000 7f017ce00640 1 --2- 172.21.15.42:0/1526187716 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f015c0a2c00 0x7f015c0a50c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0168009cd0 tx=0x7f0168005f90 comp rx=0 tx=0).stop 2024-08-26T00:00:16.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.356+0000 7f017ce00640 1 -- 172.21.15.42:0/1526187716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f017810e1d0 msgr2=0x7f017819ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:16.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.356+0000 7f017ce00640 1 --2- 172.21.15.42:0/1526187716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f017810e1d0 0x7f017819ed40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0170005fd0 tx=0x7f017000c6a0 comp rx=0 tx=0).stop 2024-08-26T00:00:16.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.357+0000 7f017ce00640 1 -- 172.21.15.42:0/1526187716 shutdown_connections 2024-08-26T00:00:16.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.357+0000 7f017ce00640 1 --2- 172.21.15.42:0/1526187716 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f015c0a2c00 0x7f015c0a50c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:16.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.357+0000 7f017ce00640 1 --2- 172.21.15.42:0/1526187716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f017810e1d0 0x7f017819ed40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:16.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.357+0000 7f017ce00640 1 --2- 172.21.15.42:0/1526187716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0178074c80 0x7f017819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:16.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.357+0000 7f017ce00640 1 --2- 172.21.15.42:0/1526187716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0178074360 0x7f017819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:16.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.357+0000 7f017ce00640 1 -- 172.21.15.42:0/1526187716 >> 172.21.15.42:0/1526187716 conn(0x7f01780fd650 msgr2=0x7f01780fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:16.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.357+0000 7f017ce00640 1 -- 172.21.15.42:0/1526187716 shutdown_connections 2024-08-26T00:00:16.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:16.357+0000 7f017ce00640 1 -- 172.21.15.42:0/1526187716 wait complete. 2024-08-26T00:00:16.683 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:16 smithi042 ceph-mon[17225]: mds.? [v2:172.21.15.42:6840/3533492491,v1:172.21.15.42:6841/3533492491] up:boot 2024-08-26T00:00:16.683 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:16 smithi042 ceph-mon[17225]: fsmap 11 up:standby 2024-08-26T00:00:16.683 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:16 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-08-26T00:00:16.683 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:16 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:16.684 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:16 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:16.684 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:16 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:16.684 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:16 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-26T00:00:16.684 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:16 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-26T00:00:16.684 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:16 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:16.684 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:16 smithi042 ceph-mon[17225]: Deploying daemon mds.b on smithi043 2024-08-26T00:00:16.684 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:16 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1526187716' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:00:16.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:16 smithi181 ceph-mon[22102]: mds.? [v2:172.21.15.42:6840/3533492491,v1:172.21.15.42:6841/3533492491] up:boot 2024-08-26T00:00:16.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:16 smithi181 ceph-mon[22102]: fsmap 11 up:standby 2024-08-26T00:00:16.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:16 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-08-26T00:00:16.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:16 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:16.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:16 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:16.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:16 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:16.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:16 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-26T00:00:16.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:16 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-26T00:00:16.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:16 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:16.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:16 smithi181 ceph-mon[22102]: Deploying daemon mds.b on smithi043 2024-08-26T00:00:16.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:16 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1526187716' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:00:16.823 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:16 smithi043 ceph-mon[22091]: mds.? [v2:172.21.15.42:6840/3533492491,v1:172.21.15.42:6841/3533492491] up:boot 2024-08-26T00:00:16.823 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:16 smithi043 ceph-mon[22091]: fsmap 11 up:standby 2024-08-26T00:00:16.823 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:16 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-08-26T00:00:16.824 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:16 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:16.824 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:16 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:16.824 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:16 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:16.824 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:16 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-26T00:00:16.824 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:16 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-26T00:00:16.824 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:16 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:16.824 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:16 smithi043 ceph-mon[22091]: Deploying daemon mds.b on smithi043 2024-08-26T00:00:16.824 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:16 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1526187716' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:00:17.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:17 smithi043 ceph-mon[22091]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:17.761 INFO:journalctl@ceph.mds.b.smithi043.stdout:Aug 26 00:00:17 smithi043 systemd[1]: Starting Ceph mds.b for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:00:17.864 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:17 smithi181 ceph-mon[22102]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:18.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:17 smithi042 ceph-mon[17225]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:18.048 INFO:journalctl@ceph.mds.b.smithi043.stdout:Aug 26 00:00:17 smithi043 podman[52964]: 2024-08-26 00:00:17.693152225 +0000 UTC m=+0.015812597 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34 2024-08-26T00:00:18.048 INFO:journalctl@ceph.mds.b.smithi043.stdout:Aug 26 00:00:17 smithi043 podman[52964]: 2024-08-26 00:00:17.820439763 +0000 UTC m=+0.143100122 container create 186e65419a0f912af47099e818fbea5cb7db843361712f68de0d7d5e14782daa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-f273685, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-08-26T00:00:18.048 INFO:journalctl@ceph.mds.b.smithi043.stdout:Aug 26 00:00:18 smithi043 podman[52964]: 2024-08-26 00:00:18.047973862 +0000 UTC m=+0.370634223 container init 186e65419a0f912af47099e818fbea5cb7db843361712f68de0d7d5e14782daa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-b, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-f273685, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-08-26T00:00:18.510 INFO:journalctl@ceph.mds.b.smithi043.stdout:Aug 26 00:00:18 smithi043 podman[52964]: 2024-08-26 00:00:18.051058931 +0000 UTC m=+0.373719302 container start 186e65419a0f912af47099e818fbea5cb7db843361712f68de0d7d5e14782daa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-b, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, RELEASE=squid-f273685, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-08-26T00:00:18.510 INFO:journalctl@ceph.mds.b.smithi043.stdout:Aug 26 00:00:18 smithi043 ceph-mds[52983]: -- 172.21.15.43:0/3889812177 <== mon.2 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56277bf0f860 con 0x56277beec800 2024-08-26T00:00:18.510 INFO:journalctl@ceph.mds.b.smithi043.stdout:Aug 26 00:00:18 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-b[52979]: starting mds.b at 2024-08-26T00:00:18.510 INFO:journalctl@ceph.mds.b.smithi043.stdout:Aug 26 00:00:18 smithi043 bash[52964]: 186e65419a0f912af47099e818fbea5cb7db843361712f68de0d7d5e14782daa 2024-08-26T00:00:18.510 INFO:journalctl@ceph.mds.b.smithi043.stdout:Aug 26 00:00:18 smithi043 systemd[1]: Started Ceph mds.b for f89d317a-633c-11ef-bcd2-c7b262605968. 2024-08-26T00:00:19.119 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:00:19.273 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:19 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:19.273 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:19 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:19.273 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:19 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:19.273 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:19 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:19.273 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:19 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:19.273 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:19 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:00:19.273 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:19 smithi181 ceph-mon[22102]: mds.? [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] up:boot 2024-08-26T00:00:19.273 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:19 smithi181 ceph-mon[22102]: fsmap 12 up:standby 2024-08-26T00:00:19.274 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:19 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-26T00:00:19.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:19 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:19.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:19 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:19.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:19 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:19.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:19 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:19.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:19 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:19.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:19 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:00:19.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:19 smithi043 ceph-mon[22091]: mds.? [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] up:boot 2024-08-26T00:00:19.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:19 smithi043 ceph-mon[22091]: fsmap 12 up:standby 2024-08-26T00:00:19.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:19 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-26T00:00:19.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:19 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:19.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:19 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:19.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:19 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:19.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:19 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:19.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:19 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:19.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:19 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:00:19.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:19 smithi042 ceph-mon[17225]: mds.? [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] up:boot 2024-08-26T00:00:19.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:19 smithi042 ceph-mon[17225]: fsmap 12 up:standby 2024-08-26T00:00:19.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:19 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-26T00:00:19.703 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:20.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.272+0000 7faf26600640 1 -- 172.21.15.42:0/1267231925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf20109c00 msgr2=0x7faf20109fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:20.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.272+0000 7faf26600640 1 --2- 172.21.15.42:0/1267231925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf20109c00 0x7faf20109fe0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faf10009930 tx=0x7faf1002a420 comp rx=0 tx=0).stop 2024-08-26T00:00:20.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.272+0000 7faf26600640 1 -- 172.21.15.42:0/1267231925 shutdown_connections 2024-08-26T00:00:20.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.272+0000 7faf26600640 1 --2- 172.21.15.42:0/1267231925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf201044f0 0x7faf201109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:20.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.272+0000 7faf26600640 1 --2- 172.21.15.42:0/1267231925 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf20103b50 0x7faf20103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:20.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.272+0000 7faf26600640 1 --2- 172.21.15.42:0/1267231925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf20109c00 0x7faf20109fe0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:20.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.272+0000 7faf26600640 1 -- 172.21.15.42:0/1267231925 >> 172.21.15.42:0/1267231925 conn(0x7faf200ff830 msgr2=0x7faf20101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:20.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.272+0000 7faf26600640 1 -- 172.21.15.42:0/1267231925 shutdown_connections 2024-08-26T00:00:20.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.273+0000 7faf26600640 1 -- 172.21.15.42:0/1267231925 wait complete. 2024-08-26T00:00:20.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.273+0000 7faf26600640 1 Processor -- start 2024-08-26T00:00:20.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.274+0000 7faf26600640 1 -- start start 2024-08-26T00:00:20.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.274+0000 7faf26600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf20103b50 0x7faf2019a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:20.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.274+0000 7faf26600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf201044f0 0x7faf2019a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:20.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.274+0000 7faf26600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf20109c00 0x7faf2019ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:20.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.274+0000 7faf26600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faf20113f60 con 0x7faf20103b50 2024-08-26T00:00:20.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.274+0000 7faf26600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faf20113de0 con 0x7faf20109c00 2024-08-26T00:00:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.274+0000 7faf26600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7faf201140e0 con 0x7faf201044f0 2024-08-26T00:00:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.274+0000 7faf17e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf201044f0 0x7faf2019a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.274+0000 7faf17e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf201044f0 0x7faf2019a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:43384/0 (socket says 172.21.15.42:43384) 2024-08-26T00:00:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.274+0000 7faf17e00640 1 -- 172.21.15.42:0/1106131989 learned_addr learned my addr 172.21.15.42:0/1106131989 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.274+0000 7faf1f400640 1 --2- 172.21.15.42:0/1106131989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf20103b50 0x7faf2019a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.274+0000 7faf1fe00640 1 --2- 172.21.15.42:0/1106131989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf20109c00 0x7faf2019ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.275+0000 7faf17e00640 1 -- 172.21.15.42:0/1106131989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf20109c00 msgr2=0x7faf2019ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.275+0000 7faf17e00640 1 --2- 172.21.15.42:0/1106131989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf20109c00 0x7faf2019ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.275+0000 7faf17e00640 1 -- 172.21.15.42:0/1106131989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf20103b50 msgr2=0x7faf2019a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.275+0000 7faf17e00640 1 --2- 172.21.15.42:0/1106131989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf20103b50 0x7faf2019a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.275+0000 7faf17e00640 1 -- 172.21.15.42:0/1106131989 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2019f310 con 0x7faf201044f0 2024-08-26T00:00:20.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.275+0000 7faf1f400640 1 --2- 172.21.15.42:0/1106131989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf20103b50 0x7faf2019a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:00:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.275+0000 7faf17e00640 1 --2- 172.21.15.42:0/1106131989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf201044f0 0x7faf2019a8a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faf0800e9f0 tx=0x7faf0800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.276+0000 7faf1cc00640 1 -- 172.21.15.42:0/1106131989 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0800cd80 con 0x7faf201044f0 2024-08-26T00:00:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.276+0000 7faf26600640 1 -- 172.21.15.42:0/1106131989 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf2019f600 con 0x7faf201044f0 2024-08-26T00:00:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.276+0000 7faf1cc00640 1 -- 172.21.15.42:0/1106131989 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf08005500 con 0x7faf201044f0 2024-08-26T00:00:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.276+0000 7faf1cc00640 1 -- 172.21.15.42:0/1106131989 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08010690 con 0x7faf201044f0 2024-08-26T00:00:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.276+0000 7faf26600640 1 -- 172.21.15.42:0/1106131989 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf201a6ee0 con 0x7faf201044f0 2024-08-26T00:00:20.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.277+0000 7faf26600640 1 -- 172.21.15.42:0/1106131989 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf20103fb0 con 0x7faf201044f0 2024-08-26T00:00:20.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.279+0000 7faf1cc00640 1 -- 172.21.15.42:0/1106131989 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7faf08004f60 con 0x7faf201044f0 2024-08-26T00:00:20.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.280+0000 7faf1cc00640 1 --2- 172.21.15.42:0/1106131989 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7faf040a2b80 0x7faf040a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:20.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.280+0000 7faf1cc00640 1 -- 172.21.15.42:0/1106131989 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7faf080cf1e0 con 0x7faf201044f0 2024-08-26T00:00:20.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.280+0000 7faf1f400640 1 --2- 172.21.15.42:0/1106131989 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7faf040a2b80 0x7faf040a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:20.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.281+0000 7faf1f400640 1 --2- 172.21.15.42:0/1106131989 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7faf040a2b80 0x7faf040a5040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faf10000c00 tx=0x7faf10005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:20.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.284+0000 7faf1cc00640 1 -- 172.21.15.42:0/1106131989 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7faf08016330 con 0x7faf201044f0 2024-08-26T00:00:20.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:20 smithi043 ceph-mon[22091]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:20.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:20 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:20.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:20 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:20.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:20 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:20.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:20 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:20.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.524+0000 7faf26600640 1 -- 172.21.15.42:0/1106131989 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf2002d6a0 con 0x7faf201044f0 2024-08-26T00:00:20.525 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:20 smithi042 ceph-mon[17225]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:20.525 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:20 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:20.526 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:20 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:20.526 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:20 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:20.526 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:20 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:20.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.525+0000 7faf1cc00640 1 -- 172.21.15.42:0/1106131989 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10521 (secure 0 0 0) 0x7faf0809c540 con 0x7faf201044f0 2024-08-26T00:00:20.527 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:00:20.527 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":13,"btime":"2024-08-26T00:00:18:575779+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3168581452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3168581452},{"type":"v1","addr":"172.21.15.42:6839","nonce":3168581452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/3533492491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":3533492491},{"type":"v1","addr":"172.21.15.42:6841","nonce":3533492491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24494,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24527,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/2653014277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2653014277},{"type":"v1","addr":"172.21.15.43:6839","nonce":2653014277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24532,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-26T00:00:20.527 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 13 2024-08-26T00:00:20.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.529+0000 7faf26600640 1 -- 172.21.15.42:0/1106131989 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7faf040a2b80 msgr2=0x7faf040a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:20.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.529+0000 7faf26600640 1 --2- 172.21.15.42:0/1106131989 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7faf040a2b80 0x7faf040a5040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faf10000c00 tx=0x7faf10005a20 comp rx=0 tx=0).stop 2024-08-26T00:00:20.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.529+0000 7faf26600640 1 -- 172.21.15.42:0/1106131989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf201044f0 msgr2=0x7faf2019a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:20.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.529+0000 7faf26600640 1 --2- 172.21.15.42:0/1106131989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf201044f0 0x7faf2019a8a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faf0800e9f0 tx=0x7faf0800edf0 comp rx=0 tx=0).stop 2024-08-26T00:00:20.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.529+0000 7faf26600640 1 -- 172.21.15.42:0/1106131989 shutdown_connections 2024-08-26T00:00:20.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.529+0000 7faf26600640 1 --2- 172.21.15.42:0/1106131989 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7faf040a2b80 0x7faf040a5040 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:20.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.529+0000 7faf26600640 1 --2- 172.21.15.42:0/1106131989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf20109c00 0x7faf2019ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:20.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.529+0000 7faf26600640 1 --2- 172.21.15.42:0/1106131989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf201044f0 0x7faf2019a8a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:20.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.529+0000 7faf26600640 1 --2- 172.21.15.42:0/1106131989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf20103b50 0x7faf2019a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:20.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.529+0000 7faf26600640 1 -- 172.21.15.42:0/1106131989 >> 172.21.15.42:0/1106131989 conn(0x7faf200ff830 msgr2=0x7faf20100f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:20.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.529+0000 7faf26600640 1 -- 172.21.15.42:0/1106131989 shutdown_connections 2024-08-26T00:00:20.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:20.529+0000 7faf26600640 1 -- 172.21.15.42:0/1106131989 wait complete. 2024-08-26T00:00:20.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:20 smithi181 ceph-mon[22102]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:20.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:20 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:20.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:20 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:20.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:20 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:20.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:20 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:21.398 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-08-26T00:00:21.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:21 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1106131989' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:00:21.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:21 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1106131989' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:00:21.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:21 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1106131989' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:00:21.799 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:22.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.336+0000 7f2373400640 1 -- 172.21.15.42:0/4014109661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f236c109c00 msgr2=0x7f236c109fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:22.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.336+0000 7f2373400640 1 --2- 172.21.15.42:0/4014109661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f236c109c00 0x7f236c109fe0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2360009900 tx=0x7f236002a410 comp rx=0 tx=0).stop 2024-08-26T00:00:22.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.336+0000 7f2373400640 1 -- 172.21.15.42:0/4014109661 shutdown_connections 2024-08-26T00:00:22.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.336+0000 7f2373400640 1 --2- 172.21.15.42:0/4014109661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f236c1044f0 0x7f236c1109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:22.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.336+0000 7f2373400640 1 --2- 172.21.15.42:0/4014109661 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f236c103b50 0x7f236c103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:22.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.336+0000 7f2373400640 1 --2- 172.21.15.42:0/4014109661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f236c109c00 0x7f236c109fe0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:22.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.336+0000 7f2373400640 1 -- 172.21.15.42:0/4014109661 >> 172.21.15.42:0/4014109661 conn(0x7f236c0ff830 msgr2=0x7f236c101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:22.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.336+0000 7f2373400640 1 -- 172.21.15.42:0/4014109661 shutdown_connections 2024-08-26T00:00:22.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.336+0000 7f2373400640 1 -- 172.21.15.42:0/4014109661 wait complete. 2024-08-26T00:00:22.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.337+0000 7f2373400640 1 Processor -- start 2024-08-26T00:00:22.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.337+0000 7f2373400640 1 -- start start 2024-08-26T00:00:22.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.338+0000 7f2373400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f236c103b50 0x7f236c19a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:22.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.338+0000 7f2373400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f236c1044f0 0x7f236c19a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:22.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.338+0000 7f2373400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f236c109c00 0x7f236c19eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:22.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.338+0000 7f2373400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f236c113f70 con 0x7f236c103b50 2024-08-26T00:00:22.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.338+0000 7f2373400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f236c113df0 con 0x7f236c1044f0 2024-08-26T00:00:22.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.338+0000 7f2373400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f236c1140f0 con 0x7f236c109c00 2024-08-26T00:00:22.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.338+0000 7f2370a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f236c103b50 0x7f236c19a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:22.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.338+0000 7f2371400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f236c109c00 0x7f236c19eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:22.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.338+0000 7f236be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f236c1044f0 0x7f236c19a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:22.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.338+0000 7f2371400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f236c109c00 0x7f236c19eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:43410/0 (socket says 172.21.15.42:43410) 2024-08-26T00:00:22.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.338+0000 7f2371400640 1 -- 172.21.15.42:0/1462990472 learned_addr learned my addr 172.21.15.42:0/1462990472 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:22.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.339+0000 7f236be00640 1 -- 172.21.15.42:0/1462990472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f236c109c00 msgr2=0x7f236c19eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:22.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.339+0000 7f236be00640 1 --2- 172.21.15.42:0/1462990472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f236c109c00 0x7f236c19eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:22.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.339+0000 7f236be00640 1 -- 172.21.15.42:0/1462990472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f236c103b50 msgr2=0x7f236c19a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:22.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.339+0000 7f236be00640 1 --2- 172.21.15.42:0/1462990472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f236c103b50 0x7f236c19a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:22.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.339+0000 7f236be00640 1 -- 172.21.15.42:0/1462990472 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236c19f380 con 0x7f236c1044f0 2024-08-26T00:00:22.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.339+0000 7f2371400640 1 --2- 172.21.15.42:0/1462990472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f236c109c00 0x7f236c19eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:00:22.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.339+0000 7f236be00640 1 --2- 172.21.15.42:0/1462990472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f236c1044f0 0x7f236c19a910 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f235800e9f0 tx=0x7f235800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:22.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.339+0000 7f2369600640 1 -- 172.21.15.42:0/1462990472 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235800ccc0 con 0x7f236c1044f0 2024-08-26T00:00:22.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.339+0000 7f2369600640 1 -- 172.21.15.42:0/1462990472 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2358010910 con 0x7f236c1044f0 2024-08-26T00:00:22.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.339+0000 7f2373400640 1 -- 172.21.15.42:0/1462990472 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f236c19f670 con 0x7f236c1044f0 2024-08-26T00:00:22.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.339+0000 7f2369600640 1 -- 172.21.15.42:0/1462990472 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2358018960 con 0x7f236c1044f0 2024-08-26T00:00:22.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.340+0000 7f2373400640 1 -- 172.21.15.42:0/1462990472 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f236c1a6f50 con 0x7f236c1044f0 2024-08-26T00:00:22.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.341+0000 7f2373400640 1 -- 172.21.15.42:0/1462990472 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f236c103fb0 con 0x7f236c1044f0 2024-08-26T00:00:22.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.342+0000 7f2369600640 1 -- 172.21.15.42:0/1462990472 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2358010ac0 con 0x7f236c1044f0 2024-08-26T00:00:22.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.344+0000 7f2369600640 1 --2- 172.21.15.42:0/1462990472 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f23540a2c00 0x7f23540a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:22.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.344+0000 7f2369600640 1 -- 172.21.15.42:0/1462990472 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f23580cef30 con 0x7f236c1044f0 2024-08-26T00:00:22.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.344+0000 7f2370a00640 1 --2- 172.21.15.42:0/1462990472 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f23540a2c00 0x7f23540a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:22.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.345+0000 7f2370a00640 1 --2- 172.21.15.42:0/1462990472 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f23540a2c00 0x7f23540a50c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2360000c00 tx=0x7f2360005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:22.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.347+0000 7f2369600640 1 -- 172.21.15.42:0/1462990472 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f235809bc40 con 0x7f236c1044f0 2024-08-26T00:00:22.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:22 smithi043 ceph-mon[22091]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:22.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:22 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:22.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:22 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:22.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:22 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:22.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:22 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:00:22.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:22 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:22.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:22 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:00:22.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:22 smithi042 ceph-mon[17225]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:22.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:22 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:22.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:22 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:22.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:22 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:22.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:22 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:00:22.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:22 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:22.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:22 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:00:22.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:22 smithi181 ceph-mon[22102]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:22.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:22 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:22.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:22 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:22.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:22 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:22.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:22 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:00:22.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:22 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:22.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:22 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:00:22.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.559+0000 7f2373400640 1 -- 172.21.15.42:0/1462990472 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f236c10c000 con 0x7f236c1044f0 2024-08-26T00:00:22.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.560+0000 7f2369600640 1 -- 172.21.15.42:0/1462990472 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) ==== 84+0+65 (secure 0 0 0) 0x7f235809ff40 con 0x7f236c1044f0 2024-08-26T00:00:22.561 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:00:22.561 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-08-26T00:00:22.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:00:22.561 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-08-26T00:00:22.561 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-08-26T00:00:22.562 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:00:22.562 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-08-26T00:00:22.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.562+0000 7f2373400640 1 -- 172.21.15.42:0/1462990472 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f23540a2c00 msgr2=0x7f23540a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:22.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.562+0000 7f2373400640 1 --2- 172.21.15.42:0/1462990472 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f23540a2c00 0x7f23540a50c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2360000c00 tx=0x7f2360005b50 comp rx=0 tx=0).stop 2024-08-26T00:00:22.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.562+0000 7f2373400640 1 -- 172.21.15.42:0/1462990472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f236c1044f0 msgr2=0x7f236c19a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:22.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.562+0000 7f2373400640 1 --2- 172.21.15.42:0/1462990472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f236c1044f0 0x7f236c19a910 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f235800e9f0 tx=0x7f235800eeb0 comp rx=0 tx=0).stop 2024-08-26T00:00:22.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.562+0000 7f2373400640 1 -- 172.21.15.42:0/1462990472 shutdown_connections 2024-08-26T00:00:22.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.562+0000 7f2373400640 1 --2- 172.21.15.42:0/1462990472 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f23540a2c00 0x7f23540a50c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:22.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.562+0000 7f2373400640 1 --2- 172.21.15.42:0/1462990472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f236c109c00 0x7f236c19eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:22.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.562+0000 7f2373400640 1 --2- 172.21.15.42:0/1462990472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f236c1044f0 0x7f236c19a910 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:22.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.562+0000 7f2373400640 1 --2- 172.21.15.42:0/1462990472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f236c103b50 0x7f236c19a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:22.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.562+0000 7f2373400640 1 -- 172.21.15.42:0/1462990472 >> 172.21.15.42:0/1462990472 conn(0x7f236c0ff830 msgr2=0x7f236c100f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:22.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.562+0000 7f2373400640 1 -- 172.21.15.42:0/1462990472 shutdown_connections 2024-08-26T00:00:22.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:22.562+0000 7f2373400640 1 -- 172.21.15.42:0/1462990472 wait complete. 2024-08-26T00:00:23.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:23 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:23.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:23 smithi043 ceph-mon[22091]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:23.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:23 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1462990472' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-08-26T00:00:23.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:23 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:23.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:23 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:23.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:23 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:23.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:23 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:23.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:23 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:23.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:23 smithi042 ceph-mon[17225]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:23.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:23 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1462990472' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-08-26T00:00:23.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:23 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:23.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:23 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:23.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:23 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:23.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:23 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:23.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:23 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:23.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:23 smithi181 ceph-mon[22102]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:23.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:23 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1462990472' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-08-26T00:00:23.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:23 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:23.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:23 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:23.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:23 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:23.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:23 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:23.879 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-26T00:00:23.879 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-26T00:00:24.303 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:24.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.850+0000 7fcac0c00640 1 -- 172.21.15.42:0/3611593136 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcabc103db0 msgr2=0x7fcabc104190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:24.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.850+0000 7fcac0c00640 1 --2- 172.21.15.42:0/3611593136 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcabc103db0 0x7fcabc104190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcaac009900 tx=0x7fcaac02a410 comp rx=0 tx=0).stop 2024-08-26T00:00:24.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.850+0000 7fcac0c00640 1 -- 172.21.15.42:0/3611593136 shutdown_connections 2024-08-26T00:00:24.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.850+0000 7fcac0c00640 1 --2- 172.21.15.42:0/3611593136 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcabc108ee0 0x7fcabc110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:24.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.850+0000 7fcac0c00640 1 --2- 172.21.15.42:0/3611593136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcabc104760 0x7fcabc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:24.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.850+0000 7fcac0c00640 1 --2- 172.21.15.42:0/3611593136 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcabc103db0 0x7fcabc104190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:24.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.850+0000 7fcac0c00640 1 -- 172.21.15.42:0/3611593136 >> 172.21.15.42:0/3611593136 conn(0x7fcabc0ff7f0 msgr2=0x7fcabc101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:24.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.850+0000 7fcac0c00640 1 -- 172.21.15.42:0/3611593136 shutdown_connections 2024-08-26T00:00:24.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.850+0000 7fcac0c00640 1 -- 172.21.15.42:0/3611593136 wait complete. 2024-08-26T00:00:24.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.851+0000 7fcac0c00640 1 Processor -- start 2024-08-26T00:00:24.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.851+0000 7fcac0c00640 1 -- start start 2024-08-26T00:00:24.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.851+0000 7fcac0c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcabc103db0 0x7fcabc19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:24.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.851+0000 7fcac0c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcabc104760 0x7fcabc19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:24.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.851+0000 7fcac0c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcabc108ee0 0x7fcabc19ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:24.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.852+0000 7fcac0c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcabc113f90 con 0x7fcabc103db0 2024-08-26T00:00:24.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.852+0000 7fcac0c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcabc113e10 con 0x7fcabc108ee0 2024-08-26T00:00:24.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.852+0000 7fcac0c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcabc114110 con 0x7fcabc104760 2024-08-26T00:00:24.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.852+0000 7fcab9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcabc103db0 0x7fcabc19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:24.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.852+0000 7fcab9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcabc103db0 0x7fcabc19a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47816/0 (socket says 172.21.15.42:47816) 2024-08-26T00:00:24.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.852+0000 7fcab9e00640 1 -- 172.21.15.42:0/1853349580 learned_addr learned my addr 172.21.15.42:0/1853349580 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:24.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.852+0000 7fcaba800640 1 --2- 172.21.15.42:0/1853349580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcabc108ee0 0x7fcabc19ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:24.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.852+0000 7fcab9400640 1 --2- 172.21.15.42:0/1853349580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcabc104760 0x7fcabc19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:24.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.852+0000 7fcab9e00640 1 -- 172.21.15.42:0/1853349580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcabc104760 msgr2=0x7fcabc19a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:24.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.852+0000 7fcab9e00640 1 --2- 172.21.15.42:0/1853349580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcabc104760 0x7fcabc19a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:24.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.852+0000 7fcab9e00640 1 -- 172.21.15.42:0/1853349580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcabc108ee0 msgr2=0x7fcabc19ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:24.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.852+0000 7fcab9e00640 1 --2- 172.21.15.42:0/1853349580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcabc108ee0 0x7fcabc19ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:24.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.852+0000 7fcab9e00640 1 -- 172.21.15.42:0/1853349580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcabc19f3e0 con 0x7fcabc103db0 2024-08-26T00:00:24.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.852+0000 7fcaba800640 1 --2- 172.21.15.42:0/1853349580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcabc108ee0 0x7fcabc19ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:00:24.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.853+0000 7fcab9e00640 1 --2- 172.21.15.42:0/1853349580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcabc103db0 0x7fcabc19a430 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcaac004770 tx=0x7fcaac003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:24.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.853+0000 7fcab2a00640 1 -- 172.21.15.42:0/1853349580 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaac03f070 con 0x7fcabc103db0 2024-08-26T00:00:24.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.853+0000 7fcab2a00640 1 -- 172.21.15.42:0/1853349580 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcaac031ca0 con 0x7fcabc103db0 2024-08-26T00:00:24.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.853+0000 7fcac0c00640 1 -- 172.21.15.42:0/1853349580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcabc19f670 con 0x7fcabc103db0 2024-08-26T00:00:24.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.853+0000 7fcab2a00640 1 -- 172.21.15.42:0/1853349580 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaac035030 con 0x7fcabc103db0 2024-08-26T00:00:24.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.853+0000 7fcac0c00640 1 -- 172.21.15.42:0/1853349580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcabc1a6fb0 con 0x7fcabc103db0 2024-08-26T00:00:24.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.854+0000 7fcac0c00640 1 -- 172.21.15.42:0/1853349580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcabc105290 con 0x7fcabc103db0 2024-08-26T00:00:24.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.856+0000 7fcab2a00640 1 -- 172.21.15.42:0/1853349580 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fcaac042070 con 0x7fcabc103db0 2024-08-26T00:00:24.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.858+0000 7fcab2a00640 1 --2- 172.21.15.42:0/1853349580 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcaa00a2b80 0x7fcaa00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:24.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.858+0000 7fcab2a00640 1 -- 172.21.15.42:0/1853349580 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fcaac0ef840 con 0x7fcabc103db0 2024-08-26T00:00:24.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.858+0000 7fcab9400640 1 --2- 172.21.15.42:0/1853349580 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcaa00a2b80 0x7fcaa00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:24.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.859+0000 7fcab9400640 1 --2- 172.21.15.42:0/1853349580 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcaa00a2b80 0x7fcaa00a5040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcabc0ffc10 tx=0x7fcaa8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:24.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:24.860+0000 7fcab2a00640 1 -- 172.21.15.42:0/1853349580 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fcaac0bc550 con 0x7fcabc103db0 2024-08-26T00:00:25.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:25.068+0000 7fcac0c00640 1 -- 172.21.15.42:0/1853349580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fcabc104190 con 0x7fcabc103db0 2024-08-26T00:00:25.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:25.970+0000 7fcab2a00640 1 -- 172.21.15.42:0/1853349580 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v74) ==== 138+0+0 (secure 0 0 0) 0x7fcabc104190 con 0x7fcabc103db0 2024-08-26T00:00:25.972 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-08-26T00:00:25.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:25.973+0000 7fcac0c00640 1 -- 172.21.15.42:0/1853349580 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcaa00a2b80 msgr2=0x7fcaa00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:25.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:25.973+0000 7fcac0c00640 1 --2- 172.21.15.42:0/1853349580 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcaa00a2b80 0x7fcaa00a5040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcabc0ffc10 tx=0x7fcaa8005f90 comp rx=0 tx=0).stop 2024-08-26T00:00:25.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:25.973+0000 7fcac0c00640 1 -- 172.21.15.42:0/1853349580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcabc103db0 msgr2=0x7fcabc19a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:25.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:25.973+0000 7fcac0c00640 1 --2- 172.21.15.42:0/1853349580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcabc103db0 0x7fcabc19a430 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcaac004770 tx=0x7fcaac003c10 comp rx=0 tx=0).stop 2024-08-26T00:00:25.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:25.974+0000 7fcac0c00640 1 -- 172.21.15.42:0/1853349580 shutdown_connections 2024-08-26T00:00:25.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:25.974+0000 7fcac0c00640 1 --2- 172.21.15.42:0/1853349580 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcaa00a2b80 0x7fcaa00a5040 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:25.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:25.974+0000 7fcac0c00640 1 --2- 172.21.15.42:0/1853349580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcabc108ee0 0x7fcabc19ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:25.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:25.974+0000 7fcac0c00640 1 --2- 172.21.15.42:0/1853349580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcabc104760 0x7fcabc19a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:25.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:25.974+0000 7fcac0c00640 1 --2- 172.21.15.42:0/1853349580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcabc103db0 0x7fcabc19a430 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:25.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:25.974+0000 7fcac0c00640 1 -- 172.21.15.42:0/1853349580 >> 172.21.15.42:0/1853349580 conn(0x7fcabc0ff7f0 msgr2=0x7fcabc100b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:25.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:25.974+0000 7fcac0c00640 1 -- 172.21.15.42:0/1853349580 shutdown_connections 2024-08-26T00:00:25.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:25.975+0000 7fcac0c00640 1 -- 172.21.15.42:0/1853349580 wait complete. 2024-08-26T00:00:26.246 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:25 smithi042 ceph-mon[17225]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:26.246 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:25 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:26.246 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:25 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:26.247 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:25 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:26.247 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:25 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:00:26.247 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:25 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:26.247 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:25 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1853349580' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-08-26T00:00:26.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:25 smithi043 ceph-mon[22091]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:26.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:25 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:26.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:25 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:26.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:25 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:26.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:25 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:00:26.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:25 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:26.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:25 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1853349580' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-08-26T00:00:26.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:25 smithi181 ceph-mon[22102]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:26.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:25 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:26.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:25 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:26.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:25 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:00:26.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:25 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:00:26.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:25 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:00:26.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:25 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1853349580' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-08-26T00:00:26.634 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-26T00:00:27.024 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:27.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:26 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1853349580' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-26T00:00:27.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:26 smithi043 ceph-mon[22091]: osdmap e74: 12 total, 12 up, 12 in 2024-08-26T00:00:27.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:26 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1853349580' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-26T00:00:27.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:26 smithi042 ceph-mon[17225]: osdmap e74: 12 total, 12 up, 12 in 2024-08-26T00:00:27.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:26 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1853349580' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-26T00:00:27.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:26 smithi181 ceph-mon[22102]: osdmap e74: 12 total, 12 up, 12 in 2024-08-26T00:00:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.585+0000 7f64a3400640 1 -- 172.21.15.42:0/3792924372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f649c108ee0 msgr2=0x7f649c110a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.585+0000 7f64a3400640 1 --2- 172.21.15.42:0/3792924372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f649c108ee0 0x7f649c110a60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6494009ca0 tx=0x7f649402a8c0 comp rx=0 tx=0).stop 2024-08-26T00:00:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.585+0000 7f64a3400640 1 -- 172.21.15.42:0/3792924372 shutdown_connections 2024-08-26T00:00:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.585+0000 7f64a3400640 1 --2- 172.21.15.42:0/3792924372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f649c108ee0 0x7f649c110a60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.585+0000 7f64a3400640 1 --2- 172.21.15.42:0/3792924372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f649c104760 0x7f649c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.585+0000 7f64a3400640 1 --2- 172.21.15.42:0/3792924372 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f649c103db0 0x7f649c104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:27.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.585+0000 7f64a3400640 1 -- 172.21.15.42:0/3792924372 >> 172.21.15.42:0/3792924372 conn(0x7f649c0ff7f0 msgr2=0x7f649c101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:27.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.585+0000 7f64a3400640 1 -- 172.21.15.42:0/3792924372 shutdown_connections 2024-08-26T00:00:27.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.586+0000 7f64a3400640 1 -- 172.21.15.42:0/3792924372 wait complete. 2024-08-26T00:00:27.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.587+0000 7f64a3400640 1 Processor -- start 2024-08-26T00:00:27.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.587+0000 7f64a3400640 1 -- start start 2024-08-26T00:00:27.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.588+0000 7f64a3400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f649c103db0 0x7f649c19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.588+0000 7f64a3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f649c104760 0x7f649c19a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.588+0000 7f64a3400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f649c108ee0 0x7f649c19ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.588+0000 7f64a3400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f649c113f90 con 0x7f649c104760 2024-08-26T00:00:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.588+0000 7f64a3400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f649c113e10 con 0x7f649c103db0 2024-08-26T00:00:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.588+0000 7f64a3400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f649c114110 con 0x7f649c108ee0 2024-08-26T00:00:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.588+0000 7f649be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f649c104760 0x7f649c19a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.588+0000 7f64a0a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f649c103db0 0x7f649c19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.588+0000 7f64a0a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f649c103db0 0x7f649c19a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45658/0 (socket says 172.21.15.42:45658) 2024-08-26T00:00:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.588+0000 7f649be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f649c104760 0x7f649c19a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47836/0 (socket says 172.21.15.42:47836) 2024-08-26T00:00:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.588+0000 7f64a0a00640 1 -- 172.21.15.42:0/1931958111 learned_addr learned my addr 172.21.15.42:0/1931958111 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.588+0000 7f64a1400640 1 --2- 172.21.15.42:0/1931958111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f649c108ee0 0x7f649c19ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:27.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.588+0000 7f649be00640 1 -- 172.21.15.42:0/1931958111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f649c108ee0 msgr2=0x7f649c19ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.588+0000 7f649be00640 1 --2- 172.21.15.42:0/1931958111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f649c108ee0 0x7f649c19ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.588+0000 7f649be00640 1 -- 172.21.15.42:0/1931958111 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f649c103db0 msgr2=0x7f649c19a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.588+0000 7f649be00640 1 --2- 172.21.15.42:0/1931958111 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f649c103db0 0x7f649c19a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.588+0000 7f649be00640 1 -- 172.21.15.42:0/1931958111 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649c19f3c0 con 0x7f649c104760 2024-08-26T00:00:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.588+0000 7f64a0a00640 1 --2- 172.21.15.42:0/1931958111 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f649c103db0 0x7f649c19a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:00:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.589+0000 7f649be00640 1 --2- 172.21.15.42:0/1931958111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f649c104760 0x7f649c19a950 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f648800e9f0 tx=0x7f648800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.589+0000 7f6499600640 1 -- 172.21.15.42:0/1931958111 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648800ccc0 con 0x7f649c104760 2024-08-26T00:00:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.589+0000 7f6499600640 1 -- 172.21.15.42:0/1931958111 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6488005020 con 0x7f649c104760 2024-08-26T00:00:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.589+0000 7f64a3400640 1 -- 172.21.15.42:0/1931958111 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f649c19f6b0 con 0x7f649c104760 2024-08-26T00:00:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.589+0000 7f6499600640 1 -- 172.21.15.42:0/1931958111 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64880049e0 con 0x7f649c104760 2024-08-26T00:00:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.589+0000 7f64a3400640 1 -- 172.21.15.42:0/1931958111 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f649c1a6f90 con 0x7f649c104760 2024-08-26T00:00:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.591+0000 7f64a3400640 1 -- 172.21.15.42:0/1931958111 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f649c104190 con 0x7f649c104760 2024-08-26T00:00:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.593+0000 7f6499600640 1 -- 172.21.15.42:0/1931958111 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6488005560 con 0x7f649c104760 2024-08-26T00:00:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.594+0000 7f6499600640 1 --2- 172.21.15.42:0/1931958111 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f64840a2b80 0x7f64840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.594+0000 7f6499600640 1 -- 172.21.15.42:0/1931958111 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7497+0+0 (secure 0 0 0) 0x7f64880ced40 con 0x7f649c104760 2024-08-26T00:00:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.594+0000 7f64a0a00640 1 --2- 172.21.15.42:0/1931958111 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f64840a2b80 0x7f64840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.595+0000 7f64a0a00640 1 --2- 172.21.15.42:0/1931958111 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f64840a2b80 0x7f64840a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6490011550 tx=0x7f6490005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:27.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.596+0000 7f6499600640 1 -- 172.21.15.42:0/1931958111 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f64880051d0 con 0x7f649c104760 2024-08-26T00:00:27.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:27.780+0000 7f64a3400640 1 -- 172.21.15.42:0/1931958111 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f649c1a71c0 con 0x7f649c104760 2024-08-26T00:00:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:28.330+0000 7f6499600640 1 -- 172.21.15.42:0/1931958111 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v76) ==== 170+0+0 (secure 0 0 0) 0x7f648809bfc0 con 0x7f649c104760 2024-08-26T00:00:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-08-26T00:00:28.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:28.333+0000 7f64a3400640 1 -- 172.21.15.42:0/1931958111 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f64840a2b80 msgr2=0x7f64840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:28.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:28.333+0000 7f64a3400640 1 --2- 172.21.15.42:0/1931958111 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f64840a2b80 0x7f64840a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6490011550 tx=0x7f6490005f90 comp rx=0 tx=0).stop 2024-08-26T00:00:28.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:28.333+0000 7f64a3400640 1 -- 172.21.15.42:0/1931958111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f649c104760 msgr2=0x7f649c19a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:28.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:28.333+0000 7f64a3400640 1 --2- 172.21.15.42:0/1931958111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f649c104760 0x7f649c19a950 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f648800e9f0 tx=0x7f648800eeb0 comp rx=0 tx=0).stop 2024-08-26T00:00:28.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:28.333+0000 7f64a3400640 1 -- 172.21.15.42:0/1931958111 shutdown_connections 2024-08-26T00:00:28.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:28.333+0000 7f64a3400640 1 --2- 172.21.15.42:0/1931958111 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f64840a2b80 0x7f64840a5040 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:28.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:28.333+0000 7f64a3400640 1 --2- 172.21.15.42:0/1931958111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f649c108ee0 0x7f649c19ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:28.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:28.333+0000 7f64a3400640 1 --2- 172.21.15.42:0/1931958111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f649c104760 0x7f649c19a950 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:28.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:28.333+0000 7f64a3400640 1 --2- 172.21.15.42:0/1931958111 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f649c103db0 0x7f649c19a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:28.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:28.333+0000 7f64a3400640 1 -- 172.21.15.42:0/1931958111 >> 172.21.15.42:0/1931958111 conn(0x7f649c0ff7f0 msgr2=0x7f649c101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:28.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:28.333+0000 7f64a3400640 1 -- 172.21.15.42:0/1931958111 shutdown_connections 2024-08-26T00:00:28.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:28.333+0000 7f64a3400640 1 -- 172.21.15.42:0/1931958111 wait complete. 2024-08-26T00:00:28.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:28 smithi042 ceph-mon[17225]: pgmap v271: 33 pgs: 2 creating+peering, 30 unknown, 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:28.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:28 smithi042 ceph-mon[17225]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-26T00:00:28.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:28 smithi042 ceph-mon[17225]: osdmap e75: 12 total, 12 up, 12 in 2024-08-26T00:00:28.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:28 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1931958111' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-08-26T00:00:28.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:28 smithi043 ceph-mon[22091]: pgmap v271: 33 pgs: 2 creating+peering, 30 unknown, 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:28.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:28 smithi043 ceph-mon[22091]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-26T00:00:28.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:28 smithi043 ceph-mon[22091]: osdmap e75: 12 total, 12 up, 12 in 2024-08-26T00:00:28.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:28 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1931958111' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-08-26T00:00:28.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:28 smithi181 ceph-mon[22102]: pgmap v271: 33 pgs: 2 creating+peering, 30 unknown, 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:28.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:28 smithi181 ceph-mon[22102]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-26T00:00:28.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:28 smithi181 ceph-mon[22102]: osdmap e75: 12 total, 12 up, 12 in 2024-08-26T00:00:28.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:28 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1931958111' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-08-26T00:00:29.017 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-26T00:00:29.412 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:29.668 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:29 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1931958111' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-26T00:00:29.668 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:29 smithi042 ceph-mon[17225]: osdmap e76: 12 total, 12 up, 12 in 2024-08-26T00:00:29.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:29 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1931958111' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-26T00:00:29.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:29 smithi043 ceph-mon[22091]: osdmap e76: 12 total, 12 up, 12 in 2024-08-26T00:00:29.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:29 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1931958111' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-26T00:00:29.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:29 smithi181 ceph-mon[22102]: osdmap e76: 12 total, 12 up, 12 in 2024-08-26T00:00:29.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.934+0000 7fbec7a00640 1 -- 172.21.15.42:0/996356424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbec0103b50 msgr2=0x7fbec0103fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:29.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.934+0000 7fbec7a00640 1 --2- 172.21.15.42:0/996356424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbec0103b50 0x7fbec0103fb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009930 tx=0x7fbeac02a420 comp rx=0 tx=0).stop 2024-08-26T00:00:29.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.934+0000 7fbec7a00640 1 -- 172.21.15.42:0/996356424 shutdown_connections 2024-08-26T00:00:29.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.934+0000 7fbec7a00640 1 --2- 172.21.15.42:0/996356424 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbec01044f0 0x7fbec01109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:29.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.934+0000 7fbec7a00640 1 --2- 172.21.15.42:0/996356424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbec0103b50 0x7fbec0103fb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:29.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.934+0000 7fbec7a00640 1 --2- 172.21.15.42:0/996356424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbec0109c00 0x7fbec0109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:29.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.934+0000 7fbec7a00640 1 -- 172.21.15.42:0/996356424 >> 172.21.15.42:0/996356424 conn(0x7fbec00ff830 msgr2=0x7fbec0101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:29.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.934+0000 7fbec7a00640 1 -- 172.21.15.42:0/996356424 shutdown_connections 2024-08-26T00:00:29.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.934+0000 7fbec7a00640 1 -- 172.21.15.42:0/996356424 wait complete. 2024-08-26T00:00:29.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.935+0000 7fbec7a00640 1 Processor -- start 2024-08-26T00:00:29.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.935+0000 7fbec7a00640 1 -- start start 2024-08-26T00:00:29.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.935+0000 7fbec7a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbec0103b50 0x7fbec019a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:29.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.935+0000 7fbec7a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbec01044f0 0x7fbec019a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:29.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.935+0000 7fbec7a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbec0109c00 0x7fbec019ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:29.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.935+0000 7fbec7a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbec0113f20 con 0x7fbec0103b50 2024-08-26T00:00:29.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.935+0000 7fbec7a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbec0113da0 con 0x7fbec01044f0 2024-08-26T00:00:29.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.935+0000 7fbec7a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbec01140a0 con 0x7fbec0109c00 2024-08-26T00:00:29.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.936+0000 7fbebfe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbec01044f0 0x7fbec019a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:29.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.936+0000 7fbec5000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbec0103b50 0x7fbec019a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:29.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.936+0000 7fbebfe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbec01044f0 0x7fbec019a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45682/0 (socket says 172.21.15.42:45682) 2024-08-26T00:00:29.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.936+0000 7fbebfe00640 1 -- 172.21.15.42:0/740226312 learned_addr learned my addr 172.21.15.42:0/740226312 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:29.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.936+0000 7fbec5a00640 1 --2- 172.21.15.42:0/740226312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbec0109c00 0x7fbec019ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:29.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.936+0000 7fbebfe00640 1 -- 172.21.15.42:0/740226312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbec0109c00 msgr2=0x7fbec019ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:29.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.936+0000 7fbebfe00640 1 --2- 172.21.15.42:0/740226312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbec0109c00 0x7fbec019ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:29.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.936+0000 7fbebfe00640 1 -- 172.21.15.42:0/740226312 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbec0103b50 msgr2=0x7fbec019a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:29.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.936+0000 7fbebfe00640 1 --2- 172.21.15.42:0/740226312 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbec0103b50 0x7fbec019a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:29.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.936+0000 7fbebfe00640 1 -- 172.21.15.42:0/740226312 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec019f330 con 0x7fbec01044f0 2024-08-26T00:00:29.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.936+0000 7fbec5a00640 1 --2- 172.21.15.42:0/740226312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbec0109c00 0x7fbec019ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:00:29.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.936+0000 7fbebfe00640 1 --2- 172.21.15.42:0/740226312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbec01044f0 0x7fbec019a8c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009230 tx=0x7fbeac004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:29.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.937+0000 7fbebd600640 1 -- 172.21.15.42:0/740226312 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac03f030 con 0x7fbec01044f0 2024-08-26T00:00:29.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.937+0000 7fbec7a00640 1 -- 172.21.15.42:0/740226312 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec019f5c0 con 0x7fbec01044f0 2024-08-26T00:00:29.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.937+0000 7fbebd600640 1 -- 172.21.15.42:0/740226312 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbeac003ad0 con 0x7fbec01044f0 2024-08-26T00:00:29.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.937+0000 7fbebd600640 1 -- 172.21.15.42:0/740226312 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac035070 con 0x7fbec01044f0 2024-08-26T00:00:29.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.937+0000 7fbec7a00640 1 -- 172.21.15.42:0/740226312 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec01a6f00 con 0x7fbec01044f0 2024-08-26T00:00:29.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.938+0000 7fbec7a00640 1 -- 172.21.15.42:0/740226312 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec0105200 con 0x7fbec01044f0 2024-08-26T00:00:29.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.940+0000 7fbebd600640 1 -- 172.21.15.42:0/740226312 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbeac042030 con 0x7fbec01044f0 2024-08-26T00:00:29.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.941+0000 7fbebd600640 1 --2- 172.21.15.42:0/740226312 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fbea80a2b80 0x7fbea80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:29.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.941+0000 7fbebd600640 1 -- 172.21.15.42:0/740226312 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7879+0+0 (secure 0 0 0) 0x7fbeac0ef9f0 con 0x7fbec01044f0 2024-08-26T00:00:29.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.942+0000 7fbec5000640 1 --2- 172.21.15.42:0/740226312 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fbea80a2b80 0x7fbea80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:29.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.942+0000 7fbec5000640 1 --2- 172.21.15.42:0/740226312 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fbea80a2b80 0x7fbea80a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4009b50 tx=0x7fbeb4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:29.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:29.943+0000 7fbebd600640 1 -- 172.21.15.42:0/740226312 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fbeac0bca60 con 0x7fbec01044f0 2024-08-26T00:00:30.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:30.167+0000 7fbec7a00640 1 -- 172.21.15.42:0/740226312 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fbec0103fb0 con 0x7fbec01044f0 2024-08-26T00:00:30.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:30.341+0000 7fbebd600640 1 -- 172.21.15.42:0/740226312 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fbec0103fb0 con 0x7fbec01044f0 2024-08-26T00:00:30.343 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 2 and data pool 3 2024-08-26T00:00:30.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:30.345+0000 7fbec7a00640 1 -- 172.21.15.42:0/740226312 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fbea80a2b80 msgr2=0x7fbea80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:30.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:30.345+0000 7fbec7a00640 1 --2- 172.21.15.42:0/740226312 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fbea80a2b80 0x7fbea80a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4009b50 tx=0x7fbeb4005f90 comp rx=0 tx=0).stop 2024-08-26T00:00:30.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:30.345+0000 7fbec7a00640 1 -- 172.21.15.42:0/740226312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbec01044f0 msgr2=0x7fbec019a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:30.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:30.345+0000 7fbec7a00640 1 --2- 172.21.15.42:0/740226312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbec01044f0 0x7fbec019a8c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009230 tx=0x7fbeac004270 comp rx=0 tx=0).stop 2024-08-26T00:00:30.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:30.345+0000 7fbec7a00640 1 -- 172.21.15.42:0/740226312 shutdown_connections 2024-08-26T00:00:30.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:30.345+0000 7fbec7a00640 1 --2- 172.21.15.42:0/740226312 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fbea80a2b80 0x7fbea80a5040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:30.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:30.345+0000 7fbec7a00640 1 --2- 172.21.15.42:0/740226312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbec0109c00 0x7fbec019ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:30.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:30.345+0000 7fbec7a00640 1 --2- 172.21.15.42:0/740226312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbec01044f0 0x7fbec019a8c0 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009230 tx=0x7fbeac004270 comp rx=0 tx=0).stop 2024-08-26T00:00:30.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:30.345+0000 7fbec7a00640 1 --2- 172.21.15.42:0/740226312 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbec0103b50 0x7fbec019a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:30.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:30.345+0000 7fbec7a00640 1 -- 172.21.15.42:0/740226312 >> 172.21.15.42:0/740226312 conn(0x7fbec00ff830 msgr2=0x7fbec0100fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:30.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:30.345+0000 7fbec7a00640 1 -- 172.21.15.42:0/740226312 shutdown_connections 2024-08-26T00:00:30.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:30.346+0000 7fbec7a00640 1 -- 172.21.15.42:0/740226312 wait complete. 2024-08-26T00:00:30.685 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:30 smithi042 ceph-mon[17225]: pgmap v274: 97 pgs: 15 active+clean, 6 creating+peering, 76 unknown; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:30.685 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:30 smithi042 ceph-mon[17225]: osdmap e77: 12 total, 12 up, 12 in 2024-08-26T00:00:30.685 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:30 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/740226312' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-08-26T00:00:30.685 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:30 smithi042 ceph-mon[17225]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-08-26T00:00:30.685 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:30 smithi042 ceph-mon[17225]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-08-26T00:00:30.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:30 smithi043 ceph-mon[22091]: pgmap v274: 97 pgs: 15 active+clean, 6 creating+peering, 76 unknown; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:30.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:30 smithi043 ceph-mon[22091]: osdmap e77: 12 total, 12 up, 12 in 2024-08-26T00:00:30.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:30 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/740226312' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-08-26T00:00:30.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:30 smithi043 ceph-mon[22091]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-08-26T00:00:30.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:30 smithi043 ceph-mon[22091]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-08-26T00:00:30.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:30 smithi181 ceph-mon[22102]: pgmap v274: 97 pgs: 15 active+clean, 6 creating+peering, 76 unknown; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:30.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:30 smithi181 ceph-mon[22102]: osdmap e77: 12 total, 12 up, 12 in 2024-08-26T00:00:30.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:30 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/740226312' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-08-26T00:00:30.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:30 smithi181 ceph-mon[22102]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-08-26T00:00:30.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:30 smithi181 ceph-mon[22102]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-08-26T00:00:31.054 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd dump --format=json 2024-08-26T00:00:31.431 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:31.684 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:31 smithi042 ceph-mon[17225]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-26T00:00:31.684 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:31 smithi042 ceph-mon[17225]: osdmap e78: 12 total, 12 up, 12 in 2024-08-26T00:00:31.685 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:31 smithi042 ceph-mon[17225]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-08-26T00:00:31.685 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:31 smithi042 ceph-mon[17225]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-08-26T00:00:31.685 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:31 smithi042 ceph-mon[17225]: pgmap v277: 97 pgs: 39 active+clean, 6 creating+peering, 52 unknown; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:31.685 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:31 smithi042 ceph-mon[17225]: mds.? [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] up:active 2024-08-26T00:00:31.685 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:31 smithi042 ceph-mon[17225]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-26T00:00:31.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:31 smithi043 ceph-mon[22091]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-26T00:00:31.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:31 smithi043 ceph-mon[22091]: osdmap e78: 12 total, 12 up, 12 in 2024-08-26T00:00:31.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:31 smithi043 ceph-mon[22091]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-08-26T00:00:31.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:31 smithi043 ceph-mon[22091]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-08-26T00:00:31.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:31 smithi043 ceph-mon[22091]: pgmap v277: 97 pgs: 39 active+clean, 6 creating+peering, 52 unknown; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:31.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:31 smithi043 ceph-mon[22091]: mds.? [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] up:active 2024-08-26T00:00:31.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:31 smithi043 ceph-mon[22091]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-26T00:00:31.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:31 smithi181 ceph-mon[22102]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-26T00:00:31.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:31 smithi181 ceph-mon[22102]: osdmap e78: 12 total, 12 up, 12 in 2024-08-26T00:00:31.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:31 smithi181 ceph-mon[22102]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-08-26T00:00:31.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:31 smithi181 ceph-mon[22102]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-08-26T00:00:31.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:31 smithi181 ceph-mon[22102]: pgmap v277: 97 pgs: 39 active+clean, 6 creating+peering, 52 unknown; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:00:31.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:31 smithi181 ceph-mon[22102]: mds.? [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] up:active 2024-08-26T00:00:31.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:31 smithi181 ceph-mon[22102]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-26T00:00:31.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.970+0000 7fa359000640 1 -- 172.21.15.42:0/2498778597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354109970 msgr2=0x7fa354109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:31.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.970+0000 7fa359000640 1 --2- 172.21.15.42:0/2498778597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354109970 0x7fa354109d50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa344009890 tx=0x7fa34402a380 comp rx=0 tx=0).stop 2024-08-26T00:00:31.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.970+0000 7fa359000640 1 -- 172.21.15.42:0/2498778597 shutdown_connections 2024-08-26T00:00:31.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.970+0000 7fa359000640 1 --2- 172.21.15.42:0/2498778597 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa354104310 0x7fa354110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:31.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.970+0000 7fa359000640 1 --2- 172.21.15.42:0/2498778597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa354103970 0x7fa354103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:31.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.970+0000 7fa359000640 1 --2- 172.21.15.42:0/2498778597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354109970 0x7fa354109d50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:31.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.970+0000 7fa359000640 1 -- 172.21.15.42:0/2498778597 >> 172.21.15.42:0/2498778597 conn(0x7fa3540ff670 msgr2=0x7fa354101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:31.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.970+0000 7fa359000640 1 -- 172.21.15.42:0/2498778597 shutdown_connections 2024-08-26T00:00:31.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.970+0000 7fa359000640 1 -- 172.21.15.42:0/2498778597 wait complete. 2024-08-26T00:00:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.971+0000 7fa359000640 1 Processor -- start 2024-08-26T00:00:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.971+0000 7fa359000640 1 -- start start 2024-08-26T00:00:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.971+0000 7fa359000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa354103970 0x7fa35419a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.971+0000 7fa359000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354104310 0x7fa35419a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.971+0000 7fa359000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa354109970 0x7fa35419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.972+0000 7fa359000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa354113d70 con 0x7fa354104310 2024-08-26T00:00:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.972+0000 7fa359000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa354113bf0 con 0x7fa354103970 2024-08-26T00:00:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.972+0000 7fa359000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa354113ef0 con 0x7fa354109970 2024-08-26T00:00:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.972+0000 7fa34be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354104310 0x7fa35419a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.972+0000 7fa34be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354104310 0x7fa35419a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47880/0 (socket says 172.21.15.42:47880) 2024-08-26T00:00:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.972+0000 7fa34be00640 1 -- 172.21.15.42:0/1172865934 learned_addr learned my addr 172.21.15.42:0/1172865934 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:31.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.972+0000 7fa353400640 1 --2- 172.21.15.42:0/1172865934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa354103970 0x7fa35419a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:31.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.972+0000 7fa353e00640 1 --2- 172.21.15.42:0/1172865934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa354109970 0x7fa35419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:31.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.972+0000 7fa353400640 1 -- 172.21.15.42:0/1172865934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa354109970 msgr2=0x7fa35419eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:31.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.972+0000 7fa353400640 1 --2- 172.21.15.42:0/1172865934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa354109970 0x7fa35419eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:31.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.972+0000 7fa353400640 1 -- 172.21.15.42:0/1172865934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354104310 msgr2=0x7fa35419a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:31.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.972+0000 7fa353400640 1 --2- 172.21.15.42:0/1172865934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354104310 0x7fa35419a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:31.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.972+0000 7fa353400640 1 -- 172.21.15.42:0/1172865934 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35419f220 con 0x7fa354103970 2024-08-26T00:00:31.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.972+0000 7fa34be00640 1 --2- 172.21.15.42:0/1172865934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354104310 0x7fa35419a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:00:31.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.973+0000 7fa353400640 1 --2- 172.21.15.42:0/1172865934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa354103970 0x7fa35419a270 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa3440057c0 tx=0x7fa344033ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.973+0000 7fa350c00640 1 -- 172.21.15.42:0/1172865934 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa344037040 con 0x7fa354103970 2024-08-26T00:00:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.973+0000 7fa359000640 1 -- 172.21.15.42:0/1172865934 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa35419f4b0 con 0x7fa354103970 2024-08-26T00:00:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.973+0000 7fa350c00640 1 -- 172.21.15.42:0/1172865934 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa344033d90 con 0x7fa354103970 2024-08-26T00:00:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.973+0000 7fa350c00640 1 -- 172.21.15.42:0/1172865934 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa344003970 con 0x7fa354103970 2024-08-26T00:00:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.973+0000 7fa359000640 1 -- 172.21.15.42:0/1172865934 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3541a6df0 con 0x7fa354103970 2024-08-26T00:00:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.974+0000 7fa359000640 1 -- 172.21.15.42:0/1172865934 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3541050b0 con 0x7fa354103970 2024-08-26T00:00:31.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.976+0000 7fa350c00640 1 -- 172.21.15.42:0/1172865934 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa344042020 con 0x7fa354103970 2024-08-26T00:00:31.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.977+0000 7fa350c00640 1 --2- 172.21.15.42:0/1172865934 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa3380a2b80 0x7fa3380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:31.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.978+0000 7fa350c00640 1 -- 172.21.15.42:0/1172865934 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fa3440ee5a0 con 0x7fa354103970 2024-08-26T00:00:31.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.978+0000 7fa34be00640 1 --2- 172.21.15.42:0/1172865934 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa3380a2b80 0x7fa3380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:31.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.978+0000 7fa34be00640 1 --2- 172.21.15.42:0/1172865934 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa3380a2b80 0x7fa3380a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa354101c80 tx=0x7fa33c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:31.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:31.982+0000 7fa350c00640 1 -- 172.21.15.42:0/1172865934 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa344049020 con 0x7fa354103970 2024-08-26T00:00:32.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:32.167+0000 7fa359000640 1 -- 172.21.15.42:0/1172865934 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa35410bee0 con 0x7fa354103970 2024-08-26T00:00:32.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:32.169+0000 7fa350c00640 1 -- 172.21.15.42:0/1172865934 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22147 (secure 0 0 0) 0x7fa3440bb5b0 con 0x7fa354103970 2024-08-26T00:00:32.171 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:00:32.172 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":78,"fsid":"f89d317a-633c-11ef-bcd2-c7b262605968","created":"2024-08-25T23:52:39.598509+0000","modified":"2024-08-26T00:00:30.169413+0000","last_up_change":"2024-08-25T23:59:35.047575+0000","last_in_change":"2024-08-25T23:59:12.796940+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-25T23:55:51.022219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-26T00:00:25.606536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-26T00:00:28.322822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"980d8635-bca1-4c5a-b78e-4b44f9315d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6803","nonce":2657450248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6805","nonce":2657450248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6809","nonce":2657450248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6807","nonce":2657450248}]},"public_addr":"172.21.15.42:6803/2657450248","cluster_addr":"172.21.15.42:6805/2657450248","heartbeat_back_addr":"172.21.15.42:6809/2657450248","heartbeat_front_addr":"172.21.15.42:6807/2657450248","state":["exists","up"]},{"osd":1,"uuid":"e5f8dc3b-876a-4bdd-b6b0-b0d99d098d95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6801","nonce":2396081001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6803","nonce":2396081001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6807","nonce":2396081001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6805","nonce":2396081001}]},"public_addr":"172.21.15.43:6801/2396081001","cluster_addr":"172.21.15.43:6803/2396081001","heartbeat_back_addr":"172.21.15.43:6807/2396081001","heartbeat_front_addr":"172.21.15.43:6805/2396081001","state":["exists","up"]},{"osd":2,"uuid":"06eb25af-8e3d-4f90-bc24-28a9bc224c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6801","nonce":189987070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6803","nonce":189987070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6807","nonce":189987070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6805","nonce":189987070}]},"public_addr":"172.21.15.181:6801/189987070","cluster_addr":"172.21.15.181:6803/189987070","heartbeat_back_addr":"172.21.15.181:6807/189987070","heartbeat_front_addr":"172.21.15.181:6805/189987070","state":["exists","up"]},{"osd":3,"uuid":"c78dbc49-b5c7-4f82-be36-c76a89496520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6811","nonce":251017896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6813","nonce":251017896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6817","nonce":251017896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6815","nonce":251017896}]},"public_addr":"172.21.15.42:6811/251017896","cluster_addr":"172.21.15.42:6813/251017896","heartbeat_back_addr":"172.21.15.42:6817/251017896","heartbeat_front_addr":"172.21.15.42:6815/251017896","state":["exists","up"]},{"osd":4,"uuid":"ba633f66-25af-492f-bbf2-76032a4cd3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6809","nonce":1315420796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6811","nonce":1315420796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6815","nonce":1315420796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6813","nonce":1315420796}]},"public_addr":"172.21.15.43:6809/1315420796","cluster_addr":"172.21.15.43:6811/1315420796","heartbeat_back_addr":"172.21.15.43:6815/1315420796","heartbeat_front_addr":"172.21.15.43:6813/1315420796","state":["exists","up"]},{"osd":5,"uuid":"04e47ad9-21ba-43da-9793-d5cf83150dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6809","nonce":246971403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6811","nonce":246971403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6815","nonce":246971403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6813","nonce":246971403}]},"public_addr":"172.21.15.181:6809/246971403","cluster_addr":"172.21.15.181:6811/246971403","heartbeat_back_addr":"172.21.15.181:6815/246971403","heartbeat_front_addr":"172.21.15.181:6813/246971403","state":["exists","up"]},{"osd":6,"uuid":"f48161cd-bc44-4d99-8248-1bb845111129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6819","nonce":2910656480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6821","nonce":2910656480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6825","nonce":2910656480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6823","nonce":2910656480}]},"public_addr":"172.21.15.42:6819/2910656480","cluster_addr":"172.21.15.42:6821/2910656480","heartbeat_back_addr":"172.21.15.42:6825/2910656480","heartbeat_front_addr":"172.21.15.42:6823/2910656480","state":["exists","up"]},{"osd":7,"uuid":"65470b06-b14d-4d8e-9bcb-e6927c37fda5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6817","nonce":624542778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6819","nonce":624542778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6823","nonce":624542778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6821","nonce":624542778}]},"public_addr":"172.21.15.43:6817/624542778","cluster_addr":"172.21.15.43:6819/624542778","heartbeat_back_addr":"172.21.15.43:6823/624542778","heartbeat_front_addr":"172.21.15.43:6821/624542778","state":["exists","up"]},{"osd":8,"uuid":"1f4c9152-4b7c-415f-9cb9-d1e926fad5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6817","nonce":728226568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6819","nonce":728226568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6823","nonce":728226568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6821","nonce":728226568}]},"public_addr":"172.21.15.181:6817/728226568","cluster_addr":"172.21.15.181:6819/728226568","heartbeat_back_addr":"172.21.15.181:6823/728226568","heartbeat_front_addr":"172.21.15.181:6821/728226568","state":["exists","up"]},{"osd":9,"uuid":"fb387fbe-19b4-4a3e-8e40-81bd1363b55c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6827","nonce":1052069444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6829","nonce":1052069444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6833","nonce":1052069444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6831","nonce":1052069444}]},"public_addr":"172.21.15.42:6827/1052069444","cluster_addr":"172.21.15.42:6829/1052069444","heartbeat_back_addr":"172.21.15.42:6833/1052069444","heartbeat_front_addr":"172.21.15.42:6831/1052069444","state":["exists","up"]},{"osd":10,"uuid":"fe5bbeec-2341-4ea9-97ab-cc45d738d741","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6825","nonce":3417487386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6827","nonce":3417487386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6831","nonce":3417487386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6829","nonce":3417487386}]},"public_addr":"172.21.15.43:6825/3417487386","cluster_addr":"172.21.15.43:6827/3417487386","heartbeat_back_addr":"172.21.15.43:6831/3417487386","heartbeat_front_addr":"172.21.15.43:6829/3417487386","state":["exists","up"]},{"osd":11,"uuid":"cee07741-3ab7-481e-8477-54319f4f178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6825","nonce":3817502913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6827","nonce":3817502913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6831","nonce":3817502913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6829","nonce":3817502913}]},"public_addr":"172.21.15.181:6825/3817502913","cluster_addr":"172.21.15.181:6827/3817502913","heartbeat_back_addr":"172.21.15.181:6831/3817502913","heartbeat_front_addr":"172.21.15.181:6829/3817502913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:00.603592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:24.637326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:47.587859+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:14.978783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:39.025819+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:01.965471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:29.753475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:54.162377+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:17.970871+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:46.175576+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:10.590220+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:33.216701+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/3711239085":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6801/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2983166615":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/2974122891":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2980210051":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/4227793902":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6801/1517739376":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6800/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/1775009918":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6800/1517739376":"2024-08-26T23:53:05.122858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-26T00:00:32.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:32.172+0000 7fa359000640 1 -- 172.21.15.42:0/1172865934 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa3380a2b80 msgr2=0x7fa3380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:32.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:32.172+0000 7fa359000640 1 --2- 172.21.15.42:0/1172865934 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa3380a2b80 0x7fa3380a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa354101c80 tx=0x7fa33c009260 comp rx=0 tx=0).stop 2024-08-26T00:00:32.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:32.172+0000 7fa359000640 1 -- 172.21.15.42:0/1172865934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa354103970 msgr2=0x7fa35419a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:32.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:32.172+0000 7fa359000640 1 --2- 172.21.15.42:0/1172865934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa354103970 0x7fa35419a270 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa3440057c0 tx=0x7fa344033ae0 comp rx=0 tx=0).stop 2024-08-26T00:00:32.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:32.172+0000 7fa359000640 1 -- 172.21.15.42:0/1172865934 shutdown_connections 2024-08-26T00:00:32.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:32.172+0000 7fa359000640 1 --2- 172.21.15.42:0/1172865934 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa3380a2b80 0x7fa3380a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:32.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:32.172+0000 7fa359000640 1 --2- 172.21.15.42:0/1172865934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa354109970 0x7fa35419eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:32.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:32.172+0000 7fa359000640 1 --2- 172.21.15.42:0/1172865934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa354104310 0x7fa35419a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:32.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:32.172+0000 7fa359000640 1 --2- 172.21.15.42:0/1172865934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa354103970 0x7fa35419a270 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:32.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:32.172+0000 7fa359000640 1 -- 172.21.15.42:0/1172865934 >> 172.21.15.42:0/1172865934 conn(0x7fa3540ff670 msgr2=0x7fa3540ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:32.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:32.172+0000 7fa359000640 1 -- 172.21.15.42:0/1172865934 shutdown_connections 2024-08-26T00:00:32.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:32.172+0000 7fa359000640 1 -- 172.21.15.42:0/1172865934 wait complete. 2024-08-26T00:00:32.668 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:32 smithi042 ceph-mon[17225]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-26T00:00:32.668 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:32 smithi042 ceph-mon[17225]: Cluster is now healthy 2024-08-26T00:00:32.668 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:32 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1172865934' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:00:32.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:32 smithi043 ceph-mon[22091]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-26T00:00:32.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:32 smithi043 ceph-mon[22091]: Cluster is now healthy 2024-08-26T00:00:32.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:32 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1172865934' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:00:32.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:32 smithi181 ceph-mon[22102]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-26T00:00:32.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:32 smithi181 ceph-mon[22102]: Cluster is now healthy 2024-08-26T00:00:32.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:32 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1172865934' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:00:33.027 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd dump --format=json 2024-08-26T00:00:33.404 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:33.668 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:33 smithi042 ceph-mon[17225]: pgmap v278: 97 pgs: 92 active+clean, 5 unknown; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 743 B/s wr, 3 op/s 2024-08-26T00:00:33.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:33 smithi043 ceph-mon[22091]: pgmap v278: 97 pgs: 92 active+clean, 5 unknown; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 743 B/s wr, 3 op/s 2024-08-26T00:00:33.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:33 smithi181 ceph-mon[22102]: pgmap v278: 97 pgs: 92 active+clean, 5 unknown; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 743 B/s wr, 3 op/s 2024-08-26T00:00:33.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.918+0000 7f6713400640 1 -- 172.21.15.42:0/2027052684 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f670c1044f0 msgr2=0x7f670c1109d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:33.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.918+0000 7f6713400640 1 --2- 172.21.15.42:0/2027052684 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f670c1044f0 0x7f670c1109d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6704009ca0 tx=0x7f670402a8c0 comp rx=0 tx=0).stop 2024-08-26T00:00:33.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.919+0000 7f6713400640 1 -- 172.21.15.42:0/2027052684 shutdown_connections 2024-08-26T00:00:33.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.919+0000 7f6713400640 1 --2- 172.21.15.42:0/2027052684 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f670c1044f0 0x7f670c1109d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:33.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.919+0000 7f6713400640 1 --2- 172.21.15.42:0/2027052684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f670c103b50 0x7f670c103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:33.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.919+0000 7f6713400640 1 --2- 172.21.15.42:0/2027052684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f670c109c00 0x7f670c109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:33.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.919+0000 7f6713400640 1 -- 172.21.15.42:0/2027052684 >> 172.21.15.42:0/2027052684 conn(0x7f670c0ff830 msgr2=0x7f670c101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:33.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.919+0000 7f6713400640 1 -- 172.21.15.42:0/2027052684 shutdown_connections 2024-08-26T00:00:33.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.919+0000 7f6713400640 1 -- 172.21.15.42:0/2027052684 wait complete. 2024-08-26T00:00:33.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.920+0000 7f6713400640 1 Processor -- start 2024-08-26T00:00:33.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.920+0000 7f6713400640 1 -- start start 2024-08-26T00:00:33.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.920+0000 7f6713400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f670c103b50 0x7f670c19a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:33.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.920+0000 7f6713400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f670c1044f0 0x7f670c19a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:33.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.920+0000 7f6713400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f670c109c00 0x7f670c19eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:33.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.920+0000 7f6713400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f670c113f60 con 0x7f670c109c00 2024-08-26T00:00:33.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.920+0000 7f6713400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f670c113de0 con 0x7f670c1044f0 2024-08-26T00:00:33.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.920+0000 7f6713400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f670c1140e0 con 0x7f670c103b50 2024-08-26T00:00:33.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.921+0000 7f6711400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f670c109c00 0x7f670c19eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:33.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.921+0000 7f6703e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f670c1044f0 0x7f670c19a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:33.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.921+0000 7f6703e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f670c1044f0 0x7f670c19a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45712/0 (socket says 172.21.15.42:45712) 2024-08-26T00:00:33.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.921+0000 7f6711400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f670c109c00 0x7f670c19eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47904/0 (socket says 172.21.15.42:47904) 2024-08-26T00:00:33.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.921+0000 7f6703e00640 1 -- 172.21.15.42:0/2433766649 learned_addr learned my addr 172.21.15.42:0/2433766649 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:33.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.921+0000 7f6710a00640 1 --2- 172.21.15.42:0/2433766649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f670c103b50 0x7f670c19a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:33.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.921+0000 7f6703e00640 1 -- 172.21.15.42:0/2433766649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f670c103b50 msgr2=0x7f670c19a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:33.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.921+0000 7f6703e00640 1 --2- 172.21.15.42:0/2433766649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f670c103b50 0x7f670c19a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:33.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.921+0000 7f6703e00640 1 -- 172.21.15.42:0/2433766649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f670c109c00 msgr2=0x7f670c19eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:33.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.921+0000 7f6703e00640 1 --2- 172.21.15.42:0/2433766649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f670c109c00 0x7f670c19eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:33.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.921+0000 7f6703e00640 1 -- 172.21.15.42:0/2433766649 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f670c19f270 con 0x7f670c1044f0 2024-08-26T00:00:33.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.922+0000 7f6703e00640 1 --2- 172.21.15.42:0/2433766649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f670c1044f0 0x7f670c19a800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f66f400ea60 tx=0x7f66f400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:33.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.922+0000 7f670a000640 1 -- 172.21.15.42:0/2433766649 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f400cde0 con 0x7f670c1044f0 2024-08-26T00:00:33.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.922+0000 7f6713400640 1 -- 172.21.15.42:0/2433766649 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f670c19f560 con 0x7f670c1044f0 2024-08-26T00:00:33.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.922+0000 7f670a000640 1 -- 172.21.15.42:0/2433766649 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66f40035f0 con 0x7f670c1044f0 2024-08-26T00:00:33.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.922+0000 7f670a000640 1 -- 172.21.15.42:0/2433766649 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f4010670 con 0x7f670c1044f0 2024-08-26T00:00:33.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.922+0000 7f6713400640 1 -- 172.21.15.42:0/2433766649 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f670c1a6e40 con 0x7f670c1044f0 2024-08-26T00:00:33.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.923+0000 7f6713400640 1 -- 172.21.15.42:0/2433766649 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f670c103fb0 con 0x7f670c1044f0 2024-08-26T00:00:33.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.925+0000 7f670a000640 1 -- 172.21.15.42:0/2433766649 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f66f40037a0 con 0x7f670c1044f0 2024-08-26T00:00:33.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.926+0000 7f670a000640 1 --2- 172.21.15.42:0/2433766649 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f66f00a2b80 0x7f66f00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:33.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.926+0000 7f670a000640 1 -- 172.21.15.42:0/2433766649 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f66f40cf210 con 0x7f670c1044f0 2024-08-26T00:00:33.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.927+0000 7f6710a00640 1 --2- 172.21.15.42:0/2433766649 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f66f00a2b80 0x7f66f00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:33.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.927+0000 7f6710a00640 1 --2- 172.21.15.42:0/2433766649 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f66f00a2b80 0x7f66f00a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f66fc009bd0 tx=0x7f66fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:33.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:33.930+0000 7f670a000640 1 -- 172.21.15.42:0/2433766649 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f66f409c220 con 0x7f670c1044f0 2024-08-26T00:00:34.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:34.118+0000 7f6713400640 1 -- 172.21.15.42:0/2433766649 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f670c19b620 con 0x7f670c1044f0 2024-08-26T00:00:34.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:34.120+0000 7f670a000640 1 -- 172.21.15.42:0/2433766649 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22147 (secure 0 0 0) 0x7f670c19b620 con 0x7f670c1044f0 2024-08-26T00:00:34.122 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:00:34.122 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":78,"fsid":"f89d317a-633c-11ef-bcd2-c7b262605968","created":"2024-08-25T23:52:39.598509+0000","modified":"2024-08-26T00:00:30.169413+0000","last_up_change":"2024-08-25T23:59:35.047575+0000","last_in_change":"2024-08-25T23:59:12.796940+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-25T23:55:51.022219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-26T00:00:25.606536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-26T00:00:28.322822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"980d8635-bca1-4c5a-b78e-4b44f9315d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6803","nonce":2657450248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6805","nonce":2657450248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6809","nonce":2657450248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6807","nonce":2657450248}]},"public_addr":"172.21.15.42:6803/2657450248","cluster_addr":"172.21.15.42:6805/2657450248","heartbeat_back_addr":"172.21.15.42:6809/2657450248","heartbeat_front_addr":"172.21.15.42:6807/2657450248","state":["exists","up"]},{"osd":1,"uuid":"e5f8dc3b-876a-4bdd-b6b0-b0d99d098d95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6801","nonce":2396081001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6803","nonce":2396081001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6807","nonce":2396081001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6805","nonce":2396081001}]},"public_addr":"172.21.15.43:6801/2396081001","cluster_addr":"172.21.15.43:6803/2396081001","heartbeat_back_addr":"172.21.15.43:6807/2396081001","heartbeat_front_addr":"172.21.15.43:6805/2396081001","state":["exists","up"]},{"osd":2,"uuid":"06eb25af-8e3d-4f90-bc24-28a9bc224c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6801","nonce":189987070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6803","nonce":189987070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6807","nonce":189987070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6805","nonce":189987070}]},"public_addr":"172.21.15.181:6801/189987070","cluster_addr":"172.21.15.181:6803/189987070","heartbeat_back_addr":"172.21.15.181:6807/189987070","heartbeat_front_addr":"172.21.15.181:6805/189987070","state":["exists","up"]},{"osd":3,"uuid":"c78dbc49-b5c7-4f82-be36-c76a89496520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6811","nonce":251017896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6813","nonce":251017896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6817","nonce":251017896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6815","nonce":251017896}]},"public_addr":"172.21.15.42:6811/251017896","cluster_addr":"172.21.15.42:6813/251017896","heartbeat_back_addr":"172.21.15.42:6817/251017896","heartbeat_front_addr":"172.21.15.42:6815/251017896","state":["exists","up"]},{"osd":4,"uuid":"ba633f66-25af-492f-bbf2-76032a4cd3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6809","nonce":1315420796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6811","nonce":1315420796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6815","nonce":1315420796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6813","nonce":1315420796}]},"public_addr":"172.21.15.43:6809/1315420796","cluster_addr":"172.21.15.43:6811/1315420796","heartbeat_back_addr":"172.21.15.43:6815/1315420796","heartbeat_front_addr":"172.21.15.43:6813/1315420796","state":["exists","up"]},{"osd":5,"uuid":"04e47ad9-21ba-43da-9793-d5cf83150dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6809","nonce":246971403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6811","nonce":246971403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6815","nonce":246971403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6813","nonce":246971403}]},"public_addr":"172.21.15.181:6809/246971403","cluster_addr":"172.21.15.181:6811/246971403","heartbeat_back_addr":"172.21.15.181:6815/246971403","heartbeat_front_addr":"172.21.15.181:6813/246971403","state":["exists","up"]},{"osd":6,"uuid":"f48161cd-bc44-4d99-8248-1bb845111129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6819","nonce":2910656480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6821","nonce":2910656480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6825","nonce":2910656480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6823","nonce":2910656480}]},"public_addr":"172.21.15.42:6819/2910656480","cluster_addr":"172.21.15.42:6821/2910656480","heartbeat_back_addr":"172.21.15.42:6825/2910656480","heartbeat_front_addr":"172.21.15.42:6823/2910656480","state":["exists","up"]},{"osd":7,"uuid":"65470b06-b14d-4d8e-9bcb-e6927c37fda5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6817","nonce":624542778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6819","nonce":624542778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6823","nonce":624542778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6821","nonce":624542778}]},"public_addr":"172.21.15.43:6817/624542778","cluster_addr":"172.21.15.43:6819/624542778","heartbeat_back_addr":"172.21.15.43:6823/624542778","heartbeat_front_addr":"172.21.15.43:6821/624542778","state":["exists","up"]},{"osd":8,"uuid":"1f4c9152-4b7c-415f-9cb9-d1e926fad5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6817","nonce":728226568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6819","nonce":728226568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6823","nonce":728226568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6821","nonce":728226568}]},"public_addr":"172.21.15.181:6817/728226568","cluster_addr":"172.21.15.181:6819/728226568","heartbeat_back_addr":"172.21.15.181:6823/728226568","heartbeat_front_addr":"172.21.15.181:6821/728226568","state":["exists","up"]},{"osd":9,"uuid":"fb387fbe-19b4-4a3e-8e40-81bd1363b55c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6827","nonce":1052069444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6829","nonce":1052069444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6833","nonce":1052069444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6831","nonce":1052069444}]},"public_addr":"172.21.15.42:6827/1052069444","cluster_addr":"172.21.15.42:6829/1052069444","heartbeat_back_addr":"172.21.15.42:6833/1052069444","heartbeat_front_addr":"172.21.15.42:6831/1052069444","state":["exists","up"]},{"osd":10,"uuid":"fe5bbeec-2341-4ea9-97ab-cc45d738d741","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6825","nonce":3417487386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6827","nonce":3417487386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6831","nonce":3417487386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6829","nonce":3417487386}]},"public_addr":"172.21.15.43:6825/3417487386","cluster_addr":"172.21.15.43:6827/3417487386","heartbeat_back_addr":"172.21.15.43:6831/3417487386","heartbeat_front_addr":"172.21.15.43:6829/3417487386","state":["exists","up"]},{"osd":11,"uuid":"cee07741-3ab7-481e-8477-54319f4f178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6825","nonce":3817502913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6827","nonce":3817502913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6831","nonce":3817502913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6829","nonce":3817502913}]},"public_addr":"172.21.15.181:6825/3817502913","cluster_addr":"172.21.15.181:6827/3817502913","heartbeat_back_addr":"172.21.15.181:6831/3817502913","heartbeat_front_addr":"172.21.15.181:6829/3817502913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:00.603592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:24.637326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:47.587859+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:14.978783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:39.025819+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:01.965471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:29.753475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:54.162377+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:17.970871+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:46.175576+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:10.590220+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:33.216701+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/3711239085":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6801/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2983166615":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/2974122891":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2980210051":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/4227793902":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6801/1517739376":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6800/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/1775009918":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6800/1517739376":"2024-08-26T23:53:05.122858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-26T00:00:34.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:34.122+0000 7f6713400640 1 -- 172.21.15.42:0/2433766649 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f66f00a2b80 msgr2=0x7f66f00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:34.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:34.122+0000 7f6713400640 1 --2- 172.21.15.42:0/2433766649 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f66f00a2b80 0x7f66f00a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f66fc009bd0 tx=0x7f66fc005f90 comp rx=0 tx=0).stop 2024-08-26T00:00:34.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:34.122+0000 7f6713400640 1 -- 172.21.15.42:0/2433766649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f670c1044f0 msgr2=0x7f670c19a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:34.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:34.123+0000 7f6713400640 1 --2- 172.21.15.42:0/2433766649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f670c1044f0 0x7f670c19a800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f66f400ea60 tx=0x7f66f400ef20 comp rx=0 tx=0).stop 2024-08-26T00:00:34.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:34.123+0000 7f6713400640 1 -- 172.21.15.42:0/2433766649 shutdown_connections 2024-08-26T00:00:34.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:34.123+0000 7f6713400640 1 --2- 172.21.15.42:0/2433766649 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f66f00a2b80 0x7f66f00a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:34.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:34.123+0000 7f6713400640 1 --2- 172.21.15.42:0/2433766649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f670c109c00 0x7f670c19eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:34.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:34.123+0000 7f6713400640 1 --2- 172.21.15.42:0/2433766649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f670c1044f0 0x7f670c19a800 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:34.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:34.123+0000 7f6713400640 1 --2- 172.21.15.42:0/2433766649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f670c103b50 0x7f670c19a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:34.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:34.123+0000 7f6713400640 1 -- 172.21.15.42:0/2433766649 >> 172.21.15.42:0/2433766649 conn(0x7f670c0ff830 msgr2=0x7f670c100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:34.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:34.123+0000 7f6713400640 1 -- 172.21.15.42:0/2433766649 shutdown_connections 2024-08-26T00:00:34.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:34.123+0000 7f6713400640 1 -- 172.21.15.42:0/2433766649 wait complete. 2024-08-26T00:00:34.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:34 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/2433766649' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:00:34.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:34 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2433766649' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:00:34.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:34 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/2433766649' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:00:34.784 INFO:journalctl@ceph.mds.i.smithi181.stdout:Aug 26 00:00:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-i[52991]: 2024-08-26T00:00:34.323+0000 7fbd83072640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-26T00:00:34.828 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-08-26T00:00:35.209 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:35.623 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:35 smithi042 ceph-mon[17225]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 997 B/s wr, 3 op/s 2024-08-26T00:00:35.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.737+0000 7fc932200640 1 -- 172.21.15.42:0/566538563 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc92c0764c0 msgr2=0x7fc92c0768a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:35.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.737+0000 7fc932200640 1 --2- 172.21.15.42:0/566538563 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc92c0764c0 0x7fc92c0768a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc91c009900 tx=0x7fc91c02a3f0 comp rx=0 tx=0).stop 2024-08-26T00:00:35.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.737+0000 7fc932200640 1 -- 172.21.15.42:0/566538563 shutdown_connections 2024-08-26T00:00:35.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.737+0000 7fc932200640 1 --2- 172.21.15.42:0/566538563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc92c1127d0 0x7fc92c114bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:35.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.737+0000 7fc932200640 1 --2- 172.21.15.42:0/566538563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc92c076de0 0x7fc92c112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:35.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.737+0000 7fc932200640 1 --2- 172.21.15.42:0/566538563 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc92c0764c0 0x7fc92c0768a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:35.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.737+0000 7fc932200640 1 -- 172.21.15.42:0/566538563 >> 172.21.15.42:0/566538563 conn(0x7fc92c0ff830 msgr2=0x7fc92c101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:35.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.737+0000 7fc932200640 1 -- 172.21.15.42:0/566538563 shutdown_connections 2024-08-26T00:00:35.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.737+0000 7fc932200640 1 -- 172.21.15.42:0/566538563 wait complete. 2024-08-26T00:00:35.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.738+0000 7fc932200640 1 Processor -- start 2024-08-26T00:00:35.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.738+0000 7fc932200640 1 -- start start 2024-08-26T00:00:35.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.739+0000 7fc932200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc92c0764c0 0x7fc92c1a45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:35.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.739+0000 7fc932200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc92c076de0 0x7fc92c1a4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:35.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.739+0000 7fc932200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc92c1127d0 0x7fc92c19e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:35.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.739+0000 7fc932200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc92c1183b0 con 0x7fc92c0764c0 2024-08-26T00:00:35.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.739+0000 7fc932200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc92c118230 con 0x7fc92c1127d0 2024-08-26T00:00:35.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.739+0000 7fc932200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc92c118530 con 0x7fc92c076de0 2024-08-26T00:00:35.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.739+0000 7fc92b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc92c0764c0 0x7fc92c1a45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:35.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.739+0000 7fc92b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc92c0764c0 0x7fc92c1a45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48632/0 (socket says 172.21.15.42:48632) 2024-08-26T00:00:35.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.739+0000 7fc92b400640 1 -- 172.21.15.42:0/3599012535 learned_addr learned my addr 172.21.15.42:0/3599012535 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:35.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.739+0000 7fc92be00640 1 --2- 172.21.15.42:0/3599012535 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc92c1127d0 0x7fc92c19e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:35.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.739+0000 7fc92aa00640 1 --2- 172.21.15.42:0/3599012535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc92c076de0 0x7fc92c1a4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:35.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.739+0000 7fc92b400640 1 -- 172.21.15.42:0/3599012535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc92c076de0 msgr2=0x7fc92c1a4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:35.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.739+0000 7fc92b400640 1 --2- 172.21.15.42:0/3599012535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc92c076de0 0x7fc92c1a4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:35.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.739+0000 7fc92b400640 1 -- 172.21.15.42:0/3599012535 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc92c1127d0 msgr2=0x7fc92c19e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:35.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.739+0000 7fc92b400640 1 --2- 172.21.15.42:0/3599012535 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc92c1127d0 0x7fc92c19e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:35.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.739+0000 7fc92b400640 1 -- 172.21.15.42:0/3599012535 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92c19eee0 con 0x7fc92c0764c0 2024-08-26T00:00:35.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.740+0000 7fc92b400640 1 --2- 172.21.15.42:0/3599012535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc92c0764c0 0x7fc92c1a45a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc91c004770 tx=0x7fc91c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:35.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.740+0000 7fc923e00640 1 -- 172.21.15.42:0/3599012535 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c03f070 con 0x7fc92c0764c0 2024-08-26T00:00:35.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.740+0000 7fc923e00640 1 -- 172.21.15.42:0/3599012535 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc91c031ca0 con 0x7fc92c0764c0 2024-08-26T00:00:35.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.740+0000 7fc932200640 1 -- 172.21.15.42:0/3599012535 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc92c19f170 con 0x7fc92c0764c0 2024-08-26T00:00:35.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.740+0000 7fc923e00640 1 -- 172.21.15.42:0/3599012535 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c035030 con 0x7fc92c0764c0 2024-08-26T00:00:35.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.740+0000 7fc932200640 1 -- 172.21.15.42:0/3599012535 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc92c1ab350 con 0x7fc92c0764c0 2024-08-26T00:00:35.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.741+0000 7fc932200640 1 -- 172.21.15.42:0/3599012535 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc92c077c00 con 0x7fc92c0764c0 2024-08-26T00:00:35.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.743+0000 7fc923e00640 1 -- 172.21.15.42:0/3599012535 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc91c042070 con 0x7fc92c0764c0 2024-08-26T00:00:35.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.746+0000 7fc923e00640 1 --2- 172.21.15.42:0/3599012535 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc9100a2b80 0x7fc9100a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:35.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.746+0000 7fc923e00640 1 -- 172.21.15.42:0/3599012535 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fc91c0efb30 con 0x7fc92c0764c0 2024-08-26T00:00:35.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.746+0000 7fc92aa00640 1 --2- 172.21.15.42:0/3599012535 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc9100a2b80 0x7fc9100a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:35.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.746+0000 7fc92aa00640 1 --2- 172.21.15.42:0/3599012535 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc9100a2b80 0x7fc9100a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc92c19fec0 tx=0x7fc918005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:35.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.748+0000 7fc923e00640 1 -- 172.21.15.42:0/3599012535 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fc91c0bc5b0 con 0x7fc92c0764c0 2024-08-26T00:00:35.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:35 smithi043 ceph-mon[22091]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 997 B/s wr, 3 op/s 2024-08-26T00:00:35.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:35 smithi181 ceph-mon[22102]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 997 B/s wr, 3 op/s 2024-08-26T00:00:35.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:35.974+0000 7fc932200640 1 -- 172.21.15.42:0/3599012535 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc92c10d960 con 0x7fc92c0764c0 2024-08-26T00:00:36.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:36.370+0000 7fc923e00640 1 -- 172.21.15.42:0/3599012535 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7fc91c0c08b0 con 0x7fc92c0764c0 2024-08-26T00:00:36.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:36.373+0000 7fc932200640 1 -- 172.21.15.42:0/3599012535 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc9100a2b80 msgr2=0x7fc9100a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:36.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:36.373+0000 7fc932200640 1 --2- 172.21.15.42:0/3599012535 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc9100a2b80 0x7fc9100a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc92c19fec0 tx=0x7fc918005f90 comp rx=0 tx=0).stop 2024-08-26T00:00:36.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:36.373+0000 7fc932200640 1 -- 172.21.15.42:0/3599012535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc92c0764c0 msgr2=0x7fc92c1a45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:36.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:36.373+0000 7fc932200640 1 --2- 172.21.15.42:0/3599012535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc92c0764c0 0x7fc92c1a45a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc91c004770 tx=0x7fc91c003c10 comp rx=0 tx=0).stop 2024-08-26T00:00:36.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:36.373+0000 7fc932200640 1 -- 172.21.15.42:0/3599012535 shutdown_connections 2024-08-26T00:00:36.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:36.373+0000 7fc932200640 1 --2- 172.21.15.42:0/3599012535 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc9100a2b80 0x7fc9100a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:36.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:36.373+0000 7fc932200640 1 --2- 172.21.15.42:0/3599012535 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc92c1127d0 0x7fc92c19e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:36.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:36.373+0000 7fc932200640 1 --2- 172.21.15.42:0/3599012535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc92c076de0 0x7fc92c1a4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:36.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:36.373+0000 7fc932200640 1 --2- 172.21.15.42:0/3599012535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc92c0764c0 0x7fc92c1a45a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:36.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:36.373+0000 7fc932200640 1 -- 172.21.15.42:0/3599012535 >> 172.21.15.42:0/3599012535 conn(0x7fc92c0ff830 msgr2=0x7fc92c101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:36.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:36.373+0000 7fc932200640 1 -- 172.21.15.42:0/3599012535 shutdown_connections 2024-08-26T00:00:36.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:36.373+0000 7fc932200640 1 -- 172.21.15.42:0/3599012535 wait complete. 2024-08-26T00:00:36.719 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:36 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/3599012535' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-08-26T00:00:36.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:36 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/3599012535' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-08-26T00:00:36.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:36 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/3599012535' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-08-26T00:00:37.118 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-08-26T00:00:37.119 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-08-26T00:00:37.515 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:37.655 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:37 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/3599012535' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-26T00:00:37.655 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:37 smithi042 ceph-mon[17225]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-26T00:00:37.655 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:37 smithi042 ceph-mon[17225]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-08-26T00:00:37.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:37 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/3599012535' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-26T00:00:37.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:37 smithi043 ceph-mon[22091]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-26T00:00:37.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:37 smithi043 ceph-mon[22091]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-08-26T00:00:37.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:37 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/3599012535' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-26T00:00:37.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:37 smithi181 ceph-mon[22102]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-26T00:00:37.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:37 smithi181 ceph-mon[22102]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-08-26T00:00:37.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.989+0000 7f0d7d800640 1 -- 172.21.15.42:0/4269906779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d78104760 msgr2=0x7f0d781087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:37.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.989+0000 7f0d7d800640 1 --2- 172.21.15.42:0/4269906779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d78104760 0x7f0d781087b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009860 tx=0x7f0d6002a340 comp rx=0 tx=0).stop 2024-08-26T00:00:37.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.989+0000 7f0d7d800640 1 -- 172.21.15.42:0/4269906779 shutdown_connections 2024-08-26T00:00:37.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.989+0000 7f0d7d800640 1 --2- 172.21.15.42:0/4269906779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d78108ee0 0x7f0d78110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:37.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.989+0000 7f0d7d800640 1 --2- 172.21.15.42:0/4269906779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d78104760 0x7f0d781087b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:37.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.989+0000 7f0d7d800640 1 --2- 172.21.15.42:0/4269906779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d78103db0 0x7f0d78104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:37.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.989+0000 7f0d7d800640 1 -- 172.21.15.42:0/4269906779 >> 172.21.15.42:0/4269906779 conn(0x7f0d780ff7f0 msgr2=0x7f0d78101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:37.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.989+0000 7f0d7d800640 1 -- 172.21.15.42:0/4269906779 shutdown_connections 2024-08-26T00:00:37.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.989+0000 7f0d7d800640 1 -- 172.21.15.42:0/4269906779 wait complete. 2024-08-26T00:00:37.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.990+0000 7f0d7d800640 1 Processor -- start 2024-08-26T00:00:37.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.990+0000 7f0d7d800640 1 -- start start 2024-08-26T00:00:37.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.991+0000 7f0d7d800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d78103db0 0x7f0d7819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:37.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.991+0000 7f0d7d800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d78104760 0x7f0d7819a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:37.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.991+0000 7f0d7d800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d78108ee0 0x7f0d7819ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:37.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.991+0000 7f0d7d800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0d78113f40 con 0x7f0d78104760 2024-08-26T00:00:37.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.991+0000 7f0d7d800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0d78113dc0 con 0x7f0d78103db0 2024-08-26T00:00:37.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.991+0000 7f0d7d800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0d781140c0 con 0x7f0d78108ee0 2024-08-26T00:00:37.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.991+0000 7f0d6fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d78104760 0x7f0d7819a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:37.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.991+0000 7f0d76a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d78103db0 0x7f0d7819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:37.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.991+0000 7f0d76a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d78103db0 0x7f0d7819a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:52876/0 (socket says 172.21.15.42:52876) 2024-08-26T00:00:37.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.991+0000 7f0d76a00640 1 -- 172.21.15.42:0/3053265776 learned_addr learned my addr 172.21.15.42:0/3053265776 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:37.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.991+0000 7f0d77400640 1 --2- 172.21.15.42:0/3053265776 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d78108ee0 0x7f0d7819ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:37.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.991+0000 7f0d76a00640 1 -- 172.21.15.42:0/3053265776 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d78108ee0 msgr2=0x7f0d7819ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:37.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.991+0000 7f0d76a00640 1 --2- 172.21.15.42:0/3053265776 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d78108ee0 0x7f0d7819ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:37.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.991+0000 7f0d76a00640 1 -- 172.21.15.42:0/3053265776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d78104760 msgr2=0x7f0d7819a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:37.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.991+0000 7f0d76a00640 1 --2- 172.21.15.42:0/3053265776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d78104760 0x7f0d7819a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:37.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.991+0000 7f0d76a00640 1 -- 172.21.15.42:0/3053265776 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7819f3b0 con 0x7f0d78103db0 2024-08-26T00:00:37.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.991+0000 7f0d6fe00640 1 --2- 172.21.15.42:0/3053265776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d78104760 0x7f0d7819a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:00:37.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.992+0000 7f0d76a00640 1 --2- 172.21.15.42:0/3053265776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d78103db0 0x7f0d7819a400 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800e9f0 tx=0x7f0d6800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:37.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.992+0000 7f0d6f400640 1 -- 172.21.15.42:0/3053265776 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6800cd80 con 0x7f0d78103db0 2024-08-26T00:00:37.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.992+0000 7f0d6f400640 1 -- 172.21.15.42:0/3053265776 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d68005500 con 0x7f0d78103db0 2024-08-26T00:00:37.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.992+0000 7f0d6f400640 1 -- 172.21.15.42:0/3053265776 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d68010690 con 0x7f0d78103db0 2024-08-26T00:00:37.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.992+0000 7f0d7d800640 1 -- 172.21.15.42:0/3053265776 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d7819f6a0 con 0x7f0d78103db0 2024-08-26T00:00:37.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.992+0000 7f0d7d800640 1 -- 172.21.15.42:0/3053265776 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d781a6f80 con 0x7f0d78103db0 2024-08-26T00:00:37.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.993+0000 7f0d7d800640 1 -- 172.21.15.42:0/3053265776 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d78104190 con 0x7f0d78103db0 2024-08-26T00:00:37.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.995+0000 7f0d6f400640 1 -- 172.21.15.42:0/3053265776 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0d680046c0 con 0x7f0d78103db0 2024-08-26T00:00:37.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.996+0000 7f0d6f400640 1 --2- 172.21.15.42:0/3053265776 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0d5c0a2c00 0x7f0d5c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:37.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.997+0000 7f0d6f400640 1 -- 172.21.15.42:0/3053265776 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f0d680cf310 con 0x7f0d78103db0 2024-08-26T00:00:37.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.997+0000 7f0d6fe00640 1 --2- 172.21.15.42:0/3053265776 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0d5c0a2c00 0x7f0d5c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:37.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:37.997+0000 7f0d6fe00640 1 --2- 172.21.15.42:0/3053265776 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0d5c0a2c00 0x7f0d5c0a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0d6002a930 tx=0x7f0d600056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:38.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:38.000+0000 7f0d6f400640 1 -- 172.21.15.42:0/3053265776 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f0d6809c320 con 0x7f0d78103db0 2024-08-26T00:00:38.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:38.224+0000 7f0d7d800640 1 -- 172.21.15.42:0/3053265776 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f0d7810c180 con 0x7f0d78103db0 2024-08-26T00:00:38.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:38.385+0000 7f0d6f400640 1 -- 172.21.15.42:0/3053265776 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v17) ==== 105+0+0 (secure 0 0 0) 0x7f0d68086070 con 0x7f0d78103db0 2024-08-26T00:00:38.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:38.388+0000 7f0d7d800640 1 -- 172.21.15.42:0/3053265776 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0d5c0a2c00 msgr2=0x7f0d5c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:38.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:38.388+0000 7f0d7d800640 1 --2- 172.21.15.42:0/3053265776 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0d5c0a2c00 0x7f0d5c0a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0d6002a930 tx=0x7f0d600056d0 comp rx=0 tx=0).stop 2024-08-26T00:00:38.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:38.388+0000 7f0d7d800640 1 -- 172.21.15.42:0/3053265776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d78103db0 msgr2=0x7f0d7819a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:38.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:38.388+0000 7f0d7d800640 1 --2- 172.21.15.42:0/3053265776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d78103db0 0x7f0d7819a400 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800e9f0 tx=0x7f0d6800edf0 comp rx=0 tx=0).stop 2024-08-26T00:00:38.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:38.388+0000 7f0d7d800640 1 -- 172.21.15.42:0/3053265776 shutdown_connections 2024-08-26T00:00:38.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:38.388+0000 7f0d7d800640 1 --2- 172.21.15.42:0/3053265776 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0d5c0a2c00 0x7f0d5c0a50c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:38.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:38.388+0000 7f0d7d800640 1 --2- 172.21.15.42:0/3053265776 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d78108ee0 0x7f0d7819ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:38.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:38.388+0000 7f0d7d800640 1 --2- 172.21.15.42:0/3053265776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d78104760 0x7f0d7819a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:38.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:38.388+0000 7f0d7d800640 1 --2- 172.21.15.42:0/3053265776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d78103db0 0x7f0d7819a400 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:38.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:38.388+0000 7f0d7d800640 1 -- 172.21.15.42:0/3053265776 >> 172.21.15.42:0/3053265776 conn(0x7f0d780ff7f0 msgr2=0x7f0d78100b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:38.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:38.388+0000 7f0d7d800640 1 -- 172.21.15.42:0/3053265776 shutdown_connections 2024-08-26T00:00:38.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:38.388+0000 7f0d7d800640 1 -- 172.21.15.42:0/3053265776 wait complete. 2024-08-26T00:00:38.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:38 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/3053265776' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-08-26T00:00:38.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:38 smithi042 ceph-mon[17225]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-08-26T00:00:38.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:38 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/3053265776' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-08-26T00:00:38.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:38 smithi043 ceph-mon[22091]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-08-26T00:00:38.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:38 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/3053265776' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-08-26T00:00:38.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:38 smithi181 ceph-mon[22102]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-08-26T00:00:39.123 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-08-26T00:00:39.511 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:39.650 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:39 smithi042 ceph-mon[17225]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-26T00:00:39.651 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:39 smithi042 ceph-mon[17225]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-26T00:00:39.651 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:39 smithi042 ceph-mon[17225]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-26T00:00:39.651 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:39 smithi042 ceph-mon[17225]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-26T00:00:39.651 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:39 smithi042 ceph-mon[17225]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-08-26T00:00:39.651 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:39 smithi042 ceph-mon[17225]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-08-26T00:00:39.651 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:39 smithi042 ceph-mon[17225]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-08-26T00:00:39.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:39 smithi043 ceph-mon[22091]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-26T00:00:39.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:39 smithi043 ceph-mon[22091]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-26T00:00:39.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:39 smithi043 ceph-mon[22091]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-26T00:00:39.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:39 smithi043 ceph-mon[22091]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-26T00:00:39.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:39 smithi043 ceph-mon[22091]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-08-26T00:00:39.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:39 smithi043 ceph-mon[22091]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-08-26T00:00:39.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:39 smithi043 ceph-mon[22091]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-08-26T00:00:39.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:39 smithi181 ceph-mon[22102]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-26T00:00:39.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:39 smithi181 ceph-mon[22102]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-26T00:00:39.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:39 smithi181 ceph-mon[22102]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-26T00:00:39.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:39 smithi181 ceph-mon[22102]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-26T00:00:39.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:39 smithi181 ceph-mon[22102]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-08-26T00:00:39.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:39 smithi181 ceph-mon[22102]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-08-26T00:00:39.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:39 smithi181 ceph-mon[22102]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-08-26T00:00:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.071+0000 7fb147800640 1 -- 172.21.15.42:0/1556242696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1401127d0 msgr2=0x7fb140114bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.071+0000 7fb147800640 1 --2- 172.21.15.42:0/1556242696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1401127d0 0x7fb140114bc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb138009ca0 tx=0x7fb13802a8c0 comp rx=0 tx=0).stop 2024-08-26T00:00:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.071+0000 7fb147800640 1 -- 172.21.15.42:0/1556242696 shutdown_connections 2024-08-26T00:00:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.071+0000 7fb147800640 1 --2- 172.21.15.42:0/1556242696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1401127d0 0x7fb140114bc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.071+0000 7fb147800640 1 --2- 172.21.15.42:0/1556242696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb140076de0 0x7fb140112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.071+0000 7fb147800640 1 --2- 172.21.15.42:0/1556242696 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1400764c0 0x7fb1400768a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:40.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.071+0000 7fb147800640 1 -- 172.21.15.42:0/1556242696 >> 172.21.15.42:0/1556242696 conn(0x7fb1400ff830 msgr2=0x7fb140101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:40.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.071+0000 7fb147800640 1 -- 172.21.15.42:0/1556242696 shutdown_connections 2024-08-26T00:00:40.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.071+0000 7fb147800640 1 -- 172.21.15.42:0/1556242696 wait complete. 2024-08-26T00:00:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.072+0000 7fb147800640 1 Processor -- start 2024-08-26T00:00:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.072+0000 7fb147800640 1 -- start start 2024-08-26T00:00:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.073+0000 7fb147800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1400764c0 0x7fb1401a4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.073+0000 7fb147800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb140076de0 0x7fb1401a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.073+0000 7fb147800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1401127d0 0x7fb14019e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.073+0000 7fb147800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb140118320 con 0x7fb1401127d0 2024-08-26T00:00:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.073+0000 7fb147800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb1401181a0 con 0x7fb140076de0 2024-08-26T00:00:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.073+0000 7fb147800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb1401184a0 con 0x7fb1400764c0 2024-08-26T00:00:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.073+0000 7fb145800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1401127d0 0x7fb14019e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.073+0000 7fb13fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb140076de0 0x7fb1401a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.073+0000 7fb145800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1401127d0 0x7fb14019e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48658/0 (socket says 172.21.15.42:48658) 2024-08-26T00:00:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.073+0000 7fb145800640 1 -- 172.21.15.42:0/2212652656 learned_addr learned my addr 172.21.15.42:0/2212652656 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.073+0000 7fb144e00640 1 --2- 172.21.15.42:0/2212652656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1400764c0 0x7fb1401a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.074+0000 7fb145800640 1 -- 172.21.15.42:0/2212652656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1400764c0 msgr2=0x7fb1401a4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.074+0000 7fb145800640 1 --2- 172.21.15.42:0/2212652656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1400764c0 0x7fb1401a4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.074+0000 7fb145800640 1 -- 172.21.15.42:0/2212652656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb140076de0 msgr2=0x7fb1401a4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.074+0000 7fb145800640 1 --2- 172.21.15.42:0/2212652656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb140076de0 0x7fb1401a4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.074+0000 7fb145800640 1 -- 172.21.15.42:0/2212652656 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14019ed10 con 0x7fb1401127d0 2024-08-26T00:00:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.074+0000 7fb145800640 1 --2- 172.21.15.42:0/2212652656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1401127d0 0x7fb14019e5e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb13802ade0 tx=0x7fb1380319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:40.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.074+0000 7fb13d600640 1 -- 172.21.15.42:0/2212652656 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb138003b70 con 0x7fb1401127d0 2024-08-26T00:00:40.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.074+0000 7fb13d600640 1 -- 172.21.15.42:0/2212652656 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb138003d10 con 0x7fb1401127d0 2024-08-26T00:00:40.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.074+0000 7fb13d600640 1 -- 172.21.15.42:0/2212652656 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13802fc40 con 0x7fb1401127d0 2024-08-26T00:00:40.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.074+0000 7fb147800640 1 -- 172.21.15.42:0/2212652656 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb14019efa0 con 0x7fb1401127d0 2024-08-26T00:00:40.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.074+0000 7fb147800640 1 -- 172.21.15.42:0/2212652656 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1401ab2f0 con 0x7fb1401127d0 2024-08-26T00:00:40.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.076+0000 7fb147800640 1 -- 172.21.15.42:0/2212652656 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1400768a0 con 0x7fb1401127d0 2024-08-26T00:00:40.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.077+0000 7fb13d600640 1 -- 172.21.15.42:0/2212652656 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb138004050 con 0x7fb1401127d0 2024-08-26T00:00:40.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.079+0000 7fb13d600640 1 --2- 172.21.15.42:0/2212652656 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb1280a2c00 0x7fb1280a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:40.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.079+0000 7fb13d600640 1 -- 172.21.15.42:0/2212652656 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fb1380f00c0 con 0x7fb1401127d0 2024-08-26T00:00:40.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.079+0000 7fb144e00640 1 --2- 172.21.15.42:0/2212652656 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb1280a2c00 0x7fb1280a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:40.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.079+0000 7fb144e00640 1 --2- 172.21.15.42:0/2212652656 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb1280a2c00 0x7fb1280a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb134009bd0 tx=0x7fb134005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:40.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.083+0000 7fb13d600640 1 -- 172.21.15.42:0/2212652656 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb1380bd0d0 con 0x7fb1401127d0 2024-08-26T00:00:40.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.307+0000 7fb147800640 1 -- 172.21.15.42:0/2212652656 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fb14002d6a0 con 0x7fb1401127d0 2024-08-26T00:00:40.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.396+0000 7fb13d600640 1 -- 172.21.15.42:0/2212652656 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7fb1380bc9d0 con 0x7fb1401127d0 2024-08-26T00:00:40.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.399+0000 7fb147800640 1 -- 172.21.15.42:0/2212652656 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb1280a2c00 msgr2=0x7fb1280a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:40.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.399+0000 7fb147800640 1 --2- 172.21.15.42:0/2212652656 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb1280a2c00 0x7fb1280a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb134009bd0 tx=0x7fb134005f90 comp rx=0 tx=0).stop 2024-08-26T00:00:40.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.399+0000 7fb147800640 1 -- 172.21.15.42:0/2212652656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1401127d0 msgr2=0x7fb14019e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:40.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.399+0000 7fb147800640 1 --2- 172.21.15.42:0/2212652656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1401127d0 0x7fb14019e5e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb13802ade0 tx=0x7fb1380319f0 comp rx=0 tx=0).stop 2024-08-26T00:00:40.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.399+0000 7fb147800640 1 -- 172.21.15.42:0/2212652656 shutdown_connections 2024-08-26T00:00:40.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.399+0000 7fb147800640 1 --2- 172.21.15.42:0/2212652656 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb1280a2c00 0x7fb1280a50c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:40.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.399+0000 7fb147800640 1 --2- 172.21.15.42:0/2212652656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1401127d0 0x7fb14019e5e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:40.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.399+0000 7fb147800640 1 --2- 172.21.15.42:0/2212652656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb140076de0 0x7fb1401a4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:40.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.399+0000 7fb147800640 1 --2- 172.21.15.42:0/2212652656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1400764c0 0x7fb1401a4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:40.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.399+0000 7fb147800640 1 -- 172.21.15.42:0/2212652656 >> 172.21.15.42:0/2212652656 conn(0x7fb1400ff830 msgr2=0x7fb140101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:40.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.399+0000 7fb147800640 1 -- 172.21.15.42:0/2212652656 shutdown_connections 2024-08-26T00:00:40.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:40.399+0000 7fb147800640 1 -- 172.21.15.42:0/2212652656 wait complete. 2024-08-26T00:00:40.729 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:40 smithi042 ceph-mon[17225]: mds.? [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] up:active 2024-08-26T00:00:40.729 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:40 smithi042 ceph-mon[17225]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-26T00:00:40.729 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:40 smithi042 ceph-mon[17225]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-26T00:00:40.729 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:40 smithi042 ceph-mon[17225]: Cluster is now healthy 2024-08-26T00:00:40.729 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:40 smithi042 ceph-mon[17225]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-08-26T00:00:40.730 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:40 smithi042 ceph-mon[17225]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-08-26T00:00:40.730 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:40 smithi042 ceph-mon[17225]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-08-26T00:00:40.730 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:40 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2212652656' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-08-26T00:00:40.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:40 smithi043 ceph-mon[22091]: mds.? [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] up:active 2024-08-26T00:00:40.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:40 smithi043 ceph-mon[22091]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-26T00:00:40.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:40 smithi043 ceph-mon[22091]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-26T00:00:40.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:40 smithi043 ceph-mon[22091]: Cluster is now healthy 2024-08-26T00:00:40.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:40 smithi043 ceph-mon[22091]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-08-26T00:00:40.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:40 smithi043 ceph-mon[22091]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-08-26T00:00:40.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:40 smithi043 ceph-mon[22091]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-08-26T00:00:40.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:40 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/2212652656' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-08-26T00:00:40.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:40 smithi181 ceph-mon[22102]: mds.? [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] up:active 2024-08-26T00:00:40.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:40 smithi181 ceph-mon[22102]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-26T00:00:40.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:40 smithi181 ceph-mon[22102]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-26T00:00:40.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:40 smithi181 ceph-mon[22102]: Cluster is now healthy 2024-08-26T00:00:40.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:40 smithi181 ceph-mon[22102]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-08-26T00:00:40.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:40 smithi181 ceph-mon[22102]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-08-26T00:00:40.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:40 smithi181 ceph-mon[22102]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-08-26T00:00:40.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:40 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/2212652656' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-08-26T00:00:41.114 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-08-26T00:00:41.493 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:41.688 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:41 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2212652656' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-26T00:00:41.688 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:41 smithi042 ceph-mon[17225]: mds.? [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] up:active 2024-08-26T00:00:41.688 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:41 smithi042 ceph-mon[17225]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-08-26T00:00:41.688 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:41 smithi042 ceph-mon[17225]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:00:41.688 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:41 smithi042 ceph-mon[17225]: pgmap v282: 97 pgs: 97 active+clean; 580 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-08-26T00:00:41.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:41 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/2212652656' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-26T00:00:41.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:41 smithi043 ceph-mon[22091]: mds.? [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] up:active 2024-08-26T00:00:41.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:41 smithi043 ceph-mon[22091]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-08-26T00:00:41.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:41 smithi043 ceph-mon[22091]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:00:41.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:41 smithi043 ceph-mon[22091]: pgmap v282: 97 pgs: 97 active+clean; 580 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-08-26T00:00:41.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:41 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/2212652656' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-26T00:00:41.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:41 smithi181 ceph-mon[22102]: mds.? [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] up:active 2024-08-26T00:00:41.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:41 smithi181 ceph-mon[22102]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-08-26T00:00:41.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:41 smithi181 ceph-mon[22102]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:00:41.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:41 smithi181 ceph-mon[22102]: pgmap v282: 97 pgs: 97 active+clean; 580 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-08-26T00:00:42.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.071+0000 7f4536600640 1 -- 172.21.15.42:0/185743935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4530104760 msgr2=0x7f45301087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:42.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.071+0000 7f4536600640 1 --2- 172.21.15.42:0/185743935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4530104760 0x7f45301087b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f451c009900 tx=0x7f451c02a3f0 comp rx=0 tx=0).stop 2024-08-26T00:00:42.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.071+0000 7f4536600640 1 -- 172.21.15.42:0/185743935 shutdown_connections 2024-08-26T00:00:42.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.071+0000 7f4536600640 1 --2- 172.21.15.42:0/185743935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4530108ee0 0x7f4530110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:42.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.071+0000 7f4536600640 1 --2- 172.21.15.42:0/185743935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4530104760 0x7f45301087b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:42.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.071+0000 7f4536600640 1 --2- 172.21.15.42:0/185743935 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4530103db0 0x7f4530104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:42.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.071+0000 7f4536600640 1 -- 172.21.15.42:0/185743935 >> 172.21.15.42:0/185743935 conn(0x7f45300ff7f0 msgr2=0x7f4530101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:42.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.071+0000 7f4536600640 1 -- 172.21.15.42:0/185743935 shutdown_connections 2024-08-26T00:00:42.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.071+0000 7f4536600640 1 -- 172.21.15.42:0/185743935 wait complete. 2024-08-26T00:00:42.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.072+0000 7f4536600640 1 Processor -- start 2024-08-26T00:00:42.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.073+0000 7f4536600640 1 -- start start 2024-08-26T00:00:42.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.073+0000 7f4536600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4530103db0 0x7f453019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:42.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.073+0000 7f4536600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4530104760 0x7f453019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:42.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.073+0000 7f4536600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4530108ee0 0x7f453019ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:42.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.073+0000 7f4536600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4530113f40 con 0x7f4530108ee0 2024-08-26T00:00:42.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.073+0000 7f4536600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4530113dc0 con 0x7f4530103db0 2024-08-26T00:00:42.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.073+0000 7f4536600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f45301140c0 con 0x7f4530104760 2024-08-26T00:00:42.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.073+0000 7f452fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4530108ee0 0x7f453019ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:42.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.073+0000 7f452f400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4530103db0 0x7f453019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:42.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.073+0000 7f452ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4530104760 0x7f453019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:42.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.073+0000 7f452f400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4530103db0 0x7f453019a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:52906/0 (socket says 172.21.15.42:52906) 2024-08-26T00:00:42.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.073+0000 7f452f400640 1 -- 172.21.15.42:0/2555594550 learned_addr learned my addr 172.21.15.42:0/2555594550 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:42.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.074+0000 7f452fe00640 1 -- 172.21.15.42:0/2555594550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4530104760 msgr2=0x7f453019a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:42.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.074+0000 7f452fe00640 1 --2- 172.21.15.42:0/2555594550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4530104760 0x7f453019a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:42.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.074+0000 7f452fe00640 1 -- 172.21.15.42:0/2555594550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4530103db0 msgr2=0x7f453019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:42.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.074+0000 7f452fe00640 1 --2- 172.21.15.42:0/2555594550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4530103db0 0x7f453019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:42.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.074+0000 7f452fe00640 1 -- 172.21.15.42:0/2555594550 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f453019f410 con 0x7f4530108ee0 2024-08-26T00:00:42.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.074+0000 7f452f400640 1 --2- 172.21.15.42:0/2555594550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4530103db0 0x7f453019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:00:42.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.074+0000 7f452fe00640 1 --2- 172.21.15.42:0/2555594550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4530108ee0 0x7f453019ed30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f452800da10 tx=0x7f452800ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:42.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.074+0000 7f4527e00640 1 -- 172.21.15.42:0/2555594550 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452800bd70 con 0x7f4530108ee0 2024-08-26T00:00:42.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.074+0000 7f4536600640 1 -- 172.21.15.42:0/2555594550 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f453019f700 con 0x7f4530108ee0 2024-08-26T00:00:42.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.074+0000 7f4527e00640 1 -- 172.21.15.42:0/2555594550 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4528003e50 con 0x7f4530108ee0 2024-08-26T00:00:42.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.074+0000 7f4527e00640 1 -- 172.21.15.42:0/2555594550 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45280106a0 con 0x7f4530108ee0 2024-08-26T00:00:42.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.075+0000 7f4536600640 1 -- 172.21.15.42:0/2555594550 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45301a6fe0 con 0x7f4530108ee0 2024-08-26T00:00:42.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.076+0000 7f4536600640 1 -- 172.21.15.42:0/2555594550 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4530104190 con 0x7f4530108ee0 2024-08-26T00:00:42.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.077+0000 7f4527e00640 1 -- 172.21.15.42:0/2555594550 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4528003970 con 0x7f4530108ee0 2024-08-26T00:00:42.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.079+0000 7f4527e00640 1 --2- 172.21.15.42:0/2555594550 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f45140a2c00 0x7f45140a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:42.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.079+0000 7f4527e00640 1 -- 172.21.15.42:0/2555594550 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f45280cf210 con 0x7f4530108ee0 2024-08-26T00:00:42.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.079+0000 7f452f400640 1 --2- 172.21.15.42:0/2555594550 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f45140a2c00 0x7f45140a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:42.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.080+0000 7f452f400640 1 --2- 172.21.15.42:0/2555594550 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f45140a2c00 0x7f45140a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f45200104e0 tx=0x7f452000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:42.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.083+0000 7f4527e00640 1 -- 172.21.15.42:0/2555594550 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f452809c220 con 0x7f4530108ee0 2024-08-26T00:00:42.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.312+0000 7f4536600640 1 -- 172.21.15.42:0/2555594550 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f453002d6a0 con 0x7f4530108ee0 2024-08-26T00:00:42.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.409+0000 7f4527e00640 1 -- 172.21.15.42:0/2555594550 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) ==== 115+0+0 (secure 0 0 0) 0x7f452809bb20 con 0x7f4530108ee0 2024-08-26T00:00:42.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.411+0000 7f4536600640 1 -- 172.21.15.42:0/2555594550 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f45140a2c00 msgr2=0x7f45140a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:42.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.411+0000 7f4536600640 1 --2- 172.21.15.42:0/2555594550 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f45140a2c00 0x7f45140a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f45200104e0 tx=0x7f452000b410 comp rx=0 tx=0).stop 2024-08-26T00:00:42.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.412+0000 7f4536600640 1 -- 172.21.15.42:0/2555594550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4530108ee0 msgr2=0x7f453019ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:42.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.412+0000 7f4536600640 1 --2- 172.21.15.42:0/2555594550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4530108ee0 0x7f453019ed30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f452800da10 tx=0x7f452800ded0 comp rx=0 tx=0).stop 2024-08-26T00:00:42.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.412+0000 7f4536600640 1 -- 172.21.15.42:0/2555594550 shutdown_connections 2024-08-26T00:00:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.412+0000 7f4536600640 1 --2- 172.21.15.42:0/2555594550 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f45140a2c00 0x7f45140a50c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.412+0000 7f4536600640 1 --2- 172.21.15.42:0/2555594550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4530108ee0 0x7f453019ed30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.412+0000 7f4536600640 1 --2- 172.21.15.42:0/2555594550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4530104760 0x7f453019a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.412+0000 7f4536600640 1 --2- 172.21.15.42:0/2555594550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4530103db0 0x7f453019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.412+0000 7f4536600640 1 -- 172.21.15.42:0/2555594550 >> 172.21.15.42:0/2555594550 conn(0x7f45300ff7f0 msgr2=0x7f4530100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.412+0000 7f4536600640 1 -- 172.21.15.42:0/2555594550 shutdown_connections 2024-08-26T00:00:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:42.412+0000 7f4536600640 1 -- 172.21.15.42:0/2555594550 wait complete. 2024-08-26T00:00:42.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:42 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/2555594550' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-08-26T00:00:42.770 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:42 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2555594550' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-08-26T00:00:42.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:42 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/2555594550' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-08-26T00:00:43.149 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-08-26T00:00:43.150 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-08-26T00:00:43.531 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:43.669 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:43 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2555594550' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-26T00:00:43.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:43 smithi042 ceph-mon[17225]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:00:43.670 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:43 smithi042 ceph-mon[17225]: pgmap v283: 97 pgs: 97 active+clean; 580 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-08-26T00:00:43.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:43 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/2555594550' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-26T00:00:43.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:43 smithi043 ceph-mon[22091]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:00:43.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:43 smithi043 ceph-mon[22091]: pgmap v283: 97 pgs: 97 active+clean; 580 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-08-26T00:00:43.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:43 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/2555594550' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-26T00:00:43.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:43 smithi181 ceph-mon[22102]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:00:43.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:43 smithi181 ceph-mon[22102]: pgmap v283: 97 pgs: 97 active+clean; 580 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-08-26T00:00:44.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.079+0000 7f681d000640 1 -- 172.21.15.42:0/1335588268 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6818109c00 msgr2=0x7f6818109fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:44.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.079+0000 7f681d000640 1 --2- 172.21.15.42:0/1335588268 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6818109c00 0x7f6818109fe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6808009930 tx=0x7f680802a440 comp rx=0 tx=0).stop 2024-08-26T00:00:44.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.079+0000 7f681d000640 1 -- 172.21.15.42:0/1335588268 shutdown_connections 2024-08-26T00:00:44.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.079+0000 7f681d000640 1 --2- 172.21.15.42:0/1335588268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68181044f0 0x7f68181109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:44.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.079+0000 7f681d000640 1 --2- 172.21.15.42:0/1335588268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6818103b50 0x7f6818103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:44.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.079+0000 7f681d000640 1 --2- 172.21.15.42:0/1335588268 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6818109c00 0x7f6818109fe0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:44.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.079+0000 7f681d000640 1 -- 172.21.15.42:0/1335588268 >> 172.21.15.42:0/1335588268 conn(0x7f68180ff830 msgr2=0x7f6818101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:44.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.080+0000 7f681d000640 1 -- 172.21.15.42:0/1335588268 shutdown_connections 2024-08-26T00:00:44.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.080+0000 7f681d000640 1 -- 172.21.15.42:0/1335588268 wait complete. 2024-08-26T00:00:44.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.080+0000 7f681d000640 1 Processor -- start 2024-08-26T00:00:44.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.081+0000 7f681d000640 1 -- start start 2024-08-26T00:00:44.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.081+0000 7f681d000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6818103b50 0x7f681819a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:44.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.081+0000 7f681d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68181044f0 0x7f681819a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:44.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.081+0000 7f681d000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6818109c00 0x7f681819ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:44.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.081+0000 7f681d000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6818113fb0 con 0x7f68181044f0 2024-08-26T00:00:44.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.081+0000 7f681d000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6818113e30 con 0x7f6818109c00 2024-08-26T00:00:44.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.081+0000 7f681d000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6818114130 con 0x7f6818103b50 2024-08-26T00:00:44.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.081+0000 7f6815400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68181044f0 0x7f681819a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:44.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.081+0000 7f6815400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68181044f0 0x7f681819a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48702/0 (socket says 172.21.15.42:48702) 2024-08-26T00:00:44.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.081+0000 7f6815e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6818103b50 0x7f681819a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:44.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.081+0000 7f6815400640 1 -- 172.21.15.42:0/3577408118 learned_addr learned my addr 172.21.15.42:0/3577408118 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:44.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.081+0000 7f6816800640 1 --2- 172.21.15.42:0/3577408118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6818109c00 0x7f681819ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:44.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.082+0000 7f6815400640 1 -- 172.21.15.42:0/3577408118 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6818103b50 msgr2=0x7f681819a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:44.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.082+0000 7f6815400640 1 --2- 172.21.15.42:0/3577408118 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6818103b50 0x7f681819a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:44.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.082+0000 7f6815400640 1 -- 172.21.15.42:0/3577408118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6818109c00 msgr2=0x7f681819ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.082+0000 7f6815400640 1 --2- 172.21.15.42:0/3577408118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6818109c00 0x7f681819ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.082+0000 7f6815400640 1 -- 172.21.15.42:0/3577408118 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f681819f360 con 0x7f68181044f0 2024-08-26T00:00:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.082+0000 7f6815e00640 1 --2- 172.21.15.42:0/3577408118 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6818103b50 0x7f681819a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:00:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.082+0000 7f6815400640 1 --2- 172.21.15.42:0/3577408118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68181044f0 0x7f681819a8f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f680400e9f0 tx=0x7f680400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.082+0000 7f680ea00640 1 -- 172.21.15.42:0/3577408118 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680400cd80 con 0x7f68181044f0 2024-08-26T00:00:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.082+0000 7f681d000640 1 -- 172.21.15.42:0/3577408118 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f681819f650 con 0x7f68181044f0 2024-08-26T00:00:44.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.082+0000 7f680ea00640 1 -- 172.21.15.42:0/3577408118 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6804005500 con 0x7f68181044f0 2024-08-26T00:00:44.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.082+0000 7f680ea00640 1 -- 172.21.15.42:0/3577408118 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6804010690 con 0x7f68181044f0 2024-08-26T00:00:44.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.083+0000 7f681d000640 1 -- 172.21.15.42:0/3577408118 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68181a6f30 con 0x7f68181044f0 2024-08-26T00:00:44.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.084+0000 7f681d000640 1 -- 172.21.15.42:0/3577408118 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6818103fb0 con 0x7f68181044f0 2024-08-26T00:00:44.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.086+0000 7f680ea00640 1 -- 172.21.15.42:0/3577408118 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f68040046c0 con 0x7f68181044f0 2024-08-26T00:00:44.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.087+0000 7f680ea00640 1 --2- 172.21.15.42:0/3577408118 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f67fc0a2b80 0x7f67fc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:44.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.088+0000 7f680ea00640 1 -- 172.21.15.42:0/3577408118 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f68040cf370 con 0x7f68181044f0 2024-08-26T00:00:44.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.088+0000 7f6815e00640 1 --2- 172.21.15.42:0/3577408118 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f67fc0a2b80 0x7f67fc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:44.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.088+0000 7f6815e00640 1 --2- 172.21.15.42:0/3577408118 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f67fc0a2b80 0x7f67fc0a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6808006010 tx=0x7f6808031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:44.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.091+0000 7f680ea00640 1 -- 172.21.15.42:0/3577408118 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f680409c380 con 0x7f68181044f0 2024-08-26T00:00:44.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.301+0000 7f681d000640 1 -- 172.21.15.42:0/3577408118 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f68180623d0 con 0x7f67fc0a2b80 2024-08-26T00:00:44.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.330+0000 7f680ea00640 1 -- 172.21.15.42:0/3577408118 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f68180623d0 con 0x7f67fc0a2b80 2024-08-26T00:00:44.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.332+0000 7f681d000640 1 -- 172.21.15.42:0/3577408118 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f67fc0a2b80 msgr2=0x7f67fc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:44.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.332+0000 7f681d000640 1 --2- 172.21.15.42:0/3577408118 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f67fc0a2b80 0x7f67fc0a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6808006010 tx=0x7f6808031510 comp rx=0 tx=0).stop 2024-08-26T00:00:44.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.332+0000 7f681d000640 1 -- 172.21.15.42:0/3577408118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68181044f0 msgr2=0x7f681819a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:44.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.332+0000 7f681d000640 1 --2- 172.21.15.42:0/3577408118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68181044f0 0x7f681819a8f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f680400e9f0 tx=0x7f680400edf0 comp rx=0 tx=0).stop 2024-08-26T00:00:44.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.332+0000 7f681d000640 1 -- 172.21.15.42:0/3577408118 shutdown_connections 2024-08-26T00:00:44.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.332+0000 7f681d000640 1 --2- 172.21.15.42:0/3577408118 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f67fc0a2b80 0x7f67fc0a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:44.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.332+0000 7f681d000640 1 --2- 172.21.15.42:0/3577408118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6818109c00 0x7f681819ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:44.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.332+0000 7f681d000640 1 --2- 172.21.15.42:0/3577408118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68181044f0 0x7f681819a8f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:44.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.332+0000 7f681d000640 1 --2- 172.21.15.42:0/3577408118 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6818103b50 0x7f681819a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:44.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.332+0000 7f681d000640 1 -- 172.21.15.42:0/3577408118 >> 172.21.15.42:0/3577408118 conn(0x7f68180ff830 msgr2=0x7f6818100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:44.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.332+0000 7f681d000640 1 -- 172.21.15.42:0/3577408118 shutdown_connections 2024-08-26T00:00:44.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:44.333+0000 7f681d000640 1 -- 172.21.15.42:0/3577408118 wait complete. 2024-08-26T00:00:44.736 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:44 smithi042 ceph-mon[17225]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:00:44.736 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 26 00:00:44 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-26T00:00:44.308+0000 7f1389200640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-26T00:00:44.736 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 26 00:00:44 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-26T00:00:44.308+0000 7f1389200640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-26T00:00:44.736 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 26 00:00:44 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-26T00:00:44.308+0000 7f1389200640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-26T00:00:44.736 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 26 00:00:44 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-26T00:00:44.308+0000 7f1389200640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-26T00:00:44.736 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 26 00:00:44 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-26T00:00:44.308+0000 7f1389200640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-26T00:00:44.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:44 smithi043 ceph-mon[22091]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:00:44.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:44 smithi181 ceph-mon[22102]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:00:45.074 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-08-26T00:00:45.463 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:45.680 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:45 smithi043 ceph-mon[22091]: pgmap v284: 97 pgs: 97 active+clean; 582 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-08-26T00:00:45.738 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:45 smithi042 ceph-mon[17225]: pgmap v284: 97 pgs: 97 active+clean; 582 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-08-26T00:00:45.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:45 smithi181 ceph-mon[22102]: pgmap v284: 97 pgs: 97 active+clean; 582 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-08-26T00:00:45.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.973+0000 7f8721c00640 1 -- 172.21.15.42:0/2095164253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f871c104760 msgr2=0x7f871c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:45.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.973+0000 7f8721c00640 1 --2- 172.21.15.42:0/2095164253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f871c104760 0x7f871c1087b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8704009900 tx=0x7f870402a3f0 comp rx=0 tx=0).stop 2024-08-26T00:00:45.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.973+0000 7f8721c00640 1 -- 172.21.15.42:0/2095164253 shutdown_connections 2024-08-26T00:00:45.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.973+0000 7f8721c00640 1 --2- 172.21.15.42:0/2095164253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f871c108ee0 0x7f871c110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:45.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.973+0000 7f8721c00640 1 --2- 172.21.15.42:0/2095164253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f871c104760 0x7f871c1087b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:45.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.973+0000 7f8721c00640 1 --2- 172.21.15.42:0/2095164253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f871c103db0 0x7f871c104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:45.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.973+0000 7f8721c00640 1 -- 172.21.15.42:0/2095164253 >> 172.21.15.42:0/2095164253 conn(0x7f871c0ff7f0 msgr2=0x7f871c101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:45.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.973+0000 7f8721c00640 1 -- 172.21.15.42:0/2095164253 shutdown_connections 2024-08-26T00:00:45.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.973+0000 7f8721c00640 1 -- 172.21.15.42:0/2095164253 wait complete. 2024-08-26T00:00:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.974+0000 7f8721c00640 1 Processor -- start 2024-08-26T00:00:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.974+0000 7f8721c00640 1 -- start start 2024-08-26T00:00:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.975+0000 7f8721c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f871c103db0 0x7f871c19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.975+0000 7f8721c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f871c104760 0x7f871c19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.975+0000 7f8721c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f871c108ee0 0x7f871c19ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.975+0000 7f8721c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f871c113f90 con 0x7f871c103db0 2024-08-26T00:00:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.975+0000 7f8721c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f871c113e10 con 0x7f871c108ee0 2024-08-26T00:00:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.975+0000 7f8721c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f871c114110 con 0x7f871c104760 2024-08-26T00:00:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.975+0000 7f871aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f871c103db0 0x7f871c19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.975+0000 7f871b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f871c108ee0 0x7f871c19ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.975+0000 7f871b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f871c108ee0 0x7f871c19ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:49266/0 (socket says 172.21.15.42:49266) 2024-08-26T00:00:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.975+0000 7f8713e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f871c104760 0x7f871c19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.975+0000 7f871b400640 1 -- 172.21.15.42:0/2719080480 learned_addr learned my addr 172.21.15.42:0/2719080480 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.975+0000 7f871b400640 1 -- 172.21.15.42:0/2719080480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f871c104760 msgr2=0x7f871c19a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.975+0000 7f871b400640 1 --2- 172.21.15.42:0/2719080480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f871c104760 0x7f871c19a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.975+0000 7f871b400640 1 -- 172.21.15.42:0/2719080480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f871c103db0 msgr2=0x7f871c19a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.975+0000 7f871b400640 1 --2- 172.21.15.42:0/2719080480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f871c103db0 0x7f871c19a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.976+0000 7f871b400640 1 -- 172.21.15.42:0/2719080480 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f871c19f3e0 con 0x7f871c108ee0 2024-08-26T00:00:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.976+0000 7f871aa00640 1 --2- 172.21.15.42:0/2719080480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f871c103db0 0x7f871c19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:00:45.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.976+0000 7f871b400640 1 --2- 172.21.15.42:0/2719080480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f871c108ee0 0x7f871c19ed00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f871400efd0 tx=0x7f871400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:45.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.976+0000 7f8713400640 1 -- 172.21.15.42:0/2719080480 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8714003b70 con 0x7f871c108ee0 2024-08-26T00:00:45.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.976+0000 7f8713400640 1 -- 172.21.15.42:0/2719080480 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8714003d10 con 0x7f871c108ee0 2024-08-26T00:00:45.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.976+0000 7f8713400640 1 -- 172.21.15.42:0/2719080480 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87140109f0 con 0x7f871c108ee0 2024-08-26T00:00:45.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.976+0000 7f8721c00640 1 -- 172.21.15.42:0/2719080480 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f871c19f6d0 con 0x7f871c108ee0 2024-08-26T00:00:45.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.976+0000 7f8721c00640 1 -- 172.21.15.42:0/2719080480 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f871c1a6fb0 con 0x7f871c108ee0 2024-08-26T00:00:45.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.977+0000 7f8721c00640 1 -- 172.21.15.42:0/2719080480 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f871c104190 con 0x7f871c108ee0 2024-08-26T00:00:45.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.979+0000 7f8713400640 1 -- 172.21.15.42:0/2719080480 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8714004020 con 0x7f871c108ee0 2024-08-26T00:00:45.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.980+0000 7f8713400640 1 --2- 172.21.15.42:0/2719080480 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f87000a2c10 0x7f87000a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.980+0000 7f8713400640 1 -- 172.21.15.42:0/2719080480 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f87140cf4e0 con 0x7f871c108ee0 2024-08-26T00:00:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.980+0000 7f871aa00640 1 --2- 172.21.15.42:0/2719080480 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f87000a2c10 0x7f87000a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.981+0000 7f871aa00640 1 --2- 172.21.15.42:0/2719080480 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f87000a2c10 0x7f87000a50d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f870c009fc0 tx=0x7f870c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:45.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:45.984+0000 7f8713400640 1 -- 172.21.15.42:0/2719080480 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f871409c390 con 0x7f871c108ee0 2024-08-26T00:00:46.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:46.197+0000 7f8721c00640 1 -- 172.21.15.42:0/2719080480 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f871c10c190 con 0x7f87000a2c10 2024-08-26T00:00:46.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:46.223+0000 7f8713400640 1 -- 172.21.15.42:0/2719080480 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f870c004030 con 0x7f87000a2c10 2024-08-26T00:00:46.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:46.225+0000 7f8721c00640 1 -- 172.21.15.42:0/2719080480 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f87000a2c10 msgr2=0x7f87000a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:46.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:46.225+0000 7f8721c00640 1 --2- 172.21.15.42:0/2719080480 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f87000a2c10 0x7f87000a50d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f870c009fc0 tx=0x7f870c005f90 comp rx=0 tx=0).stop 2024-08-26T00:00:46.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:46.225+0000 7f8721c00640 1 -- 172.21.15.42:0/2719080480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f871c108ee0 msgr2=0x7f871c19ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:46.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:46.225+0000 7f8721c00640 1 --2- 172.21.15.42:0/2719080480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f871c108ee0 0x7f871c19ed00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f871400efd0 tx=0x7f871400c6a0 comp rx=0 tx=0).stop 2024-08-26T00:00:46.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:46.225+0000 7f8721c00640 1 -- 172.21.15.42:0/2719080480 shutdown_connections 2024-08-26T00:00:46.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:46.225+0000 7f8721c00640 1 --2- 172.21.15.42:0/2719080480 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f87000a2c10 0x7f87000a50d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:46.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:46.225+0000 7f8721c00640 1 --2- 172.21.15.42:0/2719080480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f871c108ee0 0x7f871c19ed00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:46.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:46.225+0000 7f8721c00640 1 --2- 172.21.15.42:0/2719080480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f871c104760 0x7f871c19a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:46.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:46.225+0000 7f8721c00640 1 --2- 172.21.15.42:0/2719080480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f871c103db0 0x7f871c19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:46.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:46.225+0000 7f8721c00640 1 -- 172.21.15.42:0/2719080480 >> 172.21.15.42:0/2719080480 conn(0x7f871c0ff7f0 msgr2=0x7f871c100b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:46.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:46.225+0000 7f8721c00640 1 -- 172.21.15.42:0/2719080480 shutdown_connections 2024-08-26T00:00:46.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:46.225+0000 7f8721c00640 1 -- 172.21.15.42:0/2719080480 wait complete. 2024-08-26T00:00:46.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:46 smithi042 ceph-mon[17225]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-08-26T00:00:46.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:46 smithi042 ceph-mon[17225]: from='client.24611 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:00:46.685 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:46 smithi181 ceph-mon[22102]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-08-26T00:00:46.685 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:46 smithi181 ceph-mon[22102]: from='client.24611 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:00:46.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:46 smithi043 ceph-mon[22091]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-08-26T00:00:46.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:46 smithi043 ceph-mon[22091]: from='client.24611 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:00:47.042 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-08-26T00:00:47.422 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:47.691 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:47 smithi042 ceph-mon[17225]: pgmap v285: 97 pgs: 97 active+clean; 582 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-08-26T00:00:47.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:47 smithi043 ceph-mon[22091]: pgmap v285: 97 pgs: 97 active+clean; 582 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-08-26T00:00:47.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:47 smithi181 ceph-mon[22102]: pgmap v285: 97 pgs: 97 active+clean; 582 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-08-26T00:00:47.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.939+0000 7f831aa00640 1 -- 172.21.15.42:0/358989017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8314101920 msgr2=0x7f8314101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:47.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.939+0000 7f831aa00640 1 --2- 172.21.15.42:0/358989017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8314101920 0x7f8314101d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f82fc009930 tx=0x7f82fc02a420 comp rx=0 tx=0).stop 2024-08-26T00:00:47.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.939+0000 7f831aa00640 1 -- 172.21.15.42:0/358989017 shutdown_connections 2024-08-26T00:00:47.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.939+0000 7f831aa00640 1 --2- 172.21.15.42:0/358989017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83141022c0 0x7f831410e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:47.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.939+0000 7f831aa00640 1 --2- 172.21.15.42:0/358989017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8314101920 0x7f8314101d80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:47.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.939+0000 7f831aa00640 1 --2- 172.21.15.42:0/358989017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8314107920 0x7f8314107d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:47.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.939+0000 7f831aa00640 1 -- 172.21.15.42:0/358989017 >> 172.21.15.42:0/358989017 conn(0x7f83140fd680 msgr2=0x7f83140ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:47.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.940+0000 7f831aa00640 1 -- 172.21.15.42:0/358989017 shutdown_connections 2024-08-26T00:00:47.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.940+0000 7f831aa00640 1 -- 172.21.15.42:0/358989017 wait complete. 2024-08-26T00:00:47.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.941+0000 7f831aa00640 1 Processor -- start 2024-08-26T00:00:47.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.941+0000 7f831aa00640 1 -- start start 2024-08-26T00:00:47.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.941+0000 7f831aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8314101920 0x7f83141981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:47.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.941+0000 7f831aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83141022c0 0x7f8314198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:47.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.941+0000 7f831aa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8314107920 0x7f831419cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:47.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.941+0000 7f831aa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8314111d20 con 0x7f8314101920 2024-08-26T00:00:47.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.941+0000 7f831aa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8314111ba0 con 0x7f83141022c0 2024-08-26T00:00:47.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.941+0000 7f831aa00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8314111ea0 con 0x7f8314107920 2024-08-26T00:00:47.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.942+0000 7f8313e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8314101920 0x7f83141981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:47.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.942+0000 7f830b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83141022c0 0x7f8314198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:47.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.942+0000 7f8313e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8314101920 0x7f83141981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42932/0 (socket says 172.21.15.42:42932) 2024-08-26T00:00:47.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.942+0000 7f8313e00640 1 -- 172.21.15.42:0/68492011 learned_addr learned my addr 172.21.15.42:0/68492011 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:47.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.942+0000 7f8318a00640 1 --2- 172.21.15.42:0/68492011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8314107920 0x7f831419cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:47.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.942+0000 7f830b400640 1 -- 172.21.15.42:0/68492011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8314107920 msgr2=0x7f831419cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:47.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.942+0000 7f830b400640 1 --2- 172.21.15.42:0/68492011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8314107920 0x7f831419cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:47.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.942+0000 7f830b400640 1 -- 172.21.15.42:0/68492011 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8314101920 msgr2=0x7f83141981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:47.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.942+0000 7f830b400640 1 --2- 172.21.15.42:0/68492011 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8314101920 0x7f83141981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:47.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.942+0000 7f830b400640 1 -- 172.21.15.42:0/68492011 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831419d190 con 0x7f83141022c0 2024-08-26T00:00:47.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.942+0000 7f8318a00640 1 --2- 172.21.15.42:0/68492011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8314107920 0x7f831419cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:00:47.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.942+0000 7f8313e00640 1 --2- 172.21.15.42:0/68492011 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8314101920 0x7f83141981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:00:47.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.943+0000 7f830b400640 1 --2- 172.21.15.42:0/68492011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83141022c0 0x7f8314198720 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f82fc005940 tx=0x7f82fc031b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:47.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.943+0000 7f8311600640 1 -- 172.21.15.42:0/68492011 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82fc03f070 con 0x7f83141022c0 2024-08-26T00:00:47.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.943+0000 7f8311600640 1 -- 172.21.15.42:0/68492011 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82fc003ad0 con 0x7f83141022c0 2024-08-26T00:00:47.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.943+0000 7f831aa00640 1 -- 172.21.15.42:0/68492011 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f831419d420 con 0x7f83141022c0 2024-08-26T00:00:47.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.943+0000 7f8311600640 1 -- 172.21.15.42:0/68492011 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82fc035070 con 0x7f83141022c0 2024-08-26T00:00:47.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.943+0000 7f831aa00640 1 -- 172.21.15.42:0/68492011 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83141a4d60 con 0x7f83141022c0 2024-08-26T00:00:47.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.945+0000 7f831aa00640 1 -- 172.21.15.42:0/68492011 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8314103060 con 0x7f83141022c0 2024-08-26T00:00:47.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.946+0000 7f8311600640 1 -- 172.21.15.42:0/68492011 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f82fc0035f0 con 0x7f83141022c0 2024-08-26T00:00:47.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.948+0000 7f8311600640 1 --2- 172.21.15.42:0/68492011 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f82f80a2c10 0x7f82f80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:47.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.948+0000 7f8311600640 1 -- 172.21.15.42:0/68492011 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f82fc0ef240 con 0x7f83141022c0 2024-08-26T00:00:47.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.948+0000 7f8313e00640 1 --2- 172.21.15.42:0/68492011 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f82f80a2c10 0x7f82f80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:47.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.949+0000 7f8313e00640 1 --2- 172.21.15.42:0/68492011 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f82f80a2c10 0x7f82f80a50d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8304011440 tx=0x7f8304005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:47.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:47.952+0000 7f8311600640 1 -- 172.21.15.42:0/68492011 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f82fc0bbaa0 con 0x7f83141022c0 2024-08-26T00:00:48.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:48.167+0000 7f831aa00640 1 -- 172.21.15.42:0/68492011 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f8314109ec0 con 0x7f82f80a2c10 2024-08-26T00:00:48.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:48.172+0000 7f8311600640 1 -- 172.21.15.42:0/68492011 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f8314109ec0 con 0x7f82f80a2c10 2024-08-26T00:00:48.271 INFO:teuthology.orchestra.run.smithi042.stdout:/volumes/qa/sv_0/3006c503-034f-440c-bec7-4373fd7900ba 2024-08-26T00:00:48.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:48.174+0000 7f831aa00640 1 -- 172.21.15.42:0/68492011 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f82f80a2c10 msgr2=0x7f82f80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:48.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:48.174+0000 7f831aa00640 1 --2- 172.21.15.42:0/68492011 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f82f80a2c10 0x7f82f80a50d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8304011440 tx=0x7f8304005f90 comp rx=0 tx=0).stop 2024-08-26T00:00:48.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:48.174+0000 7f831aa00640 1 -- 172.21.15.42:0/68492011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83141022c0 msgr2=0x7f8314198720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:48.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:48.174+0000 7f831aa00640 1 --2- 172.21.15.42:0/68492011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83141022c0 0x7f8314198720 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f82fc005940 tx=0x7f82fc031b50 comp rx=0 tx=0).stop 2024-08-26T00:00:48.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:48.174+0000 7f831aa00640 1 -- 172.21.15.42:0/68492011 shutdown_connections 2024-08-26T00:00:48.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:48.174+0000 7f831aa00640 1 --2- 172.21.15.42:0/68492011 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f82f80a2c10 0x7f82f80a50d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:48.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:48.174+0000 7f831aa00640 1 --2- 172.21.15.42:0/68492011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8314107920 0x7f831419cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:48.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:48.174+0000 7f831aa00640 1 --2- 172.21.15.42:0/68492011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83141022c0 0x7f8314198720 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:48.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:48.174+0000 7f831aa00640 1 --2- 172.21.15.42:0/68492011 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8314101920 0x7f83141981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:48.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:48.174+0000 7f831aa00640 1 -- 172.21.15.42:0/68492011 >> 172.21.15.42:0/68492011 conn(0x7f83140fd680 msgr2=0x7f83140fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:48.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:48.174+0000 7f831aa00640 1 -- 172.21.15.42:0/68492011 shutdown_connections 2024-08-26T00:00:48.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:48.174+0000 7f831aa00640 1 -- 172.21.15.42:0/68492011 wait complete. 2024-08-26T00:00:48.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:48 smithi043 ceph-mon[22091]: from='client.24617 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:00:48.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:48 smithi042 ceph-mon[17225]: from='client.24617 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:00:48.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:48 smithi181 ceph-mon[22102]: from='client.24617 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:00:49.035 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-08-26T00:00:49.414 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:49.689 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:49 smithi042 ceph-mon[17225]: pgmap v286: 97 pgs: 97 active+clean; 602 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-08-26T00:00:49.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:49 smithi043 ceph-mon[22091]: pgmap v286: 97 pgs: 97 active+clean; 602 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-08-26T00:00:49.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:49 smithi181 ceph-mon[22102]: pgmap v286: 97 pgs: 97 active+clean; 602 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-08-26T00:00:49.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.976+0000 7f8b8be00640 1 -- 172.21.15.42:0/3881647197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b84103b50 msgr2=0x7f8b84103fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:49.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.976+0000 7f8b8be00640 1 --2- 172.21.15.42:0/3881647197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b84103b50 0x7f8b84103fb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8b70009890 tx=0x7f8b7002a360 comp rx=0 tx=0).stop 2024-08-26T00:00:49.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.976+0000 7f8b8be00640 1 -- 172.21.15.42:0/3881647197 shutdown_connections 2024-08-26T00:00:49.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.976+0000 7f8b8be00640 1 --2- 172.21.15.42:0/3881647197 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b841044f0 0x7f8b841109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:49.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.976+0000 7f8b8be00640 1 --2- 172.21.15.42:0/3881647197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b84103b50 0x7f8b84103fb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:49.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.976+0000 7f8b8be00640 1 --2- 172.21.15.42:0/3881647197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b84109c00 0x7f8b84109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:49.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.976+0000 7f8b8be00640 1 -- 172.21.15.42:0/3881647197 >> 172.21.15.42:0/3881647197 conn(0x7f8b840ff830 msgr2=0x7f8b84101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:49.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.976+0000 7f8b8be00640 1 -- 172.21.15.42:0/3881647197 shutdown_connections 2024-08-26T00:00:49.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.976+0000 7f8b8be00640 1 -- 172.21.15.42:0/3881647197 wait complete. 2024-08-26T00:00:49.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.977+0000 7f8b8be00640 1 Processor -- start 2024-08-26T00:00:49.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.977+0000 7f8b8be00640 1 -- start start 2024-08-26T00:00:49.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.977+0000 7f8b8be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b84103b50 0x7f8b8419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:49.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.977+0000 7f8b8be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b841044f0 0x7f8b8419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:49.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.977+0000 7f8b8be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b84109c00 0x7f8b8419ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:49.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.977+0000 7f8b8be00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8b84113f60 con 0x7f8b84103b50 2024-08-26T00:00:49.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.977+0000 7f8b8be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8b84113de0 con 0x7f8b841044f0 2024-08-26T00:00:49.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.977+0000 7f8b8be00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8b841140e0 con 0x7f8b84109c00 2024-08-26T00:00:49.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.978+0000 7f8b88a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b841044f0 0x7f8b8419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:49.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.978+0000 7f8b89400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b84103b50 0x7f8b8419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:49.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.978+0000 7f8b88a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b841044f0 0x7f8b8419a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:49296/0 (socket says 172.21.15.42:49296) 2024-08-26T00:00:49.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.978+0000 7f8b88a00640 1 -- 172.21.15.42:0/1342121604 learned_addr learned my addr 172.21.15.42:0/1342121604 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:49.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.978+0000 7f8b89400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b84103b50 0x7f8b8419a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42944/0 (socket says 172.21.15.42:42944) 2024-08-26T00:00:49.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.978+0000 7f8b89e00640 1 --2- 172.21.15.42:0/1342121604 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b84109c00 0x7f8b8419ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:49.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.978+0000 7f8b88a00640 1 -- 172.21.15.42:0/1342121604 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b84109c00 msgr2=0x7f8b8419ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:49.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.978+0000 7f8b88a00640 1 --2- 172.21.15.42:0/1342121604 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b84109c00 0x7f8b8419ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:49.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.978+0000 7f8b88a00640 1 -- 172.21.15.42:0/1342121604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b84103b50 msgr2=0x7f8b8419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:49.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.978+0000 7f8b88a00640 1 --2- 172.21.15.42:0/1342121604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b84103b50 0x7f8b8419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:49.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.978+0000 7f8b88a00640 1 -- 172.21.15.42:0/1342121604 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b8419f410 con 0x7f8b841044f0 2024-08-26T00:00:49.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.978+0000 7f8b88a00640 1 --2- 172.21.15.42:0/1342121604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b841044f0 0x7f8b8419a9a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8b70033ae0 tx=0x7f8b70033b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:49.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.979+0000 7f8b82000640 1 -- 172.21.15.42:0/1342121604 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70037040 con 0x7f8b841044f0 2024-08-26T00:00:49.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.979+0000 7f8b8be00640 1 -- 172.21.15.42:0/1342121604 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b8419f6a0 con 0x7f8b841044f0 2024-08-26T00:00:49.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.979+0000 7f8b8be00640 1 -- 172.21.15.42:0/1342121604 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b841a6fe0 con 0x7f8b841044f0 2024-08-26T00:00:49.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.979+0000 7f8b82000640 1 -- 172.21.15.42:0/1342121604 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b70040070 con 0x7f8b841044f0 2024-08-26T00:00:49.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.979+0000 7f8b82000640 1 -- 172.21.15.42:0/1342121604 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b700039b0 con 0x7f8b841044f0 2024-08-26T00:00:49.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.980+0000 7f8b8be00640 1 -- 172.21.15.42:0/1342121604 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b84103fb0 con 0x7f8b841044f0 2024-08-26T00:00:49.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.982+0000 7f8b82000640 1 -- 172.21.15.42:0/1342121604 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8b70030610 con 0x7f8b841044f0 2024-08-26T00:00:49.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.984+0000 7f8b82000640 1 --2- 172.21.15.42:0/1342121604 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f8b6c0a2c10 0x7f8b6c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:49.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.984+0000 7f8b82000640 1 -- 172.21.15.42:0/1342121604 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f8b700eedf0 con 0x7f8b841044f0 2024-08-26T00:00:49.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.984+0000 7f8b89400640 1 --2- 172.21.15.42:0/1342121604 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f8b6c0a2c10 0x7f8b6c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:49.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.985+0000 7f8b89400640 1 --2- 172.21.15.42:0/1342121604 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f8b6c0a2c10 0x7f8b6c0a50d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8b780096c0 tx=0x7f8b78009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:49.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:49.987+0000 7f8b82000640 1 -- 172.21.15.42:0/1342121604 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f8b7004b020 con 0x7f8b841044f0 2024-08-26T00:00:50.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:50.197+0000 7f8b8be00640 1 -- 172.21.15.42:0/1342121604 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f8b840623d0 con 0x7f8b6c0a2c10 2024-08-26T00:00:50.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:50.223+0000 7f8b82000640 1 -- 172.21.15.42:0/1342121604 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8b840623d0 con 0x7f8b6c0a2c10 2024-08-26T00:00:50.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:50.225+0000 7f8b8be00640 1 -- 172.21.15.42:0/1342121604 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f8b6c0a2c10 msgr2=0x7f8b6c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:50.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:50.225+0000 7f8b8be00640 1 --2- 172.21.15.42:0/1342121604 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f8b6c0a2c10 0x7f8b6c0a50d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8b780096c0 tx=0x7f8b78009260 comp rx=0 tx=0).stop 2024-08-26T00:00:50.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:50.225+0000 7f8b8be00640 1 -- 172.21.15.42:0/1342121604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b841044f0 msgr2=0x7f8b8419a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:50.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:50.225+0000 7f8b8be00640 1 --2- 172.21.15.42:0/1342121604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b841044f0 0x7f8b8419a9a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8b70033ae0 tx=0x7f8b70033b10 comp rx=0 tx=0).stop 2024-08-26T00:00:50.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:50.225+0000 7f8b8be00640 1 -- 172.21.15.42:0/1342121604 shutdown_connections 2024-08-26T00:00:50.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:50.225+0000 7f8b8be00640 1 --2- 172.21.15.42:0/1342121604 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f8b6c0a2c10 0x7f8b6c0a50d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:50.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:50.225+0000 7f8b8be00640 1 --2- 172.21.15.42:0/1342121604 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b84109c00 0x7f8b8419ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:50.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:50.225+0000 7f8b8be00640 1 --2- 172.21.15.42:0/1342121604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b841044f0 0x7f8b8419a9a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:50.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:50.225+0000 7f8b8be00640 1 --2- 172.21.15.42:0/1342121604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b84103b50 0x7f8b8419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:50.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:50.225+0000 7f8b8be00640 1 -- 172.21.15.42:0/1342121604 >> 172.21.15.42:0/1342121604 conn(0x7f8b840ff830 msgr2=0x7f8b84100fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:50.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:50.225+0000 7f8b8be00640 1 -- 172.21.15.42:0/1342121604 shutdown_connections 2024-08-26T00:00:50.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:50.225+0000 7f8b8be00640 1 -- 172.21.15.42:0/1342121604 wait complete. 2024-08-26T00:00:50.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:50 smithi042 ceph-mon[17225]: from='client.24623 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:00:50.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:50 smithi043 ceph-mon[22091]: from='client.24623 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:00:50.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:50 smithi181 ceph-mon[22102]: from='client.24623 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:00:51.102 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-08-26T00:00:51.482 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:51.750 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:51 smithi042 ceph-mon[17225]: pgmap v287: 97 pgs: 97 active+clean; 602 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-08-26T00:00:51.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:51 smithi043 ceph-mon[22091]: pgmap v287: 97 pgs: 97 active+clean; 602 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-08-26T00:00:51.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:51 smithi181 ceph-mon[22102]: pgmap v287: 97 pgs: 97 active+clean; 602 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-08-26T00:00:51.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.993+0000 7f7d40400640 1 -- 172.21.15.42:0/2358815490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d38108ee0 msgr2=0x7f7d38110a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:51.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.993+0000 7f7d40400640 1 --2- 172.21.15.42:0/2358815490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d38108ee0 0x7f7d38110a60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7d30009ca0 tx=0x7f7d3002a8c0 comp rx=0 tx=0).stop 2024-08-26T00:00:51.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.993+0000 7f7d40400640 1 -- 172.21.15.42:0/2358815490 shutdown_connections 2024-08-26T00:00:51.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.993+0000 7f7d40400640 1 --2- 172.21.15.42:0/2358815490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d38108ee0 0x7f7d38110a60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:51.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.993+0000 7f7d40400640 1 --2- 172.21.15.42:0/2358815490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d38104760 0x7f7d381087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:51.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.993+0000 7f7d40400640 1 --2- 172.21.15.42:0/2358815490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d38103db0 0x7f7d38104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:51.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.993+0000 7f7d40400640 1 -- 172.21.15.42:0/2358815490 >> 172.21.15.42:0/2358815490 conn(0x7f7d380ff7f0 msgr2=0x7f7d38101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:51.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.993+0000 7f7d40400640 1 -- 172.21.15.42:0/2358815490 shutdown_connections 2024-08-26T00:00:51.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.993+0000 7f7d40400640 1 -- 172.21.15.42:0/2358815490 wait complete. 2024-08-26T00:00:51.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.994+0000 7f7d40400640 1 Processor -- start 2024-08-26T00:00:51.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.995+0000 7f7d40400640 1 -- start start 2024-08-26T00:00:51.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.995+0000 7f7d40400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d38103db0 0x7f7d3819a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:51.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.995+0000 7f7d40400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d38104760 0x7f7d3819a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:51.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.995+0000 7f7d40400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d38108ee0 0x7f7d3819ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:51.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.995+0000 7f7d40400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7d38113f90 con 0x7f7d38104760 2024-08-26T00:00:51.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.995+0000 7f7d40400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7d38113e10 con 0x7f7d38103db0 2024-08-26T00:00:51.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.995+0000 7f7d40400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7d38114110 con 0x7f7d38108ee0 2024-08-26T00:00:51.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.995+0000 7f7d3d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d38104760 0x7f7d3819a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:51.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.995+0000 7f7d3da00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d38103db0 0x7f7d3819a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:51.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.995+0000 7f7d3da00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d38103db0 0x7f7d3819a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:49314/0 (socket says 172.21.15.42:49314) 2024-08-26T00:00:51.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.995+0000 7f7d3da00640 1 -- 172.21.15.42:0/18096063 learned_addr learned my addr 172.21.15.42:0/18096063 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:51.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.995+0000 7f7d3e400640 1 --2- 172.21.15.42:0/18096063 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d38108ee0 0x7f7d3819ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:51.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.996+0000 7f7d3d000640 1 -- 172.21.15.42:0/18096063 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d38108ee0 msgr2=0x7f7d3819ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:51.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.996+0000 7f7d3d000640 1 --2- 172.21.15.42:0/18096063 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d38108ee0 0x7f7d3819ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:51.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.996+0000 7f7d3d000640 1 -- 172.21.15.42:0/18096063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d38103db0 msgr2=0x7f7d3819a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:51.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.996+0000 7f7d3d000640 1 --2- 172.21.15.42:0/18096063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d38103db0 0x7f7d3819a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:51.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.996+0000 7f7d3d000640 1 -- 172.21.15.42:0/18096063 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3819f340 con 0x7f7d38104760 2024-08-26T00:00:51.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.996+0000 7f7d3d000640 1 --2- 172.21.15.42:0/18096063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d38104760 0x7f7d3819a8d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7d2400e9f0 tx=0x7f7d2400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:51.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.996+0000 7f7d36000640 1 -- 172.21.15.42:0/18096063 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2400cd80 con 0x7f7d38104760 2024-08-26T00:00:51.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.996+0000 7f7d36000640 1 -- 172.21.15.42:0/18096063 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d240035f0 con 0x7f7d38104760 2024-08-26T00:00:51.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.996+0000 7f7d40400640 1 -- 172.21.15.42:0/18096063 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d3819f630 con 0x7f7d38104760 2024-08-26T00:00:51.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.996+0000 7f7d36000640 1 -- 172.21.15.42:0/18096063 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d24010690 con 0x7f7d38104760 2024-08-26T00:00:51.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.996+0000 7f7d40400640 1 -- 172.21.15.42:0/18096063 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d381a6f10 con 0x7f7d38104760 2024-08-26T00:00:51.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.998+0000 7f7d40400640 1 -- 172.21.15.42:0/18096063 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d38104190 con 0x7f7d38104760 2024-08-26T00:00:52.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:51.999+0000 7f7d36000640 1 -- 172.21.15.42:0/18096063 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7d24003b30 con 0x7f7d38104760 2024-08-26T00:00:52.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:52.001+0000 7f7d36000640 1 --2- 172.21.15.42:0/18096063 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7d200a2c90 0x7f7d200a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:52.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:52.001+0000 7f7d36000640 1 -- 172.21.15.42:0/18096063 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f7d240cf300 con 0x7f7d38104760 2024-08-26T00:00:52.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:52.001+0000 7f7d3da00640 1 --2- 172.21.15.42:0/18096063 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7d200a2c90 0x7f7d200a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:52.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:52.002+0000 7f7d3da00640 1 --2- 172.21.15.42:0/18096063 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7d200a2c90 0x7f7d200a5150 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c009cd0 tx=0x7f7d2c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:52.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:52.006+0000 7f7d36000640 1 -- 172.21.15.42:0/18096063 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f7d2409c1b0 con 0x7f7d38104760 2024-08-26T00:00:52.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:52.218+0000 7f7d40400640 1 -- 172.21.15.42:0/18096063 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f7d380623d0 con 0x7f7d200a2c90 2024-08-26T00:00:52.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:52.223+0000 7f7d36000640 1 -- 172.21.15.42:0/18096063 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f7d380623d0 con 0x7f7d200a2c90 2024-08-26T00:00:52.224 INFO:teuthology.orchestra.run.smithi042.stdout:/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750 2024-08-26T00:00:52.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:52.225+0000 7f7d40400640 1 -- 172.21.15.42:0/18096063 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7d200a2c90 msgr2=0x7f7d200a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:52.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:52.225+0000 7f7d40400640 1 --2- 172.21.15.42:0/18096063 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7d200a2c90 0x7f7d200a5150 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c009cd0 tx=0x7f7d2c005f90 comp rx=0 tx=0).stop 2024-08-26T00:00:52.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:52.225+0000 7f7d40400640 1 -- 172.21.15.42:0/18096063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d38104760 msgr2=0x7f7d3819a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:52.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:52.225+0000 7f7d40400640 1 --2- 172.21.15.42:0/18096063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d38104760 0x7f7d3819a8d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7d2400e9f0 tx=0x7f7d2400eeb0 comp rx=0 tx=0).stop 2024-08-26T00:00:52.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:52.225+0000 7f7d40400640 1 -- 172.21.15.42:0/18096063 shutdown_connections 2024-08-26T00:00:52.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:52.225+0000 7f7d40400640 1 --2- 172.21.15.42:0/18096063 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7d200a2c90 0x7f7d200a5150 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:52.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:52.225+0000 7f7d40400640 1 --2- 172.21.15.42:0/18096063 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d38108ee0 0x7f7d3819ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:52.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:52.225+0000 7f7d40400640 1 --2- 172.21.15.42:0/18096063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d38104760 0x7f7d3819a8d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:52.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:52.225+0000 7f7d40400640 1 --2- 172.21.15.42:0/18096063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d38103db0 0x7f7d3819a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:52.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:52.225+0000 7f7d40400640 1 -- 172.21.15.42:0/18096063 >> 172.21.15.42:0/18096063 conn(0x7f7d380ff7f0 msgr2=0x7f7d38100a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:52.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:52.225+0000 7f7d40400640 1 -- 172.21.15.42:0/18096063 shutdown_connections 2024-08-26T00:00:52.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:52.225+0000 7f7d40400640 1 -- 172.21.15.42:0/18096063 wait complete. 2024-08-26T00:00:52.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:52 smithi043 ceph-mon[22091]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:00:52.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:52 smithi042 ceph-mon[17225]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:00:52.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:52 smithi181 ceph-mon[22102]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:00:52.986 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:00:53.367 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:53.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:53 smithi043 ceph-mon[22091]: pgmap v288: 97 pgs: 97 active+clean; 621 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2024-08-26T00:00:53.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:53 smithi042 ceph-mon[17225]: pgmap v288: 97 pgs: 97 active+clean; 621 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2024-08-26T00:00:53.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:53 smithi181 ceph-mon[22102]: pgmap v288: 97 pgs: 97 active+clean; 621 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2024-08-26T00:00:53.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.894+0000 7f8876600640 1 -- 172.21.15.42:0/3524165169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8870108ee0 msgr2=0x7f8870110a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:53.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.894+0000 7f8876600640 1 --2- 172.21.15.42:0/3524165169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8870108ee0 0x7f8870110a60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8868009ca0 tx=0x7f886802a8c0 comp rx=0 tx=0).stop 2024-08-26T00:00:53.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.894+0000 7f8876600640 1 -- 172.21.15.42:0/3524165169 shutdown_connections 2024-08-26T00:00:53.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.894+0000 7f8876600640 1 --2- 172.21.15.42:0/3524165169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8870108ee0 0x7f8870110a60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:53.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.894+0000 7f8876600640 1 --2- 172.21.15.42:0/3524165169 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8870104760 0x7f88701087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:53.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.894+0000 7f8876600640 1 --2- 172.21.15.42:0/3524165169 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8870103db0 0x7f8870104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:53.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.894+0000 7f8876600640 1 -- 172.21.15.42:0/3524165169 >> 172.21.15.42:0/3524165169 conn(0x7f88700ff7f0 msgr2=0x7f8870101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:53.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.894+0000 7f8876600640 1 -- 172.21.15.42:0/3524165169 shutdown_connections 2024-08-26T00:00:53.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.894+0000 7f8876600640 1 -- 172.21.15.42:0/3524165169 wait complete. 2024-08-26T00:00:53.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.895+0000 7f8876600640 1 Processor -- start 2024-08-26T00:00:53.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.895+0000 7f8876600640 1 -- start start 2024-08-26T00:00:53.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.895+0000 7f8876600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8870103db0 0x7f887019a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:53.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.895+0000 7f8876600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8870104760 0x7f887019a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:53.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.895+0000 7f8876600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8870108ee0 0x7f887019ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:53.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.895+0000 7f8876600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8870113f40 con 0x7f8870108ee0 2024-08-26T00:00:53.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.895+0000 7f8876600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8870113dc0 con 0x7f8870104760 2024-08-26T00:00:53.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.895+0000 7f8876600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f88701140c0 con 0x7f8870103db0 2024-08-26T00:00:53.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.895+0000 7f8866a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8870104760 0x7f887019a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:53.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.896+0000 7f886fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8870108ee0 0x7f887019ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:53.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.896+0000 7f8866a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8870104760 0x7f887019a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:49336/0 (socket says 172.21.15.42:49336) 2024-08-26T00:00:53.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.896+0000 7f8866a00640 1 -- 172.21.15.42:0/1983190116 learned_addr learned my addr 172.21.15.42:0/1983190116 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:53.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.896+0000 7f886f400640 1 --2- 172.21.15.42:0/1983190116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8870103db0 0x7f887019a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:53.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.896+0000 7f8866a00640 1 -- 172.21.15.42:0/1983190116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8870103db0 msgr2=0x7f887019a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:53.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.896+0000 7f8866a00640 1 --2- 172.21.15.42:0/1983190116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8870103db0 0x7f887019a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:53.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.896+0000 7f8866a00640 1 -- 172.21.15.42:0/1983190116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8870108ee0 msgr2=0x7f887019ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:53.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.896+0000 7f8866a00640 1 --2- 172.21.15.42:0/1983190116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8870108ee0 0x7f887019ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:53.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.896+0000 7f8866a00640 1 -- 172.21.15.42:0/1983190116 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887019f330 con 0x7f8870104760 2024-08-26T00:00:53.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.896+0000 7f886fe00640 1 --2- 172.21.15.42:0/1983190116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8870108ee0 0x7f887019ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:00:53.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.896+0000 7f8866a00640 1 --2- 172.21.15.42:0/1983190116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8870104760 0x7f887019a8c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f885800ea60 tx=0x7f885800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:53.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.896+0000 7f886cc00640 1 -- 172.21.15.42:0/1983190116 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885800cde0 con 0x7f8870104760 2024-08-26T00:00:53.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.897+0000 7f8876600640 1 -- 172.21.15.42:0/1983190116 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f887019f620 con 0x7f8870104760 2024-08-26T00:00:53.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.897+0000 7f886cc00640 1 -- 172.21.15.42:0/1983190116 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88580035f0 con 0x7f8870104760 2024-08-26T00:00:53.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.897+0000 7f886cc00640 1 -- 172.21.15.42:0/1983190116 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8858010670 con 0x7f8870104760 2024-08-26T00:00:53.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.897+0000 7f8876600640 1 -- 172.21.15.42:0/1983190116 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88701a6f00 con 0x7f8870104760 2024-08-26T00:00:53.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.898+0000 7f8876600640 1 -- 172.21.15.42:0/1983190116 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8870104190 con 0x7f8870104760 2024-08-26T00:00:53.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.900+0000 7f886cc00640 1 -- 172.21.15.42:0/1983190116 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f88580037a0 con 0x7f8870104760 2024-08-26T00:00:53.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.902+0000 7f886cc00640 1 --2- 172.21.15.42:0/1983190116 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f88540a2c10 0x7f88540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:53.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.902+0000 7f886cc00640 1 -- 172.21.15.42:0/1983190116 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f88580cf450 con 0x7f8870104760 2024-08-26T00:00:53.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.902+0000 7f886f400640 1 --2- 172.21.15.42:0/1983190116 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f88540a2c10 0x7f88540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:53.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.903+0000 7f886f400640 1 --2- 172.21.15.42:0/1983190116 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f88540a2c10 0x7f88540a50d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8860009bd0 tx=0x7f8860005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:53.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:53.903+0000 7f886cc00640 1 -- 172.21.15.42:0/1983190116 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f885809c390 con 0x7f8870104760 2024-08-26T00:00:54.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:54.123+0000 7f8876600640 1 -- 172.21.15.42:0/1983190116 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f887010c180 con 0x7f8870104760 2024-08-26T00:00:54.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:54.124+0000 7f886cc00640 1 -- 172.21.15.42:0/1983190116 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11909 (secure 0 0 0) 0x7f885809bc90 con 0x7f8870104760 2024-08-26T00:00:54.125 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:00:54.126 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":23,"btime":"2024-08-26T00:00:42:404711+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3168581452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3168581452},{"type":"v1","addr":"172.21.15.42:6839","nonce":3168581452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/3533492491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":3533492491},{"type":"v1","addr":"172.21.15.42:6841","nonce":3533492491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-26T00:00:30.169633+0000","modified":"2024-08-26T00:00:42.314271+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24532,"mds_1":24527,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6839/2653014277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2653014277},{"type":"v1","addr":"172.21.15.43:6839","nonce":2653014277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24532,"qdb_cluster":[24514,24527,24532]},"id":1}]} 2024-08-26T00:00:54.126 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 23 2024-08-26T00:00:54.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:54.126+0000 7f8876600640 1 -- 172.21.15.42:0/1983190116 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f88540a2c10 msgr2=0x7f88540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:54.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:54.126+0000 7f8876600640 1 --2- 172.21.15.42:0/1983190116 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f88540a2c10 0x7f88540a50d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8860009bd0 tx=0x7f8860005f90 comp rx=0 tx=0).stop 2024-08-26T00:00:54.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:54.126+0000 7f8876600640 1 -- 172.21.15.42:0/1983190116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8870104760 msgr2=0x7f887019a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:54.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:54.126+0000 7f8876600640 1 --2- 172.21.15.42:0/1983190116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8870104760 0x7f887019a8c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f885800ea60 tx=0x7f885800ef20 comp rx=0 tx=0).stop 2024-08-26T00:00:54.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:54.127+0000 7f8876600640 1 -- 172.21.15.42:0/1983190116 shutdown_connections 2024-08-26T00:00:54.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:54.127+0000 7f8876600640 1 --2- 172.21.15.42:0/1983190116 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f88540a2c10 0x7f88540a50d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:54.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:54.127+0000 7f8876600640 1 --2- 172.21.15.42:0/1983190116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8870108ee0 0x7f887019ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:54.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:54.127+0000 7f8876600640 1 --2- 172.21.15.42:0/1983190116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8870104760 0x7f887019a8c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:54.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:54.127+0000 7f8876600640 1 --2- 172.21.15.42:0/1983190116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8870103db0 0x7f887019a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:54.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:54.127+0000 7f8876600640 1 -- 172.21.15.42:0/1983190116 >> 172.21.15.42:0/1983190116 conn(0x7f88700ff7f0 msgr2=0x7f8870100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:54.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:54.127+0000 7f8876600640 1 -- 172.21.15.42:0/1983190116 shutdown_connections 2024-08-26T00:00:54.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:54.127+0000 7f8876600640 1 -- 172.21.15.42:0/1983190116 wait complete. 2024-08-26T00:00:54.745 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:54 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1983190116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:00:54.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:54 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1983190116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:00:54.781 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd dump --format=json 2024-08-26T00:00:54.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:54 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1983190116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:00:55.157 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:55.616 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:55 smithi042 ceph-mon[17225]: pgmap v289: 97 pgs: 97 active+clean; 621 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.3 KiB/s wr, 9 op/s 2024-08-26T00:00:55.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.727+0000 7f7b62600640 1 -- 172.21.15.42:0/2411613744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b5c104760 msgr2=0x7f7b5c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:55.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.727+0000 7f7b62600640 1 --2- 172.21.15.42:0/2411613744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b5c104760 0x7f7b5c1087b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7b48009900 tx=0x7f7b4802a410 comp rx=0 tx=0).stop 2024-08-26T00:00:55.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.727+0000 7f7b62600640 1 -- 172.21.15.42:0/2411613744 shutdown_connections 2024-08-26T00:00:55.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.727+0000 7f7b62600640 1 --2- 172.21.15.42:0/2411613744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b5c108ee0 0x7f7b5c110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:55.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.727+0000 7f7b62600640 1 --2- 172.21.15.42:0/2411613744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b5c104760 0x7f7b5c1087b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:55.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.727+0000 7f7b62600640 1 --2- 172.21.15.42:0/2411613744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b5c103db0 0x7f7b5c104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:55.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.727+0000 7f7b62600640 1 -- 172.21.15.42:0/2411613744 >> 172.21.15.42:0/2411613744 conn(0x7f7b5c0ff7f0 msgr2=0x7f7b5c101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:55.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.727+0000 7f7b62600640 1 -- 172.21.15.42:0/2411613744 shutdown_connections 2024-08-26T00:00:55.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.727+0000 7f7b62600640 1 -- 172.21.15.42:0/2411613744 wait complete. 2024-08-26T00:00:55.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.728+0000 7f7b62600640 1 Processor -- start 2024-08-26T00:00:55.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.729+0000 7f7b62600640 1 -- start start 2024-08-26T00:00:55.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.729+0000 7f7b62600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b5c103db0 0x7f7b5c19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:55.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.729+0000 7f7b62600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b5c104760 0x7f7b5c19a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:55.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.729+0000 7f7b62600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b5c108ee0 0x7f7b5c19ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:55.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.729+0000 7f7b62600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c113f40 con 0x7f7b5c108ee0 2024-08-26T00:00:55.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.729+0000 7f7b62600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c113dc0 con 0x7f7b5c103db0 2024-08-26T00:00:55.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.729+0000 7f7b62600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c1140c0 con 0x7f7b5c104760 2024-08-26T00:00:55.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.729+0000 7f7b5aa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b5c104760 0x7f7b5c19a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:55.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.729+0000 7f7b5aa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b5c104760 0x7f7b5c19a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:44210/0 (socket says 172.21.15.42:44210) 2024-08-26T00:00:55.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.729+0000 7f7b5aa00640 1 -- 172.21.15.42:0/1623182229 learned_addr learned my addr 172.21.15.42:0/1623182229 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:55.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.729+0000 7f7b5b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b5c103db0 0x7f7b5c19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:55.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.729+0000 7f7b5be00640 1 --2- 172.21.15.42:0/1623182229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b5c108ee0 0x7f7b5c19ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:55.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.730+0000 7f7b5aa00640 1 -- 172.21.15.42:0/1623182229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b5c103db0 msgr2=0x7f7b5c19a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:55.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.730+0000 7f7b5aa00640 1 --2- 172.21.15.42:0/1623182229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b5c103db0 0x7f7b5c19a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:55.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.730+0000 7f7b5aa00640 1 -- 172.21.15.42:0/1623182229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b5c108ee0 msgr2=0x7f7b5c19ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:55.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.730+0000 7f7b5aa00640 1 --2- 172.21.15.42:0/1623182229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b5c108ee0 0x7f7b5c19ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:55.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.730+0000 7f7b5aa00640 1 -- 172.21.15.42:0/1623182229 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b5c19f3a0 con 0x7f7b5c104760 2024-08-26T00:00:55.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.730+0000 7f7b5b400640 1 --2- 172.21.15.42:0/1623182229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b5c103db0 0x7f7b5c19a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:00:55.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.730+0000 7f7b5be00640 1 --2- 172.21.15.42:0/1623182229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b5c108ee0 0x7f7b5c19ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:00:55.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.730+0000 7f7b5aa00640 1 --2- 172.21.15.42:0/1623182229 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b5c104760 0x7f7b5c19a930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7b48006010 tx=0x7f7b480042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:55.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.731+0000 7f7b53e00640 1 -- 172.21.15.42:0/1623182229 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4803f030 con 0x7f7b5c104760 2024-08-26T00:00:55.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.731+0000 7f7b53e00640 1 -- 172.21.15.42:0/1623182229 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b48003ce0 con 0x7f7b5c104760 2024-08-26T00:00:55.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.731+0000 7f7b62600640 1 -- 172.21.15.42:0/1623182229 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b5c19f630 con 0x7f7b5c104760 2024-08-26T00:00:55.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.731+0000 7f7b53e00640 1 -- 172.21.15.42:0/1623182229 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b48035070 con 0x7f7b5c104760 2024-08-26T00:00:55.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.731+0000 7f7b62600640 1 -- 172.21.15.42:0/1623182229 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b5c1a6f70 con 0x7f7b5c104760 2024-08-26T00:00:55.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.732+0000 7f7b62600640 1 -- 172.21.15.42:0/1623182229 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b5c104190 con 0x7f7b5c104760 2024-08-26T00:00:55.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.735+0000 7f7b53e00640 1 -- 172.21.15.42:0/1623182229 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7b48042030 con 0x7f7b5c104760 2024-08-26T00:00:55.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.736+0000 7f7b53e00640 1 --2- 172.21.15.42:0/1623182229 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7b400a2c10 0x7f7b400a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:55.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.736+0000 7f7b53e00640 1 -- 172.21.15.42:0/1623182229 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f7b480efa40 con 0x7f7b5c104760 2024-08-26T00:00:55.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.736+0000 7f7b5b400640 1 --2- 172.21.15.42:0/1623182229 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7b400a2c10 0x7f7b400a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:55.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.737+0000 7f7b5b400640 1 --2- 172.21.15.42:0/1623182229 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7b400a2c10 0x7f7b400a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c00bfd0 tx=0x7f7b4c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:55.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.737+0000 7f7b53e00640 1 -- 172.21.15.42:0/1623182229 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f7b480bc8f0 con 0x7f7b5c104760 2024-08-26T00:00:55.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:55 smithi043 ceph-mon[22091]: pgmap v289: 97 pgs: 97 active+clean; 621 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.3 KiB/s wr, 9 op/s 2024-08-26T00:00:55.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:55 smithi181 ceph-mon[22102]: pgmap v289: 97 pgs: 97 active+clean; 621 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.3 KiB/s wr, 9 op/s 2024-08-26T00:00:55.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.925+0000 7f7b62600640 1 -- 172.21.15.42:0/1623182229 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b5c10c120 con 0x7f7b5c104760 2024-08-26T00:00:55.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.926+0000 7f7b53e00640 1 -- 172.21.15.42:0/1623182229 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22147 (secure 0 0 0) 0x7f7b480bc1f0 con 0x7f7b5c104760 2024-08-26T00:00:55.928 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:00:55.929 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":78,"fsid":"f89d317a-633c-11ef-bcd2-c7b262605968","created":"2024-08-25T23:52:39.598509+0000","modified":"2024-08-26T00:00:30.169413+0000","last_up_change":"2024-08-25T23:59:35.047575+0000","last_in_change":"2024-08-25T23:59:12.796940+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-25T23:55:51.022219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-26T00:00:25.606536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-26T00:00:28.322822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"980d8635-bca1-4c5a-b78e-4b44f9315d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6803","nonce":2657450248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6805","nonce":2657450248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6809","nonce":2657450248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6807","nonce":2657450248}]},"public_addr":"172.21.15.42:6803/2657450248","cluster_addr":"172.21.15.42:6805/2657450248","heartbeat_back_addr":"172.21.15.42:6809/2657450248","heartbeat_front_addr":"172.21.15.42:6807/2657450248","state":["exists","up"]},{"osd":1,"uuid":"e5f8dc3b-876a-4bdd-b6b0-b0d99d098d95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6801","nonce":2396081001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6803","nonce":2396081001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6807","nonce":2396081001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6805","nonce":2396081001}]},"public_addr":"172.21.15.43:6801/2396081001","cluster_addr":"172.21.15.43:6803/2396081001","heartbeat_back_addr":"172.21.15.43:6807/2396081001","heartbeat_front_addr":"172.21.15.43:6805/2396081001","state":["exists","up"]},{"osd":2,"uuid":"06eb25af-8e3d-4f90-bc24-28a9bc224c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6801","nonce":189987070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6803","nonce":189987070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6807","nonce":189987070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6805","nonce":189987070}]},"public_addr":"172.21.15.181:6801/189987070","cluster_addr":"172.21.15.181:6803/189987070","heartbeat_back_addr":"172.21.15.181:6807/189987070","heartbeat_front_addr":"172.21.15.181:6805/189987070","state":["exists","up"]},{"osd":3,"uuid":"c78dbc49-b5c7-4f82-be36-c76a89496520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6811","nonce":251017896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6813","nonce":251017896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6817","nonce":251017896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6815","nonce":251017896}]},"public_addr":"172.21.15.42:6811/251017896","cluster_addr":"172.21.15.42:6813/251017896","heartbeat_back_addr":"172.21.15.42:6817/251017896","heartbeat_front_addr":"172.21.15.42:6815/251017896","state":["exists","up"]},{"osd":4,"uuid":"ba633f66-25af-492f-bbf2-76032a4cd3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6809","nonce":1315420796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6811","nonce":1315420796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6815","nonce":1315420796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6813","nonce":1315420796}]},"public_addr":"172.21.15.43:6809/1315420796","cluster_addr":"172.21.15.43:6811/1315420796","heartbeat_back_addr":"172.21.15.43:6815/1315420796","heartbeat_front_addr":"172.21.15.43:6813/1315420796","state":["exists","up"]},{"osd":5,"uuid":"04e47ad9-21ba-43da-9793-d5cf83150dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6809","nonce":246971403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6811","nonce":246971403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6815","nonce":246971403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6813","nonce":246971403}]},"public_addr":"172.21.15.181:6809/246971403","cluster_addr":"172.21.15.181:6811/246971403","heartbeat_back_addr":"172.21.15.181:6815/246971403","heartbeat_front_addr":"172.21.15.181:6813/246971403","state":["exists","up"]},{"osd":6,"uuid":"f48161cd-bc44-4d99-8248-1bb845111129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6819","nonce":2910656480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6821","nonce":2910656480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6825","nonce":2910656480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6823","nonce":2910656480}]},"public_addr":"172.21.15.42:6819/2910656480","cluster_addr":"172.21.15.42:6821/2910656480","heartbeat_back_addr":"172.21.15.42:6825/2910656480","heartbeat_front_addr":"172.21.15.42:6823/2910656480","state":["exists","up"]},{"osd":7,"uuid":"65470b06-b14d-4d8e-9bcb-e6927c37fda5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6817","nonce":624542778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6819","nonce":624542778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6823","nonce":624542778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6821","nonce":624542778}]},"public_addr":"172.21.15.43:6817/624542778","cluster_addr":"172.21.15.43:6819/624542778","heartbeat_back_addr":"172.21.15.43:6823/624542778","heartbeat_front_addr":"172.21.15.43:6821/624542778","state":["exists","up"]},{"osd":8,"uuid":"1f4c9152-4b7c-415f-9cb9-d1e926fad5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6817","nonce":728226568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6819","nonce":728226568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6823","nonce":728226568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6821","nonce":728226568}]},"public_addr":"172.21.15.181:6817/728226568","cluster_addr":"172.21.15.181:6819/728226568","heartbeat_back_addr":"172.21.15.181:6823/728226568","heartbeat_front_addr":"172.21.15.181:6821/728226568","state":["exists","up"]},{"osd":9,"uuid":"fb387fbe-19b4-4a3e-8e40-81bd1363b55c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6827","nonce":1052069444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6829","nonce":1052069444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6833","nonce":1052069444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6831","nonce":1052069444}]},"public_addr":"172.21.15.42:6827/1052069444","cluster_addr":"172.21.15.42:6829/1052069444","heartbeat_back_addr":"172.21.15.42:6833/1052069444","heartbeat_front_addr":"172.21.15.42:6831/1052069444","state":["exists","up"]},{"osd":10,"uuid":"fe5bbeec-2341-4ea9-97ab-cc45d738d741","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6825","nonce":3417487386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6827","nonce":3417487386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6831","nonce":3417487386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6829","nonce":3417487386}]},"public_addr":"172.21.15.43:6825/3417487386","cluster_addr":"172.21.15.43:6827/3417487386","heartbeat_back_addr":"172.21.15.43:6831/3417487386","heartbeat_front_addr":"172.21.15.43:6829/3417487386","state":["exists","up"]},{"osd":11,"uuid":"cee07741-3ab7-481e-8477-54319f4f178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6825","nonce":3817502913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6827","nonce":3817502913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6831","nonce":3817502913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6829","nonce":3817502913}]},"public_addr":"172.21.15.181:6825/3817502913","cluster_addr":"172.21.15.181:6827/3817502913","heartbeat_back_addr":"172.21.15.181:6831/3817502913","heartbeat_front_addr":"172.21.15.181:6829/3817502913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:00.603592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:24.637326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:47.587859+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:14.978783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:39.025819+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:01.965471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:29.753475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:54.162377+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:17.970871+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:46.175576+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:10.590220+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:33.216701+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/3711239085":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6801/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2983166615":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/2974122891":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2980210051":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/4227793902":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6801/1517739376":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6800/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/1775009918":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6800/1517739376":"2024-08-26T23:53:05.122858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-26T00:00:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.929+0000 7f7b62600640 1 -- 172.21.15.42:0/1623182229 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7b400a2c10 msgr2=0x7f7b400a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.929+0000 7f7b62600640 1 --2- 172.21.15.42:0/1623182229 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7b400a2c10 0x7f7b400a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c00bfd0 tx=0x7f7b4c00b390 comp rx=0 tx=0).stop 2024-08-26T00:00:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.929+0000 7f7b62600640 1 -- 172.21.15.42:0/1623182229 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b5c104760 msgr2=0x7f7b5c19a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.929+0000 7f7b62600640 1 --2- 172.21.15.42:0/1623182229 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b5c104760 0x7f7b5c19a930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7b48006010 tx=0x7f7b480042f0 comp rx=0 tx=0).stop 2024-08-26T00:00:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.929+0000 7f7b62600640 1 -- 172.21.15.42:0/1623182229 shutdown_connections 2024-08-26T00:00:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.929+0000 7f7b62600640 1 --2- 172.21.15.42:0/1623182229 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7b400a2c10 0x7f7b400a50d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.929+0000 7f7b62600640 1 --2- 172.21.15.42:0/1623182229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b5c108ee0 0x7f7b5c19ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.929+0000 7f7b62600640 1 --2- 172.21.15.42:0/1623182229 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b5c104760 0x7f7b5c19a930 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.929+0000 7f7b62600640 1 --2- 172.21.15.42:0/1623182229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b5c103db0 0x7f7b5c19a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.929+0000 7f7b62600640 1 -- 172.21.15.42:0/1623182229 >> 172.21.15.42:0/1623182229 conn(0x7f7b5c0ff7f0 msgr2=0x7f7b5c100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.930+0000 7f7b62600640 1 -- 172.21.15.42:0/1623182229 shutdown_connections 2024-08-26T00:00:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:55.930+0000 7f7b62600640 1 -- 172.21.15.42:0/1623182229 wait complete. 2024-08-26T00:00:56.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:56 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1623182229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:00:56.640 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-26T00:00:56.641 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph pg dump --format=json 2024-08-26T00:00:56.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:56 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1623182229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:00:56.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:56 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1623182229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:00:57.020 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:57.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.579+0000 7fa943c00640 1 -- 172.21.15.42:0/1852128846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa93c109c00 msgr2=0x7fa93c109fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:57.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.579+0000 7fa943c00640 1 --2- 172.21.15.42:0/1852128846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa93c109c00 0x7fa93c109fe0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa92c009900 tx=0x7fa92c02a410 comp rx=0 tx=0).stop 2024-08-26T00:00:57.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.579+0000 7fa943c00640 1 -- 172.21.15.42:0/1852128846 shutdown_connections 2024-08-26T00:00:57.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.579+0000 7fa943c00640 1 --2- 172.21.15.42:0/1852128846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa93c1044f0 0x7fa93c1109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:57.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.579+0000 7fa943c00640 1 --2- 172.21.15.42:0/1852128846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa93c103b50 0x7fa93c103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:57.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.579+0000 7fa943c00640 1 --2- 172.21.15.42:0/1852128846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa93c109c00 0x7fa93c109fe0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:57.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.579+0000 7fa943c00640 1 -- 172.21.15.42:0/1852128846 >> 172.21.15.42:0/1852128846 conn(0x7fa93c0ff830 msgr2=0x7fa93c101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:57.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.579+0000 7fa943c00640 1 -- 172.21.15.42:0/1852128846 shutdown_connections 2024-08-26T00:00:57.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.579+0000 7fa943c00640 1 -- 172.21.15.42:0/1852128846 wait complete. 2024-08-26T00:00:57.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.580+0000 7fa943c00640 1 Processor -- start 2024-08-26T00:00:57.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.580+0000 7fa943c00640 1 -- start start 2024-08-26T00:00:57.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.580+0000 7fa943c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa93c103b50 0x7fa93c19a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:57.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.580+0000 7fa943c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa93c1044f0 0x7fa93c19a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:57.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.580+0000 7fa943c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa93c109c00 0x7fa93c19ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:57.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.580+0000 7fa943c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa93c113fb0 con 0x7fa93c109c00 2024-08-26T00:00:57.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.580+0000 7fa943c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa93c113e30 con 0x7fa93c103b50 2024-08-26T00:00:57.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.580+0000 7fa943c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa93c114130 con 0x7fa93c1044f0 2024-08-26T00:00:57.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.581+0000 7fa941c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa93c109c00 0x7fa93c19ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:57.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.581+0000 7fa941200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa93c103b50 0x7fa93c19a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:57.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.581+0000 7fa941200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa93c103b50 0x7fa93c19a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:38122/0 (socket says 172.21.15.42:38122) 2024-08-26T00:00:57.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.581+0000 7fa941200640 1 -- 172.21.15.42:0/4021145654 learned_addr learned my addr 172.21.15.42:0/4021145654 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:57.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.581+0000 7fa941c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa93c109c00 0x7fa93c19ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58392/0 (socket says 172.21.15.42:58392) 2024-08-26T00:00:57.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.581+0000 7fa933e00640 1 --2- 172.21.15.42:0/4021145654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa93c1044f0 0x7fa93c19a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:57.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.581+0000 7fa941200640 1 -- 172.21.15.42:0/4021145654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa93c1044f0 msgr2=0x7fa93c19a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:57.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.581+0000 7fa941200640 1 --2- 172.21.15.42:0/4021145654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa93c1044f0 0x7fa93c19a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:57.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.581+0000 7fa941200640 1 -- 172.21.15.42:0/4021145654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa93c109c00 msgr2=0x7fa93c19ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:57.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.581+0000 7fa941200640 1 --2- 172.21.15.42:0/4021145654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa93c109c00 0x7fa93c19ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:57.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.581+0000 7fa941200640 1 -- 172.21.15.42:0/4021145654 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa93c19f360 con 0x7fa93c103b50 2024-08-26T00:00:57.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.581+0000 7fa941c00640 1 --2- 172.21.15.42:0/4021145654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa93c109c00 0x7fa93c19ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:00:57.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.582+0000 7fa941200640 1 --2- 172.21.15.42:0/4021145654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa93c103b50 0x7fa93c19a3b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa92c02aa00 tx=0x7fa92c003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:57.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.582+0000 7fa93a000640 1 -- 172.21.15.42:0/4021145654 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92c03f070 con 0x7fa93c103b50 2024-08-26T00:00:57.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.582+0000 7fa93a000640 1 -- 172.21.15.42:0/4021145654 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa92c031c30 con 0x7fa93c103b50 2024-08-26T00:00:57.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.582+0000 7fa943c00640 1 -- 172.21.15.42:0/4021145654 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa93c19f5f0 con 0x7fa93c103b50 2024-08-26T00:00:57.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.582+0000 7fa93a000640 1 -- 172.21.15.42:0/4021145654 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92c035030 con 0x7fa93c103b50 2024-08-26T00:00:57.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.582+0000 7fa943c00640 1 -- 172.21.15.42:0/4021145654 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa93c1a6f30 con 0x7fa93c103b50 2024-08-26T00:00:57.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.583+0000 7fa943c00640 1 -- 172.21.15.42:0/4021145654 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa93c105200 con 0x7fa93c103b50 2024-08-26T00:00:57.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.585+0000 7fa93a000640 1 -- 172.21.15.42:0/4021145654 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa92c042070 con 0x7fa93c103b50 2024-08-26T00:00:57.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.586+0000 7fa93a000640 1 --2- 172.21.15.42:0/4021145654 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa9200a2c10 0x7fa9200a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:57.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.586+0000 7fa93a000640 1 -- 172.21.15.42:0/4021145654 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fa92c0ef6d0 con 0x7fa93c103b50 2024-08-26T00:00:57.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.586+0000 7fa933e00640 1 --2- 172.21.15.42:0/4021145654 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa9200a2c10 0x7fa9200a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:57.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.587+0000 7fa933e00640 1 --2- 172.21.15.42:0/4021145654 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa9200a2c10 0x7fa9200a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa93c1091c0 tx=0x7fa924005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:57.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.590+0000 7fa93a000640 1 -- 172.21.15.42:0/4021145654 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa92c0bc580 con 0x7fa93c103b50 2024-08-26T00:00:57.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:57 smithi043 ceph-mon[22091]: pgmap v290: 97 pgs: 97 active+clean; 621 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-08-26T00:00:57.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.771+0000 7fa943c00640 1 -- 172.21.15.42:0/4021145654 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa93c0623d0 con 0x7fa9200a2c10 2024-08-26T00:00:57.772 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:57 smithi042 ceph-mon[17225]: pgmap v290: 97 pgs: 97 active+clean; 621 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-08-26T00:00:57.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.779+0000 7fa93a000640 1 -- 172.21.15.42:0/4021145654 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258699 (secure 0 0 0) 0x7fa93c0623d0 con 0x7fa9200a2c10 2024-08-26T00:00:57.786 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:00:57.788 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-08-26T00:00:57.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.783+0000 7fa943c00640 1 -- 172.21.15.42:0/4021145654 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa9200a2c10 msgr2=0x7fa9200a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:57.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.783+0000 7fa943c00640 1 --2- 172.21.15.42:0/4021145654 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa9200a2c10 0x7fa9200a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa93c1091c0 tx=0x7fa924005f90 comp rx=0 tx=0).stop 2024-08-26T00:00:57.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.783+0000 7fa943c00640 1 -- 172.21.15.42:0/4021145654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa93c103b50 msgr2=0x7fa93c19a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:57.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.783+0000 7fa943c00640 1 --2- 172.21.15.42:0/4021145654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa93c103b50 0x7fa93c19a3b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa92c02aa00 tx=0x7fa92c003c10 comp rx=0 tx=0).stop 2024-08-26T00:00:57.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.783+0000 7fa943c00640 1 -- 172.21.15.42:0/4021145654 shutdown_connections 2024-08-26T00:00:57.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.783+0000 7fa943c00640 1 --2- 172.21.15.42:0/4021145654 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa9200a2c10 0x7fa9200a50d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:57.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.783+0000 7fa943c00640 1 --2- 172.21.15.42:0/4021145654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa93c109c00 0x7fa93c19ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:57.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.783+0000 7fa943c00640 1 --2- 172.21.15.42:0/4021145654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa93c1044f0 0x7fa93c19a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:57.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.783+0000 7fa943c00640 1 --2- 172.21.15.42:0/4021145654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa93c103b50 0x7fa93c19a3b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:57.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.783+0000 7fa943c00640 1 -- 172.21.15.42:0/4021145654 >> 172.21.15.42:0/4021145654 conn(0x7fa93c0ff830 msgr2=0x7fa93c100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:57.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.784+0000 7fa943c00640 1 -- 172.21.15.42:0/4021145654 shutdown_connections 2024-08-26T00:00:57.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:57.784+0000 7fa943c00640 1 -- 172.21.15.42:0/4021145654 wait complete. 2024-08-26T00:00:57.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:57 smithi181 ceph-mon[22102]: pgmap v290: 97 pgs: 97 active+clean; 621 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-08-26T00:00:58.666 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2024-08-26T00:00:56.496772+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":635662,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":228,"num_read_kb":206,"num_write":332,"num_write_kb":3025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":394544,"kb_used_data":12016,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124547280,"statfs":{"total":1151940427776,"available":1151536414720,"internally_reserved":0,"allocated":12304384,"data_stored":6823999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19137,"internal_metadata":391492927},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":40072,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":78,"num_write":28,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003054"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.357329+0000","last_change":"2024-08-26T00:00:29.365654+0000","last_active":"2024-08-26T00:00:30.357329+0000","last_peered":"2024-08-26T00:00:30.357329+0000","last_clean":"2024-08-26T00:00:30.357329+0000","last_became_active":"2024-08-26T00:00:29.364609+0000","last_became_peered":"2024-08-26T00:00:29.364609+0000","last_unstale":"2024-08-26T00:00:30.357329+0000","last_undegraded":"2024-08-26T00:00:30.357329+0000","last_fullsized":"2024-08-26T00:00:30.357329+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:54:39.886248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350513+0000","last_change":"2024-08-26T00:00:29.367657+0000","last_active":"2024-08-26T00:00:30.350513+0000","last_peered":"2024-08-26T00:00:30.350513+0000","last_clean":"2024-08-26T00:00:30.350513+0000","last_became_active":"2024-08-26T00:00:29.367376+0000","last_became_peered":"2024-08-26T00:00:29.367376+0000","last_unstale":"2024-08-26T00:00:30.350513+0000","last_undegraded":"2024-08-26T00:00:30.350513+0000","last_fullsized":"2024-08-26T00:00:30.350513+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:16:13.414883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350833+0000","last_change":"2024-08-26T00:00:29.369219+0000","last_active":"2024-08-26T00:00:30.350833+0000","last_peered":"2024-08-26T00:00:30.350833+0000","last_clean":"2024-08-26T00:00:30.350833+0000","last_became_active":"2024-08-26T00:00:29.368902+0000","last_became_peered":"2024-08-26T00:00:29.368902+0000","last_unstale":"2024-08-26T00:00:30.350833+0000","last_undegraded":"2024-08-26T00:00:30.350833+0000","last_fullsized":"2024-08-26T00:00:30.350833+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:53:28.636658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.349890+0000","last_change":"2024-08-26T00:00:29.359501+0000","last_active":"2024-08-26T00:00:30.349890+0000","last_peered":"2024-08-26T00:00:30.349890+0000","last_clean":"2024-08-26T00:00:30.349890+0000","last_became_active":"2024-08-26T00:00:29.358778+0000","last_became_peered":"2024-08-26T00:00:29.358778+0000","last_unstale":"2024-08-26T00:00:30.349890+0000","last_undegraded":"2024-08-26T00:00:30.349890+0000","last_fullsized":"2024-08-26T00:00:30.349890+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:20:40.200105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341534+0000","last_change":"2024-08-26T00:00:29.358387+0000","last_active":"2024-08-26T00:00:30.341534+0000","last_peered":"2024-08-26T00:00:30.341534+0000","last_clean":"2024-08-26T00:00:30.341534+0000","last_became_active":"2024-08-26T00:00:29.357839+0000","last_became_peered":"2024-08-26T00:00:29.357839+0000","last_unstale":"2024-08-26T00:00:30.341534+0000","last_undegraded":"2024-08-26T00:00:30.341534+0000","last_fullsized":"2024-08-26T00:00:30.341534+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:05:21.065258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.349598+0000","last_change":"2024-08-26T00:00:29.354429+0000","last_active":"2024-08-26T00:00:30.349598+0000","last_peered":"2024-08-26T00:00:30.349598+0000","last_clean":"2024-08-26T00:00:30.349598+0000","last_became_active":"2024-08-26T00:00:29.354108+0000","last_became_peered":"2024-08-26T00:00:29.354108+0000","last_unstale":"2024-08-26T00:00:30.349598+0000","last_undegraded":"2024-08-26T00:00:30.349598+0000","last_fullsized":"2024-08-26T00:00:30.349598+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:58:07.912980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350294+0000","last_change":"2024-08-26T00:00:29.360127+0000","last_active":"2024-08-26T00:00:30.350294+0000","last_peered":"2024-08-26T00:00:30.350294+0000","last_clean":"2024-08-26T00:00:30.350294+0000","last_became_active":"2024-08-26T00:00:29.359730+0000","last_became_peered":"2024-08-26T00:00:29.359730+0000","last_unstale":"2024-08-26T00:00:30.350294+0000","last_undegraded":"2024-08-26T00:00:30.350294+0000","last_fullsized":"2024-08-26T00:00:30.350294+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:38:16.377861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.349797+0000","last_change":"2024-08-26T00:00:29.362117+0000","last_active":"2024-08-26T00:00:30.349797+0000","last_peered":"2024-08-26T00:00:30.349797+0000","last_clean":"2024-08-26T00:00:30.349797+0000","last_became_active":"2024-08-26T00:00:29.361738+0000","last_became_peered":"2024-08-26T00:00:29.361738+0000","last_unstale":"2024-08-26T00:00:30.349797+0000","last_undegraded":"2024-08-26T00:00:30.349797+0000","last_fullsized":"2024-08-26T00:00:30.349797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:38:15.468364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.342037+0000","last_change":"2024-08-26T00:00:29.363693+0000","last_active":"2024-08-26T00:00:30.342037+0000","last_peered":"2024-08-26T00:00:30.342037+0000","last_clean":"2024-08-26T00:00:30.342037+0000","last_became_active":"2024-08-26T00:00:29.363356+0000","last_became_peered":"2024-08-26T00:00:29.363356+0000","last_unstale":"2024-08-26T00:00:30.342037+0000","last_undegraded":"2024-08-26T00:00:30.342037+0000","last_fullsized":"2024-08-26T00:00:30.342037+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:18:46.180255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350350+0000","last_change":"2024-08-26T00:00:29.363401+0000","last_active":"2024-08-26T00:00:30.350350+0000","last_peered":"2024-08-26T00:00:30.350350+0000","last_clean":"2024-08-26T00:00:30.350350+0000","last_became_active":"2024-08-26T00:00:29.363045+0000","last_became_peered":"2024-08-26T00:00:29.363045+0000","last_unstale":"2024-08-26T00:00:30.350350+0000","last_undegraded":"2024-08-26T00:00:30.350350+0000","last_fullsized":"2024-08-26T00:00:30.350350+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:18:24.931121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351680+0000","last_change":"2024-08-26T00:00:29.356440+0000","last_active":"2024-08-26T00:00:30.351680+0000","last_peered":"2024-08-26T00:00:30.351680+0000","last_clean":"2024-08-26T00:00:30.351680+0000","last_became_active":"2024-08-26T00:00:29.355498+0000","last_became_peered":"2024-08-26T00:00:29.355498+0000","last_unstale":"2024-08-26T00:00:30.351680+0000","last_undegraded":"2024-08-26T00:00:30.351680+0000","last_fullsized":"2024-08-26T00:00:30.351680+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:27:31.363962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350049+0000","last_change":"2024-08-26T00:00:29.359185+0000","last_active":"2024-08-26T00:00:30.350049+0000","last_peered":"2024-08-26T00:00:30.350049+0000","last_clean":"2024-08-26T00:00:30.350049+0000","last_became_active":"2024-08-26T00:00:29.358670+0000","last_became_peered":"2024-08-26T00:00:29.358670+0000","last_unstale":"2024-08-26T00:00:30.350049+0000","last_undegraded":"2024-08-26T00:00:30.350049+0000","last_fullsized":"2024-08-26T00:00:30.350049+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:15:31.327823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341654+0000","last_change":"2024-08-26T00:00:29.361477+0000","last_active":"2024-08-26T00:00:30.341654+0000","last_peered":"2024-08-26T00:00:30.341654+0000","last_clean":"2024-08-26T00:00:30.341654+0000","last_became_active":"2024-08-26T00:00:29.360870+0000","last_became_peered":"2024-08-26T00:00:29.360870+0000","last_unstale":"2024-08-26T00:00:30.341654+0000","last_undegraded":"2024-08-26T00:00:30.341654+0000","last_fullsized":"2024-08-26T00:00:30.341654+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:37:01.434606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350329+0000","last_change":"2024-08-26T00:00:29.362301+0000","last_active":"2024-08-26T00:00:30.350329+0000","last_peered":"2024-08-26T00:00:30.350329+0000","last_clean":"2024-08-26T00:00:30.350329+0000","last_became_active":"2024-08-26T00:00:29.359613+0000","last_became_peered":"2024-08-26T00:00:29.359613+0000","last_unstale":"2024-08-26T00:00:30.350329+0000","last_undegraded":"2024-08-26T00:00:30.350329+0000","last_fullsized":"2024-08-26T00:00:30.350329+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:24:09.515352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.349760+0000","last_change":"2024-08-26T00:00:29.365553+0000","last_active":"2024-08-26T00:00:30.349760+0000","last_peered":"2024-08-26T00:00:30.349760+0000","last_clean":"2024-08-26T00:00:30.349760+0000","last_became_active":"2024-08-26T00:00:29.363344+0000","last_became_peered":"2024-08-26T00:00:29.363344+0000","last_unstale":"2024-08-26T00:00:30.349760+0000","last_undegraded":"2024-08-26T00:00:30.349760+0000","last_fullsized":"2024-08-26T00:00:30.349760+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:27:43.172749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341468+0000","last_change":"2024-08-26T00:00:29.362061+0000","last_active":"2024-08-26T00:00:30.341468+0000","last_peered":"2024-08-26T00:00:30.341468+0000","last_clean":"2024-08-26T00:00:30.341468+0000","last_became_active":"2024-08-26T00:00:29.361712+0000","last_became_peered":"2024-08-26T00:00:29.361712+0000","last_unstale":"2024-08-26T00:00:30.341468+0000","last_undegraded":"2024-08-26T00:00:30.341468+0000","last_fullsized":"2024-08-26T00:00:30.341468+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:20:14.944167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.357329+0000","last_change":"2024-08-26T00:00:29.365160+0000","last_active":"2024-08-26T00:00:30.357329+0000","last_peered":"2024-08-26T00:00:30.357329+0000","last_clean":"2024-08-26T00:00:30.357329+0000","last_became_active":"2024-08-26T00:00:29.364541+0000","last_became_peered":"2024-08-26T00:00:29.364541+0000","last_unstale":"2024-08-26T00:00:30.357329+0000","last_undegraded":"2024-08-26T00:00:30.357329+0000","last_fullsized":"2024-08-26T00:00:30.357329+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:59:54.417495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.352593+0000","last_change":"2024-08-26T00:00:29.361264+0000","last_active":"2024-08-26T00:00:30.352593+0000","last_peered":"2024-08-26T00:00:30.352593+0000","last_clean":"2024-08-26T00:00:30.352593+0000","last_became_active":"2024-08-26T00:00:29.358501+0000","last_became_peered":"2024-08-26T00:00:29.358501+0000","last_unstale":"2024-08-26T00:00:30.352593+0000","last_undegraded":"2024-08-26T00:00:30.352593+0000","last_fullsized":"2024-08-26T00:00:30.352593+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:04:44.930112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351562+0000","last_change":"2024-08-26T00:00:29.365428+0000","last_active":"2024-08-26T00:00:30.351562+0000","last_peered":"2024-08-26T00:00:30.351562+0000","last_clean":"2024-08-26T00:00:30.351562+0000","last_became_active":"2024-08-26T00:00:29.365138+0000","last_became_peered":"2024-08-26T00:00:29.365138+0000","last_unstale":"2024-08-26T00:00:30.351562+0000","last_undegraded":"2024-08-26T00:00:30.351562+0000","last_fullsized":"2024-08-26T00:00:30.351562+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:05:52.276062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.357030+0000","last_change":"2024-08-26T00:00:29.363072+0000","last_active":"2024-08-26T00:00:30.357030+0000","last_peered":"2024-08-26T00:00:30.357030+0000","last_clean":"2024-08-26T00:00:30.357030+0000","last_became_active":"2024-08-26T00:00:29.362751+0000","last_became_peered":"2024-08-26T00:00:29.362751+0000","last_unstale":"2024-08-26T00:00:30.357030+0000","last_undegraded":"2024-08-26T00:00:30.357030+0000","last_fullsized":"2024-08-26T00:00:30.357030+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:49:14.455371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341806+0000","last_change":"2024-08-26T00:00:29.367489+0000","last_active":"2024-08-26T00:00:30.341806+0000","last_peered":"2024-08-26T00:00:30.341806+0000","last_clean":"2024-08-26T00:00:30.341806+0000","last_became_active":"2024-08-26T00:00:29.367183+0000","last_became_peered":"2024-08-26T00:00:29.367183+0000","last_unstale":"2024-08-26T00:00:30.341806+0000","last_undegraded":"2024-08-26T00:00:30.341806+0000","last_fullsized":"2024-08-26T00:00:30.341806+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:05:53.736139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341803+0000","last_change":"2024-08-26T00:00:29.356751+0000","last_active":"2024-08-26T00:00:30.341803+0000","last_peered":"2024-08-26T00:00:30.341803+0000","last_clean":"2024-08-26T00:00:30.341803+0000","last_became_active":"2024-08-26T00:00:29.356291+0000","last_became_peered":"2024-08-26T00:00:29.356291+0000","last_unstale":"2024-08-26T00:00:30.341803+0000","last_undegraded":"2024-08-26T00:00:30.341803+0000","last_fullsized":"2024-08-26T00:00:30.341803+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:32:50.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350251+0000","last_change":"2024-08-26T00:00:29.356965+0000","last_active":"2024-08-26T00:00:30.350251+0000","last_peered":"2024-08-26T00:00:30.350251+0000","last_clean":"2024-08-26T00:00:30.350251+0000","last_became_active":"2024-08-26T00:00:29.356588+0000","last_became_peered":"2024-08-26T00:00:29.356588+0000","last_unstale":"2024-08-26T00:00:30.350251+0000","last_undegraded":"2024-08-26T00:00:30.350251+0000","last_fullsized":"2024-08-26T00:00:30.350251+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:02:25.833139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351032+0000","last_change":"2024-08-26T00:00:29.352304+0000","last_active":"2024-08-26T00:00:30.351032+0000","last_peered":"2024-08-26T00:00:30.351032+0000","last_clean":"2024-08-26T00:00:30.351032+0000","last_became_active":"2024-08-26T00:00:29.351981+0000","last_became_peered":"2024-08-26T00:00:29.351981+0000","last_unstale":"2024-08-26T00:00:30.351032+0000","last_undegraded":"2024-08-26T00:00:30.351032+0000","last_fullsized":"2024-08-26T00:00:30.351032+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:06:29.105905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351596+0000","last_change":"2024-08-26T00:00:29.354424+0000","last_active":"2024-08-26T00:00:30.351596+0000","last_peered":"2024-08-26T00:00:30.351596+0000","last_clean":"2024-08-26T00:00:30.351596+0000","last_became_active":"2024-08-26T00:00:29.352687+0000","last_became_peered":"2024-08-26T00:00:29.352687+0000","last_unstale":"2024-08-26T00:00:30.351596+0000","last_undegraded":"2024-08-26T00:00:30.351596+0000","last_fullsized":"2024-08-26T00:00:30.351596+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:26:21.769928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.352002+0000","last_change":"2024-08-26T00:00:29.355680+0000","last_active":"2024-08-26T00:00:30.352002+0000","last_peered":"2024-08-26T00:00:30.352002+0000","last_clean":"2024-08-26T00:00:30.352002+0000","last_became_active":"2024-08-26T00:00:29.355335+0000","last_became_peered":"2024-08-26T00:00:29.355335+0000","last_unstale":"2024-08-26T00:00:30.352002+0000","last_undegraded":"2024-08-26T00:00:30.352002+0000","last_fullsized":"2024-08-26T00:00:30.352002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:16:04.085892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.357068+0000","last_change":"2024-08-26T00:00:29.357564+0000","last_active":"2024-08-26T00:00:30.357068+0000","last_peered":"2024-08-26T00:00:30.357068+0000","last_clean":"2024-08-26T00:00:30.357068+0000","last_became_active":"2024-08-26T00:00:29.357215+0000","last_became_peered":"2024-08-26T00:00:29.357215+0000","last_unstale":"2024-08-26T00:00:30.357068+0000","last_undegraded":"2024-08-26T00:00:30.357068+0000","last_fullsized":"2024-08-26T00:00:30.357068+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:47:32.969629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341580+0000","last_change":"2024-08-26T00:00:29.368272+0000","last_active":"2024-08-26T00:00:30.341580+0000","last_peered":"2024-08-26T00:00:30.341580+0000","last_clean":"2024-08-26T00:00:30.341580+0000","last_became_active":"2024-08-26T00:00:29.367920+0000","last_became_peered":"2024-08-26T00:00:29.367920+0000","last_unstale":"2024-08-26T00:00:30.341580+0000","last_undegraded":"2024-08-26T00:00:30.341580+0000","last_fullsized":"2024-08-26T00:00:30.341580+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:35:19.373782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.349952+0000","last_change":"2024-08-26T00:00:29.371609+0000","last_active":"2024-08-26T00:00:30.349952+0000","last_peered":"2024-08-26T00:00:30.349952+0000","last_clean":"2024-08-26T00:00:30.349952+0000","last_became_active":"2024-08-26T00:00:29.371199+0000","last_became_peered":"2024-08-26T00:00:29.371199+0000","last_unstale":"2024-08-26T00:00:30.349952+0000","last_undegraded":"2024-08-26T00:00:30.349952+0000","last_fullsized":"2024-08-26T00:00:30.349952+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:03:43.542718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350025+0000","last_change":"2024-08-26T00:00:29.362222+0000","last_active":"2024-08-26T00:00:30.350025+0000","last_peered":"2024-08-26T00:00:30.350025+0000","last_clean":"2024-08-26T00:00:30.350025+0000","last_became_active":"2024-08-26T00:00:29.361767+0000","last_became_peered":"2024-08-26T00:00:29.361767+0000","last_unstale":"2024-08-26T00:00:30.350025+0000","last_undegraded":"2024-08-26T00:00:30.350025+0000","last_fullsized":"2024-08-26T00:00:30.350025+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:42:17.032034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.349832+0000","last_change":"2024-08-26T00:00:29.357997+0000","last_active":"2024-08-26T00:00:30.349832+0000","last_peered":"2024-08-26T00:00:30.349832+0000","last_clean":"2024-08-26T00:00:30.349832+0000","last_became_active":"2024-08-26T00:00:29.357693+0000","last_became_peered":"2024-08-26T00:00:29.357693+0000","last_unstale":"2024-08-26T00:00:30.349832+0000","last_undegraded":"2024-08-26T00:00:30.349832+0000","last_fullsized":"2024-08-26T00:00:30.349832+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:02:49.074234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.356663+0000","last_change":"2024-08-26T00:00:29.358305+0000","last_active":"2024-08-26T00:00:30.356663+0000","last_peered":"2024-08-26T00:00:30.356663+0000","last_clean":"2024-08-26T00:00:30.356663+0000","last_became_active":"2024-08-26T00:00:29.357928+0000","last_became_peered":"2024-08-26T00:00:29.357928+0000","last_unstale":"2024-08-26T00:00:30.356663+0000","last_undegraded":"2024-08-26T00:00:30.356663+0000","last_fullsized":"2024-08-26T00:00:30.356663+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:34:47.609170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341964+0000","last_change":"2024-08-26T00:00:29.357931+0000","last_active":"2024-08-26T00:00:30.341964+0000","last_peered":"2024-08-26T00:00:30.341964+0000","last_clean":"2024-08-26T00:00:30.341964+0000","last_became_active":"2024-08-26T00:00:29.357408+0000","last_became_peered":"2024-08-26T00:00:29.357408+0000","last_unstale":"2024-08-26T00:00:30.341964+0000","last_undegraded":"2024-08-26T00:00:30.341964+0000","last_fullsized":"2024-08-26T00:00:30.341964+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:21:10.230267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'5","reported_seq":38,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:51.425000+0000","last_change":"2024-08-26T00:00:26.993942+0000","last_active":"2024-08-26T00:00:51.425000+0000","last_peered":"2024-08-26T00:00:51.425000+0000","last_clean":"2024-08-26T00:00:51.425000+0000","last_became_active":"2024-08-26T00:00:26.993136+0000","last_became_peered":"2024-08-26T00:00:26.993136+0000","last_unstale":"2024-08-26T00:00:51.425000+0000","last_undegraded":"2024-08-26T00:00:51.425000+0000","last_fullsized":"2024-08-26T00:00:51.425000+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:30:31.890643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350430+0000","last_change":"2024-08-26T00:00:29.351174+0000","last_active":"2024-08-26T00:00:30.350430+0000","last_peered":"2024-08-26T00:00:30.350430+0000","last_clean":"2024-08-26T00:00:30.350430+0000","last_became_active":"2024-08-26T00:00:29.350758+0000","last_became_peered":"2024-08-26T00:00:29.350758+0000","last_unstale":"2024-08-26T00:00:30.350430+0000","last_undegraded":"2024-08-26T00:00:30.350430+0000","last_fullsized":"2024-08-26T00:00:30.350430+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:02:56.986251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:39.405501+0000","last_change":"2024-08-26T00:00:26.991547+0000","last_active":"2024-08-26T00:00:39.405501+0000","last_peered":"2024-08-26T00:00:39.405501+0000","last_clean":"2024-08-26T00:00:39.405501+0000","last_became_active":"2024-08-26T00:00:26.991120+0000","last_became_peered":"2024-08-26T00:00:26.991120+0000","last_unstale":"2024-08-26T00:00:39.405501+0000","last_undegraded":"2024-08-26T00:00:39.405501+0000","last_fullsized":"2024-08-26T00:00:39.405501+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:42:12.381882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:39.406465+0000","last_change":"2024-08-26T00:00:26.988477+0000","last_active":"2024-08-26T00:00:39.406465+0000","last_peered":"2024-08-26T00:00:39.406465+0000","last_clean":"2024-08-26T00:00:39.406465+0000","last_became_active":"2024-08-26T00:00:26.988180+0000","last_became_peered":"2024-08-26T00:00:26.988180+0000","last_unstale":"2024-08-26T00:00:39.406465+0000","last_undegraded":"2024-08-26T00:00:39.406465+0000","last_fullsized":"2024-08-26T00:00:39.406465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:00:35.586628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350023+0000","last_change":"2024-08-26T00:00:29.360687+0000","last_active":"2024-08-26T00:00:30.350023+0000","last_peered":"2024-08-26T00:00:30.350023+0000","last_clean":"2024-08-26T00:00:30.350023+0000","last_became_active":"2024-08-26T00:00:29.358427+0000","last_became_peered":"2024-08-26T00:00:29.358427+0000","last_unstale":"2024-08-26T00:00:30.350023+0000","last_undegraded":"2024-08-26T00:00:30.350023+0000","last_fullsized":"2024-08-26T00:00:30.350023+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:15:41.175510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351999+0000","last_change":"2024-08-26T00:00:26.995054+0000","last_active":"2024-08-26T00:00:30.351999+0000","last_peered":"2024-08-26T00:00:30.351999+0000","last_clean":"2024-08-26T00:00:30.351999+0000","last_became_active":"2024-08-26T00:00:26.994742+0000","last_became_peered":"2024-08-26T00:00:26.994742+0000","last_unstale":"2024-08-26T00:00:30.351999+0000","last_undegraded":"2024-08-26T00:00:30.351999+0000","last_fullsized":"2024-08-26T00:00:30.351999+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:02:30.509497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351911+0000","last_change":"2024-08-26T00:00:29.352343+0000","last_active":"2024-08-26T00:00:30.351911+0000","last_peered":"2024-08-26T00:00:30.351911+0000","last_clean":"2024-08-26T00:00:30.351911+0000","last_became_active":"2024-08-26T00:00:29.352036+0000","last_became_peered":"2024-08-26T00:00:29.352036+0000","last_unstale":"2024-08-26T00:00:30.351911+0000","last_undegraded":"2024-08-26T00:00:30.351911+0000","last_fullsized":"2024-08-26T00:00:30.351911+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:28:14.399870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:50.422736+0000","last_change":"2024-08-26T00:00:26.989828+0000","last_active":"2024-08-26T00:00:50.422736+0000","last_peered":"2024-08-26T00:00:50.422736+0000","last_clean":"2024-08-26T00:00:50.422736+0000","last_became_active":"2024-08-26T00:00:26.989365+0000","last_became_peered":"2024-08-26T00:00:26.989365+0000","last_unstale":"2024-08-26T00:00:50.422736+0000","last_undegraded":"2024-08-26T00:00:50.422736+0000","last_fullsized":"2024-08-26T00:00:50.422736+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:00:40.821500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341858+0000","last_change":"2024-08-26T00:00:29.359506+0000","last_active":"2024-08-26T00:00:30.341858+0000","last_peered":"2024-08-26T00:00:30.341858+0000","last_clean":"2024-08-26T00:00:30.341858+0000","last_became_active":"2024-08-26T00:00:29.359042+0000","last_became_peered":"2024-08-26T00:00:29.359042+0000","last_unstale":"2024-08-26T00:00:30.341858+0000","last_undegraded":"2024-08-26T00:00:30.341858+0000","last_fullsized":"2024-08-26T00:00:30.341858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:38:34.661823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:38.398775+0000","last_change":"2024-08-26T00:00:26.994272+0000","last_active":"2024-08-26T00:00:38.398775+0000","last_peered":"2024-08-26T00:00:38.398775+0000","last_clean":"2024-08-26T00:00:38.398775+0000","last_became_active":"2024-08-26T00:00:26.993769+0000","last_became_peered":"2024-08-26T00:00:26.993769+0000","last_unstale":"2024-08-26T00:00:38.398775+0000","last_undegraded":"2024-08-26T00:00:38.398775+0000","last_fullsized":"2024-08-26T00:00:38.398775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:03:39.816595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350863+0000","last_change":"2024-08-26T00:00:29.372236+0000","last_active":"2024-08-26T00:00:30.350863+0000","last_peered":"2024-08-26T00:00:30.350863+0000","last_clean":"2024-08-26T00:00:30.350863+0000","last_became_active":"2024-08-26T00:00:29.371632+0000","last_became_peered":"2024-08-26T00:00:29.371632+0000","last_unstale":"2024-08-26T00:00:30.350863+0000","last_undegraded":"2024-08-26T00:00:30.350863+0000","last_fullsized":"2024-08-26T00:00:30.350863+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:46:10.735550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:38.397056+0000","last_change":"2024-08-26T00:00:27.080074+0000","last_active":"2024-08-26T00:00:38.397056+0000","last_peered":"2024-08-26T00:00:38.397056+0000","last_clean":"2024-08-26T00:00:38.397056+0000","last_became_active":"2024-08-26T00:00:27.079646+0000","last_became_peered":"2024-08-26T00:00:27.079646+0000","last_unstale":"2024-08-26T00:00:38.397056+0000","last_undegraded":"2024-08-26T00:00:38.397056+0000","last_fullsized":"2024-08-26T00:00:38.397056+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:22:42.677747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341611+0000","last_change":"2024-08-26T00:00:29.358323+0000","last_active":"2024-08-26T00:00:30.341611+0000","last_peered":"2024-08-26T00:00:30.341611+0000","last_clean":"2024-08-26T00:00:30.341611+0000","last_became_active":"2024-08-26T00:00:29.357658+0000","last_became_peered":"2024-08-26T00:00:29.357658+0000","last_unstale":"2024-08-26T00:00:30.341611+0000","last_undegraded":"2024-08-26T00:00:30.341611+0000","last_fullsized":"2024-08-26T00:00:30.341611+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:23:40.859598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'21","reported_seq":69,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:51.427637+0000","last_change":"2024-08-26T00:00:26.990434+0000","last_active":"2024-08-26T00:00:51.427637+0000","last_peered":"2024-08-26T00:00:51.427637+0000","last_clean":"2024-08-26T00:00:51.427637+0000","last_became_active":"2024-08-26T00:00:26.989961+0000","last_became_peered":"2024-08-26T00:00:26.989961+0000","last_unstale":"2024-08-26T00:00:51.427637+0000","last_undegraded":"2024-08-26T00:00:51.427637+0000","last_fullsized":"2024-08-26T00:00:51.427637+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:45:19.263082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41061,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":54,"num_write":22,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.342093+0000","last_change":"2024-08-26T00:00:29.356969+0000","last_active":"2024-08-26T00:00:30.342093+0000","last_peered":"2024-08-26T00:00:30.342093+0000","last_clean":"2024-08-26T00:00:30.342093+0000","last_became_active":"2024-08-26T00:00:29.356493+0000","last_became_peered":"2024-08-26T00:00:29.356493+0000","last_unstale":"2024-08-26T00:00:30.342093+0000","last_undegraded":"2024-08-26T00:00:30.342093+0000","last_fullsized":"2024-08-26T00:00:30.342093+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:42:29.663933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:39.405426+0000","last_change":"2024-08-26T00:00:26.993733+0000","last_active":"2024-08-26T00:00:39.405426+0000","last_peered":"2024-08-26T00:00:39.405426+0000","last_clean":"2024-08-26T00:00:39.405426+0000","last_became_active":"2024-08-26T00:00:26.991196+0000","last_became_peered":"2024-08-26T00:00:26.991196+0000","last_unstale":"2024-08-26T00:00:39.405426+0000","last_undegraded":"2024-08-26T00:00:39.405426+0000","last_fullsized":"2024-08-26T00:00:39.405426+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:53:49.056228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341409+0000","last_change":"2024-08-26T00:00:29.363095+0000","last_active":"2024-08-26T00:00:30.341409+0000","last_peered":"2024-08-26T00:00:30.341409+0000","last_clean":"2024-08-26T00:00:30.341409+0000","last_became_active":"2024-08-26T00:00:29.361374+0000","last_became_peered":"2024-08-26T00:00:29.361374+0000","last_unstale":"2024-08-26T00:00:30.341409+0000","last_undegraded":"2024-08-26T00:00:30.341409+0000","last_fullsized":"2024-08-26T00:00:30.341409+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:30:34.072712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:38.398578+0000","last_change":"2024-08-26T00:00:26.993920+0000","last_active":"2024-08-26T00:00:38.398578+0000","last_peered":"2024-08-26T00:00:38.398578+0000","last_clean":"2024-08-26T00:00:38.398578+0000","last_became_active":"2024-08-26T00:00:26.993578+0000","last_became_peered":"2024-08-26T00:00:26.993578+0000","last_unstale":"2024-08-26T00:00:38.398578+0000","last_undegraded":"2024-08-26T00:00:38.398578+0000","last_fullsized":"2024-08-26T00:00:38.398578+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:29:49.751384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351220+0000","last_change":"2024-08-26T00:00:29.362535+0000","last_active":"2024-08-26T00:00:30.351220+0000","last_peered":"2024-08-26T00:00:30.351220+0000","last_clean":"2024-08-26T00:00:30.351220+0000","last_became_active":"2024-08-26T00:00:29.362167+0000","last_became_peered":"2024-08-26T00:00:29.362167+0000","last_unstale":"2024-08-26T00:00:30.351220+0000","last_undegraded":"2024-08-26T00:00:30.351220+0000","last_fullsized":"2024-08-26T00:00:30.351220+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:21:54.020323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'4","reported_seq":41,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:54.429179+0000","last_change":"2024-08-26T00:00:26.993988+0000","last_active":"2024-08-26T00:00:54.429179+0000","last_peered":"2024-08-26T00:00:54.429179+0000","last_clean":"2024-08-26T00:00:54.429179+0000","last_became_active":"2024-08-26T00:00:26.993485+0000","last_became_peered":"2024-08-26T00:00:26.993485+0000","last_unstale":"2024-08-26T00:00:54.429179+0000","last_undegraded":"2024-08-26T00:00:54.429179+0000","last_fullsized":"2024-08-26T00:00:54.429179+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:46:29.475574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":977,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.352260+0000","last_change":"2024-08-26T00:00:29.354108+0000","last_active":"2024-08-26T00:00:30.352260+0000","last_peered":"2024-08-26T00:00:30.352260+0000","last_clean":"2024-08-26T00:00:30.352260+0000","last_became_active":"2024-08-26T00:00:29.353765+0000","last_became_peered":"2024-08-26T00:00:29.353765+0000","last_unstale":"2024-08-26T00:00:30.352260+0000","last_undegraded":"2024-08-26T00:00:30.352260+0000","last_fullsized":"2024-08-26T00:00:30.352260+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:54:20.998930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:39.408112+0000","last_change":"2024-08-26T00:00:27.077517+0000","last_active":"2024-08-26T00:00:39.408112+0000","last_peered":"2024-08-26T00:00:39.408112+0000","last_clean":"2024-08-26T00:00:39.408112+0000","last_became_active":"2024-08-26T00:00:27.077083+0000","last_became_peered":"2024-08-26T00:00:27.077083+0000","last_unstale":"2024-08-26T00:00:39.408112+0000","last_undegraded":"2024-08-26T00:00:39.408112+0000","last_fullsized":"2024-08-26T00:00:39.408112+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:27:43.522233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.352513+0000","last_change":"2024-08-26T00:00:29.355532+0000","last_active":"2024-08-26T00:00:30.352513+0000","last_peered":"2024-08-26T00:00:30.352513+0000","last_clean":"2024-08-26T00:00:30.352513+0000","last_became_active":"2024-08-26T00:00:29.355211+0000","last_became_peered":"2024-08-26T00:00:29.355211+0000","last_unstale":"2024-08-26T00:00:30.352513+0000","last_undegraded":"2024-08-26T00:00:30.352513+0000","last_fullsized":"2024-08-26T00:00:30.352513+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:08:51.419634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:40.401704+0000","last_change":"2024-08-26T00:00:26.992613+0000","last_active":"2024-08-26T00:00:40.401704+0000","last_peered":"2024-08-26T00:00:40.401704+0000","last_clean":"2024-08-26T00:00:40.401704+0000","last_became_active":"2024-08-26T00:00:26.992137+0000","last_became_peered":"2024-08-26T00:00:26.992137+0000","last_unstale":"2024-08-26T00:00:40.401704+0000","last_undegraded":"2024-08-26T00:00:40.401704+0000","last_fullsized":"2024-08-26T00:00:40.401704+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:30:32.586859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.357123+0000","last_change":"2024-08-26T00:00:29.362342+0000","last_active":"2024-08-26T00:00:30.357123+0000","last_peered":"2024-08-26T00:00:30.357123+0000","last_clean":"2024-08-26T00:00:30.357123+0000","last_became_active":"2024-08-26T00:00:29.362017+0000","last_became_peered":"2024-08-26T00:00:29.362017+0000","last_unstale":"2024-08-26T00:00:30.357123+0000","last_undegraded":"2024-08-26T00:00:30.357123+0000","last_fullsized":"2024-08-26T00:00:30.357123+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:01:55.507893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.353047+0000","last_change":"2024-08-26T00:00:26.989977+0000","last_active":"2024-08-26T00:00:30.353047+0000","last_peered":"2024-08-26T00:00:30.353047+0000","last_clean":"2024-08-26T00:00:30.353047+0000","last_became_active":"2024-08-26T00:00:26.989535+0000","last_became_peered":"2024-08-26T00:00:26.989535+0000","last_unstale":"2024-08-26T00:00:30.353047+0000","last_undegraded":"2024-08-26T00:00:30.353047+0000","last_fullsized":"2024-08-26T00:00:30.353047+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:33:20.347005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351800+0000","last_change":"2024-08-26T00:00:29.355928+0000","last_active":"2024-08-26T00:00:30.351800+0000","last_peered":"2024-08-26T00:00:30.351800+0000","last_clean":"2024-08-26T00:00:30.351800+0000","last_became_active":"2024-08-26T00:00:29.355546+0000","last_became_peered":"2024-08-26T00:00:29.355546+0000","last_unstale":"2024-08-26T00:00:30.351800+0000","last_undegraded":"2024-08-26T00:00:30.351800+0000","last_fullsized":"2024-08-26T00:00:30.351800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:15:06.116141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.356434+0000","last_change":"2024-08-26T00:00:26.992523+0000","last_active":"2024-08-26T00:00:30.356434+0000","last_peered":"2024-08-26T00:00:30.356434+0000","last_clean":"2024-08-26T00:00:30.356434+0000","last_became_active":"2024-08-26T00:00:26.992193+0000","last_became_peered":"2024-08-26T00:00:26.992193+0000","last_unstale":"2024-08-26T00:00:30.356434+0000","last_undegraded":"2024-08-26T00:00:30.356434+0000","last_fullsized":"2024-08-26T00:00:30.356434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:34:21.879373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:31.555090+0000","last_change":"2024-08-26T00:00:29.358826+0000","last_active":"2024-08-26T00:00:31.555090+0000","last_peered":"2024-08-26T00:00:31.555090+0000","last_clean":"2024-08-26T00:00:31.555090+0000","last_became_active":"2024-08-26T00:00:29.358478+0000","last_became_peered":"2024-08-26T00:00:29.358478+0000","last_unstale":"2024-08-26T00:00:31.555090+0000","last_undegraded":"2024-08-26T00:00:31.555090+0000","last_fullsized":"2024-08-26T00:00:31.555090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:30:39.484666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:39.407576+0000","last_change":"2024-08-26T00:00:27.077599+0000","last_active":"2024-08-26T00:00:39.407576+0000","last_peered":"2024-08-26T00:00:39.407576+0000","last_clean":"2024-08-26T00:00:39.407576+0000","last_became_active":"2024-08-26T00:00:27.077094+0000","last_became_peered":"2024-08-26T00:00:27.077094+0000","last_unstale":"2024-08-26T00:00:39.407576+0000","last_undegraded":"2024-08-26T00:00:39.407576+0000","last_fullsized":"2024-08-26T00:00:39.407576+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:06:47.966097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351847+0000","last_change":"2024-08-26T00:00:29.355243+0000","last_active":"2024-08-26T00:00:30.351847+0000","last_peered":"2024-08-26T00:00:30.351847+0000","last_clean":"2024-08-26T00:00:30.351847+0000","last_became_active":"2024-08-26T00:00:29.354151+0000","last_became_peered":"2024-08-26T00:00:29.354151+0000","last_unstale":"2024-08-26T00:00:30.351847+0000","last_undegraded":"2024-08-26T00:00:30.351847+0000","last_fullsized":"2024-08-26T00:00:30.351847+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:00:12.520736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":330,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.352379+0000","last_change":"2024-08-25T23:59:16.227980+0000","last_active":"2024-08-26T00:00:30.352379+0000","last_peered":"2024-08-26T00:00:30.352379+0000","last_clean":"2024-08-26T00:00:30.352379+0000","last_became_active":"2024-08-25T23:59:16.227550+0000","last_became_peered":"2024-08-25T23:59:16.227550+0000","last_unstale":"2024-08-26T00:00:30.352379+0000","last_undegraded":"2024-08-26T00:00:30.352379+0000","last_fullsized":"2024-08-26T00:00:30.352379+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-25T23:55:51.247914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-25T23:55:51.247914+0000","last_clean_scrub_stamp":"2024-08-25T23:55:51.247914+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:39:34.184312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:40.407361+0000","last_change":"2024-08-26T00:00:26.992675+0000","last_active":"2024-08-26T00:00:40.407361+0000","last_peered":"2024-08-26T00:00:40.407361+0000","last_clean":"2024-08-26T00:00:40.407361+0000","last_became_active":"2024-08-26T00:00:26.992322+0000","last_became_peered":"2024-08-26T00:00:26.992322+0000","last_unstale":"2024-08-26T00:00:40.407361+0000","last_undegraded":"2024-08-26T00:00:40.407361+0000","last_fullsized":"2024-08-26T00:00:40.407361+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:38:26.016220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350787+0000","last_change":"2024-08-26T00:00:29.362617+0000","last_active":"2024-08-26T00:00:30.350787+0000","last_peered":"2024-08-26T00:00:30.350787+0000","last_clean":"2024-08-26T00:00:30.350787+0000","last_became_active":"2024-08-26T00:00:29.362245+0000","last_became_peered":"2024-08-26T00:00:29.362245+0000","last_unstale":"2024-08-26T00:00:30.350787+0000","last_undegraded":"2024-08-26T00:00:30.350787+0000","last_fullsized":"2024-08-26T00:00:30.350787+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:30:12.309213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:39.404402+0000","last_change":"2024-08-26T00:00:26.990064+0000","last_active":"2024-08-26T00:00:39.404402+0000","last_peered":"2024-08-26T00:00:39.404402+0000","last_clean":"2024-08-26T00:00:39.404402+0000","last_became_active":"2024-08-26T00:00:26.989716+0000","last_became_peered":"2024-08-26T00:00:26.989716+0000","last_unstale":"2024-08-26T00:00:39.404402+0000","last_undegraded":"2024-08-26T00:00:39.404402+0000","last_fullsized":"2024-08-26T00:00:39.404402+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:20:26.713776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341327+0000","last_change":"2024-08-26T00:00:29.366378+0000","last_active":"2024-08-26T00:00:30.341327+0000","last_peered":"2024-08-26T00:00:30.341327+0000","last_clean":"2024-08-26T00:00:30.341327+0000","last_became_active":"2024-08-26T00:00:29.365837+0000","last_became_peered":"2024-08-26T00:00:29.365837+0000","last_unstale":"2024-08-26T00:00:30.341327+0000","last_undegraded":"2024-08-26T00:00:30.341327+0000","last_fullsized":"2024-08-26T00:00:30.341327+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:45:21.667426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:50.423480+0000","last_change":"2024-08-26T00:00:27.077840+0000","last_active":"2024-08-26T00:00:50.423480+0000","last_peered":"2024-08-26T00:00:50.423480+0000","last_clean":"2024-08-26T00:00:50.423480+0000","last_became_active":"2024-08-26T00:00:27.077355+0000","last_became_peered":"2024-08-26T00:00:27.077355+0000","last_unstale":"2024-08-26T00:00:50.423480+0000","last_undegraded":"2024-08-26T00:00:50.423480+0000","last_fullsized":"2024-08-26T00:00:50.423480+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:03:30.718962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351209+0000","last_change":"2024-08-26T00:00:29.357738+0000","last_active":"2024-08-26T00:00:30.351209+0000","last_peered":"2024-08-26T00:00:30.351209+0000","last_clean":"2024-08-26T00:00:30.351209+0000","last_became_active":"2024-08-26T00:00:29.357369+0000","last_became_peered":"2024-08-26T00:00:29.357369+0000","last_unstale":"2024-08-26T00:00:30.351209+0000","last_undegraded":"2024-08-26T00:00:30.351209+0000","last_fullsized":"2024-08-26T00:00:30.351209+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:39:33.924747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351457+0000","last_change":"2024-08-26T00:00:26.994187+0000","last_active":"2024-08-26T00:00:30.351457+0000","last_peered":"2024-08-26T00:00:30.351457+0000","last_clean":"2024-08-26T00:00:30.351457+0000","last_became_active":"2024-08-26T00:00:26.993699+0000","last_became_peered":"2024-08-26T00:00:26.993699+0000","last_unstale":"2024-08-26T00:00:30.351457+0000","last_undegraded":"2024-08-26T00:00:30.351457+0000","last_fullsized":"2024-08-26T00:00:30.351457+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:19:50.412724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350521+0000","last_change":"2024-08-26T00:00:29.364507+0000","last_active":"2024-08-26T00:00:30.350521+0000","last_peered":"2024-08-26T00:00:30.350521+0000","last_clean":"2024-08-26T00:00:30.350521+0000","last_became_active":"2024-08-26T00:00:29.364129+0000","last_became_peered":"2024-08-26T00:00:29.364129+0000","last_unstale":"2024-08-26T00:00:30.350521+0000","last_undegraded":"2024-08-26T00:00:30.350521+0000","last_fullsized":"2024-08-26T00:00:30.350521+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:17:36.837206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.352367+0000","last_change":"2024-08-26T00:00:27.076977+0000","last_active":"2024-08-26T00:00:30.352367+0000","last_peered":"2024-08-26T00:00:30.352367+0000","last_clean":"2024-08-26T00:00:30.352367+0000","last_became_active":"2024-08-26T00:00:27.076524+0000","last_became_peered":"2024-08-26T00:00:27.076524+0000","last_unstale":"2024-08-26T00:00:30.352367+0000","last_undegraded":"2024-08-26T00:00:30.352367+0000","last_fullsized":"2024-08-26T00:00:30.352367+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:22:21.820009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:32.211525+0000","last_change":"2024-08-26T00:00:29.363880+0000","last_active":"2024-08-26T00:00:32.211525+0000","last_peered":"2024-08-26T00:00:32.211525+0000","last_clean":"2024-08-26T00:00:32.211525+0000","last_became_active":"2024-08-26T00:00:29.363475+0000","last_became_peered":"2024-08-26T00:00:29.363475+0000","last_unstale":"2024-08-26T00:00:32.211525+0000","last_undegraded":"2024-08-26T00:00:32.211525+0000","last_fullsized":"2024-08-26T00:00:32.211525+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:30:55.875922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:38.399372+0000","last_change":"2024-08-26T00:00:27.077675+0000","last_active":"2024-08-26T00:00:38.399372+0000","last_peered":"2024-08-26T00:00:38.399372+0000","last_clean":"2024-08-26T00:00:38.399372+0000","last_became_active":"2024-08-26T00:00:27.077060+0000","last_became_peered":"2024-08-26T00:00:27.077060+0000","last_unstale":"2024-08-26T00:00:38.399372+0000","last_undegraded":"2024-08-26T00:00:38.399372+0000","last_fullsized":"2024-08-26T00:00:38.399372+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:17:28.257614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341647+0000","last_change":"2024-08-26T00:00:29.360285+0000","last_active":"2024-08-26T00:00:30.341647+0000","last_peered":"2024-08-26T00:00:30.341647+0000","last_clean":"2024-08-26T00:00:30.341647+0000","last_became_active":"2024-08-26T00:00:29.359879+0000","last_became_peered":"2024-08-26T00:00:29.359879+0000","last_unstale":"2024-08-26T00:00:30.341647+0000","last_undegraded":"2024-08-26T00:00:30.341647+0000","last_fullsized":"2024-08-26T00:00:30.341647+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:49:10.691817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:50.348351+0000","last_change":"2024-08-26T00:00:26.990419+0000","last_active":"2024-08-26T00:00:50.348351+0000","last_peered":"2024-08-26T00:00:50.348351+0000","last_clean":"2024-08-26T00:00:50.348351+0000","last_became_active":"2024-08-26T00:00:26.990052+0000","last_became_peered":"2024-08-26T00:00:26.990052+0000","last_unstale":"2024-08-26T00:00:50.348351+0000","last_undegraded":"2024-08-26T00:00:50.348351+0000","last_fullsized":"2024-08-26T00:00:50.348351+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:27:41.229418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351739+0000","last_change":"2024-08-26T00:00:29.354671+0000","last_active":"2024-08-26T00:00:30.351739+0000","last_peered":"2024-08-26T00:00:30.351739+0000","last_clean":"2024-08-26T00:00:30.351739+0000","last_became_active":"2024-08-26T00:00:29.354071+0000","last_became_peered":"2024-08-26T00:00:29.354071+0000","last_unstale":"2024-08-26T00:00:30.351739+0000","last_undegraded":"2024-08-26T00:00:30.351739+0000","last_fullsized":"2024-08-26T00:00:30.351739+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:50:09.097757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:38.398738+0000","last_change":"2024-08-26T00:00:26.991622+0000","last_active":"2024-08-26T00:00:38.398738+0000","last_peered":"2024-08-26T00:00:38.398738+0000","last_clean":"2024-08-26T00:00:38.398738+0000","last_became_active":"2024-08-26T00:00:26.991244+0000","last_became_peered":"2024-08-26T00:00:26.991244+0000","last_unstale":"2024-08-26T00:00:38.398738+0000","last_undegraded":"2024-08-26T00:00:38.398738+0000","last_fullsized":"2024-08-26T00:00:38.398738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:58:25.676985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350680+0000","last_change":"2024-08-26T00:00:29.367033+0000","last_active":"2024-08-26T00:00:30.350680+0000","last_peered":"2024-08-26T00:00:30.350680+0000","last_clean":"2024-08-26T00:00:30.350680+0000","last_became_active":"2024-08-26T00:00:29.365572+0000","last_became_peered":"2024-08-26T00:00:29.365572+0000","last_unstale":"2024-08-26T00:00:30.350680+0000","last_undegraded":"2024-08-26T00:00:30.350680+0000","last_fullsized":"2024-08-26T00:00:30.350680+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:16:49.116721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:38.399106+0000","last_change":"2024-08-26T00:00:27.076562+0000","last_active":"2024-08-26T00:00:38.399106+0000","last_peered":"2024-08-26T00:00:38.399106+0000","last_clean":"2024-08-26T00:00:38.399106+0000","last_became_active":"2024-08-26T00:00:27.076163+0000","last_became_peered":"2024-08-26T00:00:27.076163+0000","last_unstale":"2024-08-26T00:00:38.399106+0000","last_undegraded":"2024-08-26T00:00:38.399106+0000","last_fullsized":"2024-08-26T00:00:38.399106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:25:03.222457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341350+0000","last_change":"2024-08-26T00:00:29.352787+0000","last_active":"2024-08-26T00:00:30.341350+0000","last_peered":"2024-08-26T00:00:30.341350+0000","last_clean":"2024-08-26T00:00:30.341350+0000","last_became_active":"2024-08-26T00:00:29.352429+0000","last_became_peered":"2024-08-26T00:00:29.352429+0000","last_unstale":"2024-08-26T00:00:30.341350+0000","last_undegraded":"2024-08-26T00:00:30.341350+0000","last_fullsized":"2024-08-26T00:00:30.341350+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:39:45.080372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:38.397964+0000","last_change":"2024-08-26T00:00:26.989778+0000","last_active":"2024-08-26T00:00:38.397964+0000","last_peered":"2024-08-26T00:00:38.397964+0000","last_clean":"2024-08-26T00:00:38.397964+0000","last_became_active":"2024-08-26T00:00:26.989433+0000","last_became_peered":"2024-08-26T00:00:26.989433+0000","last_unstale":"2024-08-26T00:00:38.397964+0000","last_undegraded":"2024-08-26T00:00:38.397964+0000","last_fullsized":"2024-08-26T00:00:38.397964+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:36:16.684252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.356842+0000","last_change":"2024-08-26T00:00:29.362705+0000","last_active":"2024-08-26T00:00:30.356842+0000","last_peered":"2024-08-26T00:00:30.356842+0000","last_clean":"2024-08-26T00:00:30.356842+0000","last_became_active":"2024-08-26T00:00:29.362341+0000","last_became_peered":"2024-08-26T00:00:29.362341+0000","last_unstale":"2024-08-26T00:00:30.356842+0000","last_undegraded":"2024-08-26T00:00:30.356842+0000","last_fullsized":"2024-08-26T00:00:30.356842+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:10:47.051351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350223+0000","last_change":"2024-08-26T00:00:26.994382+0000","last_active":"2024-08-26T00:00:30.350223+0000","last_peered":"2024-08-26T00:00:30.350223+0000","last_clean":"2024-08-26T00:00:30.350223+0000","last_became_active":"2024-08-26T00:00:26.993960+0000","last_became_peered":"2024-08-26T00:00:26.993960+0000","last_unstale":"2024-08-26T00:00:30.350223+0000","last_undegraded":"2024-08-26T00:00:30.350223+0000","last_fullsized":"2024-08-26T00:00:30.350223+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:42:54.234731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351142+0000","last_change":"2024-08-26T00:00:29.365553+0000","last_active":"2024-08-26T00:00:30.351142+0000","last_peered":"2024-08-26T00:00:30.351142+0000","last_clean":"2024-08-26T00:00:30.351142+0000","last_became_active":"2024-08-26T00:00:29.365215+0000","last_became_peered":"2024-08-26T00:00:29.365215+0000","last_unstale":"2024-08-26T00:00:30.351142+0000","last_undegraded":"2024-08-26T00:00:30.351142+0000","last_fullsized":"2024-08-26T00:00:30.351142+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:55:01.505530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:38.399647+0000","last_change":"2024-08-26T00:00:26.995228+0000","last_active":"2024-08-26T00:00:38.399647+0000","last_peered":"2024-08-26T00:00:38.399647+0000","last_clean":"2024-08-26T00:00:38.399647+0000","last_became_active":"2024-08-26T00:00:26.994875+0000","last_became_peered":"2024-08-26T00:00:26.994875+0000","last_unstale":"2024-08-26T00:00:38.399647+0000","last_undegraded":"2024-08-26T00:00:38.399647+0000","last_fullsized":"2024-08-26T00:00:38.399647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:27:21.110162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351042+0000","last_change":"2024-08-26T00:00:29.361598+0000","last_active":"2024-08-26T00:00:30.351042+0000","last_peered":"2024-08-26T00:00:30.351042+0000","last_clean":"2024-08-26T00:00:30.351042+0000","last_became_active":"2024-08-26T00:00:29.361237+0000","last_became_peered":"2024-08-26T00:00:29.361237+0000","last_unstale":"2024-08-26T00:00:30.351042+0000","last_undegraded":"2024-08-26T00:00:30.351042+0000","last_fullsized":"2024-08-26T00:00:30.351042+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:21:30.126060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350907+0000","last_change":"2024-08-26T00:00:29.355240+0000","last_active":"2024-08-26T00:00:30.350907+0000","last_peered":"2024-08-26T00:00:30.350907+0000","last_clean":"2024-08-26T00:00:30.350907+0000","last_became_active":"2024-08-26T00:00:29.354165+0000","last_became_peered":"2024-08-26T00:00:29.354165+0000","last_unstale":"2024-08-26T00:00:30.350907+0000","last_undegraded":"2024-08-26T00:00:30.350907+0000","last_fullsized":"2024-08-26T00:00:30.350907+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:07:56.573032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.349650+0000","last_change":"2024-08-26T00:00:26.992240+0000","last_active":"2024-08-26T00:00:30.349650+0000","last_peered":"2024-08-26T00:00:30.349650+0000","last_clean":"2024-08-26T00:00:30.349650+0000","last_became_active":"2024-08-26T00:00:26.991866+0000","last_became_peered":"2024-08-26T00:00:26.991866+0000","last_unstale":"2024-08-26T00:00:30.349650+0000","last_undegraded":"2024-08-26T00:00:30.349650+0000","last_fullsized":"2024-08-26T00:00:30.349650+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:25:50.815151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341876+0000","last_change":"2024-08-26T00:00:29.370358+0000","last_active":"2024-08-26T00:00:30.341876+0000","last_peered":"2024-08-26T00:00:30.341876+0000","last_clean":"2024-08-26T00:00:30.341876+0000","last_became_active":"2024-08-26T00:00:29.369910+0000","last_became_peered":"2024-08-26T00:00:29.369910+0000","last_unstale":"2024-08-26T00:00:30.341876+0000","last_undegraded":"2024-08-26T00:00:30.341876+0000","last_fullsized":"2024-08-26T00:00:30.341876+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:49:11.351575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:39.405856+0000","last_change":"2024-08-26T00:00:26.989759+0000","last_active":"2024-08-26T00:00:39.405856+0000","last_peered":"2024-08-26T00:00:39.405856+0000","last_clean":"2024-08-26T00:00:39.405856+0000","last_became_active":"2024-08-26T00:00:26.989376+0000","last_became_peered":"2024-08-26T00:00:26.989376+0000","last_unstale":"2024-08-26T00:00:39.405856+0000","last_undegraded":"2024-08-26T00:00:39.405856+0000","last_fullsized":"2024-08-26T00:00:39.405856+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:44:36.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350714+0000","last_change":"2024-08-26T00:00:29.367050+0000","last_active":"2024-08-26T00:00:30.350714+0000","last_peered":"2024-08-26T00:00:30.350714+0000","last_clean":"2024-08-26T00:00:30.350714+0000","last_became_active":"2024-08-26T00:00:29.366737+0000","last_became_peered":"2024-08-26T00:00:29.366737+0000","last_unstale":"2024-08-26T00:00:30.350714+0000","last_undegraded":"2024-08-26T00:00:30.350714+0000","last_fullsized":"2024-08-26T00:00:30.350714+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:00:54.461716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.356109+0000","last_change":"2024-08-26T00:00:27.078078+0000","last_active":"2024-08-26T00:00:30.356109+0000","last_peered":"2024-08-26T00:00:30.356109+0000","last_clean":"2024-08-26T00:00:30.356109+0000","last_became_active":"2024-08-26T00:00:27.077036+0000","last_became_peered":"2024-08-26T00:00:27.077036+0000","last_unstale":"2024-08-26T00:00:30.356109+0000","last_undegraded":"2024-08-26T00:00:30.356109+0000","last_fullsized":"2024-08-26T00:00:30.356109+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:47:44.674548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351327+0000","last_change":"2024-08-26T00:00:29.363867+0000","last_active":"2024-08-26T00:00:30.351327+0000","last_peered":"2024-08-26T00:00:30.351327+0000","last_clean":"2024-08-26T00:00:30.351327+0000","last_became_active":"2024-08-26T00:00:29.363556+0000","last_became_peered":"2024-08-26T00:00:29.363556+0000","last_unstale":"2024-08-26T00:00:30.351327+0000","last_undegraded":"2024-08-26T00:00:30.351327+0000","last_fullsized":"2024-08-26T00:00:30.351327+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:50:04.009177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:39.408272+0000","last_change":"2024-08-26T00:00:26.990557+0000","last_active":"2024-08-26T00:00:39.408272+0000","last_peered":"2024-08-26T00:00:39.408272+0000","last_clean":"2024-08-26T00:00:39.408272+0000","last_became_active":"2024-08-26T00:00:26.989945+0000","last_became_peered":"2024-08-26T00:00:26.989945+0000","last_unstale":"2024-08-26T00:00:39.408272+0000","last_undegraded":"2024-08-26T00:00:39.408272+0000","last_fullsized":"2024-08-26T00:00:39.408272+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:26:54.388359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":45060,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":149,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":372736,"data_stored":148489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645330,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":409224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874261,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36832,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708320,"statfs":{"total":95995035648,"available":95957319680,"internally_reserved":0,"allocated":1523712,"data_stored":1042155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037787,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":864256,"data_stored":409460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266722,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":864256,"data_stored":409380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495653,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40928,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704224,"statfs":{"total":95995035648,"available":95953125376,"internally_reserved":0,"allocated":1458176,"data_stored":1001308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626474,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":851968,"data_stored":408849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855408,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28460,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716692,"statfs":{"total":95995035648,"available":95965892608,"internally_reserved":0,"allocated":1470464,"data_stored":1000603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018932,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":856064,"data_stored":409675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247866,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":409160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444096,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":933888,"data_stored":464362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40376,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704776,"statfs":{"total":95995035648,"available":95953690624,"internally_reserved":0,"allocated":892928,"data_stored":449703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":410120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":41061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":55720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":43028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-26T00:00:58.671 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph pg dump --format=json 2024-08-26T00:00:58.720 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:58 smithi042 ceph-mon[17225]: from='client.24647 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-26T00:00:58.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:58 smithi043 ceph-mon[22091]: from='client.24647 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-26T00:00:58.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:58 smithi181 ceph-mon[22102]: from='client.24647 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-26T00:00:59.049 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:00:59.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.562+0000 7f3c8da00640 1 -- 172.21.15.42:0/724865333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c88104330 msgr2=0x7f3c88110970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:59.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.562+0000 7f3c8da00640 1 --2- 172.21.15.42:0/724865333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c88104330 0x7f3c88110970 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3c80009cd0 tx=0x7f3c8002a8e0 comp rx=0 tx=0).stop 2024-08-26T00:00:59.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.562+0000 7f3c8da00640 1 -- 172.21.15.42:0/724865333 shutdown_connections 2024-08-26T00:00:59.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.562+0000 7f3c8da00640 1 --2- 172.21.15.42:0/724865333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c88104330 0x7f3c88110970 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:59.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.562+0000 7f3c8da00640 1 --2- 172.21.15.42:0/724865333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c88103990 0x7f3c88103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:59.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.562+0000 7f3c8da00640 1 --2- 172.21.15.42:0/724865333 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c88109aa0 0x7f3c88109e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:59.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.562+0000 7f3c8da00640 1 -- 172.21.15.42:0/724865333 >> 172.21.15.42:0/724865333 conn(0x7f3c880ff650 msgr2=0x7f3c88101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:59.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.562+0000 7f3c8da00640 1 -- 172.21.15.42:0/724865333 shutdown_connections 2024-08-26T00:00:59.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.562+0000 7f3c8da00640 1 -- 172.21.15.42:0/724865333 wait complete. 2024-08-26T00:00:59.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.563+0000 7f3c8da00640 1 Processor -- start 2024-08-26T00:00:59.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.563+0000 7f3c8da00640 1 -- start start 2024-08-26T00:00:59.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.564+0000 7f3c8da00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c88103990 0x7f3c8819a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:59.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.564+0000 7f3c8da00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c88104330 0x7f3c8819a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:59.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.564+0000 7f3c8da00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c88109aa0 0x7f3c8819ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:59.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.564+0000 7f3c8da00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3c88113ea0 con 0x7f3c88104330 2024-08-26T00:00:59.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.564+0000 7f3c8da00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3c88113d20 con 0x7f3c88103990 2024-08-26T00:00:59.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.564+0000 7f3c8da00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3c88114020 con 0x7f3c88109aa0 2024-08-26T00:00:59.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.564+0000 7f3c7f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c88104330 0x7f3c8819a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:59.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.564+0000 7f3c87e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c88103990 0x7f3c8819a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:59.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.564+0000 7f3c7f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c88104330 0x7f3c8819a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58408/0 (socket says 172.21.15.42:58408) 2024-08-26T00:00:59.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.564+0000 7f3c7f400640 1 -- 172.21.15.42:0/1575973257 learned_addr learned my addr 172.21.15.42:0/1575973257 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:00:59.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.564+0000 7f3c8d000640 1 --2- 172.21.15.42:0/1575973257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c88109aa0 0x7f3c8819ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:59.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.564+0000 7f3c87e00640 1 -- 172.21.15.42:0/1575973257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c88109aa0 msgr2=0x7f3c8819ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:59.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.564+0000 7f3c87e00640 1 --2- 172.21.15.42:0/1575973257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c88109aa0 0x7f3c8819ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:59.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.564+0000 7f3c87e00640 1 -- 172.21.15.42:0/1575973257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c88104330 msgr2=0x7f3c8819a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:59.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.564+0000 7f3c87e00640 1 --2- 172.21.15.42:0/1575973257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c88104330 0x7f3c8819a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:59.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.564+0000 7f3c87e00640 1 -- 172.21.15.42:0/1575973257 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c8819f300 con 0x7f3c88103990 2024-08-26T00:00:59.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.565+0000 7f3c7f400640 1 --2- 172.21.15.42:0/1575973257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c88104330 0x7f3c8819a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:00:59.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.565+0000 7f3c87e00640 1 --2- 172.21.15.42:0/1575973257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c88103990 0x7f3c8819a350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3c7800d720 tx=0x7f3c7800dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:59.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.565+0000 7f3c85600640 1 -- 172.21.15.42:0/1575973257 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c78017070 con 0x7f3c88103990 2024-08-26T00:00:59.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.565+0000 7f3c8da00640 1 -- 172.21.15.42:0/1575973257 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c8819f5f0 con 0x7f3c88103990 2024-08-26T00:00:59.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.565+0000 7f3c85600640 1 -- 172.21.15.42:0/1575973257 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c7800de30 con 0x7f3c88103990 2024-08-26T00:00:59.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.565+0000 7f3c85600640 1 -- 172.21.15.42:0/1575973257 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c78005020 con 0x7f3c88103990 2024-08-26T00:00:59.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.565+0000 7f3c8da00640 1 -- 172.21.15.42:0/1575973257 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c881a6ed0 con 0x7f3c88103990 2024-08-26T00:00:59.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.566+0000 7f3c8da00640 1 -- 172.21.15.42:0/1575973257 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c88103df0 con 0x7f3c88103990 2024-08-26T00:00:59.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.568+0000 7f3c85600640 1 -- 172.21.15.42:0/1575973257 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3c780099d0 con 0x7f3c88103990 2024-08-26T00:00:59.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.569+0000 7f3c85600640 1 --2- 172.21.15.42:0/1575973257 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3c6c0a2c90 0x7f3c6c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:00:59.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.569+0000 7f3c85600640 1 -- 172.21.15.42:0/1575973257 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f3c780cecb0 con 0x7f3c88103990 2024-08-26T00:00:59.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.570+0000 7f3c7f400640 1 --2- 172.21.15.42:0/1575973257 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3c6c0a2c90 0x7f3c6c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:00:59.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.570+0000 7f3c7f400640 1 --2- 172.21.15.42:0/1575973257 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3c6c0a2c90 0x7f3c6c0a5150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3c88101c60 tx=0x7f3c7000b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:00:59.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.574+0000 7f3c85600640 1 -- 172.21.15.42:0/1575973257 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f3c78020020 con 0x7f3c88103990 2024-08-26T00:00:59.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.756+0000 7f3c8da00640 1 -- 172.21.15.42:0/1575973257 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3c88105190 con 0x7f3c6c0a2c90 2024-08-26T00:00:59.758 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:00:59 smithi042 ceph-mon[17225]: pgmap v291: 97 pgs: 97 active+clean; 634 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.3 KiB/s wr, 10 op/s 2024-08-26T00:00:59.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:00:59 smithi043 ceph-mon[22091]: pgmap v291: 97 pgs: 97 active+clean; 634 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.3 KiB/s wr, 10 op/s 2024-08-26T00:00:59.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.764+0000 7f3c85600640 1 -- 172.21.15.42:0/1575973257 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258703 (secure 0 0 0) 0x7f3c88105190 con 0x7f3c6c0a2c90 2024-08-26T00:00:59.769 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:00:59.770 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-08-26T00:00:59.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.768+0000 7f3c8da00640 1 -- 172.21.15.42:0/1575973257 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3c6c0a2c90 msgr2=0x7f3c6c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:59.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.768+0000 7f3c8da00640 1 --2- 172.21.15.42:0/1575973257 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3c6c0a2c90 0x7f3c6c0a5150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3c88101c60 tx=0x7f3c7000b4a0 comp rx=0 tx=0).stop 2024-08-26T00:00:59.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.768+0000 7f3c8da00640 1 -- 172.21.15.42:0/1575973257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c88103990 msgr2=0x7f3c8819a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:00:59.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.768+0000 7f3c8da00640 1 --2- 172.21.15.42:0/1575973257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c88103990 0x7f3c8819a350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3c7800d720 tx=0x7f3c7800dbe0 comp rx=0 tx=0).stop 2024-08-26T00:00:59.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.768+0000 7f3c8da00640 1 -- 172.21.15.42:0/1575973257 shutdown_connections 2024-08-26T00:00:59.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.769+0000 7f3c8da00640 1 --2- 172.21.15.42:0/1575973257 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3c6c0a2c90 0x7f3c6c0a5150 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:59.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.769+0000 7f3c8da00640 1 --2- 172.21.15.42:0/1575973257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c88109aa0 0x7f3c8819ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:59.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.769+0000 7f3c8da00640 1 --2- 172.21.15.42:0/1575973257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c88104330 0x7f3c8819a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:59.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.769+0000 7f3c8da00640 1 --2- 172.21.15.42:0/1575973257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c88103990 0x7f3c8819a350 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:00:59.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.769+0000 7f3c8da00640 1 -- 172.21.15.42:0/1575973257 >> 172.21.15.42:0/1575973257 conn(0x7f3c880ff650 msgr2=0x7f3c880ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:00:59.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.769+0000 7f3c8da00640 1 -- 172.21.15.42:0/1575973257 shutdown_connections 2024-08-26T00:00:59.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:00:59.769+0000 7f3c8da00640 1 -- 172.21.15.42:0/1575973257 wait complete. 2024-08-26T00:00:59.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:00:59 smithi181 ceph-mon[22102]: pgmap v291: 97 pgs: 97 active+clean; 634 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.3 KiB/s wr, 10 op/s 2024-08-26T00:01:00.677 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2024-08-26T00:00:58.497276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":648971,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":254,"num_read_kb":234,"num_write":342,"num_write_kb":3041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274,"ondisk_log_size":274,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":394576,"kb_used_data":12048,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124547248,"statfs":{"total":1151940427776,"available":1151536381952,"internally_reserved":0,"allocated":12337152,"data_stored":6850617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19137,"internal_metadata":391492927},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":52992,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":90,"num_read_kb":98,"num_write":35,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003153"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.357329+0000","last_change":"2024-08-26T00:00:29.365654+0000","last_active":"2024-08-26T00:00:30.357329+0000","last_peered":"2024-08-26T00:00:30.357329+0000","last_clean":"2024-08-26T00:00:30.357329+0000","last_became_active":"2024-08-26T00:00:29.364609+0000","last_became_peered":"2024-08-26T00:00:29.364609+0000","last_unstale":"2024-08-26T00:00:30.357329+0000","last_undegraded":"2024-08-26T00:00:30.357329+0000","last_fullsized":"2024-08-26T00:00:30.357329+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:54:39.886248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350513+0000","last_change":"2024-08-26T00:00:29.367657+0000","last_active":"2024-08-26T00:00:30.350513+0000","last_peered":"2024-08-26T00:00:30.350513+0000","last_clean":"2024-08-26T00:00:30.350513+0000","last_became_active":"2024-08-26T00:00:29.367376+0000","last_became_peered":"2024-08-26T00:00:29.367376+0000","last_unstale":"2024-08-26T00:00:30.350513+0000","last_undegraded":"2024-08-26T00:00:30.350513+0000","last_fullsized":"2024-08-26T00:00:30.350513+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:16:13.414883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350833+0000","last_change":"2024-08-26T00:00:29.369219+0000","last_active":"2024-08-26T00:00:30.350833+0000","last_peered":"2024-08-26T00:00:30.350833+0000","last_clean":"2024-08-26T00:00:30.350833+0000","last_became_active":"2024-08-26T00:00:29.368902+0000","last_became_peered":"2024-08-26T00:00:29.368902+0000","last_unstale":"2024-08-26T00:00:30.350833+0000","last_undegraded":"2024-08-26T00:00:30.350833+0000","last_fullsized":"2024-08-26T00:00:30.350833+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:53:28.636658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.349890+0000","last_change":"2024-08-26T00:00:29.359501+0000","last_active":"2024-08-26T00:00:30.349890+0000","last_peered":"2024-08-26T00:00:30.349890+0000","last_clean":"2024-08-26T00:00:30.349890+0000","last_became_active":"2024-08-26T00:00:29.358778+0000","last_became_peered":"2024-08-26T00:00:29.358778+0000","last_unstale":"2024-08-26T00:00:30.349890+0000","last_undegraded":"2024-08-26T00:00:30.349890+0000","last_fullsized":"2024-08-26T00:00:30.349890+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:20:40.200105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341534+0000","last_change":"2024-08-26T00:00:29.358387+0000","last_active":"2024-08-26T00:00:30.341534+0000","last_peered":"2024-08-26T00:00:30.341534+0000","last_clean":"2024-08-26T00:00:30.341534+0000","last_became_active":"2024-08-26T00:00:29.357839+0000","last_became_peered":"2024-08-26T00:00:29.357839+0000","last_unstale":"2024-08-26T00:00:30.341534+0000","last_undegraded":"2024-08-26T00:00:30.341534+0000","last_fullsized":"2024-08-26T00:00:30.341534+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:05:21.065258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.349598+0000","last_change":"2024-08-26T00:00:29.354429+0000","last_active":"2024-08-26T00:00:30.349598+0000","last_peered":"2024-08-26T00:00:30.349598+0000","last_clean":"2024-08-26T00:00:30.349598+0000","last_became_active":"2024-08-26T00:00:29.354108+0000","last_became_peered":"2024-08-26T00:00:29.354108+0000","last_unstale":"2024-08-26T00:00:30.349598+0000","last_undegraded":"2024-08-26T00:00:30.349598+0000","last_fullsized":"2024-08-26T00:00:30.349598+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:58:07.912980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350294+0000","last_change":"2024-08-26T00:00:29.360127+0000","last_active":"2024-08-26T00:00:30.350294+0000","last_peered":"2024-08-26T00:00:30.350294+0000","last_clean":"2024-08-26T00:00:30.350294+0000","last_became_active":"2024-08-26T00:00:29.359730+0000","last_became_peered":"2024-08-26T00:00:29.359730+0000","last_unstale":"2024-08-26T00:00:30.350294+0000","last_undegraded":"2024-08-26T00:00:30.350294+0000","last_fullsized":"2024-08-26T00:00:30.350294+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:38:16.377861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.349797+0000","last_change":"2024-08-26T00:00:29.362117+0000","last_active":"2024-08-26T00:00:30.349797+0000","last_peered":"2024-08-26T00:00:30.349797+0000","last_clean":"2024-08-26T00:00:30.349797+0000","last_became_active":"2024-08-26T00:00:29.361738+0000","last_became_peered":"2024-08-26T00:00:29.361738+0000","last_unstale":"2024-08-26T00:00:30.349797+0000","last_undegraded":"2024-08-26T00:00:30.349797+0000","last_fullsized":"2024-08-26T00:00:30.349797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:38:15.468364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.342037+0000","last_change":"2024-08-26T00:00:29.363693+0000","last_active":"2024-08-26T00:00:30.342037+0000","last_peered":"2024-08-26T00:00:30.342037+0000","last_clean":"2024-08-26T00:00:30.342037+0000","last_became_active":"2024-08-26T00:00:29.363356+0000","last_became_peered":"2024-08-26T00:00:29.363356+0000","last_unstale":"2024-08-26T00:00:30.342037+0000","last_undegraded":"2024-08-26T00:00:30.342037+0000","last_fullsized":"2024-08-26T00:00:30.342037+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:18:46.180255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350350+0000","last_change":"2024-08-26T00:00:29.363401+0000","last_active":"2024-08-26T00:00:30.350350+0000","last_peered":"2024-08-26T00:00:30.350350+0000","last_clean":"2024-08-26T00:00:30.350350+0000","last_became_active":"2024-08-26T00:00:29.363045+0000","last_became_peered":"2024-08-26T00:00:29.363045+0000","last_unstale":"2024-08-26T00:00:30.350350+0000","last_undegraded":"2024-08-26T00:00:30.350350+0000","last_fullsized":"2024-08-26T00:00:30.350350+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:18:24.931121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351680+0000","last_change":"2024-08-26T00:00:29.356440+0000","last_active":"2024-08-26T00:00:30.351680+0000","last_peered":"2024-08-26T00:00:30.351680+0000","last_clean":"2024-08-26T00:00:30.351680+0000","last_became_active":"2024-08-26T00:00:29.355498+0000","last_became_peered":"2024-08-26T00:00:29.355498+0000","last_unstale":"2024-08-26T00:00:30.351680+0000","last_undegraded":"2024-08-26T00:00:30.351680+0000","last_fullsized":"2024-08-26T00:00:30.351680+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:27:31.363962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350049+0000","last_change":"2024-08-26T00:00:29.359185+0000","last_active":"2024-08-26T00:00:30.350049+0000","last_peered":"2024-08-26T00:00:30.350049+0000","last_clean":"2024-08-26T00:00:30.350049+0000","last_became_active":"2024-08-26T00:00:29.358670+0000","last_became_peered":"2024-08-26T00:00:29.358670+0000","last_unstale":"2024-08-26T00:00:30.350049+0000","last_undegraded":"2024-08-26T00:00:30.350049+0000","last_fullsized":"2024-08-26T00:00:30.350049+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:15:31.327823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341654+0000","last_change":"2024-08-26T00:00:29.361477+0000","last_active":"2024-08-26T00:00:30.341654+0000","last_peered":"2024-08-26T00:00:30.341654+0000","last_clean":"2024-08-26T00:00:30.341654+0000","last_became_active":"2024-08-26T00:00:29.360870+0000","last_became_peered":"2024-08-26T00:00:29.360870+0000","last_unstale":"2024-08-26T00:00:30.341654+0000","last_undegraded":"2024-08-26T00:00:30.341654+0000","last_fullsized":"2024-08-26T00:00:30.341654+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:37:01.434606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350329+0000","last_change":"2024-08-26T00:00:29.362301+0000","last_active":"2024-08-26T00:00:30.350329+0000","last_peered":"2024-08-26T00:00:30.350329+0000","last_clean":"2024-08-26T00:00:30.350329+0000","last_became_active":"2024-08-26T00:00:29.359613+0000","last_became_peered":"2024-08-26T00:00:29.359613+0000","last_unstale":"2024-08-26T00:00:30.350329+0000","last_undegraded":"2024-08-26T00:00:30.350329+0000","last_fullsized":"2024-08-26T00:00:30.350329+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:24:09.515352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.349760+0000","last_change":"2024-08-26T00:00:29.365553+0000","last_active":"2024-08-26T00:00:30.349760+0000","last_peered":"2024-08-26T00:00:30.349760+0000","last_clean":"2024-08-26T00:00:30.349760+0000","last_became_active":"2024-08-26T00:00:29.363344+0000","last_became_peered":"2024-08-26T00:00:29.363344+0000","last_unstale":"2024-08-26T00:00:30.349760+0000","last_undegraded":"2024-08-26T00:00:30.349760+0000","last_fullsized":"2024-08-26T00:00:30.349760+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:27:43.172749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341468+0000","last_change":"2024-08-26T00:00:29.362061+0000","last_active":"2024-08-26T00:00:30.341468+0000","last_peered":"2024-08-26T00:00:30.341468+0000","last_clean":"2024-08-26T00:00:30.341468+0000","last_became_active":"2024-08-26T00:00:29.361712+0000","last_became_peered":"2024-08-26T00:00:29.361712+0000","last_unstale":"2024-08-26T00:00:30.341468+0000","last_undegraded":"2024-08-26T00:00:30.341468+0000","last_fullsized":"2024-08-26T00:00:30.341468+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:20:14.944167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.357329+0000","last_change":"2024-08-26T00:00:29.365160+0000","last_active":"2024-08-26T00:00:30.357329+0000","last_peered":"2024-08-26T00:00:30.357329+0000","last_clean":"2024-08-26T00:00:30.357329+0000","last_became_active":"2024-08-26T00:00:29.364541+0000","last_became_peered":"2024-08-26T00:00:29.364541+0000","last_unstale":"2024-08-26T00:00:30.357329+0000","last_undegraded":"2024-08-26T00:00:30.357329+0000","last_fullsized":"2024-08-26T00:00:30.357329+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:59:54.417495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.352593+0000","last_change":"2024-08-26T00:00:29.361264+0000","last_active":"2024-08-26T00:00:30.352593+0000","last_peered":"2024-08-26T00:00:30.352593+0000","last_clean":"2024-08-26T00:00:30.352593+0000","last_became_active":"2024-08-26T00:00:29.358501+0000","last_became_peered":"2024-08-26T00:00:29.358501+0000","last_unstale":"2024-08-26T00:00:30.352593+0000","last_undegraded":"2024-08-26T00:00:30.352593+0000","last_fullsized":"2024-08-26T00:00:30.352593+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:04:44.930112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351562+0000","last_change":"2024-08-26T00:00:29.365428+0000","last_active":"2024-08-26T00:00:30.351562+0000","last_peered":"2024-08-26T00:00:30.351562+0000","last_clean":"2024-08-26T00:00:30.351562+0000","last_became_active":"2024-08-26T00:00:29.365138+0000","last_became_peered":"2024-08-26T00:00:29.365138+0000","last_unstale":"2024-08-26T00:00:30.351562+0000","last_undegraded":"2024-08-26T00:00:30.351562+0000","last_fullsized":"2024-08-26T00:00:30.351562+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:05:52.276062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.357030+0000","last_change":"2024-08-26T00:00:29.363072+0000","last_active":"2024-08-26T00:00:30.357030+0000","last_peered":"2024-08-26T00:00:30.357030+0000","last_clean":"2024-08-26T00:00:30.357030+0000","last_became_active":"2024-08-26T00:00:29.362751+0000","last_became_peered":"2024-08-26T00:00:29.362751+0000","last_unstale":"2024-08-26T00:00:30.357030+0000","last_undegraded":"2024-08-26T00:00:30.357030+0000","last_fullsized":"2024-08-26T00:00:30.357030+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:49:14.455371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341806+0000","last_change":"2024-08-26T00:00:29.367489+0000","last_active":"2024-08-26T00:00:30.341806+0000","last_peered":"2024-08-26T00:00:30.341806+0000","last_clean":"2024-08-26T00:00:30.341806+0000","last_became_active":"2024-08-26T00:00:29.367183+0000","last_became_peered":"2024-08-26T00:00:29.367183+0000","last_unstale":"2024-08-26T00:00:30.341806+0000","last_undegraded":"2024-08-26T00:00:30.341806+0000","last_fullsized":"2024-08-26T00:00:30.341806+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:05:53.736139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341803+0000","last_change":"2024-08-26T00:00:29.356751+0000","last_active":"2024-08-26T00:00:30.341803+0000","last_peered":"2024-08-26T00:00:30.341803+0000","last_clean":"2024-08-26T00:00:30.341803+0000","last_became_active":"2024-08-26T00:00:29.356291+0000","last_became_peered":"2024-08-26T00:00:29.356291+0000","last_unstale":"2024-08-26T00:00:30.341803+0000","last_undegraded":"2024-08-26T00:00:30.341803+0000","last_fullsized":"2024-08-26T00:00:30.341803+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:32:50.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350251+0000","last_change":"2024-08-26T00:00:29.356965+0000","last_active":"2024-08-26T00:00:30.350251+0000","last_peered":"2024-08-26T00:00:30.350251+0000","last_clean":"2024-08-26T00:00:30.350251+0000","last_became_active":"2024-08-26T00:00:29.356588+0000","last_became_peered":"2024-08-26T00:00:29.356588+0000","last_unstale":"2024-08-26T00:00:30.350251+0000","last_undegraded":"2024-08-26T00:00:30.350251+0000","last_fullsized":"2024-08-26T00:00:30.350251+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:02:25.833139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351032+0000","last_change":"2024-08-26T00:00:29.352304+0000","last_active":"2024-08-26T00:00:30.351032+0000","last_peered":"2024-08-26T00:00:30.351032+0000","last_clean":"2024-08-26T00:00:30.351032+0000","last_became_active":"2024-08-26T00:00:29.351981+0000","last_became_peered":"2024-08-26T00:00:29.351981+0000","last_unstale":"2024-08-26T00:00:30.351032+0000","last_undegraded":"2024-08-26T00:00:30.351032+0000","last_fullsized":"2024-08-26T00:00:30.351032+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:06:29.105905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351596+0000","last_change":"2024-08-26T00:00:29.354424+0000","last_active":"2024-08-26T00:00:30.351596+0000","last_peered":"2024-08-26T00:00:30.351596+0000","last_clean":"2024-08-26T00:00:30.351596+0000","last_became_active":"2024-08-26T00:00:29.352687+0000","last_became_peered":"2024-08-26T00:00:29.352687+0000","last_unstale":"2024-08-26T00:00:30.351596+0000","last_undegraded":"2024-08-26T00:00:30.351596+0000","last_fullsized":"2024-08-26T00:00:30.351596+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:26:21.769928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.352002+0000","last_change":"2024-08-26T00:00:29.355680+0000","last_active":"2024-08-26T00:00:30.352002+0000","last_peered":"2024-08-26T00:00:30.352002+0000","last_clean":"2024-08-26T00:00:30.352002+0000","last_became_active":"2024-08-26T00:00:29.355335+0000","last_became_peered":"2024-08-26T00:00:29.355335+0000","last_unstale":"2024-08-26T00:00:30.352002+0000","last_undegraded":"2024-08-26T00:00:30.352002+0000","last_fullsized":"2024-08-26T00:00:30.352002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:16:04.085892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.357068+0000","last_change":"2024-08-26T00:00:29.357564+0000","last_active":"2024-08-26T00:00:30.357068+0000","last_peered":"2024-08-26T00:00:30.357068+0000","last_clean":"2024-08-26T00:00:30.357068+0000","last_became_active":"2024-08-26T00:00:29.357215+0000","last_became_peered":"2024-08-26T00:00:29.357215+0000","last_unstale":"2024-08-26T00:00:30.357068+0000","last_undegraded":"2024-08-26T00:00:30.357068+0000","last_fullsized":"2024-08-26T00:00:30.357068+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:47:32.969629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341580+0000","last_change":"2024-08-26T00:00:29.368272+0000","last_active":"2024-08-26T00:00:30.341580+0000","last_peered":"2024-08-26T00:00:30.341580+0000","last_clean":"2024-08-26T00:00:30.341580+0000","last_became_active":"2024-08-26T00:00:29.367920+0000","last_became_peered":"2024-08-26T00:00:29.367920+0000","last_unstale":"2024-08-26T00:00:30.341580+0000","last_undegraded":"2024-08-26T00:00:30.341580+0000","last_fullsized":"2024-08-26T00:00:30.341580+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:35:19.373782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.349952+0000","last_change":"2024-08-26T00:00:29.371609+0000","last_active":"2024-08-26T00:00:30.349952+0000","last_peered":"2024-08-26T00:00:30.349952+0000","last_clean":"2024-08-26T00:00:30.349952+0000","last_became_active":"2024-08-26T00:00:29.371199+0000","last_became_peered":"2024-08-26T00:00:29.371199+0000","last_unstale":"2024-08-26T00:00:30.349952+0000","last_undegraded":"2024-08-26T00:00:30.349952+0000","last_fullsized":"2024-08-26T00:00:30.349952+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:03:43.542718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350025+0000","last_change":"2024-08-26T00:00:29.362222+0000","last_active":"2024-08-26T00:00:30.350025+0000","last_peered":"2024-08-26T00:00:30.350025+0000","last_clean":"2024-08-26T00:00:30.350025+0000","last_became_active":"2024-08-26T00:00:29.361767+0000","last_became_peered":"2024-08-26T00:00:29.361767+0000","last_unstale":"2024-08-26T00:00:30.350025+0000","last_undegraded":"2024-08-26T00:00:30.350025+0000","last_fullsized":"2024-08-26T00:00:30.350025+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:42:17.032034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.349832+0000","last_change":"2024-08-26T00:00:29.357997+0000","last_active":"2024-08-26T00:00:30.349832+0000","last_peered":"2024-08-26T00:00:30.349832+0000","last_clean":"2024-08-26T00:00:30.349832+0000","last_became_active":"2024-08-26T00:00:29.357693+0000","last_became_peered":"2024-08-26T00:00:29.357693+0000","last_unstale":"2024-08-26T00:00:30.349832+0000","last_undegraded":"2024-08-26T00:00:30.349832+0000","last_fullsized":"2024-08-26T00:00:30.349832+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:02:49.074234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.356663+0000","last_change":"2024-08-26T00:00:29.358305+0000","last_active":"2024-08-26T00:00:30.356663+0000","last_peered":"2024-08-26T00:00:30.356663+0000","last_clean":"2024-08-26T00:00:30.356663+0000","last_became_active":"2024-08-26T00:00:29.357928+0000","last_became_peered":"2024-08-26T00:00:29.357928+0000","last_unstale":"2024-08-26T00:00:30.356663+0000","last_undegraded":"2024-08-26T00:00:30.356663+0000","last_fullsized":"2024-08-26T00:00:30.356663+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:34:47.609170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341964+0000","last_change":"2024-08-26T00:00:29.357931+0000","last_active":"2024-08-26T00:00:30.341964+0000","last_peered":"2024-08-26T00:00:30.341964+0000","last_clean":"2024-08-26T00:00:30.341964+0000","last_became_active":"2024-08-26T00:00:29.357408+0000","last_became_peered":"2024-08-26T00:00:29.357408+0000","last_unstale":"2024-08-26T00:00:30.341964+0000","last_undegraded":"2024-08-26T00:00:30.341964+0000","last_fullsized":"2024-08-26T00:00:30.341964+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:21:10.230267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'5","reported_seq":43,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:56.431948+0000","last_change":"2024-08-26T00:00:26.993942+0000","last_active":"2024-08-26T00:00:56.431948+0000","last_peered":"2024-08-26T00:00:56.431948+0000","last_clean":"2024-08-26T00:00:56.431948+0000","last_became_active":"2024-08-26T00:00:26.993136+0000","last_became_peered":"2024-08-26T00:00:26.993136+0000","last_unstale":"2024-08-26T00:00:56.431948+0000","last_undegraded":"2024-08-26T00:00:56.431948+0000","last_fullsized":"2024-08-26T00:00:56.431948+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:30:31.890643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350430+0000","last_change":"2024-08-26T00:00:29.351174+0000","last_active":"2024-08-26T00:00:30.350430+0000","last_peered":"2024-08-26T00:00:30.350430+0000","last_clean":"2024-08-26T00:00:30.350430+0000","last_became_active":"2024-08-26T00:00:29.350758+0000","last_became_peered":"2024-08-26T00:00:29.350758+0000","last_unstale":"2024-08-26T00:00:30.350430+0000","last_undegraded":"2024-08-26T00:00:30.350430+0000","last_fullsized":"2024-08-26T00:00:30.350430+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:02:56.986251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:39.405501+0000","last_change":"2024-08-26T00:00:26.991547+0000","last_active":"2024-08-26T00:00:39.405501+0000","last_peered":"2024-08-26T00:00:39.405501+0000","last_clean":"2024-08-26T00:00:39.405501+0000","last_became_active":"2024-08-26T00:00:26.991120+0000","last_became_peered":"2024-08-26T00:00:26.991120+0000","last_unstale":"2024-08-26T00:00:39.405501+0000","last_undegraded":"2024-08-26T00:00:39.405501+0000","last_fullsized":"2024-08-26T00:00:39.405501+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:42:12.381882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:39.406465+0000","last_change":"2024-08-26T00:00:26.988477+0000","last_active":"2024-08-26T00:00:39.406465+0000","last_peered":"2024-08-26T00:00:39.406465+0000","last_clean":"2024-08-26T00:00:39.406465+0000","last_became_active":"2024-08-26T00:00:26.988180+0000","last_became_peered":"2024-08-26T00:00:26.988180+0000","last_unstale":"2024-08-26T00:00:39.406465+0000","last_undegraded":"2024-08-26T00:00:39.406465+0000","last_fullsized":"2024-08-26T00:00:39.406465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:00:35.586628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350023+0000","last_change":"2024-08-26T00:00:29.360687+0000","last_active":"2024-08-26T00:00:30.350023+0000","last_peered":"2024-08-26T00:00:30.350023+0000","last_clean":"2024-08-26T00:00:30.350023+0000","last_became_active":"2024-08-26T00:00:29.358427+0000","last_became_peered":"2024-08-26T00:00:29.358427+0000","last_unstale":"2024-08-26T00:00:30.350023+0000","last_undegraded":"2024-08-26T00:00:30.350023+0000","last_fullsized":"2024-08-26T00:00:30.350023+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:15:41.175510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351999+0000","last_change":"2024-08-26T00:00:26.995054+0000","last_active":"2024-08-26T00:00:30.351999+0000","last_peered":"2024-08-26T00:00:30.351999+0000","last_clean":"2024-08-26T00:00:30.351999+0000","last_became_active":"2024-08-26T00:00:26.994742+0000","last_became_peered":"2024-08-26T00:00:26.994742+0000","last_unstale":"2024-08-26T00:00:30.351999+0000","last_undegraded":"2024-08-26T00:00:30.351999+0000","last_fullsized":"2024-08-26T00:00:30.351999+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:02:30.509497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351911+0000","last_change":"2024-08-26T00:00:29.352343+0000","last_active":"2024-08-26T00:00:30.351911+0000","last_peered":"2024-08-26T00:00:30.351911+0000","last_clean":"2024-08-26T00:00:30.351911+0000","last_became_active":"2024-08-26T00:00:29.352036+0000","last_became_peered":"2024-08-26T00:00:29.352036+0000","last_unstale":"2024-08-26T00:00:30.351911+0000","last_undegraded":"2024-08-26T00:00:30.351911+0000","last_fullsized":"2024-08-26T00:00:30.351911+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:28:14.399870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":38,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:55.429882+0000","last_change":"2024-08-26T00:00:26.989828+0000","last_active":"2024-08-26T00:00:55.429882+0000","last_peered":"2024-08-26T00:00:55.429882+0000","last_clean":"2024-08-26T00:00:55.429882+0000","last_became_active":"2024-08-26T00:00:26.989365+0000","last_became_peered":"2024-08-26T00:00:26.989365+0000","last_unstale":"2024-08-26T00:00:55.429882+0000","last_undegraded":"2024-08-26T00:00:55.429882+0000","last_fullsized":"2024-08-26T00:00:55.429882+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:00:40.821500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341858+0000","last_change":"2024-08-26T00:00:29.359506+0000","last_active":"2024-08-26T00:00:30.341858+0000","last_peered":"2024-08-26T00:00:30.341858+0000","last_clean":"2024-08-26T00:00:30.341858+0000","last_became_active":"2024-08-26T00:00:29.359042+0000","last_became_peered":"2024-08-26T00:00:29.359042+0000","last_unstale":"2024-08-26T00:00:30.341858+0000","last_undegraded":"2024-08-26T00:00:30.341858+0000","last_fullsized":"2024-08-26T00:00:30.341858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:38:34.661823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:38.398775+0000","last_change":"2024-08-26T00:00:26.994272+0000","last_active":"2024-08-26T00:00:38.398775+0000","last_peered":"2024-08-26T00:00:38.398775+0000","last_clean":"2024-08-26T00:00:38.398775+0000","last_became_active":"2024-08-26T00:00:26.993769+0000","last_became_peered":"2024-08-26T00:00:26.993769+0000","last_unstale":"2024-08-26T00:00:38.398775+0000","last_undegraded":"2024-08-26T00:00:38.398775+0000","last_fullsized":"2024-08-26T00:00:38.398775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:03:39.816595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350863+0000","last_change":"2024-08-26T00:00:29.372236+0000","last_active":"2024-08-26T00:00:30.350863+0000","last_peered":"2024-08-26T00:00:30.350863+0000","last_clean":"2024-08-26T00:00:30.350863+0000","last_became_active":"2024-08-26T00:00:29.371632+0000","last_became_peered":"2024-08-26T00:00:29.371632+0000","last_unstale":"2024-08-26T00:00:30.350863+0000","last_undegraded":"2024-08-26T00:00:30.350863+0000","last_fullsized":"2024-08-26T00:00:30.350863+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:46:10.735550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:38.397056+0000","last_change":"2024-08-26T00:00:27.080074+0000","last_active":"2024-08-26T00:00:38.397056+0000","last_peered":"2024-08-26T00:00:38.397056+0000","last_clean":"2024-08-26T00:00:38.397056+0000","last_became_active":"2024-08-26T00:00:27.079646+0000","last_became_peered":"2024-08-26T00:00:27.079646+0000","last_unstale":"2024-08-26T00:00:38.397056+0000","last_undegraded":"2024-08-26T00:00:38.397056+0000","last_fullsized":"2024-08-26T00:00:38.397056+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:22:42.677747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341611+0000","last_change":"2024-08-26T00:00:29.358323+0000","last_active":"2024-08-26T00:00:30.341611+0000","last_peered":"2024-08-26T00:00:30.341611+0000","last_clean":"2024-08-26T00:00:30.341611+0000","last_became_active":"2024-08-26T00:00:29.357658+0000","last_became_peered":"2024-08-26T00:00:29.357658+0000","last_unstale":"2024-08-26T00:00:30.341611+0000","last_undegraded":"2024-08-26T00:00:30.341611+0000","last_fullsized":"2024-08-26T00:00:30.341611+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:23:40.859598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'25","reported_seq":84,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:56.435117+0000","last_change":"2024-08-26T00:00:26.990434+0000","last_active":"2024-08-26T00:00:56.435117+0000","last_peered":"2024-08-26T00:00:56.435117+0000","last_clean":"2024-08-26T00:00:56.435117+0000","last_became_active":"2024-08-26T00:00:26.989961+0000","last_became_peered":"2024-08-26T00:00:26.989961+0000","last_unstale":"2024-08-26T00:00:56.435117+0000","last_undegraded":"2024-08-26T00:00:56.435117+0000","last_fullsized":"2024-08-26T00:00:56.435117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:45:19.263082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54370,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":72,"num_write":26,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.342093+0000","last_change":"2024-08-26T00:00:29.356969+0000","last_active":"2024-08-26T00:00:30.342093+0000","last_peered":"2024-08-26T00:00:30.342093+0000","last_clean":"2024-08-26T00:00:30.342093+0000","last_became_active":"2024-08-26T00:00:29.356493+0000","last_became_peered":"2024-08-26T00:00:29.356493+0000","last_unstale":"2024-08-26T00:00:30.342093+0000","last_undegraded":"2024-08-26T00:00:30.342093+0000","last_fullsized":"2024-08-26T00:00:30.342093+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:42:29.663933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:39.405426+0000","last_change":"2024-08-26T00:00:26.993733+0000","last_active":"2024-08-26T00:00:39.405426+0000","last_peered":"2024-08-26T00:00:39.405426+0000","last_clean":"2024-08-26T00:00:39.405426+0000","last_became_active":"2024-08-26T00:00:26.991196+0000","last_became_peered":"2024-08-26T00:00:26.991196+0000","last_unstale":"2024-08-26T00:00:39.405426+0000","last_undegraded":"2024-08-26T00:00:39.405426+0000","last_fullsized":"2024-08-26T00:00:39.405426+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:53:49.056228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341409+0000","last_change":"2024-08-26T00:00:29.363095+0000","last_active":"2024-08-26T00:00:30.341409+0000","last_peered":"2024-08-26T00:00:30.341409+0000","last_clean":"2024-08-26T00:00:30.341409+0000","last_became_active":"2024-08-26T00:00:29.361374+0000","last_became_peered":"2024-08-26T00:00:29.361374+0000","last_unstale":"2024-08-26T00:00:30.341409+0000","last_undegraded":"2024-08-26T00:00:30.341409+0000","last_fullsized":"2024-08-26T00:00:30.341409+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:30:34.072712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:38.398578+0000","last_change":"2024-08-26T00:00:26.993920+0000","last_active":"2024-08-26T00:00:38.398578+0000","last_peered":"2024-08-26T00:00:38.398578+0000","last_clean":"2024-08-26T00:00:38.398578+0000","last_became_active":"2024-08-26T00:00:26.993578+0000","last_became_peered":"2024-08-26T00:00:26.993578+0000","last_unstale":"2024-08-26T00:00:38.398578+0000","last_undegraded":"2024-08-26T00:00:38.398578+0000","last_fullsized":"2024-08-26T00:00:38.398578+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:29:49.751384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351220+0000","last_change":"2024-08-26T00:00:29.362535+0000","last_active":"2024-08-26T00:00:30.351220+0000","last_peered":"2024-08-26T00:00:30.351220+0000","last_clean":"2024-08-26T00:00:30.351220+0000","last_became_active":"2024-08-26T00:00:29.362167+0000","last_became_peered":"2024-08-26T00:00:29.362167+0000","last_unstale":"2024-08-26T00:00:30.351220+0000","last_undegraded":"2024-08-26T00:00:30.351220+0000","last_fullsized":"2024-08-26T00:00:30.351220+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:21:54.020323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'4","reported_seq":41,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:54.429179+0000","last_change":"2024-08-26T00:00:26.993988+0000","last_active":"2024-08-26T00:00:54.429179+0000","last_peered":"2024-08-26T00:00:54.429179+0000","last_clean":"2024-08-26T00:00:54.429179+0000","last_became_active":"2024-08-26T00:00:26.993485+0000","last_became_peered":"2024-08-26T00:00:26.993485+0000","last_unstale":"2024-08-26T00:00:54.429179+0000","last_undegraded":"2024-08-26T00:00:54.429179+0000","last_fullsized":"2024-08-26T00:00:54.429179+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:46:29.475574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":977,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.352260+0000","last_change":"2024-08-26T00:00:29.354108+0000","last_active":"2024-08-26T00:00:30.352260+0000","last_peered":"2024-08-26T00:00:30.352260+0000","last_clean":"2024-08-26T00:00:30.352260+0000","last_became_active":"2024-08-26T00:00:29.353765+0000","last_became_peered":"2024-08-26T00:00:29.353765+0000","last_unstale":"2024-08-26T00:00:30.352260+0000","last_undegraded":"2024-08-26T00:00:30.352260+0000","last_fullsized":"2024-08-26T00:00:30.352260+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:54:20.998930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:39.408112+0000","last_change":"2024-08-26T00:00:27.077517+0000","last_active":"2024-08-26T00:00:39.408112+0000","last_peered":"2024-08-26T00:00:39.408112+0000","last_clean":"2024-08-26T00:00:39.408112+0000","last_became_active":"2024-08-26T00:00:27.077083+0000","last_became_peered":"2024-08-26T00:00:27.077083+0000","last_unstale":"2024-08-26T00:00:39.408112+0000","last_undegraded":"2024-08-26T00:00:39.408112+0000","last_fullsized":"2024-08-26T00:00:39.408112+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:27:43.522233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.352513+0000","last_change":"2024-08-26T00:00:29.355532+0000","last_active":"2024-08-26T00:00:30.352513+0000","last_peered":"2024-08-26T00:00:30.352513+0000","last_clean":"2024-08-26T00:00:30.352513+0000","last_became_active":"2024-08-26T00:00:29.355211+0000","last_became_peered":"2024-08-26T00:00:29.355211+0000","last_unstale":"2024-08-26T00:00:30.352513+0000","last_undegraded":"2024-08-26T00:00:30.352513+0000","last_fullsized":"2024-08-26T00:00:30.352513+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:08:51.419634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:40.401704+0000","last_change":"2024-08-26T00:00:26.992613+0000","last_active":"2024-08-26T00:00:40.401704+0000","last_peered":"2024-08-26T00:00:40.401704+0000","last_clean":"2024-08-26T00:00:40.401704+0000","last_became_active":"2024-08-26T00:00:26.992137+0000","last_became_peered":"2024-08-26T00:00:26.992137+0000","last_unstale":"2024-08-26T00:00:40.401704+0000","last_undegraded":"2024-08-26T00:00:40.401704+0000","last_fullsized":"2024-08-26T00:00:40.401704+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:30:32.586859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.357123+0000","last_change":"2024-08-26T00:00:29.362342+0000","last_active":"2024-08-26T00:00:30.357123+0000","last_peered":"2024-08-26T00:00:30.357123+0000","last_clean":"2024-08-26T00:00:30.357123+0000","last_became_active":"2024-08-26T00:00:29.362017+0000","last_became_peered":"2024-08-26T00:00:29.362017+0000","last_unstale":"2024-08-26T00:00:30.357123+0000","last_undegraded":"2024-08-26T00:00:30.357123+0000","last_fullsized":"2024-08-26T00:00:30.357123+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:01:55.507893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.353047+0000","last_change":"2024-08-26T00:00:26.989977+0000","last_active":"2024-08-26T00:00:30.353047+0000","last_peered":"2024-08-26T00:00:30.353047+0000","last_clean":"2024-08-26T00:00:30.353047+0000","last_became_active":"2024-08-26T00:00:26.989535+0000","last_became_peered":"2024-08-26T00:00:26.989535+0000","last_unstale":"2024-08-26T00:00:30.353047+0000","last_undegraded":"2024-08-26T00:00:30.353047+0000","last_fullsized":"2024-08-26T00:00:30.353047+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:33:20.347005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351800+0000","last_change":"2024-08-26T00:00:29.355928+0000","last_active":"2024-08-26T00:00:30.351800+0000","last_peered":"2024-08-26T00:00:30.351800+0000","last_clean":"2024-08-26T00:00:30.351800+0000","last_became_active":"2024-08-26T00:00:29.355546+0000","last_became_peered":"2024-08-26T00:00:29.355546+0000","last_unstale":"2024-08-26T00:00:30.351800+0000","last_undegraded":"2024-08-26T00:00:30.351800+0000","last_fullsized":"2024-08-26T00:00:30.351800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:15:06.116141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.356434+0000","last_change":"2024-08-26T00:00:26.992523+0000","last_active":"2024-08-26T00:00:30.356434+0000","last_peered":"2024-08-26T00:00:30.356434+0000","last_clean":"2024-08-26T00:00:30.356434+0000","last_became_active":"2024-08-26T00:00:26.992193+0000","last_became_peered":"2024-08-26T00:00:26.992193+0000","last_unstale":"2024-08-26T00:00:30.356434+0000","last_undegraded":"2024-08-26T00:00:30.356434+0000","last_fullsized":"2024-08-26T00:00:30.356434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:34:21.879373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:31.555090+0000","last_change":"2024-08-26T00:00:29.358826+0000","last_active":"2024-08-26T00:00:31.555090+0000","last_peered":"2024-08-26T00:00:31.555090+0000","last_clean":"2024-08-26T00:00:31.555090+0000","last_became_active":"2024-08-26T00:00:29.358478+0000","last_became_peered":"2024-08-26T00:00:29.358478+0000","last_unstale":"2024-08-26T00:00:31.555090+0000","last_undegraded":"2024-08-26T00:00:31.555090+0000","last_fullsized":"2024-08-26T00:00:31.555090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:30:39.484666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:39.407576+0000","last_change":"2024-08-26T00:00:27.077599+0000","last_active":"2024-08-26T00:00:39.407576+0000","last_peered":"2024-08-26T00:00:39.407576+0000","last_clean":"2024-08-26T00:00:39.407576+0000","last_became_active":"2024-08-26T00:00:27.077094+0000","last_became_peered":"2024-08-26T00:00:27.077094+0000","last_unstale":"2024-08-26T00:00:39.407576+0000","last_undegraded":"2024-08-26T00:00:39.407576+0000","last_fullsized":"2024-08-26T00:00:39.407576+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:06:47.966097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351847+0000","last_change":"2024-08-26T00:00:29.355243+0000","last_active":"2024-08-26T00:00:30.351847+0000","last_peered":"2024-08-26T00:00:30.351847+0000","last_clean":"2024-08-26T00:00:30.351847+0000","last_became_active":"2024-08-26T00:00:29.354151+0000","last_became_peered":"2024-08-26T00:00:29.354151+0000","last_unstale":"2024-08-26T00:00:30.351847+0000","last_undegraded":"2024-08-26T00:00:30.351847+0000","last_fullsized":"2024-08-26T00:00:30.351847+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:00:12.520736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":330,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.352379+0000","last_change":"2024-08-25T23:59:16.227980+0000","last_active":"2024-08-26T00:00:30.352379+0000","last_peered":"2024-08-26T00:00:30.352379+0000","last_clean":"2024-08-26T00:00:30.352379+0000","last_became_active":"2024-08-25T23:59:16.227550+0000","last_became_peered":"2024-08-25T23:59:16.227550+0000","last_unstale":"2024-08-26T00:00:30.352379+0000","last_undegraded":"2024-08-26T00:00:30.352379+0000","last_fullsized":"2024-08-26T00:00:30.352379+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-25T23:55:51.247914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-25T23:55:51.247914+0000","last_clean_scrub_stamp":"2024-08-25T23:55:51.247914+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:39:34.184312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:40.407361+0000","last_change":"2024-08-26T00:00:26.992675+0000","last_active":"2024-08-26T00:00:40.407361+0000","last_peered":"2024-08-26T00:00:40.407361+0000","last_clean":"2024-08-26T00:00:40.407361+0000","last_became_active":"2024-08-26T00:00:26.992322+0000","last_became_peered":"2024-08-26T00:00:26.992322+0000","last_unstale":"2024-08-26T00:00:40.407361+0000","last_undegraded":"2024-08-26T00:00:40.407361+0000","last_fullsized":"2024-08-26T00:00:40.407361+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:38:26.016220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350787+0000","last_change":"2024-08-26T00:00:29.362617+0000","last_active":"2024-08-26T00:00:30.350787+0000","last_peered":"2024-08-26T00:00:30.350787+0000","last_clean":"2024-08-26T00:00:30.350787+0000","last_became_active":"2024-08-26T00:00:29.362245+0000","last_became_peered":"2024-08-26T00:00:29.362245+0000","last_unstale":"2024-08-26T00:00:30.350787+0000","last_undegraded":"2024-08-26T00:00:30.350787+0000","last_fullsized":"2024-08-26T00:00:30.350787+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:30:12.309213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:39.404402+0000","last_change":"2024-08-26T00:00:26.990064+0000","last_active":"2024-08-26T00:00:39.404402+0000","last_peered":"2024-08-26T00:00:39.404402+0000","last_clean":"2024-08-26T00:00:39.404402+0000","last_became_active":"2024-08-26T00:00:26.989716+0000","last_became_peered":"2024-08-26T00:00:26.989716+0000","last_unstale":"2024-08-26T00:00:39.404402+0000","last_undegraded":"2024-08-26T00:00:39.404402+0000","last_fullsized":"2024-08-26T00:00:39.404402+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:20:26.713776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341327+0000","last_change":"2024-08-26T00:00:29.366378+0000","last_active":"2024-08-26T00:00:30.341327+0000","last_peered":"2024-08-26T00:00:30.341327+0000","last_clean":"2024-08-26T00:00:30.341327+0000","last_became_active":"2024-08-26T00:00:29.365837+0000","last_became_peered":"2024-08-26T00:00:29.365837+0000","last_unstale":"2024-08-26T00:00:30.341327+0000","last_undegraded":"2024-08-26T00:00:30.341327+0000","last_fullsized":"2024-08-26T00:00:30.341327+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:45:21.667426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":39,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:55.430030+0000","last_change":"2024-08-26T00:00:27.077840+0000","last_active":"2024-08-26T00:00:55.430030+0000","last_peered":"2024-08-26T00:00:55.430030+0000","last_clean":"2024-08-26T00:00:55.430030+0000","last_became_active":"2024-08-26T00:00:27.077355+0000","last_became_peered":"2024-08-26T00:00:27.077355+0000","last_unstale":"2024-08-26T00:00:55.430030+0000","last_undegraded":"2024-08-26T00:00:55.430030+0000","last_fullsized":"2024-08-26T00:00:55.430030+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:03:30.718962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351209+0000","last_change":"2024-08-26T00:00:29.357738+0000","last_active":"2024-08-26T00:00:30.351209+0000","last_peered":"2024-08-26T00:00:30.351209+0000","last_clean":"2024-08-26T00:00:30.351209+0000","last_became_active":"2024-08-26T00:00:29.357369+0000","last_became_peered":"2024-08-26T00:00:29.357369+0000","last_unstale":"2024-08-26T00:00:30.351209+0000","last_undegraded":"2024-08-26T00:00:30.351209+0000","last_fullsized":"2024-08-26T00:00:30.351209+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:39:33.924747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351457+0000","last_change":"2024-08-26T00:00:26.994187+0000","last_active":"2024-08-26T00:00:30.351457+0000","last_peered":"2024-08-26T00:00:30.351457+0000","last_clean":"2024-08-26T00:00:30.351457+0000","last_became_active":"2024-08-26T00:00:26.993699+0000","last_became_peered":"2024-08-26T00:00:26.993699+0000","last_unstale":"2024-08-26T00:00:30.351457+0000","last_undegraded":"2024-08-26T00:00:30.351457+0000","last_fullsized":"2024-08-26T00:00:30.351457+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:19:50.412724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350521+0000","last_change":"2024-08-26T00:00:29.364507+0000","last_active":"2024-08-26T00:00:30.350521+0000","last_peered":"2024-08-26T00:00:30.350521+0000","last_clean":"2024-08-26T00:00:30.350521+0000","last_became_active":"2024-08-26T00:00:29.364129+0000","last_became_peered":"2024-08-26T00:00:29.364129+0000","last_unstale":"2024-08-26T00:00:30.350521+0000","last_undegraded":"2024-08-26T00:00:30.350521+0000","last_fullsized":"2024-08-26T00:00:30.350521+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:17:36.837206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.352367+0000","last_change":"2024-08-26T00:00:27.076977+0000","last_active":"2024-08-26T00:00:30.352367+0000","last_peered":"2024-08-26T00:00:30.352367+0000","last_clean":"2024-08-26T00:00:30.352367+0000","last_became_active":"2024-08-26T00:00:27.076524+0000","last_became_peered":"2024-08-26T00:00:27.076524+0000","last_unstale":"2024-08-26T00:00:30.352367+0000","last_undegraded":"2024-08-26T00:00:30.352367+0000","last_fullsized":"2024-08-26T00:00:30.352367+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:22:21.820009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:32.211525+0000","last_change":"2024-08-26T00:00:29.363880+0000","last_active":"2024-08-26T00:00:32.211525+0000","last_peered":"2024-08-26T00:00:32.211525+0000","last_clean":"2024-08-26T00:00:32.211525+0000","last_became_active":"2024-08-26T00:00:29.363475+0000","last_became_peered":"2024-08-26T00:00:29.363475+0000","last_unstale":"2024-08-26T00:00:32.211525+0000","last_undegraded":"2024-08-26T00:00:32.211525+0000","last_fullsized":"2024-08-26T00:00:32.211525+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:30:55.875922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:38.399372+0000","last_change":"2024-08-26T00:00:27.077675+0000","last_active":"2024-08-26T00:00:38.399372+0000","last_peered":"2024-08-26T00:00:38.399372+0000","last_clean":"2024-08-26T00:00:38.399372+0000","last_became_active":"2024-08-26T00:00:27.077060+0000","last_became_peered":"2024-08-26T00:00:27.077060+0000","last_unstale":"2024-08-26T00:00:38.399372+0000","last_undegraded":"2024-08-26T00:00:38.399372+0000","last_fullsized":"2024-08-26T00:00:38.399372+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:17:28.257614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341647+0000","last_change":"2024-08-26T00:00:29.360285+0000","last_active":"2024-08-26T00:00:30.341647+0000","last_peered":"2024-08-26T00:00:30.341647+0000","last_clean":"2024-08-26T00:00:30.341647+0000","last_became_active":"2024-08-26T00:00:29.359879+0000","last_became_peered":"2024-08-26T00:00:29.359879+0000","last_unstale":"2024-08-26T00:00:30.341647+0000","last_undegraded":"2024-08-26T00:00:30.341647+0000","last_fullsized":"2024-08-26T00:00:30.341647+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:49:10.691817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'11","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:54.348938+0000","last_change":"2024-08-26T00:00:26.990419+0000","last_active":"2024-08-26T00:00:54.348938+0000","last_peered":"2024-08-26T00:00:54.348938+0000","last_clean":"2024-08-26T00:00:54.348938+0000","last_became_active":"2024-08-26T00:00:26.990052+0000","last_became_peered":"2024-08-26T00:00:26.990052+0000","last_unstale":"2024-08-26T00:00:54.348938+0000","last_undegraded":"2024-08-26T00:00:54.348938+0000","last_fullsized":"2024-08-26T00:00:54.348938+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:27:41.229418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351739+0000","last_change":"2024-08-26T00:00:29.354671+0000","last_active":"2024-08-26T00:00:30.351739+0000","last_peered":"2024-08-26T00:00:30.351739+0000","last_clean":"2024-08-26T00:00:30.351739+0000","last_became_active":"2024-08-26T00:00:29.354071+0000","last_became_peered":"2024-08-26T00:00:29.354071+0000","last_unstale":"2024-08-26T00:00:30.351739+0000","last_undegraded":"2024-08-26T00:00:30.351739+0000","last_fullsized":"2024-08-26T00:00:30.351739+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:50:09.097757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:38.398738+0000","last_change":"2024-08-26T00:00:26.991622+0000","last_active":"2024-08-26T00:00:38.398738+0000","last_peered":"2024-08-26T00:00:38.398738+0000","last_clean":"2024-08-26T00:00:38.398738+0000","last_became_active":"2024-08-26T00:00:26.991244+0000","last_became_peered":"2024-08-26T00:00:26.991244+0000","last_unstale":"2024-08-26T00:00:38.398738+0000","last_undegraded":"2024-08-26T00:00:38.398738+0000","last_fullsized":"2024-08-26T00:00:38.398738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:58:25.676985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350680+0000","last_change":"2024-08-26T00:00:29.367033+0000","last_active":"2024-08-26T00:00:30.350680+0000","last_peered":"2024-08-26T00:00:30.350680+0000","last_clean":"2024-08-26T00:00:30.350680+0000","last_became_active":"2024-08-26T00:00:29.365572+0000","last_became_peered":"2024-08-26T00:00:29.365572+0000","last_unstale":"2024-08-26T00:00:30.350680+0000","last_undegraded":"2024-08-26T00:00:30.350680+0000","last_fullsized":"2024-08-26T00:00:30.350680+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:16:49.116721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:38.399106+0000","last_change":"2024-08-26T00:00:27.076562+0000","last_active":"2024-08-26T00:00:38.399106+0000","last_peered":"2024-08-26T00:00:38.399106+0000","last_clean":"2024-08-26T00:00:38.399106+0000","last_became_active":"2024-08-26T00:00:27.076163+0000","last_became_peered":"2024-08-26T00:00:27.076163+0000","last_unstale":"2024-08-26T00:00:38.399106+0000","last_undegraded":"2024-08-26T00:00:38.399106+0000","last_fullsized":"2024-08-26T00:00:38.399106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:25:03.222457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341350+0000","last_change":"2024-08-26T00:00:29.352787+0000","last_active":"2024-08-26T00:00:30.341350+0000","last_peered":"2024-08-26T00:00:30.341350+0000","last_clean":"2024-08-26T00:00:30.341350+0000","last_became_active":"2024-08-26T00:00:29.352429+0000","last_became_peered":"2024-08-26T00:00:29.352429+0000","last_unstale":"2024-08-26T00:00:30.341350+0000","last_undegraded":"2024-08-26T00:00:30.341350+0000","last_fullsized":"2024-08-26T00:00:30.341350+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:39:45.080372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:38.397964+0000","last_change":"2024-08-26T00:00:26.989778+0000","last_active":"2024-08-26T00:00:38.397964+0000","last_peered":"2024-08-26T00:00:38.397964+0000","last_clean":"2024-08-26T00:00:38.397964+0000","last_became_active":"2024-08-26T00:00:26.989433+0000","last_became_peered":"2024-08-26T00:00:26.989433+0000","last_unstale":"2024-08-26T00:00:38.397964+0000","last_undegraded":"2024-08-26T00:00:38.397964+0000","last_fullsized":"2024-08-26T00:00:38.397964+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:36:16.684252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.356842+0000","last_change":"2024-08-26T00:00:29.362705+0000","last_active":"2024-08-26T00:00:30.356842+0000","last_peered":"2024-08-26T00:00:30.356842+0000","last_clean":"2024-08-26T00:00:30.356842+0000","last_became_active":"2024-08-26T00:00:29.362341+0000","last_became_peered":"2024-08-26T00:00:29.362341+0000","last_unstale":"2024-08-26T00:00:30.356842+0000","last_undegraded":"2024-08-26T00:00:30.356842+0000","last_fullsized":"2024-08-26T00:00:30.356842+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:10:47.051351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350223+0000","last_change":"2024-08-26T00:00:26.994382+0000","last_active":"2024-08-26T00:00:30.350223+0000","last_peered":"2024-08-26T00:00:30.350223+0000","last_clean":"2024-08-26T00:00:30.350223+0000","last_became_active":"2024-08-26T00:00:26.993960+0000","last_became_peered":"2024-08-26T00:00:26.993960+0000","last_unstale":"2024-08-26T00:00:30.350223+0000","last_undegraded":"2024-08-26T00:00:30.350223+0000","last_fullsized":"2024-08-26T00:00:30.350223+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:42:54.234731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351142+0000","last_change":"2024-08-26T00:00:29.365553+0000","last_active":"2024-08-26T00:00:30.351142+0000","last_peered":"2024-08-26T00:00:30.351142+0000","last_clean":"2024-08-26T00:00:30.351142+0000","last_became_active":"2024-08-26T00:00:29.365215+0000","last_became_peered":"2024-08-26T00:00:29.365215+0000","last_unstale":"2024-08-26T00:00:30.351142+0000","last_undegraded":"2024-08-26T00:00:30.351142+0000","last_fullsized":"2024-08-26T00:00:30.351142+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:55:01.505530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:38.399647+0000","last_change":"2024-08-26T00:00:26.995228+0000","last_active":"2024-08-26T00:00:38.399647+0000","last_peered":"2024-08-26T00:00:38.399647+0000","last_clean":"2024-08-26T00:00:38.399647+0000","last_became_active":"2024-08-26T00:00:26.994875+0000","last_became_peered":"2024-08-26T00:00:26.994875+0000","last_unstale":"2024-08-26T00:00:38.399647+0000","last_undegraded":"2024-08-26T00:00:38.399647+0000","last_fullsized":"2024-08-26T00:00:38.399647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:27:21.110162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351042+0000","last_change":"2024-08-26T00:00:29.361598+0000","last_active":"2024-08-26T00:00:30.351042+0000","last_peered":"2024-08-26T00:00:30.351042+0000","last_clean":"2024-08-26T00:00:30.351042+0000","last_became_active":"2024-08-26T00:00:29.361237+0000","last_became_peered":"2024-08-26T00:00:29.361237+0000","last_unstale":"2024-08-26T00:00:30.351042+0000","last_undegraded":"2024-08-26T00:00:30.351042+0000","last_fullsized":"2024-08-26T00:00:30.351042+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:21:30.126060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350907+0000","last_change":"2024-08-26T00:00:29.355240+0000","last_active":"2024-08-26T00:00:30.350907+0000","last_peered":"2024-08-26T00:00:30.350907+0000","last_clean":"2024-08-26T00:00:30.350907+0000","last_became_active":"2024-08-26T00:00:29.354165+0000","last_became_peered":"2024-08-26T00:00:29.354165+0000","last_unstale":"2024-08-26T00:00:30.350907+0000","last_undegraded":"2024-08-26T00:00:30.350907+0000","last_fullsized":"2024-08-26T00:00:30.350907+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:07:56.573032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.349650+0000","last_change":"2024-08-26T00:00:26.992240+0000","last_active":"2024-08-26T00:00:30.349650+0000","last_peered":"2024-08-26T00:00:30.349650+0000","last_clean":"2024-08-26T00:00:30.349650+0000","last_became_active":"2024-08-26T00:00:26.991866+0000","last_became_peered":"2024-08-26T00:00:26.991866+0000","last_unstale":"2024-08-26T00:00:30.349650+0000","last_undegraded":"2024-08-26T00:00:30.349650+0000","last_fullsized":"2024-08-26T00:00:30.349650+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:25:50.815151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.341876+0000","last_change":"2024-08-26T00:00:29.370358+0000","last_active":"2024-08-26T00:00:30.341876+0000","last_peered":"2024-08-26T00:00:30.341876+0000","last_clean":"2024-08-26T00:00:30.341876+0000","last_became_active":"2024-08-26T00:00:29.369910+0000","last_became_peered":"2024-08-26T00:00:29.369910+0000","last_unstale":"2024-08-26T00:00:30.341876+0000","last_undegraded":"2024-08-26T00:00:30.341876+0000","last_fullsized":"2024-08-26T00:00:30.341876+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:49:11.351575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:39.405856+0000","last_change":"2024-08-26T00:00:26.989759+0000","last_active":"2024-08-26T00:00:39.405856+0000","last_peered":"2024-08-26T00:00:39.405856+0000","last_clean":"2024-08-26T00:00:39.405856+0000","last_became_active":"2024-08-26T00:00:26.989376+0000","last_became_peered":"2024-08-26T00:00:26.989376+0000","last_unstale":"2024-08-26T00:00:39.405856+0000","last_undegraded":"2024-08-26T00:00:39.405856+0000","last_fullsized":"2024-08-26T00:00:39.405856+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:44:36.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.350714+0000","last_change":"2024-08-26T00:00:29.367050+0000","last_active":"2024-08-26T00:00:30.350714+0000","last_peered":"2024-08-26T00:00:30.350714+0000","last_clean":"2024-08-26T00:00:30.350714+0000","last_became_active":"2024-08-26T00:00:29.366737+0000","last_became_peered":"2024-08-26T00:00:29.366737+0000","last_unstale":"2024-08-26T00:00:30.350714+0000","last_undegraded":"2024-08-26T00:00:30.350714+0000","last_fullsized":"2024-08-26T00:00:30.350714+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:00:54.461716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.356109+0000","last_change":"2024-08-26T00:00:27.078078+0000","last_active":"2024-08-26T00:00:30.356109+0000","last_peered":"2024-08-26T00:00:30.356109+0000","last_clean":"2024-08-26T00:00:30.356109+0000","last_became_active":"2024-08-26T00:00:27.077036+0000","last_became_peered":"2024-08-26T00:00:27.077036+0000","last_unstale":"2024-08-26T00:00:30.356109+0000","last_undegraded":"2024-08-26T00:00:30.356109+0000","last_fullsized":"2024-08-26T00:00:30.356109+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:47:44.674548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:30.351327+0000","last_change":"2024-08-26T00:00:29.363867+0000","last_active":"2024-08-26T00:00:30.351327+0000","last_peered":"2024-08-26T00:00:30.351327+0000","last_clean":"2024-08-26T00:00:30.351327+0000","last_became_active":"2024-08-26T00:00:29.363556+0000","last_became_peered":"2024-08-26T00:00:29.363556+0000","last_unstale":"2024-08-26T00:00:30.351327+0000","last_undegraded":"2024-08-26T00:00:30.351327+0000","last_fullsized":"2024-08-26T00:00:30.351327+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:50:04.009177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-26T00:00:39.408272+0000","last_change":"2024-08-26T00:00:26.990557+0000","last_active":"2024-08-26T00:00:39.408272+0000","last_peered":"2024-08-26T00:00:39.408272+0000","last_clean":"2024-08-26T00:00:39.408272+0000","last_became_active":"2024-08-26T00:00:26.989945+0000","last_became_peered":"2024-08-26T00:00:26.989945+0000","last_unstale":"2024-08-26T00:00:39.408272+0000","last_undegraded":"2024-08-26T00:00:39.408272+0000","last_fullsized":"2024-08-26T00:00:39.408272+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:26:54.388359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58369,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":128,"num_read_kb":125,"num_write":159,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":175107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645330,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":409224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874262,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36848,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708304,"statfs":{"total":95995035648,"available":95957303296,"internally_reserved":0,"allocated":1540096,"data_stored":1055464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037788,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":864256,"data_stored":409460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266722,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":864256,"data_stored":409380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495654,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40928,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704224,"statfs":{"total":95995035648,"available":95953125376,"internally_reserved":0,"allocated":1458176,"data_stored":1001308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626475,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":851968,"data_stored":408849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855409,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28460,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716692,"statfs":{"total":95995035648,"available":95965892608,"internally_reserved":0,"allocated":1470464,"data_stored":1000603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018932,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":856064,"data_stored":409675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247866,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":409160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444096,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":933888,"data_stored":464362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40392,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704760,"statfs":{"total":95995035648,"available":95953674240,"internally_reserved":0,"allocated":909312,"data_stored":463012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":410120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":55720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-26T00:01:00.682 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-26T00:01:00.682 INFO:tasks.cephadm:Setting up client nodes... 2024-08-26T00:01:00.683 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-08-26T00:01:00.731 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:00 smithi042 ceph-mon[17225]: from='client.24653 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-26T00:01:00.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:00 smithi043 ceph-mon[22091]: from='client.24653 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-26T00:01:00.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:00 smithi181 ceph-mon[22102]: from='client.24653 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-26T00:01:01.059 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:01.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.579+0000 7f9c4a600640 1 -- 172.21.15.42:0/2502705983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c44075f60 msgr2=0x7f9c440743c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:01.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.579+0000 7f9c4a600640 1 --2- 172.21.15.42:0/2502705983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c44075f60 0x7f9c440743c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9c34009900 tx=0x7f9c3402a480 comp rx=0 tx=0).stop 2024-08-26T00:01:01.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.579+0000 7f9c4a600640 1 -- 172.21.15.42:0/2502705983 shutdown_connections 2024-08-26T00:01:01.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.579+0000 7f9c4a600640 1 --2- 172.21.15.42:0/2502705983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c44109840 0x7f9c4410bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:01.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.579+0000 7f9c4a600640 1 --2- 172.21.15.42:0/2502705983 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c44074990 0x7f9c44074df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:01.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.579+0000 7f9c4a600640 1 --2- 172.21.15.42:0/2502705983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c44075f60 0x7f9c440743c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:01.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.579+0000 7f9c4a600640 1 -- 172.21.15.42:0/2502705983 >> 172.21.15.42:0/2502705983 conn(0x7f9c440fd130 msgr2=0x7f9c440ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:01.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.579+0000 7f9c4a600640 1 -- 172.21.15.42:0/2502705983 shutdown_connections 2024-08-26T00:01:01.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.579+0000 7f9c4a600640 1 -- 172.21.15.42:0/2502705983 wait complete. 2024-08-26T00:01:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.580+0000 7f9c4a600640 1 Processor -- start 2024-08-26T00:01:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.580+0000 7f9c4a600640 1 -- start start 2024-08-26T00:01:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.580+0000 7f9c4a600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c44074990 0x7f9c44199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.580+0000 7f9c4a600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c44075f60 0x7f9c4419a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.580+0000 7f9c4a600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c44109840 0x7f9c441a1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.580+0000 7f9c4a600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4410f850 con 0x7f9c44109840 2024-08-26T00:01:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.580+0000 7f9c4a600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4410f6d0 con 0x7f9c44074990 2024-08-26T00:01:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.580+0000 7f9c4a600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4410f9d0 con 0x7f9c44075f60 2024-08-26T00:01:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.580+0000 7f9c43e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c44109840 0x7f9c441a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.580+0000 7f9c43e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c44109840 0x7f9c441a1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58428/0 (socket says 172.21.15.42:58428) 2024-08-26T00:01:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.580+0000 7f9c43400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c44074990 0x7f9c44199e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.581+0000 7f9c43400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c44074990 0x7f9c44199e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:38148/0 (socket says 172.21.15.42:38148) 2024-08-26T00:01:01.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.581+0000 7f9c43e00640 1 -- 172.21.15.42:0/714025015 learned_addr learned my addr 172.21.15.42:0/714025015 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:01.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.581+0000 7f9c3aa00640 1 --2- 172.21.15.42:0/714025015 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c44075f60 0x7f9c4419a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:01.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.581+0000 7f9c43400640 1 -- 172.21.15.42:0/714025015 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c44075f60 msgr2=0x7f9c4419a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:01.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.581+0000 7f9c43400640 1 --2- 172.21.15.42:0/714025015 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c44075f60 0x7f9c4419a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:01.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.581+0000 7f9c43400640 1 -- 172.21.15.42:0/714025015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c44109840 msgr2=0x7f9c441a1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:01.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.581+0000 7f9c43400640 1 --2- 172.21.15.42:0/714025015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c44109840 0x7f9c441a1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:01.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.581+0000 7f9c43400640 1 -- 172.21.15.42:0/714025015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c441a1a80 con 0x7f9c44074990 2024-08-26T00:01:01.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.581+0000 7f9c43e00640 1 --2- 172.21.15.42:0/714025015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c44109840 0x7f9c441a1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:01.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.581+0000 7f9c43400640 1 --2- 172.21.15.42:0/714025015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c44074990 0x7f9c44199e50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9c3402a9a0 tx=0x7f9c34032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:01.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.582+0000 7f9c40c00640 1 -- 172.21.15.42:0/714025015 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3403f030 con 0x7f9c44074990 2024-08-26T00:01:01.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.582+0000 7f9c4a600640 1 -- 172.21.15.42:0/714025015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c441a1d10 con 0x7f9c44074990 2024-08-26T00:01:01.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.582+0000 7f9c40c00640 1 -- 172.21.15.42:0/714025015 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c34003ce0 con 0x7f9c44074990 2024-08-26T00:01:01.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.582+0000 7f9c40c00640 1 -- 172.21.15.42:0/714025015 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c34035070 con 0x7f9c44074990 2024-08-26T00:01:01.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.582+0000 7f9c4a600640 1 -- 172.21.15.42:0/714025015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c441a21c0 con 0x7f9c44074990 2024-08-26T00:01:01.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.583+0000 7f9c4a600640 1 -- 172.21.15.42:0/714025015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c44108600 con 0x7f9c44074990 2024-08-26T00:01:01.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.585+0000 7f9c40c00640 1 -- 172.21.15.42:0/714025015 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9c34042030 con 0x7f9c44074990 2024-08-26T00:01:01.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.586+0000 7f9c40c00640 1 --2- 172.21.15.42:0/714025015 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9c280a2cc0 0x7f9c280a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:01.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.586+0000 7f9c40c00640 1 -- 172.21.15.42:0/714025015 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f9c340ef4a0 con 0x7f9c44074990 2024-08-26T00:01:01.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.586+0000 7f9c3aa00640 1 --2- 172.21.15.42:0/714025015 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9c280a2cc0 0x7f9c280a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:01.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.587+0000 7f9c3aa00640 1 --2- 172.21.15.42:0/714025015 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9c280a2cc0 0x7f9c280a5180 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9c4419b370 tx=0x7f9c2c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:01.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.590+0000 7f9c40c00640 1 -- 172.21.15.42:0/714025015 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f9c340bbd00 con 0x7f9c44074990 2024-08-26T00:01:01.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:01 smithi043 ceph-mon[22091]: pgmap v292: 97 pgs: 97 active+clean; 634 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-08-26T00:01:01.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:01 smithi042 ceph-mon[17225]: pgmap v292: 97 pgs: 97 active+clean; 634 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-08-26T00:01:01.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:01 smithi181 ceph-mon[22102]: pgmap v292: 97 pgs: 97 active+clean; 634 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-08-26T00:01:01.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.846+0000 7f9c4a600640 1 -- 172.21.15.42:0/714025015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f9c4402d890 con 0x7f9c44074990 2024-08-26T00:01:01.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.852+0000 7f9c40c00640 1 -- 172.21.15.42:0/714025015 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f9c340c0000 con 0x7f9c44074990 2024-08-26T00:01:01.854 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-08-26T00:01:01.854 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQC9xctmaLmTMhAACFCMIPbUnkh0temftCboiA== 2024-08-26T00:01:01.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.855+0000 7f9c4a600640 1 -- 172.21.15.42:0/714025015 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9c280a2cc0 msgr2=0x7f9c280a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:01.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.855+0000 7f9c4a600640 1 --2- 172.21.15.42:0/714025015 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9c280a2cc0 0x7f9c280a5180 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9c4419b370 tx=0x7f9c2c00b390 comp rx=0 tx=0).stop 2024-08-26T00:01:01.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.855+0000 7f9c4a600640 1 -- 172.21.15.42:0/714025015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c44074990 msgr2=0x7f9c44199e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:01.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.855+0000 7f9c4a600640 1 --2- 172.21.15.42:0/714025015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c44074990 0x7f9c44199e50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9c3402a9a0 tx=0x7f9c34032ce0 comp rx=0 tx=0).stop 2024-08-26T00:01:01.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.855+0000 7f9c4a600640 1 -- 172.21.15.42:0/714025015 shutdown_connections 2024-08-26T00:01:01.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.855+0000 7f9c4a600640 1 --2- 172.21.15.42:0/714025015 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9c280a2cc0 0x7f9c280a5180 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:01.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.855+0000 7f9c4a600640 1 --2- 172.21.15.42:0/714025015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c44109840 0x7f9c441a1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:01.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.855+0000 7f9c4a600640 1 --2- 172.21.15.42:0/714025015 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c44075f60 0x7f9c4419a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:01.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.855+0000 7f9c4a600640 1 --2- 172.21.15.42:0/714025015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c44074990 0x7f9c44199e50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:01.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.855+0000 7f9c4a600640 1 -- 172.21.15.42:0/714025015 >> 172.21.15.42:0/714025015 conn(0x7f9c440fd130 msgr2=0x7f9c441057d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:01.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.855+0000 7f9c4a600640 1 -- 172.21.15.42:0/714025015 shutdown_connections 2024-08-26T00:01:01.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:01.855+0000 7f9c4a600640 1 -- 172.21.15.42:0/714025015 wait complete. 2024-08-26T00:01:02.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:02 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/714025015' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-26T00:01:02.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:02 smithi043 ceph-mon[22091]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-26T00:01:02.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:02 smithi043 ceph-mon[22091]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-26T00:01:02.779 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:02 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/714025015' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-26T00:01:02.779 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:02 smithi042 ceph-mon[17225]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-26T00:01:02.779 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:02 smithi042 ceph-mon[17225]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-26T00:01:02.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:02 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/714025015' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-26T00:01:02.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:02 smithi181 ceph-mon[22102]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-26T00:01:02.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:02 smithi181 ceph-mon[22102]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-26T00:01:02.822 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-26T00:01:02.823 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-08-26T00:01:02.823 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-26T00:01:02.905 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-26T00:01:02.905 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-08-26T00:01:02.906 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph mgr dump --format=json 2024-08-26T00:01:03.322 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:03.741 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:03 smithi042 ceph-mon[17225]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.6 KiB/s wr, 9 op/s 2024-08-26T00:01:03.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:03 smithi043 ceph-mon[22091]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.6 KiB/s wr, 9 op/s 2024-08-26T00:01:03.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:03 smithi181 ceph-mon[22102]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.6 KiB/s wr, 9 op/s 2024-08-26T00:01:03.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.853+0000 7f5744a00640 1 -- 172.21.15.42:0/498054949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5740102100 msgr2=0x7f574010e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:03.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.853+0000 7f5744a00640 1 --2- 172.21.15.42:0/498054949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5740102100 0x7f574010e630 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5738009cd0 tx=0x7f573802a8e0 comp rx=0 tx=0).stop 2024-08-26T00:01:03.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.853+0000 7f5744a00640 1 -- 172.21.15.42:0/498054949 shutdown_connections 2024-08-26T00:01:03.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.853+0000 7f5744a00640 1 --2- 172.21.15.42:0/498054949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5740102100 0x7f574010e630 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:03.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.853+0000 7f5744a00640 1 --2- 172.21.15.42:0/498054949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5740101760 0x7f5740101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:03.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.853+0000 7f5744a00640 1 --2- 172.21.15.42:0/498054949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5740107760 0x7f5740107b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:03.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.853+0000 7f5744a00640 1 -- 172.21.15.42:0/498054949 >> 172.21.15.42:0/498054949 conn(0x7f57400fd4e0 msgr2=0x7f57400ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:03.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.853+0000 7f5744a00640 1 -- 172.21.15.42:0/498054949 shutdown_connections 2024-08-26T00:01:03.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.853+0000 7f5744a00640 1 -- 172.21.15.42:0/498054949 wait complete. 2024-08-26T00:01:03.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.854+0000 7f5744a00640 1 Processor -- start 2024-08-26T00:01:03.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.854+0000 7f5744a00640 1 -- start start 2024-08-26T00:01:03.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.855+0000 7f5744a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5740101760 0x7f5740074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:03.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.855+0000 7f5744a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5740102100 0x7f57400747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:03.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.855+0000 7f5744a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5740107760 0x7f5740074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:03.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.855+0000 7f5744a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5740111b60 con 0x7f5740102100 2024-08-26T00:01:03.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.855+0000 7f5744a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f57401119e0 con 0x7f5740107760 2024-08-26T00:01:03.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.855+0000 7f5744a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5740111ce0 con 0x7f5740101760 2024-08-26T00:01:03.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.855+0000 7f573fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5740107760 0x7f5740074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:03.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.855+0000 7f573ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5740102100 0x7f57400747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:03.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.855+0000 7f573fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5740107760 0x7f5740074d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:38162/0 (socket says 172.21.15.42:38162) 2024-08-26T00:01:03.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.855+0000 7f573ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5740102100 0x7f57400747d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58452/0 (socket says 172.21.15.42:58452) 2024-08-26T00:01:03.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.855+0000 7f573fe00640 1 -- 172.21.15.42:0/1452437489 learned_addr learned my addr 172.21.15.42:0/1452437489 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:03.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.855+0000 7f573f400640 1 --2- 172.21.15.42:0/1452437489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5740101760 0x7f5740074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:03.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.856+0000 7f573ea00640 1 -- 172.21.15.42:0/1452437489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5740101760 msgr2=0x7f5740074290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:03.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.856+0000 7f573ea00640 1 --2- 172.21.15.42:0/1452437489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5740101760 0x7f5740074290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:03.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.856+0000 7f573ea00640 1 -- 172.21.15.42:0/1452437489 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5740107760 msgr2=0x7f5740074d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:03.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.856+0000 7f573ea00640 1 --2- 172.21.15.42:0/1452437489 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5740107760 0x7f5740074d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:03.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.856+0000 7f573ea00640 1 -- 172.21.15.42:0/1452437489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57401a6500 con 0x7f5740102100 2024-08-26T00:01:03.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.856+0000 7f573fe00640 1 --2- 172.21.15.42:0/1452437489 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5740107760 0x7f5740074d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:03.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.856+0000 7f573ea00640 1 --2- 172.21.15.42:0/1452437489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5740102100 0x7f57400747d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f572c00e9f0 tx=0x7f572c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:03.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.856+0000 7f5737e00640 1 -- 172.21.15.42:0/1452437489 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c00ccc0 con 0x7f5740102100 2024-08-26T00:01:03.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.856+0000 7f5737e00640 1 -- 172.21.15.42:0/1452437489 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f572c010910 con 0x7f5740102100 2024-08-26T00:01:03.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.856+0000 7f5744a00640 1 -- 172.21.15.42:0/1452437489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57401a67f0 con 0x7f5740102100 2024-08-26T00:01:03.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.856+0000 7f5737e00640 1 -- 172.21.15.42:0/1452437489 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c018960 con 0x7f5740102100 2024-08-26T00:01:03.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.856+0000 7f5744a00640 1 -- 172.21.15.42:0/1452437489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57401a6d30 con 0x7f5740102100 2024-08-26T00:01:03.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.857+0000 7f5744a00640 1 -- 172.21.15.42:0/1452437489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5740101bc0 con 0x7f5740102100 2024-08-26T00:01:03.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.860+0000 7f5737e00640 1 -- 172.21.15.42:0/1452437489 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f572c010ac0 con 0x7f5740102100 2024-08-26T00:01:03.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.861+0000 7f5737e00640 1 --2- 172.21.15.42:0/1452437489 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f57240a2c10 0x7f57240a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:03.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.861+0000 7f5737e00640 1 -- 172.21.15.42:0/1452437489 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f572c0cf4b0 con 0x7f5740102100 2024-08-26T00:01:03.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.862+0000 7f573f400640 1 --2- 172.21.15.42:0/1452437489 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f57240a2c10 0x7f57240a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:03.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.862+0000 7f573f400640 1 --2- 172.21.15.42:0/1452437489 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f57240a2c10 0x7f57240a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5730009b50 tx=0x7f5730005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:03.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:03.866+0000 7f5737e00640 1 -- 172.21.15.42:0/1452437489 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f572c09bd10 con 0x7f5740102100 2024-08-26T00:01:04.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:04.107+0000 7f5744a00640 1 -- 172.21.15.42:0/1452437489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f5740109cf0 con 0x7f5740102100 2024-08-26T00:01:04.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:04.113+0000 7f5737e00640 1 -- 172.21.15.42:0/1452437489 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263195 (secure 0 0 0) 0x7f572c0a0010 con 0x7f5740102100 2024-08-26T00:01:04.118 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:01:04.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:04.118+0000 7f5744a00640 1 -- 172.21.15.42:0/1452437489 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f57240a2c10 msgr2=0x7f57240a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:04.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:04.118+0000 7f5744a00640 1 --2- 172.21.15.42:0/1452437489 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f57240a2c10 0x7f57240a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5730009b50 tx=0x7f5730005f90 comp rx=0 tx=0).stop 2024-08-26T00:01:04.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:04.118+0000 7f5744a00640 1 -- 172.21.15.42:0/1452437489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5740102100 msgr2=0x7f57400747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:04.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:04.118+0000 7f5744a00640 1 --2- 172.21.15.42:0/1452437489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5740102100 0x7f57400747d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f572c00e9f0 tx=0x7f572c00eeb0 comp rx=0 tx=0).stop 2024-08-26T00:01:04.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:04.118+0000 7f5744a00640 1 -- 172.21.15.42:0/1452437489 shutdown_connections 2024-08-26T00:01:04.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:04.118+0000 7f5744a00640 1 --2- 172.21.15.42:0/1452437489 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f57240a2c10 0x7f57240a50d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:04.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:04.118+0000 7f5744a00640 1 --2- 172.21.15.42:0/1452437489 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5740107760 0x7f5740074d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:04.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:04.118+0000 7f5744a00640 1 --2- 172.21.15.42:0/1452437489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5740102100 0x7f57400747d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:04.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:04.118+0000 7f5744a00640 1 --2- 172.21.15.42:0/1452437489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5740101760 0x7f5740074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:04.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:04.118+0000 7f5744a00640 1 -- 172.21.15.42:0/1452437489 >> 172.21.15.42:0/1452437489 conn(0x7f57400fd4e0 msgr2=0x7f57400fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:04.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:04.118+0000 7f5744a00640 1 -- 172.21.15.42:0/1452437489 shutdown_connections 2024-08-26T00:01:04.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:04.118+0000 7f5744a00640 1 -- 172.21.15.42:0/1452437489 wait complete. 2024-08-26T00:01:04.669 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:04 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1452437489' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-08-26T00:01:04.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:04 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1452437489' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-08-26T00:01:04.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:04 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1452437489' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-08-26T00:01:04.971 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":22448279},{"type":"v1","addr":"172.21.15.42:6801","nonce":22448279}]},"active_addr":"172.21.15.42:6801/22448279","active_change":"2024-08-25T23:53:32.406312+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.42:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":1073308372}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":3771818851}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":2851540126}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":2925536692}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":3700455483}]}]} 2024-08-26T00:01:04.976 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-08-26T00:01:04.977 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-08-26T00:01:04.977 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd dump --format=json 2024-08-26T00:01:05.365 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:05.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:05 smithi043 ceph-mon[22091]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-08-26T00:01:05.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:05 smithi042 ceph-mon[17225]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-08-26T00:01:05.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:05 smithi181 ceph-mon[22102]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-08-26T00:01:05.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.972+0000 7fb6c3e00640 1 -- 172.21.15.42:0/2664044896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6c4102100 msgr2=0x7fb6c410e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:05.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.972+0000 7fb6c3e00640 1 --2- 172.21.15.42:0/2664044896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6c4102100 0x7fb6c410e630 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc009cd0 tx=0x7fb6bc02a8e0 comp rx=0 tx=0).stop 2024-08-26T00:01:05.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.972+0000 7fb6c3e00640 1 -- 172.21.15.42:0/2664044896 shutdown_connections 2024-08-26T00:01:05.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.972+0000 7fb6c3e00640 1 --2- 172.21.15.42:0/2664044896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6c4102100 0x7fb6c410e630 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:05.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.972+0000 7fb6c3e00640 1 --2- 172.21.15.42:0/2664044896 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb6c4101760 0x7fb6c4101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:05.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.972+0000 7fb6c3e00640 1 --2- 172.21.15.42:0/2664044896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6c4107760 0x7fb6c4107b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:05.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.972+0000 7fb6c3e00640 1 -- 172.21.15.42:0/2664044896 >> 172.21.15.42:0/2664044896 conn(0x7fb6c40fd4e0 msgr2=0x7fb6c40ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:05.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.972+0000 7fb6c3e00640 1 -- 172.21.15.42:0/2664044896 shutdown_connections 2024-08-26T00:01:05.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.972+0000 7fb6c3e00640 1 -- 172.21.15.42:0/2664044896 wait complete. 2024-08-26T00:01:05.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.973+0000 7fb6c3e00640 1 Processor -- start 2024-08-26T00:01:05.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.973+0000 7fb6c3e00640 1 -- start start 2024-08-26T00:01:05.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.974+0000 7fb6c3e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb6c4101760 0x7fb6c419a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:05.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.974+0000 7fb6c3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6c4102100 0x7fb6c419a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:05.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.974+0000 7fb6c3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6c4107760 0x7fb6c419eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:05.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.974+0000 7fb6c3e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c4111bb0 con 0x7fb6c4107760 2024-08-26T00:01:05.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.974+0000 7fb6c3e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c4111a30 con 0x7fb6c4102100 2024-08-26T00:01:05.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.974+0000 7fb6c3e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c4111d30 con 0x7fb6c4101760 2024-08-26T00:01:05.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.974+0000 7fb6c3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6c4107760 0x7fb6c419eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:05.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.974+0000 7fb6c3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6c4107760 0x7fb6c419eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56390/0 (socket says 172.21.15.42:56390) 2024-08-26T00:01:05.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.974+0000 7fb6c3400640 1 -- 172.21.15.42:0/2275546396 learned_addr learned my addr 172.21.15.42:0/2275546396 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:05.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.974+0000 7fb6bbe00640 1 --2- 172.21.15.42:0/2275546396 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6c4102100 0x7fb6c419a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:05.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.974+0000 7fb6c2a00640 1 --2- 172.21.15.42:0/2275546396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb6c4101760 0x7fb6c419a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:05.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.974+0000 7fb6c3400640 1 -- 172.21.15.42:0/2275546396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb6c4101760 msgr2=0x7fb6c419a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:05.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.974+0000 7fb6c3400640 1 --2- 172.21.15.42:0/2275546396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb6c4101760 0x7fb6c419a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:05.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.974+0000 7fb6c3400640 1 -- 172.21.15.42:0/2275546396 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6c4102100 msgr2=0x7fb6c419a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:05.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.974+0000 7fb6c3400640 1 --2- 172.21.15.42:0/2275546396 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6c4102100 0x7fb6c419a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:05.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.974+0000 7fb6c3400640 1 -- 172.21.15.42:0/2275546396 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c419f250 con 0x7fb6c4107760 2024-08-26T00:01:05.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.975+0000 7fb6c3400640 1 --2- 172.21.15.42:0/2275546396 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6c4107760 0x7fb6c419eb70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc033040 tx=0x7fb6bc031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:05.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.975+0000 7fb6bb400640 1 -- 172.21.15.42:0/2275546396 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc004040 con 0x7fb6c4107760 2024-08-26T00:01:05.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.975+0000 7fb6bb400640 1 -- 172.21.15.42:0/2275546396 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6bc0046c0 con 0x7fb6c4107760 2024-08-26T00:01:05.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.975+0000 7fb6bb400640 1 -- 172.21.15.42:0/2275546396 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc030ed0 con 0x7fb6c4107760 2024-08-26T00:01:05.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.975+0000 7fb6c3e00640 1 -- 172.21.15.42:0/2275546396 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c419f4e0 con 0x7fb6c4107760 2024-08-26T00:01:05.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.975+0000 7fb6c3e00640 1 -- 172.21.15.42:0/2275546396 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c41a6e20 con 0x7fb6c4107760 2024-08-26T00:01:05.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.976+0000 7fb6c3e00640 1 -- 172.21.15.42:0/2275546396 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c4102ea0 con 0x7fb6c4107760 2024-08-26T00:01:05.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.978+0000 7fb6bb400640 1 -- 172.21.15.42:0/2275546396 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb6bc0041e0 con 0x7fb6c4107760 2024-08-26T00:01:05.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.980+0000 7fb6bb400640 1 --2- 172.21.15.42:0/2275546396 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb6a80a2c90 0x7fb6a80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:05.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.981+0000 7fb6bb400640 1 -- 172.21.15.42:0/2275546396 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fb6bc02e030 con 0x7fb6c4107760 2024-08-26T00:01:05.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.981+0000 7fb6c2a00640 1 --2- 172.21.15.42:0/2275546396 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb6a80a2c90 0x7fb6a80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:05.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.981+0000 7fb6c2a00640 1 --2- 172.21.15.42:0/2275546396 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb6a80a2c90 0x7fb6a80a5150 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4009b50 tx=0x7fb6b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:05.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:05.985+0000 7fb6bb400640 1 -- 172.21.15.42:0/2275546396 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb6bc04b060 con 0x7fb6c4107760 2024-08-26T00:01:06.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:06.170+0000 7fb6c3e00640 1 -- 172.21.15.42:0/2275546396 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6c41a6ff0 con 0x7fb6c4107760 2024-08-26T00:01:06.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:06.172+0000 7fb6bb400640 1 -- 172.21.15.42:0/2275546396 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22147 (secure 0 0 0) 0x7fb6bc0c3070 con 0x7fb6c4107760 2024-08-26T00:01:06.173 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:01:06.174 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":78,"fsid":"f89d317a-633c-11ef-bcd2-c7b262605968","created":"2024-08-25T23:52:39.598509+0000","modified":"2024-08-26T00:00:30.169413+0000","last_up_change":"2024-08-25T23:59:35.047575+0000","last_in_change":"2024-08-25T23:59:12.796940+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-25T23:55:51.022219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-26T00:00:25.606536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-26T00:00:28.322822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"980d8635-bca1-4c5a-b78e-4b44f9315d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6803","nonce":2657450248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6805","nonce":2657450248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6809","nonce":2657450248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6807","nonce":2657450248}]},"public_addr":"172.21.15.42:6803/2657450248","cluster_addr":"172.21.15.42:6805/2657450248","heartbeat_back_addr":"172.21.15.42:6809/2657450248","heartbeat_front_addr":"172.21.15.42:6807/2657450248","state":["exists","up"]},{"osd":1,"uuid":"e5f8dc3b-876a-4bdd-b6b0-b0d99d098d95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6801","nonce":2396081001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6803","nonce":2396081001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6807","nonce":2396081001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6805","nonce":2396081001}]},"public_addr":"172.21.15.43:6801/2396081001","cluster_addr":"172.21.15.43:6803/2396081001","heartbeat_back_addr":"172.21.15.43:6807/2396081001","heartbeat_front_addr":"172.21.15.43:6805/2396081001","state":["exists","up"]},{"osd":2,"uuid":"06eb25af-8e3d-4f90-bc24-28a9bc224c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6801","nonce":189987070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6803","nonce":189987070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6807","nonce":189987070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6805","nonce":189987070}]},"public_addr":"172.21.15.181:6801/189987070","cluster_addr":"172.21.15.181:6803/189987070","heartbeat_back_addr":"172.21.15.181:6807/189987070","heartbeat_front_addr":"172.21.15.181:6805/189987070","state":["exists","up"]},{"osd":3,"uuid":"c78dbc49-b5c7-4f82-be36-c76a89496520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6811","nonce":251017896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6813","nonce":251017896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6817","nonce":251017896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6815","nonce":251017896}]},"public_addr":"172.21.15.42:6811/251017896","cluster_addr":"172.21.15.42:6813/251017896","heartbeat_back_addr":"172.21.15.42:6817/251017896","heartbeat_front_addr":"172.21.15.42:6815/251017896","state":["exists","up"]},{"osd":4,"uuid":"ba633f66-25af-492f-bbf2-76032a4cd3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6809","nonce":1315420796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6811","nonce":1315420796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6815","nonce":1315420796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6813","nonce":1315420796}]},"public_addr":"172.21.15.43:6809/1315420796","cluster_addr":"172.21.15.43:6811/1315420796","heartbeat_back_addr":"172.21.15.43:6815/1315420796","heartbeat_front_addr":"172.21.15.43:6813/1315420796","state":["exists","up"]},{"osd":5,"uuid":"04e47ad9-21ba-43da-9793-d5cf83150dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6809","nonce":246971403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6811","nonce":246971403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6815","nonce":246971403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6813","nonce":246971403}]},"public_addr":"172.21.15.181:6809/246971403","cluster_addr":"172.21.15.181:6811/246971403","heartbeat_back_addr":"172.21.15.181:6815/246971403","heartbeat_front_addr":"172.21.15.181:6813/246971403","state":["exists","up"]},{"osd":6,"uuid":"f48161cd-bc44-4d99-8248-1bb845111129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6819","nonce":2910656480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6821","nonce":2910656480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6825","nonce":2910656480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6823","nonce":2910656480}]},"public_addr":"172.21.15.42:6819/2910656480","cluster_addr":"172.21.15.42:6821/2910656480","heartbeat_back_addr":"172.21.15.42:6825/2910656480","heartbeat_front_addr":"172.21.15.42:6823/2910656480","state":["exists","up"]},{"osd":7,"uuid":"65470b06-b14d-4d8e-9bcb-e6927c37fda5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6817","nonce":624542778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6819","nonce":624542778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6823","nonce":624542778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6821","nonce":624542778}]},"public_addr":"172.21.15.43:6817/624542778","cluster_addr":"172.21.15.43:6819/624542778","heartbeat_back_addr":"172.21.15.43:6823/624542778","heartbeat_front_addr":"172.21.15.43:6821/624542778","state":["exists","up"]},{"osd":8,"uuid":"1f4c9152-4b7c-415f-9cb9-d1e926fad5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6817","nonce":728226568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6819","nonce":728226568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6823","nonce":728226568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6821","nonce":728226568}]},"public_addr":"172.21.15.181:6817/728226568","cluster_addr":"172.21.15.181:6819/728226568","heartbeat_back_addr":"172.21.15.181:6823/728226568","heartbeat_front_addr":"172.21.15.181:6821/728226568","state":["exists","up"]},{"osd":9,"uuid":"fb387fbe-19b4-4a3e-8e40-81bd1363b55c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6827","nonce":1052069444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6829","nonce":1052069444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6833","nonce":1052069444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6831","nonce":1052069444}]},"public_addr":"172.21.15.42:6827/1052069444","cluster_addr":"172.21.15.42:6829/1052069444","heartbeat_back_addr":"172.21.15.42:6833/1052069444","heartbeat_front_addr":"172.21.15.42:6831/1052069444","state":["exists","up"]},{"osd":10,"uuid":"fe5bbeec-2341-4ea9-97ab-cc45d738d741","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6825","nonce":3417487386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6827","nonce":3417487386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6831","nonce":3417487386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6829","nonce":3417487386}]},"public_addr":"172.21.15.43:6825/3417487386","cluster_addr":"172.21.15.43:6827/3417487386","heartbeat_back_addr":"172.21.15.43:6831/3417487386","heartbeat_front_addr":"172.21.15.43:6829/3417487386","state":["exists","up"]},{"osd":11,"uuid":"cee07741-3ab7-481e-8477-54319f4f178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6825","nonce":3817502913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6827","nonce":3817502913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6831","nonce":3817502913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6829","nonce":3817502913}]},"public_addr":"172.21.15.181:6825/3817502913","cluster_addr":"172.21.15.181:6827/3817502913","heartbeat_back_addr":"172.21.15.181:6831/3817502913","heartbeat_front_addr":"172.21.15.181:6829/3817502913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:00.603592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:24.637326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:47.587859+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:14.978783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:39.025819+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:01.965471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:29.753475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:54.162377+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:17.970871+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:46.175576+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:10.590220+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:33.216701+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/3711239085":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6801/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2983166615":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/2974122891":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2980210051":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/4227793902":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6801/1517739376":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6800/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/1775009918":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6800/1517739376":"2024-08-26T23:53:05.122858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-26T00:01:06.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:06.174+0000 7fb6c3e00640 1 -- 172.21.15.42:0/2275546396 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb6a80a2c90 msgr2=0x7fb6a80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:06.174+0000 7fb6c3e00640 1 --2- 172.21.15.42:0/2275546396 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb6a80a2c90 0x7fb6a80a5150 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4009b50 tx=0x7fb6b4005f90 comp rx=0 tx=0).stop 2024-08-26T00:01:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:06.174+0000 7fb6c3e00640 1 -- 172.21.15.42:0/2275546396 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6c4107760 msgr2=0x7fb6c419eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:06.174+0000 7fb6c3e00640 1 --2- 172.21.15.42:0/2275546396 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6c4107760 0x7fb6c419eb70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc033040 tx=0x7fb6bc031e60 comp rx=0 tx=0).stop 2024-08-26T00:01:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:06.174+0000 7fb6c3e00640 1 -- 172.21.15.42:0/2275546396 shutdown_connections 2024-08-26T00:01:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:06.174+0000 7fb6c3e00640 1 --2- 172.21.15.42:0/2275546396 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb6a80a2c90 0x7fb6a80a5150 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:06.174+0000 7fb6c3e00640 1 --2- 172.21.15.42:0/2275546396 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6c4107760 0x7fb6c419eb70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:06.174+0000 7fb6c3e00640 1 --2- 172.21.15.42:0/2275546396 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6c4102100 0x7fb6c419a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:06.174+0000 7fb6c3e00640 1 --2- 172.21.15.42:0/2275546396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb6c4101760 0x7fb6c419a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:06.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:06.174+0000 7fb6c3e00640 1 -- 172.21.15.42:0/2275546396 >> 172.21.15.42:0/2275546396 conn(0x7fb6c40fd4e0 msgr2=0x7fb6c410ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:06.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:06.175+0000 7fb6c3e00640 1 -- 172.21.15.42:0/2275546396 shutdown_connections 2024-08-26T00:01:06.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:06.175+0000 7fb6c3e00640 1 -- 172.21.15.42:0/2275546396 wait complete. 2024-08-26T00:01:06.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:06 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2275546396' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:01:06.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:06 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/2275546396' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:01:07.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:06 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/2275546396' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:01:07.061 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-08-26T00:01:07.062 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd dump --format=json 2024-08-26T00:01:07.446 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:07.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:07 smithi042 ceph-mon[17225]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-08-26T00:01:07.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:07 smithi181 ceph-mon[22102]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-08-26T00:01:08.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:07 smithi043 ceph-mon[22091]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-08-26T00:01:08.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.012+0000 7f9825200640 1 -- 172.21.15.42:0/509287646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9820103db0 msgr2=0x7f9820104190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:08.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.012+0000 7f9825200640 1 --2- 172.21.15.42:0/509287646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9820103db0 0x7f9820104190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9810009900 tx=0x7f981002a3f0 comp rx=0 tx=0).stop 2024-08-26T00:01:08.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.012+0000 7f9825200640 1 -- 172.21.15.42:0/509287646 shutdown_connections 2024-08-26T00:01:08.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.012+0000 7f9825200640 1 --2- 172.21.15.42:0/509287646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9820108ee0 0x7f9820110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:08.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.012+0000 7f9825200640 1 --2- 172.21.15.42:0/509287646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9820104760 0x7f98201087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:08.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.012+0000 7f9825200640 1 --2- 172.21.15.42:0/509287646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9820103db0 0x7f9820104190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:08.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.012+0000 7f9825200640 1 -- 172.21.15.42:0/509287646 >> 172.21.15.42:0/509287646 conn(0x7f98200ff7f0 msgr2=0x7f9820101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:08.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.012+0000 7f9825200640 1 -- 172.21.15.42:0/509287646 shutdown_connections 2024-08-26T00:01:08.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.013+0000 7f9825200640 1 -- 172.21.15.42:0/509287646 wait complete. 2024-08-26T00:01:08.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.013+0000 7f9825200640 1 Processor -- start 2024-08-26T00:01:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.014+0000 7f9825200640 1 -- start start 2024-08-26T00:01:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.014+0000 7f9825200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9820103db0 0x7f982019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.014+0000 7f9825200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9820104760 0x7f982019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.014+0000 7f9825200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9820108ee0 0x7f982019ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.014+0000 7f9825200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9820113f90 con 0x7f9820104760 2024-08-26T00:01:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.014+0000 7f9825200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9820113e10 con 0x7f9820108ee0 2024-08-26T00:01:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.014+0000 7f9825200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9820114110 con 0x7f9820103db0 2024-08-26T00:01:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.014+0000 7f9817e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9820104760 0x7f982019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.014+0000 7f9817e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9820104760 0x7f982019a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56398/0 (socket says 172.21.15.42:56398) 2024-08-26T00:01:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.014+0000 7f981de00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9820103db0 0x7f982019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.014+0000 7f9817e00640 1 -- 172.21.15.42:0/2721517882 learned_addr learned my addr 172.21.15.42:0/2721517882 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.014+0000 7f981e800640 1 --2- 172.21.15.42:0/2721517882 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9820108ee0 0x7f982019ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:08.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.015+0000 7f9817e00640 1 -- 172.21.15.42:0/2721517882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9820103db0 msgr2=0x7f982019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:08.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.015+0000 7f9817e00640 1 --2- 172.21.15.42:0/2721517882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9820103db0 0x7f982019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:08.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.015+0000 7f9817e00640 1 -- 172.21.15.42:0/2721517882 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9820108ee0 msgr2=0x7f982019ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:08.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.015+0000 7f9817e00640 1 --2- 172.21.15.42:0/2721517882 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9820108ee0 0x7f982019ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:08.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.015+0000 7f9817e00640 1 -- 172.21.15.42:0/2721517882 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982019f440 con 0x7f9820104760 2024-08-26T00:01:08.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.015+0000 7f981de00640 1 --2- 172.21.15.42:0/2721517882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9820103db0 0x7f982019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:08.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.015+0000 7f9817e00640 1 --2- 172.21.15.42:0/2721517882 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9820104760 0x7f982019a9d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f980800d950 tx=0x7f980800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:08.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.015+0000 7f9816a00640 1 -- 172.21.15.42:0/2721517882 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9808017030 con 0x7f9820104760 2024-08-26T00:01:08.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.016+0000 7f9816a00640 1 -- 172.21.15.42:0/2721517882 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9808004020 con 0x7f9820104760 2024-08-26T00:01:08.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.016+0000 7f9825200640 1 -- 172.21.15.42:0/2721517882 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f982019f730 con 0x7f9820104760 2024-08-26T00:01:08.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.016+0000 7f9816a00640 1 -- 172.21.15.42:0/2721517882 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98080047a0 con 0x7f9820104760 2024-08-26T00:01:08.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.016+0000 7f9825200640 1 -- 172.21.15.42:0/2721517882 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98201a7010 con 0x7f9820104760 2024-08-26T00:01:08.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.017+0000 7f9825200640 1 -- 172.21.15.42:0/2721517882 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9820104190 con 0x7f9820104760 2024-08-26T00:01:08.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.018+0000 7f9816a00640 1 -- 172.21.15.42:0/2721517882 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f98080041d0 con 0x7f9820104760 2024-08-26T00:01:08.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.020+0000 7f9816a00640 1 --2- 172.21.15.42:0/2721517882 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f98040a2c90 0x7f98040a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:08.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.020+0000 7f9816a00640 1 -- 172.21.15.42:0/2721517882 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f98080ce9e0 con 0x7f9820104760 2024-08-26T00:01:08.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.020+0000 7f981de00640 1 --2- 172.21.15.42:0/2721517882 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f98040a2c90 0x7f98040a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:08.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.021+0000 7f981de00640 1 --2- 172.21.15.42:0/2721517882 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f98040a2c90 0x7f98040a5150 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9810000c00 tx=0x7f9810031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:08.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.024+0000 7f9816a00640 1 -- 172.21.15.42:0/2721517882 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f980809b890 con 0x7f9820104760 2024-08-26T00:01:08.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.209+0000 7f9825200640 1 -- 172.21.15.42:0/2721517882 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f982010c120 con 0x7f9820104760 2024-08-26T00:01:08.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.211+0000 7f9816a00640 1 -- 172.21.15.42:0/2721517882 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22147 (secure 0 0 0) 0x7f980809b190 con 0x7f9820104760 2024-08-26T00:01:08.213 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:01:08.213 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":78,"fsid":"f89d317a-633c-11ef-bcd2-c7b262605968","created":"2024-08-25T23:52:39.598509+0000","modified":"2024-08-26T00:00:30.169413+0000","last_up_change":"2024-08-25T23:59:35.047575+0000","last_in_change":"2024-08-25T23:59:12.796940+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-25T23:55:51.022219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-26T00:00:25.606536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-26T00:00:28.322822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"980d8635-bca1-4c5a-b78e-4b44f9315d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6803","nonce":2657450248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6805","nonce":2657450248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6809","nonce":2657450248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6807","nonce":2657450248}]},"public_addr":"172.21.15.42:6803/2657450248","cluster_addr":"172.21.15.42:6805/2657450248","heartbeat_back_addr":"172.21.15.42:6809/2657450248","heartbeat_front_addr":"172.21.15.42:6807/2657450248","state":["exists","up"]},{"osd":1,"uuid":"e5f8dc3b-876a-4bdd-b6b0-b0d99d098d95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6801","nonce":2396081001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6803","nonce":2396081001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6807","nonce":2396081001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6805","nonce":2396081001}]},"public_addr":"172.21.15.43:6801/2396081001","cluster_addr":"172.21.15.43:6803/2396081001","heartbeat_back_addr":"172.21.15.43:6807/2396081001","heartbeat_front_addr":"172.21.15.43:6805/2396081001","state":["exists","up"]},{"osd":2,"uuid":"06eb25af-8e3d-4f90-bc24-28a9bc224c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6801","nonce":189987070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6803","nonce":189987070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6807","nonce":189987070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6805","nonce":189987070}]},"public_addr":"172.21.15.181:6801/189987070","cluster_addr":"172.21.15.181:6803/189987070","heartbeat_back_addr":"172.21.15.181:6807/189987070","heartbeat_front_addr":"172.21.15.181:6805/189987070","state":["exists","up"]},{"osd":3,"uuid":"c78dbc49-b5c7-4f82-be36-c76a89496520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6811","nonce":251017896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6813","nonce":251017896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6817","nonce":251017896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6815","nonce":251017896}]},"public_addr":"172.21.15.42:6811/251017896","cluster_addr":"172.21.15.42:6813/251017896","heartbeat_back_addr":"172.21.15.42:6817/251017896","heartbeat_front_addr":"172.21.15.42:6815/251017896","state":["exists","up"]},{"osd":4,"uuid":"ba633f66-25af-492f-bbf2-76032a4cd3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6809","nonce":1315420796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6811","nonce":1315420796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6815","nonce":1315420796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6813","nonce":1315420796}]},"public_addr":"172.21.15.43:6809/1315420796","cluster_addr":"172.21.15.43:6811/1315420796","heartbeat_back_addr":"172.21.15.43:6815/1315420796","heartbeat_front_addr":"172.21.15.43:6813/1315420796","state":["exists","up"]},{"osd":5,"uuid":"04e47ad9-21ba-43da-9793-d5cf83150dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6809","nonce":246971403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6811","nonce":246971403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6815","nonce":246971403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6813","nonce":246971403}]},"public_addr":"172.21.15.181:6809/246971403","cluster_addr":"172.21.15.181:6811/246971403","heartbeat_back_addr":"172.21.15.181:6815/246971403","heartbeat_front_addr":"172.21.15.181:6813/246971403","state":["exists","up"]},{"osd":6,"uuid":"f48161cd-bc44-4d99-8248-1bb845111129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6819","nonce":2910656480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6821","nonce":2910656480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6825","nonce":2910656480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6823","nonce":2910656480}]},"public_addr":"172.21.15.42:6819/2910656480","cluster_addr":"172.21.15.42:6821/2910656480","heartbeat_back_addr":"172.21.15.42:6825/2910656480","heartbeat_front_addr":"172.21.15.42:6823/2910656480","state":["exists","up"]},{"osd":7,"uuid":"65470b06-b14d-4d8e-9bcb-e6927c37fda5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6817","nonce":624542778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6819","nonce":624542778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6823","nonce":624542778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6821","nonce":624542778}]},"public_addr":"172.21.15.43:6817/624542778","cluster_addr":"172.21.15.43:6819/624542778","heartbeat_back_addr":"172.21.15.43:6823/624542778","heartbeat_front_addr":"172.21.15.43:6821/624542778","state":["exists","up"]},{"osd":8,"uuid":"1f4c9152-4b7c-415f-9cb9-d1e926fad5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6817","nonce":728226568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6819","nonce":728226568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6823","nonce":728226568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6821","nonce":728226568}]},"public_addr":"172.21.15.181:6817/728226568","cluster_addr":"172.21.15.181:6819/728226568","heartbeat_back_addr":"172.21.15.181:6823/728226568","heartbeat_front_addr":"172.21.15.181:6821/728226568","state":["exists","up"]},{"osd":9,"uuid":"fb387fbe-19b4-4a3e-8e40-81bd1363b55c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6827","nonce":1052069444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6829","nonce":1052069444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6833","nonce":1052069444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6831","nonce":1052069444}]},"public_addr":"172.21.15.42:6827/1052069444","cluster_addr":"172.21.15.42:6829/1052069444","heartbeat_back_addr":"172.21.15.42:6833/1052069444","heartbeat_front_addr":"172.21.15.42:6831/1052069444","state":["exists","up"]},{"osd":10,"uuid":"fe5bbeec-2341-4ea9-97ab-cc45d738d741","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6825","nonce":3417487386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6827","nonce":3417487386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6831","nonce":3417487386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6829","nonce":3417487386}]},"public_addr":"172.21.15.43:6825/3417487386","cluster_addr":"172.21.15.43:6827/3417487386","heartbeat_back_addr":"172.21.15.43:6831/3417487386","heartbeat_front_addr":"172.21.15.43:6829/3417487386","state":["exists","up"]},{"osd":11,"uuid":"cee07741-3ab7-481e-8477-54319f4f178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6825","nonce":3817502913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6827","nonce":3817502913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6831","nonce":3817502913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6829","nonce":3817502913}]},"public_addr":"172.21.15.181:6825/3817502913","cluster_addr":"172.21.15.181:6827/3817502913","heartbeat_back_addr":"172.21.15.181:6831/3817502913","heartbeat_front_addr":"172.21.15.181:6829/3817502913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:00.603592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:24.637326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:47.587859+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:14.978783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:39.025819+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:01.965471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:29.753475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:54.162377+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:17.970871+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:46.175576+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:10.590220+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:33.216701+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/3711239085":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6801/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2983166615":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/2974122891":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2980210051":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/4227793902":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6801/1517739376":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6800/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/1775009918":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6800/1517739376":"2024-08-26T23:53:05.122858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-26T00:01:08.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.214+0000 7f9825200640 1 -- 172.21.15.42:0/2721517882 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f98040a2c90 msgr2=0x7f98040a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:08.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.214+0000 7f9825200640 1 --2- 172.21.15.42:0/2721517882 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f98040a2c90 0x7f98040a5150 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9810000c00 tx=0x7f9810031510 comp rx=0 tx=0).stop 2024-08-26T00:01:08.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.214+0000 7f9825200640 1 -- 172.21.15.42:0/2721517882 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9820104760 msgr2=0x7f982019a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:08.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.214+0000 7f9825200640 1 --2- 172.21.15.42:0/2721517882 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9820104760 0x7f982019a9d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f980800d950 tx=0x7f980800de10 comp rx=0 tx=0).stop 2024-08-26T00:01:08.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.214+0000 7f9825200640 1 -- 172.21.15.42:0/2721517882 shutdown_connections 2024-08-26T00:01:08.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.214+0000 7f9825200640 1 --2- 172.21.15.42:0/2721517882 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f98040a2c90 0x7f98040a5150 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:08.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.214+0000 7f9825200640 1 --2- 172.21.15.42:0/2721517882 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9820108ee0 0x7f982019ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:08.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.214+0000 7f9825200640 1 --2- 172.21.15.42:0/2721517882 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9820104760 0x7f982019a9d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:08.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.214+0000 7f9825200640 1 --2- 172.21.15.42:0/2721517882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9820103db0 0x7f982019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:08.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.214+0000 7f9825200640 1 -- 172.21.15.42:0/2721517882 >> 172.21.15.42:0/2721517882 conn(0x7f98200ff7f0 msgr2=0x7f9820100b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:08.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.214+0000 7f9825200640 1 -- 172.21.15.42:0/2721517882 shutdown_connections 2024-08-26T00:01:08.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:08.214+0000 7f9825200640 1 -- 172.21.15.42:0/2721517882 wait complete. 2024-08-26T00:01:08.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:08 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/2721517882' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:01:08.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:08 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2721517882' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:01:09.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:08 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/2721517882' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:01:09.059 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-08-26T00:01:09.060 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-08-26T00:01:09.060 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-08-26T00:01:09.061 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-08-26T00:01:09.061 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-08-26T00:01:09.061 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-08-26T00:01:09.062 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-08-26T00:01:09.062 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-08-26T00:01:09.063 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-08-26T00:01:09.063 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-08-26T00:01:09.063 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-08-26T00:01:09.064 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-08-26T00:01:09.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:09 smithi042 ceph-mon[17225]: pgmap v296: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-08-26T00:01:09.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:09 smithi181 ceph-mon[22102]: pgmap v296: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-08-26T00:01:10.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:09 smithi043 ceph-mon[22091]: pgmap v296: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-08-26T00:01:10.123 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:10.123 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:10.124 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:10.144 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:10.147 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:10.155 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:10.275 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:11.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.994+0000 7ff96fe00640 1 -- 172.21.15.42:0/1028324819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff970074c80 msgr2=0x7ff97010dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:11.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.994+0000 7ff96fe00640 1 --2- 172.21.15.42:0/1028324819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff970074c80 0x7ff97010dac0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009900 tx=0x7ff95c02a480 comp rx=0 tx=0).stop 2024-08-26T00:01:11.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.994+0000 7ff96fe00640 1 -- 172.21.15.42:0/1028324819 shutdown_connections 2024-08-26T00:01:11.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.994+0000 7ff96fe00640 1 --2- 172.21.15.42:0/1028324819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff97010e000 0x7ff9701103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:11.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.994+0000 7ff96fe00640 1 --2- 172.21.15.42:0/1028324819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff970074c80 0x7ff97010dac0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:11.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.994+0000 7ff96fe00640 1 --2- 172.21.15.42:0/1028324819 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff970074360 0x7ff970074740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:11.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.994+0000 7ff96fe00640 1 -- 172.21.15.42:0/1028324819 >> 172.21.15.42:0/1028324819 conn(0x7ff9700fd4e0 msgr2=0x7ff9700ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.994+0000 7ff96fe00640 1 -- 172.21.15.42:0/1028324819 shutdown_connections 2024-08-26T00:01:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.994+0000 7ff96fe00640 1 -- 172.21.15.42:0/1028324819 wait complete. 2024-08-26T00:01:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.995+0000 7ff96fe00640 1 Processor -- start 2024-08-26T00:01:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.996+0000 7ff96fe00640 1 -- start start 2024-08-26T00:01:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.996+0000 7ff96fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff970074360 0x7ff97019a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.996+0000 7ff96fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff970074c80 0x7ff97019a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.996+0000 7ff96fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff97010e000 0x7ff97019eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.996+0000 7ff96fe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff970113da0 con 0x7ff970074c80 2024-08-26T00:01:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.996+0000 7ff96fe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff970113c20 con 0x7ff97010e000 2024-08-26T00:01:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.996+0000 7ff96fe00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff970113f20 con 0x7ff970074360 2024-08-26T00:01:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.996+0000 7ff96ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff970074360 0x7ff97019a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.996+0000 7ff96ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff970074360 0x7ff97019a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:38708/0 (socket says 172.21.15.42:38708) 2024-08-26T00:01:11.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.996+0000 7ff96e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff970074c80 0x7ff97019a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:11.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.996+0000 7ff96ea00640 1 -- 172.21.15.42:0/3442780763 learned_addr learned my addr 172.21.15.42:0/3442780763 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:11.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.997+0000 7ff96f400640 1 --2- 172.21.15.42:0/3442780763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff97010e000 0x7ff97019eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:11.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.997+0000 7ff96ea00640 1 -- 172.21.15.42:0/3442780763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff97010e000 msgr2=0x7ff97019eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:11.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.997+0000 7ff96ea00640 1 --2- 172.21.15.42:0/3442780763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff97010e000 0x7ff97019eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:11.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.997+0000 7ff96ea00640 1 -- 172.21.15.42:0/3442780763 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff970074c80 msgr2=0x7ff97019a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:11.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.997+0000 7ff96ea00640 1 --2- 172.21.15.42:0/3442780763 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff970074c80 0x7ff97019a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:11.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.997+0000 7ff96ea00640 1 -- 172.21.15.42:0/3442780763 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff97019f250 con 0x7ff970074360 2024-08-26T00:01:11.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.997+0000 7ff96ea00640 1 --2- 172.21.15.42:0/3442780763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff970074360 0x7ff97019a2a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff96000d950 tx=0x7ff96000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:11.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.997+0000 7ff967400640 1 -- 172.21.15.42:0/3442780763 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff960017030 con 0x7ff970074360 2024-08-26T00:01:11.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.997+0000 7ff967400640 1 -- 172.21.15.42:0/3442780763 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff960004020 con 0x7ff970074360 2024-08-26T00:01:11.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.997+0000 7ff96fe00640 1 -- 172.21.15.42:0/3442780763 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff97019f540 con 0x7ff970074360 2024-08-26T00:01:11.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.997+0000 7ff967400640 1 -- 172.21.15.42:0/3442780763 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9600047a0 con 0x7ff970074360 2024-08-26T00:01:11.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.998+0000 7ff96fe00640 1 -- 172.21.15.42:0/3442780763 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9701a6e20 con 0x7ff970074360 2024-08-26T00:01:11.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:10.998+0000 7ff96fe00640 1 -- 172.21.15.42:0/3442780763 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff9700626e0 con 0x7ff970074360 2024-08-26T00:01:11.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.000+0000 7ff967400640 1 -- 172.21.15.42:0/3442780763 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff9600041d0 con 0x7ff970074360 2024-08-26T00:01:11.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.002+0000 7ff967400640 1 --2- 172.21.15.42:0/3442780763 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff9540a2c10 0x7ff9540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:11.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.002+0000 7ff967400640 1 -- 172.21.15.42:0/3442780763 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7ff9600cf110 con 0x7ff970074360 2024-08-26T00:01:11.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.002+0000 7ff96e000640 1 --2- 172.21.15.42:0/3442780763 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff9540a2c10 0x7ff9540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:11.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.002+0000 7ff967400640 1 --2- 172.21.15.42:0/3442780763 >> [v2:172.21.15.43:6816/624542778,v1:172.21.15.43:6817/624542778] conn(0x7ff9540ac460 0x7ff9540ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:11.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.002+0000 7ff967400640 1 -- 172.21.15.42:0/3442780763 --> [v2:172.21.15.43:6816/624542778,v1:172.21.15.43:6817/624542778] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9540aef30 con 0x7ff9540ac460 2024-08-26T00:01:11.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.002+0000 7ff967400640 1 -- 172.21.15.42:0/3442780763 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7ff9600cf4c0 con 0x7ff970074360 2024-08-26T00:01:11.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.003+0000 7ff96f400640 1 --2- 172.21.15.42:0/3442780763 >> [v2:172.21.15.43:6816/624542778,v1:172.21.15.43:6817/624542778] conn(0x7ff9540ac460 0x7ff9540ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:11.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.003+0000 7ff96e000640 1 --2- 172.21.15.42:0/3442780763 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff9540a2c10 0x7ff9540a50d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff95c000c00 tx=0x7ff95c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:11.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.003+0000 7ff96f400640 1 --2- 172.21.15.42:0/3442780763 >> [v2:172.21.15.43:6816/624542778,v1:172.21.15.43:6817/624542778] conn(0x7ff9540ac460 0x7ff9540ae880 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:11.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.004+0000 7ff967400640 1 -- 172.21.15.42:0/3442780763 <== osd.7 v2:172.21.15.43:6816/624542778 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9540aef30 con 0x7ff9540ac460 2024-08-26T00:01:11.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.019+0000 7ff96fe00640 1 -- 172.21.15.42:0/3442780763 --> [v2:172.21.15.43:6816/624542778,v1:172.21.15.43:6817/624542778] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff970062ae0 con 0x7ff9540ac460 2024-08-26T00:01:11.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.019+0000 7ff967400640 1 -- 172.21.15.42:0/3442780763 <== osd.7 v2:172.21.15.43:6816/624542778 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff970062ae0 con 0x7ff9540ac460 2024-08-26T00:01:11.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.020+0000 7ff96fe00640 1 -- 172.21.15.42:0/3442780763 >> [v2:172.21.15.43:6816/624542778,v1:172.21.15.43:6817/624542778] conn(0x7ff9540ac460 msgr2=0x7ff9540ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:11.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.020+0000 7ff96fe00640 1 --2- 172.21.15.42:0/3442780763 >> [v2:172.21.15.43:6816/624542778,v1:172.21.15.43:6817/624542778] conn(0x7ff9540ac460 0x7ff9540ae880 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:11.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.020+0000 7ff96fe00640 1 -- 172.21.15.42:0/3442780763 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff9540a2c10 msgr2=0x7ff9540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:11.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.020+0000 7ff96fe00640 1 --2- 172.21.15.42:0/3442780763 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff9540a2c10 0x7ff9540a50d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff95c000c00 tx=0x7ff95c005b50 comp rx=0 tx=0).stop 2024-08-26T00:01:11.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.020+0000 7ff96fe00640 1 -- 172.21.15.42:0/3442780763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff970074360 msgr2=0x7ff97019a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:11.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.020+0000 7ff96fe00640 1 --2- 172.21.15.42:0/3442780763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff970074360 0x7ff97019a2a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff96000d950 tx=0x7ff96000de10 comp rx=0 tx=0).stop 2024-08-26T00:01:11.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.020+0000 7ff96f400640 1 -- 172.21.15.42:0/3442780763 reap_dead start 2024-08-26T00:01:11.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.020+0000 7ff96fe00640 1 -- 172.21.15.42:0/3442780763 shutdown_connections 2024-08-26T00:01:11.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.020+0000 7ff96fe00640 1 -- 172.21.15.42:0/3442780763 >> 172.21.15.42:0/3442780763 conn(0x7ff9700fd4e0 msgr2=0x7ff9700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:11.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.020+0000 7ff96fe00640 1 -- 172.21.15.42:0/3442780763 shutdown_connections 2024-08-26T00:01:11.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.020+0000 7ff96fe00640 1 -- 172.21.15.42:0/3442780763 wait complete. 2024-08-26T00:01:11.321 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:11.322 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:11.322 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:11.323 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:11.323 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:11.702 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:11 smithi042 ceph-mon[17225]: pgmap v297: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-08-26T00:01:11.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:11 smithi181 ceph-mon[22102]: pgmap v297: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-08-26T00:01:12.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:11 smithi043 ceph-mon[22091]: pgmap v297: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-08-26T00:01:12.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.761+0000 7f9ef1400640 1 -- 172.21.15.42:0/2027481279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9eec1044f0 msgr2=0x7f9eec1109d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:12.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.761+0000 7f9ef1400640 1 --2- 172.21.15.42:0/2027481279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9eec1044f0 0x7f9eec1109d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009c10 tx=0x7f9ee402a6f0 comp rx=0 tx=0).stop 2024-08-26T00:01:12.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.761+0000 7f9ef1400640 1 -- 172.21.15.42:0/2027481279 shutdown_connections 2024-08-26T00:01:12.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.761+0000 7f9ef1400640 1 --2- 172.21.15.42:0/2027481279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9eec1044f0 0x7f9eec1109d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:12.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.761+0000 7f9ef1400640 1 --2- 172.21.15.42:0/2027481279 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9eec103b50 0x7f9eec103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:12.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.761+0000 7f9ef1400640 1 --2- 172.21.15.42:0/2027481279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9eec109c00 0x7f9eec109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:12.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.761+0000 7f9ef1400640 1 -- 172.21.15.42:0/2027481279 >> 172.21.15.42:0/2027481279 conn(0x7f9eec0ff830 msgr2=0x7f9eec101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:12.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.761+0000 7f9ef1400640 1 -- 172.21.15.42:0/2027481279 shutdown_connections 2024-08-26T00:01:12.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.761+0000 7f9ef1400640 1 -- 172.21.15.42:0/2027481279 wait complete. 2024-08-26T00:01:12.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.762+0000 7f9ef1400640 1 Processor -- start 2024-08-26T00:01:12.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.762+0000 7f9ef1400640 1 -- start start 2024-08-26T00:01:12.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.763+0000 7f9ef1400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9eec103b50 0x7f9eec19a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:12.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.763+0000 7f9ef1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9eec1044f0 0x7f9eec19a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:12.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.763+0000 7f9ef1400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9eec109c00 0x7f9eec19ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:12.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.763+0000 7f9ef1400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec113f60 con 0x7f9eec1044f0 2024-08-26T00:01:12.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.763+0000 7f9ef1400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec113de0 con 0x7f9eec103b50 2024-08-26T00:01:12.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.763+0000 7f9ef1400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec1140e0 con 0x7f9eec109c00 2024-08-26T00:01:12.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.763+0000 7f9ee9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9eec1044f0 0x7f9eec19a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:12.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.763+0000 7f9eea800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9eec103b50 0x7f9eec19a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:12.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.763+0000 7f9eea800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9eec103b50 0x7f9eec19a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:60662/0 (socket says 172.21.15.42:60662) 2024-08-26T00:01:12.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.763+0000 7f9eea800640 1 -- 172.21.15.42:0/1137223856 learned_addr learned my addr 172.21.15.42:0/1137223856 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:12.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.763+0000 7f9eeb200640 1 --2- 172.21.15.42:0/1137223856 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9eec109c00 0x7f9eec19ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:12.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.763+0000 7f9ee9e00640 1 -- 172.21.15.42:0/1137223856 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9eec109c00 msgr2=0x7f9eec19ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:12.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.763+0000 7f9ee9e00640 1 --2- 172.21.15.42:0/1137223856 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9eec109c00 0x7f9eec19ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:12.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.763+0000 7f9ee9e00640 1 -- 172.21.15.42:0/1137223856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9eec103b50 msgr2=0x7f9eec19a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:12.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.763+0000 7f9ee9e00640 1 --2- 172.21.15.42:0/1137223856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9eec103b50 0x7f9eec19a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:12.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.763+0000 7f9ee9e00640 1 -- 172.21.15.42:0/1137223856 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eec19f370 con 0x7f9eec1044f0 2024-08-26T00:01:12.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.764+0000 7f9ee9e00640 1 --2- 172.21.15.42:0/1137223856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9eec1044f0 0x7f9eec19a900 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800e9f0 tx=0x7f9ed800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:12.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.764+0000 7f9ee3400640 1 -- 172.21.15.42:0/1137223856 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed800ccc0 con 0x7f9eec1044f0 2024-08-26T00:01:12.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.764+0000 7f9ee3400640 1 -- 172.21.15.42:0/1137223856 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ed8010910 con 0x7f9eec1044f0 2024-08-26T00:01:12.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.764+0000 7f9ef1400640 1 -- 172.21.15.42:0/1137223856 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eec19f660 con 0x7f9eec1044f0 2024-08-26T00:01:12.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.764+0000 7f9ee3400640 1 -- 172.21.15.42:0/1137223856 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8018960 con 0x7f9eec1044f0 2024-08-26T00:01:12.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.764+0000 7f9ef1400640 1 -- 172.21.15.42:0/1137223856 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eec1a6f40 con 0x7f9eec1044f0 2024-08-26T00:01:12.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.765+0000 7f9ef1400640 1 -- 172.21.15.42:0/1137223856 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9eec062720 con 0x7f9eec1044f0 2024-08-26T00:01:12.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.767+0000 7f9ee3400640 1 -- 172.21.15.42:0/1137223856 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9ed8010ac0 con 0x7f9eec1044f0 2024-08-26T00:01:12.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.768+0000 7f9ee3400640 1 --2- 172.21.15.42:0/1137223856 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9ed00a2c90 0x7f9ed00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:12.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.768+0000 7f9ee3400640 1 -- 172.21.15.42:0/1137223856 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f9ed80cfcf0 con 0x7f9eec1044f0 2024-08-26T00:01:12.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.769+0000 7f9eea800640 1 --2- 172.21.15.42:0/1137223856 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9ed00a2c90 0x7f9ed00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:12.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.769+0000 7f9ee3400640 1 --2- 172.21.15.42:0/1137223856 >> [v2:172.21.15.181:6816/728226568,v1:172.21.15.181:6817/728226568] conn(0x7f9ed00ac4e0 0x7f9ed00ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:12.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.769+0000 7f9ee3400640 1 -- 172.21.15.42:0/1137223856 --> [v2:172.21.15.181:6816/728226568,v1:172.21.15.181:6817/728226568] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ed8028ea0 con 0x7f9ed00ac4e0 2024-08-26T00:01:12.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.769+0000 7f9ee3400640 1 -- 172.21.15.42:0/1137223856 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f9ed80d00a0 con 0x7f9eec1044f0 2024-08-26T00:01:12.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.769+0000 7f9eeb200640 1 --2- 172.21.15.42:0/1137223856 >> [v2:172.21.15.181:6816/728226568,v1:172.21.15.181:6817/728226568] conn(0x7f9ed00ac4e0 0x7f9ed00ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:12.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.769+0000 7f9eea800640 1 --2- 172.21.15.42:0/1137223856 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9ed00a2c90 0x7f9ed00a5150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0096c0 tx=0x7f9edc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:12.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.770+0000 7f9eeb200640 1 --2- 172.21.15.42:0/1137223856 >> [v2:172.21.15.181:6816/728226568,v1:172.21.15.181:6817/728226568] conn(0x7f9ed00ac4e0 0x7f9ed00ae900 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:12.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.771+0000 7f9ee3400640 1 -- 172.21.15.42:0/1137223856 <== osd.8 v2:172.21.15.181:6816/728226568 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ed8028ea0 con 0x7f9ed00ac4e0 2024-08-26T00:01:12.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.785+0000 7f9ef1400640 1 -- 172.21.15.42:0/1137223856 --> [v2:172.21.15.181:6816/728226568,v1:172.21.15.181:6817/728226568] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9eec062b20 con 0x7f9ed00ac4e0 2024-08-26T00:01:12.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.786+0000 7f9ee3400640 1 -- 172.21.15.42:0/1137223856 <== osd.8 v2:172.21.15.181:6816/728226568 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9eec062b20 con 0x7f9ed00ac4e0 2024-08-26T00:01:12.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.786+0000 7f9ef1400640 1 -- 172.21.15.42:0/1137223856 >> [v2:172.21.15.181:6816/728226568,v1:172.21.15.181:6817/728226568] conn(0x7f9ed00ac4e0 msgr2=0x7f9ed00ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:12.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.786+0000 7f9ef1400640 1 --2- 172.21.15.42:0/1137223856 >> [v2:172.21.15.181:6816/728226568,v1:172.21.15.181:6817/728226568] conn(0x7f9ed00ac4e0 0x7f9ed00ae900 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:12.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.786+0000 7f9ef1400640 1 -- 172.21.15.42:0/1137223856 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9ed00a2c90 msgr2=0x7f9ed00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:12.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.786+0000 7f9ef1400640 1 --2- 172.21.15.42:0/1137223856 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9ed00a2c90 0x7f9ed00a5150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0096c0 tx=0x7f9edc009260 comp rx=0 tx=0).stop 2024-08-26T00:01:12.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.786+0000 7f9ef1400640 1 -- 172.21.15.42:0/1137223856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9eec1044f0 msgr2=0x7f9eec19a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:12.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.786+0000 7f9ef1400640 1 --2- 172.21.15.42:0/1137223856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9eec1044f0 0x7f9eec19a900 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800e9f0 tx=0x7f9ed800eeb0 comp rx=0 tx=0).stop 2024-08-26T00:01:12.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.786+0000 7f9eeb200640 1 -- 172.21.15.42:0/1137223856 reap_dead start 2024-08-26T00:01:12.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.786+0000 7f9ef1400640 1 -- 172.21.15.42:0/1137223856 shutdown_connections 2024-08-26T00:01:12.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.786+0000 7f9ef1400640 1 -- 172.21.15.42:0/1137223856 >> 172.21.15.42:0/1137223856 conn(0x7f9eec0ff830 msgr2=0x7f9eec100f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:12.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.787+0000 7f9ef1400640 1 -- 172.21.15.42:0/1137223856 shutdown_connections 2024-08-26T00:01:12.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.787+0000 7f9ef1400640 1 -- 172.21.15.42:0/1137223856 wait complete. 2024-08-26T00:01:12.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.994+0000 7efe95000640 1 -- 172.21.15.42:0/1480656840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe90103970 msgr2=0x7efe90103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:12.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.994+0000 7efe95000640 1 --2- 172.21.15.42:0/1480656840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe90103970 0x7efe90103dd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efe78009930 tx=0x7efe7802a420 comp rx=0 tx=0).stop 2024-08-26T00:01:12.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.994+0000 7efe95000640 1 -- 172.21.15.42:0/1480656840 shutdown_connections 2024-08-26T00:01:12.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.994+0000 7efe95000640 1 --2- 172.21.15.42:0/1480656840 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe90104310 0x7efe90110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:12.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.994+0000 7efe95000640 1 --2- 172.21.15.42:0/1480656840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe90103970 0x7efe90103dd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:12.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.994+0000 7efe95000640 1 --2- 172.21.15.42:0/1480656840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe90109970 0x7efe90109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:12.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.994+0000 7efe95000640 1 -- 172.21.15.42:0/1480656840 >> 172.21.15.42:0/1480656840 conn(0x7efe900ff670 msgr2=0x7efe90101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:12.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.995+0000 7efe95000640 1 -- 172.21.15.42:0/1480656840 shutdown_connections 2024-08-26T00:01:12.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.995+0000 7efe95000640 1 -- 172.21.15.42:0/1480656840 wait complete. 2024-08-26T00:01:12.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.995+0000 7efe95000640 1 Processor -- start 2024-08-26T00:01:12.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.996+0000 7efe95000640 1 -- start start 2024-08-26T00:01:12.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.996+0000 7efe95000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe90103970 0x7efe9019a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:12.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.996+0000 7efe95000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe90104310 0x7efe9019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:12.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.996+0000 7efe95000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe90109970 0x7efe9019eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:12.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.996+0000 7efe95000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efe90113d90 con 0x7efe90103970 2024-08-26T00:01:12.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.996+0000 7efe95000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efe90113c10 con 0x7efe90109970 2024-08-26T00:01:12.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.996+0000 7efe95000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efe90113f10 con 0x7efe90104310 2024-08-26T00:01:12.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.996+0000 7efe8f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe90103970 0x7efe9019a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:12.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.996+0000 7efe8f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe90103970 0x7efe9019a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56482/0 (socket says 172.21.15.42:56482) 2024-08-26T00:01:12.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.996+0000 7efe8f400640 1 -- 172.21.15.42:0/2870801707 learned_addr learned my addr 172.21.15.42:0/2870801707 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:12.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.996+0000 7efe87e00640 1 --2- 172.21.15.42:0/2870801707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe90104310 0x7efe9019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:12.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.996+0000 7efe8fe00640 1 --2- 172.21.15.42:0/2870801707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe90109970 0x7efe9019eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:12.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.997+0000 7efe8f400640 1 -- 172.21.15.42:0/2870801707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe90104310 msgr2=0x7efe9019a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:12.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.997+0000 7efe8f400640 1 --2- 172.21.15.42:0/2870801707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe90104310 0x7efe9019a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:12.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.997+0000 7efe8f400640 1 -- 172.21.15.42:0/2870801707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe90109970 msgr2=0x7efe9019eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:13.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.997+0000 7efe8f400640 1 --2- 172.21.15.42:0/2870801707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe90109970 0x7efe9019eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:13.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.997+0000 7efe8f400640 1 -- 172.21.15.42:0/2870801707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9019f200 con 0x7efe90103970 2024-08-26T00:01:13.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.997+0000 7efe8f400640 1 --2- 172.21.15.42:0/2870801707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe90103970 0x7efe9019a250 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efe8000e9f0 tx=0x7efe8000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:13.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.997+0000 7efe8cc00640 1 -- 172.21.15.42:0/2870801707 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8000cd80 con 0x7efe90103970 2024-08-26T00:01:13.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.997+0000 7efe8cc00640 1 -- 172.21.15.42:0/2870801707 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe80010910 con 0x7efe90103970 2024-08-26T00:01:13.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.997+0000 7efe95000640 1 -- 172.21.15.42:0/2870801707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe9019f4f0 con 0x7efe90103970 2024-08-26T00:01:13.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.997+0000 7efe8cc00640 1 -- 172.21.15.42:0/2870801707 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe80018990 con 0x7efe90103970 2024-08-26T00:01:13.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.998+0000 7efe95000640 1 -- 172.21.15.42:0/2870801707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe901a6dd0 con 0x7efe90103970 2024-08-26T00:01:13.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.998+0000 7efe95000640 1 -- 172.21.15.42:0/2870801707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efe900626a0 con 0x7efe90103970 2024-08-26T00:01:13.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.001+0000 7efe8cc00640 1 -- 172.21.15.42:0/2870801707 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7efe80010ac0 con 0x7efe90103970 2024-08-26T00:01:13.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.002+0000 7efe8cc00640 1 --2- 172.21.15.42:0/2870801707 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7efe740a2c10 0x7efe740a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:13.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.002+0000 7efe8cc00640 1 -- 172.21.15.42:0/2870801707 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7efe800cfa60 con 0x7efe90103970 2024-08-26T00:01:13.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.002+0000 7efe87e00640 1 --2- 172.21.15.42:0/2870801707 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7efe740a2c10 0x7efe740a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:13.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.002+0000 7efe8cc00640 1 --2- 172.21.15.42:0/2870801707 >> [v2:172.21.15.42:6810/251017896,v1:172.21.15.42:6811/251017896] conn(0x7efe740ac460 0x7efe740ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:13.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.002+0000 7efe8cc00640 1 -- 172.21.15.42:0/2870801707 --> [v2:172.21.15.42:6810/251017896,v1:172.21.15.42:6811/251017896] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efe80010760 con 0x7efe740ac460 2024-08-26T00:01:13.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.002+0000 7efe8cc00640 1 -- 172.21.15.42:0/2870801707 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7efe800cfe10 con 0x7efe90103970 2024-08-26T00:01:13.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.003+0000 7efe8fe00640 1 --2- 172.21.15.42:0/2870801707 >> [v2:172.21.15.42:6810/251017896,v1:172.21.15.42:6811/251017896] conn(0x7efe740ac460 0x7efe740ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:13.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.003+0000 7efe87e00640 1 --2- 172.21.15.42:0/2870801707 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7efe740a2c10 0x7efe740a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efe78006010 tx=0x7efe78000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:13.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.003+0000 7efe8fe00640 1 --2- 172.21.15.42:0/2870801707 >> [v2:172.21.15.42:6810/251017896,v1:172.21.15.42:6811/251017896] conn(0x7efe740ac460 0x7efe740ae880 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:13.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.004+0000 7efe8cc00640 1 -- 172.21.15.42:0/2870801707 <== osd.3 v2:172.21.15.42:6810/251017896 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efe80010760 con 0x7efe740ac460 2024-08-26T00:01:13.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.019+0000 7efe95000640 1 -- 172.21.15.42:0/2870801707 --> [v2:172.21.15.42:6810/251017896,v1:172.21.15.42:6811/251017896] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efe90062b20 con 0x7efe740ac460 2024-08-26T00:01:13.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.020+0000 7efe8cc00640 1 -- 172.21.15.42:0/2870801707 <== osd.3 v2:172.21.15.42:6810/251017896 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efe90062b20 con 0x7efe740ac460 2024-08-26T00:01:13.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.020+0000 7efe95000640 1 -- 172.21.15.42:0/2870801707 >> [v2:172.21.15.42:6810/251017896,v1:172.21.15.42:6811/251017896] conn(0x7efe740ac460 msgr2=0x7efe740ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:13.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.020+0000 7efe95000640 1 --2- 172.21.15.42:0/2870801707 >> [v2:172.21.15.42:6810/251017896,v1:172.21.15.42:6811/251017896] conn(0x7efe740ac460 0x7efe740ae880 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:13.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.020+0000 7efe95000640 1 -- 172.21.15.42:0/2870801707 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7efe740a2c10 msgr2=0x7efe740a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:13.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.020+0000 7efe95000640 1 --2- 172.21.15.42:0/2870801707 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7efe740a2c10 0x7efe740a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efe78006010 tx=0x7efe78000bc0 comp rx=0 tx=0).stop 2024-08-26T00:01:13.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.020+0000 7efe95000640 1 -- 172.21.15.42:0/2870801707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe90103970 msgr2=0x7efe9019a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:13.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.020+0000 7efe95000640 1 --2- 172.21.15.42:0/2870801707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe90103970 0x7efe9019a250 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efe8000e9f0 tx=0x7efe8000eeb0 comp rx=0 tx=0).stop 2024-08-26T00:01:13.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.020+0000 7efe8fe00640 1 -- 172.21.15.42:0/2870801707 reap_dead start 2024-08-26T00:01:13.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.020+0000 7efe95000640 1 -- 172.21.15.42:0/2870801707 shutdown_connections 2024-08-26T00:01:13.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.020+0000 7efe95000640 1 -- 172.21.15.42:0/2870801707 >> 172.21.15.42:0/2870801707 conn(0x7efe900ff670 msgr2=0x7efe900ffd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:13.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.020+0000 7efe95000640 1 -- 172.21.15.42:0/2870801707 shutdown_connections 2024-08-26T00:01:13.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.020+0000 7efe95000640 1 -- 172.21.15.42:0/2870801707 wait complete. 2024-08-26T00:01:13.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.506+0000 7fb131e00640 1 -- 172.21.15.42:0/1240323852 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb12c103970 msgr2=0x7fb12c103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:13.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.506+0000 7fb131e00640 1 --2- 172.21.15.42:0/1240323852 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb12c103970 0x7fb12c103dd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb118009930 tx=0x7fb11802a420 comp rx=0 tx=0).stop 2024-08-26T00:01:13.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.506+0000 7fb131e00640 1 -- 172.21.15.42:0/1240323852 shutdown_connections 2024-08-26T00:01:13.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.506+0000 7fb131e00640 1 --2- 172.21.15.42:0/1240323852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb12c104310 0x7fb12c110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:13.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.506+0000 7fb131e00640 1 --2- 172.21.15.42:0/1240323852 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb12c103970 0x7fb12c103dd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:13.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.506+0000 7fb131e00640 1 --2- 172.21.15.42:0/1240323852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb12c109970 0x7fb12c109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:13.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.506+0000 7fb131e00640 1 -- 172.21.15.42:0/1240323852 >> 172.21.15.42:0/1240323852 conn(0x7fb12c0ff670 msgr2=0x7fb12c101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:13.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.506+0000 7fb131e00640 1 -- 172.21.15.42:0/1240323852 shutdown_connections 2024-08-26T00:01:13.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.506+0000 7fb131e00640 1 -- 172.21.15.42:0/1240323852 wait complete. 2024-08-26T00:01:13.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.507+0000 7fb131e00640 1 Processor -- start 2024-08-26T00:01:13.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.508+0000 7fb131e00640 1 -- start start 2024-08-26T00:01:13.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.508+0000 7fb131e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb12c103970 0x7fb12c19a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:13.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.508+0000 7fb131e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb12c104310 0x7fb12c19a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:13.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.508+0000 7fb131e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb12c109970 0x7fb12c19eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:13.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.508+0000 7fb131e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb12c113d70 con 0x7fb12c104310 2024-08-26T00:01:13.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.508+0000 7fb131e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb12c113bf0 con 0x7fb12c103970 2024-08-26T00:01:13.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.508+0000 7fb131e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb12c113ef0 con 0x7fb12c109970 2024-08-26T00:01:13.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.508+0000 7fb130a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb12c103970 0x7fb12c19a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:13.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.508+0000 7fb130a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb12c103970 0x7fb12c19a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:60698/0 (socket says 172.21.15.42:60698) 2024-08-26T00:01:13.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.508+0000 7fb131400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb12c109970 0x7fb12c19eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:13.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.508+0000 7fb130a00640 1 -- 172.21.15.42:0/559615959 learned_addr learned my addr 172.21.15.42:0/559615959 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:13.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.508+0000 7fb12be00640 1 --2- 172.21.15.42:0/559615959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb12c104310 0x7fb12c19a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:13.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.509+0000 7fb130a00640 1 -- 172.21.15.42:0/559615959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb12c109970 msgr2=0x7fb12c19eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:13.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.509+0000 7fb130a00640 1 --2- 172.21.15.42:0/559615959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb12c109970 0x7fb12c19eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:13.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.509+0000 7fb130a00640 1 -- 172.21.15.42:0/559615959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb12c104310 msgr2=0x7fb12c19a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:13.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.509+0000 7fb130a00640 1 --2- 172.21.15.42:0/559615959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb12c104310 0x7fb12c19a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:13.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.509+0000 7fb130a00640 1 -- 172.21.15.42:0/559615959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb12c19f1e0 con 0x7fb12c103970 2024-08-26T00:01:13.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.509+0000 7fb130a00640 1 --2- 172.21.15.42:0/559615959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb12c103970 0x7fb12c19a230 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb12000e9f0 tx=0x7fb12000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:13.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.509+0000 7fb129600640 1 -- 172.21.15.42:0/559615959 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12000cd80 con 0x7fb12c103970 2024-08-26T00:01:13.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.509+0000 7fb129600640 1 -- 172.21.15.42:0/559615959 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb120005500 con 0x7fb12c103970 2024-08-26T00:01:13.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.509+0000 7fb131e00640 1 -- 172.21.15.42:0/559615959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb12c19f4d0 con 0x7fb12c103970 2024-08-26T00:01:13.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.509+0000 7fb129600640 1 -- 172.21.15.42:0/559615959 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb120010690 con 0x7fb12c103970 2024-08-26T00:01:13.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.509+0000 7fb131e00640 1 -- 172.21.15.42:0/559615959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb12c1a6db0 con 0x7fb12c103970 2024-08-26T00:01:13.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.510+0000 7fb131e00640 1 -- 172.21.15.42:0/559615959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb12c062720 con 0x7fb12c103970 2024-08-26T00:01:13.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.512+0000 7fb129600640 1 -- 172.21.15.42:0/559615959 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb1200046c0 con 0x7fb12c103970 2024-08-26T00:01:13.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.514+0000 7fb129600640 1 --2- 172.21.15.42:0/559615959 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb1140a2c10 0x7fb1140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:13.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.514+0000 7fb129600640 1 -- 172.21.15.42:0/559615959 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fb1200cf900 con 0x7fb12c103970 2024-08-26T00:01:13.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.514+0000 7fb12be00640 1 --2- 172.21.15.42:0/559615959 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb1140a2c10 0x7fb1140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:13.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.514+0000 7fb129600640 1 --2- 172.21.15.42:0/559615959 >> [v2:172.21.15.181:6824/3817502913,v1:172.21.15.181:6825/3817502913] conn(0x7fb1140ac460 0x7fb1140ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:13.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.514+0000 7fb129600640 1 -- 172.21.15.42:0/559615959 --> [v2:172.21.15.181:6824/3817502913,v1:172.21.15.181:6825/3817502913] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb120004470 con 0x7fb1140ac460 2024-08-26T00:01:13.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.514+0000 7fb129600640 1 -- 172.21.15.42:0/559615959 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7fb1200cfcb0 con 0x7fb12c103970 2024-08-26T00:01:13.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.515+0000 7fb131400640 1 --2- 172.21.15.42:0/559615959 >> [v2:172.21.15.181:6824/3817502913,v1:172.21.15.181:6825/3817502913] conn(0x7fb1140ac460 0x7fb1140ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:13.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.515+0000 7fb12be00640 1 --2- 172.21.15.42:0/559615959 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb1140a2c10 0x7fb1140a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb118009900 tx=0x7fb1180058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:13.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.515+0000 7fb131400640 1 --2- 172.21.15.42:0/559615959 >> [v2:172.21.15.181:6824/3817502913,v1:172.21.15.181:6825/3817502913] conn(0x7fb1140ac460 0x7fb1140ae880 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:13.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.516+0000 7fb129600640 1 -- 172.21.15.42:0/559615959 <== osd.11 v2:172.21.15.181:6824/3817502913 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb120004470 con 0x7fb1140ac460 2024-08-26T00:01:13.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.530+0000 7fb131e00640 1 -- 172.21.15.42:0/559615959 --> [v2:172.21.15.181:6824/3817502913,v1:172.21.15.181:6825/3817502913] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb12c062ba0 con 0x7fb1140ac460 2024-08-26T00:01:13.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.531+0000 7fb129600640 1 -- 172.21.15.42:0/559615959 <== osd.11 v2:172.21.15.181:6824/3817502913 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb12c062ba0 con 0x7fb1140ac460 2024-08-26T00:01:13.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.531+0000 7fb131e00640 1 -- 172.21.15.42:0/559615959 >> [v2:172.21.15.181:6824/3817502913,v1:172.21.15.181:6825/3817502913] conn(0x7fb1140ac460 msgr2=0x7fb1140ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:13.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.531+0000 7fb131e00640 1 --2- 172.21.15.42:0/559615959 >> [v2:172.21.15.181:6824/3817502913,v1:172.21.15.181:6825/3817502913] conn(0x7fb1140ac460 0x7fb1140ae880 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:13.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.531+0000 7fb131e00640 1 -- 172.21.15.42:0/559615959 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb1140a2c10 msgr2=0x7fb1140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:13.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.531+0000 7fb131e00640 1 --2- 172.21.15.42:0/559615959 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb1140a2c10 0x7fb1140a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb118009900 tx=0x7fb1180058d0 comp rx=0 tx=0).stop 2024-08-26T00:01:13.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.531+0000 7fb131e00640 1 -- 172.21.15.42:0/559615959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb12c103970 msgr2=0x7fb12c19a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:13.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.531+0000 7fb131e00640 1 --2- 172.21.15.42:0/559615959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb12c103970 0x7fb12c19a230 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb12000e9f0 tx=0x7fb12000edf0 comp rx=0 tx=0).stop 2024-08-26T00:01:13.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.531+0000 7fb131400640 1 -- 172.21.15.42:0/559615959 reap_dead start 2024-08-26T00:01:13.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.531+0000 7fb131e00640 1 -- 172.21.15.42:0/559615959 shutdown_connections 2024-08-26T00:01:13.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.532+0000 7fb131e00640 1 -- 172.21.15.42:0/559615959 >> 172.21.15.42:0/559615959 conn(0x7fb12c0ff670 msgr2=0x7fb12c0ffe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:13.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.532+0000 7fb131e00640 1 -- 172.21.15.42:0/559615959 shutdown_connections 2024-08-26T00:01:13.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.532+0000 7fb131e00640 1 -- 172.21.15.42:0/559615959 wait complete. 2024-08-26T00:01:13.760 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:13 smithi042 ceph-mon[17225]: pgmap v298: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 682 B/s wr, 7 op/s 2024-08-26T00:01:14.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:13 smithi043 ceph-mon[22091]: pgmap v298: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 682 B/s wr, 7 op/s 2024-08-26T00:01:14.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:13 smithi181 ceph-mon[22102]: pgmap v298: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 682 B/s wr, 7 op/s 2024-08-26T00:01:14.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.358+0000 7fc2a6600640 1 -- 172.21.15.42:0/3727380505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2a0112930 msgr2=0x7fc2a0114d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:14.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.358+0000 7fc2a6600640 1 --2- 172.21.15.42:0/3727380505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2a0112930 0x7fc2a0114d20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc298009ca0 tx=0x7fc29802a950 comp rx=0 tx=0).stop 2024-08-26T00:01:14.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.358+0000 7fc2a6600640 1 -- 172.21.15.42:0/3727380505 shutdown_connections 2024-08-26T00:01:14.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.358+0000 7fc2a6600640 1 --2- 172.21.15.42:0/3727380505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2a0112930 0x7fc2a0114d20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:14.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.358+0000 7fc2a6600640 1 --2- 172.21.15.42:0/3727380505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a0074c50 0x7fc2a01123f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:14.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.358+0000 7fc2a6600640 1 --2- 172.21.15.42:0/3727380505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2a0074330 0x7fc2a0074710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:14.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.358+0000 7fc2a6600640 1 -- 172.21.15.42:0/3727380505 >> 172.21.15.42:0/3727380505 conn(0x7fc2a00fd660 msgr2=0x7fc2a00ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:14.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.359+0000 7fc2a6600640 1 -- 172.21.15.42:0/3727380505 shutdown_connections 2024-08-26T00:01:14.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.359+0000 7fc2a6600640 1 -- 172.21.15.42:0/3727380505 wait complete. 2024-08-26T00:01:14.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.359+0000 7fc2a6600640 1 Processor -- start 2024-08-26T00:01:14.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.360+0000 7fc2a6600640 1 -- start start 2024-08-26T00:01:14.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.360+0000 7fc2a6600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a0074330 0x7fc2a01a4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:14.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.360+0000 7fc2a6600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2a0074c50 0x7fc2a01a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:14.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.360+0000 7fc2a6600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2a0112930 0x7fc2a019e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:14.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.360+0000 7fc2a6600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a0118310 con 0x7fc2a0112930 2024-08-26T00:01:14.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.360+0000 7fc2a6600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a0118190 con 0x7fc2a0074c50 2024-08-26T00:01:14.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.360+0000 7fc2a6600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a0118490 con 0x7fc2a0074330 2024-08-26T00:01:14.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.360+0000 7fc29fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2a0112930 0x7fc2a019e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:14.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.360+0000 7fc29f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a0074330 0x7fc2a01a4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:14.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.360+0000 7fc297e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2a0074c50 0x7fc2a01a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:14.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.360+0000 7fc29fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2a0112930 0x7fc2a019e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56458/0 (socket says 172.21.15.42:56458) 2024-08-26T00:01:14.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.360+0000 7fc29fe00640 1 -- 172.21.15.42:0/3009890255 learned_addr learned my addr 172.21.15.42:0/3009890255 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:14.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.361+0000 7fc29fe00640 1 -- 172.21.15.42:0/3009890255 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a0074330 msgr2=0x7fc2a01a4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:14.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.361+0000 7fc29fe00640 1 --2- 172.21.15.42:0/3009890255 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2a0074330 0x7fc2a01a4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:14.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.361+0000 7fc29fe00640 1 -- 172.21.15.42:0/3009890255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2a0074c50 msgr2=0x7fc2a01a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:14.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.361+0000 7fc29fe00640 1 --2- 172.21.15.42:0/3009890255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2a0074c50 0x7fc2a01a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:14.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.361+0000 7fc29fe00640 1 -- 172.21.15.42:0/3009890255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a019eed0 con 0x7fc2a0112930 2024-08-26T00:01:14.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.361+0000 7fc29fe00640 1 --2- 172.21.15.42:0/3009890255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2a0112930 0x7fc2a019e660 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc29802ae70 tx=0x7fc29802f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:14.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.361+0000 7fc29cc00640 1 -- 172.21.15.42:0/3009890255 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc298034040 con 0x7fc2a0112930 2024-08-26T00:01:14.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.361+0000 7fc29cc00640 1 -- 172.21.15.42:0/3009890255 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc298030920 con 0x7fc2a0112930 2024-08-26T00:01:14.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.361+0000 7fc29cc00640 1 -- 172.21.15.42:0/3009890255 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc298045480 con 0x7fc2a0112930 2024-08-26T00:01:14.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.361+0000 7fc2a6600640 1 -- 172.21.15.42:0/3009890255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2a019f160 con 0x7fc2a0112930 2024-08-26T00:01:14.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.361+0000 7fc2a6600640 1 -- 172.21.15.42:0/3009890255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2a01ab340 con 0x7fc2a0112930 2024-08-26T00:01:14.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.362+0000 7fc2a6600640 1 -- 172.21.15.42:0/3009890255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc2a00ff880 con 0x7fc2a0112930 2024-08-26T00:01:14.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.364+0000 7fc29cc00640 1 -- 172.21.15.42:0/3009890255 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc298037020 con 0x7fc2a0112930 2024-08-26T00:01:14.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.366+0000 7fc29cc00640 1 --2- 172.21.15.42:0/3009890255 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc2840a2c90 0x7fc2840a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:14.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.366+0000 7fc29cc00640 1 -- 172.21.15.42:0/3009890255 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fc2980f0220 con 0x7fc2a0112930 2024-08-26T00:01:14.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.366+0000 7fc29f400640 1 --2- 172.21.15.42:0/3009890255 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc2840a2c90 0x7fc2840a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:14.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.366+0000 7fc29cc00640 1 --2- 172.21.15.42:0/3009890255 >> [v2:172.21.15.43:6808/1315420796,v1:172.21.15.43:6809/1315420796] conn(0x7fc2840ac4e0 0x7fc2840ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:14.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.366+0000 7fc29cc00640 1 -- 172.21.15.42:0/3009890255 --> [v2:172.21.15.43:6808/1315420796,v1:172.21.15.43:6809/1315420796] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc2840aefb0 con 0x7fc2840ac4e0 2024-08-26T00:01:14.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.366+0000 7fc29cc00640 1 -- 172.21.15.42:0/3009890255 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7fc2980f05d0 con 0x7fc2a0112930 2024-08-26T00:01:14.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.367+0000 7fc29f400640 1 --2- 172.21.15.42:0/3009890255 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc2840a2c90 0x7fc2840a5150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc290005d00 tx=0x7fc29000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:14.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.367+0000 7fc297e00640 1 --2- 172.21.15.42:0/3009890255 >> [v2:172.21.15.43:6808/1315420796,v1:172.21.15.43:6809/1315420796] conn(0x7fc2840ac4e0 0x7fc2840ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:14.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.367+0000 7fc297e00640 1 --2- 172.21.15.42:0/3009890255 >> [v2:172.21.15.43:6808/1315420796,v1:172.21.15.43:6809/1315420796] conn(0x7fc2840ac4e0 0x7fc2840ae900 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:14.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.368+0000 7fc29cc00640 1 -- 172.21.15.42:0/3009890255 <== osd.4 v2:172.21.15.43:6808/1315420796 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc2840aefb0 con 0x7fc2840ac4e0 2024-08-26T00:01:14.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.383+0000 7fc2a6600640 1 -- 172.21.15.42:0/3009890255 --> [v2:172.21.15.43:6808/1315420796,v1:172.21.15.43:6809/1315420796] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc2a0075a70 con 0x7fc2840ac4e0 2024-08-26T00:01:14.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.383+0000 7fc29cc00640 1 -- 172.21.15.42:0/3009890255 <== osd.4 v2:172.21.15.43:6808/1315420796 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc2a0075a70 con 0x7fc2840ac4e0 2024-08-26T00:01:14.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.383+0000 7fc2a6600640 1 -- 172.21.15.42:0/3009890255 >> [v2:172.21.15.43:6808/1315420796,v1:172.21.15.43:6809/1315420796] conn(0x7fc2840ac4e0 msgr2=0x7fc2840ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:14.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.384+0000 7fc2a6600640 1 --2- 172.21.15.42:0/3009890255 >> [v2:172.21.15.43:6808/1315420796,v1:172.21.15.43:6809/1315420796] conn(0x7fc2840ac4e0 0x7fc2840ae900 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:14.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.384+0000 7fc2a6600640 1 -- 172.21.15.42:0/3009890255 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc2840a2c90 msgr2=0x7fc2840a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:14.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.384+0000 7fc2a6600640 1 --2- 172.21.15.42:0/3009890255 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc2840a2c90 0x7fc2840a5150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc290005d00 tx=0x7fc29000b410 comp rx=0 tx=0).stop 2024-08-26T00:01:14.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.384+0000 7fc2a6600640 1 -- 172.21.15.42:0/3009890255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2a0112930 msgr2=0x7fc2a019e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:14.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.384+0000 7fc2a6600640 1 --2- 172.21.15.42:0/3009890255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2a0112930 0x7fc2a019e660 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc29802ae70 tx=0x7fc29802f5b0 comp rx=0 tx=0).stop 2024-08-26T00:01:14.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.384+0000 7fc29fe00640 1 -- 172.21.15.42:0/3009890255 reap_dead start 2024-08-26T00:01:14.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.384+0000 7fc2a6600640 1 -- 172.21.15.42:0/3009890255 shutdown_connections 2024-08-26T00:01:14.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.384+0000 7fc2a6600640 1 -- 172.21.15.42:0/3009890255 >> 172.21.15.42:0/3009890255 conn(0x7fc2a00fd660 msgr2=0x7fc2a00fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:14.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.384+0000 7fc2a6600640 1 -- 172.21.15.42:0/3009890255 shutdown_connections 2024-08-26T00:01:14.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:12.384+0000 7fc2a6600640 1 -- 172.21.15.42:0/3009890255 wait complete. 2024-08-26T00:01:14.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.802+0000 7f229a800640 1 -- 172.21.15.42:0/3145419077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2294107760 msgr2=0x7f2294107b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:14.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.802+0000 7f229a800640 1 --2- 172.21.15.42:0/3145419077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2294107760 0x7f2294107b40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2288009930 tx=0x7f228802a440 comp rx=0 tx=0).stop 2024-08-26T00:01:14.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.802+0000 7f229a800640 1 -- 172.21.15.42:0/3145419077 shutdown_connections 2024-08-26T00:01:14.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.802+0000 7f229a800640 1 --2- 172.21.15.42:0/3145419077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2294102100 0x7f229410e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:14.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.802+0000 7f229a800640 1 --2- 172.21.15.42:0/3145419077 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2294101760 0x7f2294101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:14.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.802+0000 7f229a800640 1 --2- 172.21.15.42:0/3145419077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2294107760 0x7f2294107b40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:14.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.802+0000 7f229a800640 1 -- 172.21.15.42:0/3145419077 >> 172.21.15.42:0/3145419077 conn(0x7f22940fd4e0 msgr2=0x7f22940ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:14.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.802+0000 7f229a800640 1 -- 172.21.15.42:0/3145419077 shutdown_connections 2024-08-26T00:01:14.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.802+0000 7f229a800640 1 -- 172.21.15.42:0/3145419077 wait complete. 2024-08-26T00:01:14.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.803+0000 7f229a800640 1 Processor -- start 2024-08-26T00:01:14.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.803+0000 7f229a800640 1 -- start start 2024-08-26T00:01:14.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.803+0000 7f229a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2294101760 0x7f229419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:14.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.803+0000 7f229a800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2294102100 0x7f229419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:14.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.803+0000 7f229a800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2294107760 0x7f229419eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:14.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.803+0000 7f229a800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2294111bb0 con 0x7f2294101760 2024-08-26T00:01:14.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.803+0000 7f229a800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2294111a30 con 0x7f2294102100 2024-08-26T00:01:14.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.803+0000 7f229a800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2294111d30 con 0x7f2294107760 2024-08-26T00:01:14.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.804+0000 7f2299400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2294101760 0x7f229419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:14.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.804+0000 7f2299400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2294101760 0x7f229419a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56528/0 (socket says 172.21.15.42:56528) 2024-08-26T00:01:14.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.804+0000 7f2299400640 1 -- 172.21.15.42:0/1296604205 learned_addr learned my addr 172.21.15.42:0/1296604205 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:14.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.804+0000 7f2298a00640 1 --2- 172.21.15.42:0/1296604205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2294102100 0x7f229419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:14.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.804+0000 7f2299e00640 1 --2- 172.21.15.42:0/1296604205 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2294107760 0x7f229419eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:14.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.804+0000 7f2299400640 1 -- 172.21.15.42:0/1296604205 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2294107760 msgr2=0x7f229419eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:14.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.804+0000 7f2299400640 1 --2- 172.21.15.42:0/1296604205 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2294107760 0x7f229419eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:14.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.804+0000 7f2299400640 1 -- 172.21.15.42:0/1296604205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2294102100 msgr2=0x7f229419a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:14.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.804+0000 7f2299400640 1 --2- 172.21.15.42:0/1296604205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2294102100 0x7f229419a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:14.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.804+0000 7f2299400640 1 -- 172.21.15.42:0/1296604205 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f229419f230 con 0x7f2294101760 2024-08-26T00:01:14.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.805+0000 7f2299400640 1 --2- 172.21.15.42:0/1296604205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2294101760 0x7f229419a280 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f228802a960 tx=0x7f2288003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:14.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.805+0000 7f2292000640 1 -- 172.21.15.42:0/1296604205 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228803f070 con 0x7f2294101760 2024-08-26T00:01:14.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.805+0000 7f2292000640 1 -- 172.21.15.42:0/1296604205 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2288031c90 con 0x7f2294101760 2024-08-26T00:01:14.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.805+0000 7f229a800640 1 -- 172.21.15.42:0/1296604205 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f229419f4c0 con 0x7f2294101760 2024-08-26T00:01:14.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.805+0000 7f2292000640 1 -- 172.21.15.42:0/1296604205 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288035030 con 0x7f2294101760 2024-08-26T00:01:14.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.805+0000 7f229a800640 1 -- 172.21.15.42:0/1296604205 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22941a6e00 con 0x7f2294101760 2024-08-26T00:01:14.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.806+0000 7f229a800640 1 -- 172.21.15.42:0/1296604205 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f22940fee60 con 0x7f2294101760 2024-08-26T00:01:14.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.808+0000 7f2292000640 1 -- 172.21.15.42:0/1296604205 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2288042070 con 0x7f2294101760 2024-08-26T00:01:14.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.809+0000 7f2292000640 1 --2- 172.21.15.42:0/1296604205 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f227c0a2c90 0x7f227c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:14.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.809+0000 7f2292000640 1 -- 172.21.15.42:0/1296604205 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f22880efeb0 con 0x7f2294101760 2024-08-26T00:01:14.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.809+0000 7f2298a00640 1 --2- 172.21.15.42:0/1296604205 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f227c0a2c90 0x7f227c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:14.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.810+0000 7f2292000640 1 --2- 172.21.15.42:0/1296604205 >> [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480] conn(0x7f227c0ac4e0 0x7f227c0ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:14.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.810+0000 7f2292000640 1 -- 172.21.15.42:0/1296604205 --> [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f228800b0b0 con 0x7f227c0ac4e0 2024-08-26T00:01:14.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.810+0000 7f2292000640 1 -- 172.21.15.42:0/1296604205 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f22880f0260 con 0x7f2294101760 2024-08-26T00:01:14.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.810+0000 7f2299e00640 1 --2- 172.21.15.42:0/1296604205 >> [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480] conn(0x7f227c0ac4e0 0x7f227c0ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:14.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.810+0000 7f2298a00640 1 --2- 172.21.15.42:0/1296604205 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f227c0a2c90 0x7f227c0a5150 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f229410e7d0 tx=0x7f228000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:14.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.811+0000 7f2299e00640 1 --2- 172.21.15.42:0/1296604205 >> [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480] conn(0x7f227c0ac4e0 0x7f227c0ae900 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:14.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.812+0000 7f2292000640 1 -- 172.21.15.42:0/1296604205 <== osd.6 v2:172.21.15.42:6818/2910656480 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f228800b0b0 con 0x7f227c0ac4e0 2024-08-26T00:01:14.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.827+0000 7f229a800640 1 -- 172.21.15.42:0/1296604205 --> [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2294102ea0 con 0x7f227c0ac4e0 2024-08-26T00:01:14.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.827+0000 7f2292000640 1 -- 172.21.15.42:0/1296604205 <== osd.6 v2:172.21.15.42:6818/2910656480 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2294102ea0 con 0x7f227c0ac4e0 2024-08-26T00:01:14.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.828+0000 7f229a800640 1 -- 172.21.15.42:0/1296604205 >> [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480] conn(0x7f227c0ac4e0 msgr2=0x7f227c0ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:14.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.828+0000 7f229a800640 1 --2- 172.21.15.42:0/1296604205 >> [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480] conn(0x7f227c0ac4e0 0x7f227c0ae900 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:14.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.828+0000 7f229a800640 1 -- 172.21.15.42:0/1296604205 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f227c0a2c90 msgr2=0x7f227c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:14.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.828+0000 7f229a800640 1 --2- 172.21.15.42:0/1296604205 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f227c0a2c90 0x7f227c0a5150 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f229410e7d0 tx=0x7f228000b390 comp rx=0 tx=0).stop 2024-08-26T00:01:14.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.828+0000 7f229a800640 1 -- 172.21.15.42:0/1296604205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2294101760 msgr2=0x7f229419a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:14.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.828+0000 7f229a800640 1 --2- 172.21.15.42:0/1296604205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2294101760 0x7f229419a280 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f228802a960 tx=0x7f2288003b90 comp rx=0 tx=0).stop 2024-08-26T00:01:14.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.828+0000 7f2299e00640 1 -- 172.21.15.42:0/1296604205 reap_dead start 2024-08-26T00:01:14.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.828+0000 7f229a800640 1 -- 172.21.15.42:0/1296604205 shutdown_connections 2024-08-26T00:01:14.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.828+0000 7f229a800640 1 -- 172.21.15.42:0/1296604205 >> 172.21.15.42:0/1296604205 conn(0x7f22940fd4e0 msgr2=0x7f229410cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:14.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.828+0000 7f229a800640 1 -- 172.21.15.42:0/1296604205 shutdown_connections 2024-08-26T00:01:14.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.828+0000 7f229a800640 1 -- 172.21.15.42:0/1296604205 wait complete. 2024-08-26T00:01:15.572 INFO:teuthology.orchestra.run.smithi042.stdout:197568495657 2024-08-26T00:01:15.572 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-08-26T00:01:15.812 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:15 smithi043 ceph-mon[22091]: pgmap v299: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-26T00:01:15.887 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:15 smithi042 ceph-mon[17225]: pgmap v299: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-26T00:01:16.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:15 smithi181 ceph-mon[22102]: pgmap v299: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-26T00:01:16.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.885+0000 7f353ee00640 1 -- 172.21.15.42:0/1821648527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3538109970 msgr2=0x7f3538109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:16.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.885+0000 7f353ee00640 1 --2- 172.21.15.42:0/1821648527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3538109970 0x7f3538109d50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f352c009890 tx=0x7f352c02a360 comp rx=0 tx=0).stop 2024-08-26T00:01:16.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.885+0000 7f353ee00640 1 -- 172.21.15.42:0/1821648527 shutdown_connections 2024-08-26T00:01:16.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.885+0000 7f353ee00640 1 --2- 172.21.15.42:0/1821648527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3538104310 0x7f3538110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:16.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.885+0000 7f353ee00640 1 --2- 172.21.15.42:0/1821648527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3538103970 0x7f3538103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:16.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.885+0000 7f353ee00640 1 --2- 172.21.15.42:0/1821648527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3538109970 0x7f3538109d50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:16.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.885+0000 7f353ee00640 1 -- 172.21.15.42:0/1821648527 >> 172.21.15.42:0/1821648527 conn(0x7f35380ff6b0 msgr2=0x7f3538101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:16.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.885+0000 7f353ee00640 1 -- 172.21.15.42:0/1821648527 shutdown_connections 2024-08-26T00:01:16.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.885+0000 7f353ee00640 1 -- 172.21.15.42:0/1821648527 wait complete. 2024-08-26T00:01:16.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.886+0000 7f353ee00640 1 Processor -- start 2024-08-26T00:01:16.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.886+0000 7f353ee00640 1 -- start start 2024-08-26T00:01:16.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.887+0000 7f353ee00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3538103970 0x7f353819a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:16.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.887+0000 7f353ee00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3538104310 0x7f353819a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:16.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.887+0000 7f353ee00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3538109970 0x7f353819ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:16.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.887+0000 7f353ee00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3538113d70 con 0x7f3538103970 2024-08-26T00:01:16.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.887+0000 7f353ee00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3538113bf0 con 0x7f3538109970 2024-08-26T00:01:16.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.887+0000 7f353ee00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3538113ef0 con 0x7f3538104310 2024-08-26T00:01:16.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.887+0000 7f353e400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3538109970 0x7f353819ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:16.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.887+0000 7f353e400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3538109970 0x7f353819ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:39488/0 (socket says 172.21.15.42:39488) 2024-08-26T00:01:16.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.887+0000 7f353da00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3538103970 0x7f353819a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:16.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.887+0000 7f353e400640 1 -- 172.21.15.42:0/1318317596 learned_addr learned my addr 172.21.15.42:0/1318317596 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:16.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.887+0000 7f353d000640 1 --2- 172.21.15.42:0/1318317596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3538104310 0x7f353819a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:16.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.888+0000 7f353e400640 1 -- 172.21.15.42:0/1318317596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3538104310 msgr2=0x7f353819a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:16.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.888+0000 7f353e400640 1 --2- 172.21.15.42:0/1318317596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3538104310 0x7f353819a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:16.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.888+0000 7f353e400640 1 -- 172.21.15.42:0/1318317596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3538103970 msgr2=0x7f353819a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:16.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.888+0000 7f353e400640 1 --2- 172.21.15.42:0/1318317596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3538103970 0x7f353819a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:16.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.888+0000 7f353e400640 1 -- 172.21.15.42:0/1318317596 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353819f2a0 con 0x7f3538109970 2024-08-26T00:01:16.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.888+0000 7f353e400640 1 --2- 172.21.15.42:0/1318317596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3538109970 0x7f353819ebc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f353000efc0 tx=0x7f353000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:16.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.888+0000 7f3536000640 1 -- 172.21.15.42:0/1318317596 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3530003970 con 0x7f3538109970 2024-08-26T00:01:16.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.888+0000 7f3536000640 1 -- 172.21.15.42:0/1318317596 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3530004020 con 0x7f3538109970 2024-08-26T00:01:16.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.888+0000 7f353ee00640 1 -- 172.21.15.42:0/1318317596 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f353819f590 con 0x7f3538109970 2024-08-26T00:01:16.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.888+0000 7f3536000640 1 -- 172.21.15.42:0/1318317596 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353000b9f0 con 0x7f3538109970 2024-08-26T00:01:16.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.888+0000 7f353ee00640 1 -- 172.21.15.42:0/1318317596 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35381a6e70 con 0x7f3538109970 2024-08-26T00:01:16.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.889+0000 7f353ee00640 1 -- 172.21.15.42:0/1318317596 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3538062720 con 0x7f3538109970 2024-08-26T00:01:16.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.891+0000 7f3536000640 1 -- 172.21.15.42:0/1318317596 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f353001d020 con 0x7f3538109970 2024-08-26T00:01:16.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.892+0000 7f3536000640 1 --2- 172.21.15.42:0/1318317596 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f35200a2c90 0x7f35200a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:16.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.893+0000 7f3536000640 1 -- 172.21.15.42:0/1318317596 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f35300cf760 con 0x7f3538109970 2024-08-26T00:01:16.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.893+0000 7f353da00640 1 --2- 172.21.15.42:0/1318317596 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f35200a2c90 0x7f35200a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:16.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.893+0000 7f3536000640 1 --2- 172.21.15.42:0/1318317596 >> [v2:172.21.15.181:6808/246971403,v1:172.21.15.181:6809/246971403] conn(0x7f35200ac4e0 0x7f35200ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:16.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.893+0000 7f3536000640 1 -- 172.21.15.42:0/1318317596 --> [v2:172.21.15.181:6808/246971403,v1:172.21.15.181:6809/246971403] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f35200aefb0 con 0x7f35200ac4e0 2024-08-26T00:01:16.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.893+0000 7f3536000640 1 -- 172.21.15.42:0/1318317596 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f35300cfb10 con 0x7f3538109970 2024-08-26T00:01:16.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.893+0000 7f353d000640 1 --2- 172.21.15.42:0/1318317596 >> [v2:172.21.15.181:6808/246971403,v1:172.21.15.181:6809/246971403] conn(0x7f35200ac4e0 0x7f35200ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:16.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.893+0000 7f353da00640 1 --2- 172.21.15.42:0/1318317596 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f35200a2c90 0x7f35200a5150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f352c035040 tx=0x7f352c0056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:16.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.894+0000 7f353d000640 1 --2- 172.21.15.42:0/1318317596 >> [v2:172.21.15.181:6808/246971403,v1:172.21.15.181:6809/246971403] conn(0x7f35200ac4e0 0x7f35200ae900 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:16.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.895+0000 7f3536000640 1 -- 172.21.15.42:0/1318317596 <== osd.5 v2:172.21.15.181:6808/246971403 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f35200aefb0 con 0x7f35200ac4e0 2024-08-26T00:01:16.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.909+0000 7f353ee00640 1 -- 172.21.15.42:0/1318317596 --> [v2:172.21.15.181:6808/246971403,v1:172.21.15.181:6809/246971403] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3538062ba0 con 0x7f35200ac4e0 2024-08-26T00:01:16.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.910+0000 7f3536000640 1 -- 172.21.15.42:0/1318317596 <== osd.5 v2:172.21.15.181:6808/246971403 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3538062ba0 con 0x7f35200ac4e0 2024-08-26T00:01:16.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.910+0000 7f353ee00640 1 -- 172.21.15.42:0/1318317596 >> [v2:172.21.15.181:6808/246971403,v1:172.21.15.181:6809/246971403] conn(0x7f35200ac4e0 msgr2=0x7f35200ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:16.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.910+0000 7f353ee00640 1 --2- 172.21.15.42:0/1318317596 >> [v2:172.21.15.181:6808/246971403,v1:172.21.15.181:6809/246971403] conn(0x7f35200ac4e0 0x7f35200ae900 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:16.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.910+0000 7f353ee00640 1 -- 172.21.15.42:0/1318317596 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f35200a2c90 msgr2=0x7f35200a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:16.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.910+0000 7f353ee00640 1 --2- 172.21.15.42:0/1318317596 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f35200a2c90 0x7f35200a5150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f352c035040 tx=0x7f352c0056d0 comp rx=0 tx=0).stop 2024-08-26T00:01:16.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.910+0000 7f353ee00640 1 -- 172.21.15.42:0/1318317596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3538109970 msgr2=0x7f353819ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:16.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.910+0000 7f353ee00640 1 --2- 172.21.15.42:0/1318317596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3538109970 0x7f353819ebc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f353000efc0 tx=0x7f353000c800 comp rx=0 tx=0).stop 2024-08-26T00:01:16.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.910+0000 7f353e400640 1 -- 172.21.15.42:0/1318317596 reap_dead start 2024-08-26T00:01:16.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.910+0000 7f353ee00640 1 -- 172.21.15.42:0/1318317596 shutdown_connections 2024-08-26T00:01:16.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.910+0000 7f353ee00640 1 -- 172.21.15.42:0/1318317596 >> 172.21.15.42:0/1318317596 conn(0x7f35380ff6b0 msgr2=0x7f35380ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:16.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.910+0000 7f353ee00640 1 -- 172.21.15.42:0/1318317596 shutdown_connections 2024-08-26T00:01:16.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:15.911+0000 7f353ee00640 1 -- 172.21.15.42:0/1318317596 wait complete. 2024-08-26T00:01:16.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.759+0000 7f4614a00640 1 -- 172.21.15.42:0/2323489583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4610102100 msgr2=0x7f461010e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:16.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.759+0000 7f4614a00640 1 --2- 172.21.15.42:0/2323489583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4610102100 0x7f461010e630 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4608009930 tx=0x7f460802a420 comp rx=0 tx=0).stop 2024-08-26T00:01:16.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.759+0000 7f4614a00640 1 -- 172.21.15.42:0/2323489583 shutdown_connections 2024-08-26T00:01:16.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.759+0000 7f4614a00640 1 --2- 172.21.15.42:0/2323489583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4610102100 0x7f461010e630 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:16.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.759+0000 7f4614a00640 1 --2- 172.21.15.42:0/2323489583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4610101760 0x7f4610101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:16.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.759+0000 7f4614a00640 1 --2- 172.21.15.42:0/2323489583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4610107760 0x7f4610107b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:16.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.759+0000 7f4614a00640 1 -- 172.21.15.42:0/2323489583 >> 172.21.15.42:0/2323489583 conn(0x7f46100fd4e0 msgr2=0x7f46100ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:16.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.759+0000 7f4614a00640 1 -- 172.21.15.42:0/2323489583 shutdown_connections 2024-08-26T00:01:16.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.759+0000 7f4614a00640 1 -- 172.21.15.42:0/2323489583 wait complete. 2024-08-26T00:01:16.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.760+0000 7f4614a00640 1 Processor -- start 2024-08-26T00:01:16.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.760+0000 7f4614a00640 1 -- start start 2024-08-26T00:01:16.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.761+0000 7f4614a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4610101760 0x7f461019a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:16.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.761+0000 7f4614a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4610102100 0x7f461019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:16.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.761+0000 7f4614a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4610107760 0x7f461019eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:16.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.761+0000 7f4614a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4610111bb0 con 0x7f4610102100 2024-08-26T00:01:16.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.761+0000 7f4614a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4610111a30 con 0x7f4610101760 2024-08-26T00:01:16.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.761+0000 7f4614a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4610111d30 con 0x7f4610107760 2024-08-26T00:01:16.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.761+0000 7f4605e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4610102100 0x7f461019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:16.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.761+0000 7f4605e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4610102100 0x7f461019a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56512/0 (socket says 172.21.15.42:56512) 2024-08-26T00:01:16.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.761+0000 7f4605e00640 1 -- 172.21.15.42:0/2068436260 learned_addr learned my addr 172.21.15.42:0/2068436260 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:16.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.761+0000 7f460e800640 1 --2- 172.21.15.42:0/2068436260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4610101760 0x7f461019a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:16.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.761+0000 7f460f200640 1 --2- 172.21.15.42:0/2068436260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4610107760 0x7f461019eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:16.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.761+0000 7f4605e00640 1 -- 172.21.15.42:0/2068436260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4610107760 msgr2=0x7f461019eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:16.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.761+0000 7f4605e00640 1 --2- 172.21.15.42:0/2068436260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4610107760 0x7f461019eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:16.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.761+0000 7f4605e00640 1 -- 172.21.15.42:0/2068436260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4610101760 msgr2=0x7f461019a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:16.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.761+0000 7f4605e00640 1 --2- 172.21.15.42:0/2068436260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4610101760 0x7f461019a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:16.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.761+0000 7f4605e00640 1 -- 172.21.15.42:0/2068436260 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461019f1e0 con 0x7f4610102100 2024-08-26T00:01:16.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.762+0000 7f4605e00640 1 --2- 172.21.15.42:0/2068436260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4610102100 0x7f461019a770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f45f800d950 tx=0x7f45f800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:16.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.762+0000 7f4607e00640 1 -- 172.21.15.42:0/2068436260 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8017030 con 0x7f4610102100 2024-08-26T00:01:16.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.762+0000 7f4614a00640 1 -- 172.21.15.42:0/2068436260 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f461019f4d0 con 0x7f4610102100 2024-08-26T00:01:16.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.762+0000 7f4607e00640 1 -- 172.21.15.42:0/2068436260 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45f8004020 con 0x7f4610102100 2024-08-26T00:01:16.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.762+0000 7f4607e00640 1 -- 172.21.15.42:0/2068436260 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f80047a0 con 0x7f4610102100 2024-08-26T00:01:16.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.762+0000 7f4614a00640 1 -- 172.21.15.42:0/2068436260 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46101a6db0 con 0x7f4610102100 2024-08-26T00:01:16.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.763+0000 7f4614a00640 1 -- 172.21.15.42:0/2068436260 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f46100fe550 con 0x7f4610102100 2024-08-26T00:01:16.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.766+0000 7f4607e00640 1 -- 172.21.15.42:0/2068436260 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f45f80041d0 con 0x7f4610102100 2024-08-26T00:01:16.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.767+0000 7f4607e00640 1 --2- 172.21.15.42:0/2068436260 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f45f40a2c10 0x7f45f40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:16.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.767+0000 7f4607e00640 1 -- 172.21.15.42:0/2068436260 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f45f80cf0f0 con 0x7f4610102100 2024-08-26T00:01:16.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.767+0000 7f460e800640 1 --2- 172.21.15.42:0/2068436260 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f45f40a2c10 0x7f45f40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:16.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.767+0000 7f4607e00640 1 --2- 172.21.15.42:0/2068436260 >> [v2:172.21.15.43:6800/2396081001,v1:172.21.15.43:6801/2396081001] conn(0x7f45f40ac460 0x7f45f40ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:16.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.767+0000 7f4607e00640 1 -- 172.21.15.42:0/2068436260 --> [v2:172.21.15.43:6800/2396081001,v1:172.21.15.43:6801/2396081001] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f45f40aef30 con 0x7f45f40ac460 2024-08-26T00:01:16.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.767+0000 7f4607e00640 1 -- 172.21.15.42:0/2068436260 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f45f80cf5d0 con 0x7f4610102100 2024-08-26T00:01:16.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.768+0000 7f460e800640 1 --2- 172.21.15.42:0/2068436260 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f45f40a2c10 0x7f45f40a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4600005fd0 tx=0x7f4600009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:16.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.768+0000 7f460f200640 1 --2- 172.21.15.42:0/2068436260 >> [v2:172.21.15.43:6800/2396081001,v1:172.21.15.43:6801/2396081001] conn(0x7f45f40ac460 0x7f45f40ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:16.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.768+0000 7f460f200640 1 --2- 172.21.15.42:0/2068436260 >> [v2:172.21.15.43:6800/2396081001,v1:172.21.15.43:6801/2396081001] conn(0x7f45f40ac460 0x7f45f40ae880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:16.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.769+0000 7f4607e00640 1 -- 172.21.15.42:0/2068436260 <== osd.1 v2:172.21.15.43:6800/2396081001 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f45f40aef30 con 0x7f45f40ac460 2024-08-26T00:01:16.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.784+0000 7f4614a00640 1 -- 172.21.15.42:0/2068436260 --> [v2:172.21.15.43:6800/2396081001,v1:172.21.15.43:6801/2396081001] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4610102ea0 con 0x7f45f40ac460 2024-08-26T00:01:16.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.784+0000 7f4607e00640 1 -- 172.21.15.42:0/2068436260 <== osd.1 v2:172.21.15.43:6800/2396081001 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4610102ea0 con 0x7f45f40ac460 2024-08-26T00:01:16.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.785+0000 7f4614a00640 1 -- 172.21.15.42:0/2068436260 >> [v2:172.21.15.43:6800/2396081001,v1:172.21.15.43:6801/2396081001] conn(0x7f45f40ac460 msgr2=0x7f45f40ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:16.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.785+0000 7f4614a00640 1 --2- 172.21.15.42:0/2068436260 >> [v2:172.21.15.43:6800/2396081001,v1:172.21.15.43:6801/2396081001] conn(0x7f45f40ac460 0x7f45f40ae880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:16.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.785+0000 7f4614a00640 1 -- 172.21.15.42:0/2068436260 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f45f40a2c10 msgr2=0x7f45f40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:16.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.785+0000 7f4614a00640 1 --2- 172.21.15.42:0/2068436260 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f45f40a2c10 0x7f45f40a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4600005fd0 tx=0x7f4600009500 comp rx=0 tx=0).stop 2024-08-26T00:01:16.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.785+0000 7f4614a00640 1 -- 172.21.15.42:0/2068436260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4610102100 msgr2=0x7f461019a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:16.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.785+0000 7f4614a00640 1 --2- 172.21.15.42:0/2068436260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4610102100 0x7f461019a770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f45f800d950 tx=0x7f45f800de10 comp rx=0 tx=0).stop 2024-08-26T00:01:16.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.785+0000 7f460f200640 1 -- 172.21.15.42:0/2068436260 reap_dead start 2024-08-26T00:01:16.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.785+0000 7f4614a00640 1 -- 172.21.15.42:0/2068436260 shutdown_connections 2024-08-26T00:01:16.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.785+0000 7f4614a00640 1 -- 172.21.15.42:0/2068436260 >> 172.21.15.42:0/2068436260 conn(0x7f46100fd4e0 msgr2=0x7f46100fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:16.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.785+0000 7f4614a00640 1 -- 172.21.15.42:0/2068436260 shutdown_connections 2024-08-26T00:01:16.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:13.785+0000 7f4614a00640 1 -- 172.21.15.42:0/2068436260 wait complete. 2024-08-26T00:01:17.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.461+0000 7f8aa3000640 1 -- 172.21.15.42:0/2548590431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a9c103990 msgr2=0x7f8a9c103df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:17.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.461+0000 7f8aa3000640 1 --2- 172.21.15.42:0/2548590431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a9c103990 0x7f8a9c103df0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8a88009900 tx=0x7f8a8802a410 comp rx=0 tx=0).stop 2024-08-26T00:01:17.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.461+0000 7f8aa3000640 1 -- 172.21.15.42:0/2548590431 shutdown_connections 2024-08-26T00:01:17.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.461+0000 7f8aa3000640 1 --2- 172.21.15.42:0/2548590431 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a9c104330 0x7f8a9c110970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:17.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.461+0000 7f8aa3000640 1 --2- 172.21.15.42:0/2548590431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a9c103990 0x7f8a9c103df0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:17.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.461+0000 7f8aa3000640 1 --2- 172.21.15.42:0/2548590431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a9c109aa0 0x7f8a9c109e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:17.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.461+0000 7f8aa3000640 1 -- 172.21.15.42:0/2548590431 >> 172.21.15.42:0/2548590431 conn(0x7f8a9c0ff650 msgr2=0x7f8a9c101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:17.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.462+0000 7f8aa3000640 1 -- 172.21.15.42:0/2548590431 shutdown_connections 2024-08-26T00:01:17.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.462+0000 7f8aa3000640 1 -- 172.21.15.42:0/2548590431 wait complete. 2024-08-26T00:01:17.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.462+0000 7f8aa3000640 1 Processor -- start 2024-08-26T00:01:17.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.463+0000 7f8aa3000640 1 -- start start 2024-08-26T00:01:17.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.463+0000 7f8aa3000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a9c103990 0x7f8a9c19a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:17.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.463+0000 7f8aa3000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a9c104330 0x7f8a9c19a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:17.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.463+0000 7f8aa3000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a9c109aa0 0x7f8a9c19ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:17.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.463+0000 7f8aa3000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c113eb0 con 0x7f8a9c104330 2024-08-26T00:01:17.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.463+0000 7f8aa3000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c113d30 con 0x7f8a9c109aa0 2024-08-26T00:01:17.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.463+0000 7f8aa3000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c114030 con 0x7f8a9c103990 2024-08-26T00:01:17.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.463+0000 7f8aa1c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a9c103990 0x7f8a9c19a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:17.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.463+0000 7f8aa2600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a9c109aa0 0x7f8a9c19ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:17.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.463+0000 7f8aa1200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a9c104330 0x7f8a9c19a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:17.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.463+0000 7f8aa1c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a9c103990 0x7f8a9c19a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:59680/0 (socket says 172.21.15.42:59680) 2024-08-26T00:01:17.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.463+0000 7f8aa1c00640 1 -- 172.21.15.42:0/483831644 learned_addr learned my addr 172.21.15.42:0/483831644 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:17.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.464+0000 7f8aa1c00640 1 -- 172.21.15.42:0/483831644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a9c109aa0 msgr2=0x7f8a9c19ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:17.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.464+0000 7f8aa1c00640 1 --2- 172.21.15.42:0/483831644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a9c109aa0 0x7f8a9c19ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:17.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.464+0000 7f8aa1c00640 1 -- 172.21.15.42:0/483831644 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a9c104330 msgr2=0x7f8a9c19a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:17.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.464+0000 7f8aa1c00640 1 --2- 172.21.15.42:0/483831644 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a9c104330 0x7f8a9c19a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:17.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.464+0000 7f8aa1c00640 1 -- 172.21.15.42:0/483831644 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9c19f360 con 0x7f8a9c103990 2024-08-26T00:01:17.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.464+0000 7f8aa2600640 1 --2- 172.21.15.42:0/483831644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a9c109aa0 0x7f8a9c19ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:17.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.464+0000 7f8aa1c00640 1 --2- 172.21.15.42:0/483831644 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a9c103990 0x7f8a9c19a3b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8a9000e9f0 tx=0x7f8a9000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:17.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.464+0000 7f8a9a000640 1 -- 172.21.15.42:0/483831644 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9000cd80 con 0x7f8a9c103990 2024-08-26T00:01:17.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.464+0000 7f8aa3000640 1 -- 172.21.15.42:0/483831644 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a9c19f650 con 0x7f8a9c103990 2024-08-26T00:01:17.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.464+0000 7f8a9a000640 1 -- 172.21.15.42:0/483831644 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a90010910 con 0x7f8a9c103990 2024-08-26T00:01:17.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.465+0000 7f8a9a000640 1 -- 172.21.15.42:0/483831644 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a900188f0 con 0x7f8a9c103990 2024-08-26T00:01:17.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.465+0000 7f8aa3000640 1 -- 172.21.15.42:0/483831644 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a9c1a6f30 con 0x7f8a9c103990 2024-08-26T00:01:17.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.465+0000 7f8aa3000640 1 -- 172.21.15.42:0/483831644 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8a9c103df0 con 0x7f8a9c103990 2024-08-26T00:01:17.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.468+0000 7f8a9a000640 1 -- 172.21.15.42:0/483831644 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8a90010ac0 con 0x7f8a9c103990 2024-08-26T00:01:17.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.469+0000 7f8a9a000640 1 --2- 172.21.15.42:0/483831644 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f8a840a2c90 0x7f8a840a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:17.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.469+0000 7f8a9a000640 1 -- 172.21.15.42:0/483831644 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f8a900cfa20 con 0x7f8a9c103990 2024-08-26T00:01:17.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.469+0000 7f8aa1200640 1 --2- 172.21.15.42:0/483831644 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f8a840a2c90 0x7f8a840a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:17.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.470+0000 7f8a9a000640 1 --2- 172.21.15.42:0/483831644 >> [v2:172.21.15.43:6824/3417487386,v1:172.21.15.43:6825/3417487386] conn(0x7f8a840ac4e0 0x7f8a840ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:17.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.470+0000 7f8a9a000640 1 -- 172.21.15.42:0/483831644 --> [v2:172.21.15.43:6824/3417487386,v1:172.21.15.43:6825/3417487386] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a840aefb0 con 0x7f8a840ac4e0 2024-08-26T00:01:17.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.470+0000 7f8a9a000640 1 -- 172.21.15.42:0/483831644 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f8a900cfdd0 con 0x7f8a9c103990 2024-08-26T00:01:17.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.470+0000 7f8aa2600640 1 --2- 172.21.15.42:0/483831644 >> [v2:172.21.15.43:6824/3417487386,v1:172.21.15.43:6825/3417487386] conn(0x7f8a840ac4e0 0x7f8a840ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:17.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.470+0000 7f8aa1200640 1 --2- 172.21.15.42:0/483831644 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f8a840a2c90 0x7f8a840a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8a88000c00 tx=0x7f8a88005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:17.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.470+0000 7f8aa2600640 1 --2- 172.21.15.42:0/483831644 >> [v2:172.21.15.43:6824/3417487386,v1:172.21.15.43:6825/3417487386] conn(0x7f8a840ac4e0 0x7f8a840ae900 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:17.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.471+0000 7f8a9a000640 1 -- 172.21.15.42:0/483831644 <== osd.10 v2:172.21.15.43:6824/3417487386 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8a840aefb0 con 0x7f8a840ac4e0 2024-08-26T00:01:17.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.486+0000 7f8aa3000640 1 -- 172.21.15.42:0/483831644 --> [v2:172.21.15.43:6824/3417487386,v1:172.21.15.43:6825/3417487386] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8a9c0626a0 con 0x7f8a840ac4e0 2024-08-26T00:01:17.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.486+0000 7f8a9a000640 1 -- 172.21.15.42:0/483831644 <== osd.10 v2:172.21.15.43:6824/3417487386 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8a9c0626a0 con 0x7f8a840ac4e0 2024-08-26T00:01:17.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.487+0000 7f8aa3000640 1 -- 172.21.15.42:0/483831644 >> [v2:172.21.15.43:6824/3417487386,v1:172.21.15.43:6825/3417487386] conn(0x7f8a840ac4e0 msgr2=0x7f8a840ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:17.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.487+0000 7f8aa3000640 1 --2- 172.21.15.42:0/483831644 >> [v2:172.21.15.43:6824/3417487386,v1:172.21.15.43:6825/3417487386] conn(0x7f8a840ac4e0 0x7f8a840ae900 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:17.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.487+0000 7f8aa3000640 1 -- 172.21.15.42:0/483831644 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f8a840a2c90 msgr2=0x7f8a840a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:17.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.487+0000 7f8aa3000640 1 --2- 172.21.15.42:0/483831644 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f8a840a2c90 0x7f8a840a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8a88000c00 tx=0x7f8a88005b50 comp rx=0 tx=0).stop 2024-08-26T00:01:17.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.487+0000 7f8aa3000640 1 -- 172.21.15.42:0/483831644 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a9c103990 msgr2=0x7f8a9c19a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:17.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.487+0000 7f8aa3000640 1 --2- 172.21.15.42:0/483831644 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a9c103990 0x7f8a9c19a3b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8a9000e9f0 tx=0x7f8a9000eeb0 comp rx=0 tx=0).stop 2024-08-26T00:01:17.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.487+0000 7f8aa2600640 1 -- 172.21.15.42:0/483831644 reap_dead start 2024-08-26T00:01:17.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.487+0000 7f8aa3000640 1 -- 172.21.15.42:0/483831644 shutdown_connections 2024-08-26T00:01:17.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.487+0000 7f8aa3000640 1 -- 172.21.15.42:0/483831644 >> 172.21.15.42:0/483831644 conn(0x7f8a9c0ff650 msgr2=0x7f8a9c0ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:17.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.487+0000 7f8aa3000640 1 -- 172.21.15.42:0/483831644 shutdown_connections 2024-08-26T00:01:17.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.487+0000 7f8aa3000640 1 -- 172.21.15.42:0/483831644 wait complete. 2024-08-26T00:01:17.659 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:17 smithi042 ceph-mon[17225]: pgmap v300: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-26T00:01:17.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.665+0000 7f0e7f200640 1 -- 172.21.15.42:0/1819402543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e80107770 msgr2=0x7f0e80107b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:17.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.665+0000 7f0e7f200640 1 --2- 172.21.15.42:0/1819402543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e80107770 0x7f0e80107b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009900 tx=0x7f0e7002a410 comp rx=0 tx=0).stop 2024-08-26T00:01:17.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.665+0000 7f0e7f200640 1 -- 172.21.15.42:0/1819402543 shutdown_connections 2024-08-26T00:01:17.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.665+0000 7f0e7f200640 1 --2- 172.21.15.42:0/1819402543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e80102110 0x7f0e8010e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:17.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.665+0000 7f0e7f200640 1 --2- 172.21.15.42:0/1819402543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e80101770 0x7f0e80101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:17.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.665+0000 7f0e7f200640 1 --2- 172.21.15.42:0/1819402543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e80107770 0x7f0e80107b50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:17.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.665+0000 7f0e7f200640 1 -- 172.21.15.42:0/1819402543 >> 172.21.15.42:0/1819402543 conn(0x7f0e800fd4b0 msgr2=0x7f0e800ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:17.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.665+0000 7f0e7f200640 1 -- 172.21.15.42:0/1819402543 shutdown_connections 2024-08-26T00:01:17.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.665+0000 7f0e7f200640 1 -- 172.21.15.42:0/1819402543 wait complete. 2024-08-26T00:01:17.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.666+0000 7f0e7f200640 1 Processor -- start 2024-08-26T00:01:17.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.666+0000 7f0e7f200640 1 -- start start 2024-08-26T00:01:17.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.666+0000 7f0e7f200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e80101770 0x7f0e80198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:17.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.666+0000 7f0e7f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e80102110 0x7f0e80198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:17.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.666+0000 7f0e7f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e80107770 0x7f0e8019c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:17.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.666+0000 7f0e7f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0e80111b30 con 0x7f0e80107770 2024-08-26T00:01:17.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.666+0000 7f0e7f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0e801119b0 con 0x7f0e80102110 2024-08-26T00:01:17.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.666+0000 7f0e7f200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0e80111cb0 con 0x7f0e80101770 2024-08-26T00:01:17.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.667+0000 7f0e7d400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e80102110 0x7f0e80198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:17.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.667+0000 7f0e7d400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e80102110 0x7f0e80198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:39538/0 (socket says 172.21.15.42:39538) 2024-08-26T00:01:17.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.667+0000 7f0e7d400640 1 -- 172.21.15.42:0/321960580 learned_addr learned my addr 172.21.15.42:0/321960580 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:17.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.667+0000 7f0e7e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e80107770 0x7f0e8019c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:17.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.667+0000 7f0e7de00640 1 --2- 172.21.15.42:0/321960580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e80101770 0x7f0e80198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:17.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.667+0000 7f0e7d400640 1 -- 172.21.15.42:0/321960580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e80101770 msgr2=0x7f0e80198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:17.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.667+0000 7f0e7d400640 1 --2- 172.21.15.42:0/321960580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e80101770 0x7f0e80198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:17.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.667+0000 7f0e7d400640 1 -- 172.21.15.42:0/321960580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e80107770 msgr2=0x7f0e8019c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:17.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.667+0000 7f0e7d400640 1 --2- 172.21.15.42:0/321960580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e80107770 0x7f0e8019c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:17.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.667+0000 7f0e7d400640 1 -- 172.21.15.42:0/321960580 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e8019cfb0 con 0x7f0e80102110 2024-08-26T00:01:17.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.668+0000 7f0e7d400640 1 --2- 172.21.15.42:0/321960580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e80102110 0x7f0e80198540 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c00d950 tx=0x7f0e6c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:17.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.668+0000 7f0e76a00640 1 -- 172.21.15.42:0/321960580 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c017070 con 0x7f0e80102110 2024-08-26T00:01:17.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.668+0000 7f0e76a00640 1 -- 172.21.15.42:0/321960580 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e6c009c30 con 0x7f0e80102110 2024-08-26T00:01:17.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.668+0000 7f0e76a00640 1 -- 172.21.15.42:0/321960580 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c00f6b0 con 0x7f0e80102110 2024-08-26T00:01:17.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.668+0000 7f0e7f200640 1 -- 172.21.15.42:0/321960580 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e8019d2a0 con 0x7f0e80102110 2024-08-26T00:01:17.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.668+0000 7f0e7f200640 1 -- 172.21.15.42:0/321960580 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e801a4b80 con 0x7f0e80102110 2024-08-26T00:01:17.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.669+0000 7f0e7f200640 1 -- 172.21.15.42:0/321960580 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0e80062720 con 0x7f0e80102110 2024-08-26T00:01:17.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.671+0000 7f0e76a00640 1 -- 172.21.15.42:0/321960580 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0e6c0109d0 con 0x7f0e80102110 2024-08-26T00:01:17.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.673+0000 7f0e76a00640 1 --2- 172.21.15.42:0/321960580 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0e640a2c90 0x7f0e640a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:17.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.673+0000 7f0e76a00640 1 -- 172.21.15.42:0/321960580 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f0e6c0cec60 con 0x7f0e80102110 2024-08-26T00:01:17.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.673+0000 7f0e7de00640 1 --2- 172.21.15.42:0/321960580 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0e640a2c90 0x7f0e640a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:17.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.673+0000 7f0e76a00640 1 --2- 172.21.15.42:0/321960580 >> [v2:172.21.15.42:6802/2657450248,v1:172.21.15.42:6803/2657450248] conn(0x7f0e640ac4e0 0x7f0e640ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:17.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.673+0000 7f0e76a00640 1 -- 172.21.15.42:0/321960580 --> [v2:172.21.15.42:6802/2657450248,v1:172.21.15.42:6803/2657450248] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e6c004470 con 0x7f0e640ac4e0 2024-08-26T00:01:17.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.673+0000 7f0e76a00640 1 -- 172.21.15.42:0/321960580 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f0e6c0d32a0 con 0x7f0e80102110 2024-08-26T00:01:17.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.673+0000 7f0e7e800640 1 --2- 172.21.15.42:0/321960580 >> [v2:172.21.15.42:6802/2657450248,v1:172.21.15.42:6803/2657450248] conn(0x7f0e640ac4e0 0x7f0e640ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:17.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.674+0000 7f0e7de00640 1 --2- 172.21.15.42:0/321960580 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0e640a2c90 0x7f0e640a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009230 tx=0x7f0e700058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:17.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.674+0000 7f0e7e800640 1 --2- 172.21.15.42:0/321960580 >> [v2:172.21.15.42:6802/2657450248,v1:172.21.15.42:6803/2657450248] conn(0x7f0e640ac4e0 0x7f0e640ae900 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:17.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.675+0000 7f0e76a00640 1 -- 172.21.15.42:0/321960580 <== osd.0 v2:172.21.15.42:6802/2657450248 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0e6c004470 con 0x7f0e640ac4e0 2024-08-26T00:01:17.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.689+0000 7f0e7f200640 1 -- 172.21.15.42:0/321960580 --> [v2:172.21.15.42:6802/2657450248,v1:172.21.15.42:6803/2657450248] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0e80062bf0 con 0x7f0e640ac4e0 2024-08-26T00:01:17.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.690+0000 7f0e76a00640 1 -- 172.21.15.42:0/321960580 <== osd.0 v2:172.21.15.42:6802/2657450248 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0e80062bf0 con 0x7f0e640ac4e0 2024-08-26T00:01:17.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.690+0000 7f0e7f200640 1 -- 172.21.15.42:0/321960580 >> [v2:172.21.15.42:6802/2657450248,v1:172.21.15.42:6803/2657450248] conn(0x7f0e640ac4e0 msgr2=0x7f0e640ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:17.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.690+0000 7f0e7f200640 1 --2- 172.21.15.42:0/321960580 >> [v2:172.21.15.42:6802/2657450248,v1:172.21.15.42:6803/2657450248] conn(0x7f0e640ac4e0 0x7f0e640ae900 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:17.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.690+0000 7f0e7f200640 1 -- 172.21.15.42:0/321960580 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0e640a2c90 msgr2=0x7f0e640a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:17.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.690+0000 7f0e7f200640 1 --2- 172.21.15.42:0/321960580 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0e640a2c90 0x7f0e640a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009230 tx=0x7f0e700058d0 comp rx=0 tx=0).stop 2024-08-26T00:01:17.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.690+0000 7f0e7f200640 1 -- 172.21.15.42:0/321960580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e80102110 msgr2=0x7f0e80198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:17.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.690+0000 7f0e7f200640 1 --2- 172.21.15.42:0/321960580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e80102110 0x7f0e80198540 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c00d950 tx=0x7f0e6c00de10 comp rx=0 tx=0).stop 2024-08-26T00:01:17.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.690+0000 7f0e7e800640 1 -- 172.21.15.42:0/321960580 reap_dead start 2024-08-26T00:01:17.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.690+0000 7f0e7f200640 1 -- 172.21.15.42:0/321960580 shutdown_connections 2024-08-26T00:01:17.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.690+0000 7f0e7f200640 1 -- 172.21.15.42:0/321960580 >> 172.21.15.42:0/321960580 conn(0x7f0e800fd4b0 msgr2=0x7f0e800fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:17.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.691+0000 7f0e7f200640 1 -- 172.21.15.42:0/321960580 shutdown_connections 2024-08-26T00:01:17.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:17.691+0000 7f0e7f200640 1 -- 172.21.15.42:0/321960580 wait complete. 2024-08-26T00:01:17.836 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:17 smithi181 ceph-mon[22102]: pgmap v300: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-26T00:01:18.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:17 smithi043 ceph-mon[22091]: pgmap v300: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-26T00:01:18.985 INFO:teuthology.orchestra.run.smithi042.stdout:98784247870 2024-08-26T00:01:18.986 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-08-26T00:01:19.150 INFO:teuthology.orchestra.run.smithi042.stdout:34359738446 2024-08-26T00:01:19.150 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-08-26T00:01:19.747 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:19 smithi042 ceph-mon[17225]: pgmap v301: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-26T00:01:19.781 INFO:teuthology.orchestra.run.smithi042.stdout:150323855413 2024-08-26T00:01:19.782 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-08-26T00:01:19.980 INFO:teuthology.orchestra.run.smithi042.stdout:180388626479 2024-08-26T00:01:19.981 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-08-26T00:01:20.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:19 smithi043 ceph-mon[22091]: pgmap v301: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-26T00:01:20.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:19 smithi181 ceph-mon[22102]: pgmap v301: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-26T00:01:20.125 INFO:teuthology.orchestra.run.smithi042.stdout:128849018936 2024-08-26T00:01:20.125 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-08-26T00:01:20.587 INFO:teuthology.orchestra.run.smithi042.stdout:279172874267 2024-08-26T00:01:20.587 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-08-26T00:01:20.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.105+0000 7f318dc00640 1 -- 172.21.15.42:0/1768742126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3188102110 msgr2=0x7f318810e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:20.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.105+0000 7f318dc00640 1 --2- 172.21.15.42:0/1768742126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3188102110 0x7f318810e640 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3180009930 tx=0x7f318002a420 comp rx=0 tx=0).stop 2024-08-26T00:01:20.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.105+0000 7f318dc00640 1 -- 172.21.15.42:0/1768742126 shutdown_connections 2024-08-26T00:01:20.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.105+0000 7f318dc00640 1 --2- 172.21.15.42:0/1768742126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3188102110 0x7f318810e640 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:20.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.105+0000 7f318dc00640 1 --2- 172.21.15.42:0/1768742126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3188101770 0x7f3188101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:20.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.105+0000 7f318dc00640 1 --2- 172.21.15.42:0/1768742126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3188107770 0x7f3188107b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:20.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.105+0000 7f318dc00640 1 -- 172.21.15.42:0/1768742126 >> 172.21.15.42:0/1768742126 conn(0x7f31880fd4b0 msgr2=0x7f31880ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:20.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.105+0000 7f318dc00640 1 -- 172.21.15.42:0/1768742126 shutdown_connections 2024-08-26T00:01:20.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.105+0000 7f318dc00640 1 -- 172.21.15.42:0/1768742126 wait complete. 2024-08-26T00:01:20.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.106+0000 7f318dc00640 1 Processor -- start 2024-08-26T00:01:20.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.106+0000 7f318dc00640 1 -- start start 2024-08-26T00:01:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.106+0000 7f318dc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3188101770 0x7f3188074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.106+0000 7f318dc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3188102110 0x7f31880747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.106+0000 7f318dc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3188107770 0x7f3188074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.106+0000 7f318dc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3188111bc0 con 0x7f3188107770 2024-08-26T00:01:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.106+0000 7f318dc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3188111a40 con 0x7f3188101770 2024-08-26T00:01:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.106+0000 7f318dc00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3188111d40 con 0x7f3188102110 2024-08-26T00:01:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.107+0000 7f318d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3188107770 0x7f3188074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.107+0000 7f318d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3188107770 0x7f3188074d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56432/0 (socket says 172.21.15.42:56432) 2024-08-26T00:01:20.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.107+0000 7f318d200640 1 -- 172.21.15.42:0/468433727 learned_addr learned my addr 172.21.15.42:0/468433727 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:20.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.107+0000 7f3187e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3188101770 0x7f3188074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:20.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.107+0000 7f317f400640 1 --2- 172.21.15.42:0/468433727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3188102110 0x7f31880747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:20.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.107+0000 7f3187e00640 1 -- 172.21.15.42:0/468433727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3188102110 msgr2=0x7f31880747d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:20.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.107+0000 7f3187e00640 1 --2- 172.21.15.42:0/468433727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3188102110 0x7f31880747d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:20.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.107+0000 7f3187e00640 1 -- 172.21.15.42:0/468433727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3188107770 msgr2=0x7f3188074d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:20.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.107+0000 7f3187e00640 1 --2- 172.21.15.42:0/468433727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3188107770 0x7f3188074d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:20.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.107+0000 7f3187e00640 1 -- 172.21.15.42:0/468433727 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31881a6480 con 0x7f3188101770 2024-08-26T00:01:20.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.107+0000 7f3187e00640 1 --2- 172.21.15.42:0/468433727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3188101770 0x7f3188074290 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f317800ec80 tx=0x7f317800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:20.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.108+0000 7f3185600640 1 -- 172.21.15.42:0/468433727 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178003b70 con 0x7f3188101770 2024-08-26T00:01:20.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.108+0000 7f318dc00640 1 -- 172.21.15.42:0/468433727 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31881a6770 con 0x7f3188101770 2024-08-26T00:01:20.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.108+0000 7f3185600640 1 -- 172.21.15.42:0/468433727 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3178003d10 con 0x7f3188101770 2024-08-26T00:01:20.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.108+0000 7f3185600640 1 -- 172.21.15.42:0/468433727 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178010a30 con 0x7f3188101770 2024-08-26T00:01:20.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.108+0000 7f318dc00640 1 -- 172.21.15.42:0/468433727 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31881a6cb0 con 0x7f3188101770 2024-08-26T00:01:20.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.108+0000 7f318dc00640 1 -- 172.21.15.42:0/468433727 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f31880ff510 con 0x7f3188101770 2024-08-26T00:01:20.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.111+0000 7f3185600640 1 -- 172.21.15.42:0/468433727 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3178003ec0 con 0x7f3188101770 2024-08-26T00:01:20.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.112+0000 7f3185600640 1 --2- 172.21.15.42:0/468433727 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f316c0a2c10 0x7f316c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:20.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.112+0000 7f3185600640 1 -- 172.21.15.42:0/468433727 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f31780cf7c0 con 0x7f3188101770 2024-08-26T00:01:20.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.112+0000 7f317f400640 1 --2- 172.21.15.42:0/468433727 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f316c0a2c10 0x7f316c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:20.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.112+0000 7f3185600640 1 --2- 172.21.15.42:0/468433727 >> [v2:172.21.15.181:6800/189987070,v1:172.21.15.181:6801/189987070] conn(0x7f316c0ac460 0x7f316c0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:20.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.112+0000 7f3185600640 1 -- 172.21.15.42:0/468433727 --> [v2:172.21.15.181:6800/189987070,v1:172.21.15.181:6801/189987070] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f316c0aef30 con 0x7f316c0ac460 2024-08-26T00:01:20.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.112+0000 7f3185600640 1 -- 172.21.15.42:0/468433727 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f31780cfb70 con 0x7f3188101770 2024-08-26T00:01:20.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.113+0000 7f318d200640 1 --2- 172.21.15.42:0/468433727 >> [v2:172.21.15.181:6800/189987070,v1:172.21.15.181:6801/189987070] conn(0x7f316c0ac460 0x7f316c0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:20.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.113+0000 7f317f400640 1 --2- 172.21.15.42:0/468433727 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f316c0a2c10 0x7f316c0a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3188075d20 tx=0x7f3170005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:20.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.113+0000 7f318d200640 1 --2- 172.21.15.42:0/468433727 >> [v2:172.21.15.181:6800/189987070,v1:172.21.15.181:6801/189987070] conn(0x7f316c0ac460 0x7f316c0ae880 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:20.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.114+0000 7f3185600640 1 -- 172.21.15.42:0/468433727 <== osd.2 v2:172.21.15.181:6800/189987070 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f316c0aef30 con 0x7f316c0ac460 2024-08-26T00:01:20.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.129+0000 7f318dc00640 1 -- 172.21.15.42:0/468433727 --> [v2:172.21.15.181:6800/189987070,v1:172.21.15.181:6801/189987070] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3188102eb0 con 0x7f316c0ac460 2024-08-26T00:01:20.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.129+0000 7f3185600640 1 -- 172.21.15.42:0/468433727 <== osd.2 v2:172.21.15.181:6800/189987070 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3188102eb0 con 0x7f316c0ac460 2024-08-26T00:01:20.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.130+0000 7f318dc00640 1 -- 172.21.15.42:0/468433727 >> [v2:172.21.15.181:6800/189987070,v1:172.21.15.181:6801/189987070] conn(0x7f316c0ac460 msgr2=0x7f316c0ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:20.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.130+0000 7f318dc00640 1 --2- 172.21.15.42:0/468433727 >> [v2:172.21.15.181:6800/189987070,v1:172.21.15.181:6801/189987070] conn(0x7f316c0ac460 0x7f316c0ae880 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:20.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.130+0000 7f318dc00640 1 -- 172.21.15.42:0/468433727 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f316c0a2c10 msgr2=0x7f316c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:20.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.130+0000 7f318dc00640 1 --2- 172.21.15.42:0/468433727 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f316c0a2c10 0x7f316c0a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3188075d20 tx=0x7f3170005f90 comp rx=0 tx=0).stop 2024-08-26T00:01:20.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.130+0000 7f318dc00640 1 -- 172.21.15.42:0/468433727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3188101770 msgr2=0x7f3188074290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:20.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.130+0000 7f318dc00640 1 --2- 172.21.15.42:0/468433727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3188101770 0x7f3188074290 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f317800ec80 tx=0x7f317800c6a0 comp rx=0 tx=0).stop 2024-08-26T00:01:20.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.130+0000 7f318d200640 1 -- 172.21.15.42:0/468433727 reap_dead start 2024-08-26T00:01:20.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.130+0000 7f318dc00640 1 -- 172.21.15.42:0/468433727 shutdown_connections 2024-08-26T00:01:20.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.130+0000 7f318dc00640 1 -- 172.21.15.42:0/468433727 >> 172.21.15.42:0/468433727 conn(0x7f31880fd4b0 msgr2=0x7f31880feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:20.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.130+0000 7f318dc00640 1 -- 172.21.15.42:0/468433727 shutdown_connections 2024-08-26T00:01:20.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:11.130+0000 7f318dc00640 1 -- 172.21.15.42:0/468433727 wait complete. 2024-08-26T00:01:21.486 INFO:teuthology.orchestra.run.smithi042.stdout:73014444100 2024-08-26T00:01:21.486 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-08-26T00:01:21.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:21 smithi042 ceph-mon[17225]: pgmap v302: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-26T00:01:22.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:21 smithi043 ceph-mon[22091]: pgmap v302: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-26T00:01:22.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:21 smithi181 ceph-mon[22102]: pgmap v302: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-26T00:01:22.295 INFO:teuthology.orchestra.run.smithi042.stdout:227633266726 2024-08-26T00:01:22.296 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-08-26T00:01:22.649 INFO:teuthology.orchestra.run.smithi042.stdout:309237645334 2024-08-26T00:01:22.649 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-08-26T00:01:22.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.915+0000 7f6c4b600640 1 -- 172.21.15.42:0/568666036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c44103b50 msgr2=0x7f6c44103fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.915+0000 7f6c4b600640 1 --2- 172.21.15.42:0/568666036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c44103b50 0x7f6c44103fb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009890 tx=0x7f6c3002a360 comp rx=0 tx=0).stop 2024-08-26T00:01:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.915+0000 7f6c4b600640 1 -- 172.21.15.42:0/568666036 shutdown_connections 2024-08-26T00:01:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.915+0000 7f6c4b600640 1 --2- 172.21.15.42:0/568666036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c441044f0 0x7f6c441109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.915+0000 7f6c4b600640 1 --2- 172.21.15.42:0/568666036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c44103b50 0x7f6c44103fb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.915+0000 7f6c4b600640 1 --2- 172.21.15.42:0/568666036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c44109c00 0x7f6c44109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.915+0000 7f6c4b600640 1 -- 172.21.15.42:0/568666036 >> 172.21.15.42:0/568666036 conn(0x7f6c440ff830 msgr2=0x7f6c44101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.915+0000 7f6c4b600640 1 -- 172.21.15.42:0/568666036 shutdown_connections 2024-08-26T00:01:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.915+0000 7f6c4b600640 1 -- 172.21.15.42:0/568666036 wait complete. 2024-08-26T00:01:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.916+0000 7f6c4b600640 1 Processor -- start 2024-08-26T00:01:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.916+0000 7f6c4b600640 1 -- start start 2024-08-26T00:01:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.917+0000 7f6c4b600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c44103b50 0x7f6c4419a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:22.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.917+0000 7f6c4b600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c441044f0 0x7f6c4419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.917+0000 7f6c4b600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c44109c00 0x7f6c4419ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.917+0000 7f6c4b600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6c44113f20 con 0x7f6c441044f0 2024-08-26T00:01:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.917+0000 7f6c4b600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6c44113da0 con 0x7f6c44109c00 2024-08-26T00:01:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.917+0000 7f6c4b600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6c441140a0 con 0x7f6c44103b50 2024-08-26T00:01:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.917+0000 7f6c48c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c44103b50 0x7f6c4419a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.917+0000 7f6c49600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c44109c00 0x7f6c4419ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.917+0000 7f6c48c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c44103b50 0x7f6c4419a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:59650/0 (socket says 172.21.15.42:59650) 2024-08-26T00:01:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.917+0000 7f6c43e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c441044f0 0x7f6c4419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.917+0000 7f6c48c00640 1 -- 172.21.15.42:0/4175384026 learned_addr learned my addr 172.21.15.42:0/4175384026 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.917+0000 7f6c48c00640 1 -- 172.21.15.42:0/4175384026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c44109c00 msgr2=0x7f6c4419ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.917+0000 7f6c48c00640 1 --2- 172.21.15.42:0/4175384026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c44109c00 0x7f6c4419ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.918+0000 7f6c48c00640 1 -- 172.21.15.42:0/4175384026 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c441044f0 msgr2=0x7f6c4419a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.918+0000 7f6c48c00640 1 --2- 172.21.15.42:0/4175384026 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c441044f0 0x7f6c4419a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:22.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.918+0000 7f6c48c00640 1 -- 172.21.15.42:0/4175384026 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4419f330 con 0x7f6c44103b50 2024-08-26T00:01:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.918+0000 7f6c43e00640 1 --2- 172.21.15.42:0/4175384026 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c441044f0 0x7f6c4419a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.918+0000 7f6c49600640 1 --2- 172.21.15.42:0/4175384026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c44109c00 0x7f6c4419ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.918+0000 7f6c48c00640 1 --2- 172.21.15.42:0/4175384026 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c44103b50 0x7f6c4419a380 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800e9c0 tx=0x7f6c3800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.918+0000 7f6c41600640 1 -- 172.21.15.42:0/4175384026 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3800ccc0 con 0x7f6c44103b50 2024-08-26T00:01:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.918+0000 7f6c41600640 1 -- 172.21.15.42:0/4175384026 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c38005500 con 0x7f6c44103b50 2024-08-26T00:01:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.918+0000 7f6c4b600640 1 -- 172.21.15.42:0/4175384026 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c4419f620 con 0x7f6c44103b50 2024-08-26T00:01:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.918+0000 7f6c41600640 1 -- 172.21.15.42:0/4175384026 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c38010430 con 0x7f6c44103b50 2024-08-26T00:01:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.918+0000 7f6c4b600640 1 -- 172.21.15.42:0/4175384026 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c441a6f00 con 0x7f6c44103b50 2024-08-26T00:01:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.919+0000 7f6c4b600640 1 -- 172.21.15.42:0/4175384026 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6c44062720 con 0x7f6c44103b50 2024-08-26T00:01:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.921+0000 7f6c41600640 1 -- 172.21.15.42:0/4175384026 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6c380046c0 con 0x7f6c44103b50 2024-08-26T00:01:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.923+0000 7f6c41600640 1 --2- 172.21.15.42:0/4175384026 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f6c2c0a2c10 0x7f6c2c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.923+0000 7f6c41600640 1 -- 172.21.15.42:0/4175384026 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f6c380cf830 con 0x7f6c44103b50 2024-08-26T00:01:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.923+0000 7f6c43e00640 1 --2- 172.21.15.42:0/4175384026 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f6c2c0a2c10 0x7f6c2c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.923+0000 7f6c41600640 1 --2- 172.21.15.42:0/4175384026 >> [v2:172.21.15.42:6826/1052069444,v1:172.21.15.42:6827/1052069444] conn(0x7f6c2c0ac460 0x7f6c2c0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.923+0000 7f6c41600640 1 -- 172.21.15.42:0/4175384026 --> [v2:172.21.15.42:6826/1052069444,v1:172.21.15.42:6827/1052069444] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c2c0aef30 con 0x7f6c2c0ac460 2024-08-26T00:01:22.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.923+0000 7f6c41600640 1 -- 172.21.15.42:0/4175384026 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f6c380cfbe0 con 0x7f6c44103b50 2024-08-26T00:01:22.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.923+0000 7f6c49600640 1 --2- 172.21.15.42:0/4175384026 >> [v2:172.21.15.42:6826/1052069444,v1:172.21.15.42:6827/1052069444] conn(0x7f6c2c0ac460 0x7f6c2c0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:22.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.924+0000 7f6c43e00640 1 --2- 172.21.15.42:0/4175384026 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f6c2c0a2c10 0x7f6c2c0a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6c30035040 tx=0x7f6c300056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:22.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.924+0000 7f6c49600640 1 --2- 172.21.15.42:0/4175384026 >> [v2:172.21.15.42:6826/1052069444,v1:172.21.15.42:6827/1052069444] conn(0x7f6c2c0ac460 0x7f6c2c0ae880 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:22.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.925+0000 7f6c41600640 1 -- 172.21.15.42:0/4175384026 <== osd.9 v2:172.21.15.42:6826/1052069444 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6c2c0aef30 con 0x7f6c2c0ac460 2024-08-26T00:01:22.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.939+0000 7f6c4b600640 1 -- 172.21.15.42:0/4175384026 --> [v2:172.21.15.42:6826/1052069444,v1:172.21.15.42:6827/1052069444] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6c44062ba0 con 0x7f6c2c0ac460 2024-08-26T00:01:22.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.939+0000 7f6c41600640 1 -- 172.21.15.42:0/4175384026 <== osd.9 v2:172.21.15.42:6826/1052069444 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6c44062ba0 con 0x7f6c2c0ac460 2024-08-26T00:01:22.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.940+0000 7f6c4b600640 1 -- 172.21.15.42:0/4175384026 >> [v2:172.21.15.42:6826/1052069444,v1:172.21.15.42:6827/1052069444] conn(0x7f6c2c0ac460 msgr2=0x7f6c2c0ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:22.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.940+0000 7f6c4b600640 1 --2- 172.21.15.42:0/4175384026 >> [v2:172.21.15.42:6826/1052069444,v1:172.21.15.42:6827/1052069444] conn(0x7f6c2c0ac460 0x7f6c2c0ae880 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:22.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.940+0000 7f6c4b600640 1 -- 172.21.15.42:0/4175384026 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f6c2c0a2c10 msgr2=0x7f6c2c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:22.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.940+0000 7f6c4b600640 1 --2- 172.21.15.42:0/4175384026 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f6c2c0a2c10 0x7f6c2c0a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6c30035040 tx=0x7f6c300056d0 comp rx=0 tx=0).stop 2024-08-26T00:01:22.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.940+0000 7f6c4b600640 1 -- 172.21.15.42:0/4175384026 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c44103b50 msgr2=0x7f6c4419a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:22.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.940+0000 7f6c4b600640 1 --2- 172.21.15.42:0/4175384026 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c44103b50 0x7f6c4419a380 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800e9c0 tx=0x7f6c3800ee80 comp rx=0 tx=0).stop 2024-08-26T00:01:22.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.940+0000 7f6c49600640 1 -- 172.21.15.42:0/4175384026 reap_dead start 2024-08-26T00:01:22.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.940+0000 7f6c4b600640 1 -- 172.21.15.42:0/4175384026 shutdown_connections 2024-08-26T00:01:22.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.940+0000 7f6c4b600640 1 -- 172.21.15.42:0/4175384026 >> 172.21.15.42:0/4175384026 conn(0x7f6c440ff830 msgr2=0x7f6c44100fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:22.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.940+0000 7f6c4b600640 1 -- 172.21.15.42:0/4175384026 shutdown_connections 2024-08-26T00:01:22.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:14.940+0000 7f6c4b600640 1 -- 172.21.15.42:0/4175384026 wait complete. 2024-08-26T00:01:23.379 INFO:teuthology.orchestra.run.smithi042.stdout:55834574921 2024-08-26T00:01:23.380 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-08-26T00:01:23.694 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:23 smithi042 ceph-mon[17225]: pgmap v303: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:01:23.740 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:23.745 INFO:teuthology.orchestra.run.smithi042.stdout:257698037792 2024-08-26T00:01:23.746 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-08-26T00:01:23.774 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:23.788 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:23.791 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:23.837 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:23.849 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:23.920 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:24.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:23 smithi043 ceph-mon[22091]: pgmap v303: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:01:24.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:23 smithi181 ceph-mon[22102]: pgmap v303: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:01:25.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.665+0000 7fa477800640 1 -- 172.21.15.42:0/196050539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa470103b50 msgr2=0x7fa470103fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:25.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.665+0000 7fa477800640 1 --2- 172.21.15.42:0/196050539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa470103b50 0x7fa470103fb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009900 tx=0x7fa45c02a410 comp rx=0 tx=0).stop 2024-08-26T00:01:25.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.665+0000 7fa477800640 1 -- 172.21.15.42:0/196050539 shutdown_connections 2024-08-26T00:01:25.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.665+0000 7fa477800640 1 --2- 172.21.15.42:0/196050539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4701044f0 0x7fa4701109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:25.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.665+0000 7fa477800640 1 --2- 172.21.15.42:0/196050539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa470103b50 0x7fa470103fb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:25.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.665+0000 7fa477800640 1 --2- 172.21.15.42:0/196050539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa470109c00 0x7fa470109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:25.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.665+0000 7fa477800640 1 -- 172.21.15.42:0/196050539 >> 172.21.15.42:0/196050539 conn(0x7fa4700ff830 msgr2=0x7fa470101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:25.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.665+0000 7fa477800640 1 -- 172.21.15.42:0/196050539 shutdown_connections 2024-08-26T00:01:25.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.665+0000 7fa477800640 1 -- 172.21.15.42:0/196050539 wait complete. 2024-08-26T00:01:25.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.666+0000 7fa477800640 1 Processor -- start 2024-08-26T00:01:25.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.666+0000 7fa477800640 1 -- start start 2024-08-26T00:01:25.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.666+0000 7fa477800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa470103b50 0x7fa47019a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:25.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.666+0000 7fa477800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4701044f0 0x7fa47019a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:25.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.666+0000 7fa477800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa470109c00 0x7fa47019ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:25.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.666+0000 7fa477800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa470113fb0 con 0x7fa470109c00 2024-08-26T00:01:25.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.666+0000 7fa477800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa470113e30 con 0x7fa4701044f0 2024-08-26T00:01:25.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.666+0000 7fa477800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa470114130 con 0x7fa470103b50 2024-08-26T00:01:25.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.667+0000 7fa475800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa470109c00 0x7fa47019ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:25.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.667+0000 7fa475800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa470109c00 0x7fa47019ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54972/0 (socket says 172.21.15.42:54972) 2024-08-26T00:01:25.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.667+0000 7fa475800640 1 -- 172.21.15.42:0/282505146 learned_addr learned my addr 172.21.15.42:0/282505146 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:25.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.667+0000 7fa46fe00640 1 --2- 172.21.15.42:0/282505146 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4701044f0 0x7fa47019a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:25.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.667+0000 7fa474e00640 1 --2- 172.21.15.42:0/282505146 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa470103b50 0x7fa47019a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:25.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.667+0000 7fa475800640 1 -- 172.21.15.42:0/282505146 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa470103b50 msgr2=0x7fa47019a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:25.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.667+0000 7fa475800640 1 --2- 172.21.15.42:0/282505146 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa470103b50 0x7fa47019a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:25.014 INFO:teuthology.orchestra.run.smithi042.stdout:34359738447 2024-08-26T00:01:25.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.667+0000 7fa475800640 1 -- 172.21.15.42:0/282505146 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4701044f0 msgr2=0x7fa47019a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:25.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.667+0000 7fa475800640 1 --2- 172.21.15.42:0/282505146 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4701044f0 0x7fa47019a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:25.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.667+0000 7fa475800640 1 -- 172.21.15.42:0/282505146 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa47019f340 con 0x7fa470109c00 2024-08-26T00:01:25.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.667+0000 7fa475800640 1 --2- 172.21.15.42:0/282505146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa470109c00 0x7fa47019ec60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa46800eb10 tx=0x7fa46800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:25.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.667+0000 7fa46d600640 1 -- 172.21.15.42:0/282505146 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa468004b20 con 0x7fa470109c00 2024-08-26T00:01:25.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.668+0000 7fa46d600640 1 -- 172.21.15.42:0/282505146 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa468004cc0 con 0x7fa470109c00 2024-08-26T00:01:25.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.668+0000 7fa46d600640 1 -- 172.21.15.42:0/282505146 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa468010760 con 0x7fa470109c00 2024-08-26T00:01:25.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.668+0000 7fa477800640 1 -- 172.21.15.42:0/282505146 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa47019f630 con 0x7fa470109c00 2024-08-26T00:01:25.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.668+0000 7fa477800640 1 -- 172.21.15.42:0/282505146 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4701a6f10 con 0x7fa470109c00 2024-08-26T00:01:25.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.669+0000 7fa477800640 1 -- 172.21.15.42:0/282505146 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa470103fb0 con 0x7fa470109c00 2024-08-26T00:01:25.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.671+0000 7fa46d600640 1 -- 172.21.15.42:0/282505146 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa468005020 con 0x7fa470109c00 2024-08-26T00:01:25.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.672+0000 7fa46d600640 1 --2- 172.21.15.42:0/282505146 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa4580a2c10 0x7fa4580a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:25.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.672+0000 7fa46d600640 1 -- 172.21.15.42:0/282505146 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fa4680cf7c0 con 0x7fa470109c00 2024-08-26T00:01:25.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.672+0000 7fa474e00640 1 --2- 172.21.15.42:0/282505146 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa4580a2c10 0x7fa4580a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:25.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.673+0000 7fa474e00640 1 --2- 172.21.15.42:0/282505146 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa4580a2c10 0x7fa4580a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa464009bd0 tx=0x7fa464005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:25.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.676+0000 7fa46d600640 1 -- 172.21.15.42:0/282505146 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa46809c670 con 0x7fa470109c00 2024-08-26T00:01:25.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.865+0000 7fa477800640 1 -- 172.21.15.42:0/282505146 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa4701a72a0 con 0x7fa470109c00 2024-08-26T00:01:25.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.866+0000 7fa46d600640 1 -- 172.21.15.42:0/282505146 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa46809bf70 con 0x7fa470109c00 2024-08-26T00:01:25.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.868+0000 7fa477800640 1 -- 172.21.15.42:0/282505146 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa4580a2c10 msgr2=0x7fa4580a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:25.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.868+0000 7fa477800640 1 --2- 172.21.15.42:0/282505146 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa4580a2c10 0x7fa4580a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa464009bd0 tx=0x7fa464005f90 comp rx=0 tx=0).stop 2024-08-26T00:01:25.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.868+0000 7fa477800640 1 -- 172.21.15.42:0/282505146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa470109c00 msgr2=0x7fa47019ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:25.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.868+0000 7fa477800640 1 --2- 172.21.15.42:0/282505146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa470109c00 0x7fa47019ec60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa46800eb10 tx=0x7fa46800c2d0 comp rx=0 tx=0).stop 2024-08-26T00:01:25.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.868+0000 7fa477800640 1 -- 172.21.15.42:0/282505146 shutdown_connections 2024-08-26T00:01:25.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.868+0000 7fa477800640 1 --2- 172.21.15.42:0/282505146 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa4580a2c10 0x7fa4580a50d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:25.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.868+0000 7fa477800640 1 --2- 172.21.15.42:0/282505146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa470109c00 0x7fa47019ec60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:25.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.868+0000 7fa477800640 1 --2- 172.21.15.42:0/282505146 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4701044f0 0x7fa47019a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:25.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.868+0000 7fa477800640 1 --2- 172.21.15.42:0/282505146 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa470103b50 0x7fa47019a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:25.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.868+0000 7fa477800640 1 -- 172.21.15.42:0/282505146 >> 172.21.15.42:0/282505146 conn(0x7fa4700ff830 msgr2=0x7fa470100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:25.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.868+0000 7fa477800640 1 -- 172.21.15.42:0/282505146 shutdown_connections 2024-08-26T00:01:25.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:24.868+0000 7fa477800640 1 -- 172.21.15.42:0/282505146 wait complete. 2024-08-26T00:01:25.254 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:25.254 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:25.693 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:25 smithi042 ceph-mon[17225]: pgmap v304: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:01:25.693 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:25 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/282505146' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-08-26T00:01:25.693 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:25 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:01:25.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.706+0000 7fd313e00640 1 -- 172.21.15.42:0/3077440601 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd314103970 msgr2=0x7fd314103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:25.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.706+0000 7fd313e00640 1 --2- 172.21.15.42:0/3077440601 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd314103970 0x7fd314103dd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009930 tx=0x7fd2fc02a420 comp rx=0 tx=0).stop 2024-08-26T00:01:25.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.706+0000 7fd313e00640 1 -- 172.21.15.42:0/3077440601 shutdown_connections 2024-08-26T00:01:25.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.706+0000 7fd313e00640 1 --2- 172.21.15.42:0/3077440601 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd314104310 0x7fd314110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:25.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.706+0000 7fd313e00640 1 --2- 172.21.15.42:0/3077440601 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd314103970 0x7fd314103dd0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:25.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.706+0000 7fd313e00640 1 --2- 172.21.15.42:0/3077440601 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd314109970 0x7fd314109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:25.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.706+0000 7fd313e00640 1 -- 172.21.15.42:0/3077440601 >> 172.21.15.42:0/3077440601 conn(0x7fd3140ff670 msgr2=0x7fd314101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:25.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.706+0000 7fd313e00640 1 -- 172.21.15.42:0/3077440601 shutdown_connections 2024-08-26T00:01:25.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.706+0000 7fd313e00640 1 -- 172.21.15.42:0/3077440601 wait complete. 2024-08-26T00:01:25.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.707+0000 7fd313e00640 1 Processor -- start 2024-08-26T00:01:25.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.707+0000 7fd313e00640 1 -- start start 2024-08-26T00:01:25.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.707+0000 7fd313e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd314103970 0x7fd31419a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:25.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.708+0000 7fd313e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd314104310 0x7fd31419a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:25.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.708+0000 7fd313e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd314109970 0x7fd31419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:25.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.708+0000 7fd313e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd314113d90 con 0x7fd314103970 2024-08-26T00:01:25.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.708+0000 7fd313e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd314113c10 con 0x7fd314109970 2024-08-26T00:01:25.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.708+0000 7fd313e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd314113f10 con 0x7fd314104310 2024-08-26T00:01:25.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.708+0000 7fd312a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd314103970 0x7fd31419a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:25.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.708+0000 7fd312a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd314103970 0x7fd31419a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43748/0 (socket says 172.21.15.42:43748) 2024-08-26T00:01:25.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.708+0000 7fd312a00640 1 -- 172.21.15.42:0/3177055496 learned_addr learned my addr 172.21.15.42:0/3177055496 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:25.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.708+0000 7fd313400640 1 --2- 172.21.15.42:0/3177055496 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd314109970 0x7fd31419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:25.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.708+0000 7fd30be00640 1 --2- 172.21.15.42:0/3177055496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd314104310 0x7fd31419a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:25.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.708+0000 7fd312a00640 1 -- 172.21.15.42:0/3177055496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd314104310 msgr2=0x7fd31419a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:25.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.708+0000 7fd312a00640 1 --2- 172.21.15.42:0/3177055496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd314104310 0x7fd31419a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:25.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.708+0000 7fd312a00640 1 -- 172.21.15.42:0/3177055496 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd314109970 msgr2=0x7fd31419eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:25.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.708+0000 7fd312a00640 1 --2- 172.21.15.42:0/3177055496 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd314109970 0x7fd31419eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:25.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.708+0000 7fd312a00640 1 -- 172.21.15.42:0/3177055496 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31419f220 con 0x7fd314103970 2024-08-26T00:01:25.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.708+0000 7fd313400640 1 --2- 172.21.15.42:0/3177055496 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd314109970 0x7fd31419eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:25.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.709+0000 7fd312a00640 1 --2- 172.21.15.42:0/3177055496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd314103970 0x7fd31419a270 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd30400d950 tx=0x7fd30400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:25.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.709+0000 7fd30b400640 1 -- 172.21.15.42:0/3177055496 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd304017070 con 0x7fd314103970 2024-08-26T00:01:25.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.709+0000 7fd30b400640 1 -- 172.21.15.42:0/3177055496 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd304009c30 con 0x7fd314103970 2024-08-26T00:01:25.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.709+0000 7fd313e00640 1 -- 172.21.15.42:0/3177055496 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31419f510 con 0x7fd314103970 2024-08-26T00:01:25.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.709+0000 7fd30b400640 1 -- 172.21.15.42:0/3177055496 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30400f6b0 con 0x7fd314103970 2024-08-26T00:01:25.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.709+0000 7fd313e00640 1 -- 172.21.15.42:0/3177055496 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3141a6df0 con 0x7fd314103970 2024-08-26T00:01:25.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.710+0000 7fd313e00640 1 -- 172.21.15.42:0/3177055496 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2f0005290 con 0x7fd314103970 2024-08-26T00:01:25.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.712+0000 7fd30b400640 1 -- 172.21.15.42:0/3177055496 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd30400f850 con 0x7fd314103970 2024-08-26T00:01:25.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.713+0000 7fd30b400640 1 --2- 172.21.15.42:0/3177055496 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd2f80a2c10 0x7fd2f80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:25.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.713+0000 7fd30b400640 1 -- 172.21.15.42:0/3177055496 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fd3040ceb60 con 0x7fd314103970 2024-08-26T00:01:25.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.713+0000 7fd30be00640 1 --2- 172.21.15.42:0/3177055496 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd2f80a2c10 0x7fd2f80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:25.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.714+0000 7fd30be00640 1 --2- 172.21.15.42:0/3177055496 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd2f80a2c10 0x7fd2f80a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc006010 tx=0x7fd2fc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:25.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.717+0000 7fd30b400640 1 -- 172.21.15.42:0/3177055496 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd304009de0 con 0x7fd314103970 2024-08-26T00:01:25.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:25 smithi043 ceph-mon[22091]: pgmap v304: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:01:25.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:25 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/282505146' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-08-26T00:01:25.866 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:25 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:01:25.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.905+0000 7fd313e00640 1 -- 172.21.15.42:0/3177055496 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd2f0005850 con 0x7fd314103970 2024-08-26T00:01:25.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.905+0000 7fd30b400640 1 -- 172.21.15.42:0/3177055496 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd30409b3c0 con 0x7fd314103970 2024-08-26T00:01:25.907 INFO:teuthology.orchestra.run.smithi042.stdout:150323855415 2024-08-26T00:01:25.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.907+0000 7fd313e00640 1 -- 172.21.15.42:0/3177055496 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd2f80a2c10 msgr2=0x7fd2f80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:25.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.907+0000 7fd313e00640 1 --2- 172.21.15.42:0/3177055496 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd2f80a2c10 0x7fd2f80a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc006010 tx=0x7fd2fc000bc0 comp rx=0 tx=0).stop 2024-08-26T00:01:25.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.907+0000 7fd313e00640 1 -- 172.21.15.42:0/3177055496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd314103970 msgr2=0x7fd31419a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:25.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.907+0000 7fd313e00640 1 --2- 172.21.15.42:0/3177055496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd314103970 0x7fd31419a270 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd30400d950 tx=0x7fd30400de10 comp rx=0 tx=0).stop 2024-08-26T00:01:25.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.908+0000 7fd313e00640 1 -- 172.21.15.42:0/3177055496 shutdown_connections 2024-08-26T00:01:25.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.908+0000 7fd313e00640 1 --2- 172.21.15.42:0/3177055496 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd2f80a2c10 0x7fd2f80a50d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:25.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.908+0000 7fd313e00640 1 --2- 172.21.15.42:0/3177055496 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd314109970 0x7fd31419eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:25.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.908+0000 7fd313e00640 1 --2- 172.21.15.42:0/3177055496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd314104310 0x7fd31419a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:25.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.908+0000 7fd313e00640 1 --2- 172.21.15.42:0/3177055496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd314103970 0x7fd31419a270 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:25.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.908+0000 7fd313e00640 1 -- 172.21.15.42:0/3177055496 >> 172.21.15.42:0/3177055496 conn(0x7fd3140ff670 msgr2=0x7fd3140ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:25.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.908+0000 7fd313e00640 1 -- 172.21.15.42:0/3177055496 shutdown_connections 2024-08-26T00:01:25.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:25.908+0000 7fd313e00640 1 -- 172.21.15.42:0/3177055496 wait complete. 2024-08-26T00:01:25.917 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:25 smithi181 ceph-mon[22102]: pgmap v304: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:01:25.917 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:25 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/282505146' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-08-26T00:01:25.917 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:25 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:01:26.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.588+0000 7fe5d1400640 1 -- 172.21.15.42:0/31920855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5cc104760 msgr2=0x7fe5cc1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:26.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.588+0000 7fe5d1400640 1 --2- 172.21.15.42:0/31920855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5cc104760 0x7fe5cc1087b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009900 tx=0x7fe5b402a3f0 comp rx=0 tx=0).stop 2024-08-26T00:01:26.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.588+0000 7fe5d1400640 1 -- 172.21.15.42:0/31920855 shutdown_connections 2024-08-26T00:01:26.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.588+0000 7fe5d1400640 1 --2- 172.21.15.42:0/31920855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5cc108ee0 0x7fe5cc110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:26.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.588+0000 7fe5d1400640 1 --2- 172.21.15.42:0/31920855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5cc104760 0x7fe5cc1087b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:26.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.588+0000 7fe5d1400640 1 --2- 172.21.15.42:0/31920855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5cc103db0 0x7fe5cc104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:26.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.588+0000 7fe5d1400640 1 -- 172.21.15.42:0/31920855 >> 172.21.15.42:0/31920855 conn(0x7fe5cc0ff7f0 msgr2=0x7fe5cc101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:26.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.588+0000 7fe5d1400640 1 -- 172.21.15.42:0/31920855 shutdown_connections 2024-08-26T00:01:26.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.588+0000 7fe5d1400640 1 -- 172.21.15.42:0/31920855 wait complete. 2024-08-26T00:01:26.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.589+0000 7fe5d1400640 1 Processor -- start 2024-08-26T00:01:26.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.589+0000 7fe5d1400640 1 -- start start 2024-08-26T00:01:26.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.590+0000 7fe5d1400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5cc103db0 0x7fe5cc19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:26.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.590+0000 7fe5d1400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5cc104760 0x7fe5cc19a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:26.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.590+0000 7fe5d1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5cc108ee0 0x7fe5cc19ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:26.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.590+0000 7fe5d1400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe5cc113f90 con 0x7fe5cc108ee0 2024-08-26T00:01:26.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.590+0000 7fe5d1400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe5cc113e10 con 0x7fe5cc103db0 2024-08-26T00:01:26.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.590+0000 7fe5d1400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe5cc114110 con 0x7fe5cc104760 2024-08-26T00:01:26.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.590+0000 7fe5c3e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5cc104760 0x7fe5cc19a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:26.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.590+0000 7fe5c3e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5cc104760 0x7fe5cc19a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:50032/0 (socket says 172.21.15.42:50032) 2024-08-26T00:01:26.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.590+0000 7fe5c3e00640 1 -- 172.21.15.42:0/271802801 learned_addr learned my addr 172.21.15.42:0/271802801 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:26.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.590+0000 7fe5ca800640 1 --2- 172.21.15.42:0/271802801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5cc103db0 0x7fe5cc19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:26.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.590+0000 7fe5cb200640 1 --2- 172.21.15.42:0/271802801 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5cc108ee0 0x7fe5cc19ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:26.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.590+0000 7fe5c3e00640 1 -- 172.21.15.42:0/271802801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5cc103db0 msgr2=0x7fe5cc19a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:26.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.590+0000 7fe5c3e00640 1 --2- 172.21.15.42:0/271802801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5cc103db0 0x7fe5cc19a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:26.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.590+0000 7fe5c3e00640 1 -- 172.21.15.42:0/271802801 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5cc108ee0 msgr2=0x7fe5cc19ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:26.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.590+0000 7fe5c3e00640 1 --2- 172.21.15.42:0/271802801 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5cc108ee0 0x7fe5cc19ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:26.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.591+0000 7fe5c3e00640 1 -- 172.21.15.42:0/271802801 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5cc19f3c0 con 0x7fe5cc104760 2024-08-26T00:01:26.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.591+0000 7fe5c3e00640 1 --2- 172.21.15.42:0/271802801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5cc104760 0x7fe5cc19a950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4004770 tx=0x7fe5b4003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:26.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.591+0000 7fe5c3400640 1 -- 172.21.15.42:0/271802801 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b403f070 con 0x7fe5cc104760 2024-08-26T00:01:26.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.591+0000 7fe5c3400640 1 -- 172.21.15.42:0/271802801 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5b4031ca0 con 0x7fe5cc104760 2024-08-26T00:01:26.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.591+0000 7fe5c3400640 1 -- 172.21.15.42:0/271802801 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4035030 con 0x7fe5cc104760 2024-08-26T00:01:26.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.592+0000 7fe5d1400640 1 -- 172.21.15.42:0/271802801 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5cc19f650 con 0x7fe5cc104760 2024-08-26T00:01:26.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.592+0000 7fe5d1400640 1 -- 172.21.15.42:0/271802801 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5cc19fab0 con 0x7fe5cc104760 2024-08-26T00:01:26.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.594+0000 7fe5d1400640 1 -- 172.21.15.42:0/271802801 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5cc104190 con 0x7fe5cc104760 2024-08-26T00:01:26.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.595+0000 7fe5c3400640 1 -- 172.21.15.42:0/271802801 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe5b4042070 con 0x7fe5cc104760 2024-08-26T00:01:26.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.596+0000 7fe5c3400640 1 --2- 172.21.15.42:0/271802801 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe5b00a2c10 0x7fe5b00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:26.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.596+0000 7fe5c3400640 1 -- 172.21.15.42:0/271802801 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fe5b40ef9e0 con 0x7fe5cc104760 2024-08-26T00:01:26.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.597+0000 7fe5ca800640 1 --2- 172.21.15.42:0/271802801 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe5b00a2c10 0x7fe5b00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:26.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.597+0000 7fe5ca800640 1 --2- 172.21.15.42:0/271802801 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe5b00a2c10 0x7fe5b00a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009bd0 tx=0x7fe5bc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:26.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.600+0000 7fe5c3400640 1 -- 172.21.15.42:0/271802801 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe5b4049030 con 0x7fe5cc104760 2024-08-26T00:01:26.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.816+0000 7fe5d1400640 1 -- 172.21.15.42:0/271802801 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe5cc10bb90 con 0x7fe5cc104760 2024-08-26T00:01:26.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:26 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/3177055496' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-08-26T00:01:26.817 INFO:teuthology.orchestra.run.smithi042.stdout:128849018939 2024-08-26T00:01:26.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.816+0000 7fe5c3400640 1 -- 172.21.15.42:0/271802801 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe5b40bc950 con 0x7fe5cc104760 2024-08-26T00:01:26.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.819+0000 7fe5d1400640 1 -- 172.21.15.42:0/271802801 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe5b00a2c10 msgr2=0x7fe5b00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:26.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.819+0000 7fe5d1400640 1 --2- 172.21.15.42:0/271802801 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe5b00a2c10 0x7fe5b00a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009bd0 tx=0x7fe5bc005f90 comp rx=0 tx=0).stop 2024-08-26T00:01:26.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.819+0000 7fe5d1400640 1 -- 172.21.15.42:0/271802801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5cc104760 msgr2=0x7fe5cc19a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:26.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.819+0000 7fe5d1400640 1 --2- 172.21.15.42:0/271802801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5cc104760 0x7fe5cc19a950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4004770 tx=0x7fe5b4003c10 comp rx=0 tx=0).stop 2024-08-26T00:01:26.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.819+0000 7fe5d1400640 1 -- 172.21.15.42:0/271802801 shutdown_connections 2024-08-26T00:01:26.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.819+0000 7fe5d1400640 1 --2- 172.21.15.42:0/271802801 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe5b00a2c10 0x7fe5b00a50d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:26.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.819+0000 7fe5d1400640 1 --2- 172.21.15.42:0/271802801 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5cc108ee0 0x7fe5cc19ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:26.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.819+0000 7fe5d1400640 1 --2- 172.21.15.42:0/271802801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5cc104760 0x7fe5cc19a950 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:26.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.819+0000 7fe5d1400640 1 --2- 172.21.15.42:0/271802801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5cc103db0 0x7fe5cc19a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:26.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.819+0000 7fe5d1400640 1 -- 172.21.15.42:0/271802801 >> 172.21.15.42:0/271802801 conn(0x7fe5cc0ff7f0 msgr2=0x7fe5cc100b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:26.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.820+0000 7fe5d1400640 1 -- 172.21.15.42:0/271802801 shutdown_connections 2024-08-26T00:01:26.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.820+0000 7fe5d1400640 1 -- 172.21.15.42:0/271802801 wait complete. 2024-08-26T00:01:26.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.823+0000 7fcf6fe00640 1 -- 172.21.15.42:0/4082129306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf70104300 msgr2=0x7fcf70110830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:26.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.823+0000 7fcf6fe00640 1 --2- 172.21.15.42:0/4082129306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf70104300 0x7fcf70110830 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcf68009c10 tx=0x7fcf6802a6e0 comp rx=0 tx=0).stop 2024-08-26T00:01:26.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.823+0000 7fcf6fe00640 1 -- 172.21.15.42:0/4082129306 shutdown_connections 2024-08-26T00:01:26.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.823+0000 7fcf6fe00640 1 --2- 172.21.15.42:0/4082129306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf70104300 0x7fcf70110830 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:26.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.823+0000 7fcf6fe00640 1 --2- 172.21.15.42:0/4082129306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf70103960 0x7fcf70103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:26.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.823+0000 7fcf6fe00640 1 --2- 172.21.15.42:0/4082129306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf70109960 0x7fcf70109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:26.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.823+0000 7fcf6fe00640 1 -- 172.21.15.42:0/4082129306 >> 172.21.15.42:0/4082129306 conn(0x7fcf700ff620 msgr2=0x7fcf70101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:26.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.823+0000 7fcf6fe00640 1 -- 172.21.15.42:0/4082129306 shutdown_connections 2024-08-26T00:01:26.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.823+0000 7fcf6fe00640 1 -- 172.21.15.42:0/4082129306 wait complete. 2024-08-26T00:01:26.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.824+0000 7fcf6fe00640 1 Processor -- start 2024-08-26T00:01:26.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.824+0000 7fcf6fe00640 1 -- start start 2024-08-26T00:01:26.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.824+0000 7fcf6fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf70103960 0x7fcf7019a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:26.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.824+0000 7fcf6fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf70104300 0x7fcf7019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:26.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.824+0000 7fcf6fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf70109960 0x7fcf7019eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:26.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.825+0000 7fcf6fe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcf70113d60 con 0x7fcf70109960 2024-08-26T00:01:26.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.825+0000 7fcf6fe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcf70113be0 con 0x7fcf70104300 2024-08-26T00:01:26.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.825+0000 7fcf6fe00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcf70113ee0 con 0x7fcf70103960 2024-08-26T00:01:26.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.825+0000 7fcf6ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf70103960 0x7fcf7019a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:26.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.825+0000 7fcf6f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf70109960 0x7fcf7019eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:26.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.825+0000 7fcf6ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf70103960 0x7fcf7019a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:50054/0 (socket says 172.21.15.42:50054) 2024-08-26T00:01:26.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.825+0000 7fcf6ea00640 1 -- 172.21.15.42:0/1029710038 learned_addr learned my addr 172.21.15.42:0/1029710038 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:26.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.825+0000 7fcf6e000640 1 --2- 172.21.15.42:0/1029710038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf70104300 0x7fcf7019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:26.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.825+0000 7fcf6f400640 1 -- 172.21.15.42:0/1029710038 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf70103960 msgr2=0x7fcf7019a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:26.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.826+0000 7fcf6f400640 1 --2- 172.21.15.42:0/1029710038 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf70103960 0x7fcf7019a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:26.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.826+0000 7fcf6f400640 1 -- 172.21.15.42:0/1029710038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf70104300 msgr2=0x7fcf7019a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:26.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.826+0000 7fcf6f400640 1 --2- 172.21.15.42:0/1029710038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf70104300 0x7fcf7019a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:26.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.826+0000 7fcf6f400640 1 -- 172.21.15.42:0/1029710038 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf7019f1d0 con 0x7fcf70109960 2024-08-26T00:01:26.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.826+0000 7fcf6f400640 1 --2- 172.21.15.42:0/1029710038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf70109960 0x7fcf7019eaf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcf68034040 tx=0x7fcf680305d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:26.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.826+0000 7fcf67400640 1 -- 172.21.15.42:0/1029710038 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf68041020 con 0x7fcf70109960 2024-08-26T00:01:26.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.826+0000 7fcf67400640 1 -- 172.21.15.42:0/1029710038 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf68003e50 con 0x7fcf70109960 2024-08-26T00:01:26.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.826+0000 7fcf6fe00640 1 -- 172.21.15.42:0/1029710038 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf7019f460 con 0x7fcf70109960 2024-08-26T00:01:26.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.827+0000 7fcf6fe00640 1 -- 172.21.15.42:0/1029710038 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf7019f910 con 0x7fcf70109960 2024-08-26T00:01:26.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.827+0000 7fcf67400640 1 -- 172.21.15.42:0/1029710038 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf68036040 con 0x7fcf70109960 2024-08-26T00:01:26.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.828+0000 7fcf6fe00640 1 -- 172.21.15.42:0/1029710038 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf50005290 con 0x7fcf70109960 2024-08-26T00:01:26.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.830+0000 7fcf67400640 1 -- 172.21.15.42:0/1029710038 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fcf68044020 con 0x7fcf70109960 2024-08-26T00:01:26.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.831+0000 7fcf67400640 1 --2- 172.21.15.42:0/1029710038 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcf540a2c10 0x7fcf540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:26.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.832+0000 7fcf67400640 1 -- 172.21.15.42:0/1029710038 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fcf680f0180 con 0x7fcf70109960 2024-08-26T00:01:26.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.832+0000 7fcf6ea00640 1 --2- 172.21.15.42:0/1029710038 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcf540a2c10 0x7fcf540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:26.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.832+0000 7fcf6ea00640 1 --2- 172.21.15.42:0/1029710038 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcf540a2c10 0x7fcf540a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcf600095f0 tx=0x7fcf60005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:26.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:26.838+0000 7fcf67400640 1 -- 172.21.15.42:0/1029710038 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fcf6804b030 con 0x7fcf70109960 2024-08-26T00:01:27.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:26 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/3177055496' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-08-26T00:01:27.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:26 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/3177055496' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-08-26T00:01:27.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.059+0000 7fcf6fe00640 1 -- 172.21.15.42:0/1029710038 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fcf50005850 con 0x7fcf70109960 2024-08-26T00:01:27.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.059+0000 7fcf67400640 1 -- 172.21.15.42:0/1029710038 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fcf680bd030 con 0x7fcf70109960 2024-08-26T00:01:27.060 INFO:teuthology.orchestra.run.smithi042.stdout:279172874268 2024-08-26T00:01:27.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.062+0000 7fcf6fe00640 1 -- 172.21.15.42:0/1029710038 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcf540a2c10 msgr2=0x7fcf540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:27.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.062+0000 7fcf6fe00640 1 --2- 172.21.15.42:0/1029710038 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcf540a2c10 0x7fcf540a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcf600095f0 tx=0x7fcf60005f90 comp rx=0 tx=0).stop 2024-08-26T00:01:27.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.062+0000 7fcf6fe00640 1 -- 172.21.15.42:0/1029710038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf70109960 msgr2=0x7fcf7019eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:27.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.062+0000 7fcf6fe00640 1 --2- 172.21.15.42:0/1029710038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf70109960 0x7fcf7019eaf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcf68034040 tx=0x7fcf680305d0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.062+0000 7fcf6fe00640 1 -- 172.21.15.42:0/1029710038 shutdown_connections 2024-08-26T00:01:27.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.062+0000 7fcf6fe00640 1 --2- 172.21.15.42:0/1029710038 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcf540a2c10 0x7fcf540a50d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.062+0000 7fcf6fe00640 1 --2- 172.21.15.42:0/1029710038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf70109960 0x7fcf7019eaf0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.062+0000 7fcf6fe00640 1 --2- 172.21.15.42:0/1029710038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf70104300 0x7fcf7019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.062+0000 7fcf6fe00640 1 --2- 172.21.15.42:0/1029710038 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcf70103960 0x7fcf7019a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.062+0000 7fcf6fe00640 1 -- 172.21.15.42:0/1029710038 >> 172.21.15.42:0/1029710038 conn(0x7fcf700ff620 msgr2=0x7fcf700ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:27.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.062+0000 7fcf6fe00640 1 -- 172.21.15.42:0/1029710038 shutdown_connections 2024-08-26T00:01:27.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.062+0000 7fcf6fe00640 1 -- 172.21.15.42:0/1029710038 wait complete. 2024-08-26T00:01:27.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.127+0000 7fb071a00640 1 -- 172.21.15.42:0/253459297 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb06c102100 msgr2=0x7fb06c10e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:27.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.127+0000 7fb071a00640 1 --2- 172.21.15.42:0/253459297 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb06c102100 0x7fb06c10e630 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb064009cd0 tx=0x7fb06402a8f0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.127+0000 7fb071a00640 1 -- 172.21.15.42:0/253459297 shutdown_connections 2024-08-26T00:01:27.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.127+0000 7fb071a00640 1 --2- 172.21.15.42:0/253459297 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb06c102100 0x7fb06c10e630 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.127+0000 7fb071a00640 1 --2- 172.21.15.42:0/253459297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb06c101760 0x7fb06c101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.127+0000 7fb071a00640 1 --2- 172.21.15.42:0/253459297 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb06c107760 0x7fb06c107b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.127+0000 7fb071a00640 1 -- 172.21.15.42:0/253459297 >> 172.21.15.42:0/253459297 conn(0x7fb06c0fd4e0 msgr2=0x7fb06c0ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:27.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.127+0000 7fb071a00640 1 -- 172.21.15.42:0/253459297 shutdown_connections 2024-08-26T00:01:27.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.127+0000 7fb071a00640 1 -- 172.21.15.42:0/253459297 wait complete. 2024-08-26T00:01:27.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.128+0000 7fb071a00640 1 Processor -- start 2024-08-26T00:01:27.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.128+0000 7fb071a00640 1 -- start start 2024-08-26T00:01:27.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.129+0000 7fb071a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb06c101760 0x7fb06c19a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:27.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.129+0000 7fb071a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb06c102100 0x7fb06c19a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:27.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.129+0000 7fb071a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb06c107760 0x7fb06c19eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:27.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.129+0000 7fb071a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb06c111b60 con 0x7fb06c102100 2024-08-26T00:01:27.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.129+0000 7fb071a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb06c1119e0 con 0x7fb06c101760 2024-08-26T00:01:27.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.129+0000 7fb071a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb06c111ce0 con 0x7fb06c107760 2024-08-26T00:01:27.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.129+0000 7fb06be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb06c101760 0x7fb06c19a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:27.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.129+0000 7fb06b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb06c102100 0x7fb06c19a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:27.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.129+0000 7fb06be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb06c101760 0x7fb06c19a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:57750/0 (socket says 172.21.15.42:57750) 2024-08-26T00:01:27.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.129+0000 7fb06be00640 1 -- 172.21.15.42:0/2565248920 learned_addr learned my addr 172.21.15.42:0/2565248920 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:27.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.129+0000 7fb071000640 1 --2- 172.21.15.42:0/2565248920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb06c107760 0x7fb06c19eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:27.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.130+0000 7fb06b400640 1 -- 172.21.15.42:0/2565248920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb06c107760 msgr2=0x7fb06c19eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:27.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.130+0000 7fb06b400640 1 --2- 172.21.15.42:0/2565248920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb06c107760 0x7fb06c19eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.130+0000 7fb06b400640 1 -- 172.21.15.42:0/2565248920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb06c101760 msgr2=0x7fb06c19a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:27.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.130+0000 7fb06b400640 1 --2- 172.21.15.42:0/2565248920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb06c101760 0x7fb06c19a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.130+0000 7fb06b400640 1 -- 172.21.15.42:0/2565248920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb06c19f210 con 0x7fb06c102100 2024-08-26T00:01:27.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.130+0000 7fb06b400640 1 --2- 172.21.15.42:0/2565248920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb06c102100 0x7fb06c19a7a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb05800e9f0 tx=0x7fb05800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:27.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.130+0000 7fb068c00640 1 -- 172.21.15.42:0/2565248920 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05800cd80 con 0x7fb06c102100 2024-08-26T00:01:27.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.130+0000 7fb068c00640 1 -- 172.21.15.42:0/2565248920 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0580035f0 con 0x7fb06c102100 2024-08-26T00:01:27.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.130+0000 7fb071a00640 1 -- 172.21.15.42:0/2565248920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb06c19f500 con 0x7fb06c102100 2024-08-26T00:01:27.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.130+0000 7fb068c00640 1 -- 172.21.15.42:0/2565248920 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb058010690 con 0x7fb06c102100 2024-08-26T00:01:27.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.130+0000 7fb071a00640 1 -- 172.21.15.42:0/2565248920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb06c1a6de0 con 0x7fb06c102100 2024-08-26T00:01:27.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.132+0000 7fb071a00640 1 -- 172.21.15.42:0/2565248920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb06c101bc0 con 0x7fb06c102100 2024-08-26T00:01:27.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.134+0000 7fb068c00640 1 -- 172.21.15.42:0/2565248920 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb058003b30 con 0x7fb06c102100 2024-08-26T00:01:27.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.135+0000 7fb068c00640 1 --2- 172.21.15.42:0/2565248920 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb0500a2c10 0x7fb0500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:27.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.136+0000 7fb068c00640 1 -- 172.21.15.42:0/2565248920 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fb0580cf3d0 con 0x7fb06c102100 2024-08-26T00:01:27.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.136+0000 7fb06be00640 1 --2- 172.21.15.42:0/2565248920 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb0500a2c10 0x7fb0500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:27.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.136+0000 7fb06be00640 1 --2- 172.21.15.42:0/2565248920 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb0500a2c10 0x7fb0500a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009c50 tx=0x7fb05c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:27.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.139+0000 7fb068c00640 1 -- 172.21.15.42:0/2565248920 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb05809c280 con 0x7fb06c102100 2024-08-26T00:01:27.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.326+0000 7fb071a00640 1 -- 172.21.15.42:0/2565248920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fb06c1a7110 con 0x7fb06c102100 2024-08-26T00:01:27.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.326+0000 7fb068c00640 1 -- 172.21.15.42:0/2565248920 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb05809bb80 con 0x7fb06c102100 2024-08-26T00:01:27.328 INFO:teuthology.orchestra.run.smithi042.stdout:197568495660 2024-08-26T00:01:27.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.328+0000 7fb071a00640 1 -- 172.21.15.42:0/2565248920 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb0500a2c10 msgr2=0x7fb0500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:27.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.328+0000 7fb071a00640 1 --2- 172.21.15.42:0/2565248920 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb0500a2c10 0x7fb0500a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009c50 tx=0x7fb05c005f90 comp rx=0 tx=0).stop 2024-08-26T00:01:27.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.328+0000 7fb071a00640 1 -- 172.21.15.42:0/2565248920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb06c102100 msgr2=0x7fb06c19a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:27.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.328+0000 7fb071a00640 1 --2- 172.21.15.42:0/2565248920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb06c102100 0x7fb06c19a7a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb05800e9f0 tx=0x7fb05800eeb0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.328+0000 7fb071a00640 1 -- 172.21.15.42:0/2565248920 shutdown_connections 2024-08-26T00:01:27.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.328+0000 7fb071a00640 1 --2- 172.21.15.42:0/2565248920 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb0500a2c10 0x7fb0500a50d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.328+0000 7fb071a00640 1 --2- 172.21.15.42:0/2565248920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb06c107760 0x7fb06c19eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.328+0000 7fb071a00640 1 --2- 172.21.15.42:0/2565248920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb06c102100 0x7fb06c19a7a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.328+0000 7fb071a00640 1 --2- 172.21.15.42:0/2565248920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb06c101760 0x7fb06c19a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.328+0000 7fb071a00640 1 -- 172.21.15.42:0/2565248920 >> 172.21.15.42:0/2565248920 conn(0x7fb06c0fd4e0 msgr2=0x7fb06c10cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:27.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.329+0000 7fb071a00640 1 -- 172.21.15.42:0/2565248920 shutdown_connections 2024-08-26T00:01:27.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.329+0000 7fb071a00640 1 -- 172.21.15.42:0/2565248920 wait complete. 2024-08-26T00:01:27.663 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:27 smithi042 ceph-mon[17225]: pgmap v305: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:01:27.663 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:27 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:01:27.663 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:27 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:01:27.663 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:27 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:01:27.663 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:27 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:01:27.663 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:27 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/271802801' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-08-26T00:01:27.663 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:27 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1029710038' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-08-26T00:01:27.663 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:27 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2565248920' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-08-26T00:01:27.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.461+0000 7efff4000640 1 -- 172.21.15.42:0/1388980597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effec076de0 msgr2=0x7effec112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:27.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.461+0000 7efff4000640 1 --2- 172.21.15.42:0/1388980597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effec076de0 0x7effec112290 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7effd8009900 tx=0x7effd802a410 comp rx=0 tx=0).stop 2024-08-26T00:01:27.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.462+0000 7efff4000640 1 -- 172.21.15.42:0/1388980597 shutdown_connections 2024-08-26T00:01:27.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.462+0000 7efff4000640 1 --2- 172.21.15.42:0/1388980597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effec1127d0 0x7effec114bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.462+0000 7efff4000640 1 --2- 172.21.15.42:0/1388980597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effec076de0 0x7effec112290 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.462+0000 7efff4000640 1 --2- 172.21.15.42:0/1388980597 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effec0764c0 0x7effec0768a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.462+0000 7efff4000640 1 -- 172.21.15.42:0/1388980597 >> 172.21.15.42:0/1388980597 conn(0x7effec0ff830 msgr2=0x7effec101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:27.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.462+0000 7efff4000640 1 -- 172.21.15.42:0/1388980597 shutdown_connections 2024-08-26T00:01:27.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.462+0000 7efff4000640 1 -- 172.21.15.42:0/1388980597 wait complete. 2024-08-26T00:01:27.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.463+0000 7efff4000640 1 Processor -- start 2024-08-26T00:01:27.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.463+0000 7efff4000640 1 -- start start 2024-08-26T00:01:27.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.463+0000 7efff4000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effec0764c0 0x7effec1a45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:27.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.463+0000 7efff4000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effec076de0 0x7effec1a4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:27.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.463+0000 7efff4000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effec1127d0 0x7effec19e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:27.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.463+0000 7efff4000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7effec1183b0 con 0x7effec1127d0 2024-08-26T00:01:27.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.463+0000 7efff4000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7effec118230 con 0x7effec076de0 2024-08-26T00:01:27.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.463+0000 7efff4000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7effec118530 con 0x7effec0764c0 2024-08-26T00:01:27.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.463+0000 7efff2000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effec1127d0 0x7effec19e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:27.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.463+0000 7efff2000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effec1127d0 0x7effec19e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43826/0 (socket says 172.21.15.42:43826) 2024-08-26T00:01:27.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.463+0000 7efff2000640 1 -- 172.21.15.42:0/3738356704 learned_addr learned my addr 172.21.15.42:0/3738356704 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:27.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.463+0000 7efff1600640 1 --2- 172.21.15.42:0/3738356704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effec0764c0 0x7effec1a45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:27.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.463+0000 7efff0c00640 1 --2- 172.21.15.42:0/3738356704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effec076de0 0x7effec1a4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:27.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.464+0000 7efff1600640 1 -- 172.21.15.42:0/3738356704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effec076de0 msgr2=0x7effec1a4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:27.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.464+0000 7efff1600640 1 --2- 172.21.15.42:0/3738356704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effec076de0 0x7effec1a4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.464+0000 7efff1600640 1 -- 172.21.15.42:0/3738356704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effec1127d0 msgr2=0x7effec19e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:27.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.464+0000 7efff1600640 1 --2- 172.21.15.42:0/3738356704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effec1127d0 0x7effec19e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.464+0000 7efff1600640 1 -- 172.21.15.42:0/3738356704 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effec19eee0 con 0x7effec0764c0 2024-08-26T00:01:27.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.464+0000 7efff2000640 1 --2- 172.21.15.42:0/3738356704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effec1127d0 0x7effec19e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:27.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.464+0000 7efff1600640 1 --2- 172.21.15.42:0/3738356704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effec0764c0 0x7effec1a45a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7effe000e9f0 tx=0x7effe000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:27.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.464+0000 7effea000640 1 -- 172.21.15.42:0/3738356704 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe000ccc0 con 0x7effec0764c0 2024-08-26T00:01:27.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.464+0000 7effea000640 1 -- 172.21.15.42:0/3738356704 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effe0005020 con 0x7effec0764c0 2024-08-26T00:01:27.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.464+0000 7efff4000640 1 -- 172.21.15.42:0/3738356704 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effec19f1d0 con 0x7effec0764c0 2024-08-26T00:01:27.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.464+0000 7effea000640 1 -- 172.21.15.42:0/3738356704 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe00049e0 con 0x7effec0764c0 2024-08-26T00:01:27.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.464+0000 7efff4000640 1 -- 172.21.15.42:0/3738356704 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effec1ab350 con 0x7effec0764c0 2024-08-26T00:01:27.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.465+0000 7efff4000640 1 -- 172.21.15.42:0/3738356704 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effec077c00 con 0x7effec0764c0 2024-08-26T00:01:27.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.467+0000 7effea000640 1 -- 172.21.15.42:0/3738356704 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7effe0005560 con 0x7effec0764c0 2024-08-26T00:01:27.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.469+0000 7effea000640 1 --2- 172.21.15.42:0/3738356704 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7effd40a2c10 0x7effd40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:27.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.469+0000 7effea000640 1 -- 172.21.15.42:0/3738356704 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7effe00cf070 con 0x7effec0764c0 2024-08-26T00:01:27.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.469+0000 7efff0c00640 1 --2- 172.21.15.42:0/3738356704 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7effd40a2c10 0x7effd40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:27.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.469+0000 7efff0c00640 1 --2- 172.21.15.42:0/3738356704 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7effd40a2c10 0x7effd40a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7effd8000c00 tx=0x7effd8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:27.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.472+0000 7effea000640 1 -- 172.21.15.42:0/3738356704 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7effe00051d0 con 0x7effec0764c0 2024-08-26T00:01:27.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.661+0000 7efff4000640 1 -- 172.21.15.42:0/3738356704 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7effec10d9c0 con 0x7effec0764c0 2024-08-26T00:01:27.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.662+0000 7effea000640 1 -- 172.21.15.42:0/3738356704 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7effe009bf20 con 0x7effec0764c0 2024-08-26T00:01:27.810 INFO:teuthology.orchestra.run.smithi042.stdout:180388626481 2024-08-26T00:01:27.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.664+0000 7efff4000640 1 -- 172.21.15.42:0/3738356704 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7effd40a2c10 msgr2=0x7effd40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:27.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.664+0000 7efff4000640 1 --2- 172.21.15.42:0/3738356704 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7effd40a2c10 0x7effd40a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7effd8000c00 tx=0x7effd8005b50 comp rx=0 tx=0).stop 2024-08-26T00:01:27.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.664+0000 7efff4000640 1 -- 172.21.15.42:0/3738356704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effec0764c0 msgr2=0x7effec1a45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:27.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.664+0000 7efff4000640 1 --2- 172.21.15.42:0/3738356704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effec0764c0 0x7effec1a45a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7effe000e9f0 tx=0x7effe000eeb0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.664+0000 7efff4000640 1 -- 172.21.15.42:0/3738356704 shutdown_connections 2024-08-26T00:01:27.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.664+0000 7efff4000640 1 --2- 172.21.15.42:0/3738356704 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7effd40a2c10 0x7effd40a50d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.664+0000 7efff4000640 1 --2- 172.21.15.42:0/3738356704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effec1127d0 0x7effec19e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.664+0000 7efff4000640 1 --2- 172.21.15.42:0/3738356704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effec076de0 0x7effec1a4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.664+0000 7efff4000640 1 --2- 172.21.15.42:0/3738356704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effec0764c0 0x7effec1a45a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:27.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.664+0000 7efff4000640 1 -- 172.21.15.42:0/3738356704 >> 172.21.15.42:0/3738356704 conn(0x7effec0ff830 msgr2=0x7effec101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:27.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.664+0000 7efff4000640 1 -- 172.21.15.42:0/3738356704 shutdown_connections 2024-08-26T00:01:27.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:27.664+0000 7efff4000640 1 -- 172.21.15.42:0/3738356704 wait complete. 2024-08-26T00:01:28.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:27 smithi043 ceph-mon[22091]: pgmap v305: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:01:28.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:27 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:01:28.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:27 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:01:28.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:27 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:01:28.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:27 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:01:28.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:27 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/271802801' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-08-26T00:01:28.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:27 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1029710038' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-08-26T00:01:28.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:27 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/2565248920' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-08-26T00:01:28.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:27 smithi181 ceph-mon[22102]: pgmap v305: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:01:28.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:27 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:01:28.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:27 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:01:28.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:27 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:01:28.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:27 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:01:28.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:27 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/271802801' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-08-26T00:01:28.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:27 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1029710038' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-08-26T00:01:28.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:27 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/2565248920' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-08-26T00:01:28.330 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855413 got 150323855415 for osd.5 2024-08-26T00:01:28.330 DEBUG:teuthology.parallel:result is None 2024-08-26T00:01:29.010 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:29.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:28 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/3738356704' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-08-26T00:01:29.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:28 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/3738356704' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-08-26T00:01:29.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:28 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/3738356704' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-08-26T00:01:29.346 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738446 got 34359738447 for osd.0 2024-08-26T00:01:29.346 DEBUG:teuthology.parallel:result is None 2024-08-26T00:01:29.876 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:29 smithi042 ceph-mon[17225]: pgmap v306: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-08-26T00:01:30.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:29 smithi043 ceph-mon[22091]: pgmap v306: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-08-26T00:01:30.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:29 smithi181 ceph-mon[22102]: pgmap v306: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-08-26T00:01:30.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.996+0000 7fb150000640 1 -- 172.21.15.42:0/585050296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb14810e160 msgr2=0x7fb1481105b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:30.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.996+0000 7fb150000640 1 --2- 172.21.15.42:0/585050296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb14810e160 0x7fb1481105b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb140009ca0 tx=0x7fb14002a950 comp rx=0 tx=0).stop 2024-08-26T00:01:30.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.996+0000 7fb150000640 1 -- 172.21.15.42:0/585050296 shutdown_connections 2024-08-26T00:01:30.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.996+0000 7fb150000640 1 --2- 172.21.15.42:0/585050296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb14810e160 0x7fb1481105b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:30.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.996+0000 7fb150000640 1 --2- 172.21.15.42:0/585050296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb148074ce0 0x7fb14810dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:30.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.996+0000 7fb150000640 1 --2- 172.21.15.42:0/585050296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1480743c0 0x7fb1480747a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:30.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.996+0000 7fb150000640 1 -- 172.21.15.42:0/585050296 >> 172.21.15.42:0/585050296 conn(0x7fb1480fd660 msgr2=0x7fb1480ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:30.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.996+0000 7fb150000640 1 -- 172.21.15.42:0/585050296 shutdown_connections 2024-08-26T00:01:30.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.996+0000 7fb150000640 1 -- 172.21.15.42:0/585050296 wait complete. 2024-08-26T00:01:30.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.998+0000 7fb150000640 1 Processor -- start 2024-08-26T00:01:30.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.998+0000 7fb150000640 1 -- start start 2024-08-26T00:01:30.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.998+0000 7fb150000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1480743c0 0x7fb14819a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:30.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.998+0000 7fb150000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb148074ce0 0x7fb14819a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:30.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.998+0000 7fb150000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb14810e160 0x7fb14819ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:30.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.998+0000 7fb150000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb148113f60 con 0x7fb1480743c0 2024-08-26T00:01:30.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.998+0000 7fb150000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb148113de0 con 0x7fb14810e160 2024-08-26T00:01:30.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.998+0000 7fb150000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb1481140e0 con 0x7fb148074ce0 2024-08-26T00:01:30.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.998+0000 7fb14d600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1480743c0 0x7fb14819a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:30.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.998+0000 7fb14d600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1480743c0 0x7fb14819a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43840/0 (socket says 172.21.15.42:43840) 2024-08-26T00:01:30.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.998+0000 7fb14d600640 1 -- 172.21.15.42:0/1928803060 learned_addr learned my addr 172.21.15.42:0/1928803060 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:30.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.999+0000 7fb14e000640 1 --2- 172.21.15.42:0/1928803060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb14810e160 0x7fb14819ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:30.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.999+0000 7fb14cc00640 1 --2- 172.21.15.42:0/1928803060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb148074ce0 0x7fb14819a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:30.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.999+0000 7fb14d600640 1 -- 172.21.15.42:0/1928803060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb148074ce0 msgr2=0x7fb14819a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:30.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.999+0000 7fb14d600640 1 --2- 172.21.15.42:0/1928803060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb148074ce0 0x7fb14819a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:30.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.999+0000 7fb14d600640 1 -- 172.21.15.42:0/1928803060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb14810e160 msgr2=0x7fb14819ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:30.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.999+0000 7fb14d600640 1 --2- 172.21.15.42:0/1928803060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb14810e160 0x7fb14819ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:30.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.999+0000 7fb14d600640 1 -- 172.21.15.42:0/1928803060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14819f3a0 con 0x7fb1480743c0 2024-08-26T00:01:30.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.999+0000 7fb14e000640 1 --2- 172.21.15.42:0/1928803060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb14810e160 0x7fb14819ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:30.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:29.999+0000 7fb14d600640 1 --2- 172.21.15.42:0/1928803060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1480743c0 0x7fb14819a3f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00e9f0 tx=0x7fb13c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:30.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.000+0000 7fb146000640 1 -- 172.21.15.42:0/1928803060 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c00cd80 con 0x7fb1480743c0 2024-08-26T00:01:30.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.000+0000 7fb146000640 1 -- 172.21.15.42:0/1928803060 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb13c005500 con 0x7fb1480743c0 2024-08-26T00:01:30.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.000+0000 7fb150000640 1 -- 172.21.15.42:0/1928803060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb14819f690 con 0x7fb1480743c0 2024-08-26T00:01:30.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.000+0000 7fb146000640 1 -- 172.21.15.42:0/1928803060 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c010690 con 0x7fb1480743c0 2024-08-26T00:01:30.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.000+0000 7fb150000640 1 -- 172.21.15.42:0/1928803060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1481a6f70 con 0x7fb1480743c0 2024-08-26T00:01:30.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.001+0000 7fb150000640 1 -- 172.21.15.42:0/1928803060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1480747a0 con 0x7fb1480743c0 2024-08-26T00:01:30.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.003+0000 7fb146000640 1 -- 172.21.15.42:0/1928803060 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb13c0046c0 con 0x7fb1480743c0 2024-08-26T00:01:30.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.004+0000 7fb146000640 1 --2- 172.21.15.42:0/1928803060 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb1300a2c10 0x7fb1300a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:30.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.004+0000 7fb146000640 1 -- 172.21.15.42:0/1928803060 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fb13c0cf540 con 0x7fb1480743c0 2024-08-26T00:01:30.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.004+0000 7fb14cc00640 1 --2- 172.21.15.42:0/1928803060 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb1300a2c10 0x7fb1300a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:30.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.005+0000 7fb14cc00640 1 --2- 172.21.15.42:0/1928803060 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb1300a2c10 0x7fb1300a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb1340095f0 tx=0x7fb134005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:30.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.008+0000 7fb146000640 1 -- 172.21.15.42:0/1928803060 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb13c09c3f0 con 0x7fb1480743c0 2024-08-26T00:01:30.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.203+0000 7fb150000640 1 -- 172.21.15.42:0/1928803060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fb148108d50 con 0x7fb1480743c0 2024-08-26T00:01:30.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.203+0000 7fb146000640 1 -- 172.21.15.42:0/1928803060 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb13c09bcf0 con 0x7fb1480743c0 2024-08-26T00:01:30.240 INFO:teuthology.orchestra.run.smithi042.stdout:227633266729 2024-08-26T00:01:30.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.206+0000 7fb150000640 1 -- 172.21.15.42:0/1928803060 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb1300a2c10 msgr2=0x7fb1300a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:30.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.206+0000 7fb150000640 1 --2- 172.21.15.42:0/1928803060 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb1300a2c10 0x7fb1300a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb1340095f0 tx=0x7fb134005f90 comp rx=0 tx=0).stop 2024-08-26T00:01:30.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.206+0000 7fb150000640 1 -- 172.21.15.42:0/1928803060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1480743c0 msgr2=0x7fb14819a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:30.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.206+0000 7fb150000640 1 --2- 172.21.15.42:0/1928803060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1480743c0 0x7fb14819a3f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00e9f0 tx=0x7fb13c00edf0 comp rx=0 tx=0).stop 2024-08-26T00:01:30.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.206+0000 7fb150000640 1 -- 172.21.15.42:0/1928803060 shutdown_connections 2024-08-26T00:01:30.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.206+0000 7fb150000640 1 --2- 172.21.15.42:0/1928803060 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb1300a2c10 0x7fb1300a50d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:30.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.206+0000 7fb150000640 1 --2- 172.21.15.42:0/1928803060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb14810e160 0x7fb14819ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:30.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.206+0000 7fb150000640 1 --2- 172.21.15.42:0/1928803060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb148074ce0 0x7fb14819a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:30.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.206+0000 7fb150000640 1 --2- 172.21.15.42:0/1928803060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1480743c0 0x7fb14819a3f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:30.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.206+0000 7fb150000640 1 -- 172.21.15.42:0/1928803060 >> 172.21.15.42:0/1928803060 conn(0x7fb1480fd660 msgr2=0x7fb1480fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:30.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.206+0000 7fb150000640 1 -- 172.21.15.42:0/1928803060 shutdown_connections 2024-08-26T00:01:30.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:30.206+0000 7fb150000640 1 -- 172.21.15.42:0/1928803060 wait complete. 2024-08-26T00:01:30.831 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:30 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1928803060' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-08-26T00:01:31.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:30 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1928803060' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-08-26T00:01:31.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:30 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1928803060' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-08-26T00:01:31.154 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018936 got 128849018939 for osd.4 2024-08-26T00:01:31.154 DEBUG:teuthology.parallel:result is None 2024-08-26T00:01:31.639 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:31 smithi042 ceph-mon[17225]: pgmap v307: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-08-26T00:01:31.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.898+0000 7f5d86600640 1 -- 172.21.15.42:0/2484977665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d80103db0 msgr2=0x7f5d80104190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:31.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.898+0000 7f5d86600640 1 --2- 172.21.15.42:0/2484977665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d80103db0 0x7f5d80104190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d70009860 tx=0x7f5d7002a340 comp rx=0 tx=0).stop 2024-08-26T00:01:31.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.899+0000 7f5d86600640 1 -- 172.21.15.42:0/2484977665 shutdown_connections 2024-08-26T00:01:31.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.899+0000 7f5d86600640 1 --2- 172.21.15.42:0/2484977665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d80108ee0 0x7f5d80110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:31.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.899+0000 7f5d86600640 1 --2- 172.21.15.42:0/2484977665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d80104760 0x7f5d801087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:31.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.899+0000 7f5d86600640 1 --2- 172.21.15.42:0/2484977665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d80103db0 0x7f5d80104190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:31.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.899+0000 7f5d86600640 1 -- 172.21.15.42:0/2484977665 >> 172.21.15.42:0/2484977665 conn(0x7f5d800ff7f0 msgr2=0x7f5d80101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:31.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.899+0000 7f5d86600640 1 -- 172.21.15.42:0/2484977665 shutdown_connections 2024-08-26T00:01:31.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.899+0000 7f5d86600640 1 -- 172.21.15.42:0/2484977665 wait complete. 2024-08-26T00:01:31.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.900+0000 7f5d86600640 1 Processor -- start 2024-08-26T00:01:31.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.900+0000 7f5d86600640 1 -- start start 2024-08-26T00:01:31.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.900+0000 7f5d86600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d80103db0 0x7f5d8019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:31.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.900+0000 7f5d86600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d80104760 0x7f5d8019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:31.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.900+0000 7f5d86600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d80108ee0 0x7f5d8019ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:31.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.900+0000 7f5d86600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5d80113f40 con 0x7f5d80104760 2024-08-26T00:01:31.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.900+0000 7f5d86600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5d80113dc0 con 0x7f5d80108ee0 2024-08-26T00:01:31.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.900+0000 7f5d86600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5d801140c0 con 0x7f5d80103db0 2024-08-26T00:01:31.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.900+0000 7f5d76a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d80104760 0x7f5d8019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:31.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.901+0000 7f5d76a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d80104760 0x7f5d8019aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43868/0 (socket says 172.21.15.42:43868) 2024-08-26T00:01:31.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.901+0000 7f5d76a00640 1 -- 172.21.15.42:0/4064907905 learned_addr learned my addr 172.21.15.42:0/4064907905 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:31.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.901+0000 7f5d7f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d80103db0 0x7f5d8019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:31.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.901+0000 7f5d7fe00640 1 --2- 172.21.15.42:0/4064907905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d80108ee0 0x7f5d8019ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:31.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.901+0000 7f5d7f400640 1 -- 172.21.15.42:0/4064907905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d80108ee0 msgr2=0x7f5d8019ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:31.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.901+0000 7f5d7f400640 1 --2- 172.21.15.42:0/4064907905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d80108ee0 0x7f5d8019ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:31.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.901+0000 7f5d7f400640 1 -- 172.21.15.42:0/4064907905 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d80104760 msgr2=0x7f5d8019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:31.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.901+0000 7f5d7f400640 1 --2- 172.21.15.42:0/4064907905 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d80104760 0x7f5d8019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:31.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.901+0000 7f5d7f400640 1 -- 172.21.15.42:0/4064907905 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d8019f4f0 con 0x7f5d80103db0 2024-08-26T00:01:31.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.901+0000 7f5d7fe00640 1 --2- 172.21.15.42:0/4064907905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d80108ee0 0x7f5d8019ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:31.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.901+0000 7f5d7f400640 1 --2- 172.21.15.42:0/4064907905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d80103db0 0x7f5d8019a540 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5d70035040 tx=0x7f5d70033b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:31.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.902+0000 7f5d7cc00640 1 -- 172.21.15.42:0/4064907905 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7003f020 con 0x7f5d80103db0 2024-08-26T00:01:31.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.902+0000 7f5d7cc00640 1 -- 172.21.15.42:0/4064907905 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d70030550 con 0x7f5d80103db0 2024-08-26T00:01:31.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.902+0000 7f5d7cc00640 1 -- 172.21.15.42:0/4064907905 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d70037040 con 0x7f5d80103db0 2024-08-26T00:01:31.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.902+0000 7f5d86600640 1 -- 172.21.15.42:0/4064907905 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d8019f780 con 0x7f5d80103db0 2024-08-26T00:01:31.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.902+0000 7f5d86600640 1 -- 172.21.15.42:0/4064907905 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d8019fc10 con 0x7f5d80103db0 2024-08-26T00:01:31.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.903+0000 7f5d86600640 1 -- 172.21.15.42:0/4064907905 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d80104190 con 0x7f5d80103db0 2024-08-26T00:01:31.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.905+0000 7f5d7cc00640 1 -- 172.21.15.42:0/4064907905 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5d70042020 con 0x7f5d80103db0 2024-08-26T00:01:31.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.906+0000 7f5d7cc00640 1 --2- 172.21.15.42:0/4064907905 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5d640a2c90 0x7f5d640a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:31.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.907+0000 7f5d7cc00640 1 -- 172.21.15.42:0/4064907905 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f5d700ef130 con 0x7f5d80103db0 2024-08-26T00:01:31.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.907+0000 7f5d76a00640 1 --2- 172.21.15.42:0/4064907905 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5d640a2c90 0x7f5d640a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:31.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.907+0000 7f5d76a00640 1 --2- 172.21.15.42:0/4064907905 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5d640a2c90 0x7f5d640a5150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5d80101dd0 tx=0x7f5d68005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:31.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.909+0000 7f5d7cc00640 1 -- 172.21.15.42:0/4064907905 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5d70049020 con 0x7f5d80103db0 2024-08-26T00:01:32.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:31 smithi043 ceph-mon[22091]: pgmap v307: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-08-26T00:01:32.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:31 smithi181 ceph-mon[22102]: pgmap v307: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-08-26T00:01:32.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:32.098+0000 7f5d86600640 1 -- 172.21.15.42:0/4064907905 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f5d8010c0f0 con 0x7f5d80103db0 2024-08-26T00:01:32.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:32.099+0000 7f5d7cc00640 1 -- 172.21.15.42:0/4064907905 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5d700bc170 con 0x7f5d80103db0 2024-08-26T00:01:32.100 INFO:teuthology.orchestra.run.smithi042.stdout:55834574924 2024-08-26T00:01:32.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:32.102+0000 7f5d86600640 1 -- 172.21.15.42:0/4064907905 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5d640a2c90 msgr2=0x7f5d640a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:32.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:32.102+0000 7f5d86600640 1 --2- 172.21.15.42:0/4064907905 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5d640a2c90 0x7f5d640a5150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5d80101dd0 tx=0x7f5d68005f90 comp rx=0 tx=0).stop 2024-08-26T00:01:32.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:32.102+0000 7f5d86600640 1 -- 172.21.15.42:0/4064907905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d80103db0 msgr2=0x7f5d8019a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:32.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:32.102+0000 7f5d86600640 1 --2- 172.21.15.42:0/4064907905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d80103db0 0x7f5d8019a540 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5d70035040 tx=0x7f5d70033b60 comp rx=0 tx=0).stop 2024-08-26T00:01:32.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:32.102+0000 7f5d86600640 1 -- 172.21.15.42:0/4064907905 shutdown_connections 2024-08-26T00:01:32.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:32.102+0000 7f5d86600640 1 --2- 172.21.15.42:0/4064907905 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5d640a2c90 0x7f5d640a5150 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:32.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:32.102+0000 7f5d86600640 1 --2- 172.21.15.42:0/4064907905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d80108ee0 0x7f5d8019ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:32.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:32.102+0000 7f5d86600640 1 --2- 172.21.15.42:0/4064907905 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d80104760 0x7f5d8019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:32.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:32.102+0000 7f5d86600640 1 --2- 172.21.15.42:0/4064907905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d80103db0 0x7f5d8019a540 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:32.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:32.102+0000 7f5d86600640 1 -- 172.21.15.42:0/4064907905 >> 172.21.15.42:0/4064907905 conn(0x7f5d800ff7f0 msgr2=0x7f5d80100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:32.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:32.102+0000 7f5d86600640 1 -- 172.21.15.42:0/4064907905 shutdown_connections 2024-08-26T00:01:32.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:32.102+0000 7f5d86600640 1 -- 172.21.15.42:0/4064907905 wait complete. 2024-08-26T00:01:32.253 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874267 got 279172874268 for osd.10 2024-08-26T00:01:32.253 DEBUG:teuthology.parallel:result is None 2024-08-26T00:01:32.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:32 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1921681231' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-08-26T00:01:32.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:32 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/4064907905' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-08-26T00:01:32.956 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2024-08-26T00:01:32.957 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-08-26T00:01:32.957 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-08-26T00:01:32.957 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-08-26T00:01:32.957 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-08-26T00:01:32.957 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-08-26T00:01:32.957 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-08-26T00:01:32.957 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-08-26T00:01:32.957 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:32 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]: dispatch 2024-08-26T00:01:33.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:32 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1921681231' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-08-26T00:01:33.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:32 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/4064907905' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-08-26T00:01:33.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2024-08-26T00:01:33.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-08-26T00:01:33.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-08-26T00:01:33.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-08-26T00:01:33.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-08-26T00:01:33.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-08-26T00:01:33.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-08-26T00:01:33.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-08-26T00:01:33.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:32 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]: dispatch 2024-08-26T00:01:33.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:32 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1921681231' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-08-26T00:01:33.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:32 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/4064907905' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-08-26T00:01:33.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2024-08-26T00:01:33.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-08-26T00:01:33.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-08-26T00:01:33.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-08-26T00:01:33.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-08-26T00:01:33.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-08-26T00:01:33.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-08-26T00:01:33.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-08-26T00:01:33.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:32 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]: dispatch 2024-08-26T00:01:33.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.069+0000 7f2820600640 1 -- 172.21.15.42:0/2407113188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2818103db0 msgr2=0x7f2818104190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:33.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.069+0000 7f2820600640 1 --2- 172.21.15.42:0/2407113188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2818103db0 0x7f2818104190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f280c009900 tx=0x7f280c02a410 comp rx=0 tx=0).stop 2024-08-26T00:01:33.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.070+0000 7f2820600640 1 -- 172.21.15.42:0/2407113188 shutdown_connections 2024-08-26T00:01:33.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.070+0000 7f2820600640 1 --2- 172.21.15.42:0/2407113188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2818108ee0 0x7f2818110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:33.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.070+0000 7f2820600640 1 --2- 172.21.15.42:0/2407113188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2818104760 0x7f28181087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:33.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.070+0000 7f2820600640 1 --2- 172.21.15.42:0/2407113188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2818103db0 0x7f2818104190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:33.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.070+0000 7f2820600640 1 -- 172.21.15.42:0/2407113188 >> 172.21.15.42:0/2407113188 conn(0x7f28180ff7f0 msgr2=0x7f2818101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:33.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.070+0000 7f2820600640 1 -- 172.21.15.42:0/2407113188 shutdown_connections 2024-08-26T00:01:33.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.070+0000 7f2820600640 1 -- 172.21.15.42:0/2407113188 wait complete. 2024-08-26T00:01:33.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.071+0000 7f2820600640 1 Processor -- start 2024-08-26T00:01:33.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.071+0000 7f2820600640 1 -- start start 2024-08-26T00:01:33.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.071+0000 7f2820600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2818103db0 0x7f281819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:33.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.071+0000 7f2820600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2818104760 0x7f281819a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:33.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.071+0000 7f2820600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2818108ee0 0x7f281819ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:33.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.071+0000 7f2820600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2818113f90 con 0x7f2818104760 2024-08-26T00:01:33.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.071+0000 7f2820600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2818113e10 con 0x7f2818108ee0 2024-08-26T00:01:33.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.071+0000 7f2820600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2818114110 con 0x7f2818103db0 2024-08-26T00:01:33.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.071+0000 7f281d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2818104760 0x7f281819a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:33.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.072+0000 7f281d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2818104760 0x7f281819a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43892/0 (socket says 172.21.15.42:43892) 2024-08-26T00:01:33.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.072+0000 7f281d200640 1 -- 172.21.15.42:0/1528659664 learned_addr learned my addr 172.21.15.42:0/1528659664 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:33.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.072+0000 7f281dc00640 1 --2- 172.21.15.42:0/1528659664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2818103db0 0x7f281819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:33.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.072+0000 7f281e600640 1 --2- 172.21.15.42:0/1528659664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2818108ee0 0x7f281819ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:33.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.072+0000 7f281d200640 1 -- 172.21.15.42:0/1528659664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2818103db0 msgr2=0x7f281819a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:33.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.072+0000 7f281d200640 1 --2- 172.21.15.42:0/1528659664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2818103db0 0x7f281819a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:33.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.072+0000 7f281d200640 1 -- 172.21.15.42:0/1528659664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2818108ee0 msgr2=0x7f281819ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:33.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.072+0000 7f281d200640 1 --2- 172.21.15.42:0/1528659664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2818108ee0 0x7f281819ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:33.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.072+0000 7f281d200640 1 -- 172.21.15.42:0/1528659664 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f281819f3c0 con 0x7f2818104760 2024-08-26T00:01:33.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.072+0000 7f281d200640 1 --2- 172.21.15.42:0/1528659664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2818104760 0x7f281819a950 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f280400e9f0 tx=0x7f280400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:33.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.072+0000 7f2816000640 1 -- 172.21.15.42:0/1528659664 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280400ccc0 con 0x7f2818104760 2024-08-26T00:01:33.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.073+0000 7f2820600640 1 -- 172.21.15.42:0/1528659664 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f281819f6b0 con 0x7f2818104760 2024-08-26T00:01:33.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.073+0000 7f2816000640 1 -- 172.21.15.42:0/1528659664 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f280400ce60 con 0x7f2818104760 2024-08-26T00:01:33.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.073+0000 7f2820600640 1 -- 172.21.15.42:0/1528659664 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28181a6f90 con 0x7f2818104760 2024-08-26T00:01:33.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.073+0000 7f2816000640 1 -- 172.21.15.42:0/1528659664 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2804018630 con 0x7f2818104760 2024-08-26T00:01:33.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.074+0000 7f2820600640 1 -- 172.21.15.42:0/1528659664 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2818104190 con 0x7f2818104760 2024-08-26T00:01:33.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.076+0000 7f2816000640 1 -- 172.21.15.42:0/1528659664 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f28040046c0 con 0x7f2818104760 2024-08-26T00:01:33.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.078+0000 7f2816000640 1 --2- 172.21.15.42:0/1528659664 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f28000a2c10 0x7f28000a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:33.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.078+0000 7f2816000640 1 -- 172.21.15.42:0/1528659664 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8240+0+0 (secure 0 0 0) 0x7f28040cf760 con 0x7f2818104760 2024-08-26T00:01:33.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.078+0000 7f281dc00640 1 --2- 172.21.15.42:0/1528659664 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f28000a2c10 0x7f28000a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:33.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.079+0000 7f281dc00640 1 --2- 172.21.15.42:0/1528659664 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f28000a2c10 0x7f28000a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f280c000c00 tx=0x7f280c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:33.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.081+0000 7f2816000640 1 -- 172.21.15.42:0/1528659664 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f280409c520 con 0x7f2818104760 2024-08-26T00:01:33.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.270+0000 7f9ac3400640 1 -- 172.21.15.42:0/420620543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9abc1127d0 msgr2=0x7f9abc114bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:33.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.270+0000 7f9ac3400640 1 --2- 172.21.15.42:0/420620543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9abc1127d0 0x7f9abc114bc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4009ca0 tx=0x7f9ab402a8c0 comp rx=0 tx=0).stop 2024-08-26T00:01:33.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.271+0000 7f9ac3400640 1 -- 172.21.15.42:0/420620543 shutdown_connections 2024-08-26T00:01:33.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.271+0000 7f9ac3400640 1 --2- 172.21.15.42:0/420620543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9abc1127d0 0x7f9abc114bc0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:33.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.271+0000 7f9ac3400640 1 --2- 172.21.15.42:0/420620543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9abc076de0 0x7f9abc112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:33.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.271+0000 7f9ac3400640 1 --2- 172.21.15.42:0/420620543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9abc0764c0 0x7f9abc0768a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:33.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.271+0000 7f9ac3400640 1 -- 172.21.15.42:0/420620543 >> 172.21.15.42:0/420620543 conn(0x7f9abc0ff830 msgr2=0x7f9abc101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:33.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.271+0000 7f9ac3400640 1 -- 172.21.15.42:0/420620543 shutdown_connections 2024-08-26T00:01:33.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.271+0000 7f9ac3400640 1 -- 172.21.15.42:0/420620543 wait complete. 2024-08-26T00:01:33.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.272+0000 7f9ac3400640 1 Processor -- start 2024-08-26T00:01:33.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.272+0000 7f9ac3400640 1 -- start start 2024-08-26T00:01:33.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.272+0000 7f9ac3400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9abc0764c0 0x7f9abc1a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:33.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.272+0000 7f9ac3400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9abc076de0 0x7f9abc1a4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:33.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.272+0000 7f9ac3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9abc1127d0 0x7f9abc19e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:33.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.272+0000 7f9ac3400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc118360 con 0x7f9abc1127d0 2024-08-26T00:01:33.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.272+0000 7f9ac3400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc1181e0 con 0x7f9abc076de0 2024-08-26T00:01:33.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.272+0000 7f9ac3400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc1184e0 con 0x7f9abc0764c0 2024-08-26T00:01:33.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.272+0000 7f9ac0a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9abc0764c0 0x7f9abc1a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:33.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.272+0000 7f9ac0a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9abc0764c0 0x7f9abc1a4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:50192/0 (socket says 172.21.15.42:50192) 2024-08-26T00:01:33.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.272+0000 7f9ac0a00640 1 -- 172.21.15.42:0/1065824294 learned_addr learned my addr 172.21.15.42:0/1065824294 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:33.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.273+0000 7f9abbe00640 1 --2- 172.21.15.42:0/1065824294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9abc076de0 0x7f9abc1a4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:33.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.273+0000 7f9ac1400640 1 --2- 172.21.15.42:0/1065824294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9abc1127d0 0x7f9abc19e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:33.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.273+0000 7f9ac0a00640 1 -- 172.21.15.42:0/1065824294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9abc076de0 msgr2=0x7f9abc1a4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:33.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.273+0000 7f9ac0a00640 1 --2- 172.21.15.42:0/1065824294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9abc076de0 0x7f9abc1a4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:33.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.273+0000 7f9ac0a00640 1 -- 172.21.15.42:0/1065824294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9abc1127d0 msgr2=0x7f9abc19e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:33.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.273+0000 7f9ac0a00640 1 --2- 172.21.15.42:0/1065824294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9abc1127d0 0x7f9abc19e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:33.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.273+0000 7f9ac0a00640 1 -- 172.21.15.42:0/1065824294 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9abc19ed30 con 0x7f9abc0764c0 2024-08-26T00:01:33.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.273+0000 7f9abbe00640 1 --2- 172.21.15.42:0/1065824294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9abc076de0 0x7f9abc1a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:33.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.273+0000 7f9ac0a00640 1 --2- 172.21.15.42:0/1065824294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9abc0764c0 0x7f9abc1a4440 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000e9f0 tx=0x7f9ab000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:33.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.274+0000 7f9ab9600640 1 -- 172.21.15.42:0/1065824294 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab000cd80 con 0x7f9abc0764c0 2024-08-26T00:01:33.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.274+0000 7f9ac3400640 1 -- 172.21.15.42:0/1065824294 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9abc19f020 con 0x7f9abc0764c0 2024-08-26T00:01:33.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.274+0000 7f9ab9600640 1 -- 172.21.15.42:0/1065824294 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ab0010910 con 0x7f9abc0764c0 2024-08-26T00:01:33.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.274+0000 7f9ab9600640 1 -- 172.21.15.42:0/1065824294 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00188f0 con 0x7f9abc0764c0 2024-08-26T00:01:33.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.274+0000 7f9ac3400640 1 -- 172.21.15.42:0/1065824294 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9abc1ab310 con 0x7f9abc0764c0 2024-08-26T00:01:33.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.275+0000 7f9ac3400640 1 -- 172.21.15.42:0/1065824294 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9abc0768a0 con 0x7f9abc0764c0 2024-08-26T00:01:33.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.275+0000 7f2820600640 1 -- 172.21.15.42:0/1528659664 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f281819b770 con 0x7f2818104760 2024-08-26T00:01:33.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.275+0000 7f2816000640 1 -- 172.21.15.42:0/1528659664 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f281819b770 con 0x7f2818104760 2024-08-26T00:01:33.277 INFO:teuthology.orchestra.run.smithi042.stdout:309237645338 2024-08-26T00:01:33.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.277+0000 7f9ab9600640 1 -- 172.21.15.42:0/1065824294 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9ab0010ac0 con 0x7f9abc0764c0 2024-08-26T00:01:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.278+0000 7f2820600640 1 -- 172.21.15.42:0/1528659664 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f28000a2c10 msgr2=0x7f28000a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.278+0000 7f2820600640 1 --2- 172.21.15.42:0/1528659664 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f28000a2c10 0x7f28000a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f280c000c00 tx=0x7f280c005b50 comp rx=0 tx=0).stop 2024-08-26T00:01:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.278+0000 7f2820600640 1 -- 172.21.15.42:0/1528659664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2818104760 msgr2=0x7f281819a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.278+0000 7f2820600640 1 --2- 172.21.15.42:0/1528659664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2818104760 0x7f281819a950 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f280400e9f0 tx=0x7f280400edf0 comp rx=0 tx=0).stop 2024-08-26T00:01:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.278+0000 7f2820600640 1 -- 172.21.15.42:0/1528659664 shutdown_connections 2024-08-26T00:01:33.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.278+0000 7f2820600640 1 --2- 172.21.15.42:0/1528659664 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f28000a2c10 0x7f28000a50d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:33.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.278+0000 7f2820600640 1 --2- 172.21.15.42:0/1528659664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2818108ee0 0x7f281819ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:33.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.278+0000 7f2820600640 1 --2- 172.21.15.42:0/1528659664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2818104760 0x7f281819a950 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:33.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.278+0000 7f2820600640 1 --2- 172.21.15.42:0/1528659664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2818103db0 0x7f281819a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:33.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.278+0000 7f2820600640 1 -- 172.21.15.42:0/1528659664 >> 172.21.15.42:0/1528659664 conn(0x7f28180ff7f0 msgr2=0x7f2818100b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:33.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.278+0000 7f2820600640 1 -- 172.21.15.42:0/1528659664 shutdown_connections 2024-08-26T00:01:33.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.278+0000 7f2820600640 1 -- 172.21.15.42:0/1528659664 wait complete. 2024-08-26T00:01:33.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.279+0000 7f9ab9600640 1 --2- 172.21.15.42:0/1065824294 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9aa40a2c10 0x7f9aa40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:33.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.279+0000 7f9ab9600640 1 -- 172.21.15.42:0/1065824294 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8240+0+0 (secure 0 0 0) 0x7f9ab00cf960 con 0x7f9abc0764c0 2024-08-26T00:01:33.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.279+0000 7f9abbe00640 1 --2- 172.21.15.42:0/1065824294 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9aa40a2c10 0x7f9aa40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:33.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.280+0000 7f9abbe00640 1 --2- 172.21.15.42:0/1065824294 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9aa40a2c10 0x7f9aa40a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9abc079050 tx=0x7f9aa8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:33.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.280+0000 7f9ab9600640 1 -- 172.21.15.42:0/1065824294 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f9ab009c110 con 0x7f9abc0764c0 2024-08-26T00:01:33.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.486+0000 7f9ac3400640 1 -- 172.21.15.42:0/1065824294 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9abc19fb30 con 0x7f9abc0764c0 2024-08-26T00:01:33.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.486+0000 7f9ab9600640 1 -- 172.21.15.42:0/1065824294 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9ab00a0410 con 0x7f9abc0764c0 2024-08-26T00:01:33.488 INFO:teuthology.orchestra.run.smithi042.stdout:98784247874 2024-08-26T00:01:33.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.488+0000 7f9ac3400640 1 -- 172.21.15.42:0/1065824294 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9aa40a2c10 msgr2=0x7f9aa40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:33.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.488+0000 7f9ac3400640 1 --2- 172.21.15.42:0/1065824294 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9aa40a2c10 0x7f9aa40a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9abc079050 tx=0x7f9aa8005f90 comp rx=0 tx=0).stop 2024-08-26T00:01:33.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.488+0000 7f9ac3400640 1 -- 172.21.15.42:0/1065824294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9abc0764c0 msgr2=0x7f9abc1a4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:33.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.488+0000 7f9ac3400640 1 --2- 172.21.15.42:0/1065824294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9abc0764c0 0x7f9abc1a4440 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000e9f0 tx=0x7f9ab000eeb0 comp rx=0 tx=0).stop 2024-08-26T00:01:33.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.488+0000 7f9ac3400640 1 -- 172.21.15.42:0/1065824294 shutdown_connections 2024-08-26T00:01:33.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.488+0000 7f9ac3400640 1 --2- 172.21.15.42:0/1065824294 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9aa40a2c10 0x7f9aa40a50d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:33.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.488+0000 7f9ac3400640 1 --2- 172.21.15.42:0/1065824294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9abc1127d0 0x7f9abc19e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:33.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.488+0000 7f9ac3400640 1 --2- 172.21.15.42:0/1065824294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9abc076de0 0x7f9abc1a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:33.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.488+0000 7f9ac3400640 1 --2- 172.21.15.42:0/1065824294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9abc0764c0 0x7f9abc1a4440 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:33.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.488+0000 7f9ac3400640 1 -- 172.21.15.42:0/1065824294 >> 172.21.15.42:0/1065824294 conn(0x7f9abc0ff830 msgr2=0x7f9abc101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:33.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.489+0000 7f9ac3400640 1 -- 172.21.15.42:0/1065824294 shutdown_connections 2024-08-26T00:01:33.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:33.489+0000 7f9ac3400640 1 -- 172.21.15.42:0/1065824294 wait complete. 2024-08-26T00:01:33.754 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:33 smithi042 ceph-mon[17225]: pgmap v308: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-08-26T00:01:33.755 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:33 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-08-26T00:01:33.755 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:33 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-08-26T00:01:33.755 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:33 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-08-26T00:01:33.755 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:33 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-08-26T00:01:33.755 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:33 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-08-26T00:01:33.755 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:33 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-08-26T00:01:33.755 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:33 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-08-26T00:01:33.755 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:33 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-08-26T00:01:33.755 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:33 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2024-08-26T00:01:33.755 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:33 smithi042 ceph-mon[17225]: osdmap e79: 12 total, 12 up, 12 in 2024-08-26T00:01:33.755 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:33 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1528659664' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-08-26T00:01:33.755 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:33 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1065824294' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-08-26T00:01:34.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:33 smithi043 ceph-mon[22091]: pgmap v308: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-08-26T00:01:34.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:33 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-08-26T00:01:34.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:33 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-08-26T00:01:34.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:33 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-08-26T00:01:34.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:33 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-08-26T00:01:34.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:33 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-08-26T00:01:34.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:33 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-08-26T00:01:34.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:33 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-08-26T00:01:34.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:33 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-08-26T00:01:34.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:33 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2024-08-26T00:01:34.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:33 smithi043 ceph-mon[22091]: osdmap e79: 12 total, 12 up, 12 in 2024-08-26T00:01:34.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:33 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1528659664' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-08-26T00:01:34.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:33 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1065824294' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-08-26T00:01:34.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:33 smithi181 ceph-mon[22102]: pgmap v308: 97 pgs: 97 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-08-26T00:01:34.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:33 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-08-26T00:01:34.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:33 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-08-26T00:01:34.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:33 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-08-26T00:01:34.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:33 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-08-26T00:01:34.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:33 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-08-26T00:01:34.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:33 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-08-26T00:01:34.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:33 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-08-26T00:01:34.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:33 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-08-26T00:01:34.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:33 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2024-08-26T00:01:34.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:33 smithi181 ceph-mon[22102]: osdmap e79: 12 total, 12 up, 12 in 2024-08-26T00:01:34.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:33 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1528659664' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-08-26T00:01:34.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:33 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1065824294' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-08-26T00:01:34.124 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645334 got 309237645338 for osd.11 2024-08-26T00:01:34.124 DEBUG:teuthology.parallel:result is None 2024-08-26T00:01:34.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.611+0000 7fa753000640 1 -- 172.21.15.42:0/2357357517 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa74c107920 msgr2=0x7fa74c107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:34.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.611+0000 7fa753000640 1 --2- 172.21.15.42:0/2357357517 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa74c107920 0x7fa74c107d00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa73c009930 tx=0x7fa73c02a420 comp rx=0 tx=0).stop 2024-08-26T00:01:34.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.612+0000 7fa753000640 1 -- 172.21.15.42:0/2357357517 shutdown_connections 2024-08-26T00:01:34.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.612+0000 7fa753000640 1 --2- 172.21.15.42:0/2357357517 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa74c1022c0 0x7fa74c10e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:34.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.612+0000 7fa753000640 1 --2- 172.21.15.42:0/2357357517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa74c101920 0x7fa74c101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:34.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.612+0000 7fa753000640 1 --2- 172.21.15.42:0/2357357517 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa74c107920 0x7fa74c107d00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:34.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.612+0000 7fa753000640 1 -- 172.21.15.42:0/2357357517 >> 172.21.15.42:0/2357357517 conn(0x7fa74c0fd660 msgr2=0x7fa74c0ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:34.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.612+0000 7fa753000640 1 -- 172.21.15.42:0/2357357517 shutdown_connections 2024-08-26T00:01:34.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.612+0000 7fa753000640 1 -- 172.21.15.42:0/2357357517 wait complete. 2024-08-26T00:01:34.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.613+0000 7fa753000640 1 Processor -- start 2024-08-26T00:01:34.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.613+0000 7fa753000640 1 -- start start 2024-08-26T00:01:34.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.613+0000 7fa753000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa74c101920 0x7fa74c19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:34.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.613+0000 7fa753000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa74c1022c0 0x7fa74c19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:34.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.613+0000 7fa753000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa74c107920 0x7fa74c19ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:34.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.613+0000 7fa753000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c111d70 con 0x7fa74c107920 2024-08-26T00:01:34.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.613+0000 7fa753000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c111bf0 con 0x7fa74c101920 2024-08-26T00:01:34.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.613+0000 7fa753000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c111ef0 con 0x7fa74c1022c0 2024-08-26T00:01:34.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.613+0000 7fa751000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa74c107920 0x7fa74c19ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:34.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.613+0000 7fa743e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa74c1022c0 0x7fa74c19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:34.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.613+0000 7fa751000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa74c107920 0x7fa74c19ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43862/0 (socket says 172.21.15.42:43862) 2024-08-26T00:01:34.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.613+0000 7fa751000640 1 -- 172.21.15.42:0/1921681231 learned_addr learned my addr 172.21.15.42:0/1921681231 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:34.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.613+0000 7fa74be00640 1 --2- 172.21.15.42:0/1921681231 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa74c101920 0x7fa74c19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:34.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.614+0000 7fa751000640 1 -- 172.21.15.42:0/1921681231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa74c1022c0 msgr2=0x7fa74c19a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:34.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.614+0000 7fa751000640 1 --2- 172.21.15.42:0/1921681231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa74c1022c0 0x7fa74c19a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:34.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.614+0000 7fa751000640 1 -- 172.21.15.42:0/1921681231 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa74c101920 msgr2=0x7fa74c19a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:34.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.614+0000 7fa751000640 1 --2- 172.21.15.42:0/1921681231 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa74c101920 0x7fa74c19a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:34.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.614+0000 7fa751000640 1 -- 172.21.15.42:0/1921681231 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74c19f3e0 con 0x7fa74c107920 2024-08-26T00:01:34.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.614+0000 7fa751000640 1 --2- 172.21.15.42:0/1921681231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa74c107920 0x7fa74c19ed00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa74400eb10 tx=0x7fa74400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:34.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.614+0000 7fa749600640 1 -- 172.21.15.42:0/1921681231 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa744004b20 con 0x7fa74c107920 2024-08-26T00:01:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.614+0000 7fa753000640 1 -- 172.21.15.42:0/1921681231 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa74c19f6d0 con 0x7fa74c107920 2024-08-26T00:01:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.614+0000 7fa749600640 1 -- 172.21.15.42:0/1921681231 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa744004cc0 con 0x7fa74c107920 2024-08-26T00:01:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.614+0000 7fa749600640 1 -- 172.21.15.42:0/1921681231 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa744010760 con 0x7fa74c107920 2024-08-26T00:01:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.615+0000 7fa753000640 1 -- 172.21.15.42:0/1921681231 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa74c1a6fb0 con 0x7fa74c107920 2024-08-26T00:01:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.616+0000 7fa753000640 1 -- 172.21.15.42:0/1921681231 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa74c101d80 con 0x7fa74c107920 2024-08-26T00:01:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.617+0000 7fa749600640 1 -- 172.21.15.42:0/1921681231 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa744005020 con 0x7fa74c107920 2024-08-26T00:01:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.619+0000 7fa749600640 1 --2- 172.21.15.42:0/1921681231 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa7300a2c10 0x7fa7300a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.619+0000 7fa749600640 1 -- 172.21.15.42:0/1921681231 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fa7440cf610 con 0x7fa74c107920 2024-08-26T00:01:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.619+0000 7fa74be00640 1 --2- 172.21.15.42:0/1921681231 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa7300a2c10 0x7fa7300a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.620+0000 7fa74be00640 1 --2- 172.21.15.42:0/1921681231 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa7300a2c10 0x7fa7300a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa73c006010 tx=0x7fa73c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.624+0000 7fa749600640 1 -- 172.21.15.42:0/1921681231 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa74409c4c0 con 0x7fa74c107920 2024-08-26T00:01:34.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.814+0000 7fa753000640 1 -- 172.21.15.42:0/1921681231 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa74c1a71e0 con 0x7fa74c107920 2024-08-26T00:01:34.342 INFO:teuthology.orchestra.run.smithi042.stdout:73014444104 2024-08-26T00:01:34.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.814+0000 7fa749600640 1 -- 172.21.15.42:0/1921681231 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa74409bdc0 con 0x7fa74c107920 2024-08-26T00:01:34.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.817+0000 7fa753000640 1 -- 172.21.15.42:0/1921681231 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa7300a2c10 msgr2=0x7fa7300a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:34.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.817+0000 7fa753000640 1 --2- 172.21.15.42:0/1921681231 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa7300a2c10 0x7fa7300a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa73c006010 tx=0x7fa73c000bc0 comp rx=0 tx=0).stop 2024-08-26T00:01:34.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.817+0000 7fa753000640 1 -- 172.21.15.42:0/1921681231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa74c107920 msgr2=0x7fa74c19ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:34.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.817+0000 7fa753000640 1 --2- 172.21.15.42:0/1921681231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa74c107920 0x7fa74c19ed00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa74400eb10 tx=0x7fa74400c2d0 comp rx=0 tx=0).stop 2024-08-26T00:01:34.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.817+0000 7fa753000640 1 -- 172.21.15.42:0/1921681231 shutdown_connections 2024-08-26T00:01:34.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.817+0000 7fa753000640 1 --2- 172.21.15.42:0/1921681231 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa7300a2c10 0x7fa7300a50d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:34.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.817+0000 7fa753000640 1 --2- 172.21.15.42:0/1921681231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa74c107920 0x7fa74c19ed00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:34.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.817+0000 7fa753000640 1 --2- 172.21.15.42:0/1921681231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa74c1022c0 0x7fa74c19a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:34.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.817+0000 7fa753000640 1 --2- 172.21.15.42:0/1921681231 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa74c101920 0x7fa74c19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:34.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.817+0000 7fa753000640 1 -- 172.21.15.42:0/1921681231 >> 172.21.15.42:0/1921681231 conn(0x7fa74c0fd660 msgr2=0x7fa74c0fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:34.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.817+0000 7fa753000640 1 -- 172.21.15.42:0/1921681231 shutdown_connections 2024-08-26T00:01:34.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:31.817+0000 7fa753000640 1 -- 172.21.15.42:0/1921681231 wait complete. 2024-08-26T00:01:34.867 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:34 smithi042 ceph-mon[17225]: osdmap e80: 12 total, 12 up, 12 in 2024-08-26T00:01:34.906 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626479 got 180388626481 for osd.6 2024-08-26T00:01:34.907 DEBUG:teuthology.parallel:result is None 2024-08-26T00:01:35.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:34 smithi043 ceph-mon[22091]: osdmap e80: 12 total, 12 up, 12 in 2024-08-26T00:01:35.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:34 smithi181 ceph-mon[22102]: osdmap e80: 12 total, 12 up, 12 in 2024-08-26T00:01:35.668 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266726 got 227633266729 for osd.8 2024-08-26T00:01:35.668 DEBUG:teuthology.parallel:result is None 2024-08-26T00:01:35.942 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:35 smithi042 ceph-mon[17225]: pgmap v311: 97 pgs: 1 peering, 96 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-26T00:01:35.942 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:35 smithi042 ceph-mon[17225]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-08-26T00:01:36.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:35 smithi043 ceph-mon[22091]: pgmap v311: 97 pgs: 1 peering, 96 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-26T00:01:36.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:35 smithi043 ceph-mon[22091]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-08-26T00:01:36.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:35 smithi181 ceph-mon[22102]: pgmap v311: 97 pgs: 1 peering, 96 active+clean; 640 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-26T00:01:36.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:35 smithi181 ceph-mon[22102]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-08-26T00:01:36.247 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574921 got 55834574924 for osd.1 2024-08-26T00:01:36.247 DEBUG:teuthology.parallel:result is None 2024-08-26T00:01:36.643 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495657 got 197568495660 for osd.7 2024-08-26T00:01:36.643 DEBUG:teuthology.parallel:result is None 2024-08-26T00:01:37.095 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:37.123 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444100 got 73014444104 for osd.2 2024-08-26T00:01:37.124 DEBUG:teuthology.parallel:result is None 2024-08-26T00:01:37.273 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247870 got 98784247874 for osd.3 2024-08-26T00:01:37.274 DEBUG:teuthology.parallel:result is None 2024-08-26T00:01:37.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.774+0000 7f349b200640 1 -- 172.21.15.42:0/1021732035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f349c101760 msgr2=0x7f349c101bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:37.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.774+0000 7f349b200640 1 --2- 172.21.15.42:0/1021732035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f349c101760 0x7f349c101bc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3488009930 tx=0x7f348802a420 comp rx=0 tx=0).stop 2024-08-26T00:01:37.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.774+0000 7f349b200640 1 -- 172.21.15.42:0/1021732035 shutdown_connections 2024-08-26T00:01:37.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.774+0000 7f349b200640 1 --2- 172.21.15.42:0/1021732035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f349c102100 0x7f349c10e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:37.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.774+0000 7f349b200640 1 --2- 172.21.15.42:0/1021732035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f349c101760 0x7f349c101bc0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:37.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.774+0000 7f349b200640 1 --2- 172.21.15.42:0/1021732035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f349c107760 0x7f349c107b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:37.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.774+0000 7f349b200640 1 -- 172.21.15.42:0/1021732035 >> 172.21.15.42:0/1021732035 conn(0x7f349c0fd4e0 msgr2=0x7f349c0ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:37.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.774+0000 7f349b200640 1 -- 172.21.15.42:0/1021732035 shutdown_connections 2024-08-26T00:01:37.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.774+0000 7f349b200640 1 -- 172.21.15.42:0/1021732035 wait complete. 2024-08-26T00:01:37.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.775+0000 7f349b200640 1 Processor -- start 2024-08-26T00:01:37.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.775+0000 7f349b200640 1 -- start start 2024-08-26T00:01:37.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.776+0000 7f349b200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f349c101760 0x7f349c074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:37.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.776+0000 7f349b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f349c102100 0x7f349c0747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:37.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.776+0000 7f349b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f349c107760 0x7f349c074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:37.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.776+0000 7f349b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f349c111b70 con 0x7f349c102100 2024-08-26T00:01:37.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.776+0000 7f349b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f349c1119f0 con 0x7f349c107760 2024-08-26T00:01:37.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.776+0000 7f349b200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f349c111cf0 con 0x7f349c101760 2024-08-26T00:01:37.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.776+0000 7f349a800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f349c107760 0x7f349c074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:37.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.776+0000 7f349a800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f349c107760 0x7f349c074d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:41810/0 (socket says 172.21.15.42:41810) 2024-08-26T00:01:37.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.776+0000 7f349a800640 1 -- 172.21.15.42:0/1557216327 learned_addr learned my addr 172.21.15.42:0/1557216327 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:37.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.776+0000 7f3499400640 1 --2- 172.21.15.42:0/1557216327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f349c102100 0x7f349c0747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:37.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.777+0000 7f349a800640 1 -- 172.21.15.42:0/1557216327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f349c101760 msgr2=0x7f349c074290 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-26T00:01:37.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.777+0000 7f349a800640 1 --2- 172.21.15.42:0/1557216327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f349c101760 0x7f349c074290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:37.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.777+0000 7f349a800640 1 -- 172.21.15.42:0/1557216327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f349c102100 msgr2=0x7f349c0747d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:37.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.777+0000 7f349a800640 1 --2- 172.21.15.42:0/1557216327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f349c102100 0x7f349c0747d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:37.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.777+0000 7f349a800640 1 -- 172.21.15.42:0/1557216327 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349c1aaa20 con 0x7f349c107760 2024-08-26T00:01:37.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.777+0000 7f3499400640 1 --2- 172.21.15.42:0/1557216327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f349c102100 0x7f349c0747d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:01:37.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.777+0000 7f349a800640 1 --2- 172.21.15.42:0/1557216327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f349c107760 0x7f349c074d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f349400efd0 tx=0x7f349400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:37.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.777+0000 7f3492a00640 1 -- 172.21.15.42:0/1557216327 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3494003b70 con 0x7f349c107760 2024-08-26T00:01:37.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.777+0000 7f349b200640 1 -- 172.21.15.42:0/1557216327 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f349c1aac50 con 0x7f349c107760 2024-08-26T00:01:37.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.777+0000 7f3492a00640 1 -- 172.21.15.42:0/1557216327 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3494003d10 con 0x7f349c107760 2024-08-26T00:01:37.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.778+0000 7f3492a00640 1 -- 172.21.15.42:0/1557216327 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34940109f0 con 0x7f349c107760 2024-08-26T00:01:37.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.778+0000 7f349b200640 1 -- 172.21.15.42:0/1557216327 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f349c1ab160 con 0x7f349c107760 2024-08-26T00:01:37.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.780+0000 7f349b200640 1 -- 172.21.15.42:0/1557216327 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f349c102ea0 con 0x7f349c107760 2024-08-26T00:01:37.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.781+0000 7f3492a00640 1 -- 172.21.15.42:0/1557216327 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3494010b90 con 0x7f349c107760 2024-08-26T00:01:37.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.783+0000 7f3492a00640 1 --2- 172.21.15.42:0/1557216327 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f34800a2c10 0x7f34800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:37.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.783+0000 7f3492a00640 1 -- 172.21.15.42:0/1557216327 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f34940cf410 con 0x7f349c107760 2024-08-26T00:01:37.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.783+0000 7f3499e00640 1 --2- 172.21.15.42:0/1557216327 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f34800a2c10 0x7f34800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:37.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.784+0000 7f3499e00640 1 --2- 172.21.15.42:0/1557216327 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f34800a2c10 0x7f34800a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f348c0099e0 tx=0x7f348c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:37.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.786+0000 7f3492a00640 1 -- 172.21.15.42:0/1557216327 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f349409c1d0 con 0x7f349c107760 2024-08-26T00:01:37.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.981+0000 7f349b200640 1 -- 172.21.15.42:0/1557216327 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f349c109cf0 con 0x7f349c107760 2024-08-26T00:01:37.982 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:37 smithi042 ceph-mon[17225]: pgmap v312: 97 pgs: 1 peering, 96 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s; 2 B/s, 0 objects/s recovering 2024-08-26T00:01:37.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.981+0000 7f3492a00640 1 -- 172.21.15.42:0/1557216327 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f349409bad0 con 0x7f349c107760 2024-08-26T00:01:37.983 INFO:teuthology.orchestra.run.smithi042.stdout:257698037796 2024-08-26T00:01:37.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.984+0000 7f349b200640 1 -- 172.21.15.42:0/1557216327 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f34800a2c10 msgr2=0x7f34800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:37.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.984+0000 7f349b200640 1 --2- 172.21.15.42:0/1557216327 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f34800a2c10 0x7f34800a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f348c0099e0 tx=0x7f348c005f90 comp rx=0 tx=0).stop 2024-08-26T00:01:37.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.984+0000 7f349b200640 1 -- 172.21.15.42:0/1557216327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f349c107760 msgr2=0x7f349c074d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:37.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.984+0000 7f349b200640 1 --2- 172.21.15.42:0/1557216327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f349c107760 0x7f349c074d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f349400efd0 tx=0x7f349400c6a0 comp rx=0 tx=0).stop 2024-08-26T00:01:37.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.984+0000 7f349b200640 1 -- 172.21.15.42:0/1557216327 shutdown_connections 2024-08-26T00:01:37.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.984+0000 7f349b200640 1 --2- 172.21.15.42:0/1557216327 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f34800a2c10 0x7f34800a50d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:37.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.984+0000 7f349b200640 1 --2- 172.21.15.42:0/1557216327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f349c107760 0x7f349c074d10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:37.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.984+0000 7f349b200640 1 --2- 172.21.15.42:0/1557216327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f349c102100 0x7f349c0747d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:37.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.984+0000 7f349b200640 1 --2- 172.21.15.42:0/1557216327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f349c101760 0x7f349c074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:37.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.984+0000 7f349b200640 1 -- 172.21.15.42:0/1557216327 >> 172.21.15.42:0/1557216327 conn(0x7f349c0fd4e0 msgr2=0x7f349c0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:37.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.984+0000 7f349b200640 1 -- 172.21.15.42:0/1557216327 shutdown_connections 2024-08-26T00:01:37.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:37.984+0000 7f349b200640 1 -- 172.21.15.42:0/1557216327 wait complete. 2024-08-26T00:01:38.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:37 smithi043 ceph-mon[22091]: pgmap v312: 97 pgs: 1 peering, 96 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s; 2 B/s, 0 objects/s recovering 2024-08-26T00:01:38.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:37 smithi181 ceph-mon[22102]: pgmap v312: 97 pgs: 1 peering, 96 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s; 2 B/s, 0 objects/s recovering 2024-08-26T00:01:38.875 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:38 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1557216327' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-08-26T00:01:39.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:38 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1557216327' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-08-26T00:01:39.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:38 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1557216327' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-08-26T00:01:39.175 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037792 got 257698037796 for osd.9 2024-08-26T00:01:39.175 DEBUG:teuthology.parallel:result is None 2024-08-26T00:01:39.175 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-26T00:01:39.175 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph pg dump --format=json 2024-08-26T00:01:39.596 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:39.892 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:39 smithi042 ceph-mon[17225]: pgmap v313: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 7.4 KiB/s, 0 objects/s recovering 2024-08-26T00:01:39.892 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:39 smithi042 ceph-mon[17225]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-08-26T00:01:39.892 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:39 smithi042 ceph-mon[17225]: Cluster is now healthy 2024-08-26T00:01:40.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:39 smithi043 ceph-mon[22091]: pgmap v313: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 7.4 KiB/s, 0 objects/s recovering 2024-08-26T00:01:40.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:39 smithi043 ceph-mon[22091]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-08-26T00:01:40.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:39 smithi043 ceph-mon[22091]: Cluster is now healthy 2024-08-26T00:01:40.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:39 smithi181 ceph-mon[22102]: pgmap v313: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 7.4 KiB/s, 0 objects/s recovering 2024-08-26T00:01:40.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:39 smithi181 ceph-mon[22102]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-08-26T00:01:40.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:39 smithi181 ceph-mon[22102]: Cluster is now healthy 2024-08-26T00:01:40.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.156+0000 7f6f66e00640 1 -- 172.21.15.42:0/1476378754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f60102100 msgr2=0x7f6f6010e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:40.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.156+0000 7f6f66e00640 1 --2- 172.21.15.42:0/1476378754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f60102100 0x7f6f6010e630 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009cd0 tx=0x7f6f5802a8e0 comp rx=0 tx=0).stop 2024-08-26T00:01:40.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.156+0000 7f6f66e00640 1 -- 172.21.15.42:0/1476378754 shutdown_connections 2024-08-26T00:01:40.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.156+0000 7f6f66e00640 1 --2- 172.21.15.42:0/1476378754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f60102100 0x7f6f6010e630 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:40.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.156+0000 7f6f66e00640 1 --2- 172.21.15.42:0/1476378754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f60101760 0x7f6f60101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:40.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.156+0000 7f6f66e00640 1 --2- 172.21.15.42:0/1476378754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f60107760 0x7f6f60107b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:40.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.156+0000 7f6f66e00640 1 -- 172.21.15.42:0/1476378754 >> 172.21.15.42:0/1476378754 conn(0x7f6f600fd4e0 msgr2=0x7f6f600ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:40.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.156+0000 7f6f66e00640 1 -- 172.21.15.42:0/1476378754 shutdown_connections 2024-08-26T00:01:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.156+0000 7f6f66e00640 1 -- 172.21.15.42:0/1476378754 wait complete. 2024-08-26T00:01:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.157+0000 7f6f66e00640 1 Processor -- start 2024-08-26T00:01:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.158+0000 7f6f66e00640 1 -- start start 2024-08-26T00:01:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.158+0000 7f6f66e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f60101760 0x7f6f6019a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.158+0000 7f6f66e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f60102100 0x7f6f6019a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.158+0000 7f6f66e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f60107760 0x7f6f6019eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.158+0000 7f6f66e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6f60111bb0 con 0x7f6f60101760 2024-08-26T00:01:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.158+0000 7f6f66e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6f60111a30 con 0x7f6f60102100 2024-08-26T00:01:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.158+0000 7f6f66e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6f60111d30 con 0x7f6f60107760 2024-08-26T00:01:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.159+0000 7f6f65a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f60101760 0x7f6f6019a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.159+0000 7f6f65000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f60102100 0x7f6f6019a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.159+0000 7f6f66400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f60107760 0x7f6f6019eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:40.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.159+0000 7f6f65a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f60101760 0x7f6f6019a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51558/0 (socket says 172.21.15.42:51558) 2024-08-26T00:01:40.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.159+0000 7f6f65000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f60102100 0x7f6f6019a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:41822/0 (socket says 172.21.15.42:41822) 2024-08-26T00:01:40.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.159+0000 7f6f65a00640 1 -- 172.21.15.42:0/2312981854 learned_addr learned my addr 172.21.15.42:0/2312981854 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:40.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.159+0000 7f6f65a00640 1 -- 172.21.15.42:0/2312981854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f60107760 msgr2=0x7f6f6019eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:40.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.159+0000 7f6f65a00640 1 --2- 172.21.15.42:0/2312981854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f60107760 0x7f6f6019eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:40.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.159+0000 7f6f65a00640 1 -- 172.21.15.42:0/2312981854 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f60102100 msgr2=0x7f6f6019a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:40.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.159+0000 7f6f65a00640 1 --2- 172.21.15.42:0/2312981854 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f60102100 0x7f6f6019a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:40.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.159+0000 7f6f65a00640 1 -- 172.21.15.42:0/2312981854 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f6019f250 con 0x7f6f60101760 2024-08-26T00:01:40.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.159+0000 7f6f65000640 1 --2- 172.21.15.42:0/2312981854 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f60102100 0x7f6f6019a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:40.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.160+0000 7f6f65a00640 1 --2- 172.21.15.42:0/2312981854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f60101760 0x7f6f6019a2a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6f5400d950 tx=0x7f6f5400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:40.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.160+0000 7f6f5e000640 1 -- 172.21.15.42:0/2312981854 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f54017070 con 0x7f6f60101760 2024-08-26T00:01:40.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.160+0000 7f6f5e000640 1 -- 172.21.15.42:0/2312981854 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f54009c30 con 0x7f6f60101760 2024-08-26T00:01:40.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.160+0000 7f6f66e00640 1 -- 172.21.15.42:0/2312981854 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f6019f540 con 0x7f6f60101760 2024-08-26T00:01:40.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.160+0000 7f6f5e000640 1 -- 172.21.15.42:0/2312981854 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5400f6b0 con 0x7f6f60101760 2024-08-26T00:01:40.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.160+0000 7f6f66e00640 1 -- 172.21.15.42:0/2312981854 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f601a6e20 con 0x7f6f60101760 2024-08-26T00:01:40.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.162+0000 7f6f66e00640 1 -- 172.21.15.42:0/2312981854 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f60101bc0 con 0x7f6f60101760 2024-08-26T00:01:40.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.163+0000 7f6f5e000640 1 -- 172.21.15.42:0/2312981854 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6f540109d0 con 0x7f6f60101760 2024-08-26T00:01:40.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.165+0000 7f6f5e000640 1 --2- 172.21.15.42:0/2312981854 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f6f480a2c10 0x7f6f480a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:40.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.165+0000 7f6f5e000640 1 -- 172.21.15.42:0/2312981854 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f6f540cecf0 con 0x7f6f60101760 2024-08-26T00:01:40.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.165+0000 7f6f65000640 1 --2- 172.21.15.42:0/2312981854 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f6f480a2c10 0x7f6f480a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:40.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.166+0000 7f6f65000640 1 --2- 172.21.15.42:0/2312981854 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f6f480a2c10 0x7f6f480a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6f60106a60 tx=0x7f6f4c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:40.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.169+0000 7f6f5e000640 1 -- 172.21.15.42:0/2312981854 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6f54009de0 con 0x7f6f60101760 2024-08-26T00:01:40.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.359+0000 7f6f66e00640 1 -- 172.21.15.42:0/2312981854 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6f6010d170 con 0x7f6f480a2c10 2024-08-26T00:01:40.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.366+0000 7f6f5e000640 1 -- 172.21.15.42:0/2312981854 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258756 (secure 0 0 0) 0x7f6f6010d170 con 0x7f6f480a2c10 2024-08-26T00:01:40.371 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:01:40.373 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-08-26T00:01:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.370+0000 7f6f66e00640 1 -- 172.21.15.42:0/2312981854 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f6f480a2c10 msgr2=0x7f6f480a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.370+0000 7f6f66e00640 1 --2- 172.21.15.42:0/2312981854 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f6f480a2c10 0x7f6f480a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6f60106a60 tx=0x7f6f4c005f90 comp rx=0 tx=0).stop 2024-08-26T00:01:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.370+0000 7f6f66e00640 1 -- 172.21.15.42:0/2312981854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f60101760 msgr2=0x7f6f6019a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.370+0000 7f6f66e00640 1 --2- 172.21.15.42:0/2312981854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f60101760 0x7f6f6019a2a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6f5400d950 tx=0x7f6f5400de10 comp rx=0 tx=0).stop 2024-08-26T00:01:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.371+0000 7f6f66e00640 1 -- 172.21.15.42:0/2312981854 shutdown_connections 2024-08-26T00:01:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.371+0000 7f6f66e00640 1 --2- 172.21.15.42:0/2312981854 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f6f480a2c10 0x7f6f480a50d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.371+0000 7f6f66e00640 1 --2- 172.21.15.42:0/2312981854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f60107760 0x7f6f6019eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.371+0000 7f6f66e00640 1 --2- 172.21.15.42:0/2312981854 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f60102100 0x7f6f6019a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.371+0000 7f6f66e00640 1 --2- 172.21.15.42:0/2312981854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f60101760 0x7f6f6019a2a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:40.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.371+0000 7f6f66e00640 1 -- 172.21.15.42:0/2312981854 >> 172.21.15.42:0/2312981854 conn(0x7f6f600fd4e0 msgr2=0x7f6f6010ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:40.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.372+0000 7f6f66e00640 1 -- 172.21.15.42:0/2312981854 shutdown_connections 2024-08-26T00:01:40.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:40.372+0000 7f6f66e00640 1 -- 172.21.15.42:0/2312981854 wait complete. 2024-08-26T00:01:41.109 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-08-26T00:01:38.508079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655216,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":491,"num_read_kb":358,"num_write":347,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1241373,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":294,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":395052,"kb_used_data":12444,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124546772,"statfs":{"total":1151940427776,"available":1151535894528,"internally_reserved":0,"allocated":12742656,"data_stored":7075716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19137,"internal_metadata":391492927},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":60637,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002040"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596396+0000","last_change":"2024-08-26T00:00:29.365654+0000","last_active":"2024-08-26T00:01:33.596396+0000","last_peered":"2024-08-26T00:01:33.596396+0000","last_clean":"2024-08-26T00:01:33.596396+0000","last_became_active":"2024-08-26T00:00:29.364609+0000","last_became_peered":"2024-08-26T00:00:29.364609+0000","last_unstale":"2024-08-26T00:01:33.596396+0000","last_undegraded":"2024-08-26T00:01:33.596396+0000","last_fullsized":"2024-08-26T00:01:33.596396+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:54:39.886248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598877+0000","last_change":"2024-08-26T00:00:29.367657+0000","last_active":"2024-08-26T00:01:33.598877+0000","last_peered":"2024-08-26T00:01:33.598877+0000","last_clean":"2024-08-26T00:01:33.598877+0000","last_became_active":"2024-08-26T00:00:29.367376+0000","last_became_peered":"2024-08-26T00:00:29.367376+0000","last_unstale":"2024-08-26T00:01:33.598877+0000","last_undegraded":"2024-08-26T00:01:33.598877+0000","last_fullsized":"2024-08-26T00:01:33.598877+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:16:13.414883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598469+0000","last_change":"2024-08-26T00:00:29.369219+0000","last_active":"2024-08-26T00:01:33.598469+0000","last_peered":"2024-08-26T00:01:33.598469+0000","last_clean":"2024-08-26T00:01:33.598469+0000","last_became_active":"2024-08-26T00:00:29.368902+0000","last_became_peered":"2024-08-26T00:00:29.368902+0000","last_unstale":"2024-08-26T00:01:33.598469+0000","last_undegraded":"2024-08-26T00:01:33.598469+0000","last_fullsized":"2024-08-26T00:01:33.598469+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:53:28.636658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.891013+0000","last_change":"2024-08-26T00:00:29.359501+0000","last_active":"2024-08-26T00:01:33.891013+0000","last_peered":"2024-08-26T00:01:33.891013+0000","last_clean":"2024-08-26T00:01:33.891013+0000","last_became_active":"2024-08-26T00:00:29.358778+0000","last_became_peered":"2024-08-26T00:00:29.358778+0000","last_unstale":"2024-08-26T00:01:33.891013+0000","last_undegraded":"2024-08-26T00:01:33.891013+0000","last_fullsized":"2024-08-26T00:01:33.891013+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:20:40.200105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598627+0000","last_change":"2024-08-26T00:00:29.358387+0000","last_active":"2024-08-26T00:01:33.598627+0000","last_peered":"2024-08-26T00:01:33.598627+0000","last_clean":"2024-08-26T00:01:33.598627+0000","last_became_active":"2024-08-26T00:00:29.357839+0000","last_became_peered":"2024-08-26T00:00:29.357839+0000","last_unstale":"2024-08-26T00:01:33.598627+0000","last_undegraded":"2024-08-26T00:01:33.598627+0000","last_fullsized":"2024-08-26T00:01:33.598627+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:05:21.065258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.593062+0000","last_change":"2024-08-26T00:00:29.354429+0000","last_active":"2024-08-26T00:01:33.593062+0000","last_peered":"2024-08-26T00:01:33.593062+0000","last_clean":"2024-08-26T00:01:33.593062+0000","last_became_active":"2024-08-26T00:00:29.354108+0000","last_became_peered":"2024-08-26T00:00:29.354108+0000","last_unstale":"2024-08-26T00:01:33.593062+0000","last_undegraded":"2024-08-26T00:01:33.593062+0000","last_fullsized":"2024-08-26T00:01:33.593062+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:58:07.912980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595403+0000","last_change":"2024-08-26T00:00:29.360127+0000","last_active":"2024-08-26T00:01:33.595403+0000","last_peered":"2024-08-26T00:01:33.595403+0000","last_clean":"2024-08-26T00:01:33.595403+0000","last_became_active":"2024-08-26T00:00:29.359730+0000","last_became_peered":"2024-08-26T00:00:29.359730+0000","last_unstale":"2024-08-26T00:01:33.595403+0000","last_undegraded":"2024-08-26T00:01:33.595403+0000","last_fullsized":"2024-08-26T00:01:33.595403+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:38:16.377861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.592366+0000","last_change":"2024-08-26T00:00:29.362117+0000","last_active":"2024-08-26T00:01:33.592366+0000","last_peered":"2024-08-26T00:01:33.592366+0000","last_clean":"2024-08-26T00:01:33.592366+0000","last_became_active":"2024-08-26T00:00:29.361738+0000","last_became_peered":"2024-08-26T00:00:29.361738+0000","last_unstale":"2024-08-26T00:01:33.592366+0000","last_undegraded":"2024-08-26T00:01:33.592366+0000","last_fullsized":"2024-08-26T00:01:33.592366+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:38:15.468364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.597311+0000","last_change":"2024-08-26T00:00:29.363693+0000","last_active":"2024-08-26T00:01:33.597311+0000","last_peered":"2024-08-26T00:01:33.597311+0000","last_clean":"2024-08-26T00:01:33.597311+0000","last_became_active":"2024-08-26T00:00:29.363356+0000","last_became_peered":"2024-08-26T00:00:29.363356+0000","last_unstale":"2024-08-26T00:01:33.597311+0000","last_undegraded":"2024-08-26T00:01:33.597311+0000","last_fullsized":"2024-08-26T00:01:33.597311+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:18:46.180255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.593806+0000","last_change":"2024-08-26T00:00:29.363401+0000","last_active":"2024-08-26T00:01:33.593806+0000","last_peered":"2024-08-26T00:01:33.593806+0000","last_clean":"2024-08-26T00:01:33.593806+0000","last_became_active":"2024-08-26T00:00:29.363045+0000","last_became_peered":"2024-08-26T00:00:29.363045+0000","last_unstale":"2024-08-26T00:01:33.593806+0000","last_undegraded":"2024-08-26T00:01:33.593806+0000","last_fullsized":"2024-08-26T00:01:33.593806+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:18:24.931121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595874+0000","last_change":"2024-08-26T00:00:29.356440+0000","last_active":"2024-08-26T00:01:33.595874+0000","last_peered":"2024-08-26T00:01:33.595874+0000","last_clean":"2024-08-26T00:01:33.595874+0000","last_became_active":"2024-08-26T00:00:29.355498+0000","last_became_peered":"2024-08-26T00:00:29.355498+0000","last_unstale":"2024-08-26T00:01:33.595874+0000","last_undegraded":"2024-08-26T00:01:33.595874+0000","last_fullsized":"2024-08-26T00:01:33.595874+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:27:31.363962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.891094+0000","last_change":"2024-08-26T00:00:29.359185+0000","last_active":"2024-08-26T00:01:33.891094+0000","last_peered":"2024-08-26T00:01:33.891094+0000","last_clean":"2024-08-26T00:01:33.891094+0000","last_became_active":"2024-08-26T00:00:29.358670+0000","last_became_peered":"2024-08-26T00:00:29.358670+0000","last_unstale":"2024-08-26T00:01:33.891094+0000","last_undegraded":"2024-08-26T00:01:33.891094+0000","last_fullsized":"2024-08-26T00:01:33.891094+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:15:31.327823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.594944+0000","last_change":"2024-08-26T00:00:29.361477+0000","last_active":"2024-08-26T00:01:33.594944+0000","last_peered":"2024-08-26T00:01:33.594944+0000","last_clean":"2024-08-26T00:01:33.594944+0000","last_became_active":"2024-08-26T00:00:29.360870+0000","last_became_peered":"2024-08-26T00:00:29.360870+0000","last_unstale":"2024-08-26T00:01:33.594944+0000","last_undegraded":"2024-08-26T00:01:33.594944+0000","last_fullsized":"2024-08-26T00:01:33.594944+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:37:01.434606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598400+0000","last_change":"2024-08-26T00:00:29.362301+0000","last_active":"2024-08-26T00:01:33.598400+0000","last_peered":"2024-08-26T00:01:33.598400+0000","last_clean":"2024-08-26T00:01:33.598400+0000","last_became_active":"2024-08-26T00:00:29.359613+0000","last_became_peered":"2024-08-26T00:00:29.359613+0000","last_unstale":"2024-08-26T00:01:33.598400+0000","last_undegraded":"2024-08-26T00:01:33.598400+0000","last_fullsized":"2024-08-26T00:01:33.598400+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:24:09.515352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598350+0000","last_change":"2024-08-26T00:00:29.365553+0000","last_active":"2024-08-26T00:01:33.598350+0000","last_peered":"2024-08-26T00:01:33.598350+0000","last_clean":"2024-08-26T00:01:33.598350+0000","last_became_active":"2024-08-26T00:00:29.363344+0000","last_became_peered":"2024-08-26T00:00:29.363344+0000","last_unstale":"2024-08-26T00:01:33.598350+0000","last_undegraded":"2024-08-26T00:01:33.598350+0000","last_fullsized":"2024-08-26T00:01:33.598350+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:27:43.172749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596325+0000","last_change":"2024-08-26T00:00:29.362061+0000","last_active":"2024-08-26T00:01:33.596325+0000","last_peered":"2024-08-26T00:01:33.596325+0000","last_clean":"2024-08-26T00:01:33.596325+0000","last_became_active":"2024-08-26T00:00:29.361712+0000","last_became_peered":"2024-08-26T00:00:29.361712+0000","last_unstale":"2024-08-26T00:01:33.596325+0000","last_undegraded":"2024-08-26T00:01:33.596325+0000","last_fullsized":"2024-08-26T00:01:33.596325+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:20:14.944167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596502+0000","last_change":"2024-08-26T00:00:29.365160+0000","last_active":"2024-08-26T00:01:33.596502+0000","last_peered":"2024-08-26T00:01:33.596502+0000","last_clean":"2024-08-26T00:01:33.596502+0000","last_became_active":"2024-08-26T00:00:29.364541+0000","last_became_peered":"2024-08-26T00:00:29.364541+0000","last_unstale":"2024-08-26T00:01:33.596502+0000","last_undegraded":"2024-08-26T00:01:33.596502+0000","last_fullsized":"2024-08-26T00:01:33.596502+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:59:54.417495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599757+0000","last_change":"2024-08-26T00:00:29.361264+0000","last_active":"2024-08-26T00:01:33.599757+0000","last_peered":"2024-08-26T00:01:33.599757+0000","last_clean":"2024-08-26T00:01:33.599757+0000","last_became_active":"2024-08-26T00:00:29.358501+0000","last_became_peered":"2024-08-26T00:00:29.358501+0000","last_unstale":"2024-08-26T00:01:33.599757+0000","last_undegraded":"2024-08-26T00:01:33.599757+0000","last_fullsized":"2024-08-26T00:01:33.599757+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:04:44.930112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.601117+0000","last_change":"2024-08-26T00:01:33.601117+0000","last_active":"2024-08-26T00:01:33.601117+0000","last_peered":"2024-08-26T00:01:33.601117+0000","last_clean":"2024-08-26T00:01:33.601117+0000","last_became_active":"2024-08-26T00:01:33.600696+0000","last_became_peered":"2024-08-26T00:01:33.600696+0000","last_unstale":"2024-08-26T00:01:33.601117+0000","last_undegraded":"2024-08-26T00:01:33.601117+0000","last_fullsized":"2024-08-26T00:01:33.601117+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:43:46.062253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595116+0000","last_change":"2024-08-26T00:00:29.363072+0000","last_active":"2024-08-26T00:01:33.595116+0000","last_peered":"2024-08-26T00:01:33.595116+0000","last_clean":"2024-08-26T00:01:33.595116+0000","last_became_active":"2024-08-26T00:00:29.362751+0000","last_became_peered":"2024-08-26T00:00:29.362751+0000","last_unstale":"2024-08-26T00:01:33.595116+0000","last_undegraded":"2024-08-26T00:01:33.595116+0000","last_fullsized":"2024-08-26T00:01:33.595116+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:49:14.455371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595021+0000","last_change":"2024-08-26T00:00:29.367489+0000","last_active":"2024-08-26T00:01:33.595021+0000","last_peered":"2024-08-26T00:01:33.595021+0000","last_clean":"2024-08-26T00:01:33.595021+0000","last_became_active":"2024-08-26T00:00:29.367183+0000","last_became_peered":"2024-08-26T00:00:29.367183+0000","last_unstale":"2024-08-26T00:01:33.595021+0000","last_undegraded":"2024-08-26T00:01:33.595021+0000","last_fullsized":"2024-08-26T00:01:33.595021+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:05:53.736139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596931+0000","last_change":"2024-08-26T00:00:29.356751+0000","last_active":"2024-08-26T00:01:33.596931+0000","last_peered":"2024-08-26T00:01:33.596931+0000","last_clean":"2024-08-26T00:01:33.596931+0000","last_became_active":"2024-08-26T00:00:29.356291+0000","last_became_peered":"2024-08-26T00:00:29.356291+0000","last_unstale":"2024-08-26T00:01:33.596931+0000","last_undegraded":"2024-08-26T00:01:33.596931+0000","last_fullsized":"2024-08-26T00:01:33.596931+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:32:50.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.592403+0000","last_change":"2024-08-26T00:00:29.356965+0000","last_active":"2024-08-26T00:01:33.592403+0000","last_peered":"2024-08-26T00:01:33.592403+0000","last_clean":"2024-08-26T00:01:33.592403+0000","last_became_active":"2024-08-26T00:00:29.356588+0000","last_became_peered":"2024-08-26T00:00:29.356588+0000","last_unstale":"2024-08-26T00:01:33.592403+0000","last_undegraded":"2024-08-26T00:01:33.592403+0000","last_fullsized":"2024-08-26T00:01:33.592403+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:02:25.833139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598579+0000","last_change":"2024-08-26T00:00:29.352304+0000","last_active":"2024-08-26T00:01:33.598579+0000","last_peered":"2024-08-26T00:01:33.598579+0000","last_clean":"2024-08-26T00:01:33.598579+0000","last_became_active":"2024-08-26T00:00:29.351981+0000","last_became_peered":"2024-08-26T00:00:29.351981+0000","last_unstale":"2024-08-26T00:01:33.598579+0000","last_undegraded":"2024-08-26T00:01:33.598579+0000","last_fullsized":"2024-08-26T00:01:33.598579+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:06:29.105905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.592678+0000","last_change":"2024-08-26T00:00:29.354424+0000","last_active":"2024-08-26T00:01:33.592678+0000","last_peered":"2024-08-26T00:01:33.592678+0000","last_clean":"2024-08-26T00:01:33.592678+0000","last_became_active":"2024-08-26T00:00:29.352687+0000","last_became_peered":"2024-08-26T00:00:29.352687+0000","last_unstale":"2024-08-26T00:01:33.592678+0000","last_undegraded":"2024-08-26T00:01:33.592678+0000","last_fullsized":"2024-08-26T00:01:33.592678+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:26:21.769928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.597237+0000","last_change":"2024-08-26T00:00:29.355680+0000","last_active":"2024-08-26T00:01:33.597237+0000","last_peered":"2024-08-26T00:01:33.597237+0000","last_clean":"2024-08-26T00:01:33.597237+0000","last_became_active":"2024-08-26T00:00:29.355335+0000","last_became_peered":"2024-08-26T00:00:29.355335+0000","last_unstale":"2024-08-26T00:01:33.597237+0000","last_undegraded":"2024-08-26T00:01:33.597237+0000","last_fullsized":"2024-08-26T00:01:33.597237+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:16:04.085892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595578+0000","last_change":"2024-08-26T00:00:29.357564+0000","last_active":"2024-08-26T00:01:33.595578+0000","last_peered":"2024-08-26T00:01:33.595578+0000","last_clean":"2024-08-26T00:01:33.595578+0000","last_became_active":"2024-08-26T00:00:29.357215+0000","last_became_peered":"2024-08-26T00:00:29.357215+0000","last_unstale":"2024-08-26T00:01:33.595578+0000","last_undegraded":"2024-08-26T00:01:33.595578+0000","last_fullsized":"2024-08-26T00:01:33.595578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:47:32.969629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.594981+0000","last_change":"2024-08-26T00:00:29.368272+0000","last_active":"2024-08-26T00:01:33.594981+0000","last_peered":"2024-08-26T00:01:33.594981+0000","last_clean":"2024-08-26T00:01:33.594981+0000","last_became_active":"2024-08-26T00:00:29.367920+0000","last_became_peered":"2024-08-26T00:00:29.367920+0000","last_unstale":"2024-08-26T00:01:33.594981+0000","last_undegraded":"2024-08-26T00:01:33.594981+0000","last_fullsized":"2024-08-26T00:01:33.594981+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:35:19.373782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598524+0000","last_change":"2024-08-26T00:00:29.371609+0000","last_active":"2024-08-26T00:01:33.598524+0000","last_peered":"2024-08-26T00:01:33.598524+0000","last_clean":"2024-08-26T00:01:33.598524+0000","last_became_active":"2024-08-26T00:00:29.371199+0000","last_became_peered":"2024-08-26T00:00:29.371199+0000","last_unstale":"2024-08-26T00:01:33.598524+0000","last_undegraded":"2024-08-26T00:01:33.598524+0000","last_fullsized":"2024-08-26T00:01:33.598524+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:03:43.542718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595387+0000","last_change":"2024-08-26T00:00:29.362222+0000","last_active":"2024-08-26T00:01:33.595387+0000","last_peered":"2024-08-26T00:01:33.595387+0000","last_clean":"2024-08-26T00:01:33.595387+0000","last_became_active":"2024-08-26T00:00:29.361767+0000","last_became_peered":"2024-08-26T00:00:29.361767+0000","last_unstale":"2024-08-26T00:01:33.595387+0000","last_undegraded":"2024-08-26T00:01:33.595387+0000","last_fullsized":"2024-08-26T00:01:33.595387+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:42:17.032034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595925+0000","last_change":"2024-08-26T00:00:29.357997+0000","last_active":"2024-08-26T00:01:33.595925+0000","last_peered":"2024-08-26T00:01:33.595925+0000","last_clean":"2024-08-26T00:01:33.595925+0000","last_became_active":"2024-08-26T00:00:29.357693+0000","last_became_peered":"2024-08-26T00:00:29.357693+0000","last_unstale":"2024-08-26T00:01:33.595925+0000","last_undegraded":"2024-08-26T00:01:33.595925+0000","last_fullsized":"2024-08-26T00:01:33.595925+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:02:49.074234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.594739+0000","last_change":"2024-08-26T00:00:29.358305+0000","last_active":"2024-08-26T00:01:33.594739+0000","last_peered":"2024-08-26T00:01:33.594739+0000","last_clean":"2024-08-26T00:01:33.594739+0000","last_became_active":"2024-08-26T00:00:29.357928+0000","last_became_peered":"2024-08-26T00:00:29.357928+0000","last_unstale":"2024-08-26T00:01:33.594739+0000","last_undegraded":"2024-08-26T00:01:33.594739+0000","last_fullsized":"2024-08-26T00:01:33.594739+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:34:47.609170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598476+0000","last_change":"2024-08-26T00:00:29.357931+0000","last_active":"2024-08-26T00:01:33.598476+0000","last_peered":"2024-08-26T00:01:33.598476+0000","last_clean":"2024-08-26T00:01:33.598476+0000","last_became_active":"2024-08-26T00:00:29.357408+0000","last_became_peered":"2024-08-26T00:00:29.357408+0000","last_unstale":"2024-08-26T00:01:33.598476+0000","last_undegraded":"2024-08-26T00:01:33.598476+0000","last_fullsized":"2024-08-26T00:01:33.598476+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:21:10.230267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'5","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:36.486995+0000","last_change":"2024-08-26T00:00:26.993942+0000","last_active":"2024-08-26T00:01:36.486995+0000","last_peered":"2024-08-26T00:01:36.486995+0000","last_clean":"2024-08-26T00:01:36.486995+0000","last_became_active":"2024-08-26T00:00:26.993136+0000","last_became_peered":"2024-08-26T00:00:26.993136+0000","last_unstale":"2024-08-26T00:01:36.486995+0000","last_undegraded":"2024-08-26T00:01:36.486995+0000","last_fullsized":"2024-08-26T00:01:36.486995+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:30:31.890643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599957+0000","last_change":"2024-08-26T00:00:29.351174+0000","last_active":"2024-08-26T00:01:33.599957+0000","last_peered":"2024-08-26T00:01:33.599957+0000","last_clean":"2024-08-26T00:01:33.599957+0000","last_became_active":"2024-08-26T00:00:29.350758+0000","last_became_peered":"2024-08-26T00:00:29.350758+0000","last_unstale":"2024-08-26T00:01:33.599957+0000","last_undegraded":"2024-08-26T00:01:33.599957+0000","last_fullsized":"2024-08-26T00:01:33.599957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:02:56.986251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.593069+0000","last_change":"2024-08-26T00:00:26.991547+0000","last_active":"2024-08-26T00:01:33.593069+0000","last_peered":"2024-08-26T00:01:33.593069+0000","last_clean":"2024-08-26T00:01:33.593069+0000","last_became_active":"2024-08-26T00:00:26.991120+0000","last_became_peered":"2024-08-26T00:00:26.991120+0000","last_unstale":"2024-08-26T00:01:33.593069+0000","last_undegraded":"2024-08-26T00:01:33.593069+0000","last_fullsized":"2024-08-26T00:01:33.593069+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:42:12.381882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.594735+0000","last_change":"2024-08-26T00:00:26.988477+0000","last_active":"2024-08-26T00:01:33.594735+0000","last_peered":"2024-08-26T00:01:33.594735+0000","last_clean":"2024-08-26T00:01:33.594735+0000","last_became_active":"2024-08-26T00:00:26.988180+0000","last_became_peered":"2024-08-26T00:00:26.988180+0000","last_unstale":"2024-08-26T00:01:33.594735+0000","last_undegraded":"2024-08-26T00:01:33.594735+0000","last_fullsized":"2024-08-26T00:01:33.594735+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:00:35.586628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.592403+0000","last_change":"2024-08-26T00:00:29.360687+0000","last_active":"2024-08-26T00:01:33.592403+0000","last_peered":"2024-08-26T00:01:33.592403+0000","last_clean":"2024-08-26T00:01:33.592403+0000","last_became_active":"2024-08-26T00:00:29.358427+0000","last_became_peered":"2024-08-26T00:00:29.358427+0000","last_unstale":"2024-08-26T00:01:33.592403+0000","last_undegraded":"2024-08-26T00:01:33.592403+0000","last_fullsized":"2024-08-26T00:01:33.592403+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:15:41.175510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599569+0000","last_change":"2024-08-26T00:00:26.995054+0000","last_active":"2024-08-26T00:01:33.599569+0000","last_peered":"2024-08-26T00:01:33.599569+0000","last_clean":"2024-08-26T00:01:33.599569+0000","last_became_active":"2024-08-26T00:00:26.994742+0000","last_became_peered":"2024-08-26T00:00:26.994742+0000","last_unstale":"2024-08-26T00:01:33.599569+0000","last_undegraded":"2024-08-26T00:01:33.599569+0000","last_fullsized":"2024-08-26T00:01:33.599569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:02:30.509497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599454+0000","last_change":"2024-08-26T00:00:29.352343+0000","last_active":"2024-08-26T00:01:33.599454+0000","last_peered":"2024-08-26T00:01:33.599454+0000","last_clean":"2024-08-26T00:01:33.599454+0000","last_became_active":"2024-08-26T00:00:29.352036+0000","last_became_peered":"2024-08-26T00:00:29.352036+0000","last_unstale":"2024-08-26T00:01:33.599454+0000","last_undegraded":"2024-08-26T00:01:33.599454+0000","last_fullsized":"2024-08-26T00:01:33.599454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:28:14.399870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:35.485036+0000","last_change":"2024-08-26T00:00:26.989828+0000","last_active":"2024-08-26T00:01:35.485036+0000","last_peered":"2024-08-26T00:01:35.485036+0000","last_clean":"2024-08-26T00:01:35.485036+0000","last_became_active":"2024-08-26T00:00:26.989365+0000","last_became_peered":"2024-08-26T00:00:26.989365+0000","last_unstale":"2024-08-26T00:01:35.485036+0000","last_undegraded":"2024-08-26T00:01:35.485036+0000","last_fullsized":"2024-08-26T00:01:35.485036+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:00:40.821500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596940+0000","last_change":"2024-08-26T00:00:29.359506+0000","last_active":"2024-08-26T00:01:33.596940+0000","last_peered":"2024-08-26T00:01:33.596940+0000","last_clean":"2024-08-26T00:01:33.596940+0000","last_became_active":"2024-08-26T00:00:29.359042+0000","last_became_peered":"2024-08-26T00:00:29.359042+0000","last_unstale":"2024-08-26T00:01:33.596940+0000","last_undegraded":"2024-08-26T00:01:33.596940+0000","last_fullsized":"2024-08-26T00:01:33.596940+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:38:34.661823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595861+0000","last_change":"2024-08-26T00:00:26.994272+0000","last_active":"2024-08-26T00:01:33.595861+0000","last_peered":"2024-08-26T00:01:33.595861+0000","last_clean":"2024-08-26T00:01:33.595861+0000","last_became_active":"2024-08-26T00:00:26.993769+0000","last_became_peered":"2024-08-26T00:00:26.993769+0000","last_unstale":"2024-08-26T00:01:33.595861+0000","last_undegraded":"2024-08-26T00:01:33.595861+0000","last_fullsized":"2024-08-26T00:01:33.595861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:03:39.816595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599305+0000","last_change":"2024-08-26T00:00:29.372236+0000","last_active":"2024-08-26T00:01:33.599305+0000","last_peered":"2024-08-26T00:01:33.599305+0000","last_clean":"2024-08-26T00:01:33.599305+0000","last_became_active":"2024-08-26T00:00:29.371632+0000","last_became_peered":"2024-08-26T00:00:29.371632+0000","last_unstale":"2024-08-26T00:01:33.599305+0000","last_undegraded":"2024-08-26T00:01:33.599305+0000","last_fullsized":"2024-08-26T00:01:33.599305+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:46:10.735550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598661+0000","last_change":"2024-08-26T00:00:27.080074+0000","last_active":"2024-08-26T00:01:33.598661+0000","last_peered":"2024-08-26T00:01:33.598661+0000","last_clean":"2024-08-26T00:01:33.598661+0000","last_became_active":"2024-08-26T00:00:27.079646+0000","last_became_peered":"2024-08-26T00:00:27.079646+0000","last_unstale":"2024-08-26T00:01:33.598661+0000","last_undegraded":"2024-08-26T00:01:33.598661+0000","last_fullsized":"2024-08-26T00:01:33.598661+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:22:42.677747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.600131+0000","last_change":"2024-08-26T00:01:33.600131+0000","last_active":"2024-08-26T00:01:33.600131+0000","last_peered":"2024-08-26T00:01:33.600131+0000","last_clean":"2024-08-26T00:01:33.600131+0000","last_became_active":"2024-08-26T00:01:33.599594+0000","last_became_peered":"2024-08-26T00:01:33.599594+0000","last_unstale":"2024-08-26T00:01:33.600131+0000","last_undegraded":"2024-08-26T00:01:33.600131+0000","last_fullsized":"2024-08-26T00:01:33.600131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:33:33.573513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'28","reported_seq":191,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:36.899917+0000","last_change":"2024-08-26T00:01:33.901247+0000","last_active":"2024-08-26T00:01:36.899917+0000","last_peered":"2024-08-26T00:01:36.899917+0000","last_clean":"2024-08-26T00:01:36.899917+0000","last_became_active":"2024-08-26T00:01:33.892141+0000","last_became_peered":"2024-08-26T00:01:33.892141+0000","last_unstale":"2024-08-26T00:01:36.899917+0000","last_undegraded":"2024-08-26T00:01:36.899917+0000","last_fullsized":"2024-08-26T00:01:36.899917+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:08:05.209223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60615,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":117,"num_write":29,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":60615,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599853+0000","last_change":"2024-08-26T00:00:29.356969+0000","last_active":"2024-08-26T00:01:33.599853+0000","last_peered":"2024-08-26T00:01:33.599853+0000","last_clean":"2024-08-26T00:01:33.599853+0000","last_became_active":"2024-08-26T00:00:29.356493+0000","last_became_peered":"2024-08-26T00:00:29.356493+0000","last_unstale":"2024-08-26T00:01:33.599853+0000","last_undegraded":"2024-08-26T00:01:33.599853+0000","last_fullsized":"2024-08-26T00:01:33.599853+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:42:29.663933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596334+0000","last_change":"2024-08-26T00:00:26.993733+0000","last_active":"2024-08-26T00:01:33.596334+0000","last_peered":"2024-08-26T00:01:33.596334+0000","last_clean":"2024-08-26T00:01:33.596334+0000","last_became_active":"2024-08-26T00:00:26.991196+0000","last_became_peered":"2024-08-26T00:00:26.991196+0000","last_unstale":"2024-08-26T00:01:33.596334+0000","last_undegraded":"2024-08-26T00:01:33.596334+0000","last_fullsized":"2024-08-26T00:01:33.596334+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:53:49.056228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.594788+0000","last_change":"2024-08-26T00:00:29.363095+0000","last_active":"2024-08-26T00:01:33.594788+0000","last_peered":"2024-08-26T00:01:33.594788+0000","last_clean":"2024-08-26T00:01:33.594788+0000","last_became_active":"2024-08-26T00:00:29.361374+0000","last_became_peered":"2024-08-26T00:00:29.361374+0000","last_unstale":"2024-08-26T00:01:33.594788+0000","last_undegraded":"2024-08-26T00:01:33.594788+0000","last_fullsized":"2024-08-26T00:01:33.594788+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:30:34.072712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598243+0000","last_change":"2024-08-26T00:00:26.993920+0000","last_active":"2024-08-26T00:01:33.598243+0000","last_peered":"2024-08-26T00:01:33.598243+0000","last_clean":"2024-08-26T00:01:33.598243+0000","last_became_active":"2024-08-26T00:00:26.993578+0000","last_became_peered":"2024-08-26T00:00:26.993578+0000","last_unstale":"2024-08-26T00:01:33.598243+0000","last_undegraded":"2024-08-26T00:01:33.598243+0000","last_fullsized":"2024-08-26T00:01:33.598243+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:29:49.751384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595562+0000","last_change":"2024-08-26T00:00:29.362535+0000","last_active":"2024-08-26T00:01:33.595562+0000","last_peered":"2024-08-26T00:01:33.595562+0000","last_clean":"2024-08-26T00:01:33.595562+0000","last_became_active":"2024-08-26T00:00:29.362167+0000","last_became_peered":"2024-08-26T00:00:29.362167+0000","last_unstale":"2024-08-26T00:01:33.595562+0000","last_undegraded":"2024-08-26T00:01:33.595562+0000","last_fullsized":"2024-08-26T00:01:33.595562+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:21:54.020323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'4","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:34.483821+0000","last_change":"2024-08-26T00:00:26.993988+0000","last_active":"2024-08-26T00:01:34.483821+0000","last_peered":"2024-08-26T00:01:34.483821+0000","last_clean":"2024-08-26T00:01:34.483821+0000","last_became_active":"2024-08-26T00:00:26.993485+0000","last_became_peered":"2024-08-26T00:00:26.993485+0000","last_unstale":"2024-08-26T00:01:34.483821+0000","last_undegraded":"2024-08-26T00:01:34.483821+0000","last_fullsized":"2024-08-26T00:01:34.483821+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:46:29.475574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":977,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599944+0000","last_change":"2024-08-26T00:01:33.599944+0000","last_active":"2024-08-26T00:01:33.599944+0000","last_peered":"2024-08-26T00:01:33.599944+0000","last_clean":"2024-08-26T00:01:33.599944+0000","last_became_active":"2024-08-26T00:01:33.599457+0000","last_became_peered":"2024-08-26T00:01:33.599457+0000","last_unstale":"2024-08-26T00:01:33.599944+0000","last_undegraded":"2024-08-26T00:01:33.599944+0000","last_fullsized":"2024-08-26T00:01:33.599944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:12:33.747334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598056+0000","last_change":"2024-08-26T00:00:27.077517+0000","last_active":"2024-08-26T00:01:33.598056+0000","last_peered":"2024-08-26T00:01:33.598056+0000","last_clean":"2024-08-26T00:01:33.598056+0000","last_became_active":"2024-08-26T00:00:27.077083+0000","last_became_peered":"2024-08-26T00:00:27.077083+0000","last_unstale":"2024-08-26T00:01:33.598056+0000","last_undegraded":"2024-08-26T00:01:33.598056+0000","last_fullsized":"2024-08-26T00:01:33.598056+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:27:43.522233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598763+0000","last_change":"2024-08-26T00:00:29.355532+0000","last_active":"2024-08-26T00:01:33.598763+0000","last_peered":"2024-08-26T00:01:33.598763+0000","last_clean":"2024-08-26T00:01:33.598763+0000","last_became_active":"2024-08-26T00:00:29.355211+0000","last_became_peered":"2024-08-26T00:00:29.355211+0000","last_unstale":"2024-08-26T00:01:33.598763+0000","last_undegraded":"2024-08-26T00:01:33.598763+0000","last_fullsized":"2024-08-26T00:01:33.598763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:08:51.419634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598596+0000","last_change":"2024-08-26T00:00:26.992613+0000","last_active":"2024-08-26T00:01:33.598596+0000","last_peered":"2024-08-26T00:01:33.598596+0000","last_clean":"2024-08-26T00:01:33.598596+0000","last_became_active":"2024-08-26T00:00:26.992137+0000","last_became_peered":"2024-08-26T00:00:26.992137+0000","last_unstale":"2024-08-26T00:01:33.598596+0000","last_undegraded":"2024-08-26T00:01:33.598596+0000","last_fullsized":"2024-08-26T00:01:33.598596+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:30:32.586859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.594985+0000","last_change":"2024-08-26T00:00:29.362342+0000","last_active":"2024-08-26T00:01:33.594985+0000","last_peered":"2024-08-26T00:01:33.594985+0000","last_clean":"2024-08-26T00:01:33.594985+0000","last_became_active":"2024-08-26T00:00:29.362017+0000","last_became_peered":"2024-08-26T00:00:29.362017+0000","last_unstale":"2024-08-26T00:01:33.594985+0000","last_undegraded":"2024-08-26T00:01:33.594985+0000","last_fullsized":"2024-08-26T00:01:33.594985+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:01:55.507893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595105+0000","last_change":"2024-08-26T00:00:26.989977+0000","last_active":"2024-08-26T00:01:33.595105+0000","last_peered":"2024-08-26T00:01:33.595105+0000","last_clean":"2024-08-26T00:01:33.595105+0000","last_became_active":"2024-08-26T00:00:26.989535+0000","last_became_peered":"2024-08-26T00:00:26.989535+0000","last_unstale":"2024-08-26T00:01:33.595105+0000","last_undegraded":"2024-08-26T00:01:33.595105+0000","last_fullsized":"2024-08-26T00:01:33.595105+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:33:20.347005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596291+0000","last_change":"2024-08-26T00:00:29.355928+0000","last_active":"2024-08-26T00:01:33.596291+0000","last_peered":"2024-08-26T00:01:33.596291+0000","last_clean":"2024-08-26T00:01:33.596291+0000","last_became_active":"2024-08-26T00:00:29.355546+0000","last_became_peered":"2024-08-26T00:00:29.355546+0000","last_unstale":"2024-08-26T00:01:33.596291+0000","last_undegraded":"2024-08-26T00:01:33.596291+0000","last_fullsized":"2024-08-26T00:01:33.596291+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:15:06.116141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598775+0000","last_change":"2024-08-26T00:00:26.992523+0000","last_active":"2024-08-26T00:01:33.598775+0000","last_peered":"2024-08-26T00:01:33.598775+0000","last_clean":"2024-08-26T00:01:33.598775+0000","last_became_active":"2024-08-26T00:00:26.992193+0000","last_became_peered":"2024-08-26T00:00:26.992193+0000","last_unstale":"2024-08-26T00:01:33.598775+0000","last_undegraded":"2024-08-26T00:01:33.598775+0000","last_fullsized":"2024-08-26T00:01:33.598775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:34:21.879373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596367+0000","last_change":"2024-08-26T00:00:29.358826+0000","last_active":"2024-08-26T00:01:33.596367+0000","last_peered":"2024-08-26T00:01:33.596367+0000","last_clean":"2024-08-26T00:01:33.596367+0000","last_became_active":"2024-08-26T00:00:29.358478+0000","last_became_peered":"2024-08-26T00:00:29.358478+0000","last_unstale":"2024-08-26T00:01:33.596367+0000","last_undegraded":"2024-08-26T00:01:33.596367+0000","last_fullsized":"2024-08-26T00:01:33.596367+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:30:39.484666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596872+0000","last_change":"2024-08-26T00:00:27.077599+0000","last_active":"2024-08-26T00:01:33.596872+0000","last_peered":"2024-08-26T00:01:33.596872+0000","last_clean":"2024-08-26T00:01:33.596872+0000","last_became_active":"2024-08-26T00:00:27.077094+0000","last_became_peered":"2024-08-26T00:00:27.077094+0000","last_unstale":"2024-08-26T00:01:33.596872+0000","last_undegraded":"2024-08-26T00:01:33.596872+0000","last_fullsized":"2024-08-26T00:01:33.596872+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:06:47.966097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595990+0000","last_change":"2024-08-26T00:00:29.355243+0000","last_active":"2024-08-26T00:01:33.595990+0000","last_peered":"2024-08-26T00:01:33.595990+0000","last_clean":"2024-08-26T00:01:33.595990+0000","last_became_active":"2024-08-26T00:00:29.354151+0000","last_became_peered":"2024-08-26T00:00:29.354151+0000","last_unstale":"2024-08-26T00:01:33.595990+0000","last_undegraded":"2024-08-26T00:01:33.595990+0000","last_fullsized":"2024-08-26T00:01:33.595990+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:00:12.520736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":334,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596182+0000","last_change":"2024-08-25T23:59:16.227980+0000","last_active":"2024-08-26T00:01:33.596182+0000","last_peered":"2024-08-26T00:01:33.596182+0000","last_clean":"2024-08-26T00:01:33.596182+0000","last_became_active":"2024-08-25T23:59:16.227550+0000","last_became_peered":"2024-08-25T23:59:16.227550+0000","last_unstale":"2024-08-26T00:01:33.596182+0000","last_undegraded":"2024-08-26T00:01:33.596182+0000","last_fullsized":"2024-08-26T00:01:33.596182+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-25T23:55:51.247914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-25T23:55:51.247914+0000","last_clean_scrub_stamp":"2024-08-25T23:55:51.247914+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:39:34.184312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.890555+0000","last_change":"2024-08-26T00:00:26.992675+0000","last_active":"2024-08-26T00:01:33.890555+0000","last_peered":"2024-08-26T00:01:33.890555+0000","last_clean":"2024-08-26T00:01:33.890555+0000","last_became_active":"2024-08-26T00:00:26.992322+0000","last_became_peered":"2024-08-26T00:00:26.992322+0000","last_unstale":"2024-08-26T00:01:33.890555+0000","last_undegraded":"2024-08-26T00:01:33.890555+0000","last_fullsized":"2024-08-26T00:01:33.890555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:38:26.016220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.592613+0000","last_change":"2024-08-26T00:00:29.362617+0000","last_active":"2024-08-26T00:01:33.592613+0000","last_peered":"2024-08-26T00:01:33.592613+0000","last_clean":"2024-08-26T00:01:33.592613+0000","last_became_active":"2024-08-26T00:00:29.362245+0000","last_became_peered":"2024-08-26T00:00:29.362245+0000","last_unstale":"2024-08-26T00:01:33.592613+0000","last_undegraded":"2024-08-26T00:01:33.592613+0000","last_fullsized":"2024-08-26T00:01:33.592613+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:30:12.309213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.895296+0000","last_change":"2024-08-26T00:01:33.895296+0000","last_active":"2024-08-26T00:01:33.895296+0000","last_peered":"2024-08-26T00:01:33.895296+0000","last_clean":"2024-08-26T00:01:33.895296+0000","last_became_active":"2024-08-26T00:01:33.891598+0000","last_became_peered":"2024-08-26T00:01:33.891598+0000","last_unstale":"2024-08-26T00:01:33.895296+0000","last_undegraded":"2024-08-26T00:01:33.895296+0000","last_fullsized":"2024-08-26T00:01:33.895296+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:26:31.794735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.601137+0000","last_change":"2024-08-26T00:01:33.601137+0000","last_active":"2024-08-26T00:01:33.601137+0000","last_peered":"2024-08-26T00:01:33.601137+0000","last_clean":"2024-08-26T00:01:33.601137+0000","last_became_active":"2024-08-26T00:01:33.600397+0000","last_became_peered":"2024-08-26T00:01:33.600397+0000","last_unstale":"2024-08-26T00:01:33.601137+0000","last_undegraded":"2024-08-26T00:01:33.601137+0000","last_fullsized":"2024-08-26T00:01:33.601137+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:42:21.507880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:35.484716+0000","last_change":"2024-08-26T00:00:27.077840+0000","last_active":"2024-08-26T00:01:35.484716+0000","last_peered":"2024-08-26T00:01:35.484716+0000","last_clean":"2024-08-26T00:01:35.484716+0000","last_became_active":"2024-08-26T00:00:27.077355+0000","last_became_peered":"2024-08-26T00:00:27.077355+0000","last_unstale":"2024-08-26T00:01:35.484716+0000","last_undegraded":"2024-08-26T00:01:35.484716+0000","last_fullsized":"2024-08-26T00:01:35.484716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:03:30.718962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.603558+0000","last_change":"2024-08-26T00:01:33.603558+0000","last_active":"2024-08-26T00:01:33.603558+0000","last_peered":"2024-08-26T00:01:33.603558+0000","last_clean":"2024-08-26T00:01:33.603558+0000","last_became_active":"2024-08-26T00:01:33.603177+0000","last_became_peered":"2024-08-26T00:01:33.603177+0000","last_unstale":"2024-08-26T00:01:33.603558+0000","last_undegraded":"2024-08-26T00:01:33.603558+0000","last_fullsized":"2024-08-26T00:01:33.603558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:21:33.913812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595978+0000","last_change":"2024-08-26T00:00:26.994187+0000","last_active":"2024-08-26T00:01:33.595978+0000","last_peered":"2024-08-26T00:01:33.595978+0000","last_clean":"2024-08-26T00:01:33.595978+0000","last_became_active":"2024-08-26T00:00:26.993699+0000","last_became_peered":"2024-08-26T00:00:26.993699+0000","last_unstale":"2024-08-26T00:01:33.595978+0000","last_undegraded":"2024-08-26T00:01:33.595978+0000","last_fullsized":"2024-08-26T00:01:33.595978+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:19:50.412724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.593191+0000","last_change":"2024-08-26T00:00:29.364507+0000","last_active":"2024-08-26T00:01:33.593191+0000","last_peered":"2024-08-26T00:01:33.593191+0000","last_clean":"2024-08-26T00:01:33.593191+0000","last_became_active":"2024-08-26T00:00:29.364129+0000","last_became_peered":"2024-08-26T00:00:29.364129+0000","last_unstale":"2024-08-26T00:01:33.593191+0000","last_undegraded":"2024-08-26T00:01:33.593191+0000","last_fullsized":"2024-08-26T00:01:33.593191+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:17:36.837206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599893+0000","last_change":"2024-08-26T00:00:27.076977+0000","last_active":"2024-08-26T00:01:33.599893+0000","last_peered":"2024-08-26T00:01:33.599893+0000","last_clean":"2024-08-26T00:01:33.599893+0000","last_became_active":"2024-08-26T00:00:27.076524+0000","last_became_peered":"2024-08-26T00:00:27.076524+0000","last_unstale":"2024-08-26T00:01:33.599893+0000","last_undegraded":"2024-08-26T00:01:33.599893+0000","last_fullsized":"2024-08-26T00:01:33.599893+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:22:21.820009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.593483+0000","last_change":"2024-08-26T00:00:29.363880+0000","last_active":"2024-08-26T00:01:33.593483+0000","last_peered":"2024-08-26T00:01:33.593483+0000","last_clean":"2024-08-26T00:01:33.593483+0000","last_became_active":"2024-08-26T00:00:29.363475+0000","last_became_peered":"2024-08-26T00:00:29.363475+0000","last_unstale":"2024-08-26T00:01:33.593483+0000","last_undegraded":"2024-08-26T00:01:33.593483+0000","last_fullsized":"2024-08-26T00:01:33.593483+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:30:55.875922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.606790+0000","last_change":"2024-08-26T00:01:33.606353+0000","last_active":"2024-08-26T00:01:33.606790+0000","last_peered":"2024-08-26T00:01:33.606790+0000","last_clean":"2024-08-26T00:01:33.606790+0000","last_became_active":"2024-08-26T00:01:33.599903+0000","last_became_peered":"2024-08-26T00:01:33.599903+0000","last_unstale":"2024-08-26T00:01:33.606790+0000","last_undegraded":"2024-08-26T00:01:33.606790+0000","last_fullsized":"2024-08-26T00:01:33.606790+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:02:09.033915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.594999+0000","last_change":"2024-08-26T00:00:29.360285+0000","last_active":"2024-08-26T00:01:33.594999+0000","last_peered":"2024-08-26T00:01:33.594999+0000","last_clean":"2024-08-26T00:01:33.594999+0000","last_became_active":"2024-08-26T00:00:29.359879+0000","last_became_peered":"2024-08-26T00:00:29.359879+0000","last_unstale":"2024-08-26T00:01:33.594999+0000","last_undegraded":"2024-08-26T00:01:33.594999+0000","last_fullsized":"2024-08-26T00:01:33.594999+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:49:10.691817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'12","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599849+0000","last_change":"2024-08-26T00:00:26.990419+0000","last_active":"2024-08-26T00:01:33.599849+0000","last_peered":"2024-08-26T00:01:33.599849+0000","last_clean":"2024-08-26T00:01:33.599849+0000","last_became_active":"2024-08-26T00:00:26.990052+0000","last_became_peered":"2024-08-26T00:00:26.990052+0000","last_unstale":"2024-08-26T00:01:33.599849+0000","last_undegraded":"2024-08-26T00:01:33.599849+0000","last_fullsized":"2024-08-26T00:01:33.599849+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:27:41.229418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.592768+0000","last_change":"2024-08-26T00:00:29.354671+0000","last_active":"2024-08-26T00:01:33.592768+0000","last_peered":"2024-08-26T00:01:33.592768+0000","last_clean":"2024-08-26T00:01:33.592768+0000","last_became_active":"2024-08-26T00:00:29.354071+0000","last_became_peered":"2024-08-26T00:00:29.354071+0000","last_unstale":"2024-08-26T00:01:33.592768+0000","last_undegraded":"2024-08-26T00:01:33.592768+0000","last_fullsized":"2024-08-26T00:01:33.592768+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:50:09.097757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.890786+0000","last_change":"2024-08-26T00:00:26.991622+0000","last_active":"2024-08-26T00:01:33.890786+0000","last_peered":"2024-08-26T00:01:33.890786+0000","last_clean":"2024-08-26T00:01:33.890786+0000","last_became_active":"2024-08-26T00:00:26.991244+0000","last_became_peered":"2024-08-26T00:00:26.991244+0000","last_unstale":"2024-08-26T00:01:33.890786+0000","last_undegraded":"2024-08-26T00:01:33.890786+0000","last_fullsized":"2024-08-26T00:01:33.890786+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:58:25.676985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598947+0000","last_change":"2024-08-26T00:00:29.367033+0000","last_active":"2024-08-26T00:01:33.598947+0000","last_peered":"2024-08-26T00:01:33.598947+0000","last_clean":"2024-08-26T00:01:33.598947+0000","last_became_active":"2024-08-26T00:00:29.365572+0000","last_became_peered":"2024-08-26T00:00:29.365572+0000","last_unstale":"2024-08-26T00:01:33.598947+0000","last_undegraded":"2024-08-26T00:01:33.598947+0000","last_fullsized":"2024-08-26T00:01:33.598947+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:16:49.116721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596764+0000","last_change":"2024-08-26T00:00:27.076562+0000","last_active":"2024-08-26T00:01:33.596764+0000","last_peered":"2024-08-26T00:01:33.596764+0000","last_clean":"2024-08-26T00:01:33.596764+0000","last_became_active":"2024-08-26T00:00:27.076163+0000","last_became_peered":"2024-08-26T00:00:27.076163+0000","last_unstale":"2024-08-26T00:01:33.596764+0000","last_undegraded":"2024-08-26T00:01:33.596764+0000","last_fullsized":"2024-08-26T00:01:33.596764+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:25:03.222457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.597865+0000","last_change":"2024-08-26T00:00:29.352787+0000","last_active":"2024-08-26T00:01:33.597865+0000","last_peered":"2024-08-26T00:01:33.597865+0000","last_clean":"2024-08-26T00:01:33.597865+0000","last_became_active":"2024-08-26T00:00:29.352429+0000","last_became_peered":"2024-08-26T00:00:29.352429+0000","last_unstale":"2024-08-26T00:01:33.597865+0000","last_undegraded":"2024-08-26T00:01:33.597865+0000","last_fullsized":"2024-08-26T00:01:33.597865+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:39:45.080372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.592534+0000","last_change":"2024-08-26T00:00:26.989778+0000","last_active":"2024-08-26T00:01:33.592534+0000","last_peered":"2024-08-26T00:01:33.592534+0000","last_clean":"2024-08-26T00:01:33.592534+0000","last_became_active":"2024-08-26T00:00:26.989433+0000","last_became_peered":"2024-08-26T00:00:26.989433+0000","last_unstale":"2024-08-26T00:01:33.592534+0000","last_undegraded":"2024-08-26T00:01:33.592534+0000","last_fullsized":"2024-08-26T00:01:33.592534+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:36:16.684252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.594871+0000","last_change":"2024-08-26T00:00:29.362705+0000","last_active":"2024-08-26T00:01:33.594871+0000","last_peered":"2024-08-26T00:01:33.594871+0000","last_clean":"2024-08-26T00:01:33.594871+0000","last_became_active":"2024-08-26T00:00:29.362341+0000","last_became_peered":"2024-08-26T00:00:29.362341+0000","last_unstale":"2024-08-26T00:01:33.594871+0000","last_undegraded":"2024-08-26T00:01:33.594871+0000","last_fullsized":"2024-08-26T00:01:33.594871+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:10:47.051351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.609432+0000","last_change":"2024-08-26T00:01:33.608894+0000","last_active":"2024-08-26T00:01:33.609432+0000","last_peered":"2024-08-26T00:01:33.609432+0000","last_clean":"2024-08-26T00:01:33.609432+0000","last_became_active":"2024-08-26T00:01:33.601976+0000","last_became_peered":"2024-08-26T00:01:33.601976+0000","last_unstale":"2024-08-26T00:01:33.609432+0000","last_undegraded":"2024-08-26T00:01:33.609432+0000","last_fullsized":"2024-08-26T00:01:33.609432+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:03:17.367456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.592926+0000","last_change":"2024-08-26T00:00:29.365553+0000","last_active":"2024-08-26T00:01:33.592926+0000","last_peered":"2024-08-26T00:01:33.592926+0000","last_clean":"2024-08-26T00:01:33.592926+0000","last_became_active":"2024-08-26T00:00:29.365215+0000","last_became_peered":"2024-08-26T00:00:29.365215+0000","last_unstale":"2024-08-26T00:01:33.592926+0000","last_undegraded":"2024-08-26T00:01:33.592926+0000","last_fullsized":"2024-08-26T00:01:33.592926+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:55:01.505530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598744+0000","last_change":"2024-08-26T00:00:26.995228+0000","last_active":"2024-08-26T00:01:33.598744+0000","last_peered":"2024-08-26T00:01:33.598744+0000","last_clean":"2024-08-26T00:01:33.598744+0000","last_became_active":"2024-08-26T00:00:26.994875+0000","last_became_peered":"2024-08-26T00:00:26.994875+0000","last_unstale":"2024-08-26T00:01:33.598744+0000","last_undegraded":"2024-08-26T00:01:33.598744+0000","last_fullsized":"2024-08-26T00:01:33.598744+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:27:21.110162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595486+0000","last_change":"2024-08-26T00:00:29.361598+0000","last_active":"2024-08-26T00:01:33.595486+0000","last_peered":"2024-08-26T00:01:33.595486+0000","last_clean":"2024-08-26T00:01:33.595486+0000","last_became_active":"2024-08-26T00:00:29.361237+0000","last_became_peered":"2024-08-26T00:00:29.361237+0000","last_unstale":"2024-08-26T00:01:33.595486+0000","last_undegraded":"2024-08-26T00:01:33.595486+0000","last_fullsized":"2024-08-26T00:01:33.595486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:21:30.126060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598556+0000","last_change":"2024-08-26T00:00:29.355240+0000","last_active":"2024-08-26T00:01:33.598556+0000","last_peered":"2024-08-26T00:01:33.598556+0000","last_clean":"2024-08-26T00:01:33.598556+0000","last_became_active":"2024-08-26T00:00:29.354165+0000","last_became_peered":"2024-08-26T00:00:29.354165+0000","last_unstale":"2024-08-26T00:01:33.598556+0000","last_undegraded":"2024-08-26T00:01:33.598556+0000","last_fullsized":"2024-08-26T00:01:33.598556+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:07:56.573032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598465+0000","last_change":"2024-08-26T00:00:26.992240+0000","last_active":"2024-08-26T00:01:33.598465+0000","last_peered":"2024-08-26T00:01:33.598465+0000","last_clean":"2024-08-26T00:01:33.598465+0000","last_became_active":"2024-08-26T00:00:26.991866+0000","last_became_peered":"2024-08-26T00:00:26.991866+0000","last_unstale":"2024-08-26T00:01:33.598465+0000","last_undegraded":"2024-08-26T00:01:33.598465+0000","last_fullsized":"2024-08-26T00:01:33.598465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:25:50.815151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596690+0000","last_change":"2024-08-26T00:00:29.370358+0000","last_active":"2024-08-26T00:01:33.596690+0000","last_peered":"2024-08-26T00:01:33.596690+0000","last_clean":"2024-08-26T00:01:33.596690+0000","last_became_active":"2024-08-26T00:00:29.369910+0000","last_became_peered":"2024-08-26T00:00:29.369910+0000","last_unstale":"2024-08-26T00:01:33.596690+0000","last_undegraded":"2024-08-26T00:01:33.596690+0000","last_fullsized":"2024-08-26T00:01:33.596690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:49:11.351575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599966+0000","last_change":"2024-08-26T00:00:26.989759+0000","last_active":"2024-08-26T00:01:33.599966+0000","last_peered":"2024-08-26T00:01:33.599966+0000","last_clean":"2024-08-26T00:01:33.599966+0000","last_became_active":"2024-08-26T00:00:26.989376+0000","last_became_peered":"2024-08-26T00:00:26.989376+0000","last_unstale":"2024-08-26T00:01:33.599966+0000","last_undegraded":"2024-08-26T00:01:33.599966+0000","last_fullsized":"2024-08-26T00:01:33.599966+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:44:36.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599277+0000","last_change":"2024-08-26T00:00:29.367050+0000","last_active":"2024-08-26T00:01:33.599277+0000","last_peered":"2024-08-26T00:01:33.599277+0000","last_clean":"2024-08-26T00:01:33.599277+0000","last_became_active":"2024-08-26T00:00:29.366737+0000","last_became_peered":"2024-08-26T00:00:29.366737+0000","last_unstale":"2024-08-26T00:01:33.599277+0000","last_undegraded":"2024-08-26T00:01:33.599277+0000","last_fullsized":"2024-08-26T00:01:33.599277+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:00:54.461716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.593249+0000","last_change":"2024-08-26T00:00:27.078078+0000","last_active":"2024-08-26T00:01:33.593249+0000","last_peered":"2024-08-26T00:01:33.593249+0000","last_clean":"2024-08-26T00:01:33.593249+0000","last_became_active":"2024-08-26T00:00:27.077036+0000","last_became_peered":"2024-08-26T00:00:27.077036+0000","last_unstale":"2024-08-26T00:01:33.593249+0000","last_undegraded":"2024-08-26T00:01:33.593249+0000","last_fullsized":"2024-08-26T00:01:33.593249+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:47:44.674548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.593125+0000","last_change":"2024-08-26T00:00:29.363867+0000","last_active":"2024-08-26T00:01:33.593125+0000","last_peered":"2024-08-26T00:01:33.593125+0000","last_clean":"2024-08-26T00:01:33.593125+0000","last_became_active":"2024-08-26T00:00:29.363556+0000","last_became_peered":"2024-08-26T00:00:29.363556+0000","last_unstale":"2024-08-26T00:01:33.593125+0000","last_undegraded":"2024-08-26T00:01:33.593125+0000","last_fullsized":"2024-08-26T00:01:33.593125+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:50:04.009177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.600007+0000","last_change":"2024-08-26T00:00:26.990557+0000","last_active":"2024-08-26T00:01:33.600007+0000","last_peered":"2024-08-26T00:01:33.600007+0000","last_clean":"2024-08-26T00:01:33.600007+0000","last_became_active":"2024-08-26T00:00:26.989945+0000","last_became_peered":"2024-08-26T00:00:26.989945+0000","last_unstale":"2024-08-26T00:01:33.600007+0000","last_undegraded":"2024-08-26T00:01:33.600007+0000","last_fullsized":"2024-08-26T00:01:33.600007+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:26:54.388359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64614,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":365,"num_read_kb":249,"num_write":164,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":60637,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":193842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645339,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":884736,"data_stored":426443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874271,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36888,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708264,"statfs":{"total":95995035648,"available":95957262336,"internally_reserved":0,"allocated":1576960,"data_stored":1078906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037797,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":426657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266731,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":892928,"data_stored":426555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495663,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40968,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704184,"statfs":{"total":95995035648,"available":95953084416,"internally_reserved":0,"allocated":1490944,"data_stored":1018505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626484,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":884736,"data_stored":426046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855418,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1503232,"data_stored":1017800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018941,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":958464,"data_stored":487487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247875,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":426357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444105,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":901120,"data_stored":427189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40436,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704716,"statfs":{"total":95995035648,"available":95953629184,"internally_reserved":0,"allocated":946176,"data_stored":486454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":905216,"data_stored":427317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-26T00:01:41.113 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph pg dump --format=json 2024-08-26T00:01:41.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:41 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:01:41.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:41 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:01:41.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:41 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:01:41.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:41 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:01:41.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:41 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:01:41.530 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:41.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:41 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:01:41.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:41 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:01:41.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:41 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:01:41.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:41 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:01:41.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:41 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:01:41.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:41 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:01:41.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:41 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:01:41.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:41 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:01:41.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:41 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:01:41.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:41 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:01:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.063+0000 7fd1caa00640 1 -- 172.21.15.42:0/3261605574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1c4107920 msgr2=0x7fd1c4107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.063+0000 7fd1caa00640 1 --2- 172.21.15.42:0/3261605574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1c4107920 0x7fd1c4107d00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009930 tx=0x7fd1b402a420 comp rx=0 tx=0).stop 2024-08-26T00:01:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.063+0000 7fd1caa00640 1 -- 172.21.15.42:0/3261605574 shutdown_connections 2024-08-26T00:01:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.063+0000 7fd1caa00640 1 --2- 172.21.15.42:0/3261605574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1c41022c0 0x7fd1c410e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.063+0000 7fd1caa00640 1 --2- 172.21.15.42:0/3261605574 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1c4101920 0x7fd1c4101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.063+0000 7fd1caa00640 1 --2- 172.21.15.42:0/3261605574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1c4107920 0x7fd1c4107d00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.063+0000 7fd1caa00640 1 -- 172.21.15.42:0/3261605574 >> 172.21.15.42:0/3261605574 conn(0x7fd1c40fd660 msgr2=0x7fd1c40ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.064+0000 7fd1caa00640 1 -- 172.21.15.42:0/3261605574 shutdown_connections 2024-08-26T00:01:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.064+0000 7fd1caa00640 1 -- 172.21.15.42:0/3261605574 wait complete. 2024-08-26T00:01:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.064+0000 7fd1caa00640 1 Processor -- start 2024-08-26T00:01:42.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.065+0000 7fd1caa00640 1 -- start start 2024-08-26T00:01:42.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.065+0000 7fd1caa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1c4101920 0x7fd1c419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:42.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.065+0000 7fd1caa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1c41022c0 0x7fd1c419a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:42.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.065+0000 7fd1caa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1c4107920 0x7fd1c419ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:42.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.065+0000 7fd1caa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c4111d20 con 0x7fd1c41022c0 2024-08-26T00:01:42.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.065+0000 7fd1caa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c4111ba0 con 0x7fd1c4101920 2024-08-26T00:01:42.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.065+0000 7fd1caa00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c4111ea0 con 0x7fd1c4107920 2024-08-26T00:01:42.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.065+0000 7fd1bb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1c41022c0 0x7fd1c419a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:42.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.065+0000 7fd1bb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1c41022c0 0x7fd1c419a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51582/0 (socket says 172.21.15.42:51582) 2024-08-26T00:01:42.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.065+0000 7fd1bb400640 1 -- 172.21.15.42:0/748549070 learned_addr learned my addr 172.21.15.42:0/748549070 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:42.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.065+0000 7fd1c3e00640 1 --2- 172.21.15.42:0/748549070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1c4101920 0x7fd1c419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:42.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.065+0000 7fd1c8a00640 1 --2- 172.21.15.42:0/748549070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1c4107920 0x7fd1c419ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:42.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.066+0000 7fd1bb400640 1 -- 172.21.15.42:0/748549070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1c4107920 msgr2=0x7fd1c419ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:42.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.066+0000 7fd1bb400640 1 --2- 172.21.15.42:0/748549070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1c4107920 0x7fd1c419ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:42.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.066+0000 7fd1bb400640 1 -- 172.21.15.42:0/748549070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1c4101920 msgr2=0x7fd1c419a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:42.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.066+0000 7fd1bb400640 1 --2- 172.21.15.42:0/748549070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1c4101920 0x7fd1c419a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:42.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.066+0000 7fd1bb400640 1 -- 172.21.15.42:0/748549070 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c419f3a0 con 0x7fd1c41022c0 2024-08-26T00:01:42.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.066+0000 7fd1c8a00640 1 --2- 172.21.15.42:0/748549070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1c4107920 0x7fd1c419ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:01:42.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.066+0000 7fd1bb400640 1 --2- 172.21.15.42:0/748549070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1c41022c0 0x7fd1c419a930 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00d950 tx=0x7fd1ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:42.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.066+0000 7fd1c1600640 1 -- 172.21.15.42:0/748549070 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac017030 con 0x7fd1c41022c0 2024-08-26T00:01:42.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.066+0000 7fd1c1600640 1 -- 172.21.15.42:0/748549070 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1ac004020 con 0x7fd1c41022c0 2024-08-26T00:01:42.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.066+0000 7fd1c1600640 1 -- 172.21.15.42:0/748549070 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac0047a0 con 0x7fd1c41022c0 2024-08-26T00:01:42.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.066+0000 7fd1caa00640 1 -- 172.21.15.42:0/748549070 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1c419f690 con 0x7fd1c41022c0 2024-08-26T00:01:42.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.066+0000 7fd1caa00640 1 -- 172.21.15.42:0/748549070 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1c41a6f70 con 0x7fd1c41022c0 2024-08-26T00:01:42.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.067+0000 7fd1caa00640 1 -- 172.21.15.42:0/748549070 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1c4101d80 con 0x7fd1c41022c0 2024-08-26T00:01:42.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.069+0000 7fd1c1600640 1 -- 172.21.15.42:0/748549070 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd1ac0041d0 con 0x7fd1c41022c0 2024-08-26T00:01:42.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.071+0000 7fd1c1600640 1 --2- 172.21.15.42:0/748549070 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd1a80a2c90 0x7fd1a80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:42.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.071+0000 7fd1c1600640 1 -- 172.21.15.42:0/748549070 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fd1ac0ceb80 con 0x7fd1c41022c0 2024-08-26T00:01:42.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.071+0000 7fd1c3e00640 1 --2- 172.21.15.42:0/748549070 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd1a80a2c90 0x7fd1a80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:42.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.072+0000 7fd1c3e00640 1 --2- 172.21.15.42:0/748549070 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd1a80a2c90 0x7fd1a80a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009900 tx=0x7fd1b40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:42.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.075+0000 7fd1c1600640 1 -- 172.21.15.42:0/748549070 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd1ac09b940 con 0x7fd1c41022c0 2024-08-26T00:01:42.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.262+0000 7fd1caa00640 1 -- 172.21.15.42:0/748549070 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd1c40ff3d0 con 0x7fd1a80a2c90 2024-08-26T00:01:42.264 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:42 smithi042 ceph-mon[17225]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-26T00:01:42.264 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:42 smithi042 ceph-mon[17225]: pgmap v314: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s; 7.4 KiB/s, 0 objects/s recovering 2024-08-26T00:01:42.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.268+0000 7fd1c1600640 1 -- 172.21.15.42:0/748549070 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258744 (secure 0 0 0) 0x7fd1c40ff3d0 con 0x7fd1a80a2c90 2024-08-26T00:01:42.274 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:01:42.275 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-08-26T00:01:42.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.272+0000 7fd1caa00640 1 -- 172.21.15.42:0/748549070 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd1a80a2c90 msgr2=0x7fd1a80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:42.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.272+0000 7fd1caa00640 1 --2- 172.21.15.42:0/748549070 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd1a80a2c90 0x7fd1a80a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009900 tx=0x7fd1b40058d0 comp rx=0 tx=0).stop 2024-08-26T00:01:42.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.273+0000 7fd1caa00640 1 -- 172.21.15.42:0/748549070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1c41022c0 msgr2=0x7fd1c419a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:42.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.273+0000 7fd1caa00640 1 --2- 172.21.15.42:0/748549070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1c41022c0 0x7fd1c419a930 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00d950 tx=0x7fd1ac00de10 comp rx=0 tx=0).stop 2024-08-26T00:01:42.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.273+0000 7fd1caa00640 1 -- 172.21.15.42:0/748549070 shutdown_connections 2024-08-26T00:01:42.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.273+0000 7fd1caa00640 1 --2- 172.21.15.42:0/748549070 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd1a80a2c90 0x7fd1a80a5150 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:42.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.273+0000 7fd1caa00640 1 --2- 172.21.15.42:0/748549070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1c4107920 0x7fd1c419ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:42.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.273+0000 7fd1caa00640 1 --2- 172.21.15.42:0/748549070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1c41022c0 0x7fd1c419a930 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:42.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.273+0000 7fd1caa00640 1 --2- 172.21.15.42:0/748549070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1c4101920 0x7fd1c419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:42.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.273+0000 7fd1caa00640 1 -- 172.21.15.42:0/748549070 >> 172.21.15.42:0/748549070 conn(0x7fd1c40fd660 msgr2=0x7fd1c40fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:42.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.273+0000 7fd1caa00640 1 -- 172.21.15.42:0/748549070 shutdown_connections 2024-08-26T00:01:42.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:42.273+0000 7fd1caa00640 1 -- 172.21.15.42:0/748549070 wait complete. 2024-08-26T00:01:42.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:42 smithi043 ceph-mon[22091]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-26T00:01:42.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:42 smithi043 ceph-mon[22091]: pgmap v314: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s; 7.4 KiB/s, 0 objects/s recovering 2024-08-26T00:01:42.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:42 smithi181 ceph-mon[22102]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-26T00:01:42.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:42 smithi181 ceph-mon[22102]: pgmap v314: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s; 7.4 KiB/s, 0 objects/s recovering 2024-08-26T00:01:42.987 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2024-08-26T00:01:40.508648+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655216,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":491,"num_read_kb":358,"num_write":347,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1241373,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":395052,"kb_used_data":12444,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124546772,"statfs":{"total":1151940427776,"available":1151535894528,"internally_reserved":0,"allocated":12742656,"data_stored":7075716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19137,"internal_metadata":391492927},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":12,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":60637,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002001"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596396+0000","last_change":"2024-08-26T00:00:29.365654+0000","last_active":"2024-08-26T00:01:33.596396+0000","last_peered":"2024-08-26T00:01:33.596396+0000","last_clean":"2024-08-26T00:01:33.596396+0000","last_became_active":"2024-08-26T00:00:29.364609+0000","last_became_peered":"2024-08-26T00:00:29.364609+0000","last_unstale":"2024-08-26T00:01:33.596396+0000","last_undegraded":"2024-08-26T00:01:33.596396+0000","last_fullsized":"2024-08-26T00:01:33.596396+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:54:39.886248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598877+0000","last_change":"2024-08-26T00:00:29.367657+0000","last_active":"2024-08-26T00:01:33.598877+0000","last_peered":"2024-08-26T00:01:33.598877+0000","last_clean":"2024-08-26T00:01:33.598877+0000","last_became_active":"2024-08-26T00:00:29.367376+0000","last_became_peered":"2024-08-26T00:00:29.367376+0000","last_unstale":"2024-08-26T00:01:33.598877+0000","last_undegraded":"2024-08-26T00:01:33.598877+0000","last_fullsized":"2024-08-26T00:01:33.598877+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:16:13.414883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598469+0000","last_change":"2024-08-26T00:00:29.369219+0000","last_active":"2024-08-26T00:01:33.598469+0000","last_peered":"2024-08-26T00:01:33.598469+0000","last_clean":"2024-08-26T00:01:33.598469+0000","last_became_active":"2024-08-26T00:00:29.368902+0000","last_became_peered":"2024-08-26T00:00:29.368902+0000","last_unstale":"2024-08-26T00:01:33.598469+0000","last_undegraded":"2024-08-26T00:01:33.598469+0000","last_fullsized":"2024-08-26T00:01:33.598469+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:53:28.636658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.891013+0000","last_change":"2024-08-26T00:00:29.359501+0000","last_active":"2024-08-26T00:01:33.891013+0000","last_peered":"2024-08-26T00:01:33.891013+0000","last_clean":"2024-08-26T00:01:33.891013+0000","last_became_active":"2024-08-26T00:00:29.358778+0000","last_became_peered":"2024-08-26T00:00:29.358778+0000","last_unstale":"2024-08-26T00:01:33.891013+0000","last_undegraded":"2024-08-26T00:01:33.891013+0000","last_fullsized":"2024-08-26T00:01:33.891013+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:20:40.200105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598627+0000","last_change":"2024-08-26T00:00:29.358387+0000","last_active":"2024-08-26T00:01:33.598627+0000","last_peered":"2024-08-26T00:01:33.598627+0000","last_clean":"2024-08-26T00:01:33.598627+0000","last_became_active":"2024-08-26T00:00:29.357839+0000","last_became_peered":"2024-08-26T00:00:29.357839+0000","last_unstale":"2024-08-26T00:01:33.598627+0000","last_undegraded":"2024-08-26T00:01:33.598627+0000","last_fullsized":"2024-08-26T00:01:33.598627+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:05:21.065258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.593062+0000","last_change":"2024-08-26T00:00:29.354429+0000","last_active":"2024-08-26T00:01:33.593062+0000","last_peered":"2024-08-26T00:01:33.593062+0000","last_clean":"2024-08-26T00:01:33.593062+0000","last_became_active":"2024-08-26T00:00:29.354108+0000","last_became_peered":"2024-08-26T00:00:29.354108+0000","last_unstale":"2024-08-26T00:01:33.593062+0000","last_undegraded":"2024-08-26T00:01:33.593062+0000","last_fullsized":"2024-08-26T00:01:33.593062+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:58:07.912980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595403+0000","last_change":"2024-08-26T00:00:29.360127+0000","last_active":"2024-08-26T00:01:33.595403+0000","last_peered":"2024-08-26T00:01:33.595403+0000","last_clean":"2024-08-26T00:01:33.595403+0000","last_became_active":"2024-08-26T00:00:29.359730+0000","last_became_peered":"2024-08-26T00:00:29.359730+0000","last_unstale":"2024-08-26T00:01:33.595403+0000","last_undegraded":"2024-08-26T00:01:33.595403+0000","last_fullsized":"2024-08-26T00:01:33.595403+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:38:16.377861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.592366+0000","last_change":"2024-08-26T00:00:29.362117+0000","last_active":"2024-08-26T00:01:33.592366+0000","last_peered":"2024-08-26T00:01:33.592366+0000","last_clean":"2024-08-26T00:01:33.592366+0000","last_became_active":"2024-08-26T00:00:29.361738+0000","last_became_peered":"2024-08-26T00:00:29.361738+0000","last_unstale":"2024-08-26T00:01:33.592366+0000","last_undegraded":"2024-08-26T00:01:33.592366+0000","last_fullsized":"2024-08-26T00:01:33.592366+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:38:15.468364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.597311+0000","last_change":"2024-08-26T00:00:29.363693+0000","last_active":"2024-08-26T00:01:33.597311+0000","last_peered":"2024-08-26T00:01:33.597311+0000","last_clean":"2024-08-26T00:01:33.597311+0000","last_became_active":"2024-08-26T00:00:29.363356+0000","last_became_peered":"2024-08-26T00:00:29.363356+0000","last_unstale":"2024-08-26T00:01:33.597311+0000","last_undegraded":"2024-08-26T00:01:33.597311+0000","last_fullsized":"2024-08-26T00:01:33.597311+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:18:46.180255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.593806+0000","last_change":"2024-08-26T00:00:29.363401+0000","last_active":"2024-08-26T00:01:33.593806+0000","last_peered":"2024-08-26T00:01:33.593806+0000","last_clean":"2024-08-26T00:01:33.593806+0000","last_became_active":"2024-08-26T00:00:29.363045+0000","last_became_peered":"2024-08-26T00:00:29.363045+0000","last_unstale":"2024-08-26T00:01:33.593806+0000","last_undegraded":"2024-08-26T00:01:33.593806+0000","last_fullsized":"2024-08-26T00:01:33.593806+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:18:24.931121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595874+0000","last_change":"2024-08-26T00:00:29.356440+0000","last_active":"2024-08-26T00:01:33.595874+0000","last_peered":"2024-08-26T00:01:33.595874+0000","last_clean":"2024-08-26T00:01:33.595874+0000","last_became_active":"2024-08-26T00:00:29.355498+0000","last_became_peered":"2024-08-26T00:00:29.355498+0000","last_unstale":"2024-08-26T00:01:33.595874+0000","last_undegraded":"2024-08-26T00:01:33.595874+0000","last_fullsized":"2024-08-26T00:01:33.595874+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:27:31.363962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.891094+0000","last_change":"2024-08-26T00:00:29.359185+0000","last_active":"2024-08-26T00:01:33.891094+0000","last_peered":"2024-08-26T00:01:33.891094+0000","last_clean":"2024-08-26T00:01:33.891094+0000","last_became_active":"2024-08-26T00:00:29.358670+0000","last_became_peered":"2024-08-26T00:00:29.358670+0000","last_unstale":"2024-08-26T00:01:33.891094+0000","last_undegraded":"2024-08-26T00:01:33.891094+0000","last_fullsized":"2024-08-26T00:01:33.891094+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:15:31.327823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.594944+0000","last_change":"2024-08-26T00:00:29.361477+0000","last_active":"2024-08-26T00:01:33.594944+0000","last_peered":"2024-08-26T00:01:33.594944+0000","last_clean":"2024-08-26T00:01:33.594944+0000","last_became_active":"2024-08-26T00:00:29.360870+0000","last_became_peered":"2024-08-26T00:00:29.360870+0000","last_unstale":"2024-08-26T00:01:33.594944+0000","last_undegraded":"2024-08-26T00:01:33.594944+0000","last_fullsized":"2024-08-26T00:01:33.594944+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:37:01.434606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598400+0000","last_change":"2024-08-26T00:00:29.362301+0000","last_active":"2024-08-26T00:01:33.598400+0000","last_peered":"2024-08-26T00:01:33.598400+0000","last_clean":"2024-08-26T00:01:33.598400+0000","last_became_active":"2024-08-26T00:00:29.359613+0000","last_became_peered":"2024-08-26T00:00:29.359613+0000","last_unstale":"2024-08-26T00:01:33.598400+0000","last_undegraded":"2024-08-26T00:01:33.598400+0000","last_fullsized":"2024-08-26T00:01:33.598400+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:24:09.515352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598350+0000","last_change":"2024-08-26T00:00:29.365553+0000","last_active":"2024-08-26T00:01:33.598350+0000","last_peered":"2024-08-26T00:01:33.598350+0000","last_clean":"2024-08-26T00:01:33.598350+0000","last_became_active":"2024-08-26T00:00:29.363344+0000","last_became_peered":"2024-08-26T00:00:29.363344+0000","last_unstale":"2024-08-26T00:01:33.598350+0000","last_undegraded":"2024-08-26T00:01:33.598350+0000","last_fullsized":"2024-08-26T00:01:33.598350+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:27:43.172749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596325+0000","last_change":"2024-08-26T00:00:29.362061+0000","last_active":"2024-08-26T00:01:33.596325+0000","last_peered":"2024-08-26T00:01:33.596325+0000","last_clean":"2024-08-26T00:01:33.596325+0000","last_became_active":"2024-08-26T00:00:29.361712+0000","last_became_peered":"2024-08-26T00:00:29.361712+0000","last_unstale":"2024-08-26T00:01:33.596325+0000","last_undegraded":"2024-08-26T00:01:33.596325+0000","last_fullsized":"2024-08-26T00:01:33.596325+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:20:14.944167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596502+0000","last_change":"2024-08-26T00:00:29.365160+0000","last_active":"2024-08-26T00:01:33.596502+0000","last_peered":"2024-08-26T00:01:33.596502+0000","last_clean":"2024-08-26T00:01:33.596502+0000","last_became_active":"2024-08-26T00:00:29.364541+0000","last_became_peered":"2024-08-26T00:00:29.364541+0000","last_unstale":"2024-08-26T00:01:33.596502+0000","last_undegraded":"2024-08-26T00:01:33.596502+0000","last_fullsized":"2024-08-26T00:01:33.596502+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:59:54.417495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599757+0000","last_change":"2024-08-26T00:00:29.361264+0000","last_active":"2024-08-26T00:01:33.599757+0000","last_peered":"2024-08-26T00:01:33.599757+0000","last_clean":"2024-08-26T00:01:33.599757+0000","last_became_active":"2024-08-26T00:00:29.358501+0000","last_became_peered":"2024-08-26T00:00:29.358501+0000","last_unstale":"2024-08-26T00:01:33.599757+0000","last_undegraded":"2024-08-26T00:01:33.599757+0000","last_fullsized":"2024-08-26T00:01:33.599757+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:04:44.930112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.601117+0000","last_change":"2024-08-26T00:01:33.601117+0000","last_active":"2024-08-26T00:01:33.601117+0000","last_peered":"2024-08-26T00:01:33.601117+0000","last_clean":"2024-08-26T00:01:33.601117+0000","last_became_active":"2024-08-26T00:01:33.600696+0000","last_became_peered":"2024-08-26T00:01:33.600696+0000","last_unstale":"2024-08-26T00:01:33.601117+0000","last_undegraded":"2024-08-26T00:01:33.601117+0000","last_fullsized":"2024-08-26T00:01:33.601117+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:43:46.062253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595116+0000","last_change":"2024-08-26T00:00:29.363072+0000","last_active":"2024-08-26T00:01:33.595116+0000","last_peered":"2024-08-26T00:01:33.595116+0000","last_clean":"2024-08-26T00:01:33.595116+0000","last_became_active":"2024-08-26T00:00:29.362751+0000","last_became_peered":"2024-08-26T00:00:29.362751+0000","last_unstale":"2024-08-26T00:01:33.595116+0000","last_undegraded":"2024-08-26T00:01:33.595116+0000","last_fullsized":"2024-08-26T00:01:33.595116+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:49:14.455371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595021+0000","last_change":"2024-08-26T00:00:29.367489+0000","last_active":"2024-08-26T00:01:33.595021+0000","last_peered":"2024-08-26T00:01:33.595021+0000","last_clean":"2024-08-26T00:01:33.595021+0000","last_became_active":"2024-08-26T00:00:29.367183+0000","last_became_peered":"2024-08-26T00:00:29.367183+0000","last_unstale":"2024-08-26T00:01:33.595021+0000","last_undegraded":"2024-08-26T00:01:33.595021+0000","last_fullsized":"2024-08-26T00:01:33.595021+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:05:53.736139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596931+0000","last_change":"2024-08-26T00:00:29.356751+0000","last_active":"2024-08-26T00:01:33.596931+0000","last_peered":"2024-08-26T00:01:33.596931+0000","last_clean":"2024-08-26T00:01:33.596931+0000","last_became_active":"2024-08-26T00:00:29.356291+0000","last_became_peered":"2024-08-26T00:00:29.356291+0000","last_unstale":"2024-08-26T00:01:33.596931+0000","last_undegraded":"2024-08-26T00:01:33.596931+0000","last_fullsized":"2024-08-26T00:01:33.596931+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:32:50.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.592403+0000","last_change":"2024-08-26T00:00:29.356965+0000","last_active":"2024-08-26T00:01:33.592403+0000","last_peered":"2024-08-26T00:01:33.592403+0000","last_clean":"2024-08-26T00:01:33.592403+0000","last_became_active":"2024-08-26T00:00:29.356588+0000","last_became_peered":"2024-08-26T00:00:29.356588+0000","last_unstale":"2024-08-26T00:01:33.592403+0000","last_undegraded":"2024-08-26T00:01:33.592403+0000","last_fullsized":"2024-08-26T00:01:33.592403+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:02:25.833139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598579+0000","last_change":"2024-08-26T00:00:29.352304+0000","last_active":"2024-08-26T00:01:33.598579+0000","last_peered":"2024-08-26T00:01:33.598579+0000","last_clean":"2024-08-26T00:01:33.598579+0000","last_became_active":"2024-08-26T00:00:29.351981+0000","last_became_peered":"2024-08-26T00:00:29.351981+0000","last_unstale":"2024-08-26T00:01:33.598579+0000","last_undegraded":"2024-08-26T00:01:33.598579+0000","last_fullsized":"2024-08-26T00:01:33.598579+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:06:29.105905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.592678+0000","last_change":"2024-08-26T00:00:29.354424+0000","last_active":"2024-08-26T00:01:33.592678+0000","last_peered":"2024-08-26T00:01:33.592678+0000","last_clean":"2024-08-26T00:01:33.592678+0000","last_became_active":"2024-08-26T00:00:29.352687+0000","last_became_peered":"2024-08-26T00:00:29.352687+0000","last_unstale":"2024-08-26T00:01:33.592678+0000","last_undegraded":"2024-08-26T00:01:33.592678+0000","last_fullsized":"2024-08-26T00:01:33.592678+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:26:21.769928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.597237+0000","last_change":"2024-08-26T00:00:29.355680+0000","last_active":"2024-08-26T00:01:33.597237+0000","last_peered":"2024-08-26T00:01:33.597237+0000","last_clean":"2024-08-26T00:01:33.597237+0000","last_became_active":"2024-08-26T00:00:29.355335+0000","last_became_peered":"2024-08-26T00:00:29.355335+0000","last_unstale":"2024-08-26T00:01:33.597237+0000","last_undegraded":"2024-08-26T00:01:33.597237+0000","last_fullsized":"2024-08-26T00:01:33.597237+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:16:04.085892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595578+0000","last_change":"2024-08-26T00:00:29.357564+0000","last_active":"2024-08-26T00:01:33.595578+0000","last_peered":"2024-08-26T00:01:33.595578+0000","last_clean":"2024-08-26T00:01:33.595578+0000","last_became_active":"2024-08-26T00:00:29.357215+0000","last_became_peered":"2024-08-26T00:00:29.357215+0000","last_unstale":"2024-08-26T00:01:33.595578+0000","last_undegraded":"2024-08-26T00:01:33.595578+0000","last_fullsized":"2024-08-26T00:01:33.595578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:47:32.969629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.594981+0000","last_change":"2024-08-26T00:00:29.368272+0000","last_active":"2024-08-26T00:01:33.594981+0000","last_peered":"2024-08-26T00:01:33.594981+0000","last_clean":"2024-08-26T00:01:33.594981+0000","last_became_active":"2024-08-26T00:00:29.367920+0000","last_became_peered":"2024-08-26T00:00:29.367920+0000","last_unstale":"2024-08-26T00:01:33.594981+0000","last_undegraded":"2024-08-26T00:01:33.594981+0000","last_fullsized":"2024-08-26T00:01:33.594981+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:35:19.373782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598524+0000","last_change":"2024-08-26T00:00:29.371609+0000","last_active":"2024-08-26T00:01:33.598524+0000","last_peered":"2024-08-26T00:01:33.598524+0000","last_clean":"2024-08-26T00:01:33.598524+0000","last_became_active":"2024-08-26T00:00:29.371199+0000","last_became_peered":"2024-08-26T00:00:29.371199+0000","last_unstale":"2024-08-26T00:01:33.598524+0000","last_undegraded":"2024-08-26T00:01:33.598524+0000","last_fullsized":"2024-08-26T00:01:33.598524+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:03:43.542718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595387+0000","last_change":"2024-08-26T00:00:29.362222+0000","last_active":"2024-08-26T00:01:33.595387+0000","last_peered":"2024-08-26T00:01:33.595387+0000","last_clean":"2024-08-26T00:01:33.595387+0000","last_became_active":"2024-08-26T00:00:29.361767+0000","last_became_peered":"2024-08-26T00:00:29.361767+0000","last_unstale":"2024-08-26T00:01:33.595387+0000","last_undegraded":"2024-08-26T00:01:33.595387+0000","last_fullsized":"2024-08-26T00:01:33.595387+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:42:17.032034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595925+0000","last_change":"2024-08-26T00:00:29.357997+0000","last_active":"2024-08-26T00:01:33.595925+0000","last_peered":"2024-08-26T00:01:33.595925+0000","last_clean":"2024-08-26T00:01:33.595925+0000","last_became_active":"2024-08-26T00:00:29.357693+0000","last_became_peered":"2024-08-26T00:00:29.357693+0000","last_unstale":"2024-08-26T00:01:33.595925+0000","last_undegraded":"2024-08-26T00:01:33.595925+0000","last_fullsized":"2024-08-26T00:01:33.595925+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:02:49.074234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.594739+0000","last_change":"2024-08-26T00:00:29.358305+0000","last_active":"2024-08-26T00:01:33.594739+0000","last_peered":"2024-08-26T00:01:33.594739+0000","last_clean":"2024-08-26T00:01:33.594739+0000","last_became_active":"2024-08-26T00:00:29.357928+0000","last_became_peered":"2024-08-26T00:00:29.357928+0000","last_unstale":"2024-08-26T00:01:33.594739+0000","last_undegraded":"2024-08-26T00:01:33.594739+0000","last_fullsized":"2024-08-26T00:01:33.594739+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:34:47.609170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598476+0000","last_change":"2024-08-26T00:00:29.357931+0000","last_active":"2024-08-26T00:01:33.598476+0000","last_peered":"2024-08-26T00:01:33.598476+0000","last_clean":"2024-08-26T00:01:33.598476+0000","last_became_active":"2024-08-26T00:00:29.357408+0000","last_became_peered":"2024-08-26T00:00:29.357408+0000","last_unstale":"2024-08-26T00:01:33.598476+0000","last_undegraded":"2024-08-26T00:01:33.598476+0000","last_fullsized":"2024-08-26T00:01:33.598476+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:21:10.230267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'5","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:36.486995+0000","last_change":"2024-08-26T00:00:26.993942+0000","last_active":"2024-08-26T00:01:36.486995+0000","last_peered":"2024-08-26T00:01:36.486995+0000","last_clean":"2024-08-26T00:01:36.486995+0000","last_became_active":"2024-08-26T00:00:26.993136+0000","last_became_peered":"2024-08-26T00:00:26.993136+0000","last_unstale":"2024-08-26T00:01:36.486995+0000","last_undegraded":"2024-08-26T00:01:36.486995+0000","last_fullsized":"2024-08-26T00:01:36.486995+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:30:31.890643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599957+0000","last_change":"2024-08-26T00:00:29.351174+0000","last_active":"2024-08-26T00:01:33.599957+0000","last_peered":"2024-08-26T00:01:33.599957+0000","last_clean":"2024-08-26T00:01:33.599957+0000","last_became_active":"2024-08-26T00:00:29.350758+0000","last_became_peered":"2024-08-26T00:00:29.350758+0000","last_unstale":"2024-08-26T00:01:33.599957+0000","last_undegraded":"2024-08-26T00:01:33.599957+0000","last_fullsized":"2024-08-26T00:01:33.599957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:02:56.986251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.593069+0000","last_change":"2024-08-26T00:00:26.991547+0000","last_active":"2024-08-26T00:01:33.593069+0000","last_peered":"2024-08-26T00:01:33.593069+0000","last_clean":"2024-08-26T00:01:33.593069+0000","last_became_active":"2024-08-26T00:00:26.991120+0000","last_became_peered":"2024-08-26T00:00:26.991120+0000","last_unstale":"2024-08-26T00:01:33.593069+0000","last_undegraded":"2024-08-26T00:01:33.593069+0000","last_fullsized":"2024-08-26T00:01:33.593069+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:42:12.381882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.594735+0000","last_change":"2024-08-26T00:00:26.988477+0000","last_active":"2024-08-26T00:01:33.594735+0000","last_peered":"2024-08-26T00:01:33.594735+0000","last_clean":"2024-08-26T00:01:33.594735+0000","last_became_active":"2024-08-26T00:00:26.988180+0000","last_became_peered":"2024-08-26T00:00:26.988180+0000","last_unstale":"2024-08-26T00:01:33.594735+0000","last_undegraded":"2024-08-26T00:01:33.594735+0000","last_fullsized":"2024-08-26T00:01:33.594735+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:00:35.586628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.592403+0000","last_change":"2024-08-26T00:00:29.360687+0000","last_active":"2024-08-26T00:01:33.592403+0000","last_peered":"2024-08-26T00:01:33.592403+0000","last_clean":"2024-08-26T00:01:33.592403+0000","last_became_active":"2024-08-26T00:00:29.358427+0000","last_became_peered":"2024-08-26T00:00:29.358427+0000","last_unstale":"2024-08-26T00:01:33.592403+0000","last_undegraded":"2024-08-26T00:01:33.592403+0000","last_fullsized":"2024-08-26T00:01:33.592403+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:15:41.175510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599569+0000","last_change":"2024-08-26T00:00:26.995054+0000","last_active":"2024-08-26T00:01:33.599569+0000","last_peered":"2024-08-26T00:01:33.599569+0000","last_clean":"2024-08-26T00:01:33.599569+0000","last_became_active":"2024-08-26T00:00:26.994742+0000","last_became_peered":"2024-08-26T00:00:26.994742+0000","last_unstale":"2024-08-26T00:01:33.599569+0000","last_undegraded":"2024-08-26T00:01:33.599569+0000","last_fullsized":"2024-08-26T00:01:33.599569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:02:30.509497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599454+0000","last_change":"2024-08-26T00:00:29.352343+0000","last_active":"2024-08-26T00:01:33.599454+0000","last_peered":"2024-08-26T00:01:33.599454+0000","last_clean":"2024-08-26T00:01:33.599454+0000","last_became_active":"2024-08-26T00:00:29.352036+0000","last_became_peered":"2024-08-26T00:00:29.352036+0000","last_unstale":"2024-08-26T00:01:33.599454+0000","last_undegraded":"2024-08-26T00:01:33.599454+0000","last_fullsized":"2024-08-26T00:01:33.599454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:28:14.399870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:35.485036+0000","last_change":"2024-08-26T00:00:26.989828+0000","last_active":"2024-08-26T00:01:35.485036+0000","last_peered":"2024-08-26T00:01:35.485036+0000","last_clean":"2024-08-26T00:01:35.485036+0000","last_became_active":"2024-08-26T00:00:26.989365+0000","last_became_peered":"2024-08-26T00:00:26.989365+0000","last_unstale":"2024-08-26T00:01:35.485036+0000","last_undegraded":"2024-08-26T00:01:35.485036+0000","last_fullsized":"2024-08-26T00:01:35.485036+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:00:40.821500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596940+0000","last_change":"2024-08-26T00:00:29.359506+0000","last_active":"2024-08-26T00:01:33.596940+0000","last_peered":"2024-08-26T00:01:33.596940+0000","last_clean":"2024-08-26T00:01:33.596940+0000","last_became_active":"2024-08-26T00:00:29.359042+0000","last_became_peered":"2024-08-26T00:00:29.359042+0000","last_unstale":"2024-08-26T00:01:33.596940+0000","last_undegraded":"2024-08-26T00:01:33.596940+0000","last_fullsized":"2024-08-26T00:01:33.596940+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:38:34.661823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595861+0000","last_change":"2024-08-26T00:00:26.994272+0000","last_active":"2024-08-26T00:01:33.595861+0000","last_peered":"2024-08-26T00:01:33.595861+0000","last_clean":"2024-08-26T00:01:33.595861+0000","last_became_active":"2024-08-26T00:00:26.993769+0000","last_became_peered":"2024-08-26T00:00:26.993769+0000","last_unstale":"2024-08-26T00:01:33.595861+0000","last_undegraded":"2024-08-26T00:01:33.595861+0000","last_fullsized":"2024-08-26T00:01:33.595861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:03:39.816595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599305+0000","last_change":"2024-08-26T00:00:29.372236+0000","last_active":"2024-08-26T00:01:33.599305+0000","last_peered":"2024-08-26T00:01:33.599305+0000","last_clean":"2024-08-26T00:01:33.599305+0000","last_became_active":"2024-08-26T00:00:29.371632+0000","last_became_peered":"2024-08-26T00:00:29.371632+0000","last_unstale":"2024-08-26T00:01:33.599305+0000","last_undegraded":"2024-08-26T00:01:33.599305+0000","last_fullsized":"2024-08-26T00:01:33.599305+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:46:10.735550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598661+0000","last_change":"2024-08-26T00:00:27.080074+0000","last_active":"2024-08-26T00:01:33.598661+0000","last_peered":"2024-08-26T00:01:33.598661+0000","last_clean":"2024-08-26T00:01:33.598661+0000","last_became_active":"2024-08-26T00:00:27.079646+0000","last_became_peered":"2024-08-26T00:00:27.079646+0000","last_unstale":"2024-08-26T00:01:33.598661+0000","last_undegraded":"2024-08-26T00:01:33.598661+0000","last_fullsized":"2024-08-26T00:01:33.598661+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:22:42.677747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.600131+0000","last_change":"2024-08-26T00:01:33.600131+0000","last_active":"2024-08-26T00:01:33.600131+0000","last_peered":"2024-08-26T00:01:33.600131+0000","last_clean":"2024-08-26T00:01:33.600131+0000","last_became_active":"2024-08-26T00:01:33.599594+0000","last_became_peered":"2024-08-26T00:01:33.599594+0000","last_unstale":"2024-08-26T00:01:33.600131+0000","last_undegraded":"2024-08-26T00:01:33.600131+0000","last_fullsized":"2024-08-26T00:01:33.600131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:33:33.573513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'28","reported_seq":191,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:36.899917+0000","last_change":"2024-08-26T00:01:33.901247+0000","last_active":"2024-08-26T00:01:36.899917+0000","last_peered":"2024-08-26T00:01:36.899917+0000","last_clean":"2024-08-26T00:01:36.899917+0000","last_became_active":"2024-08-26T00:01:33.892141+0000","last_became_peered":"2024-08-26T00:01:33.892141+0000","last_unstale":"2024-08-26T00:01:36.899917+0000","last_undegraded":"2024-08-26T00:01:36.899917+0000","last_fullsized":"2024-08-26T00:01:36.899917+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:08:05.209223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60615,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":117,"num_write":29,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":60615,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599853+0000","last_change":"2024-08-26T00:00:29.356969+0000","last_active":"2024-08-26T00:01:33.599853+0000","last_peered":"2024-08-26T00:01:33.599853+0000","last_clean":"2024-08-26T00:01:33.599853+0000","last_became_active":"2024-08-26T00:00:29.356493+0000","last_became_peered":"2024-08-26T00:00:29.356493+0000","last_unstale":"2024-08-26T00:01:33.599853+0000","last_undegraded":"2024-08-26T00:01:33.599853+0000","last_fullsized":"2024-08-26T00:01:33.599853+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:42:29.663933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596334+0000","last_change":"2024-08-26T00:00:26.993733+0000","last_active":"2024-08-26T00:01:33.596334+0000","last_peered":"2024-08-26T00:01:33.596334+0000","last_clean":"2024-08-26T00:01:33.596334+0000","last_became_active":"2024-08-26T00:00:26.991196+0000","last_became_peered":"2024-08-26T00:00:26.991196+0000","last_unstale":"2024-08-26T00:01:33.596334+0000","last_undegraded":"2024-08-26T00:01:33.596334+0000","last_fullsized":"2024-08-26T00:01:33.596334+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:53:49.056228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.594788+0000","last_change":"2024-08-26T00:00:29.363095+0000","last_active":"2024-08-26T00:01:33.594788+0000","last_peered":"2024-08-26T00:01:33.594788+0000","last_clean":"2024-08-26T00:01:33.594788+0000","last_became_active":"2024-08-26T00:00:29.361374+0000","last_became_peered":"2024-08-26T00:00:29.361374+0000","last_unstale":"2024-08-26T00:01:33.594788+0000","last_undegraded":"2024-08-26T00:01:33.594788+0000","last_fullsized":"2024-08-26T00:01:33.594788+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:30:34.072712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598243+0000","last_change":"2024-08-26T00:00:26.993920+0000","last_active":"2024-08-26T00:01:33.598243+0000","last_peered":"2024-08-26T00:01:33.598243+0000","last_clean":"2024-08-26T00:01:33.598243+0000","last_became_active":"2024-08-26T00:00:26.993578+0000","last_became_peered":"2024-08-26T00:00:26.993578+0000","last_unstale":"2024-08-26T00:01:33.598243+0000","last_undegraded":"2024-08-26T00:01:33.598243+0000","last_fullsized":"2024-08-26T00:01:33.598243+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:29:49.751384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595562+0000","last_change":"2024-08-26T00:00:29.362535+0000","last_active":"2024-08-26T00:01:33.595562+0000","last_peered":"2024-08-26T00:01:33.595562+0000","last_clean":"2024-08-26T00:01:33.595562+0000","last_became_active":"2024-08-26T00:00:29.362167+0000","last_became_peered":"2024-08-26T00:00:29.362167+0000","last_unstale":"2024-08-26T00:01:33.595562+0000","last_undegraded":"2024-08-26T00:01:33.595562+0000","last_fullsized":"2024-08-26T00:01:33.595562+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:21:54.020323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'4","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:34.483821+0000","last_change":"2024-08-26T00:00:26.993988+0000","last_active":"2024-08-26T00:01:34.483821+0000","last_peered":"2024-08-26T00:01:34.483821+0000","last_clean":"2024-08-26T00:01:34.483821+0000","last_became_active":"2024-08-26T00:00:26.993485+0000","last_became_peered":"2024-08-26T00:00:26.993485+0000","last_unstale":"2024-08-26T00:01:34.483821+0000","last_undegraded":"2024-08-26T00:01:34.483821+0000","last_fullsized":"2024-08-26T00:01:34.483821+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:46:29.475574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":977,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599944+0000","last_change":"2024-08-26T00:01:33.599944+0000","last_active":"2024-08-26T00:01:33.599944+0000","last_peered":"2024-08-26T00:01:33.599944+0000","last_clean":"2024-08-26T00:01:33.599944+0000","last_became_active":"2024-08-26T00:01:33.599457+0000","last_became_peered":"2024-08-26T00:01:33.599457+0000","last_unstale":"2024-08-26T00:01:33.599944+0000","last_undegraded":"2024-08-26T00:01:33.599944+0000","last_fullsized":"2024-08-26T00:01:33.599944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:12:33.747334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598056+0000","last_change":"2024-08-26T00:00:27.077517+0000","last_active":"2024-08-26T00:01:33.598056+0000","last_peered":"2024-08-26T00:01:33.598056+0000","last_clean":"2024-08-26T00:01:33.598056+0000","last_became_active":"2024-08-26T00:00:27.077083+0000","last_became_peered":"2024-08-26T00:00:27.077083+0000","last_unstale":"2024-08-26T00:01:33.598056+0000","last_undegraded":"2024-08-26T00:01:33.598056+0000","last_fullsized":"2024-08-26T00:01:33.598056+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:27:43.522233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598763+0000","last_change":"2024-08-26T00:00:29.355532+0000","last_active":"2024-08-26T00:01:33.598763+0000","last_peered":"2024-08-26T00:01:33.598763+0000","last_clean":"2024-08-26T00:01:33.598763+0000","last_became_active":"2024-08-26T00:00:29.355211+0000","last_became_peered":"2024-08-26T00:00:29.355211+0000","last_unstale":"2024-08-26T00:01:33.598763+0000","last_undegraded":"2024-08-26T00:01:33.598763+0000","last_fullsized":"2024-08-26T00:01:33.598763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:08:51.419634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598596+0000","last_change":"2024-08-26T00:00:26.992613+0000","last_active":"2024-08-26T00:01:33.598596+0000","last_peered":"2024-08-26T00:01:33.598596+0000","last_clean":"2024-08-26T00:01:33.598596+0000","last_became_active":"2024-08-26T00:00:26.992137+0000","last_became_peered":"2024-08-26T00:00:26.992137+0000","last_unstale":"2024-08-26T00:01:33.598596+0000","last_undegraded":"2024-08-26T00:01:33.598596+0000","last_fullsized":"2024-08-26T00:01:33.598596+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:30:32.586859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.594985+0000","last_change":"2024-08-26T00:00:29.362342+0000","last_active":"2024-08-26T00:01:33.594985+0000","last_peered":"2024-08-26T00:01:33.594985+0000","last_clean":"2024-08-26T00:01:33.594985+0000","last_became_active":"2024-08-26T00:00:29.362017+0000","last_became_peered":"2024-08-26T00:00:29.362017+0000","last_unstale":"2024-08-26T00:01:33.594985+0000","last_undegraded":"2024-08-26T00:01:33.594985+0000","last_fullsized":"2024-08-26T00:01:33.594985+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:01:55.507893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595105+0000","last_change":"2024-08-26T00:00:26.989977+0000","last_active":"2024-08-26T00:01:33.595105+0000","last_peered":"2024-08-26T00:01:33.595105+0000","last_clean":"2024-08-26T00:01:33.595105+0000","last_became_active":"2024-08-26T00:00:26.989535+0000","last_became_peered":"2024-08-26T00:00:26.989535+0000","last_unstale":"2024-08-26T00:01:33.595105+0000","last_undegraded":"2024-08-26T00:01:33.595105+0000","last_fullsized":"2024-08-26T00:01:33.595105+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:33:20.347005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596291+0000","last_change":"2024-08-26T00:00:29.355928+0000","last_active":"2024-08-26T00:01:33.596291+0000","last_peered":"2024-08-26T00:01:33.596291+0000","last_clean":"2024-08-26T00:01:33.596291+0000","last_became_active":"2024-08-26T00:00:29.355546+0000","last_became_peered":"2024-08-26T00:00:29.355546+0000","last_unstale":"2024-08-26T00:01:33.596291+0000","last_undegraded":"2024-08-26T00:01:33.596291+0000","last_fullsized":"2024-08-26T00:01:33.596291+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:15:06.116141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598775+0000","last_change":"2024-08-26T00:00:26.992523+0000","last_active":"2024-08-26T00:01:33.598775+0000","last_peered":"2024-08-26T00:01:33.598775+0000","last_clean":"2024-08-26T00:01:33.598775+0000","last_became_active":"2024-08-26T00:00:26.992193+0000","last_became_peered":"2024-08-26T00:00:26.992193+0000","last_unstale":"2024-08-26T00:01:33.598775+0000","last_undegraded":"2024-08-26T00:01:33.598775+0000","last_fullsized":"2024-08-26T00:01:33.598775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:34:21.879373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596367+0000","last_change":"2024-08-26T00:00:29.358826+0000","last_active":"2024-08-26T00:01:33.596367+0000","last_peered":"2024-08-26T00:01:33.596367+0000","last_clean":"2024-08-26T00:01:33.596367+0000","last_became_active":"2024-08-26T00:00:29.358478+0000","last_became_peered":"2024-08-26T00:00:29.358478+0000","last_unstale":"2024-08-26T00:01:33.596367+0000","last_undegraded":"2024-08-26T00:01:33.596367+0000","last_fullsized":"2024-08-26T00:01:33.596367+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:30:39.484666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596872+0000","last_change":"2024-08-26T00:00:27.077599+0000","last_active":"2024-08-26T00:01:33.596872+0000","last_peered":"2024-08-26T00:01:33.596872+0000","last_clean":"2024-08-26T00:01:33.596872+0000","last_became_active":"2024-08-26T00:00:27.077094+0000","last_became_peered":"2024-08-26T00:00:27.077094+0000","last_unstale":"2024-08-26T00:01:33.596872+0000","last_undegraded":"2024-08-26T00:01:33.596872+0000","last_fullsized":"2024-08-26T00:01:33.596872+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:06:47.966097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595990+0000","last_change":"2024-08-26T00:00:29.355243+0000","last_active":"2024-08-26T00:01:33.595990+0000","last_peered":"2024-08-26T00:01:33.595990+0000","last_clean":"2024-08-26T00:01:33.595990+0000","last_became_active":"2024-08-26T00:00:29.354151+0000","last_became_peered":"2024-08-26T00:00:29.354151+0000","last_unstale":"2024-08-26T00:01:33.595990+0000","last_undegraded":"2024-08-26T00:01:33.595990+0000","last_fullsized":"2024-08-26T00:01:33.595990+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:00:12.520736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":334,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596182+0000","last_change":"2024-08-25T23:59:16.227980+0000","last_active":"2024-08-26T00:01:33.596182+0000","last_peered":"2024-08-26T00:01:33.596182+0000","last_clean":"2024-08-26T00:01:33.596182+0000","last_became_active":"2024-08-25T23:59:16.227550+0000","last_became_peered":"2024-08-25T23:59:16.227550+0000","last_unstale":"2024-08-26T00:01:33.596182+0000","last_undegraded":"2024-08-26T00:01:33.596182+0000","last_fullsized":"2024-08-26T00:01:33.596182+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-25T23:55:51.247914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-25T23:55:51.247914+0000","last_clean_scrub_stamp":"2024-08-25T23:55:51.247914+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:39:34.184312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.890555+0000","last_change":"2024-08-26T00:00:26.992675+0000","last_active":"2024-08-26T00:01:33.890555+0000","last_peered":"2024-08-26T00:01:33.890555+0000","last_clean":"2024-08-26T00:01:33.890555+0000","last_became_active":"2024-08-26T00:00:26.992322+0000","last_became_peered":"2024-08-26T00:00:26.992322+0000","last_unstale":"2024-08-26T00:01:33.890555+0000","last_undegraded":"2024-08-26T00:01:33.890555+0000","last_fullsized":"2024-08-26T00:01:33.890555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:38:26.016220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.592613+0000","last_change":"2024-08-26T00:00:29.362617+0000","last_active":"2024-08-26T00:01:33.592613+0000","last_peered":"2024-08-26T00:01:33.592613+0000","last_clean":"2024-08-26T00:01:33.592613+0000","last_became_active":"2024-08-26T00:00:29.362245+0000","last_became_peered":"2024-08-26T00:00:29.362245+0000","last_unstale":"2024-08-26T00:01:33.592613+0000","last_undegraded":"2024-08-26T00:01:33.592613+0000","last_fullsized":"2024-08-26T00:01:33.592613+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:30:12.309213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.895296+0000","last_change":"2024-08-26T00:01:33.895296+0000","last_active":"2024-08-26T00:01:33.895296+0000","last_peered":"2024-08-26T00:01:33.895296+0000","last_clean":"2024-08-26T00:01:33.895296+0000","last_became_active":"2024-08-26T00:01:33.891598+0000","last_became_peered":"2024-08-26T00:01:33.891598+0000","last_unstale":"2024-08-26T00:01:33.895296+0000","last_undegraded":"2024-08-26T00:01:33.895296+0000","last_fullsized":"2024-08-26T00:01:33.895296+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:26:31.794735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.601137+0000","last_change":"2024-08-26T00:01:33.601137+0000","last_active":"2024-08-26T00:01:33.601137+0000","last_peered":"2024-08-26T00:01:33.601137+0000","last_clean":"2024-08-26T00:01:33.601137+0000","last_became_active":"2024-08-26T00:01:33.600397+0000","last_became_peered":"2024-08-26T00:01:33.600397+0000","last_unstale":"2024-08-26T00:01:33.601137+0000","last_undegraded":"2024-08-26T00:01:33.601137+0000","last_fullsized":"2024-08-26T00:01:33.601137+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:42:21.507880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:35.484716+0000","last_change":"2024-08-26T00:00:27.077840+0000","last_active":"2024-08-26T00:01:35.484716+0000","last_peered":"2024-08-26T00:01:35.484716+0000","last_clean":"2024-08-26T00:01:35.484716+0000","last_became_active":"2024-08-26T00:00:27.077355+0000","last_became_peered":"2024-08-26T00:00:27.077355+0000","last_unstale":"2024-08-26T00:01:35.484716+0000","last_undegraded":"2024-08-26T00:01:35.484716+0000","last_fullsized":"2024-08-26T00:01:35.484716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:03:30.718962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.603558+0000","last_change":"2024-08-26T00:01:33.603558+0000","last_active":"2024-08-26T00:01:33.603558+0000","last_peered":"2024-08-26T00:01:33.603558+0000","last_clean":"2024-08-26T00:01:33.603558+0000","last_became_active":"2024-08-26T00:01:33.603177+0000","last_became_peered":"2024-08-26T00:01:33.603177+0000","last_unstale":"2024-08-26T00:01:33.603558+0000","last_undegraded":"2024-08-26T00:01:33.603558+0000","last_fullsized":"2024-08-26T00:01:33.603558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:21:33.913812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595978+0000","last_change":"2024-08-26T00:00:26.994187+0000","last_active":"2024-08-26T00:01:33.595978+0000","last_peered":"2024-08-26T00:01:33.595978+0000","last_clean":"2024-08-26T00:01:33.595978+0000","last_became_active":"2024-08-26T00:00:26.993699+0000","last_became_peered":"2024-08-26T00:00:26.993699+0000","last_unstale":"2024-08-26T00:01:33.595978+0000","last_undegraded":"2024-08-26T00:01:33.595978+0000","last_fullsized":"2024-08-26T00:01:33.595978+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:19:50.412724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.593191+0000","last_change":"2024-08-26T00:00:29.364507+0000","last_active":"2024-08-26T00:01:33.593191+0000","last_peered":"2024-08-26T00:01:33.593191+0000","last_clean":"2024-08-26T00:01:33.593191+0000","last_became_active":"2024-08-26T00:00:29.364129+0000","last_became_peered":"2024-08-26T00:00:29.364129+0000","last_unstale":"2024-08-26T00:01:33.593191+0000","last_undegraded":"2024-08-26T00:01:33.593191+0000","last_fullsized":"2024-08-26T00:01:33.593191+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:17:36.837206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599893+0000","last_change":"2024-08-26T00:00:27.076977+0000","last_active":"2024-08-26T00:01:33.599893+0000","last_peered":"2024-08-26T00:01:33.599893+0000","last_clean":"2024-08-26T00:01:33.599893+0000","last_became_active":"2024-08-26T00:00:27.076524+0000","last_became_peered":"2024-08-26T00:00:27.076524+0000","last_unstale":"2024-08-26T00:01:33.599893+0000","last_undegraded":"2024-08-26T00:01:33.599893+0000","last_fullsized":"2024-08-26T00:01:33.599893+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:22:21.820009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.593483+0000","last_change":"2024-08-26T00:00:29.363880+0000","last_active":"2024-08-26T00:01:33.593483+0000","last_peered":"2024-08-26T00:01:33.593483+0000","last_clean":"2024-08-26T00:01:33.593483+0000","last_became_active":"2024-08-26T00:00:29.363475+0000","last_became_peered":"2024-08-26T00:00:29.363475+0000","last_unstale":"2024-08-26T00:01:33.593483+0000","last_undegraded":"2024-08-26T00:01:33.593483+0000","last_fullsized":"2024-08-26T00:01:33.593483+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:30:55.875922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.606790+0000","last_change":"2024-08-26T00:01:33.606353+0000","last_active":"2024-08-26T00:01:33.606790+0000","last_peered":"2024-08-26T00:01:33.606790+0000","last_clean":"2024-08-26T00:01:33.606790+0000","last_became_active":"2024-08-26T00:01:33.599903+0000","last_became_peered":"2024-08-26T00:01:33.599903+0000","last_unstale":"2024-08-26T00:01:33.606790+0000","last_undegraded":"2024-08-26T00:01:33.606790+0000","last_fullsized":"2024-08-26T00:01:33.606790+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:02:09.033915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.594999+0000","last_change":"2024-08-26T00:00:29.360285+0000","last_active":"2024-08-26T00:01:33.594999+0000","last_peered":"2024-08-26T00:01:33.594999+0000","last_clean":"2024-08-26T00:01:33.594999+0000","last_became_active":"2024-08-26T00:00:29.359879+0000","last_became_peered":"2024-08-26T00:00:29.359879+0000","last_unstale":"2024-08-26T00:01:33.594999+0000","last_undegraded":"2024-08-26T00:01:33.594999+0000","last_fullsized":"2024-08-26T00:01:33.594999+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:49:10.691817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'12","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599849+0000","last_change":"2024-08-26T00:00:26.990419+0000","last_active":"2024-08-26T00:01:33.599849+0000","last_peered":"2024-08-26T00:01:33.599849+0000","last_clean":"2024-08-26T00:01:33.599849+0000","last_became_active":"2024-08-26T00:00:26.990052+0000","last_became_peered":"2024-08-26T00:00:26.990052+0000","last_unstale":"2024-08-26T00:01:33.599849+0000","last_undegraded":"2024-08-26T00:01:33.599849+0000","last_fullsized":"2024-08-26T00:01:33.599849+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:27:41.229418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.592768+0000","last_change":"2024-08-26T00:00:29.354671+0000","last_active":"2024-08-26T00:01:33.592768+0000","last_peered":"2024-08-26T00:01:33.592768+0000","last_clean":"2024-08-26T00:01:33.592768+0000","last_became_active":"2024-08-26T00:00:29.354071+0000","last_became_peered":"2024-08-26T00:00:29.354071+0000","last_unstale":"2024-08-26T00:01:33.592768+0000","last_undegraded":"2024-08-26T00:01:33.592768+0000","last_fullsized":"2024-08-26T00:01:33.592768+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:50:09.097757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.890786+0000","last_change":"2024-08-26T00:00:26.991622+0000","last_active":"2024-08-26T00:01:33.890786+0000","last_peered":"2024-08-26T00:01:33.890786+0000","last_clean":"2024-08-26T00:01:33.890786+0000","last_became_active":"2024-08-26T00:00:26.991244+0000","last_became_peered":"2024-08-26T00:00:26.991244+0000","last_unstale":"2024-08-26T00:01:33.890786+0000","last_undegraded":"2024-08-26T00:01:33.890786+0000","last_fullsized":"2024-08-26T00:01:33.890786+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:58:25.676985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598947+0000","last_change":"2024-08-26T00:00:29.367033+0000","last_active":"2024-08-26T00:01:33.598947+0000","last_peered":"2024-08-26T00:01:33.598947+0000","last_clean":"2024-08-26T00:01:33.598947+0000","last_became_active":"2024-08-26T00:00:29.365572+0000","last_became_peered":"2024-08-26T00:00:29.365572+0000","last_unstale":"2024-08-26T00:01:33.598947+0000","last_undegraded":"2024-08-26T00:01:33.598947+0000","last_fullsized":"2024-08-26T00:01:33.598947+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:16:49.116721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596764+0000","last_change":"2024-08-26T00:00:27.076562+0000","last_active":"2024-08-26T00:01:33.596764+0000","last_peered":"2024-08-26T00:01:33.596764+0000","last_clean":"2024-08-26T00:01:33.596764+0000","last_became_active":"2024-08-26T00:00:27.076163+0000","last_became_peered":"2024-08-26T00:00:27.076163+0000","last_unstale":"2024-08-26T00:01:33.596764+0000","last_undegraded":"2024-08-26T00:01:33.596764+0000","last_fullsized":"2024-08-26T00:01:33.596764+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:25:03.222457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.597865+0000","last_change":"2024-08-26T00:00:29.352787+0000","last_active":"2024-08-26T00:01:33.597865+0000","last_peered":"2024-08-26T00:01:33.597865+0000","last_clean":"2024-08-26T00:01:33.597865+0000","last_became_active":"2024-08-26T00:00:29.352429+0000","last_became_peered":"2024-08-26T00:00:29.352429+0000","last_unstale":"2024-08-26T00:01:33.597865+0000","last_undegraded":"2024-08-26T00:01:33.597865+0000","last_fullsized":"2024-08-26T00:01:33.597865+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:39:45.080372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.592534+0000","last_change":"2024-08-26T00:00:26.989778+0000","last_active":"2024-08-26T00:01:33.592534+0000","last_peered":"2024-08-26T00:01:33.592534+0000","last_clean":"2024-08-26T00:01:33.592534+0000","last_became_active":"2024-08-26T00:00:26.989433+0000","last_became_peered":"2024-08-26T00:00:26.989433+0000","last_unstale":"2024-08-26T00:01:33.592534+0000","last_undegraded":"2024-08-26T00:01:33.592534+0000","last_fullsized":"2024-08-26T00:01:33.592534+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:36:16.684252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.594871+0000","last_change":"2024-08-26T00:00:29.362705+0000","last_active":"2024-08-26T00:01:33.594871+0000","last_peered":"2024-08-26T00:01:33.594871+0000","last_clean":"2024-08-26T00:01:33.594871+0000","last_became_active":"2024-08-26T00:00:29.362341+0000","last_became_peered":"2024-08-26T00:00:29.362341+0000","last_unstale":"2024-08-26T00:01:33.594871+0000","last_undegraded":"2024-08-26T00:01:33.594871+0000","last_fullsized":"2024-08-26T00:01:33.594871+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:10:47.051351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.609432+0000","last_change":"2024-08-26T00:01:33.608894+0000","last_active":"2024-08-26T00:01:33.609432+0000","last_peered":"2024-08-26T00:01:33.609432+0000","last_clean":"2024-08-26T00:01:33.609432+0000","last_became_active":"2024-08-26T00:01:33.601976+0000","last_became_peered":"2024-08-26T00:01:33.601976+0000","last_unstale":"2024-08-26T00:01:33.609432+0000","last_undegraded":"2024-08-26T00:01:33.609432+0000","last_fullsized":"2024-08-26T00:01:33.609432+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:03:17.367456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.592926+0000","last_change":"2024-08-26T00:00:29.365553+0000","last_active":"2024-08-26T00:01:33.592926+0000","last_peered":"2024-08-26T00:01:33.592926+0000","last_clean":"2024-08-26T00:01:33.592926+0000","last_became_active":"2024-08-26T00:00:29.365215+0000","last_became_peered":"2024-08-26T00:00:29.365215+0000","last_unstale":"2024-08-26T00:01:33.592926+0000","last_undegraded":"2024-08-26T00:01:33.592926+0000","last_fullsized":"2024-08-26T00:01:33.592926+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:55:01.505530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598744+0000","last_change":"2024-08-26T00:00:26.995228+0000","last_active":"2024-08-26T00:01:33.598744+0000","last_peered":"2024-08-26T00:01:33.598744+0000","last_clean":"2024-08-26T00:01:33.598744+0000","last_became_active":"2024-08-26T00:00:26.994875+0000","last_became_peered":"2024-08-26T00:00:26.994875+0000","last_unstale":"2024-08-26T00:01:33.598744+0000","last_undegraded":"2024-08-26T00:01:33.598744+0000","last_fullsized":"2024-08-26T00:01:33.598744+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:27:21.110162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595486+0000","last_change":"2024-08-26T00:00:29.361598+0000","last_active":"2024-08-26T00:01:33.595486+0000","last_peered":"2024-08-26T00:01:33.595486+0000","last_clean":"2024-08-26T00:01:33.595486+0000","last_became_active":"2024-08-26T00:00:29.361237+0000","last_became_peered":"2024-08-26T00:00:29.361237+0000","last_unstale":"2024-08-26T00:01:33.595486+0000","last_undegraded":"2024-08-26T00:01:33.595486+0000","last_fullsized":"2024-08-26T00:01:33.595486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:21:30.126060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598556+0000","last_change":"2024-08-26T00:00:29.355240+0000","last_active":"2024-08-26T00:01:33.598556+0000","last_peered":"2024-08-26T00:01:33.598556+0000","last_clean":"2024-08-26T00:01:33.598556+0000","last_became_active":"2024-08-26T00:00:29.354165+0000","last_became_peered":"2024-08-26T00:00:29.354165+0000","last_unstale":"2024-08-26T00:01:33.598556+0000","last_undegraded":"2024-08-26T00:01:33.598556+0000","last_fullsized":"2024-08-26T00:01:33.598556+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:07:56.573032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598465+0000","last_change":"2024-08-26T00:00:26.992240+0000","last_active":"2024-08-26T00:01:33.598465+0000","last_peered":"2024-08-26T00:01:33.598465+0000","last_clean":"2024-08-26T00:01:33.598465+0000","last_became_active":"2024-08-26T00:00:26.991866+0000","last_became_peered":"2024-08-26T00:00:26.991866+0000","last_unstale":"2024-08-26T00:01:33.598465+0000","last_undegraded":"2024-08-26T00:01:33.598465+0000","last_fullsized":"2024-08-26T00:01:33.598465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:25:50.815151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596690+0000","last_change":"2024-08-26T00:00:29.370358+0000","last_active":"2024-08-26T00:01:33.596690+0000","last_peered":"2024-08-26T00:01:33.596690+0000","last_clean":"2024-08-26T00:01:33.596690+0000","last_became_active":"2024-08-26T00:00:29.369910+0000","last_became_peered":"2024-08-26T00:00:29.369910+0000","last_unstale":"2024-08-26T00:01:33.596690+0000","last_undegraded":"2024-08-26T00:01:33.596690+0000","last_fullsized":"2024-08-26T00:01:33.596690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:49:11.351575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599966+0000","last_change":"2024-08-26T00:00:26.989759+0000","last_active":"2024-08-26T00:01:33.599966+0000","last_peered":"2024-08-26T00:01:33.599966+0000","last_clean":"2024-08-26T00:01:33.599966+0000","last_became_active":"2024-08-26T00:00:26.989376+0000","last_became_peered":"2024-08-26T00:00:26.989376+0000","last_unstale":"2024-08-26T00:01:33.599966+0000","last_undegraded":"2024-08-26T00:01:33.599966+0000","last_fullsized":"2024-08-26T00:01:33.599966+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:44:36.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599277+0000","last_change":"2024-08-26T00:00:29.367050+0000","last_active":"2024-08-26T00:01:33.599277+0000","last_peered":"2024-08-26T00:01:33.599277+0000","last_clean":"2024-08-26T00:01:33.599277+0000","last_became_active":"2024-08-26T00:00:29.366737+0000","last_became_peered":"2024-08-26T00:00:29.366737+0000","last_unstale":"2024-08-26T00:01:33.599277+0000","last_undegraded":"2024-08-26T00:01:33.599277+0000","last_fullsized":"2024-08-26T00:01:33.599277+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:00:54.461716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.593249+0000","last_change":"2024-08-26T00:00:27.078078+0000","last_active":"2024-08-26T00:01:33.593249+0000","last_peered":"2024-08-26T00:01:33.593249+0000","last_clean":"2024-08-26T00:01:33.593249+0000","last_became_active":"2024-08-26T00:00:27.077036+0000","last_became_peered":"2024-08-26T00:00:27.077036+0000","last_unstale":"2024-08-26T00:01:33.593249+0000","last_undegraded":"2024-08-26T00:01:33.593249+0000","last_fullsized":"2024-08-26T00:01:33.593249+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:47:44.674548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.593125+0000","last_change":"2024-08-26T00:00:29.363867+0000","last_active":"2024-08-26T00:01:33.593125+0000","last_peered":"2024-08-26T00:01:33.593125+0000","last_clean":"2024-08-26T00:01:33.593125+0000","last_became_active":"2024-08-26T00:00:29.363556+0000","last_became_peered":"2024-08-26T00:00:29.363556+0000","last_unstale":"2024-08-26T00:01:33.593125+0000","last_undegraded":"2024-08-26T00:01:33.593125+0000","last_fullsized":"2024-08-26T00:01:33.593125+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:50:04.009177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.600007+0000","last_change":"2024-08-26T00:00:26.990557+0000","last_active":"2024-08-26T00:01:33.600007+0000","last_peered":"2024-08-26T00:01:33.600007+0000","last_clean":"2024-08-26T00:01:33.600007+0000","last_became_active":"2024-08-26T00:00:26.989945+0000","last_became_peered":"2024-08-26T00:00:26.989945+0000","last_unstale":"2024-08-26T00:01:33.600007+0000","last_undegraded":"2024-08-26T00:01:33.600007+0000","last_fullsized":"2024-08-26T00:01:33.600007+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:26:54.388359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64614,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":365,"num_read_kb":249,"num_write":164,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":60637,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":193842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645340,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":884736,"data_stored":426443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874271,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36888,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708264,"statfs":{"total":95995035648,"available":95957262336,"internally_reserved":0,"allocated":1576960,"data_stored":1078906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037797,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":426657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266732,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":892928,"data_stored":426555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495663,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40968,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704184,"statfs":{"total":95995035648,"available":95953084416,"internally_reserved":0,"allocated":1490944,"data_stored":1018505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626484,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":884736,"data_stored":426046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855418,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1503232,"data_stored":1017800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018941,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":958464,"data_stored":487487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247875,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":426357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444106,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":901120,"data_stored":427189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40436,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704716,"statfs":{"total":95995035648,"available":95953629184,"internally_reserved":0,"allocated":946176,"data_stored":486454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":905216,"data_stored":427317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-26T00:01:42.991 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-26T00:01:42.991 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-26T00:01:42.991 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-08-26T00:01:42.992 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph health --format=json 2024-08-26T00:01:43.368 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:43.507 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:43 smithi042 ceph-mon[17225]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-26T00:01:43.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:43 smithi043 ceph-mon[22091]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-26T00:01:43.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:43 smithi181 ceph-mon[22102]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-26T00:01:43.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.880+0000 7fd806200640 1 -- 172.21.15.42:0/63297017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd800074c50 msgr2=0x7fd8001123f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:43.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.880+0000 7fd806200640 1 --2- 172.21.15.42:0/63297017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd800074c50 0x7fd8001123f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009900 tx=0x7fd7e802a480 comp rx=0 tx=0).stop 2024-08-26T00:01:43.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.880+0000 7fd806200640 1 -- 172.21.15.42:0/63297017 shutdown_connections 2024-08-26T00:01:43.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.880+0000 7fd806200640 1 --2- 172.21.15.42:0/63297017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd800112930 0x7fd800114d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:43.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.880+0000 7fd806200640 1 --2- 172.21.15.42:0/63297017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd800074c50 0x7fd8001123f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:43.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.880+0000 7fd806200640 1 --2- 172.21.15.42:0/63297017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd800074330 0x7fd800074710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:43.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.880+0000 7fd806200640 1 -- 172.21.15.42:0/63297017 >> 172.21.15.42:0/63297017 conn(0x7fd8000fd660 msgr2=0x7fd8000ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:43.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.881+0000 7fd806200640 1 -- 172.21.15.42:0/63297017 shutdown_connections 2024-08-26T00:01:43.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.881+0000 7fd806200640 1 -- 172.21.15.42:0/63297017 wait complete. 2024-08-26T00:01:43.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.881+0000 7fd806200640 1 Processor -- start 2024-08-26T00:01:43.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.882+0000 7fd806200640 1 -- start start 2024-08-26T00:01:43.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.882+0000 7fd806200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd800074330 0x7fd8001a45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:43.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.882+0000 7fd806200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd800074c50 0x7fd8001a4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:43.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.882+0000 7fd806200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd800112930 0x7fd80019e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:43.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.882+0000 7fd806200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd800118350 con 0x7fd800074330 2024-08-26T00:01:43.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.882+0000 7fd806200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd8001181d0 con 0x7fd800074c50 2024-08-26T00:01:43.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.882+0000 7fd806200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd8001184d0 con 0x7fd800112930 2024-08-26T00:01:43.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.882+0000 7fd7ff400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd800074330 0x7fd8001a45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:43.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.882+0000 7fd7ffe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd800112930 0x7fd80019e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:43.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.882+0000 7fd7ff400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd800074330 0x7fd8001a45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51606/0 (socket says 172.21.15.42:51606) 2024-08-26T00:01:43.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.882+0000 7fd7ff400640 1 -- 172.21.15.42:0/887037130 learned_addr learned my addr 172.21.15.42:0/887037130 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:43.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.882+0000 7fd7f7e00640 1 --2- 172.21.15.42:0/887037130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd800074c50 0x7fd8001a4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:43.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.883+0000 7fd7ffe00640 1 -- 172.21.15.42:0/887037130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd800074c50 msgr2=0x7fd8001a4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:43.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.883+0000 7fd7ffe00640 1 --2- 172.21.15.42:0/887037130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd800074c50 0x7fd8001a4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:43.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.883+0000 7fd7ffe00640 1 -- 172.21.15.42:0/887037130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd800074330 msgr2=0x7fd8001a45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:43.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.883+0000 7fd7ffe00640 1 --2- 172.21.15.42:0/887037130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd800074330 0x7fd8001a45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:43.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.883+0000 7fd7ffe00640 1 -- 172.21.15.42:0/887037130 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd80019eee0 con 0x7fd800112930 2024-08-26T00:01:43.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.883+0000 7fd7ff400640 1 --2- 172.21.15.42:0/887037130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd800074330 0x7fd8001a45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:43.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.883+0000 7fd7ffe00640 1 --2- 172.21.15.42:0/887037130 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd800112930 0x7fd80019e670 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8005fd0 tx=0x7fd7f800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:43.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.883+0000 7fd7fcc00640 1 -- 172.21.15.42:0/887037130 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f800cdf0 con 0x7fd800112930 2024-08-26T00:01:43.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.883+0000 7fd7fcc00640 1 -- 172.21.15.42:0/887037130 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7f8005020 con 0x7fd800112930 2024-08-26T00:01:43.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.883+0000 7fd806200640 1 -- 172.21.15.42:0/887037130 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd80019f1d0 con 0x7fd800112930 2024-08-26T00:01:43.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.883+0000 7fd7fcc00640 1 -- 172.21.15.42:0/887037130 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8010690 con 0x7fd800112930 2024-08-26T00:01:43.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.884+0000 7fd806200640 1 -- 172.21.15.42:0/887037130 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8001ab520 con 0x7fd800112930 2024-08-26T00:01:43.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.885+0000 7fd806200640 1 -- 172.21.15.42:0/887037130 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd800075a70 con 0x7fd800112930 2024-08-26T00:01:43.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.887+0000 7fd7fcc00640 1 -- 172.21.15.42:0/887037130 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd7f80054d0 con 0x7fd800112930 2024-08-26T00:01:43.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.888+0000 7fd7fcc00640 1 --2- 172.21.15.42:0/887037130 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd7e40a2c10 0x7fd7e40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:43.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.888+0000 7fd7fcc00640 1 -- 172.21.15.42:0/887037130 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fd7f80cf8d0 con 0x7fd800112930 2024-08-26T00:01:43.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.888+0000 7fd7ff400640 1 --2- 172.21.15.42:0/887037130 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd7e40a2c10 0x7fd7e40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:43.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.889+0000 7fd7ff400640 1 --2- 172.21.15.42:0/887037130 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd7e40a2c10 0x7fd7e40a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0005fd0 tx=0x7fd7f000b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:43.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:43.890+0000 7fd7fcc00640 1 -- 172.21.15.42:0/887037130 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd7f809c720 con 0x7fd800112930 2024-08-26T00:01:44.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:44.115+0000 7fd806200640 1 -- 172.21.15.42:0/887037130 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd8001ab6f0 con 0x7fd800112930 2024-08-26T00:01:44.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:44.116+0000 7fd7fcc00640 1 -- 172.21.15.42:0/887037130 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd7f809c020 con 0x7fd800112930 2024-08-26T00:01:44.117 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:01:44.117 INFO:teuthology.orchestra.run.smithi042.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-26T00:01:44.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:44.118+0000 7fd806200640 1 -- 172.21.15.42:0/887037130 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd7e40a2c10 msgr2=0x7fd7e40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:44.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:44.118+0000 7fd806200640 1 --2- 172.21.15.42:0/887037130 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd7e40a2c10 0x7fd7e40a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0005fd0 tx=0x7fd7f000b4a0 comp rx=0 tx=0).stop 2024-08-26T00:01:44.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:44.118+0000 7fd806200640 1 -- 172.21.15.42:0/887037130 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd800112930 msgr2=0x7fd80019e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:44.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:44.118+0000 7fd806200640 1 --2- 172.21.15.42:0/887037130 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd800112930 0x7fd80019e670 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8005fd0 tx=0x7fd7f800ef10 comp rx=0 tx=0).stop 2024-08-26T00:01:44.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:44.118+0000 7fd806200640 1 -- 172.21.15.42:0/887037130 shutdown_connections 2024-08-26T00:01:44.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:44.118+0000 7fd806200640 1 --2- 172.21.15.42:0/887037130 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd7e40a2c10 0x7fd7e40a50d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:44.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:44.118+0000 7fd806200640 1 --2- 172.21.15.42:0/887037130 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd800112930 0x7fd80019e670 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:44.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:44.118+0000 7fd806200640 1 --2- 172.21.15.42:0/887037130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd800074c50 0x7fd8001a4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:44.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:44.118+0000 7fd806200640 1 --2- 172.21.15.42:0/887037130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd800074330 0x7fd8001a45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:44.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:44.118+0000 7fd806200640 1 -- 172.21.15.42:0/887037130 >> 172.21.15.42:0/887037130 conn(0x7fd8000fd660 msgr2=0x7fd8000fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:44.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:44.118+0000 7fd806200640 1 -- 172.21.15.42:0/887037130 shutdown_connections 2024-08-26T00:01:44.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:44.118+0000 7fd806200640 1 -- 172.21.15.42:0/887037130 wait complete. 2024-08-26T00:01:44.499 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:44 smithi042 ceph-mon[17225]: pgmap v315: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 6.0 KiB/s, 0 objects/s recovering 2024-08-26T00:01:44.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:44 smithi043 ceph-mon[22091]: pgmap v315: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 6.0 KiB/s, 0 objects/s recovering 2024-08-26T00:01:44.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:44 smithi181 ceph-mon[22102]: pgmap v315: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 6.0 KiB/s, 0 objects/s recovering 2024-08-26T00:01:44.818 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-08-26T00:01:44.818 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:01:45.196 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:45.411 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:45 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/887037130' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-08-26T00:01:45.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:45 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/887037130' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-08-26T00:01:45.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:45 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/887037130' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-08-26T00:01:45.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.704+0000 7f4548800640 1 -- 172.21.15.42:0/1510819564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45401044f0 msgr2=0x7f45401109d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:45.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.704+0000 7f4548800640 1 --2- 172.21.15.42:0/1510819564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45401044f0 0x7f45401109d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f453c009ca0 tx=0x7f453c02a8c0 comp rx=0 tx=0).stop 2024-08-26T00:01:45.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.704+0000 7f4548800640 1 -- 172.21.15.42:0/1510819564 shutdown_connections 2024-08-26T00:01:45.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.704+0000 7f4548800640 1 --2- 172.21.15.42:0/1510819564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45401044f0 0x7f45401109d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:45.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.704+0000 7f4548800640 1 --2- 172.21.15.42:0/1510819564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4540103b50 0x7f4540103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:45.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.704+0000 7f4548800640 1 --2- 172.21.15.42:0/1510819564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4540109c00 0x7f4540109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:45.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.704+0000 7f4548800640 1 -- 172.21.15.42:0/1510819564 >> 172.21.15.42:0/1510819564 conn(0x7f45400ff830 msgr2=0x7f4540101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:45.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.704+0000 7f4548800640 1 -- 172.21.15.42:0/1510819564 shutdown_connections 2024-08-26T00:01:45.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.705+0000 7f4548800640 1 -- 172.21.15.42:0/1510819564 wait complete. 2024-08-26T00:01:45.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.705+0000 7f4548800640 1 Processor -- start 2024-08-26T00:01:45.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.706+0000 7f4548800640 1 -- start start 2024-08-26T00:01:45.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.706+0000 7f4548800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4540103b50 0x7f454019a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:45.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.706+0000 7f4548800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45401044f0 0x7f454019a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:45.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.706+0000 7f4548800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4540109c00 0x7f454019ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:45.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.706+0000 7f4548800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4540113f60 con 0x7f45401044f0 2024-08-26T00:01:45.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.706+0000 7f4548800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4540113de0 con 0x7f4540103b50 2024-08-26T00:01:45.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.706+0000 7f4548800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f45401140e0 con 0x7f4540109c00 2024-08-26T00:01:45.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.706+0000 7f4545400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45401044f0 0x7f454019a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:45.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.706+0000 7f4545e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4540103b50 0x7f454019a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:45.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.706+0000 7f4545e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4540103b50 0x7f454019a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:37708/0 (socket says 172.21.15.42:37708) 2024-08-26T00:01:45.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.706+0000 7f4545e00640 1 -- 172.21.15.42:0/3986384888 learned_addr learned my addr 172.21.15.42:0/3986384888 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:45.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.706+0000 7f4546800640 1 --2- 172.21.15.42:0/3986384888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4540109c00 0x7f454019ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:45.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.707+0000 7f4545400640 1 -- 172.21.15.42:0/3986384888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4540109c00 msgr2=0x7f454019ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:45.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.707+0000 7f4545400640 1 --2- 172.21.15.42:0/3986384888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4540109c00 0x7f454019ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:45.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.707+0000 7f4545400640 1 -- 172.21.15.42:0/3986384888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4540103b50 msgr2=0x7f454019a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:45.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.707+0000 7f4545400640 1 --2- 172.21.15.42:0/3986384888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4540103b50 0x7f454019a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:45.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.707+0000 7f4545400640 1 -- 172.21.15.42:0/3986384888 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454019f290 con 0x7f45401044f0 2024-08-26T00:01:45.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.707+0000 7f4545e00640 1 --2- 172.21.15.42:0/3986384888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4540103b50 0x7f454019a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:45.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.707+0000 7f4545400640 1 --2- 172.21.15.42:0/3986384888 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45401044f0 0x7f454019a820 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f453000e9f0 tx=0x7f453000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:45.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.707+0000 7f453aa00640 1 -- 172.21.15.42:0/3986384888 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453000ccc0 con 0x7f45401044f0 2024-08-26T00:01:45.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.707+0000 7f453aa00640 1 -- 172.21.15.42:0/3986384888 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4530010910 con 0x7f45401044f0 2024-08-26T00:01:45.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.707+0000 7f4548800640 1 -- 172.21.15.42:0/3986384888 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f454019f580 con 0x7f45401044f0 2024-08-26T00:01:45.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.707+0000 7f453aa00640 1 -- 172.21.15.42:0/3986384888 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4530018960 con 0x7f45401044f0 2024-08-26T00:01:45.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.708+0000 7f4548800640 1 -- 172.21.15.42:0/3986384888 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45401a6e60 con 0x7f45401044f0 2024-08-26T00:01:45.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.709+0000 7f4548800640 1 -- 172.21.15.42:0/3986384888 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4540103fb0 con 0x7f45401044f0 2024-08-26T00:01:45.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.710+0000 7f453aa00640 1 -- 172.21.15.42:0/3986384888 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4530010ac0 con 0x7f45401044f0 2024-08-26T00:01:45.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.712+0000 7f453aa00640 1 --2- 172.21.15.42:0/3986384888 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f45280a2c10 0x7f45280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:45.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.712+0000 7f453aa00640 1 -- 172.21.15.42:0/3986384888 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f45300cf5a0 con 0x7f45401044f0 2024-08-26T00:01:45.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.712+0000 7f4545e00640 1 --2- 172.21.15.42:0/3986384888 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f45280a2c10 0x7f45280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:45.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.713+0000 7f4545e00640 1 --2- 172.21.15.42:0/3986384888 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f45280a2c10 0x7f45280a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4534011500 tx=0x7f4534005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:45.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.716+0000 7f453aa00640 1 -- 172.21.15.42:0/3986384888 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f453009bd10 con 0x7f45401044f0 2024-08-26T00:01:45.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.939+0000 7f4548800640 1 -- 172.21.15.42:0/3986384888 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45401a7090 con 0x7f45401044f0 2024-08-26T00:01:45.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.940+0000 7f453aa00640 1 -- 172.21.15.42:0/3986384888 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11909 (secure 0 0 0) 0x7f45300a0010 con 0x7f45401044f0 2024-08-26T00:01:45.942 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:01:45.942 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":23,"btime":"2024-08-26T00:00:42:404711+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3168581452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3168581452},{"type":"v1","addr":"172.21.15.42:6839","nonce":3168581452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/3533492491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":3533492491},{"type":"v1","addr":"172.21.15.42:6841","nonce":3533492491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-26T00:00:30.169633+0000","modified":"2024-08-26T00:00:42.314271+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24532,"mds_1":24527,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6839/2653014277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2653014277},{"type":"v1","addr":"172.21.15.43:6839","nonce":2653014277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24532,"qdb_cluster":[24514,24527,24532]},"id":1}]} 2024-08-26T00:01:45.942 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 23 2024-08-26T00:01:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.943+0000 7f4548800640 1 -- 172.21.15.42:0/3986384888 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f45280a2c10 msgr2=0x7f45280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.943+0000 7f4548800640 1 --2- 172.21.15.42:0/3986384888 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f45280a2c10 0x7f45280a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4534011500 tx=0x7f4534005f90 comp rx=0 tx=0).stop 2024-08-26T00:01:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.943+0000 7f4548800640 1 -- 172.21.15.42:0/3986384888 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45401044f0 msgr2=0x7f454019a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.943+0000 7f4548800640 1 --2- 172.21.15.42:0/3986384888 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45401044f0 0x7f454019a820 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f453000e9f0 tx=0x7f453000eeb0 comp rx=0 tx=0).stop 2024-08-26T00:01:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.943+0000 7f4548800640 1 -- 172.21.15.42:0/3986384888 shutdown_connections 2024-08-26T00:01:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.943+0000 7f4548800640 1 --2- 172.21.15.42:0/3986384888 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f45280a2c10 0x7f45280a50d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:45.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.943+0000 7f4548800640 1 --2- 172.21.15.42:0/3986384888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4540109c00 0x7f454019ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:45.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.943+0000 7f4548800640 1 --2- 172.21.15.42:0/3986384888 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45401044f0 0x7f454019a820 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:45.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.943+0000 7f4548800640 1 --2- 172.21.15.42:0/3986384888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4540103b50 0x7f454019a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:45.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.943+0000 7f4548800640 1 -- 172.21.15.42:0/3986384888 >> 172.21.15.42:0/3986384888 conn(0x7f45400ff830 msgr2=0x7f4540100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:45.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.943+0000 7f4548800640 1 -- 172.21.15.42:0/3986384888 shutdown_connections 2024-08-26T00:01:45.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:45.943+0000 7f4548800640 1 -- 172.21.15.42:0/3986384888 wait complete. 2024-08-26T00:01:46.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:46 smithi042 ceph-mon[17225]: pgmap v316: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 5.4 KiB/s, 0 objects/s recovering 2024-08-26T00:01:46.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:46 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/3986384888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:01:46.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:46 smithi043 ceph-mon[22091]: pgmap v316: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 5.4 KiB/s, 0 objects/s recovering 2024-08-26T00:01:46.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:46 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/3986384888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:01:46.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:46 smithi181 ceph-mon[22102]: pgmap v316: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 5.4 KiB/s, 0 objects/s recovering 2024-08-26T00:01:46.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:46 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/3986384888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:01:46.684 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:01:47.062 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:47.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.613+0000 7fbc81c00640 1 -- 172.21.15.42:0/413377451 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc7c109970 msgr2=0x7fbc7c109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:47.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.613+0000 7fbc81c00640 1 --2- 172.21.15.42:0/413377451 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc7c109970 0x7fbc7c109d50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009930 tx=0x7fbc6c02a420 comp rx=0 tx=0).stop 2024-08-26T00:01:47.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.613+0000 7fbc81c00640 1 -- 172.21.15.42:0/413377451 shutdown_connections 2024-08-26T00:01:47.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.613+0000 7fbc81c00640 1 --2- 172.21.15.42:0/413377451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc7c104310 0x7fbc7c110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:47.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.613+0000 7fbc81c00640 1 --2- 172.21.15.42:0/413377451 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbc7c103970 0x7fbc7c103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:47.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.613+0000 7fbc81c00640 1 --2- 172.21.15.42:0/413377451 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc7c109970 0x7fbc7c109d50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:47.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.613+0000 7fbc81c00640 1 -- 172.21.15.42:0/413377451 >> 172.21.15.42:0/413377451 conn(0x7fbc7c0ff6b0 msgr2=0x7fbc7c101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:47.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.613+0000 7fbc81c00640 1 -- 172.21.15.42:0/413377451 shutdown_connections 2024-08-26T00:01:47.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.613+0000 7fbc81c00640 1 -- 172.21.15.42:0/413377451 wait complete. 2024-08-26T00:01:47.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.614+0000 7fbc81c00640 1 Processor -- start 2024-08-26T00:01:47.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.615+0000 7fbc81c00640 1 -- start start 2024-08-26T00:01:47.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.615+0000 7fbc81c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc7c103970 0x7fbc7c19a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:47.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.615+0000 7fbc81c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc7c104310 0x7fbc7c19a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:47.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.615+0000 7fbc81c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbc7c109970 0x7fbc7c19eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:47.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.615+0000 7fbc81c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7c113dc0 con 0x7fbc7c104310 2024-08-26T00:01:47.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.615+0000 7fbc81c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7c113c40 con 0x7fbc7c103970 2024-08-26T00:01:47.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.615+0000 7fbc81c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7c113f40 con 0x7fbc7c109970 2024-08-26T00:01:47.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.615+0000 7fbc73e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc7c104310 0x7fbc7c19a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:47.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.615+0000 7fbc73e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc7c104310 0x7fbc7c19a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35942/0 (socket says 172.21.15.42:35942) 2024-08-26T00:01:47.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.615+0000 7fbc73e00640 1 -- 172.21.15.42:0/3247467466 learned_addr learned my addr 172.21.15.42:0/3247467466 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:47.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.616+0000 7fbc7be00640 1 --2- 172.21.15.42:0/3247467466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc7c103970 0x7fbc7c19a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:47.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.616+0000 7fbc81200640 1 --2- 172.21.15.42:0/3247467466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbc7c109970 0x7fbc7c19eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:47.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.616+0000 7fbc73e00640 1 -- 172.21.15.42:0/3247467466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbc7c109970 msgr2=0x7fbc7c19eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:47.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.616+0000 7fbc73e00640 1 --2- 172.21.15.42:0/3247467466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbc7c109970 0x7fbc7c19eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:47.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.616+0000 7fbc73e00640 1 -- 172.21.15.42:0/3247467466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc7c103970 msgr2=0x7fbc7c19a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:47.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.616+0000 7fbc73e00640 1 --2- 172.21.15.42:0/3247467466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc7c103970 0x7fbc7c19a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:47.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.616+0000 7fbc73e00640 1 -- 172.21.15.42:0/3247467466 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc7c19f270 con 0x7fbc7c104310 2024-08-26T00:01:47.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.616+0000 7fbc81200640 1 --2- 172.21.15.42:0/3247467466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbc7c109970 0x7fbc7c19eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:47.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.616+0000 7fbc7be00640 1 --2- 172.21.15.42:0/3247467466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc7c103970 0x7fbc7c19a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:47.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.616+0000 7fbc73e00640 1 --2- 172.21.15.42:0/3247467466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc7c104310 0x7fbc7c19a800 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400d770 tx=0x7fbc6400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:47.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.616+0000 7fbc79600640 1 -- 172.21.15.42:0/3247467466 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc64017070 con 0x7fbc7c104310 2024-08-26T00:01:47.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.616+0000 7fbc79600640 1 -- 172.21.15.42:0/3247467466 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc64005500 con 0x7fbc7c104310 2024-08-26T00:01:47.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.617+0000 7fbc81c00640 1 -- 172.21.15.42:0/3247467466 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc7c19f560 con 0x7fbc7c104310 2024-08-26T00:01:47.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.617+0000 7fbc79600640 1 -- 172.21.15.42:0/3247467466 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc64004e00 con 0x7fbc7c104310 2024-08-26T00:01:47.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.617+0000 7fbc81c00640 1 -- 172.21.15.42:0/3247467466 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc7c1a6e40 con 0x7fbc7c104310 2024-08-26T00:01:47.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.618+0000 7fbc81c00640 1 -- 172.21.15.42:0/3247467466 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc7c1050b0 con 0x7fbc7c104310 2024-08-26T00:01:47.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.620+0000 7fbc79600640 1 -- 172.21.15.42:0/3247467466 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbc64004fa0 con 0x7fbc7c104310 2024-08-26T00:01:47.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.621+0000 7fbc79600640 1 --2- 172.21.15.42:0/3247467466 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fbc600a2c10 0x7fbc600a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:47.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.621+0000 7fbc79600640 1 -- 172.21.15.42:0/3247467466 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fbc640ceb90 con 0x7fbc7c104310 2024-08-26T00:01:47.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.621+0000 7fbc7be00640 1 --2- 172.21.15.42:0/3247467466 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fbc600a2c10 0x7fbc600a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:47.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.622+0000 7fbc7be00640 1 --2- 172.21.15.42:0/3247467466 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fbc600a2c10 0x7fbc600a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c006010 tx=0x7fbc6c031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:47.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.626+0000 7fbc79600640 1 -- 172.21.15.42:0/3247467466 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fbc6409b300 con 0x7fbc7c104310 2024-08-26T00:01:47.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.844+0000 7fbc81c00640 1 -- 172.21.15.42:0/3247467466 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc7c10bf10 con 0x7fbc7c104310 2024-08-26T00:01:47.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.845+0000 7fbc79600640 1 -- 172.21.15.42:0/3247467466 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11909 (secure 0 0 0) 0x7fbc6409f600 con 0x7fbc7c104310 2024-08-26T00:01:47.847 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:01:47.847 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":23,"btime":"2024-08-26T00:00:42:404711+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3168581452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3168581452},{"type":"v1","addr":"172.21.15.42:6839","nonce":3168581452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/3533492491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":3533492491},{"type":"v1","addr":"172.21.15.42:6841","nonce":3533492491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-26T00:00:30.169633+0000","modified":"2024-08-26T00:00:42.314271+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24532,"mds_1":24527,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6839/2653014277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2653014277},{"type":"v1","addr":"172.21.15.43:6839","nonce":2653014277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24532,"qdb_cluster":[24514,24527,24532]},"id":1}]} 2024-08-26T00:01:47.847 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 23 2024-08-26T00:01:47.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.847+0000 7fbc81c00640 1 -- 172.21.15.42:0/3247467466 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fbc600a2c10 msgr2=0x7fbc600a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:47.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.847+0000 7fbc81c00640 1 --2- 172.21.15.42:0/3247467466 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fbc600a2c10 0x7fbc600a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c006010 tx=0x7fbc6c031510 comp rx=0 tx=0).stop 2024-08-26T00:01:47.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.847+0000 7fbc81c00640 1 -- 172.21.15.42:0/3247467466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc7c104310 msgr2=0x7fbc7c19a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:47.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.847+0000 7fbc81c00640 1 --2- 172.21.15.42:0/3247467466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc7c104310 0x7fbc7c19a800 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400d770 tx=0x7fbc6400dc30 comp rx=0 tx=0).stop 2024-08-26T00:01:47.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.848+0000 7fbc81c00640 1 -- 172.21.15.42:0/3247467466 shutdown_connections 2024-08-26T00:01:47.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.848+0000 7fbc81c00640 1 --2- 172.21.15.42:0/3247467466 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fbc600a2c10 0x7fbc600a50d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:47.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.848+0000 7fbc81c00640 1 --2- 172.21.15.42:0/3247467466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbc7c109970 0x7fbc7c19eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:47.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.848+0000 7fbc81c00640 1 --2- 172.21.15.42:0/3247467466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc7c104310 0x7fbc7c19a800 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:47.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.848+0000 7fbc81c00640 1 --2- 172.21.15.42:0/3247467466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc7c103970 0x7fbc7c19a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:47.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.848+0000 7fbc81c00640 1 -- 172.21.15.42:0/3247467466 >> 172.21.15.42:0/3247467466 conn(0x7fbc7c0ff6b0 msgr2=0x7fbc7c0fff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:47.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.848+0000 7fbc81c00640 1 -- 172.21.15.42:0/3247467466 shutdown_connections 2024-08-26T00:01:47.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:47.848+0000 7fbc81c00640 1 -- 172.21.15.42:0/3247467466 wait complete. 2024-08-26T00:01:48.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:48 smithi043 ceph-mon[22091]: pgmap v317: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s; 4.9 KiB/s, 0 objects/s recovering 2024-08-26T00:01:48.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:48 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/3247467466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:01:48.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:48 smithi042 ceph-mon[17225]: pgmap v317: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s; 4.9 KiB/s, 0 objects/s recovering 2024-08-26T00:01:48.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:48 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/3247467466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:01:48.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:48 smithi181 ceph-mon[22102]: pgmap v317: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s; 4.9 KiB/s, 0 objects/s recovering 2024-08-26T00:01:48.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:48 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/3247467466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:01:48.610 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd dump --format=json 2024-08-26T00:01:48.988 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:49.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.572+0000 7feaebc00640 1 -- 172.21.15.42:0/3052136627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feae4108ee0 msgr2=0x7feae4110a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:49.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.572+0000 7feaebc00640 1 --2- 172.21.15.42:0/3052136627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feae4108ee0 0x7feae4110a60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7feadc009ca0 tx=0x7feadc02a8c0 comp rx=0 tx=0).stop 2024-08-26T00:01:49.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.572+0000 7feaebc00640 1 -- 172.21.15.42:0/3052136627 shutdown_connections 2024-08-26T00:01:49.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.572+0000 7feaebc00640 1 --2- 172.21.15.42:0/3052136627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feae4108ee0 0x7feae4110a60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:49.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.572+0000 7feaebc00640 1 --2- 172.21.15.42:0/3052136627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feae4104760 0x7feae41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:49.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.572+0000 7feaebc00640 1 --2- 172.21.15.42:0/3052136627 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feae4103db0 0x7feae4104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:49.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.572+0000 7feaebc00640 1 -- 172.21.15.42:0/3052136627 >> 172.21.15.42:0/3052136627 conn(0x7feae40ff7f0 msgr2=0x7feae4101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:49.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.572+0000 7feaebc00640 1 -- 172.21.15.42:0/3052136627 shutdown_connections 2024-08-26T00:01:49.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.572+0000 7feaebc00640 1 -- 172.21.15.42:0/3052136627 wait complete. 2024-08-26T00:01:49.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.573+0000 7feaebc00640 1 Processor -- start 2024-08-26T00:01:49.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.573+0000 7feaebc00640 1 -- start start 2024-08-26T00:01:49.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.574+0000 7feaebc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feae4103db0 0x7feae419a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:49.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.574+0000 7feaebc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feae4104760 0x7feae419a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:49.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.574+0000 7feaebc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feae4108ee0 0x7feae419ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:49.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.574+0000 7feaebc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7feae4113f90 con 0x7feae4103db0 2024-08-26T00:01:49.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.574+0000 7feaebc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7feae4113e10 con 0x7feae4108ee0 2024-08-26T00:01:49.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.574+0000 7feaebc00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7feae4114110 con 0x7feae4104760 2024-08-26T00:01:49.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.574+0000 7feae9200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feae4103db0 0x7feae419a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:49.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.574+0000 7feae9200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feae4103db0 0x7feae419a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35956/0 (socket says 172.21.15.42:35956) 2024-08-26T00:01:49.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.574+0000 7feae9200640 1 -- 172.21.15.42:0/345274535 learned_addr learned my addr 172.21.15.42:0/345274535 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:49.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.574+0000 7feadbe00640 1 --2- 172.21.15.42:0/345274535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feae4104760 0x7feae419a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:49.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.574+0000 7feae9c00640 1 --2- 172.21.15.42:0/345274535 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feae4108ee0 0x7feae419ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:49.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.575+0000 7feadbe00640 1 -- 172.21.15.42:0/345274535 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feae4108ee0 msgr2=0x7feae419ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:49.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.575+0000 7feadbe00640 1 --2- 172.21.15.42:0/345274535 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feae4108ee0 0x7feae419ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:49.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.575+0000 7feadbe00640 1 -- 172.21.15.42:0/345274535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feae4103db0 msgr2=0x7feae419a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:49.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.575+0000 7feadbe00640 1 --2- 172.21.15.42:0/345274535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feae4103db0 0x7feae419a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:49.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.575+0000 7feadbe00640 1 -- 172.21.15.42:0/345274535 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae419f340 con 0x7feae4104760 2024-08-26T00:01:49.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.575+0000 7feae9200640 1 --2- 172.21.15.42:0/345274535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feae4103db0 0x7feae419a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:01:49.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.575+0000 7feadbe00640 1 --2- 172.21.15.42:0/345274535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feae4104760 0x7feae419a8d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feacc00e9f0 tx=0x7feacc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:49.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.575+0000 7feae2000640 1 -- 172.21.15.42:0/345274535 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feacc00ccc0 con 0x7feae4104760 2024-08-26T00:01:49.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.575+0000 7feaebc00640 1 -- 172.21.15.42:0/345274535 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feae419f630 con 0x7feae4104760 2024-08-26T00:01:49.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.575+0000 7feae2000640 1 -- 172.21.15.42:0/345274535 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feacc010910 con 0x7feae4104760 2024-08-26T00:01:49.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.575+0000 7feae2000640 1 -- 172.21.15.42:0/345274535 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feacc018960 con 0x7feae4104760 2024-08-26T00:01:49.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.575+0000 7feaebc00640 1 -- 172.21.15.42:0/345274535 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feae41a6f10 con 0x7feae4104760 2024-08-26T00:01:49.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.576+0000 7feaebc00640 1 -- 172.21.15.42:0/345274535 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feae4104190 con 0x7feae4104760 2024-08-26T00:01:49.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.578+0000 7feae2000640 1 -- 172.21.15.42:0/345274535 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7feacc010ac0 con 0x7feae4104760 2024-08-26T00:01:49.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.580+0000 7feae2000640 1 --2- 172.21.15.42:0/345274535 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7feac80a2c10 0x7feac80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:49.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.580+0000 7feae2000640 1 -- 172.21.15.42:0/345274535 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7feacc0cf5e0 con 0x7feae4104760 2024-08-26T00:01:49.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.580+0000 7feae9200640 1 --2- 172.21.15.42:0/345274535 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7feac80a2c10 0x7feac80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:49.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.581+0000 7feae9200640 1 --2- 172.21.15.42:0/345274535 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7feac80a2c10 0x7feac80a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fead4005fd0 tx=0x7fead400b710 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:49.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.585+0000 7feae2000640 1 -- 172.21.15.42:0/345274535 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7feacc09c3a0 con 0x7feae4104760 2024-08-26T00:01:49.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.769+0000 7feaebc00640 1 -- 172.21.15.42:0/345274535 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feae410c120 con 0x7feae4104760 2024-08-26T00:01:49.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.771+0000 7feae2000640 1 -- 172.21.15.42:0/345274535 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22625 (secure 0 0 0) 0x7feacc09bca0 con 0x7feae4104760 2024-08-26T00:01:49.773 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:01:49.773 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":80,"fsid":"f89d317a-633c-11ef-bcd2-c7b262605968","created":"2024-08-25T23:52:39.598509+0000","modified":"2024-08-26T00:01:33.588911+0000","last_up_change":"2024-08-25T23:59:35.047575+0000","last_in_change":"2024-08-25T23:59:12.796940+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-25T23:55:51.022219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-26T00:00:25.606536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-26T00:00:28.322822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"980d8635-bca1-4c5a-b78e-4b44f9315d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6803","nonce":2657450248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6805","nonce":2657450248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6809","nonce":2657450248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6807","nonce":2657450248}]},"public_addr":"172.21.15.42:6803/2657450248","cluster_addr":"172.21.15.42:6805/2657450248","heartbeat_back_addr":"172.21.15.42:6809/2657450248","heartbeat_front_addr":"172.21.15.42:6807/2657450248","state":["exists","up"]},{"osd":1,"uuid":"e5f8dc3b-876a-4bdd-b6b0-b0d99d098d95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6801","nonce":2396081001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6803","nonce":2396081001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6807","nonce":2396081001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6805","nonce":2396081001}]},"public_addr":"172.21.15.43:6801/2396081001","cluster_addr":"172.21.15.43:6803/2396081001","heartbeat_back_addr":"172.21.15.43:6807/2396081001","heartbeat_front_addr":"172.21.15.43:6805/2396081001","state":["exists","up"]},{"osd":2,"uuid":"06eb25af-8e3d-4f90-bc24-28a9bc224c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6801","nonce":189987070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6803","nonce":189987070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6807","nonce":189987070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6805","nonce":189987070}]},"public_addr":"172.21.15.181:6801/189987070","cluster_addr":"172.21.15.181:6803/189987070","heartbeat_back_addr":"172.21.15.181:6807/189987070","heartbeat_front_addr":"172.21.15.181:6805/189987070","state":["exists","up"]},{"osd":3,"uuid":"c78dbc49-b5c7-4f82-be36-c76a89496520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6811","nonce":251017896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6813","nonce":251017896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6817","nonce":251017896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6815","nonce":251017896}]},"public_addr":"172.21.15.42:6811/251017896","cluster_addr":"172.21.15.42:6813/251017896","heartbeat_back_addr":"172.21.15.42:6817/251017896","heartbeat_front_addr":"172.21.15.42:6815/251017896","state":["exists","up"]},{"osd":4,"uuid":"ba633f66-25af-492f-bbf2-76032a4cd3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6809","nonce":1315420796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6811","nonce":1315420796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6815","nonce":1315420796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6813","nonce":1315420796}]},"public_addr":"172.21.15.43:6809/1315420796","cluster_addr":"172.21.15.43:6811/1315420796","heartbeat_back_addr":"172.21.15.43:6815/1315420796","heartbeat_front_addr":"172.21.15.43:6813/1315420796","state":["exists","up"]},{"osd":5,"uuid":"04e47ad9-21ba-43da-9793-d5cf83150dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6809","nonce":246971403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6811","nonce":246971403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6815","nonce":246971403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6813","nonce":246971403}]},"public_addr":"172.21.15.181:6809/246971403","cluster_addr":"172.21.15.181:6811/246971403","heartbeat_back_addr":"172.21.15.181:6815/246971403","heartbeat_front_addr":"172.21.15.181:6813/246971403","state":["exists","up"]},{"osd":6,"uuid":"f48161cd-bc44-4d99-8248-1bb845111129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6819","nonce":2910656480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6821","nonce":2910656480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6825","nonce":2910656480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6823","nonce":2910656480}]},"public_addr":"172.21.15.42:6819/2910656480","cluster_addr":"172.21.15.42:6821/2910656480","heartbeat_back_addr":"172.21.15.42:6825/2910656480","heartbeat_front_addr":"172.21.15.42:6823/2910656480","state":["exists","up"]},{"osd":7,"uuid":"65470b06-b14d-4d8e-9bcb-e6927c37fda5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6817","nonce":624542778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6819","nonce":624542778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6823","nonce":624542778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6821","nonce":624542778}]},"public_addr":"172.21.15.43:6817/624542778","cluster_addr":"172.21.15.43:6819/624542778","heartbeat_back_addr":"172.21.15.43:6823/624542778","heartbeat_front_addr":"172.21.15.43:6821/624542778","state":["exists","up"]},{"osd":8,"uuid":"1f4c9152-4b7c-415f-9cb9-d1e926fad5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6817","nonce":728226568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6819","nonce":728226568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6823","nonce":728226568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6821","nonce":728226568}]},"public_addr":"172.21.15.181:6817/728226568","cluster_addr":"172.21.15.181:6819/728226568","heartbeat_back_addr":"172.21.15.181:6823/728226568","heartbeat_front_addr":"172.21.15.181:6821/728226568","state":["exists","up"]},{"osd":9,"uuid":"fb387fbe-19b4-4a3e-8e40-81bd1363b55c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6827","nonce":1052069444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6829","nonce":1052069444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6833","nonce":1052069444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6831","nonce":1052069444}]},"public_addr":"172.21.15.42:6827/1052069444","cluster_addr":"172.21.15.42:6829/1052069444","heartbeat_back_addr":"172.21.15.42:6833/1052069444","heartbeat_front_addr":"172.21.15.42:6831/1052069444","state":["exists","up"]},{"osd":10,"uuid":"fe5bbeec-2341-4ea9-97ab-cc45d738d741","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6825","nonce":3417487386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6827","nonce":3417487386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6831","nonce":3417487386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6829","nonce":3417487386}]},"public_addr":"172.21.15.43:6825/3417487386","cluster_addr":"172.21.15.43:6827/3417487386","heartbeat_back_addr":"172.21.15.43:6831/3417487386","heartbeat_front_addr":"172.21.15.43:6829/3417487386","state":["exists","up"]},{"osd":11,"uuid":"cee07741-3ab7-481e-8477-54319f4f178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6825","nonce":3817502913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6827","nonce":3817502913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6831","nonce":3817502913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6829","nonce":3817502913}]},"public_addr":"172.21.15.181:6825/3817502913","cluster_addr":"172.21.15.181:6827/3817502913","heartbeat_back_addr":"172.21.15.181:6831/3817502913","heartbeat_front_addr":"172.21.15.181:6829/3817502913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:00.603592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:24.637326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:47.587859+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:14.978783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:39.025819+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:01.965471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:29.753475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:54.162377+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:17.970871+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:46.175576+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:10.590220+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:33.216701+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/3711239085":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6801/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2983166615":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/2974122891":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2980210051":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/4227793902":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6801/1517739376":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6800/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/1775009918":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6800/1517739376":"2024-08-26T23:53:05.122858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-26T00:01:49.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.773+0000 7feaebc00640 1 -- 172.21.15.42:0/345274535 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7feac80a2c10 msgr2=0x7feac80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:49.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.773+0000 7feaebc00640 1 --2- 172.21.15.42:0/345274535 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7feac80a2c10 0x7feac80a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fead4005fd0 tx=0x7fead400b710 comp rx=0 tx=0).stop 2024-08-26T00:01:49.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.773+0000 7feaebc00640 1 -- 172.21.15.42:0/345274535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feae4104760 msgr2=0x7feae419a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:49.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.773+0000 7feaebc00640 1 --2- 172.21.15.42:0/345274535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feae4104760 0x7feae419a8d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feacc00e9f0 tx=0x7feacc00eeb0 comp rx=0 tx=0).stop 2024-08-26T00:01:49.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.773+0000 7feaebc00640 1 -- 172.21.15.42:0/345274535 shutdown_connections 2024-08-26T00:01:49.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.773+0000 7feaebc00640 1 --2- 172.21.15.42:0/345274535 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7feac80a2c10 0x7feac80a50d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:49.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.773+0000 7feaebc00640 1 --2- 172.21.15.42:0/345274535 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feae4108ee0 0x7feae419ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:49.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.773+0000 7feaebc00640 1 --2- 172.21.15.42:0/345274535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feae4104760 0x7feae419a8d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:49.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.773+0000 7feaebc00640 1 --2- 172.21.15.42:0/345274535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feae4103db0 0x7feae419a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:49.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.773+0000 7feaebc00640 1 -- 172.21.15.42:0/345274535 >> 172.21.15.42:0/345274535 conn(0x7feae40ff7f0 msgr2=0x7feae4100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:49.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.774+0000 7feaebc00640 1 -- 172.21.15.42:0/345274535 shutdown_connections 2024-08-26T00:01:49.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:49.774+0000 7feaebc00640 1 -- 172.21.15.42:0/345274535 wait complete. 2024-08-26T00:01:50.438 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:50 smithi042 ceph-mon[17225]: pgmap v318: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 4.9 KiB/s, 0 objects/s recovering 2024-08-26T00:01:50.438 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:50 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/345274535' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:01:50.479 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:01:50.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:50 smithi043 ceph-mon[22091]: pgmap v318: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 4.9 KiB/s, 0 objects/s recovering 2024-08-26T00:01:50.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:50 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/345274535' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:01:50.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:50 smithi181 ceph-mon[22102]: pgmap v318: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 4.9 KiB/s, 0 objects/s recovering 2024-08-26T00:01:50.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:50 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/345274535' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:01:50.856 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:51.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.394+0000 7f13b5a00640 1 -- 172.21.15.42:0/1334686839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13b00764c0 msgr2=0x7f13b00768a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:51.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.394+0000 7f13b5a00640 1 --2- 172.21.15.42:0/1334686839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13b00764c0 0x7f13b00768a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f13a0009900 tx=0x7f13a002a3f0 comp rx=0 tx=0).stop 2024-08-26T00:01:51.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.395+0000 7f13b5a00640 1 -- 172.21.15.42:0/1334686839 shutdown_connections 2024-08-26T00:01:51.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.395+0000 7f13b5a00640 1 --2- 172.21.15.42:0/1334686839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13b01127d0 0x7f13b0114bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:51.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.395+0000 7f13b5a00640 1 --2- 172.21.15.42:0/1334686839 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13b0076de0 0x7f13b0112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:51.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.395+0000 7f13b5a00640 1 --2- 172.21.15.42:0/1334686839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13b00764c0 0x7f13b00768a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:51.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.395+0000 7f13b5a00640 1 -- 172.21.15.42:0/1334686839 >> 172.21.15.42:0/1334686839 conn(0x7f13b00ff830 msgr2=0x7f13b0101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:51.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.395+0000 7f13b5a00640 1 -- 172.21.15.42:0/1334686839 shutdown_connections 2024-08-26T00:01:51.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.395+0000 7f13b5a00640 1 -- 172.21.15.42:0/1334686839 wait complete. 2024-08-26T00:01:51.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.396+0000 7f13b5a00640 1 Processor -- start 2024-08-26T00:01:51.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.396+0000 7f13b5a00640 1 -- start start 2024-08-26T00:01:51.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.396+0000 7f13b5a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13b00764c0 0x7f13b01a45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:51.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.396+0000 7f13b5a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13b0076de0 0x7f13b01a4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:51.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.396+0000 7f13b5a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13b01127d0 0x7f13b019e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:51.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.396+0000 7f13b5a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f13b01183b0 con 0x7f13b01127d0 2024-08-26T00:01:51.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.396+0000 7f13b5a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f13b0118230 con 0x7f13b00764c0 2024-08-26T00:01:51.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.396+0000 7f13b5a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f13b0118530 con 0x7f13b0076de0 2024-08-26T00:01:51.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.397+0000 7f13af400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13b01127d0 0x7f13b019e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:51.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.397+0000 7f13aea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13b00764c0 0x7f13b01a45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.397+0000 7f13af400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13b01127d0 0x7f13b019e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35982/0 (socket says 172.21.15.42:35982) 2024-08-26T00:01:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.397+0000 7f13af400640 1 -- 172.21.15.42:0/931129432 learned_addr learned my addr 172.21.15.42:0/931129432 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.397+0000 7f13a6000640 1 --2- 172.21.15.42:0/931129432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13b0076de0 0x7f13b01a4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.397+0000 7f13a6000640 1 -- 172.21.15.42:0/931129432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13b00764c0 msgr2=0x7f13b01a45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.397+0000 7f13a6000640 1 --2- 172.21.15.42:0/931129432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13b00764c0 0x7f13b01a45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.397+0000 7f13a6000640 1 -- 172.21.15.42:0/931129432 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13b01127d0 msgr2=0x7f13b019e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:51.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.397+0000 7f13a6000640 1 --2- 172.21.15.42:0/931129432 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13b01127d0 0x7f13b019e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:51.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.397+0000 7f13a6000640 1 -- 172.21.15.42:0/931129432 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b019eee0 con 0x7f13b0076de0 2024-08-26T00:01:51.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.397+0000 7f13aea00640 1 --2- 172.21.15.42:0/931129432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13b00764c0 0x7f13b01a45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:51.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.397+0000 7f13af400640 1 --2- 172.21.15.42:0/931129432 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13b01127d0 0x7f13b019e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:51.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.397+0000 7f13a6000640 1 --2- 172.21.15.42:0/931129432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13b0076de0 0x7f13b01a4ae0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f139800e9f0 tx=0x7f139800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:51.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.398+0000 7f13a7e00640 1 -- 172.21.15.42:0/931129432 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139800ccc0 con 0x7f13b0076de0 2024-08-26T00:01:51.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.398+0000 7f13a7e00640 1 -- 172.21.15.42:0/931129432 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1398005020 con 0x7f13b0076de0 2024-08-26T00:01:51.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.398+0000 7f13b5a00640 1 -- 172.21.15.42:0/931129432 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13b019f1d0 con 0x7f13b0076de0 2024-08-26T00:01:51.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.398+0000 7f13a7e00640 1 -- 172.21.15.42:0/931129432 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13980049e0 con 0x7f13b0076de0 2024-08-26T00:01:51.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.398+0000 7f13b5a00640 1 -- 172.21.15.42:0/931129432 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13b01ab350 con 0x7f13b0076de0 2024-08-26T00:01:51.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.399+0000 7f13b5a00640 1 -- 172.21.15.42:0/931129432 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13b0077c00 con 0x7f13b0076de0 2024-08-26T00:01:51.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.401+0000 7f13a7e00640 1 -- 172.21.15.42:0/931129432 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1398005560 con 0x7f13b0076de0 2024-08-26T00:01:51.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.403+0000 7f13a7e00640 1 --2- 172.21.15.42:0/931129432 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f13940a2c10 0x7f13940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:51.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.403+0000 7f13a7e00640 1 -- 172.21.15.42:0/931129432 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f13980cf160 con 0x7f13b0076de0 2024-08-26T00:01:51.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.403+0000 7f13aea00640 1 --2- 172.21.15.42:0/931129432 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f13940a2c10 0x7f13940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:51.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.403+0000 7f13aea00640 1 --2- 172.21.15.42:0/931129432 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f13940a2c10 0x7f13940a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f13a0000c00 tx=0x7f13a0031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:51.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.406+0000 7f13a7e00640 1 -- 172.21.15.42:0/931129432 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f13980051d0 con 0x7f13b0076de0 2024-08-26T00:01:51.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.626+0000 7f13b5a00640 1 -- 172.21.15.42:0/931129432 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13b002d6a0 con 0x7f13b0076de0 2024-08-26T00:01:51.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.627+0000 7f13a7e00640 1 -- 172.21.15.42:0/931129432 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11909 (secure 0 0 0) 0x7f139809bf20 con 0x7f13b0076de0 2024-08-26T00:01:51.629 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:01:51.629 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":23,"btime":"2024-08-26T00:00:42:404711+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3168581452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3168581452},{"type":"v1","addr":"172.21.15.42:6839","nonce":3168581452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/3533492491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":3533492491},{"type":"v1","addr":"172.21.15.42:6841","nonce":3533492491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-26T00:00:30.169633+0000","modified":"2024-08-26T00:00:42.314271+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24532,"mds_1":24527,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6839/2653014277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2653014277},{"type":"v1","addr":"172.21.15.43:6839","nonce":2653014277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24532,"qdb_cluster":[24514,24527,24532]},"id":1}]} 2024-08-26T00:01:51.629 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 23 2024-08-26T00:01:51.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.630+0000 7f13b5a00640 1 -- 172.21.15.42:0/931129432 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f13940a2c10 msgr2=0x7f13940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:51.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.630+0000 7f13b5a00640 1 --2- 172.21.15.42:0/931129432 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f13940a2c10 0x7f13940a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f13a0000c00 tx=0x7f13a0031510 comp rx=0 tx=0).stop 2024-08-26T00:01:51.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.630+0000 7f13b5a00640 1 -- 172.21.15.42:0/931129432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13b0076de0 msgr2=0x7f13b01a4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:51.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.630+0000 7f13b5a00640 1 --2- 172.21.15.42:0/931129432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13b0076de0 0x7f13b01a4ae0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f139800e9f0 tx=0x7f139800eeb0 comp rx=0 tx=0).stop 2024-08-26T00:01:51.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.630+0000 7f13b5a00640 1 -- 172.21.15.42:0/931129432 shutdown_connections 2024-08-26T00:01:51.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.630+0000 7f13b5a00640 1 --2- 172.21.15.42:0/931129432 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f13940a2c10 0x7f13940a50d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:51.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.630+0000 7f13b5a00640 1 --2- 172.21.15.42:0/931129432 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13b01127d0 0x7f13b019e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:51.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.630+0000 7f13b5a00640 1 --2- 172.21.15.42:0/931129432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13b0076de0 0x7f13b01a4ae0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:51.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.630+0000 7f13b5a00640 1 --2- 172.21.15.42:0/931129432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13b00764c0 0x7f13b01a45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:51.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.630+0000 7f13b5a00640 1 -- 172.21.15.42:0/931129432 >> 172.21.15.42:0/931129432 conn(0x7f13b00ff830 msgr2=0x7f13b0101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:51.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.630+0000 7f13b5a00640 1 -- 172.21.15.42:0/931129432 shutdown_connections 2024-08-26T00:01:51.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:51.630+0000 7f13b5a00640 1 -- 172.21.15.42:0/931129432 wait complete. 2024-08-26T00:01:52.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:52 smithi042 ceph-mon[17225]: pgmap v319: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-26T00:01:52.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:52 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/931129432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:01:52.394 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-26T00:00:30.169633+0000', 'modified': '2024-08-26T00:00:42.314271+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24532, 'mds_1': 24527, 'mds_2': 24514}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24464': {'gid': 24464, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.43:6835/4195804691', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 4195804691}, {'type': 'v1', 'addr': '172.21.15.43:6835', 'nonce': 4195804691}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24494': {'gid': 24494, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.43:6837/2817851173', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6836', 'nonce': 2817851173}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 2817851173}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24502': {'gid': 24502, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6835/1496959020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 1496959020}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 1496959020}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24514': {'gid': 24514, 'name': 'c', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.181:6837/3332104552', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 3332104552}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 3332104552}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24527': {'gid': 24527, 'name': 'b', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.43:6839/2653014277', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6838', 'nonce': 2653014277}, {'type': 'v1', 'addr': '172.21.15.43:6839', 'nonce': 2653014277}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24532': {'gid': 24532, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.181:6839/351429985', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6838', 'nonce': 351429985}, {'type': 'v1', 'addr': '172.21.15.181:6839', 'nonce': 351429985}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24532, 'qdb_cluster': [24514, 24527, 24532]} 2024-08-26T00:01:52.394 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-08-26T00:01:52.394 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.c status 2024-08-26T00:01:52.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:52 smithi043 ceph-mon[22091]: pgmap v319: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-26T00:01:52.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:52 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/931129432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:01:52.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:52 smithi181 ceph-mon[22102]: pgmap v319: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-26T00:01:52.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:52 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/931129432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:01:52.771 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:53.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.312+0000 7f39db200640 1 -- 172.21.15.42:0/2494877422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39dc0764c0 msgr2=0x7f39dc0768a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:53.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.312+0000 7f39db200640 1 --2- 172.21.15.42:0/2494877422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39dc0764c0 0x7f39dc0768a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f39cc009900 tx=0x7f39cc02a410 comp rx=0 tx=0).stop 2024-08-26T00:01:53.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.312+0000 7f39db200640 1 -- 172.21.15.42:0/2494877422 shutdown_connections 2024-08-26T00:01:53.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.312+0000 7f39db200640 1 --2- 172.21.15.42:0/2494877422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39dc112610 0x7f39dc114a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.312+0000 7f39db200640 1 --2- 172.21.15.42:0/2494877422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39dc076de0 0x7f39dc1120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.312+0000 7f39db200640 1 --2- 172.21.15.42:0/2494877422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39dc0764c0 0x7f39dc0768a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.312+0000 7f39db200640 1 -- 172.21.15.42:0/2494877422 >> 172.21.15.42:0/2494877422 conn(0x7f39dc0ff670 msgr2=0x7f39dc101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:53.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.312+0000 7f39db200640 1 -- 172.21.15.42:0/2494877422 shutdown_connections 2024-08-26T00:01:53.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.312+0000 7f39db200640 1 -- 172.21.15.42:0/2494877422 wait complete. 2024-08-26T00:01:53.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.313+0000 7f39db200640 1 Processor -- start 2024-08-26T00:01:53.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.313+0000 7f39db200640 1 -- start start 2024-08-26T00:01:53.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.314+0000 7f39db200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39dc0764c0 0x7f39dc19e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:53.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.314+0000 7f39db200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39dc076de0 0x7f39dc19eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:53.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.314+0000 7f39db200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39dc112610 0x7f39dc1a2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:53.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.314+0000 7f39db200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc1181f0 con 0x7f39dc0764c0 2024-08-26T00:01:53.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.314+0000 7f39db200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc118070 con 0x7f39dc076de0 2024-08-26T00:01:53.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.314+0000 7f39db200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc118370 con 0x7f39dc112610 2024-08-26T00:01:53.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.314+0000 7f39d9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39dc0764c0 0x7f39dc19e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:53.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.314+0000 7f39d9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39dc0764c0 0x7f39dc19e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35996/0 (socket says 172.21.15.42:35996) 2024-08-26T00:01:53.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.314+0000 7f39d1400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39dc076de0 0x7f39dc19eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:53.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.314+0000 7f39d9e00640 1 -- 172.21.15.42:0/1666905238 learned_addr learned my addr 172.21.15.42:0/1666905238 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:53.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.314+0000 7f39da800640 1 --2- 172.21.15.42:0/1666905238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39dc112610 0x7f39dc1a2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:53.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.314+0000 7f39d1400640 1 -- 172.21.15.42:0/1666905238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39dc112610 msgr2=0x7f39dc1a2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:53.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.314+0000 7f39d1400640 1 --2- 172.21.15.42:0/1666905238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39dc112610 0x7f39dc1a2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.314+0000 7f39d1400640 1 -- 172.21.15.42:0/1666905238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39dc0764c0 msgr2=0x7f39dc19e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:53.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.314+0000 7f39d1400640 1 --2- 172.21.15.42:0/1666905238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39dc0764c0 0x7f39dc19e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.314+0000 7f39d1400640 1 -- 172.21.15.42:0/1666905238 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39dc1a35f0 con 0x7f39dc076de0 2024-08-26T00:01:53.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.315+0000 7f39d1400640 1 --2- 172.21.15.42:0/1666905238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39dc076de0 0x7f39dc19eb80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f39c400e9f0 tx=0x7f39c400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:53.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.315+0000 7f39d3400640 1 -- 172.21.15.42:0/1666905238 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c400ccc0 con 0x7f39dc076de0 2024-08-26T00:01:53.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.315+0000 7f39db200640 1 -- 172.21.15.42:0/1666905238 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39dc1a38e0 con 0x7f39dc076de0 2024-08-26T00:01:53.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.315+0000 7f39d3400640 1 -- 172.21.15.42:0/1666905238 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39c4010910 con 0x7f39dc076de0 2024-08-26T00:01:53.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.315+0000 7f39d3400640 1 -- 172.21.15.42:0/1666905238 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c4018960 con 0x7f39dc076de0 2024-08-26T00:01:53.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.315+0000 7f39db200640 1 -- 172.21.15.42:0/1666905238 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39dc1ab1c0 con 0x7f39dc076de0 2024-08-26T00:01:53.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.318+0000 7f39d3400640 1 -- 172.21.15.42:0/1666905238 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f39c4010ac0 con 0x7f39dc076de0 2024-08-26T00:01:53.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.318+0000 7f39e3863740 1 Processor -- start 2024-08-26T00:01:53.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.319+0000 7f39e3863740 1 -- start start 2024-08-26T00:01:53.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.319+0000 7f39e3863740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2a9a687d0 0x55c2a9a68bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:53.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.319+0000 7f39e3863740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c2a9a690f0 0x55c2a9a73470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:53.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.319+0000 7f39e3863740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a739b0 0x55c2a9a75da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:53.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.319+0000 7f39e3863740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c2a99cedb0 con 0x55c2a9a739b0 2024-08-26T00:01:53.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.319+0000 7f39e3863740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c2a99664a0 con 0x55c2a9a690f0 2024-08-26T00:01:53.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.319+0000 7f39e3863740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c2a99cad70 con 0x55c2a9a687d0 2024-08-26T00:01:53.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.319+0000 7f39d1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a739b0 0x55c2a9a75da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:53.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.319+0000 7f39da800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2a9a687d0 0x55c2a9a68bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:53.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.319+0000 7f39da800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2a9a687d0 0x55c2a9a68bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:39416/0 (socket says 172.21.15.42:39416) 2024-08-26T00:01:53.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.319+0000 7f39da800640 1 -- 172.21.15.42:0/541973603 learned_addr learned my addr 172.21.15.42:0/541973603 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:53.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.319+0000 7f39d1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a739b0 0x55c2a9a75da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36002/0 (socket says 172.21.15.42:36002) 2024-08-26T00:01:53.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.319+0000 7f39d9e00640 1 --2- 172.21.15.42:0/541973603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c2a9a690f0 0x55c2a9a73470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:53.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.320+0000 7f39da800640 1 -- 172.21.15.42:0/541973603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c2a9a690f0 msgr2=0x55c2a9a73470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:53.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.320+0000 7f39da800640 1 --2- 172.21.15.42:0/541973603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c2a9a690f0 0x55c2a9a73470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.320+0000 7f39da800640 1 -- 172.21.15.42:0/541973603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a739b0 msgr2=0x55c2a9a75da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:53.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.320+0000 7f39da800640 1 --2- 172.21.15.42:0/541973603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a739b0 0x55c2a9a75da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.320+0000 7f39da800640 1 -- 172.21.15.42:0/541973603 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2a97402b0 con 0x55c2a9a687d0 2024-08-26T00:01:53.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.320+0000 7f39d3400640 1 --2- 172.21.15.42:0/1666905238 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f39c00a2c10 0x7f39c00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:53.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.320+0000 7f39d3400640 1 -- 172.21.15.42:0/1666905238 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f39c40cf5a0 con 0x7f39dc076de0 2024-08-26T00:01:53.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.320+0000 7f39da800640 1 --2- 172.21.15.42:0/541973603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2a9a687d0 0x55c2a9a68bb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f39d4009f30 tx=0x7f39d40118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=535df98d2fdea5de server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:53.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.320+0000 7f39d9e00640 1 --2- 172.21.15.42:0/1666905238 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f39c00a2c10 0x7f39c00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:53.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.321+0000 7f39cb400640 1 -- 172.21.15.42:0/541973603 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d4004d20 con 0x55c2a9a687d0 2024-08-26T00:01:53.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.321+0000 7f39cb400640 1 -- 172.21.15.42:0/541973603 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39d4004050 con 0x55c2a9a687d0 2024-08-26T00:01:53.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.321+0000 7f39cb400640 1 -- 172.21.15.42:0/541973603 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d4005220 con 0x55c2a9a687d0 2024-08-26T00:01:53.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.321+0000 7f39e3863740 1 -- 172.21.15.42:0/541973603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2a9a687d0 msgr2=0x55c2a9a68bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:53.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.321+0000 7f39d9e00640 1 --2- 172.21.15.42:0/1666905238 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f39c00a2c10 0x7f39c00a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f39cc0096c0 tx=0x7f39cc0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:53.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.321+0000 7f39e3863740 1 --2- 172.21.15.42:0/541973603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2a9a687d0 0x55c2a9a68bb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f39d4009f30 tx=0x7f39d40118d0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.321+0000 7f39e3863740 1 -- 172.21.15.42:0/541973603 shutdown_connections 2024-08-26T00:01:53.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.321+0000 7f39e3863740 1 --2- 172.21.15.42:0/541973603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a739b0 0x55c2a9a75da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.321+0000 7f39e3863740 1 --2- 172.21.15.42:0/541973603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c2a9a690f0 0x55c2a9a73470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.321+0000 7f39e3863740 1 --2- 172.21.15.42:0/541973603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2a9a687d0 0x55c2a9a68bb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.321+0000 7f39e3863740 1 -- 172.21.15.42:0/541973603 >> 172.21.15.42:0/541973603 conn(0x55c2a9a64d60 msgr2=0x55c2a9a65140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:53.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.322+0000 7f39e3863740 1 -- 172.21.15.42:0/541973603 shutdown_connections 2024-08-26T00:01:53.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.322+0000 7f39e3863740 1 -- 172.21.15.42:0/541973603 wait complete. 2024-08-26T00:01:53.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.322+0000 7f39e3863740 1 -- start start 2024-08-26T00:01:53.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.322+0000 7f39e3863740 1 Processor -- start 2024-08-26T00:01:53.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.323+0000 7f39e3863740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2a9a687d0 0x55c2a9a708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:53.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.323+0000 7f39e3863740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a690f0 0x55c2a9a70e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:53.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.323+0000 7f39e3863740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c2a9a739b0 0x55c2a9a71350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:53.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.323+0000 7f39e3863740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c2a9a76580 con 0x55c2a9a690f0 2024-08-26T00:01:53.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.323+0000 7f39e3863740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c2a9989bf0 con 0x55c2a9a739b0 2024-08-26T00:01:53.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.323+0000 7f39e3863740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c2a9a76700 con 0x55c2a9a687d0 2024-08-26T00:01:53.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.323+0000 7f39e3863740 10 client.0 _ll_register_callbacks cb 0x55c2a9975dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:01:53.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.323+0000 7f39d1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a690f0 0x55c2a9a70e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:53.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.323+0000 7f39da800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c2a9a739b0 0x55c2a9a71350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:53.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.323+0000 7f39da800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c2a9a739b0 0x55c2a9a71350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:37802/0 (socket says 172.21.15.42:37802) 2024-08-26T00:01:53.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.323+0000 7f39d9e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2a9a687d0 0x55c2a9a708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:53.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.323+0000 7f39da800640 1 -- 172.21.15.42:0/869317237 learned_addr learned my addr 172.21.15.42:0/869317237 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:53.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.323+0000 7f39da800640 1 -- 172.21.15.42:0/869317237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2a9a687d0 msgr2=0x55c2a9a708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:53.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.323+0000 7f39da800640 1 --2- 172.21.15.42:0/869317237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2a9a687d0 0x55c2a9a708d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.323+0000 7f39da800640 1 -- 172.21.15.42:0/869317237 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a690f0 msgr2=0x55c2a9a70e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:53.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.323+0000 7f39da800640 1 --2- 172.21.15.42:0/869317237 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a690f0 0x55c2a9a70e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.323+0000 7f39da800640 1 -- 172.21.15.42:0/869317237 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2a9a7faa0 con 0x55c2a9a739b0 2024-08-26T00:01:53.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.324+0000 7f39da800640 1 --2- 172.21.15.42:0/869317237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c2a9a739b0 0x55c2a9a71350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f39d40044e0 tx=0x7f39d4004510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f789c32e0cb6c558 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:53.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.324+0000 7f39bfe00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:01:53.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.324+0000 7f39bfe00640 1 -- 172.21.15.42:0/869317237 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d4028020 con 0x55c2a9a739b0 2024-08-26T00:01:53.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.324+0000 7f39e3863740 1 -- 172.21.15.42:0/869317237 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39d4004050 con 0x55c2a9a739b0 2024-08-26T00:01:53.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.324+0000 7f39bfe00640 1 -- 172.21.15.42:0/869317237 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f39d4004c50 con 0x55c2a9a739b0 2024-08-26T00:01:53.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.325+0000 7f39bfe00640 1 -- 172.21.15.42:0/869317237 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f39d4005040 con 0x55c2a9a739b0 2024-08-26T00:01:53.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.325+0000 7f39e3863740 10 client.24875 fetch_fsmap learned FSMap version 23 2024-08-26T00:01:53.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.325+0000 7f39e3863740 1 -- 172.21.15.42:0/869317237 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55c2a9a82430 con 0x55c2a9a739b0 2024-08-26T00:01:53.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.325+0000 7f39bfe00640 1 -- 172.21.15.42:0/869317237 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39d4004050 con 0x55c2a9a739b0 2024-08-26T00:01:53.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.325+0000 7f39bfe00640 1 -- 172.21.15.42:0/869317237 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f39d40234e0 con 0x55c2a9a739b0 2024-08-26T00:01:53.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.325+0000 7f39e3863740 10 client.24875 fetch_fsmap finished waiting for FSMap version 23 2024-08-26T00:01:53.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.325+0000 7f39e3863740 10 client.24875 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-26T00:01:53.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.325+0000 7f39e3863740 20 client.24875 populate_metadata read hostname 'smithi042' 2024-08-26T00:01:53.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.325+0000 7f39e3863740 1 --2- 172.21.15.42:0/869317237 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55c2a9a848a0 0x55c2a9a85d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:53.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.325+0000 7f39e3863740 4 client.24875 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:01:53.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.325+0000 7f39e3863740 1 -- 172.21.15.42:0/869317237 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2a99dc320 con 0x55c2a9a848a0 2024-08-26T00:01:53.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.326+0000 7f39d9e00640 1 --2- 172.21.15.42:0/869317237 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55c2a9a848a0 0x55c2a9a85d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:53.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.326+0000 7f39d9e00640 1 --2- 172.21.15.42:0/869317237 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55c2a9a848a0 0x55c2a9a85d10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=55399c141d86b7cc server_cookie=459cf80b72502c2 in_seq=0 out_seq=0 2024-08-26T00:01:53.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.326+0000 7f39bfe00640 10 client.24875 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:01:53.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.327+0000 7f39bfe00640 1 -- 172.21.15.42:0/869317237 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c2a99dc320 con 0x55c2a9a848a0 2024-08-26T00:01:53.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.327+0000 7f39bfe00640 10 client.24875 handle_command_reply: tid=0 2024-08-26T00:01:53.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.327+0000 7f39e3863740 1 client.24875 shutdown 2024-08-26T00:01:53.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.328+0000 7f39e3863740 1 -- 172.21.15.42:0/869317237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c2a9a739b0 msgr2=0x55c2a9a71350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:53.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.328+0000 7f39e3863740 1 --2- 172.21.15.42:0/869317237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c2a9a739b0 0x55c2a9a71350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f39d40044e0 tx=0x7f39d4004510 comp rx=0 tx=0).stop 2024-08-26T00:01:53.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.328+0000 7f39e3863740 1 -- 172.21.15.42:0/869317237 shutdown_connections 2024-08-26T00:01:53.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.328+0000 7f39e3863740 1 --2- 172.21.15.42:0/869317237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c2a9a739b0 0x55c2a9a71350 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.328+0000 7f39e3863740 1 --2- 172.21.15.42:0/869317237 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a690f0 0x55c2a9a70e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.328+0000 7f39e3863740 1 --2- 172.21.15.42:0/869317237 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55c2a9a848a0 0x55c2a9a85d10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.328+0000 7f39e3863740 1 --2- 172.21.15.42:0/869317237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2a9a687d0 0x55c2a9a708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.328+0000 7f39e3863740 1 -- 172.21.15.42:0/869317237 >> 172.21.15.42:0/869317237 conn(0x55c2a9a64d60 msgr2=0x55c2a9a63ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:53.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.328+0000 7f39bfe00640 0 client.24875 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:01:53.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.328+0000 7f39e3863740 1 -- 172.21.15.42:0/869317237 shutdown_connections 2024-08-26T00:01:53.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.328+0000 7f39e3863740 1 -- 172.21.15.42:0/869317237 wait complete. 2024-08-26T00:01:53.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.328+0000 7f39e3863740 20 client.24875 trim_cache size 0 max 16384 2024-08-26T00:01:53.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.347+0000 7f39e3863740 1 Processor -- start 2024-08-26T00:01:53.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.347+0000 7f39e3863740 1 -- start start 2024-08-26T00:01:53.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.347+0000 7f39e3863740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a687d0 0x55c2a9a7f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:53.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.347+0000 7f39e3863740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c2a9a690f0 0x55c2a9a70e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:53.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.347+0000 7f39e3863740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2a9a739b0 0x55c2a9a713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:53.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.347+0000 7f39e3863740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c2a9a84050 con 0x55c2a9a687d0 2024-08-26T00:01:53.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.347+0000 7f39e3863740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c2a9a84720 con 0x55c2a9a690f0 2024-08-26T00:01:53.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.347+0000 7f39e3863740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c2a9a84df0 con 0x55c2a9a739b0 2024-08-26T00:01:53.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.347+0000 7f39d9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a687d0 0x55c2a9a7f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:53.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.347+0000 7f39d9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a687d0 0x55c2a9a7f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36022/0 (socket says 172.21.15.42:36022) 2024-08-26T00:01:53.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.347+0000 7f39d9e00640 1 -- 172.21.15.42:0/3621226728 learned_addr learned my addr 172.21.15.42:0/3621226728 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:53.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.347+0000 7f39d1400640 1 --2- 172.21.15.42:0/3621226728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c2a9a690f0 0x55c2a9a70e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:53.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.347+0000 7f39da800640 1 --2- 172.21.15.42:0/3621226728 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2a9a739b0 0x55c2a9a713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:53.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.348+0000 7f39d1400640 1 -- 172.21.15.42:0/3621226728 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2a9a739b0 msgr2=0x55c2a9a713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:53.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.348+0000 7f39d1400640 1 --2- 172.21.15.42:0/3621226728 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2a9a739b0 0x55c2a9a713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.348+0000 7f39d1400640 1 -- 172.21.15.42:0/3621226728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a687d0 msgr2=0x55c2a9a7f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:53.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.348+0000 7f39d1400640 1 --2- 172.21.15.42:0/3621226728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a687d0 0x55c2a9a7f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.348+0000 7f39d1400640 1 -- 172.21.15.42:0/3621226728 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2a9a76690 con 0x55c2a9a690f0 2024-08-26T00:01:53.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.348+0000 7f39d9e00640 1 --2- 172.21.15.42:0/3621226728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a687d0 0x55c2a9a7f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:53.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.348+0000 7f39d1400640 1 --2- 172.21.15.42:0/3621226728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c2a9a690f0 0x55c2a9a70e60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f39c40ccf10 tx=0x7f39c4009700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca5ad6d7fa36027e server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:53.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.348+0000 7f39caa00640 1 -- 172.21.15.42:0/3621226728 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c409b670 con 0x55c2a9a690f0 2024-08-26T00:01:53.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.348+0000 7f39caa00640 1 -- 172.21.15.42:0/3621226728 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39c409bd10 con 0x55c2a9a690f0 2024-08-26T00:01:53.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.348+0000 7f39caa00640 1 -- 172.21.15.42:0/3621226728 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c40cf350 con 0x55c2a9a690f0 2024-08-26T00:01:53.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.349+0000 7f39e3863740 1 -- 172.21.15.42:0/3621226728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c2a9a690f0 msgr2=0x55c2a9a70e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:53.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.349+0000 7f39e3863740 1 --2- 172.21.15.42:0/3621226728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c2a9a690f0 0x55c2a9a70e60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f39c40ccf10 tx=0x7f39c4009700 comp rx=0 tx=0).stop 2024-08-26T00:01:53.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.349+0000 7f39e3863740 1 -- 172.21.15.42:0/3621226728 shutdown_connections 2024-08-26T00:01:53.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.349+0000 7f39e3863740 1 --2- 172.21.15.42:0/3621226728 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2a9a739b0 0x55c2a9a713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.349+0000 7f39e3863740 1 --2- 172.21.15.42:0/3621226728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c2a9a690f0 0x55c2a9a70e60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.349+0000 7f39e3863740 1 --2- 172.21.15.42:0/3621226728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a687d0 0x55c2a9a7f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.349+0000 7f39e3863740 1 -- 172.21.15.42:0/3621226728 >> 172.21.15.42:0/3621226728 conn(0x55c2a9a64d60 msgr2=0x55c2a9a7e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:53.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.349+0000 7f39e3863740 1 -- 172.21.15.42:0/3621226728 shutdown_connections 2024-08-26T00:01:53.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.349+0000 7f39e3863740 1 -- 172.21.15.42:0/3621226728 wait complete. 2024-08-26T00:01:53.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.349+0000 7f39e3863740 1 -- start start 2024-08-26T00:01:53.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.350+0000 7f39e3863740 1 Processor -- start 2024-08-26T00:01:53.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.350+0000 7f39e3863740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a687d0 0x55c2a9a8e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:53.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.350+0000 7f39e3863740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2a9a690f0 0x55c2a9a8e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:53.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.350+0000 7f39e3863740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c2a9a739b0 0x55c2a9a89080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:53.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.350+0000 7f39e3863740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c2a9a85b90 con 0x55c2a9a687d0 2024-08-26T00:01:53.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.350+0000 7f39e3863740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c2a9a854c0 con 0x55c2a9a739b0 2024-08-26T00:01:53.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.350+0000 7f39e3863740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c2a9a86260 con 0x55c2a9a690f0 2024-08-26T00:01:53.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.350+0000 7f39e3863740 10 client.0 _ll_register_callbacks cb 0x7f39d4009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:01:53.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.350+0000 7f39d9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a687d0 0x55c2a9a8e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:53.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.350+0000 7f39d9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a687d0 0x55c2a9a8e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36032/0 (socket says 172.21.15.42:36032) 2024-08-26T00:01:53.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.350+0000 7f39d9e00640 1 -- 172.21.15.42:0/2614832187 learned_addr learned my addr 172.21.15.42:0/2614832187 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:53.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.350+0000 7f39da800640 1 --2- 172.21.15.42:0/2614832187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c2a9a739b0 0x55c2a9a89080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:53.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.350+0000 7f39d1400640 1 --2- 172.21.15.42:0/2614832187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2a9a690f0 0x55c2a9a8e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:53.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.351+0000 7f39d9e00640 1 -- 172.21.15.42:0/2614832187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2a9a690f0 msgr2=0x55c2a9a8e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:53.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.351+0000 7f39d9e00640 1 --2- 172.21.15.42:0/2614832187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2a9a690f0 0x55c2a9a8e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.351+0000 7f39d9e00640 1 -- 172.21.15.42:0/2614832187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c2a9a739b0 msgr2=0x55c2a9a89080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:53.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.351+0000 7f39d9e00640 1 --2- 172.21.15.42:0/2614832187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c2a9a739b0 0x55c2a9a89080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.351+0000 7f39d9e00640 1 -- 172.21.15.42:0/2614832187 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2a9a898b0 con 0x55c2a9a687d0 2024-08-26T00:01:53.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.351+0000 7f39d9e00640 1 --2- 172.21.15.42:0/2614832187 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a687d0 0x55c2a9a8e3c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f39cc031550 tx=0x7f39cc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68828373ff000efa server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:53.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.351+0000 7f39bfe00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:01:53.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.351+0000 7f39bfe00640 1 -- 172.21.15.42:0/2614832187 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc035040 con 0x55c2a9a687d0 2024-08-26T00:01:53.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.351+0000 7f39e3863740 1 -- 172.21.15.42:0/2614832187 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39c409bd10 con 0x55c2a9a687d0 2024-08-26T00:01:53.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.351+0000 7f39bfe00640 1 -- 172.21.15.42:0/2614832187 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f39cc031df0 con 0x55c2a9a687d0 2024-08-26T00:01:53.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.352+0000 7f39bfe00640 1 -- 172.21.15.42:0/2614832187 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f39cc0035f0 con 0x55c2a9a687d0 2024-08-26T00:01:53.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.352+0000 7f39e3863740 10 client.14877 fetch_fsmap learned FSMap version 23 2024-08-26T00:01:53.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.352+0000 7f39e3863740 1 -- 172.21.15.42:0/2614832187 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55c2a9aefcc0 con 0x55c2a9a687d0 2024-08-26T00:01:53.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.352+0000 7f39bfe00640 1 -- 172.21.15.42:0/2614832187 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39c409bd10 con 0x55c2a9a687d0 2024-08-26T00:01:53.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.352+0000 7f39bfe00640 1 -- 172.21.15.42:0/2614832187 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f39cc0547f0 con 0x55c2a9a687d0 2024-08-26T00:01:53.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.352+0000 7f39e3863740 10 client.14877 fetch_fsmap finished waiting for FSMap version 23 2024-08-26T00:01:53.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.352+0000 7f39e3863740 10 client.14877 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-26T00:01:53.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.352+0000 7f39e3863740 20 client.14877 populate_metadata read hostname 'smithi042' 2024-08-26T00:01:53.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.352+0000 7f39e3863740 1 --2- 172.21.15.42:0/2614832187 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55c2a9af48b0 0x55c2a9af35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:53.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.352+0000 7f39e3863740 4 client.14877 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-26T00:01:53.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.352+0000 7f39e3863740 1 -- 172.21.15.42:0/2614832187 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "status"}) -- 0x55c2a99d6830 con 0x55c2a9af48b0 2024-08-26T00:01:53.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.353+0000 7f39d1400640 1 --2- 172.21.15.42:0/2614832187 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55c2a9af48b0 0x55c2a9af35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:53.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.353+0000 7f39d1400640 1 --2- 172.21.15.42:0/2614832187 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55c2a9af48b0 0x55c2a9af35c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d36cc3c2c5a0c8ba server_cookie=a6f2fd5799e3ba3b in_seq=0 out_seq=0 2024-08-26T00:01:53.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.353+0000 7f39bfe00640 10 client.14877 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:01:53.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.354+0000 7f39bfe00640 1 -- 172.21.15.42:0/2614832187 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55c2a99d6830 con 0x55c2a9af48b0 2024-08-26T00:01:53.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.354+0000 7f39bfe00640 10 client.14877 handle_command_reply: tid=0 2024-08-26T00:01:53.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.354+0000 7f39e3863740 1 client.14877 shutdown 2024-08-26T00:01:53.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.354+0000 7f39e3863740 1 -- 172.21.15.42:0/2614832187 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a687d0 msgr2=0x55c2a9a8e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:53.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.354+0000 7f39e3863740 1 --2- 172.21.15.42:0/2614832187 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a687d0 0x55c2a9a8e3c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f39cc031550 tx=0x7f39cc009260 comp rx=0 tx=0).stop 2024-08-26T00:01:53.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.354+0000 7f39e3863740 1 -- 172.21.15.42:0/2614832187 shutdown_connections 2024-08-26T00:01:53.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.354+0000 7f39e3863740 1 --2- 172.21.15.42:0/2614832187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c2a9a739b0 0x55c2a9a89080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.354+0000 7f39e3863740 1 --2- 172.21.15.42:0/2614832187 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55c2a9af48b0 0x55c2a9af35c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.354+0000 7f39e3863740 1 --2- 172.21.15.42:0/2614832187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2a9a690f0 0x55c2a9a8e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.354+0000 7f39e3863740 1 --2- 172.21.15.42:0/2614832187 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c2a9a687d0 0x55c2a9a8e3c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.354+0000 7f39e3863740 1 -- 172.21.15.42:0/2614832187 >> 172.21.15.42:0/2614832187 conn(0x55c2a9a64d60 msgr2=0x55c2a9a72950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:53.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.354+0000 7f39bfe00640 0 client.14877 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:01:53.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.354+0000 7f39e3863740 1 -- 172.21.15.42:0/2614832187 shutdown_connections 2024-08-26T00:01:53.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.354+0000 7f39e3863740 1 -- 172.21.15.42:0/2614832187 wait complete. 2024-08-26T00:01:53.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.354+0000 7f39e3863740 20 client.14877 trim_cache size 0 max 16384 2024-08-26T00:01:53.358 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:01:53.358 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "f89d317a-633c-11ef-bcd2-c7b262605968", 2024-08-26T00:01:53.358 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 2, 2024-08-26T00:01:53.358 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24514, 2024-08-26T00:01:53.358 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-08-26T00:01:53.358 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-08-26T00:01:53.358 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-08-26T00:01:53.358 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 73.957118132000005, 2024-08-26T00:01:53.359 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 23, 2024-08-26T00:01:53.359 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 80, 2024-08-26T00:01:53.359 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 78, 2024-08-26T00:01:53.359 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 109.775502038 2024-08-26T00:01:53.359 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:01:53.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.355+0000 7f39db200640 1 -- 172.21.15.42:0/1666905238 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f39c00a2c10 msgr2=0x7f39c00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:53.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.355+0000 7f39db200640 1 --2- 172.21.15.42:0/1666905238 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f39c00a2c10 0x7f39c00a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f39cc0096c0 tx=0x7f39cc0046c0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.355+0000 7f39db200640 1 -- 172.21.15.42:0/1666905238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39dc076de0 msgr2=0x7f39dc19eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:53.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.355+0000 7f39db200640 1 --2- 172.21.15.42:0/1666905238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39dc076de0 0x7f39dc19eb80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f39c400e9f0 tx=0x7f39c400eeb0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.355+0000 7f39db200640 1 -- 172.21.15.42:0/1666905238 shutdown_connections 2024-08-26T00:01:53.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.355+0000 7f39db200640 1 --2- 172.21.15.42:0/1666905238 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f39c00a2c10 0x7f39c00a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.355+0000 7f39db200640 1 --2- 172.21.15.42:0/1666905238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39dc112610 0x7f39dc1a2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.355+0000 7f39db200640 1 --2- 172.21.15.42:0/1666905238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39dc076de0 0x7f39dc19eb80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.355+0000 7f39db200640 1 --2- 172.21.15.42:0/1666905238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39dc0764c0 0x7f39dc19e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:53.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.355+0000 7f39db200640 1 -- 172.21.15.42:0/1666905238 >> 172.21.15.42:0/1666905238 conn(0x7f39dc0ff670 msgr2=0x7f39dc101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:53.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.355+0000 7f39db200640 1 -- 172.21.15.42:0/1666905238 shutdown_connections 2024-08-26T00:01:53.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:53.355+0000 7f39db200640 1 -- 172.21.15.42:0/1666905238 wait complete. 2024-08-26T00:01:54.081 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.b status 2024-08-26T00:01:54.459 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:54.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:54 smithi043 ceph-mon[22091]: pgmap v320: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:01:54.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:54 smithi042 ceph-mon[17225]: pgmap v320: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:01:54.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:54 smithi181 ceph-mon[22102]: pgmap v320: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:01:55.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.104+0000 7efc9fc00640 1 -- 172.21.15.42:0/390102275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc98074c80 msgr2=0x7efc9810dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:55.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.104+0000 7efc9fc00640 1 --2- 172.21.15.42:0/390102275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc98074c80 0x7efc9810dc80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efc84009860 tx=0x7efc8402a3d0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.104+0000 7efc9fc00640 1 -- 172.21.15.42:0/390102275 shutdown_connections 2024-08-26T00:01:55.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.104+0000 7efc9fc00640 1 --2- 172.21.15.42:0/390102275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc9810e1c0 0x7efc981105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.104+0000 7efc9fc00640 1 --2- 172.21.15.42:0/390102275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc98074c80 0x7efc9810dc80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.104+0000 7efc9fc00640 1 --2- 172.21.15.42:0/390102275 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc98074360 0x7efc98074740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.104+0000 7efc9fc00640 1 -- 172.21.15.42:0/390102275 >> 172.21.15.42:0/390102275 conn(0x7efc980fd660 msgr2=0x7efc980ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:55.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.104+0000 7efc9fc00640 1 -- 172.21.15.42:0/390102275 shutdown_connections 2024-08-26T00:01:55.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.104+0000 7efc9fc00640 1 -- 172.21.15.42:0/390102275 wait complete. 2024-08-26T00:01:55.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.105+0000 7efc9fc00640 1 Processor -- start 2024-08-26T00:01:55.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.105+0000 7efc9fc00640 1 -- start start 2024-08-26T00:01:55.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.106+0000 7efc9fc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc98074360 0x7efc9819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:55.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.106+0000 7efc9fc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc98074c80 0x7efc9819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:55.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.106+0000 7efc9fc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc9810e1c0 0x7efc9819ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:55.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.106+0000 7efc9fc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efc98113f10 con 0x7efc98074c80 2024-08-26T00:01:55.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.106+0000 7efc9fc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efc98113d90 con 0x7efc98074360 2024-08-26T00:01:55.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.106+0000 7efc9fc00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efc98114090 con 0x7efc9810e1c0 2024-08-26T00:01:55.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.106+0000 7efc97e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc98074c80 0x7efc9819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:55.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.106+0000 7efc97e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc98074c80 0x7efc9819a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45666/0 (socket says 172.21.15.42:45666) 2024-08-26T00:01:55.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.106+0000 7efc97e00640 1 -- 172.21.15.42:0/3557861845 learned_addr learned my addr 172.21.15.42:0/3557861845 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:55.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.106+0000 7efc9d200640 1 --2- 172.21.15.42:0/3557861845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc98074360 0x7efc9819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:55.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.106+0000 7efc9dc00640 1 --2- 172.21.15.42:0/3557861845 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc9810e1c0 0x7efc9819ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:55.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.106+0000 7efc9d200640 1 -- 172.21.15.42:0/3557861845 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc9810e1c0 msgr2=0x7efc9819ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:55.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.106+0000 7efc9d200640 1 --2- 172.21.15.42:0/3557861845 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc9810e1c0 0x7efc9819ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.106+0000 7efc9d200640 1 -- 172.21.15.42:0/3557861845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc98074c80 msgr2=0x7efc9819a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:55.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.107+0000 7efc9d200640 1 --2- 172.21.15.42:0/3557861845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc98074c80 0x7efc9819a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.107+0000 7efc9d200640 1 -- 172.21.15.42:0/3557861845 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9819f410 con 0x7efc98074360 2024-08-26T00:01:55.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.107+0000 7efc97e00640 1 --2- 172.21.15.42:0/3557861845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc98074c80 0x7efc9819a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:55.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.107+0000 7efc9d200640 1 --2- 172.21.15.42:0/3557861845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc98074360 0x7efc9819a460 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efc8c005fd0 tx=0x7efc8c00dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:55.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.107+0000 7efc95600640 1 -- 172.21.15.42:0/3557861845 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c009c30 con 0x7efc98074360 2024-08-26T00:01:55.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.107+0000 7efc9fc00640 1 -- 172.21.15.42:0/3557861845 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc9819f700 con 0x7efc98074360 2024-08-26T00:01:55.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.107+0000 7efc95600640 1 -- 172.21.15.42:0/3557861845 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc8c009dd0 con 0x7efc98074360 2024-08-26T00:01:55.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.107+0000 7efc95600640 1 -- 172.21.15.42:0/3557861845 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c010460 con 0x7efc98074360 2024-08-26T00:01:55.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.107+0000 7efc9fc00640 1 -- 172.21.15.42:0/3557861845 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc981a6fe0 con 0x7efc98074360 2024-08-26T00:01:55.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.110+0000 7efca26ca740 1 Processor -- start 2024-08-26T00:01:55.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.111+0000 7efca26ca740 1 -- start start 2024-08-26T00:01:55.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.111+0000 7efc95600640 1 -- 172.21.15.42:0/3557861845 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7efc8c003f50 con 0x7efc98074360 2024-08-26T00:01:55.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.111+0000 7efca26ca740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008d5620 0x562d008d5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:55.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.111+0000 7efca26ca740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d008d5f40 0x562d008e02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:55.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.111+0000 7efca26ca740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562d008e0800 0x562d008e2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:55.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.111+0000 7efca26ca740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562d0083bdb0 con 0x562d008d5620 2024-08-26T00:01:55.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.111+0000 7efca26ca740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562d007d34a0 con 0x562d008d5f40 2024-08-26T00:01:55.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.111+0000 7efca26ca740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562d00837d70 con 0x562d008e0800 2024-08-26T00:01:55.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.111+0000 7efc9d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d008d5f40 0x562d008e02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:55.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.111+0000 7efc9dc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008d5620 0x562d008d5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:55.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.111+0000 7efc97e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562d008e0800 0x562d008e2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:55.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.111+0000 7efc9dc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008d5620 0x562d008d5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45680/0 (socket says 172.21.15.42:45680) 2024-08-26T00:01:55.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.111+0000 7efc9dc00640 1 -- 172.21.15.42:0/318834660 learned_addr learned my addr 172.21.15.42:0/318834660 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:55.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.112+0000 7efc9d200640 1 -- 172.21.15.42:0/318834660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562d008e0800 msgr2=0x562d008e2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:55.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.112+0000 7efc9d200640 1 --2- 172.21.15.42:0/318834660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562d008e0800 0x562d008e2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.112+0000 7efc9d200640 1 -- 172.21.15.42:0/318834660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008d5620 msgr2=0x562d008d5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:55.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.112+0000 7efc9d200640 1 --2- 172.21.15.42:0/318834660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008d5620 0x562d008d5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.112+0000 7efc9d200640 1 -- 172.21.15.42:0/318834660 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d005ad2b0 con 0x562d008d5f40 2024-08-26T00:01:55.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.112+0000 7efc9dc00640 1 --2- 172.21.15.42:0/318834660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008d5620 0x562d008d5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:55.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.112+0000 7efc9d200640 1 --2- 172.21.15.42:0/318834660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d008d5f40 0x562d008e02c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0cc990 tx=0x7efc8c0d7320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c764561bfb1932d server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:55.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.113+0000 7efc8a000640 1 -- 172.21.15.42:0/318834660 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c0e2070 con 0x562d008d5f40 2024-08-26T00:01:55.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.113+0000 7efc8a000640 1 -- 172.21.15.42:0/318834660 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc8c0d7d20 con 0x562d008d5f40 2024-08-26T00:01:55.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.113+0000 7efc8a000640 1 -- 172.21.15.42:0/318834660 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c0dd660 con 0x562d008d5f40 2024-08-26T00:01:55.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.113+0000 7efc95600640 1 --2- 172.21.15.42:0/3557861845 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7efc800a2c90 0x7efc800a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:55.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.113+0000 7efc95600640 1 -- 172.21.15.42:0/3557861845 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7efc8c0cefe0 con 0x7efc98074360 2024-08-26T00:01:55.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.113+0000 7efc9dc00640 1 --2- 172.21.15.42:0/3557861845 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7efc800a2c90 0x7efc800a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:55.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.113+0000 7efca26ca740 1 -- 172.21.15.42:0/318834660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d008d5f40 msgr2=0x562d008e02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:55.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.113+0000 7efca26ca740 1 --2- 172.21.15.42:0/318834660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d008d5f40 0x562d008e02c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0cc990 tx=0x7efc8c0d7320 comp rx=0 tx=0).stop 2024-08-26T00:01:55.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.114+0000 7efca26ca740 1 -- 172.21.15.42:0/318834660 shutdown_connections 2024-08-26T00:01:55.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.114+0000 7efca26ca740 1 --2- 172.21.15.42:0/318834660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562d008e0800 0x562d008e2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.114+0000 7efca26ca740 1 --2- 172.21.15.42:0/318834660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d008d5f40 0x562d008e02c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.114+0000 7efca26ca740 1 --2- 172.21.15.42:0/318834660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008d5620 0x562d008d5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.114+0000 7efca26ca740 1 -- 172.21.15.42:0/318834660 >> 172.21.15.42:0/318834660 conn(0x562d008d1bb0 msgr2=0x562d008d1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:55.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.114+0000 7efc9dc00640 1 --2- 172.21.15.42:0/3557861845 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7efc800a2c90 0x7efc800a5150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efc90009fd0 tx=0x7efc90010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:55.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.114+0000 7efca26ca740 1 -- 172.21.15.42:0/318834660 shutdown_connections 2024-08-26T00:01:55.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.114+0000 7efca26ca740 1 -- 172.21.15.42:0/318834660 wait complete. 2024-08-26T00:01:55.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.114+0000 7efca26ca740 1 -- start start 2024-08-26T00:01:55.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.115+0000 7efca26ca740 1 Processor -- start 2024-08-26T00:01:55.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.115+0000 7efca26ca740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562d008d5620 0x562d008dd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:55.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.115+0000 7efca26ca740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008d5f40 0x562d008ddbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:55.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.115+0000 7efca26ca740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d008e0800 0x562d008de110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:55.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.115+0000 7efca26ca740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562d008e33d0 con 0x562d008d5f40 2024-08-26T00:01:55.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.115+0000 7efca26ca740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562d007f6bf0 con 0x562d008e0800 2024-08-26T00:01:55.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.115+0000 7efca26ca740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562d008e3550 con 0x562d008d5620 2024-08-26T00:01:55.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.115+0000 7efca26ca740 10 client.0 _ll_register_callbacks cb 0x562d007e2dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:01:55.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.115+0000 7efc9d200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562d008d5620 0x562d008dd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:55.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.116+0000 7efc9d200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562d008d5620 0x562d008dd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:51032/0 (socket says 172.21.15.42:51032) 2024-08-26T00:01:55.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.116+0000 7efc97e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008d5f40 0x562d008ddbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:55.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.116+0000 7efc9d200640 1 -- 172.21.15.42:0/1041600936 learned_addr learned my addr 172.21.15.42:0/1041600936 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:55.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.116+0000 7efc9dc00640 1 --2- 172.21.15.42:0/1041600936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d008e0800 0x562d008de110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:55.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.116+0000 7efc9d200640 1 -- 172.21.15.42:0/1041600936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d008e0800 msgr2=0x562d008de110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:55.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.116+0000 7efc9d200640 1 --2- 172.21.15.42:0/1041600936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d008e0800 0x562d008de110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.116+0000 7efc9d200640 1 -- 172.21.15.42:0/1041600936 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008d5f40 msgr2=0x562d008ddbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:55.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.116+0000 7efc9d200640 1 --2- 172.21.15.42:0/1041600936 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008d5f40 0x562d008ddbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.116+0000 7efc9d200640 1 -- 172.21.15.42:0/1041600936 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d008ec8d0 con 0x562d008d5620 2024-08-26T00:01:55.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.116+0000 7efc9d200640 1 --2- 172.21.15.42:0/1041600936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562d008d5620 0x562d008dd690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efc8c097bf0 tx=0x7efc8c003960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20067b5192fafe35 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:55.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.116+0000 7efc7ea00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:01:55.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.116+0000 7efc7ea00640 1 -- 172.21.15.42:0/1041600936 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c020070 con 0x562d008d5620 2024-08-26T00:01:55.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.117+0000 7efca26ca740 1 -- 172.21.15.42:0/1041600936 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc8c0d7d20 con 0x562d008d5620 2024-08-26T00:01:55.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.117+0000 7efc7ea00640 1 -- 172.21.15.42:0/1041600936 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7efc8c0d2350 con 0x562d008d5620 2024-08-26T00:01:55.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.117+0000 7efc7ea00640 1 -- 172.21.15.42:0/1041600936 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7efc8c097a30 con 0x562d008d5620 2024-08-26T00:01:55.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.117+0000 7efca26ca740 10 client.24922 fetch_fsmap learned FSMap version 23 2024-08-26T00:01:55.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.117+0000 7efca26ca740 1 -- 172.21.15.42:0/1041600936 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x562d008e33d0 con 0x562d008d5620 2024-08-26T00:01:55.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.117+0000 7efc7ea00640 1 -- 172.21.15.42:0/1041600936 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc8c0d7d20 con 0x562d008d5620 2024-08-26T00:01:55.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.117+0000 7efc7ea00640 1 -- 172.21.15.42:0/1041600936 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7efc8c097e00 con 0x562d008d5620 2024-08-26T00:01:55.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.117+0000 7efca26ca740 10 client.24922 fetch_fsmap finished waiting for FSMap version 23 2024-08-26T00:01:55.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.117+0000 7efca26ca740 10 client.24922 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-26T00:01:55.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.117+0000 7efca26ca740 20 client.24922 populate_metadata read hostname 'smithi042' 2024-08-26T00:01:55.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.117+0000 7efca26ca740 1 --2- 172.21.15.42:0/1041600936 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562d008f1230 0x562d008f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:55.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.117+0000 7efca26ca740 4 client.24922 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:01:55.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.117+0000 7efca26ca740 1 -- 172.21.15.42:0/1041600936 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d00849320 con 0x562d008f1230 2024-08-26T00:01:55.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.118+0000 7efc97e00640 1 --2- 172.21.15.42:0/1041600936 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562d008f1230 0x562d008f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:55.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.118+0000 7efc97e00640 1 --2- 172.21.15.42:0/1041600936 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562d008f1230 0x562d008f26a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3b7810f121613a9c server_cookie=499ea9aa78b09ce6 in_seq=0 out_seq=0 2024-08-26T00:01:55.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.118+0000 7efc7ea00640 10 client.24922 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:01:55.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.119+0000 7efc7ea00640 1 -- 172.21.15.42:0/1041600936 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562d00849320 con 0x562d008f1230 2024-08-26T00:01:55.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.119+0000 7efc7ea00640 10 client.24922 handle_command_reply: tid=0 2024-08-26T00:01:55.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.119+0000 7efca26ca740 1 client.24922 shutdown 2024-08-26T00:01:55.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.120+0000 7efca26ca740 1 -- 172.21.15.42:0/1041600936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562d008d5620 msgr2=0x562d008dd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:55.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.120+0000 7efca26ca740 1 --2- 172.21.15.42:0/1041600936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562d008d5620 0x562d008dd690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efc8c097bf0 tx=0x7efc8c003960 comp rx=0 tx=0).stop 2024-08-26T00:01:55.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.120+0000 7efca26ca740 1 -- 172.21.15.42:0/1041600936 shutdown_connections 2024-08-26T00:01:55.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.120+0000 7efca26ca740 1 --2- 172.21.15.42:0/1041600936 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562d008f1230 0x562d008f26a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.120+0000 7efca26ca740 1 --2- 172.21.15.42:0/1041600936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d008e0800 0x562d008de110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.120+0000 7efca26ca740 1 --2- 172.21.15.42:0/1041600936 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008d5f40 0x562d008ddbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.120+0000 7efca26ca740 1 --2- 172.21.15.42:0/1041600936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562d008d5620 0x562d008dd690 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.120+0000 7efc7ea00640 0 client.24922 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:01:55.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.120+0000 7efca26ca740 1 -- 172.21.15.42:0/1041600936 >> 172.21.15.42:0/1041600936 conn(0x562d008d1bb0 msgr2=0x562d008d78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:55.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.120+0000 7efca26ca740 1 -- 172.21.15.42:0/1041600936 shutdown_connections 2024-08-26T00:01:55.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.120+0000 7efca26ca740 1 -- 172.21.15.42:0/1041600936 wait complete. 2024-08-26T00:01:55.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.120+0000 7efca26ca740 20 client.24922 trim_cache size 0 max 16384 2024-08-26T00:01:55.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.141+0000 7efca26ca740 1 Processor -- start 2024-08-26T00:01:55.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.141+0000 7efca26ca740 1 -- start start 2024-08-26T00:01:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.141+0000 7efca26ca740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008d5620 0x562d008f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.141+0000 7efca26ca740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d008d5f40 0x562d008d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.141+0000 7efca26ca740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562d008e0800 0x562d008d7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.141+0000 7efca26ca740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562d008f09e0 con 0x562d008d5620 2024-08-26T00:01:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.141+0000 7efca26ca740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562d008f10b0 con 0x562d008d5f40 2024-08-26T00:01:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.141+0000 7efca26ca740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562d008f1780 con 0x562d008e0800 2024-08-26T00:01:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.141+0000 7efc9d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008d5620 0x562d008f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.141+0000 7efc9d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008d5620 0x562d008f1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45688/0 (socket says 172.21.15.42:45688) 2024-08-26T00:01:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.141+0000 7efc9d200640 1 -- 172.21.15.42:0/620354263 learned_addr learned my addr 172.21.15.42:0/620354263 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.141+0000 7efc97e00640 1 --2- 172.21.15.42:0/620354263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d008d5f40 0x562d008d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.141+0000 7efc9dc00640 1 --2- 172.21.15.42:0/620354263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562d008e0800 0x562d008d7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:55.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.142+0000 7efc9d200640 1 -- 172.21.15.42:0/620354263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562d008e0800 msgr2=0x562d008d7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:55.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.142+0000 7efc9d200640 1 --2- 172.21.15.42:0/620354263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562d008e0800 0x562d008d7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.142+0000 7efc9d200640 1 -- 172.21.15.42:0/620354263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d008d5f40 msgr2=0x562d008d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:55.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.142+0000 7efc9d200640 1 --2- 172.21.15.42:0/620354263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d008d5f40 0x562d008d1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.142+0000 7efc9d200640 1 -- 172.21.15.42:0/620354263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d008d19c0 con 0x562d008d5620 2024-08-26T00:01:55.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.142+0000 7efc9d200640 1 --2- 172.21.15.42:0/620354263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008d5620 0x562d008f1fd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efc8c09b720 tx=0x7efc8c099ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42971d1493ce7a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:55.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.142+0000 7efc89600640 1 -- 172.21.15.42:0/620354263 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c020030 con 0x562d008d5620 2024-08-26T00:01:55.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.142+0000 7efc89600640 1 -- 172.21.15.42:0/620354263 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc8c0ccbe0 con 0x562d008d5620 2024-08-26T00:01:55.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.142+0000 7efc89600640 1 -- 172.21.15.42:0/620354263 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c09b0f0 con 0x562d008d5620 2024-08-26T00:01:55.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.143+0000 7efca26ca740 1 -- 172.21.15.42:0/620354263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008d5620 msgr2=0x562d008f1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:55.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.143+0000 7efca26ca740 1 --2- 172.21.15.42:0/620354263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008d5620 0x562d008f1fd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efc8c09b720 tx=0x7efc8c099ca0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.143+0000 7efca26ca740 1 -- 172.21.15.42:0/620354263 shutdown_connections 2024-08-26T00:01:55.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.143+0000 7efca26ca740 1 --2- 172.21.15.42:0/620354263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562d008e0800 0x562d008d7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.143+0000 7efca26ca740 1 --2- 172.21.15.42:0/620354263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d008d5f40 0x562d008d1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.143+0000 7efca26ca740 1 --2- 172.21.15.42:0/620354263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008d5620 0x562d008f1fd0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.143+0000 7efca26ca740 1 -- 172.21.15.42:0/620354263 >> 172.21.15.42:0/620354263 conn(0x562d008d1bb0 msgr2=0x562d008d7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:55.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.143+0000 7efca26ca740 1 -- 172.21.15.42:0/620354263 shutdown_connections 2024-08-26T00:01:55.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.143+0000 7efca26ca740 1 -- 172.21.15.42:0/620354263 wait complete. 2024-08-26T00:01:55.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.144+0000 7efca26ca740 1 -- start start 2024-08-26T00:01:55.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.144+0000 7efca26ca740 1 Processor -- start 2024-08-26T00:01:55.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.144+0000 7efca26ca740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d008d5620 0x562d008faf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:55.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.144+0000 7efca26ca740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562d008d5f40 0x562d008f62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:55.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.144+0000 7efca26ca740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008e0800 0x562d008f6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:55.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.144+0000 7efca26ca740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562d008f2520 con 0x562d008e0800 2024-08-26T00:01:55.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.145+0000 7efca26ca740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562d008f1e50 con 0x562d008d5620 2024-08-26T00:01:55.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.145+0000 7efca26ca740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562d008f2bf0 con 0x562d008d5f40 2024-08-26T00:01:55.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.145+0000 7efca26ca740 10 client.0 _ll_register_callbacks cb 0x7efc840096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:01:55.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.145+0000 7efc9d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d008d5620 0x562d008faf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:55.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.145+0000 7efc9dc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008e0800 0x562d008f6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:55.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.145+0000 7efc9d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d008d5620 0x562d008faf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:41498/0 (socket says 172.21.15.42:41498) 2024-08-26T00:01:55.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.145+0000 7efc9d200640 1 -- 172.21.15.42:0/505830005 learned_addr learned my addr 172.21.15.42:0/505830005 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:55.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.145+0000 7efc97e00640 1 --2- 172.21.15.42:0/505830005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562d008d5f40 0x562d008f62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:55.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.145+0000 7efc9d200640 1 -- 172.21.15.42:0/505830005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562d008d5f40 msgr2=0x562d008f62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:55.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.145+0000 7efc9d200640 1 --2- 172.21.15.42:0/505830005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562d008d5f40 0x562d008f62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.145+0000 7efc9d200640 1 -- 172.21.15.42:0/505830005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008e0800 msgr2=0x562d008f6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:55.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.145+0000 7efc9d200640 1 --2- 172.21.15.42:0/505830005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008e0800 0x562d008f6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.145+0000 7efc9d200640 1 -- 172.21.15.42:0/505830005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d008f6ef0 con 0x562d008d5620 2024-08-26T00:01:55.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.145+0000 7efc97e00640 1 --2- 172.21.15.42:0/505830005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562d008d5f40 0x562d008f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:01:55.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.145+0000 7efc9d200640 1 --2- 172.21.15.42:0/505830005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d008d5620 0x562d008faf90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efc8c09fc50 tx=0x7efc8c0d2560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b334001b692fb23 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:55.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.146+0000 7efc7ea00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:01:55.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.146+0000 7efc7ea00640 1 -- 172.21.15.42:0/505830005 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c020050 con 0x562d008d5620 2024-08-26T00:01:55.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.146+0000 7efc7ea00640 1 -- 172.21.15.42:0/505830005 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7efc8c0860b0 con 0x562d008d5620 2024-08-26T00:01:55.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.146+0000 7efca26ca740 1 -- 172.21.15.42:0/505830005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc8c0ccbe0 con 0x562d008d5620 2024-08-26T00:01:55.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.146+0000 7efc7ea00640 1 -- 172.21.15.42:0/505830005 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7efc8c09b2d0 con 0x562d008d5620 2024-08-26T00:01:55.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.146+0000 7efca26ca740 10 client.24899 fetch_fsmap learned FSMap version 23 2024-08-26T00:01:55.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.146+0000 7efca26ca740 1 -- 172.21.15.42:0/505830005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x562d008f6ef0 con 0x562d008d5620 2024-08-26T00:01:55.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.146+0000 7efc7ea00640 1 -- 172.21.15.42:0/505830005 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc8c0ccbe0 con 0x562d008d5620 2024-08-26T00:01:55.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.146+0000 7efc7ea00640 1 -- 172.21.15.42:0/505830005 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7efc8c004240 con 0x562d008d5620 2024-08-26T00:01:55.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.146+0000 7efca26ca740 10 client.24899 fetch_fsmap finished waiting for FSMap version 23 2024-08-26T00:01:55.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.146+0000 7efca26ca740 10 client.24899 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-26T00:01:55.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.146+0000 7efca26ca740 20 client.24899 populate_metadata read hostname 'smithi042' 2024-08-26T00:01:55.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.147+0000 7efca26ca740 1 --2- 172.21.15.42:0/505830005 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562d0095fd50 0x562d0095ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:55.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.147+0000 7efca26ca740 4 client.24899 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-26T00:01:55.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.147+0000 7efca26ca740 1 -- 172.21.15.42:0/505830005 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "status"}) -- 0x562d00843830 con 0x562d0095fd50 2024-08-26T00:01:55.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.147+0000 7efc97e00640 1 --2- 172.21.15.42:0/505830005 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562d0095fd50 0x562d0095ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:55.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.147+0000 7efc97e00640 1 --2- 172.21.15.42:0/505830005 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562d0095fd50 0x562d0095ea60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6cf0316be6ba4535 server_cookie=f36ddcb395b57238 in_seq=0 out_seq=0 2024-08-26T00:01:55.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.147+0000 7efc7ea00640 10 client.24899 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:01:55.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.147+0000 7efc7ea00640 1 -- 172.21.15.42:0/505830005 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x562d00843830 con 0x562d0095fd50 2024-08-26T00:01:55.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.147+0000 7efc7ea00640 10 client.24899 handle_command_reply: tid=0 2024-08-26T00:01:55.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.147+0000 7efca26ca740 1 client.24899 shutdown 2024-08-26T00:01:55.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.148+0000 7efca26ca740 1 -- 172.21.15.42:0/505830005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d008d5620 msgr2=0x562d008faf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:55.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.148+0000 7efca26ca740 1 --2- 172.21.15.42:0/505830005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d008d5620 0x562d008faf90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efc8c09fc50 tx=0x7efc8c0d2560 comp rx=0 tx=0).stop 2024-08-26T00:01:55.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.148+0000 7efca26ca740 1 -- 172.21.15.42:0/505830005 shutdown_connections 2024-08-26T00:01:55.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.148+0000 7efca26ca740 1 --2- 172.21.15.42:0/505830005 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562d0095fd50 0x562d0095ea60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.148+0000 7efca26ca740 1 --2- 172.21.15.42:0/505830005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d008e0800 0x562d008f6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.148+0000 7efca26ca740 1 --2- 172.21.15.42:0/505830005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562d008d5f40 0x562d008f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.148+0000 7efca26ca740 1 --2- 172.21.15.42:0/505830005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562d008d5620 0x562d008faf90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.148+0000 7efc7ea00640 0 client.24899 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:01:55.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.148+0000 7efca26ca740 1 -- 172.21.15.42:0/505830005 >> 172.21.15.42:0/505830005 conn(0x562d008d1bb0 msgr2=0x562d008d7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:55.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.148+0000 7efca26ca740 1 -- 172.21.15.42:0/505830005 shutdown_connections 2024-08-26T00:01:55.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.148+0000 7efca26ca740 1 -- 172.21.15.42:0/505830005 wait complete. 2024-08-26T00:01:55.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.148+0000 7efca26ca740 20 client.24899 trim_cache size 0 max 16384 2024-08-26T00:01:55.152 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:01:55.152 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "f89d317a-633c-11ef-bcd2-c7b262605968", 2024-08-26T00:01:55.152 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 1, 2024-08-26T00:01:55.152 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24527, 2024-08-26T00:01:55.152 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-08-26T00:01:55.152 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-08-26T00:01:55.152 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-08-26T00:01:55.152 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 76.759155245000002, 2024-08-26T00:01:55.153 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 23, 2024-08-26T00:01:55.153 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 80, 2024-08-26T00:01:55.153 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 78, 2024-08-26T00:01:55.153 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 97.071040198999995 2024-08-26T00:01:55.153 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:01:55.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.149+0000 7efc9fc00640 1 -- 172.21.15.42:0/3557861845 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7efc800a2c90 msgr2=0x7efc800a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:55.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.149+0000 7efc9fc00640 1 --2- 172.21.15.42:0/3557861845 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7efc800a2c90 0x7efc800a5150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efc90009fd0 tx=0x7efc90010040 comp rx=0 tx=0).stop 2024-08-26T00:01:55.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.149+0000 7efc9fc00640 1 -- 172.21.15.42:0/3557861845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc98074360 msgr2=0x7efc9819a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:55.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.149+0000 7efc9fc00640 1 --2- 172.21.15.42:0/3557861845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc98074360 0x7efc9819a460 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efc8c005fd0 tx=0x7efc8c00dde0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.149+0000 7efc9fc00640 1 -- 172.21.15.42:0/3557861845 shutdown_connections 2024-08-26T00:01:55.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.149+0000 7efc9fc00640 1 --2- 172.21.15.42:0/3557861845 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7efc800a2c90 0x7efc800a5150 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.149+0000 7efc9fc00640 1 --2- 172.21.15.42:0/3557861845 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc9810e1c0 0x7efc9819ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.149+0000 7efc9fc00640 1 --2- 172.21.15.42:0/3557861845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc98074c80 0x7efc9819a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.149+0000 7efc9fc00640 1 --2- 172.21.15.42:0/3557861845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc98074360 0x7efc9819a460 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:55.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.149+0000 7efc9fc00640 1 -- 172.21.15.42:0/3557861845 >> 172.21.15.42:0/3557861845 conn(0x7efc980fd660 msgr2=0x7efc980fef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:55.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.149+0000 7efc9fc00640 1 -- 172.21.15.42:0/3557861845 shutdown_connections 2024-08-26T00:01:55.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:55.149+0000 7efc9fc00640 1 -- 172.21.15.42:0/3557861845 wait complete. 2024-08-26T00:01:55.858 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.i status 2024-08-26T00:01:56.235 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:56.393 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:56 smithi042 ceph-mon[17225]: pgmap v321: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:01:56.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:56 smithi043 ceph-mon[22091]: pgmap v321: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:01:56.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:56 smithi181 ceph-mon[22102]: pgmap v321: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:01:56.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.810+0000 7fd009600640 1 -- 172.21.15.42:0/3141291055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0040764c0 msgr2=0x7fd0040768a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:56.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.810+0000 7fd009600640 1 --2- 172.21.15.42:0/3141291055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0040764c0 0x7fd0040768a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcff4009900 tx=0x7fcff402a410 comp rx=0 tx=0).stop 2024-08-26T00:01:56.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.810+0000 7fd009600640 1 -- 172.21.15.42:0/3141291055 shutdown_connections 2024-08-26T00:01:56.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.810+0000 7fd009600640 1 --2- 172.21.15.42:0/3141291055 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0041127f0 0x7fd004114be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.810+0000 7fd009600640 1 --2- 172.21.15.42:0/3141291055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd004076de0 0x7fd0041122b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.810+0000 7fd009600640 1 --2- 172.21.15.42:0/3141291055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0040764c0 0x7fd0040768a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.810+0000 7fd009600640 1 -- 172.21.15.42:0/3141291055 >> 172.21.15.42:0/3141291055 conn(0x7fd0040ff7f0 msgr2=0x7fd004101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:56.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.810+0000 7fd009600640 1 -- 172.21.15.42:0/3141291055 shutdown_connections 2024-08-26T00:01:56.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.810+0000 7fd009600640 1 -- 172.21.15.42:0/3141291055 wait complete. 2024-08-26T00:01:56.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.811+0000 7fd009600640 1 Processor -- start 2024-08-26T00:01:56.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.811+0000 7fd009600640 1 -- start start 2024-08-26T00:01:56.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.811+0000 7fd009600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0040764c0 0x7fd0041a45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:56.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.811+0000 7fd009600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd004076de0 0x7fd0041a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:56.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.811+0000 7fd009600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0041127f0 0x7fd00419e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:56.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.811+0000 7fd009600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd0041183d0 con 0x7fd0040764c0 2024-08-26T00:01:56.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.811+0000 7fd009600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd004118250 con 0x7fd0041127f0 2024-08-26T00:01:56.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.811+0000 7fd009600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd004118550 con 0x7fd004076de0 2024-08-26T00:01:56.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.812+0000 7fd002a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0040764c0 0x7fd0041a45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:56.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.812+0000 7fd002a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0040764c0 0x7fd0041a45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45730/0 (socket says 172.21.15.42:45730) 2024-08-26T00:01:56.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.812+0000 7fd002a00640 1 -- 172.21.15.42:0/3552768987 learned_addr learned my addr 172.21.15.42:0/3552768987 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:56.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.812+0000 7fd003400640 1 --2- 172.21.15.42:0/3552768987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0041127f0 0x7fd00419e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:56.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.812+0000 7fcffbe00640 1 --2- 172.21.15.42:0/3552768987 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd004076de0 0x7fd0041a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:56.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.812+0000 7fd002a00640 1 -- 172.21.15.42:0/3552768987 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd004076de0 msgr2=0x7fd0041a4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:56.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.812+0000 7fd002a00640 1 --2- 172.21.15.42:0/3552768987 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd004076de0 0x7fd0041a4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.812+0000 7fd002a00640 1 -- 172.21.15.42:0/3552768987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0041127f0 msgr2=0x7fd00419e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:56.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.812+0000 7fd002a00640 1 --2- 172.21.15.42:0/3552768987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0041127f0 0x7fd00419e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.812+0000 7fd002a00640 1 -- 172.21.15.42:0/3552768987 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd00419ef20 con 0x7fd0040764c0 2024-08-26T00:01:56.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.813+0000 7fd002a00640 1 --2- 172.21.15.42:0/3552768987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0040764c0 0x7fd0041a45e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcff4004770 tx=0x7fcff4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:56.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.813+0000 7fcffb400640 1 -- 172.21.15.42:0/3552768987 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff403f070 con 0x7fd0040764c0 2024-08-26T00:01:56.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.813+0000 7fcffb400640 1 -- 172.21.15.42:0/3552768987 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcff4031ca0 con 0x7fd0040764c0 2024-08-26T00:01:56.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.813+0000 7fcffb400640 1 -- 172.21.15.42:0/3552768987 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff4035030 con 0x7fd0040764c0 2024-08-26T00:01:56.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.813+0000 7fd009600640 1 -- 172.21.15.42:0/3552768987 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd00419f1b0 con 0x7fd0040764c0 2024-08-26T00:01:56.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.813+0000 7fd009600640 1 -- 172.21.15.42:0/3552768987 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0041ab390 con 0x7fd0040764c0 2024-08-26T00:01:56.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.816+0000 7fcffb400640 1 -- 172.21.15.42:0/3552768987 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fcff4042070 con 0x7fd0040764c0 2024-08-26T00:01:56.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.816+0000 7fd00c1df740 1 Processor -- start 2024-08-26T00:01:56.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.817+0000 7fd00c1df740 1 -- start start 2024-08-26T00:01:56.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.817+0000 7fd00c1df740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d1b620 0x557538d1ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:56.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.817+0000 7fd00c1df740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557538d1bf40 0x557538d262c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:56.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.817+0000 7fd00c1df740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557538d26800 0x557538d28bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:56.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.817+0000 7fd00c1df740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557538c81db0 con 0x557538d1b620 2024-08-26T00:01:56.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.817+0000 7fd00c1df740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557538c194a0 con 0x557538d1bf40 2024-08-26T00:01:56.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.817+0000 7fd00c1df740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557538c7dd70 con 0x557538d26800 2024-08-26T00:01:56.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.817+0000 7fd003400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d1b620 0x557538d1ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:56.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.817+0000 7fd002a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557538d1bf40 0x557538d262c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:56.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.817+0000 7fd003400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d1b620 0x557538d1ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45746/0 (socket says 172.21.15.42:45746) 2024-08-26T00:01:56.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.817+0000 7fd003400640 1 -- 172.21.15.42:0/3002047054 learned_addr learned my addr 172.21.15.42:0/3002047054 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:56.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.817+0000 7fcffbe00640 1 --2- 172.21.15.42:0/3002047054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557538d26800 0x557538d28bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:56.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.818+0000 7fcffbe00640 1 -- 172.21.15.42:0/3002047054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557538d1bf40 msgr2=0x557538d262c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:56.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.818+0000 7fcffbe00640 1 --2- 172.21.15.42:0/3002047054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557538d1bf40 0x557538d262c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.818+0000 7fcffbe00640 1 -- 172.21.15.42:0/3002047054 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d1b620 msgr2=0x557538d1ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:56.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.818+0000 7fcffbe00640 1 --2- 172.21.15.42:0/3002047054 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d1b620 0x557538d1ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.818+0000 7fcffbe00640 1 -- 172.21.15.42:0/3002047054 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575389f32b0 con 0x557538d26800 2024-08-26T00:01:56.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.818+0000 7fd003400640 1 --2- 172.21.15.42:0/3002047054 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d1b620 0x557538d1ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:56.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.818+0000 7fcffb400640 1 --2- 172.21.15.42:0/3552768987 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcfe80a2c10 0x7fcfe80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:56.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.818+0000 7fcffbe00640 1 --2- 172.21.15.42:0/3002047054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557538d26800 0x557538d28bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcfec009bd0 tx=0x7fcfec011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53b2ec36c099c95a server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:56.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.818+0000 7fcffb400640 1 -- 172.21.15.42:0/3552768987 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fcff40ef7d0 con 0x7fd0040764c0 2024-08-26T00:01:56.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.818+0000 7fd003400640 1 --2- 172.21.15.42:0/3552768987 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcfe80a2c10 0x7fcfe80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:56.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.818+0000 7fcff3400640 1 -- 172.21.15.42:0/3002047054 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfec004230 con 0x557538d26800 2024-08-26T00:01:56.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.819+0000 7fcff3400640 1 -- 172.21.15.42:0/3002047054 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfec009e40 con 0x557538d26800 2024-08-26T00:01:56.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.819+0000 7fcff3400640 1 -- 172.21.15.42:0/3002047054 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfec004d70 con 0x557538d26800 2024-08-26T00:01:56.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.819+0000 7fd00c1df740 1 -- 172.21.15.42:0/3002047054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557538d26800 msgr2=0x557538d28bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:56.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.819+0000 7fd00c1df740 1 --2- 172.21.15.42:0/3002047054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557538d26800 0x557538d28bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcfec009bd0 tx=0x7fcfec011810 comp rx=0 tx=0).stop 2024-08-26T00:01:56.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.819+0000 7fd003400640 1 --2- 172.21.15.42:0/3552768987 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcfe80a2c10 0x7fcfe80a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcffc009fd0 tx=0x7fcffc009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:56.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.819+0000 7fd00c1df740 1 -- 172.21.15.42:0/3002047054 shutdown_connections 2024-08-26T00:01:56.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.819+0000 7fd00c1df740 1 --2- 172.21.15.42:0/3002047054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557538d26800 0x557538d28bf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.819+0000 7fd00c1df740 1 --2- 172.21.15.42:0/3002047054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557538d1bf40 0x557538d262c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.819+0000 7fd00c1df740 1 --2- 172.21.15.42:0/3002047054 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d1b620 0x557538d1ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.819+0000 7fd00c1df740 1 -- 172.21.15.42:0/3002047054 >> 172.21.15.42:0/3002047054 conn(0x557538d17bb0 msgr2=0x557538d17f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:56.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.820+0000 7fd00c1df740 1 -- 172.21.15.42:0/3002047054 shutdown_connections 2024-08-26T00:01:56.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.820+0000 7fd00c1df740 1 -- 172.21.15.42:0/3002047054 wait complete. 2024-08-26T00:01:56.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.820+0000 7fd00c1df740 1 -- start start 2024-08-26T00:01:56.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.820+0000 7fd00c1df740 1 Processor -- start 2024-08-26T00:01:56.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.821+0000 7fd00c1df740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557538d1b620 0x557538d23630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:56.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.821+0000 7fd00c1df740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d1bf40 0x557538d23b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:56.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.821+0000 7fd00c1df740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557538d26800 0x557538d240b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:56.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.821+0000 7fd00c1df740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557538d293d0 con 0x557538d1bf40 2024-08-26T00:01:56.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.821+0000 7fd00c1df740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557538c3cbf0 con 0x557538d1b620 2024-08-26T00:01:56.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.821+0000 7fd00c1df740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557538d29550 con 0x557538d26800 2024-08-26T00:01:56.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.821+0000 7fd00c1df740 10 client.0 _ll_register_callbacks cb 0x557538c28dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:01:56.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.821+0000 7fcffbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d1bf40 0x557538d23b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:56.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.821+0000 7fd002a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557538d1b620 0x557538d23630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:56.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.821+0000 7fcffbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d1bf40 0x557538d23b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45752/0 (socket says 172.21.15.42:45752) 2024-08-26T00:01:56.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.821+0000 7fcffbe00640 1 -- 172.21.15.42:0/4088477743 learned_addr learned my addr 172.21.15.42:0/4088477743 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:56.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.821+0000 7fd003400640 1 --2- 172.21.15.42:0/4088477743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557538d26800 0x557538d240b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:56.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.821+0000 7fd002a00640 1 -- 172.21.15.42:0/4088477743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557538d26800 msgr2=0x557538d240b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:56.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.821+0000 7fd002a00640 1 --2- 172.21.15.42:0/4088477743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557538d26800 0x557538d240b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.821+0000 7fd002a00640 1 -- 172.21.15.42:0/4088477743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d1bf40 msgr2=0x557538d23b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:56.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.821+0000 7fd002a00640 1 --2- 172.21.15.42:0/4088477743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d1bf40 0x557538d23b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.821+0000 7fd002a00640 1 -- 172.21.15.42:0/4088477743 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557538d32840 con 0x557538d1b620 2024-08-26T00:01:56.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.821+0000 7fd003400640 1 --2- 172.21.15.42:0/4088477743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557538d26800 0x557538d240b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:01:56.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.821+0000 7fcffbe00640 1 --2- 172.21.15.42:0/4088477743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d1bf40 0x557538d23b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:56.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.822+0000 7fd002a00640 1 --2- 172.21.15.42:0/4088477743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557538d1b620 0x557538d23630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcff40ed140 tx=0x7fcff4009620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e846d5376398c8f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:56.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.822+0000 7fcfe7e00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:01:56.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.822+0000 7fcfe7e00640 1 -- 172.21.15.42:0/4088477743 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff4049070 con 0x557538d1b620 2024-08-26T00:01:56.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.822+0000 7fcfe7e00640 1 -- 172.21.15.42:0/4088477743 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fcff40ed390 con 0x557538d1b620 2024-08-26T00:01:56.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.822+0000 7fd00c1df740 1 -- 172.21.15.42:0/4088477743 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557538c8f320 con 0x557538d1b620 2024-08-26T00:01:56.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.822+0000 7fcfe7e00640 1 -- 172.21.15.42:0/4088477743 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fcff40bbb40 con 0x557538d1b620 2024-08-26T00:01:56.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.822+0000 7fd00c1df740 10 client.24911 fetch_fsmap learned FSMap version 23 2024-08-26T00:01:56.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.822+0000 7fd00c1df740 1 -- 172.21.15.42:0/4088477743 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x557538d351a0 con 0x557538d1b620 2024-08-26T00:01:56.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.823+0000 7fcfe7e00640 1 -- 172.21.15.42:0/4088477743 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x557538c8f320 con 0x557538d1b620 2024-08-26T00:01:56.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.823+0000 7fcfe7e00640 1 -- 172.21.15.42:0/4088477743 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fcff40bc260 con 0x557538d1b620 2024-08-26T00:01:56.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.823+0000 7fd00c1df740 10 client.24911 fetch_fsmap finished waiting for FSMap version 23 2024-08-26T00:01:56.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.823+0000 7fd00c1df740 10 client.24911 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-26T00:01:56.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.823+0000 7fd00c1df740 20 client.24911 populate_metadata read hostname 'smithi042' 2024-08-26T00:01:56.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.823+0000 7fd00c1df740 1 --2- 172.21.15.42:0/4088477743 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x557538d37820 0x557538d38c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:56.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.823+0000 7fd00c1df740 4 client.24911 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:01:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.823+0000 7fd00c1df740 1 -- 172.21.15.42:0/4088477743 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557538c89830 con 0x557538d37820 2024-08-26T00:01:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.823+0000 7fcffbe00640 1 --2- 172.21.15.42:0/4088477743 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x557538d37820 0x557538d38c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.824+0000 7fcffbe00640 1 --2- 172.21.15.42:0/4088477743 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x557538d37820 0x557538d38c90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d89ab5a047ad1091 server_cookie=d66be9f433ed2a9c in_seq=0 out_seq=0 2024-08-26T00:01:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.824+0000 7fcfe7e00640 10 client.24911 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:01:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.825+0000 7fcfe7e00640 1 -- 172.21.15.42:0/4088477743 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557538c89830 con 0x557538d37820 2024-08-26T00:01:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.825+0000 7fcfe7e00640 10 client.24911 handle_command_reply: tid=0 2024-08-26T00:01:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.825+0000 7fd00c1df740 1 client.24911 shutdown 2024-08-26T00:01:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.825+0000 7fd00c1df740 1 -- 172.21.15.42:0/4088477743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557538d1b620 msgr2=0x557538d23630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.825+0000 7fd00c1df740 1 --2- 172.21.15.42:0/4088477743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557538d1b620 0x557538d23630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcff40ed140 tx=0x7fcff4009620 comp rx=0 tx=0).stop 2024-08-26T00:01:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.825+0000 7fd00c1df740 1 -- 172.21.15.42:0/4088477743 shutdown_connections 2024-08-26T00:01:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.825+0000 7fd00c1df740 1 --2- 172.21.15.42:0/4088477743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557538d26800 0x557538d240b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.825+0000 7fd00c1df740 1 --2- 172.21.15.42:0/4088477743 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x557538d37820 0x557538d38c90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.825+0000 7fd00c1df740 1 --2- 172.21.15.42:0/4088477743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d1bf40 0x557538d23b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.825+0000 7fd00c1df740 1 --2- 172.21.15.42:0/4088477743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557538d1b620 0x557538d23630 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.825+0000 7fcfe7e00640 0 client.24911 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:01:56.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.825+0000 7fd00c1df740 1 -- 172.21.15.42:0/4088477743 >> 172.21.15.42:0/4088477743 conn(0x557538d17bb0 msgr2=0x557538d1d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:56.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.825+0000 7fd00c1df740 1 -- 172.21.15.42:0/4088477743 shutdown_connections 2024-08-26T00:01:56.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.825+0000 7fd00c1df740 1 -- 172.21.15.42:0/4088477743 wait complete. 2024-08-26T00:01:56.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.825+0000 7fd00c1df740 20 client.24911 trim_cache size 0 max 16384 2024-08-26T00:01:56.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.844+0000 7fd00c1df740 1 Processor -- start 2024-08-26T00:01:56.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.844+0000 7fd00c1df740 1 -- start start 2024-08-26T00:01:56.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.844+0000 7fd00c1df740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557538d1b620 0x557538d37ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:56.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.844+0000 7fd00c1df740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d1bf40 0x557538d22630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:56.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.844+0000 7fd00c1df740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557538d26800 0x557538d23f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:56.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.844+0000 7fd00c1df740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557538d36fd0 con 0x557538d1bf40 2024-08-26T00:01:56.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.844+0000 7fd00c1df740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557538d376a0 con 0x557538d1b620 2024-08-26T00:01:56.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.844+0000 7fd00c1df740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557538d37d70 con 0x557538d26800 2024-08-26T00:01:56.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.845+0000 7fcffbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d1bf40 0x557538d22630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:56.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.845+0000 7fd002a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557538d1b620 0x557538d37ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:56.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.845+0000 7fcffbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d1bf40 0x557538d22630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45760/0 (socket says 172.21.15.42:45760) 2024-08-26T00:01:56.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.845+0000 7fcffbe00640 1 -- 172.21.15.42:0/1220177835 learned_addr learned my addr 172.21.15.42:0/1220177835 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:56.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.845+0000 7fd003400640 1 --2- 172.21.15.42:0/1220177835 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557538d26800 0x557538d23f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:56.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.845+0000 7fcffbe00640 1 -- 172.21.15.42:0/1220177835 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557538d26800 msgr2=0x557538d23f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:56.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.845+0000 7fcffbe00640 1 --2- 172.21.15.42:0/1220177835 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557538d26800 0x557538d23f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.845+0000 7fcffbe00640 1 -- 172.21.15.42:0/1220177835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557538d1b620 msgr2=0x557538d37ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:56.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.845+0000 7fcffbe00640 1 --2- 172.21.15.42:0/1220177835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557538d1b620 0x557538d37ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.845+0000 7fcffbe00640 1 -- 172.21.15.42:0/1220177835 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557538d292b0 con 0x557538d1bf40 2024-08-26T00:01:56.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.845+0000 7fcffbe00640 1 --2- 172.21.15.42:0/1220177835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d1bf40 0x557538d22630 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcfec009bd0 tx=0x7fcfec005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db49828a014bce server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:56.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.845+0000 7fcff2a00640 1 -- 172.21.15.42:0/1220177835 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfec01e040 con 0x557538d1bf40 2024-08-26T00:01:56.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.846+0000 7fcff2a00640 1 -- 172.21.15.42:0/1220177835 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfec011d10 con 0x557538d1bf40 2024-08-26T00:01:56.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.846+0000 7fcff2a00640 1 -- 172.21.15.42:0/1220177835 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfec025690 con 0x557538d1bf40 2024-08-26T00:01:56.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.846+0000 7fd00c1df740 1 -- 172.21.15.42:0/1220177835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d1bf40 msgr2=0x557538d22630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:56.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.846+0000 7fd00c1df740 1 --2- 172.21.15.42:0/1220177835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d1bf40 0x557538d22630 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcfec009bd0 tx=0x7fcfec005d30 comp rx=0 tx=0).stop 2024-08-26T00:01:56.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.846+0000 7fd00c1df740 1 -- 172.21.15.42:0/1220177835 shutdown_connections 2024-08-26T00:01:56.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.846+0000 7fd00c1df740 1 --2- 172.21.15.42:0/1220177835 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557538d26800 0x557538d23f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.846+0000 7fd00c1df740 1 --2- 172.21.15.42:0/1220177835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d1bf40 0x557538d22630 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.846+0000 7fd00c1df740 1 --2- 172.21.15.42:0/1220177835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557538d1b620 0x557538d37ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.846+0000 7fd00c1df740 1 -- 172.21.15.42:0/1220177835 >> 172.21.15.42:0/1220177835 conn(0x557538d17bb0 msgr2=0x557538d21f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:56.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.846+0000 7fd00c1df740 1 -- 172.21.15.42:0/1220177835 shutdown_connections 2024-08-26T00:01:56.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.846+0000 7fd00c1df740 1 -- 172.21.15.42:0/1220177835 wait complete. 2024-08-26T00:01:56.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.847+0000 7fd00c1df740 1 -- start start 2024-08-26T00:01:56.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.847+0000 7fd00c1df740 1 Processor -- start 2024-08-26T00:01:56.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.847+0000 7fd00c1df740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557538d1b620 0x557538d3a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:56.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.847+0000 7fd00c1df740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557538d1bf40 0x557538d3a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:56.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.847+0000 7fd00c1df740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d26800 0x557538d9ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:56.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.848+0000 7fd00c1df740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557538d38b10 con 0x557538d26800 2024-08-26T00:01:56.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.848+0000 7fd00c1df740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557538d38440 con 0x557538d1bf40 2024-08-26T00:01:56.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.848+0000 7fd00c1df740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557538d391e0 con 0x557538d1b620 2024-08-26T00:01:56.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.848+0000 7fd00c1df740 10 client.0 _ll_register_callbacks cb 0x7fcff4031e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:01:56.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.848+0000 7fcffbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557538d1bf40 0x557538d3a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:56.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.848+0000 7fd003400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d26800 0x557538d9ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:56.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.848+0000 7fcffbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557538d1bf40 0x557538d3a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:41540/0 (socket says 172.21.15.42:41540) 2024-08-26T00:01:56.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.848+0000 7fcffbe00640 1 -- 172.21.15.42:0/3520160459 learned_addr learned my addr 172.21.15.42:0/3520160459 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:56.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.848+0000 7fd002a00640 1 --2- 172.21.15.42:0/3520160459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557538d1b620 0x557538d3a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:56.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.848+0000 7fd003400640 1 -- 172.21.15.42:0/3520160459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557538d1b620 msgr2=0x557538d3a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:56.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.848+0000 7fd003400640 1 --2- 172.21.15.42:0/3520160459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557538d1b620 0x557538d3a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.848+0000 7fd003400640 1 -- 172.21.15.42:0/3520160459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557538d1bf40 msgr2=0x557538d3a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:01:56.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.848+0000 7fd003400640 1 --2- 172.21.15.42:0/3520160459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557538d1bf40 0x557538d3a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.848+0000 7fd003400640 1 -- 172.21.15.42:0/3520160459 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557538da0490 con 0x557538d26800 2024-08-26T00:01:56.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.848+0000 7fcffbe00640 1 --2- 172.21.15.42:0/3520160459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557538d1bf40 0x557538d3a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:01:56.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.849+0000 7fd003400640 1 --2- 172.21.15.42:0/3520160459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d26800 0x557538d9ff20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00f3c0 tx=0x7fcffc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dadf17b96da4391e server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:56.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.849+0000 7fcfe7e00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:01:56.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.849+0000 7fcfe7e00640 1 -- 172.21.15.42:0/3520160459 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcffc010b40 con 0x557538d26800 2024-08-26T00:01:56.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.849+0000 7fd00c1df740 1 -- 172.21.15.42:0/3520160459 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfec011d10 con 0x557538d26800 2024-08-26T00:01:56.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.849+0000 7fcfe7e00640 1 -- 172.21.15.42:0/3520160459 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fcffc010ce0 con 0x557538d26800 2024-08-26T00:01:56.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.849+0000 7fcfe7e00640 1 -- 172.21.15.42:0/3520160459 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fcffc004b20 con 0x557538d26800 2024-08-26T00:01:56.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.849+0000 7fd00c1df740 10 client.14913 fetch_fsmap learned FSMap version 23 2024-08-26T00:01:56.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.849+0000 7fd00c1df740 1 -- 172.21.15.42:0/3520160459 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x557538da17c0 con 0x557538d26800 2024-08-26T00:01:56.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.849+0000 7fcfe7e00640 1 -- 172.21.15.42:0/3520160459 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfec011d10 con 0x557538d26800 2024-08-26T00:01:56.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.850+0000 7fcfe7e00640 1 -- 172.21.15.42:0/3520160459 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fcffc028070 con 0x557538d26800 2024-08-26T00:01:56.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.850+0000 7fd00c1df740 10 client.14913 fetch_fsmap finished waiting for FSMap version 23 2024-08-26T00:01:56.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.850+0000 7fd00c1df740 10 client.14913 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-26T00:01:56.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.850+0000 7fd00c1df740 20 client.14913 populate_metadata read hostname 'smithi042' 2024-08-26T00:01:56.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.850+0000 7fd00c1df740 1 --2- 172.21.15.42:0/3520160459 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x557538da6430 0x557538da5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:56.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.850+0000 7fd00c1df740 4 client.14913 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-26T00:01:56.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.850+0000 7fd00c1df740 1 -- 172.21.15.42:0/3520160459 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "status"}) -- 0x557538c05f80 con 0x557538da6430 2024-08-26T00:01:56.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.850+0000 7fd002a00640 1 --2- 172.21.15.42:0/3520160459 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x557538da6430 0x557538da5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:56.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.851+0000 7fd002a00640 1 --2- 172.21.15.42:0/3520160459 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x557538da6430 0x557538da5140 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=673678a0357a705d server_cookie=760c15cb4ea730a8 in_seq=0 out_seq=0 2024-08-26T00:01:56.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.851+0000 7fcfe7e00640 10 client.14913 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:01:56.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.851+0000 7fcfe7e00640 1 -- 172.21.15.42:0/3520160459 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x557538c05f80 con 0x557538da6430 2024-08-26T00:01:56.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.851+0000 7fcfe7e00640 10 client.14913 handle_command_reply: tid=0 2024-08-26T00:01:56.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.851+0000 7fd00c1df740 1 client.14913 shutdown 2024-08-26T00:01:56.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.851+0000 7fd00c1df740 1 -- 172.21.15.42:0/3520160459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d26800 msgr2=0x557538d9ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:56.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.851+0000 7fd00c1df740 1 --2- 172.21.15.42:0/3520160459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d26800 0x557538d9ff20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00f3c0 tx=0x7fcffc004ab0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.851+0000 7fd00c1df740 1 -- 172.21.15.42:0/3520160459 shutdown_connections 2024-08-26T00:01:56.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.851+0000 7fd00c1df740 1 --2- 172.21.15.42:0/3520160459 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x557538da6430 0x557538da5140 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.851+0000 7fd00c1df740 1 --2- 172.21.15.42:0/3520160459 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557538d26800 0x557538d9ff20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.851+0000 7fd00c1df740 1 --2- 172.21.15.42:0/3520160459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557538d1bf40 0x557538d3a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.851+0000 7fd00c1df740 1 --2- 172.21.15.42:0/3520160459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557538d1b620 0x557538d3a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.851+0000 7fd00c1df740 1 -- 172.21.15.42:0/3520160459 >> 172.21.15.42:0/3520160459 conn(0x557538d17bb0 msgr2=0x557538d31fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:56.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.851+0000 7fcfe7e00640 0 client.14913 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:01:56.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.851+0000 7fd00c1df740 1 -- 172.21.15.42:0/3520160459 shutdown_connections 2024-08-26T00:01:56.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.852+0000 7fd00c1df740 1 -- 172.21.15.42:0/3520160459 wait complete. 2024-08-26T00:01:56.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.852+0000 7fd00c1df740 20 client.14913 trim_cache size 0 max 16384 2024-08-26T00:01:56.856 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:01:56.856 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "f89d317a-633c-11ef-bcd2-c7b262605968", 2024-08-26T00:01:56.856 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-08-26T00:01:56.856 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24532, 2024-08-26T00:01:56.856 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-08-26T00:01:56.856 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-08-26T00:01:56.856 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-08-26T00:01:56.856 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 86.511377324999998, 2024-08-26T00:01:56.856 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 23, 2024-08-26T00:01:56.856 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 80, 2024-08-26T00:01:56.857 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 78, 2024-08-26T00:01:56.857 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 108.002783773 2024-08-26T00:01:56.857 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:01:56.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.852+0000 7fd009600640 1 -- 172.21.15.42:0/3552768987 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcfe80a2c10 msgr2=0x7fcfe80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:56.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.852+0000 7fd009600640 1 --2- 172.21.15.42:0/3552768987 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcfe80a2c10 0x7fcfe80a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcffc009fd0 tx=0x7fcffc009500 comp rx=0 tx=0).stop 2024-08-26T00:01:56.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.852+0000 7fd009600640 1 -- 172.21.15.42:0/3552768987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0040764c0 msgr2=0x7fd0041a45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:56.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.852+0000 7fd009600640 1 --2- 172.21.15.42:0/3552768987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0040764c0 0x7fd0041a45e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcff4004770 tx=0x7fcff4003c10 comp rx=0 tx=0).stop 2024-08-26T00:01:56.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.852+0000 7fd009600640 1 -- 172.21.15.42:0/3552768987 shutdown_connections 2024-08-26T00:01:56.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.852+0000 7fd009600640 1 --2- 172.21.15.42:0/3552768987 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcfe80a2c10 0x7fcfe80a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.852+0000 7fd009600640 1 --2- 172.21.15.42:0/3552768987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0041127f0 0x7fd00419e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.852+0000 7fd009600640 1 --2- 172.21.15.42:0/3552768987 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd004076de0 0x7fd0041a4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.852+0000 7fd009600640 1 --2- 172.21.15.42:0/3552768987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0040764c0 0x7fd0041a45e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:56.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.852+0000 7fd009600640 1 -- 172.21.15.42:0/3552768987 >> 172.21.15.42:0/3552768987 conn(0x7fd0040ff7f0 msgr2=0x7fd004101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:56.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.853+0000 7fd009600640 1 -- 172.21.15.42:0/3552768987 shutdown_connections 2024-08-26T00:01:56.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:56.853+0000 7fd009600640 1 -- 172.21.15.42:0/3552768987 wait complete. 2024-08-26T00:01:57.520 INFO:tasks.cephadm:Setup complete, yielding 2024-08-26T00:01:57.521 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-26T00:01:57.569 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi042.front.sepia.ceph.com 2024-08-26T00:01:57.569 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- bash -c 'ceph orch status' 2024-08-26T00:01:57.947 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:01:58.336 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:01:58 smithi042 ceph-mon[17225]: pgmap v322: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:01:58.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.451+0000 7fb872000640 1 -- 172.21.15.42:0/2922731814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb86c104da0 msgr2=0x7fb86c105220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:58.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.451+0000 7fb872000640 1 --2- 172.21.15.42:0/2922731814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb86c104da0 0x7fb86c105220 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb858009900 tx=0x7fb85802a410 comp rx=0 tx=0).stop 2024-08-26T00:01:58.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.451+0000 7fb872000640 1 -- 172.21.15.42:0/2922731814 shutdown_connections 2024-08-26T00:01:58.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.451+0000 7fb872000640 1 --2- 172.21.15.42:0/2922731814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb86c105760 0x7fb86c10bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:58.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.451+0000 7fb872000640 1 --2- 172.21.15.42:0/2922731814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb86c104da0 0x7fb86c105220 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:58.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.452+0000 7fb872000640 1 --2- 172.21.15.42:0/2922731814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb86c103ba0 0x7fb86c103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:58.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.452+0000 7fb872000640 1 -- 172.21.15.42:0/2922731814 >> 172.21.15.42:0/2922731814 conn(0x7fb86c0ff350 msgr2=0x7fb86c101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:58.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.452+0000 7fb872000640 1 -- 172.21.15.42:0/2922731814 shutdown_connections 2024-08-26T00:01:58.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.452+0000 7fb872000640 1 -- 172.21.15.42:0/2922731814 wait complete. 2024-08-26T00:01:58.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.453+0000 7fb872000640 1 Processor -- start 2024-08-26T00:01:58.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.453+0000 7fb872000640 1 -- start start 2024-08-26T00:01:58.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.453+0000 7fb872000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb86c103ba0 0x7fb86c199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:58.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.453+0000 7fb872000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb86c104da0 0x7fb86c19a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:58.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.453+0000 7fb872000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb86c105760 0x7fb86c1a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:58.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.453+0000 7fb872000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c10f850 con 0x7fb86c104da0 2024-08-26T00:01:58.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.453+0000 7fb872000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c10f6d0 con 0x7fb86c105760 2024-08-26T00:01:58.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.453+0000 7fb872000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c10f9d0 con 0x7fb86c103ba0 2024-08-26T00:01:58.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.453+0000 7fb86aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb86c104da0 0x7fb86c19a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:58.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.453+0000 7fb86b400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb86c103ba0 0x7fb86c199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:58.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.453+0000 7fb86aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb86c104da0 0x7fb86c19a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45784/0 (socket says 172.21.15.42:45784) 2024-08-26T00:01:58.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.453+0000 7fb86aa00640 1 -- 172.21.15.42:0/3592877796 learned_addr learned my addr 172.21.15.42:0/3592877796 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:01:58.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.453+0000 7fb86be00640 1 --2- 172.21.15.42:0/3592877796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb86c105760 0x7fb86c1a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:58.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.454+0000 7fb86aa00640 1 -- 172.21.15.42:0/3592877796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb86c103ba0 msgr2=0x7fb86c199e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:58.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.454+0000 7fb86aa00640 1 --2- 172.21.15.42:0/3592877796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb86c103ba0 0x7fb86c199e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:58.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.454+0000 7fb86aa00640 1 -- 172.21.15.42:0/3592877796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb86c105760 msgr2=0x7fb86c1a1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:58.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.454+0000 7fb86aa00640 1 --2- 172.21.15.42:0/3592877796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb86c105760 0x7fb86c1a1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:58.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.454+0000 7fb86aa00640 1 -- 172.21.15.42:0/3592877796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb86c1a1ab0 con 0x7fb86c104da0 2024-08-26T00:01:58.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.454+0000 7fb86be00640 1 --2- 172.21.15.42:0/3592877796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb86c105760 0x7fb86c1a1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:01:58.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.454+0000 7fb86aa00640 1 --2- 172.21.15.42:0/3592877796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb86c104da0 0x7fb86c19a3c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb858031440 tx=0x7fb858032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:58.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.454+0000 7fb863e00640 1 -- 172.21.15.42:0/3592877796 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85803f030 con 0x7fb86c104da0 2024-08-26T00:01:58.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.454+0000 7fb863e00640 1 -- 172.21.15.42:0/3592877796 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb858003ce0 con 0x7fb86c104da0 2024-08-26T00:01:58.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.454+0000 7fb872000640 1 -- 172.21.15.42:0/3592877796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb86c1a1d40 con 0x7fb86c104da0 2024-08-26T00:01:58.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.454+0000 7fb863e00640 1 -- 172.21.15.42:0/3592877796 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb858035070 con 0x7fb86c104da0 2024-08-26T00:01:58.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.455+0000 7fb872000640 1 -- 172.21.15.42:0/3592877796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb86c1a2210 con 0x7fb86c104da0 2024-08-26T00:01:58.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.456+0000 7fb872000640 1 -- 172.21.15.42:0/3592877796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb86c10afa0 con 0x7fb86c104da0 2024-08-26T00:01:58.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.458+0000 7fb863e00640 1 -- 172.21.15.42:0/3592877796 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb858042030 con 0x7fb86c104da0 2024-08-26T00:01:58.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.460+0000 7fb863e00640 1 --2- 172.21.15.42:0/3592877796 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb8500a2cc0 0x7fb8500a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:01:58.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.460+0000 7fb863e00640 1 -- 172.21.15.42:0/3592877796 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb8580ef710 con 0x7fb86c104da0 2024-08-26T00:01:58.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.460+0000 7fb86b400640 1 --2- 172.21.15.42:0/3592877796 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb8500a2cc0 0x7fb8500a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:01:58.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.461+0000 7fb86b400640 1 --2- 172.21.15.42:0/3592877796 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb8500a2cc0 0x7fb8500a5180 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb86c104c00 tx=0x7fb85c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:01:58.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.464+0000 7fb863e00640 1 -- 172.21.15.42:0/3592877796 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb8580bc4d0 con 0x7fb86c104da0 2024-08-26T00:01:58.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:01:58 smithi043 ceph-mon[22091]: pgmap v322: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:01:58.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:01:58 smithi181 ceph-mon[22102]: pgmap v322: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:01:58.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.666+0000 7fb872000640 1 -- 172.21.15.42:0/3592877796 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fb86c0623d0 con 0x7fb8500a2cc0 2024-08-26T00:01:58.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.668+0000 7fb863e00640 1 -- 172.21.15.42:0/3592877796 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fb86c0623d0 con 0x7fb8500a2cc0 2024-08-26T00:01:58.668 INFO:teuthology.orchestra.run.smithi042.stdout:Backend: cephadm 2024-08-26T00:01:58.668 INFO:teuthology.orchestra.run.smithi042.stdout:Available: Yes 2024-08-26T00:01:58.668 INFO:teuthology.orchestra.run.smithi042.stdout:Paused: No 2024-08-26T00:01:58.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.670+0000 7fb872000640 1 -- 172.21.15.42:0/3592877796 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb8500a2cc0 msgr2=0x7fb8500a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:58.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.670+0000 7fb872000640 1 --2- 172.21.15.42:0/3592877796 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb8500a2cc0 0x7fb8500a5180 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb86c104c00 tx=0x7fb85c005f90 comp rx=0 tx=0).stop 2024-08-26T00:01:58.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.670+0000 7fb872000640 1 -- 172.21.15.42:0/3592877796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb86c104da0 msgr2=0x7fb86c19a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:01:58.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.670+0000 7fb872000640 1 --2- 172.21.15.42:0/3592877796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb86c104da0 0x7fb86c19a3c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb858031440 tx=0x7fb858032ce0 comp rx=0 tx=0).stop 2024-08-26T00:01:58.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.671+0000 7fb872000640 1 -- 172.21.15.42:0/3592877796 shutdown_connections 2024-08-26T00:01:58.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.671+0000 7fb872000640 1 --2- 172.21.15.42:0/3592877796 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb8500a2cc0 0x7fb8500a5180 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:58.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.671+0000 7fb872000640 1 --2- 172.21.15.42:0/3592877796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb86c105760 0x7fb86c1a1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:58.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.671+0000 7fb872000640 1 --2- 172.21.15.42:0/3592877796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb86c104da0 0x7fb86c19a3c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:58.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.671+0000 7fb872000640 1 --2- 172.21.15.42:0/3592877796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb86c103ba0 0x7fb86c199e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:01:58.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.671+0000 7fb872000640 1 -- 172.21.15.42:0/3592877796 >> 172.21.15.42:0/3592877796 conn(0x7fb86c0ff350 msgr2=0x7fb86c108170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:01:58.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.671+0000 7fb872000640 1 -- 172.21.15.42:0/3592877796 shutdown_connections 2024-08-26T00:01:58.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:01:58.671+0000 7fb872000640 1 -- 172.21.15.42:0/3592877796 wait complete. 2024-08-26T00:01:59.355 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- bash -c 'ceph orch ps' 2024-08-26T00:01:59.729 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:02:00.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.250+0000 7f3684800640 1 -- 172.21.15.42:0/522650817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f367c109840 msgr2=0x7f367c10bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:00.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.250+0000 7f3684800640 1 --2- 172.21.15.42:0/522650817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f367c109840 0x7f367c10bce0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3678009ca0 tx=0x7f367802a950 comp rx=0 tx=0).stop 2024-08-26T00:02:00.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.250+0000 7f3684800640 1 -- 172.21.15.42:0/522650817 shutdown_connections 2024-08-26T00:02:00.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.250+0000 7f3684800640 1 --2- 172.21.15.42:0/522650817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f367c109840 0x7f367c10bce0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:00.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.250+0000 7f3684800640 1 --2- 172.21.15.42:0/522650817 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f367c074990 0x7f367c074df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:00.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.250+0000 7f3684800640 1 --2- 172.21.15.42:0/522650817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f367c075f60 0x7f367c0743c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:00.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.250+0000 7f3684800640 1 -- 172.21.15.42:0/522650817 >> 172.21.15.42:0/522650817 conn(0x7f367c0fd130 msgr2=0x7f367c0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:00.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.251+0000 7f3684800640 1 -- 172.21.15.42:0/522650817 shutdown_connections 2024-08-26T00:02:00.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.251+0000 7f3684800640 1 -- 172.21.15.42:0/522650817 wait complete. 2024-08-26T00:02:00.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.252+0000 7f3684800640 1 Processor -- start 2024-08-26T00:02:00.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.252+0000 7f3684800640 1 -- start start 2024-08-26T00:02:00.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.252+0000 7f3684800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f367c074990 0x7f367c199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:00.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.252+0000 7f3684800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f367c075f60 0x7f367c19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:00.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.252+0000 7f3684800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f367c109840 0x7f367c1a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:00.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.252+0000 7f3684800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f367c10f870 con 0x7f367c075f60 2024-08-26T00:02:00.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.252+0000 7f3684800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f367c10f6f0 con 0x7f367c074990 2024-08-26T00:02:00.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.252+0000 7f3684800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f367c10f9f0 con 0x7f367c109840 2024-08-26T00:02:00.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.253+0000 7f3681e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f367c074990 0x7f367c199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:00.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.253+0000 7f3681e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f367c074990 0x7f367c199df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:41580/0 (socket says 172.21.15.42:41580) 2024-08-26T00:02:00.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.253+0000 7f3681e00640 1 -- 172.21.15.42:0/2998548266 learned_addr learned my addr 172.21.15.42:0/2998548266 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:00.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.253+0000 7f3681400640 1 --2- 172.21.15.42:0/2998548266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f367c075f60 0x7f367c19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:00.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.253+0000 7f3682800640 1 --2- 172.21.15.42:0/2998548266 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f367c109840 0x7f367c1a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:00.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.253+0000 7f3681e00640 1 -- 172.21.15.42:0/2998548266 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f367c109840 msgr2=0x7f367c1a13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:00.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.253+0000 7f3681e00640 1 --2- 172.21.15.42:0/2998548266 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f367c109840 0x7f367c1a13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:00.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.253+0000 7f3681e00640 1 -- 172.21.15.42:0/2998548266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f367c075f60 msgr2=0x7f367c19a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:00.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.253+0000 7f3681e00640 1 --2- 172.21.15.42:0/2998548266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f367c075f60 0x7f367c19a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:00.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.253+0000 7f3681e00640 1 -- 172.21.15.42:0/2998548266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367c1a1a20 con 0x7f367c074990 2024-08-26T00:02:00.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.253+0000 7f3681400640 1 --2- 172.21.15.42:0/2998548266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f367c075f60 0x7f367c19a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:00.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.253+0000 7f3681e00640 1 --2- 172.21.15.42:0/2998548266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f367c074990 0x7f367c199df0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f367000d950 tx=0x7f367000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:00.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.254+0000 7f3676a00640 1 -- 172.21.15.42:0/2998548266 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3670017030 con 0x7f367c074990 2024-08-26T00:02:00.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.254+0000 7f3676a00640 1 -- 172.21.15.42:0/2998548266 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3670004020 con 0x7f367c074990 2024-08-26T00:02:00.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.254+0000 7f3684800640 1 -- 172.21.15.42:0/2998548266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f367c1a1d10 con 0x7f367c074990 2024-08-26T00:02:00.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.254+0000 7f3676a00640 1 -- 172.21.15.42:0/2998548266 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36700047a0 con 0x7f367c074990 2024-08-26T00:02:00.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.254+0000 7f3684800640 1 -- 172.21.15.42:0/2998548266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f367c1a21a0 con 0x7f367c074990 2024-08-26T00:02:00.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.255+0000 7f3684800640 1 -- 172.21.15.42:0/2998548266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f367c108600 con 0x7f367c074990 2024-08-26T00:02:00.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.257+0000 7f3676a00640 1 -- 172.21.15.42:0/2998548266 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f36700041d0 con 0x7f367c074990 2024-08-26T00:02:00.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.258+0000 7f3676a00640 1 --2- 172.21.15.42:0/2998548266 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f36640a2c40 0x7f36640a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:00.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.258+0000 7f3676a00640 1 -- 172.21.15.42:0/2998548266 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f36700ceb00 con 0x7f367c074990 2024-08-26T00:02:00.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.258+0000 7f3681400640 1 --2- 172.21.15.42:0/2998548266 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f36640a2c40 0x7f36640a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:00.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.259+0000 7f3681400640 1 --2- 172.21.15.42:0/2998548266 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f36640a2c40 0x7f36640a5100 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f367c19b310 tx=0x7f366c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:00.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.262+0000 7f3676a00640 1 -- 172.21.15.42:0/2998548266 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f367009b8c0 con 0x7f367c074990 2024-08-26T00:02:00.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.459+0000 7f3684800640 1 -- 172.21.15.42:0/2998548266 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f367c0623d0 con 0x7f36640a2c40 2024-08-26T00:02:00.460 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:00 smithi042 ceph-mon[17225]: pgmap v323: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:02:00.460 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:00 smithi042 ceph-mon[17225]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:02:00.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.473+0000 7f3676a00640 1 -- 172.21.15.42:0/2998548266 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f367c0623d0 con 0x7f36640a2c40 2024-08-26T00:02:00.473 INFO:teuthology.orchestra.run.smithi042.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-26T00:02:00.474 INFO:teuthology.orchestra.run.smithi042.stdout:mds.a smithi042 running (105s) 20s ago 104s 12.7M - 19.1.1-207-gf273685f c7be02d964cf 5b670d163482 2024-08-26T00:02:00.474 INFO:teuthology.orchestra.run.smithi042.stdout:mds.b smithi043 running (102s) 33s ago 102s 16.8M - 19.1.1-207-gf273685f c7be02d964cf 186e65419a0f 2024-08-26T00:02:00.474 INFO:teuthology.orchestra.run.smithi042.stdout:mds.c smithi181 running (117s) 33s ago 116s 18.0M - 19.1.1-207-gf273685f c7be02d964cf 6a38a30aa961 2024-08-26T00:02:00.474 INFO:teuthology.orchestra.run.smithi042.stdout:mds.d smithi042 running (2m) 20s ago 2m 12.7M - 19.1.1-207-gf273685f c7be02d964cf 038bfaedb114 2024-08-26T00:02:00.474 INFO:teuthology.orchestra.run.smithi042.stdout:mds.e smithi043 running (2m) 33s ago 2m 18.3M - 19.1.1-207-gf273685f c7be02d964cf 4f6ceec12568 2024-08-26T00:02:00.474 INFO:teuthology.orchestra.run.smithi042.stdout:mds.f smithi181 running (119s) 33s ago 119s 20.0M - 19.1.1-207-gf273685f c7be02d964cf f77e962be4bf 2024-08-26T00:02:00.474 INFO:teuthology.orchestra.run.smithi042.stdout:mds.g smithi042 running (108s) 20s ago 108s 12.7M - 19.1.1-207-gf273685f c7be02d964cf f79a3cac1c03 2024-08-26T00:02:00.474 INFO:teuthology.orchestra.run.smithi042.stdout:mds.h smithi043 running (114s) 33s ago 113s 19.0M - 19.1.1-207-gf273685f c7be02d964cf 56cb0f11a01e 2024-08-26T00:02:00.474 INFO:teuthology.orchestra.run.smithi042.stdout:mds.i smithi181 running (111s) 33s ago 111s 25.7M - 19.1.1-207-gf273685f c7be02d964cf 3f20ac14b5ad 2024-08-26T00:02:00.474 INFO:teuthology.orchestra.run.smithi042.stdout:mds.j smithi042 running (2m) 20s ago 2m 12.8M - 19.1.1-207-gf273685f c7be02d964cf 1ec190fe0970 2024-08-26T00:02:00.474 INFO:teuthology.orchestra.run.smithi042.stdout:mds.k smithi043 running (2m) 33s ago 2m 13.6M - 19.1.1-207-gf273685f c7be02d964cf 1803b8d455ff 2024-08-26T00:02:00.475 INFO:teuthology.orchestra.run.smithi042.stdout:mds.l smithi181 running (2m) 33s ago 2m 13.4M - 19.1.1-207-gf273685f c7be02d964cf 6e69c707ad48 2024-08-26T00:02:00.475 INFO:teuthology.orchestra.run.smithi042.stdout:mgr.x smithi042 *:9283,8765 running (9m) 20s ago 9m 508M - 19.1.1-207-gf273685f c7be02d964cf 375b4bd2b8cb 2024-08-26T00:02:00.475 INFO:teuthology.orchestra.run.smithi042.stdout:mgr.y smithi043 *:8443,8765 running (7m) 33s ago 7m 443M - 19.1.1-207-gf273685f c7be02d964cf 676365bc2567 2024-08-26T00:02:00.475 INFO:teuthology.orchestra.run.smithi042.stdout:mgr.z smithi181 *:8443,8765 running (7m) 33s ago 7m 440M - 19.1.1-207-gf273685f c7be02d964cf 89be3d7353b3 2024-08-26T00:02:00.475 INFO:teuthology.orchestra.run.smithi042.stdout:mon.a smithi042 running (9m) 20s ago 9m 46.9M 2048M 19.1.1-207-gf273685f c7be02d964cf 368b9008b40e 2024-08-26T00:02:00.475 INFO:teuthology.orchestra.run.smithi042.stdout:mon.b smithi043 running (7m) 33s ago 7m 43.1M 2048M 19.1.1-207-gf273685f c7be02d964cf 61c98c271844 2024-08-26T00:02:00.475 INFO:teuthology.orchestra.run.smithi042.stdout:mon.c smithi181 running (7m) 33s ago 7m 40.5M 2048M 19.1.1-207-gf273685f c7be02d964cf d7280061e313 2024-08-26T00:02:00.475 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0 smithi042 running (7m) 20s ago 7m 46.3M 4273M 19.1.1-207-gf273685f c7be02d964cf 557db4a97cda 2024-08-26T00:02:00.475 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 smithi043 running (6m) 33s ago 6m 58.3M 4273M 19.1.1-207-gf273685f c7be02d964cf 6eee71876f35 2024-08-26T00:02:00.475 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 smithi181 running (6m) 33s ago 6m 57.3M 4272M 19.1.1-207-gf273685f c7be02d964cf 86cc15547eaa 2024-08-26T00:02:00.475 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3 smithi042 running (5m) 20s ago 5m 47.2M 4273M 19.1.1-207-gf273685f c7be02d964cf e11f56fba6a6 2024-08-26T00:02:00.475 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4 smithi043 running (5m) 33s ago 5m 44.4M 4273M 19.1.1-207-gf273685f c7be02d964cf 85064d8bca56 2024-08-26T00:02:00.475 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5 smithi181 running (5m) 33s ago 5m 46.2M 4272M 19.1.1-207-gf273685f c7be02d964cf 99fdcc55ec68 2024-08-26T00:02:00.476 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6 smithi042 running (4m) 20s ago 4m 49.9M 4273M 19.1.1-207-gf273685f c7be02d964cf 60e423688e0d 2024-08-26T00:02:00.476 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7 smithi043 running (4m) 33s ago 4m 53.2M 4273M 19.1.1-207-gf273685f c7be02d964cf 1f77215a9904 2024-08-26T00:02:00.476 INFO:teuthology.orchestra.run.smithi042.stdout:osd.8 smithi181 running (3m) 33s ago 3m 52.0M 4272M 19.1.1-207-gf273685f c7be02d964cf e2d5db855e00 2024-08-26T00:02:00.476 INFO:teuthology.orchestra.run.smithi042.stdout:osd.9 smithi042 running (3m) 20s ago 3m 42.5M 4273M 19.1.1-207-gf273685f c7be02d964cf 23b463d4c123 2024-08-26T00:02:00.476 INFO:teuthology.orchestra.run.smithi042.stdout:osd.10 smithi043 running (2m) 33s ago 2m 51.8M 4273M 19.1.1-207-gf273685f c7be02d964cf d242790adf92 2024-08-26T00:02:00.476 INFO:teuthology.orchestra.run.smithi042.stdout:osd.11 smithi181 running (2m) 33s ago 2m 50.2M 4272M 19.1.1-207-gf273685f c7be02d964cf cd02f09ef156 2024-08-26T00:02:00.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.476+0000 7f3684800640 1 -- 172.21.15.42:0/2998548266 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f36640a2c40 msgr2=0x7f36640a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:00.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.476+0000 7f3684800640 1 --2- 172.21.15.42:0/2998548266 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f36640a2c40 0x7f36640a5100 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f367c19b310 tx=0x7f366c005f90 comp rx=0 tx=0).stop 2024-08-26T00:02:00.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.476+0000 7f3684800640 1 -- 172.21.15.42:0/2998548266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f367c074990 msgr2=0x7f367c199df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:00.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.476+0000 7f3684800640 1 --2- 172.21.15.42:0/2998548266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f367c074990 0x7f367c199df0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f367000d950 tx=0x7f367000de10 comp rx=0 tx=0).stop 2024-08-26T00:02:00.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.476+0000 7f3684800640 1 -- 172.21.15.42:0/2998548266 shutdown_connections 2024-08-26T00:02:00.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.476+0000 7f3684800640 1 --2- 172.21.15.42:0/2998548266 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f36640a2c40 0x7f36640a5100 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:00.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.476+0000 7f3684800640 1 --2- 172.21.15.42:0/2998548266 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f367c109840 0x7f367c1a13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:00.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.476+0000 7f3684800640 1 --2- 172.21.15.42:0/2998548266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f367c075f60 0x7f367c19a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:00.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.476+0000 7f3684800640 1 --2- 172.21.15.42:0/2998548266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f367c074990 0x7f367c199df0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:00.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.476+0000 7f3684800640 1 -- 172.21.15.42:0/2998548266 >> 172.21.15.42:0/2998548266 conn(0x7f367c0fd130 msgr2=0x7f367c1057d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:00.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.476+0000 7f3684800640 1 -- 172.21.15.42:0/2998548266 shutdown_connections 2024-08-26T00:02:00.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:00.476+0000 7f3684800640 1 -- 172.21.15.42:0/2998548266 wait complete. 2024-08-26T00:02:00.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:00 smithi043 ceph-mon[22091]: pgmap v323: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:02:00.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:00 smithi043 ceph-mon[22091]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:02:00.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:00 smithi181 ceph-mon[22102]: pgmap v323: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:02:00.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:00 smithi181 ceph-mon[22102]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:02:01.296 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- bash -c 'ceph orch ls' 2024-08-26T00:02:01.673 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:02:02.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.208+0000 7fae5fa00640 1 -- 172.21.15.42:0/3794870665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae58104da0 msgr2=0x7fae58105220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:02.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.208+0000 7fae5fa00640 1 --2- 172.21.15.42:0/3794870665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae58104da0 0x7fae58105220 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fae44009900 tx=0x7fae4402a410 comp rx=0 tx=0).stop 2024-08-26T00:02:02.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.208+0000 7fae5fa00640 1 -- 172.21.15.42:0/3794870665 shutdown_connections 2024-08-26T00:02:02.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.208+0000 7fae5fa00640 1 --2- 172.21.15.42:0/3794870665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae58105760 0x7fae5810bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:02.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.208+0000 7fae5fa00640 1 --2- 172.21.15.42:0/3794870665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae58104da0 0x7fae58105220 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:02.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.208+0000 7fae5fa00640 1 --2- 172.21.15.42:0/3794870665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae58103ba0 0x7fae58103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:02.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.208+0000 7fae5fa00640 1 -- 172.21.15.42:0/3794870665 >> 172.21.15.42:0/3794870665 conn(0x7fae580ff350 msgr2=0x7fae58101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:02.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.208+0000 7fae5fa00640 1 -- 172.21.15.42:0/3794870665 shutdown_connections 2024-08-26T00:02:02.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.208+0000 7fae5fa00640 1 -- 172.21.15.42:0/3794870665 wait complete. 2024-08-26T00:02:02.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.209+0000 7fae5fa00640 1 Processor -- start 2024-08-26T00:02:02.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.209+0000 7fae5fa00640 1 -- start start 2024-08-26T00:02:02.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.210+0000 7fae5fa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae58103ba0 0x7fae58199e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:02.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.210+0000 7fae5fa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae58104da0 0x7fae5819a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:02.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.210+0000 7fae5fa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae58105760 0x7fae581a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:02.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.210+0000 7fae5fa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fae5810f800 con 0x7fae58104da0 2024-08-26T00:02:02.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.210+0000 7fae5fa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fae5810f680 con 0x7fae58105760 2024-08-26T00:02:02.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.210+0000 7fae5fa00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fae5810f980 con 0x7fae58103ba0 2024-08-26T00:02:02.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.210+0000 7fae57e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae58104da0 0x7fae5819a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:02.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.210+0000 7fae5d000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae58103ba0 0x7fae58199e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:02.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.210+0000 7fae57e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae58104da0 0x7fae5819a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45812/0 (socket says 172.21.15.42:45812) 2024-08-26T00:02:02.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.210+0000 7fae57e00640 1 -- 172.21.15.42:0/1011384116 learned_addr learned my addr 172.21.15.42:0/1011384116 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:02.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.210+0000 7fae5da00640 1 --2- 172.21.15.42:0/1011384116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae58105760 0x7fae581a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:02.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.211+0000 7fae5d000640 1 -- 172.21.15.42:0/1011384116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae58105760 msgr2=0x7fae581a1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:02.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.211+0000 7fae5d000640 1 --2- 172.21.15.42:0/1011384116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae58105760 0x7fae581a1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:02.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.211+0000 7fae5d000640 1 -- 172.21.15.42:0/1011384116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae58104da0 msgr2=0x7fae5819a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:02.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.211+0000 7fae5d000640 1 --2- 172.21.15.42:0/1011384116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae58104da0 0x7fae5819a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:02.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.211+0000 7fae5d000640 1 -- 172.21.15.42:0/1011384116 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae581a1aa0 con 0x7fae58103ba0 2024-08-26T00:02:02.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.211+0000 7fae57e00640 1 --2- 172.21.15.42:0/1011384116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae58104da0 0x7fae5819a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:02.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.211+0000 7fae5d000640 1 --2- 172.21.15.42:0/1011384116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae58103ba0 0x7fae58199e70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fae58104c00 tx=0x7fae4c00dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:02.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.211+0000 7fae55600640 1 -- 172.21.15.42:0/1011384116 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c017070 con 0x7fae58103ba0 2024-08-26T00:02:02.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.211+0000 7fae5fa00640 1 -- 172.21.15.42:0/1011384116 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae581a1d90 con 0x7fae58103ba0 2024-08-26T00:02:02.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.211+0000 7fae55600640 1 -- 172.21.15.42:0/1011384116 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae4c009c30 con 0x7fae58103ba0 2024-08-26T00:02:02.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.211+0000 7fae55600640 1 -- 172.21.15.42:0/1011384116 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c00f620 con 0x7fae58103ba0 2024-08-26T00:02:02.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.212+0000 7fae5fa00640 1 -- 172.21.15.42:0/1011384116 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae581a2240 con 0x7fae58103ba0 2024-08-26T00:02:02.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.213+0000 7fae5fa00640 1 -- 172.21.15.42:0/1011384116 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae5810b040 con 0x7fae58103ba0 2024-08-26T00:02:02.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.214+0000 7fae55600640 1 -- 172.21.15.42:0/1011384116 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fae4c01a070 con 0x7fae58103ba0 2024-08-26T00:02:02.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.216+0000 7fae55600640 1 --2- 172.21.15.42:0/1011384116 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fae400a2cc0 0x7fae400a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:02.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.216+0000 7fae55600640 1 -- 172.21.15.42:0/1011384116 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fae4c0ced10 con 0x7fae58103ba0 2024-08-26T00:02:02.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.216+0000 7fae57e00640 1 --2- 172.21.15.42:0/1011384116 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fae400a2cc0 0x7fae400a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:02.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.217+0000 7fae57e00640 1 --2- 172.21.15.42:0/1011384116 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fae400a2cc0 0x7fae400a5180 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fae44031440 tx=0x7fae440315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:02.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.218+0000 7fae55600640 1 -- 172.21.15.42:0/1011384116 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fae4c09bb50 con 0x7fae58103ba0 2024-08-26T00:02:02.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.412+0000 7fae5fa00640 1 -- 172.21.15.42:0/1011384116 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fae580623d0 con 0x7fae400a2cc0 2024-08-26T00:02:02.413 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:02 smithi042 ceph-mon[17225]: from='client.24929 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:02:02.413 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:02 smithi042 ceph-mon[17225]: pgmap v324: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-26T00:02:02.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.418+0000 7fae55600640 1 -- 172.21.15.42:0/1011384116 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fae580623d0 con 0x7fae400a2cc0 2024-08-26T00:02:02.418 INFO:teuthology.orchestra.run.smithi042.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-08-26T00:02:02.419 INFO:teuthology.orchestra.run.smithi042.stdout:mds.all 12/12 35s ago 2m smithi042=a;smithi042=d;smithi042=g;smithi042=j;smithi043=b;smithi043=e;smithi043=h;smithi043=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-08-26T00:02:02.419 INFO:teuthology.orchestra.run.smithi042.stdout:mgr 3/3 35s ago 7m smithi042=x;smithi043=y;smithi181=z;count:3 2024-08-26T00:02:02.419 INFO:teuthology.orchestra.run.smithi042.stdout:mon 3/3 35s ago 7m smithi042:172.21.15.42=a;smithi043:172.21.15.43=b;smithi181:172.21.15.181=c;count:3 2024-08-26T00:02:02.419 INFO:teuthology.orchestra.run.smithi042.stdout:osd 12 35s ago - 2024-08-26T00:02:02.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.420+0000 7fae5fa00640 1 -- 172.21.15.42:0/1011384116 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fae400a2cc0 msgr2=0x7fae400a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:02.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.420+0000 7fae5fa00640 1 --2- 172.21.15.42:0/1011384116 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fae400a2cc0 0x7fae400a5180 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fae44031440 tx=0x7fae440315b0 comp rx=0 tx=0).stop 2024-08-26T00:02:02.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.420+0000 7fae5fa00640 1 -- 172.21.15.42:0/1011384116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae58103ba0 msgr2=0x7fae58199e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:02.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.420+0000 7fae5fa00640 1 --2- 172.21.15.42:0/1011384116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae58103ba0 0x7fae58199e70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fae58104c00 tx=0x7fae4c00dde0 comp rx=0 tx=0).stop 2024-08-26T00:02:02.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.421+0000 7fae5fa00640 1 -- 172.21.15.42:0/1011384116 shutdown_connections 2024-08-26T00:02:02.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.421+0000 7fae5fa00640 1 --2- 172.21.15.42:0/1011384116 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fae400a2cc0 0x7fae400a5180 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:02.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.421+0000 7fae5fa00640 1 --2- 172.21.15.42:0/1011384116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae58105760 0x7fae581a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:02.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.421+0000 7fae5fa00640 1 --2- 172.21.15.42:0/1011384116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae58104da0 0x7fae5819a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:02.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.421+0000 7fae5fa00640 1 --2- 172.21.15.42:0/1011384116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae58103ba0 0x7fae58199e70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:02.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.421+0000 7fae5fa00640 1 -- 172.21.15.42:0/1011384116 >> 172.21.15.42:0/1011384116 conn(0x7fae580ff350 msgr2=0x7fae58108210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:02.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.421+0000 7fae5fa00640 1 -- 172.21.15.42:0/1011384116 shutdown_connections 2024-08-26T00:02:02.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:02.421+0000 7fae5fa00640 1 -- 172.21.15.42:0/1011384116 wait complete. 2024-08-26T00:02:02.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:02 smithi043 ceph-mon[22091]: from='client.24929 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:02:02.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:02 smithi043 ceph-mon[22091]: pgmap v324: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-26T00:02:02.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:02 smithi181 ceph-mon[22102]: from='client.24929 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:02:02.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:02 smithi181 ceph-mon[22102]: pgmap v324: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-26T00:02:03.178 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- bash -c 'ceph orch host ls' 2024-08-26T00:02:03.552 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:02:04.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.059+0000 7fa80fc00640 1 -- 172.21.15.42:0/1139279015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa808102ba0 msgr2=0x7fa808103020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:04.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.059+0000 7fa80fc00640 1 --2- 172.21.15.42:0/1139279015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa808102ba0 0x7fa808103020 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009900 tx=0x7fa7f002a3f0 comp rx=0 tx=0).stop 2024-08-26T00:02:04.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.059+0000 7fa80fc00640 1 -- 172.21.15.42:0/1139279015 shutdown_connections 2024-08-26T00:02:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.059+0000 7fa80fc00640 1 --2- 172.21.15.42:0/1139279015 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa808103560 0x7fa808109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.059+0000 7fa80fc00640 1 --2- 172.21.15.42:0/1139279015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa808102ba0 0x7fa808103020 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.059+0000 7fa80fc00640 1 --2- 172.21.15.42:0/1139279015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8081019a0 0x7fa808101da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.059+0000 7fa80fc00640 1 -- 172.21.15.42:0/1139279015 >> 172.21.15.42:0/1139279015 conn(0x7fa8080fd130 msgr2=0x7fa8080ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.059+0000 7fa80fc00640 1 -- 172.21.15.42:0/1139279015 shutdown_connections 2024-08-26T00:02:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.059+0000 7fa80fc00640 1 -- 172.21.15.42:0/1139279015 wait complete. 2024-08-26T00:02:04.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.060+0000 7fa80fc00640 1 Processor -- start 2024-08-26T00:02:04.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.060+0000 7fa80fc00640 1 -- start start 2024-08-26T00:02:04.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.060+0000 7fa80fc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8081019a0 0x7fa808197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:04.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.060+0000 7fa80fc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa808102ba0 0x7fa8081981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:04.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.060+0000 7fa80fc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa808103560 0x7fa80819f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:04.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.060+0000 7fa80fc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa80810d650 con 0x7fa8081019a0 2024-08-26T00:02:04.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.060+0000 7fa80fc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa80810d4d0 con 0x7fa808103560 2024-08-26T00:02:04.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.060+0000 7fa80fc00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa80810d7d0 con 0x7fa808102ba0 2024-08-26T00:02:04.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.060+0000 7fa80d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8081019a0 0x7fa808197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:04.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.060+0000 7fa80d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8081019a0 0x7fa808197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45824/0 (socket says 172.21.15.42:45824) 2024-08-26T00:02:04.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.060+0000 7fa807e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa808102ba0 0x7fa8081981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:04.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.060+0000 7fa80d200640 1 -- 172.21.15.42:0/3576597852 learned_addr learned my addr 172.21.15.42:0/3576597852 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:04.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.061+0000 7fa80dc00640 1 --2- 172.21.15.42:0/3576597852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa808103560 0x7fa80819f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:04.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.061+0000 7fa80d200640 1 -- 172.21.15.42:0/3576597852 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa808102ba0 msgr2=0x7fa8081981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:04.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.061+0000 7fa80d200640 1 --2- 172.21.15.42:0/3576597852 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa808102ba0 0x7fa8081981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:04.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.061+0000 7fa80d200640 1 -- 172.21.15.42:0/3576597852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa808103560 msgr2=0x7fa80819f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:04.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.061+0000 7fa80d200640 1 --2- 172.21.15.42:0/3576597852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa808103560 0x7fa80819f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:04.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.061+0000 7fa80d200640 1 -- 172.21.15.42:0/3576597852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa80819f8c0 con 0x7fa8081019a0 2024-08-26T00:02:04.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.061+0000 7fa80d200640 1 --2- 172.21.15.42:0/3576597852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8081019a0 0x7fa808197ca0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800ebc0 tx=0x7fa7f800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:04.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.061+0000 7fa805600640 1 -- 172.21.15.42:0/3576597852 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8003b70 con 0x7fa8081019a0 2024-08-26T00:02:04.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.061+0000 7fa805600640 1 -- 172.21.15.42:0/3576597852 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7f8003d10 con 0x7fa8081019a0 2024-08-26T00:02:04.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.061+0000 7fa80fc00640 1 -- 172.21.15.42:0/3576597852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa80819fbb0 con 0x7fa8081019a0 2024-08-26T00:02:04.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.062+0000 7fa805600640 1 -- 172.21.15.42:0/3576597852 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8019980 con 0x7fa8081019a0 2024-08-26T00:02:04.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.062+0000 7fa80fc00640 1 -- 172.21.15.42:0/3576597852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8081a00c0 con 0x7fa8081019a0 2024-08-26T00:02:04.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.063+0000 7fa80fc00640 1 -- 172.21.15.42:0/3576597852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa808108d00 con 0x7fa8081019a0 2024-08-26T00:02:04.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.065+0000 7fa805600640 1 -- 172.21.15.42:0/3576597852 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa7f8019b20 con 0x7fa8081019a0 2024-08-26T00:02:04.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.066+0000 7fa805600640 1 --2- 172.21.15.42:0/3576597852 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa7ec0a2b80 0x7fa7ec0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:04.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.066+0000 7fa805600640 1 -- 172.21.15.42:0/3576597852 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fa7f80cf940 con 0x7fa8081019a0 2024-08-26T00:02:04.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.066+0000 7fa807e00640 1 --2- 172.21.15.42:0/3576597852 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa7ec0a2b80 0x7fa7ec0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:04.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.067+0000 7fa807e00640 1 --2- 172.21.15.42:0/3576597852 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa7ec0a2b80 0x7fa7ec0a5040 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0031440 tx=0x7fa7f00315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:04.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.070+0000 7fa805600640 1 -- 172.21.15.42:0/3576597852 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa7f809c860 con 0x7fa8081019a0 2024-08-26T00:02:04.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.263+0000 7fa80fc00640 1 -- 172.21.15.42:0/3576597852 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fa8080623d0 con 0x7fa7ec0a2b80 2024-08-26T00:02:04.264 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:04 smithi042 ceph-mon[17225]: from='client.24961 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:02:04.264 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:04 smithi042 ceph-mon[17225]: pgmap v325: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:02:04.264 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:04 smithi042 ceph-mon[17225]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-08-26T00:02:04.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.265+0000 7fa805600640 1 -- 172.21.15.42:0/3576597852 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fa8080623d0 con 0x7fa7ec0a2b80 2024-08-26T00:02:04.266 INFO:teuthology.orchestra.run.smithi042.stdout:HOST ADDR LABELS STATUS 2024-08-26T00:02:04.266 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042 172.21.15.42 2024-08-26T00:02:04.266 INFO:teuthology.orchestra.run.smithi042.stdout:smithi043 172.21.15.43 2024-08-26T00:02:04.266 INFO:teuthology.orchestra.run.smithi042.stdout:smithi181 172.21.15.181 2024-08-26T00:02:04.266 INFO:teuthology.orchestra.run.smithi042.stdout:3 hosts in cluster 2024-08-26T00:02:04.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.267+0000 7fa80fc00640 1 -- 172.21.15.42:0/3576597852 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa7ec0a2b80 msgr2=0x7fa7ec0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:04.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.267+0000 7fa80fc00640 1 --2- 172.21.15.42:0/3576597852 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa7ec0a2b80 0x7fa7ec0a5040 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0031440 tx=0x7fa7f00315b0 comp rx=0 tx=0).stop 2024-08-26T00:02:04.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.267+0000 7fa80fc00640 1 -- 172.21.15.42:0/3576597852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8081019a0 msgr2=0x7fa808197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:04.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.267+0000 7fa80fc00640 1 --2- 172.21.15.42:0/3576597852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8081019a0 0x7fa808197ca0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800ebc0 tx=0x7fa7f800c6a0 comp rx=0 tx=0).stop 2024-08-26T00:02:04.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.268+0000 7fa80fc00640 1 -- 172.21.15.42:0/3576597852 shutdown_connections 2024-08-26T00:02:04.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.268+0000 7fa80fc00640 1 --2- 172.21.15.42:0/3576597852 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa7ec0a2b80 0x7fa7ec0a5040 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:04.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.268+0000 7fa80fc00640 1 --2- 172.21.15.42:0/3576597852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa808103560 0x7fa80819f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:04.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.268+0000 7fa80fc00640 1 --2- 172.21.15.42:0/3576597852 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa808102ba0 0x7fa8081981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:04.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.268+0000 7fa80fc00640 1 --2- 172.21.15.42:0/3576597852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8081019a0 0x7fa808197ca0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:04.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.268+0000 7fa80fc00640 1 -- 172.21.15.42:0/3576597852 >> 172.21.15.42:0/3576597852 conn(0x7fa8080fd130 msgr2=0x7fa808105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:04.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.268+0000 7fa80fc00640 1 -- 172.21.15.42:0/3576597852 shutdown_connections 2024-08-26T00:02:04.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:04.268+0000 7fa80fc00640 1 -- 172.21.15.42:0/3576597852 wait complete. 2024-08-26T00:02:04.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:04 smithi043 ceph-mon[22091]: from='client.24961 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:02:04.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:04 smithi043 ceph-mon[22091]: pgmap v325: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:02:04.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:04 smithi043 ceph-mon[22091]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-08-26T00:02:04.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:04 smithi181 ceph-mon[22102]: from='client.24961 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:02:04.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:04 smithi181 ceph-mon[22102]: pgmap v325: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:02:04.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:04 smithi181 ceph-mon[22102]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-08-26T00:02:05.155 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- bash -c 'ceph orch device ls' 2024-08-26T00:02:05.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:05 smithi043 ceph-mon[22091]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:02:05.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:05 smithi042 ceph-mon[17225]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:02:05.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:05 smithi181 ceph-mon[22102]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:02:05.547 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:02:06.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.102+0000 7fb3f7200640 1 -- 172.21.15.42:0/2256080939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3f81033a0 msgr2=0x7fb3f8109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:06.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.102+0000 7fb3f7200640 1 --2- 172.21.15.42:0/2256080939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3f81033a0 0x7fb3f8109c30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0009900 tx=0x7fb3f002a3f0 comp rx=0 tx=0).stop 2024-08-26T00:02:06.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.102+0000 7fb3f7200640 1 -- 172.21.15.42:0/2256080939 shutdown_connections 2024-08-26T00:02:06.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.102+0000 7fb3f7200640 1 --2- 172.21.15.42:0/2256080939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3f81033a0 0x7fb3f8109c30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:06.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.102+0000 7fb3f7200640 1 --2- 172.21.15.42:0/2256080939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3f81029e0 0x7fb3f8102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:06.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.102+0000 7fb3f7200640 1 --2- 172.21.15.42:0/2256080939 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3f81017e0 0x7fb3f8101be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:06.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.102+0000 7fb3f7200640 1 -- 172.21.15.42:0/2256080939 >> 172.21.15.42:0/2256080939 conn(0x7fb3f80fcf90 msgr2=0x7fb3f80ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:06.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.102+0000 7fb3f7200640 1 -- 172.21.15.42:0/2256080939 shutdown_connections 2024-08-26T00:02:06.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.102+0000 7fb3f7200640 1 -- 172.21.15.42:0/2256080939 wait complete. 2024-08-26T00:02:06.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.103+0000 7fb3f7200640 1 Processor -- start 2024-08-26T00:02:06.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.103+0000 7fb3f7200640 1 -- start start 2024-08-26T00:02:06.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.104+0000 7fb3f7200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3f81017e0 0x7fb3f8199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:06.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.104+0000 7fb3f7200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3f81029e0 0x7fb3f819a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:06.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.104+0000 7fb3f7200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3f81033a0 0x7fb3f81a1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:06.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.104+0000 7fb3f7200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f810d460 con 0x7fb3f81029e0 2024-08-26T00:02:06.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.104+0000 7fb3f7200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f810d2e0 con 0x7fb3f81033a0 2024-08-26T00:02:06.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.104+0000 7fb3f7200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f810d5e0 con 0x7fb3f81017e0 2024-08-26T00:02:06.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.104+0000 7fb3ed400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3f81029e0 0x7fb3f819a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:06.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.104+0000 7fb3f6800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3f81033a0 0x7fb3f81a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:06.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.104+0000 7fb3f5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3f81017e0 0x7fb3f8199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:06.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.104+0000 7fb3f6800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3f81033a0 0x7fb3f81a1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:42208/0 (socket says 172.21.15.42:42208) 2024-08-26T00:02:06.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.104+0000 7fb3f6800640 1 -- 172.21.15.42:0/3316470963 learned_addr learned my addr 172.21.15.42:0/3316470963 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:06.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.104+0000 7fb3ed400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3f81029e0 0x7fb3f819a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58338/0 (socket says 172.21.15.42:58338) 2024-08-26T00:02:06.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.104+0000 7fb3f5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3f81017e0 0x7fb3f8199c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:49578/0 (socket says 172.21.15.42:49578) 2024-08-26T00:02:06.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.104+0000 7fb3f6800640 1 -- 172.21.15.42:0/3316470963 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3f81017e0 msgr2=0x7fb3f8199c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:06.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.104+0000 7fb3f6800640 1 --2- 172.21.15.42:0/3316470963 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3f81017e0 0x7fb3f8199c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:06.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.104+0000 7fb3f6800640 1 -- 172.21.15.42:0/3316470963 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3f81029e0 msgr2=0x7fb3f819a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:06.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.104+0000 7fb3f6800640 1 --2- 172.21.15.42:0/3316470963 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3f81029e0 0x7fb3f819a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:06.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.104+0000 7fb3f6800640 1 -- 172.21.15.42:0/3316470963 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f81a18b0 con 0x7fb3f81033a0 2024-08-26T00:02:06.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.105+0000 7fb3f6800640 1 --2- 172.21.15.42:0/3316470963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3f81033a0 0x7fb3f81a1240 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb3f00314e0 tx=0x7fb3f00042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:06.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.105+0000 7fb3ef400640 1 -- 172.21.15.42:0/3316470963 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f003f030 con 0x7fb3f81033a0 2024-08-26T00:02:06.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.105+0000 7fb3ef400640 1 -- 172.21.15.42:0/3316470963 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3f0003ce0 con 0x7fb3f81033a0 2024-08-26T00:02:06.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.105+0000 7fb3ef400640 1 -- 172.21.15.42:0/3316470963 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0035070 con 0x7fb3f81033a0 2024-08-26T00:02:06.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.105+0000 7fb3f7200640 1 -- 172.21.15.42:0/3316470963 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3f81a1b40 con 0x7fb3f81033a0 2024-08-26T00:02:06.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.105+0000 7fb3f7200640 1 -- 172.21.15.42:0/3316470963 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3f81a1fd0 con 0x7fb3f81033a0 2024-08-26T00:02:06.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.106+0000 7fb3f7200640 1 -- 172.21.15.42:0/3316470963 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3f81a2200 con 0x7fb3f81033a0 2024-08-26T00:02:06.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.108+0000 7fb3ef400640 1 -- 172.21.15.42:0/3316470963 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb3f0042030 con 0x7fb3f81033a0 2024-08-26T00:02:06.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.110+0000 7fb3ef400640 1 --2- 172.21.15.42:0/3316470963 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb3dc0a2b80 0x7fb3dc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:06.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.110+0000 7fb3ef400640 1 -- 172.21.15.42:0/3316470963 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb3f00ef8f0 con 0x7fb3f81033a0 2024-08-26T00:02:06.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.110+0000 7fb3f5e00640 1 --2- 172.21.15.42:0/3316470963 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb3dc0a2b80 0x7fb3dc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:06.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.111+0000 7fb3f5e00640 1 --2- 172.21.15.42:0/3316470963 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb3dc0a2b80 0x7fb3dc0a5040 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb3f819ab70 tx=0x7fb3e8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:06.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.112+0000 7fb3ef400640 1 -- 172.21.15.42:0/3316470963 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb3f00bc2e0 con 0x7fb3f81033a0 2024-08-26T00:02:06.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:06 smithi042 ceph-mon[17225]: pgmap v326: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:02:06.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.308+0000 7fb3f7200640 1 -- 172.21.15.42:0/3316470963 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fb3f81a2490 con 0x7fb3dc0a2b80 2024-08-26T00:02:06.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.310+0000 7fb3ef400640 1 -- 172.21.15.42:0/3316470963 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fb3f81a2490 con 0x7fb3dc0a2b80 2024-08-26T00:02:06.310 INFO:teuthology.orchestra.run.smithi042.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-08-26T00:02:06.310 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75130021480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-08-26T00:02:06.310 INFO:teuthology.orchestra.run.smithi042.stdout:smithi043 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300GH480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-08-26T00:02:06.310 INFO:teuthology.orchestra.run.smithi042.stdout:smithi181 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6246000E400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-08-26T00:02:06.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.312+0000 7fb3f7200640 1 -- 172.21.15.42:0/3316470963 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb3dc0a2b80 msgr2=0x7fb3dc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:06.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.312+0000 7fb3f7200640 1 --2- 172.21.15.42:0/3316470963 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb3dc0a2b80 0x7fb3dc0a5040 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb3f819ab70 tx=0x7fb3e8009500 comp rx=0 tx=0).stop 2024-08-26T00:02:06.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.312+0000 7fb3f7200640 1 -- 172.21.15.42:0/3316470963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3f81033a0 msgr2=0x7fb3f81a1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:06.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.312+0000 7fb3f7200640 1 --2- 172.21.15.42:0/3316470963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3f81033a0 0x7fb3f81a1240 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb3f00314e0 tx=0x7fb3f00042f0 comp rx=0 tx=0).stop 2024-08-26T00:02:06.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.312+0000 7fb3f7200640 1 -- 172.21.15.42:0/3316470963 shutdown_connections 2024-08-26T00:02:06.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.312+0000 7fb3f7200640 1 --2- 172.21.15.42:0/3316470963 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb3dc0a2b80 0x7fb3dc0a5040 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:06.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.312+0000 7fb3f7200640 1 --2- 172.21.15.42:0/3316470963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3f81033a0 0x7fb3f81a1240 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:06.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.312+0000 7fb3f7200640 1 --2- 172.21.15.42:0/3316470963 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3f81029e0 0x7fb3f819a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:06.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.312+0000 7fb3f7200640 1 --2- 172.21.15.42:0/3316470963 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3f81017e0 0x7fb3f8199c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:06.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.312+0000 7fb3f7200640 1 -- 172.21.15.42:0/3316470963 >> 172.21.15.42:0/3316470963 conn(0x7fb3f80fcf90 msgr2=0x7fb3f80741c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:06.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.313+0000 7fb3f7200640 1 -- 172.21.15.42:0/3316470963 shutdown_connections 2024-08-26T00:02:06.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:06.313+0000 7fb3f7200640 1 -- 172.21.15.42:0/3316470963 wait complete. 2024-08-26T00:02:06.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:06 smithi043 ceph-mon[22091]: pgmap v326: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:02:06.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:06 smithi181 ceph-mon[22102]: pgmap v326: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:02:06.952 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-26T00:02:06.983 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi042.front.sepia.ceph.com 2024-08-26T00:02:06.983 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-26T00:02:07.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:07 smithi042 ceph-mon[17225]: from='client.24947 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:02:07.363 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:02:07.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:07 smithi043 ceph-mon[22091]: from='client.24947 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:02:07.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:07 smithi181 ceph-mon[22102]: from='client.24947 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-26T00:02:07.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.891+0000 7f1e01000640 1 -- 172.21.15.42:0/1306261242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dfc1055b0 msgr2=0x7f1dfc10be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:07.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.891+0000 7f1e01000640 1 --2- 172.21.15.42:0/1306261242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dfc1055b0 0x7f1dfc10be40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1df4009ca0 tx=0x7f1df402a8c0 comp rx=0 tx=0).stop 2024-08-26T00:02:07.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.891+0000 7f1e01000640 1 -- 172.21.15.42:0/1306261242 shutdown_connections 2024-08-26T00:02:07.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.891+0000 7f1e01000640 1 --2- 172.21.15.42:0/1306261242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dfc1055b0 0x7f1dfc10be40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:07.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.891+0000 7f1e01000640 1 --2- 172.21.15.42:0/1306261242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1dfc104bf0 0x7f1dfc105070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:07.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.891+0000 7f1e01000640 1 --2- 172.21.15.42:0/1306261242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dfc1039f0 0x7f1dfc103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:07.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.891+0000 7f1e01000640 1 -- 172.21.15.42:0/1306261242 >> 172.21.15.42:0/1306261242 conn(0x7f1dfc0ff180 msgr2=0x7f1dfc1015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:07.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.891+0000 7f1e01000640 1 -- 172.21.15.42:0/1306261242 shutdown_connections 2024-08-26T00:02:07.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.891+0000 7f1e01000640 1 -- 172.21.15.42:0/1306261242 wait complete. 2024-08-26T00:02:07.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.892+0000 7f1e01000640 1 Processor -- start 2024-08-26T00:02:07.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.892+0000 7f1e01000640 1 -- start start 2024-08-26T00:02:07.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.893+0000 7f1e01000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dfc1039f0 0x7f1dfc199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:07.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.893+0000 7f1e01000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dfc104bf0 0x7f1dfc19a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:07.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.893+0000 7f1e01000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1dfc1055b0 0x7f1dfc1a1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:07.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.893+0000 7f1e01000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc10f6c0 con 0x7f1dfc104bf0 2024-08-26T00:02:07.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.893+0000 7f1e01000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc10f540 con 0x7f1dfc1039f0 2024-08-26T00:02:07.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.893+0000 7f1e01000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc10f840 con 0x7f1dfc1055b0 2024-08-26T00:02:07.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.893+0000 7f1dfaa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dfc104bf0 0x7f1dfc19a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:07.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.893+0000 7f1dfaa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dfc104bf0 0x7f1dfc19a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58360/0 (socket says 172.21.15.42:58360) 2024-08-26T00:02:07.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.893+0000 7f1dfaa00640 1 -- 172.21.15.42:0/736709330 learned_addr learned my addr 172.21.15.42:0/736709330 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:07.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.893+0000 7f1dfb400640 1 --2- 172.21.15.42:0/736709330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dfc1039f0 0x7f1dfc199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:07.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.893+0000 7f1dfbe00640 1 --2- 172.21.15.42:0/736709330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1dfc1055b0 0x7f1dfc1a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:07.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.893+0000 7f1dfaa00640 1 -- 172.21.15.42:0/736709330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1dfc1055b0 msgr2=0x7f1dfc1a1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:07.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.893+0000 7f1dfaa00640 1 --2- 172.21.15.42:0/736709330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1dfc1055b0 0x7f1dfc1a1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:07.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.893+0000 7f1dfaa00640 1 -- 172.21.15.42:0/736709330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dfc1039f0 msgr2=0x7f1dfc199c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:07.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.893+0000 7f1dfaa00640 1 --2- 172.21.15.42:0/736709330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dfc1039f0 0x7f1dfc199c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:07.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.893+0000 7f1dfaa00640 1 -- 172.21.15.42:0/736709330 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dfc1a18b0 con 0x7f1dfc104bf0 2024-08-26T00:02:07.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.893+0000 7f1dfb400640 1 --2- 172.21.15.42:0/736709330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dfc1039f0 0x7f1dfc199c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:07.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.894+0000 7f1dfaa00640 1 --2- 172.21.15.42:0/736709330 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dfc104bf0 0x7f1dfc19a1d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1de800d770 tx=0x7f1de800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:07.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.894+0000 7f1df3e00640 1 -- 172.21.15.42:0/736709330 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de8017070 con 0x7f1dfc104bf0 2024-08-26T00:02:07.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.894+0000 7f1df3e00640 1 -- 172.21.15.42:0/736709330 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1de8005500 con 0x7f1dfc104bf0 2024-08-26T00:02:07.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.894+0000 7f1df3e00640 1 -- 172.21.15.42:0/736709330 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de8004e00 con 0x7f1dfc104bf0 2024-08-26T00:02:07.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.894+0000 7f1e01000640 1 -- 172.21.15.42:0/736709330 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dfc1a1ba0 con 0x7f1dfc104bf0 2024-08-26T00:02:07.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.894+0000 7f1e01000640 1 -- 172.21.15.42:0/736709330 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dfc1a2090 con 0x7f1dfc104bf0 2024-08-26T00:02:07.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.895+0000 7f1e01000640 1 -- 172.21.15.42:0/736709330 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dfc10ad20 con 0x7f1dfc104bf0 2024-08-26T00:02:07.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.897+0000 7f1df3e00640 1 -- 172.21.15.42:0/736709330 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1de8004fa0 con 0x7f1dfc104bf0 2024-08-26T00:02:07.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.899+0000 7f1df3e00640 1 --2- 172.21.15.42:0/736709330 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1de00a2b80 0x7f1de00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:07.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.899+0000 7f1df3e00640 1 -- 172.21.15.42:0/736709330 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f1de80ceb00 con 0x7f1dfc104bf0 2024-08-26T00:02:07.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.899+0000 7f1dfb400640 1 --2- 172.21.15.42:0/736709330 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1de00a2b80 0x7f1de00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:07.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.899+0000 7f1dfb400640 1 --2- 172.21.15.42:0/736709330 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1de00a2b80 0x7f1de00a5040 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc19ab70 tx=0x7f1dec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:07.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:07.903+0000 7f1df3e00640 1 -- 172.21.15.42:0/736709330 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f1de809ba20 con 0x7f1dfc104bf0 2024-08-26T00:02:08.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:08.124+0000 7f1e01000640 1 -- 172.21.15.42:0/736709330 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f1dfc062c30 con 0x7f1dfc104bf0 2024-08-26T00:02:08.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:08.124+0000 7f1df3e00640 1 -- 172.21.15.42:0/736709330 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) ==== 76+0+3085 (secure 0 0 0) 0x7f1de809b320 con 0x7f1dfc104bf0 2024-08-26T00:02:08.125 INFO:teuthology.orchestra.run.smithi042.stdout:e23 2024-08-26T00:02:08.125 INFO:teuthology.orchestra.run.smithi042.stdout:btime 2024-08-26T00:00:42:404711+0000 2024-08-26T00:02:08.125 INFO:teuthology.orchestra.run.smithi042.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-26T00:02:08.125 INFO:teuthology.orchestra.run.smithi042.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-26T00:02:08.125 INFO:teuthology.orchestra.run.smithi042.stdout:legacy client fscid: 1 2024-08-26T00:02:08.125 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:02:08.125 INFO:teuthology.orchestra.run.smithi042.stdout:Filesystem 'cephfs' (1) 2024-08-26T00:02:08.125 INFO:teuthology.orchestra.run.smithi042.stdout:fs_name cephfs 2024-08-26T00:02:08.126 INFO:teuthology.orchestra.run.smithi042.stdout:epoch 23 2024-08-26T00:02:08.126 INFO:teuthology.orchestra.run.smithi042.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-26T00:02:08.126 INFO:teuthology.orchestra.run.smithi042.stdout:created 2024-08-26T00:00:30.169633+0000 2024-08-26T00:02:08.126 INFO:teuthology.orchestra.run.smithi042.stdout:modified 2024-08-26T00:00:42.314271+0000 2024-08-26T00:02:08.126 INFO:teuthology.orchestra.run.smithi042.stdout:tableserver 0 2024-08-26T00:02:08.126 INFO:teuthology.orchestra.run.smithi042.stdout:root 0 2024-08-26T00:02:08.126 INFO:teuthology.orchestra.run.smithi042.stdout:session_timeout 300 2024-08-26T00:02:08.126 INFO:teuthology.orchestra.run.smithi042.stdout:session_autoclose 300 2024-08-26T00:02:08.127 INFO:teuthology.orchestra.run.smithi042.stdout:max_file_size 1099511627776 2024-08-26T00:02:08.127 INFO:teuthology.orchestra.run.smithi042.stdout:max_xattr_size 65536 2024-08-26T00:02:08.127 INFO:teuthology.orchestra.run.smithi042.stdout:required_client_features {} 2024-08-26T00:02:08.127 INFO:teuthology.orchestra.run.smithi042.stdout:last_failure 0 2024-08-26T00:02:08.127 INFO:teuthology.orchestra.run.smithi042.stdout:last_failure_osd_epoch 0 2024-08-26T00:02:08.127 INFO:teuthology.orchestra.run.smithi042.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-26T00:02:08.127 INFO:teuthology.orchestra.run.smithi042.stdout:max_mds 3 2024-08-26T00:02:08.127 INFO:teuthology.orchestra.run.smithi042.stdout:in 0,1,2 2024-08-26T00:02:08.127 INFO:teuthology.orchestra.run.smithi042.stdout:up {0=24532,1=24527,2=24514} 2024-08-26T00:02:08.127 INFO:teuthology.orchestra.run.smithi042.stdout:failed 2024-08-26T00:02:08.128 INFO:teuthology.orchestra.run.smithi042.stdout:damaged 2024-08-26T00:02:08.128 INFO:teuthology.orchestra.run.smithi042.stdout:stopped 2024-08-26T00:02:08.128 INFO:teuthology.orchestra.run.smithi042.stdout:data_pools [3] 2024-08-26T00:02:08.128 INFO:teuthology.orchestra.run.smithi042.stdout:metadata_pool 2 2024-08-26T00:02:08.128 INFO:teuthology.orchestra.run.smithi042.stdout:inline_data disabled 2024-08-26T00:02:08.128 INFO:teuthology.orchestra.run.smithi042.stdout:balancer 2024-08-26T00:02:08.128 INFO:teuthology.orchestra.run.smithi042.stdout:bal_rank_mask -1 2024-08-26T00:02:08.128 INFO:teuthology.orchestra.run.smithi042.stdout:standby_count_wanted 0 2024-08-26T00:02:08.128 INFO:teuthology.orchestra.run.smithi042.stdout:qdb_cluster leader: 24532 members: 24514,24527,24532 2024-08-26T00:02:08.128 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.i{0:24532} state up:active seq 7 addr [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] compat {c=[1],r=[1],i=[1fff]}] 2024-08-26T00:02:08.129 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.f{0:24502} state up:standby-replay seq 1 addr [v2:172.21.15.181:6834/1496959020,v1:172.21.15.181:6835/1496959020] compat {c=[1],r=[1],i=[1fff]}] 2024-08-26T00:02:08.129 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.b{1:24527} state up:active seq 7 addr [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] compat {c=[1],r=[1],i=[1fff]}] 2024-08-26T00:02:08.129 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.h{1:24494} state up:standby-replay seq 1 addr [v2:172.21.15.43:6836/2817851173,v1:172.21.15.43:6837/2817851173] compat {c=[1],r=[1],i=[1fff]}] 2024-08-26T00:02:08.129 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.c{2:24514} state up:active seq 10 addr [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] compat {c=[1],r=[1],i=[1fff]}] 2024-08-26T00:02:08.129 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.e{2:24464} state up:standby-replay seq 1 addr [v2:172.21.15.43:6834/4195804691,v1:172.21.15.43:6835/4195804691] compat {c=[1],r=[1],i=[1fff]}] 2024-08-26T00:02:08.129 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:02:08.129 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:02:08.129 INFO:teuthology.orchestra.run.smithi042.stdout:Standby daemons: 2024-08-26T00:02:08.130 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:02:08.130 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.j{-1:14457} state up:standby seq 1 addr [v2:172.21.15.42:6834/1208862457,v1:172.21.15.42:6835/1208862457] compat {c=[1],r=[1],i=[1fff]}] 2024-08-26T00:02:08.130 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.d{-1:14469} state up:standby seq 1 addr [v2:172.21.15.42:6836/1832026661,v1:172.21.15.42:6837/1832026661] compat {c=[1],r=[1],i=[1fff]}] 2024-08-26T00:02:08.130 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.g{-1:14511} state up:standby seq 1 addr [v2:172.21.15.42:6838/3168581452,v1:172.21.15.42:6839/3168581452] compat {c=[1],r=[1],i=[1fff]}] 2024-08-26T00:02:08.130 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.a{-1:14517} state up:standby seq 1 addr [v2:172.21.15.42:6840/3533492491,v1:172.21.15.42:6841/3533492491] compat {c=[1],r=[1],i=[1fff]}] 2024-08-26T00:02:08.130 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.k{-1:24428} state up:standby seq 1 addr [v2:172.21.15.43:6832/368996647,v1:172.21.15.43:6833/368996647] compat {c=[1],r=[1],i=[1fff]}] 2024-08-26T00:02:08.130 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.l{-1:24463} state up:standby seq 1 addr [v2:172.21.15.181:6832/2147486121,v1:172.21.15.181:6833/2147486121] compat {c=[1],r=[1],i=[1fff]}] 2024-08-26T00:02:08.131 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 23 2024-08-26T00:02:08.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:08.127+0000 7f1e01000640 1 -- 172.21.15.42:0/736709330 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1de00a2b80 msgr2=0x7f1de00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:08.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:08.127+0000 7f1e01000640 1 --2- 172.21.15.42:0/736709330 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1de00a2b80 0x7f1de00a5040 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc19ab70 tx=0x7f1dec005f90 comp rx=0 tx=0).stop 2024-08-26T00:02:08.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:08.127+0000 7f1e01000640 1 -- 172.21.15.42:0/736709330 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dfc104bf0 msgr2=0x7f1dfc19a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:08.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:08.127+0000 7f1e01000640 1 --2- 172.21.15.42:0/736709330 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dfc104bf0 0x7f1dfc19a1d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1de800d770 tx=0x7f1de800dc30 comp rx=0 tx=0).stop 2024-08-26T00:02:08.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:08.127+0000 7f1e01000640 1 -- 172.21.15.42:0/736709330 shutdown_connections 2024-08-26T00:02:08.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:08.127+0000 7f1e01000640 1 --2- 172.21.15.42:0/736709330 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1de00a2b80 0x7f1de00a5040 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:08.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:08.127+0000 7f1e01000640 1 --2- 172.21.15.42:0/736709330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1dfc1055b0 0x7f1dfc1a1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:08.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:08.127+0000 7f1e01000640 1 --2- 172.21.15.42:0/736709330 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dfc104bf0 0x7f1dfc19a1d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:08.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:08.127+0000 7f1e01000640 1 --2- 172.21.15.42:0/736709330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dfc1039f0 0x7f1dfc199c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:08.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:08.127+0000 7f1e01000640 1 -- 172.21.15.42:0/736709330 >> 172.21.15.42:0/736709330 conn(0x7f1dfc0ff180 msgr2=0x7f1dfc107ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:08.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:08.127+0000 7f1e01000640 1 -- 172.21.15.42:0/736709330 shutdown_connections 2024-08-26T00:02:08.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:08.127+0000 7f1e01000640 1 -- 172.21.15.42:0/736709330 wait complete. 2024-08-26T00:02:08.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:08 smithi042 ceph-mon[17225]: pgmap v327: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-26T00:02:08.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:08 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/736709330' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-26T00:02:08.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:08 smithi043 ceph-mon[22091]: pgmap v327: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-26T00:02:08.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:08 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/736709330' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-26T00:02:08.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:08 smithi181 ceph-mon[22102]: pgmap v327: 97 pgs: 97 active+clean; 640 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-26T00:02:08.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:08 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/736709330' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-26T00:02:08.748 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- bash -c 'ceph osd dump' 2024-08-26T00:02:09.127 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:02:09.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.632+0000 7fd43ce00640 1 -- 172.21.15.42:0/2939512537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd438105760 msgr2=0x7fd43810bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:09.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.632+0000 7fd43ce00640 1 --2- 172.21.15.42:0/2939512537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd438105760 0x7fd43810bff0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd430009ca0 tx=0x7fd43002a8c0 comp rx=0 tx=0).stop 2024-08-26T00:02:09.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.632+0000 7fd43ce00640 1 -- 172.21.15.42:0/2939512537 shutdown_connections 2024-08-26T00:02:09.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.632+0000 7fd43ce00640 1 --2- 172.21.15.42:0/2939512537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd438105760 0x7fd43810bff0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:09.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.632+0000 7fd43ce00640 1 --2- 172.21.15.42:0/2939512537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd438104da0 0x7fd438105220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:09.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.632+0000 7fd43ce00640 1 --2- 172.21.15.42:0/2939512537 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd438103ba0 0x7fd438103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:09.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.632+0000 7fd43ce00640 1 -- 172.21.15.42:0/2939512537 >> 172.21.15.42:0/2939512537 conn(0x7fd4380ff350 msgr2=0x7fd438101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:09.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.633+0000 7fd43ce00640 1 -- 172.21.15.42:0/2939512537 shutdown_connections 2024-08-26T00:02:09.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.633+0000 7fd43ce00640 1 -- 172.21.15.42:0/2939512537 wait complete. 2024-08-26T00:02:09.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.633+0000 7fd43ce00640 1 Processor -- start 2024-08-26T00:02:09.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.634+0000 7fd43ce00640 1 -- start start 2024-08-26T00:02:09.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.634+0000 7fd43ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd438103ba0 0x7fd438199e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:09.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.634+0000 7fd43ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd438104da0 0x7fd43819a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:09.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.634+0000 7fd43ce00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd438105760 0x7fd4381a13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:09.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.634+0000 7fd43ce00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd43810f850 con 0x7fd438104da0 2024-08-26T00:02:09.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.634+0000 7fd43ce00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd43810f6d0 con 0x7fd438103ba0 2024-08-26T00:02:09.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.634+0000 7fd43ce00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd43810f9d0 con 0x7fd438105760 2024-08-26T00:02:09.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.634+0000 7fd435400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd438104da0 0x7fd43819a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:09.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.634+0000 7fd435e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd438103ba0 0x7fd438199e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:09.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.634+0000 7fd435e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd438103ba0 0x7fd438199e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:42230/0 (socket says 172.21.15.42:42230) 2024-08-26T00:02:09.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.634+0000 7fd435e00640 1 -- 172.21.15.42:0/225515605 learned_addr learned my addr 172.21.15.42:0/225515605 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:09.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.634+0000 7fd435400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd438104da0 0x7fd43819a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58378/0 (socket says 172.21.15.42:58378) 2024-08-26T00:02:09.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.634+0000 7fd436800640 1 --2- 172.21.15.42:0/225515605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd438105760 0x7fd4381a13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:09.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.635+0000 7fd435e00640 1 -- 172.21.15.42:0/225515605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd438105760 msgr2=0x7fd4381a13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:09.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.635+0000 7fd435e00640 1 --2- 172.21.15.42:0/225515605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd438105760 0x7fd4381a13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:09.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.635+0000 7fd435e00640 1 -- 172.21.15.42:0/225515605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd438104da0 msgr2=0x7fd43819a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:09.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.635+0000 7fd435e00640 1 --2- 172.21.15.42:0/225515605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd438104da0 0x7fd43819a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:09.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.635+0000 7fd435e00640 1 -- 172.21.15.42:0/225515605 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4381a1a40 con 0x7fd438103ba0 2024-08-26T00:02:09.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.635+0000 7fd435400640 1 --2- 172.21.15.42:0/225515605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd438104da0 0x7fd43819a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:09.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.635+0000 7fd435e00640 1 --2- 172.21.15.42:0/225515605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd438103ba0 0x7fd438199e10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd42800d950 tx=0x7fd42800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:09.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.635+0000 7fd42ea00640 1 -- 172.21.15.42:0/225515605 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd428017020 con 0x7fd438103ba0 2024-08-26T00:02:09.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.635+0000 7fd42ea00640 1 -- 172.21.15.42:0/225515605 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd428009c30 con 0x7fd438103ba0 2024-08-26T00:02:09.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.635+0000 7fd42ea00640 1 -- 172.21.15.42:0/225515605 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42800f720 con 0x7fd438103ba0 2024-08-26T00:02:09.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.635+0000 7fd43ce00640 1 -- 172.21.15.42:0/225515605 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4381a1d30 con 0x7fd438103ba0 2024-08-26T00:02:09.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.636+0000 7fd43ce00640 1 -- 172.21.15.42:0/225515605 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4381a21c0 con 0x7fd438103ba0 2024-08-26T00:02:09.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.636+0000 7fd43ce00640 1 -- 172.21.15.42:0/225515605 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd43810aed0 con 0x7fd438103ba0 2024-08-26T00:02:09.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.639+0000 7fd42ea00640 1 -- 172.21.15.42:0/225515605 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd42801a020 con 0x7fd438103ba0 2024-08-26T00:02:09.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.640+0000 7fd42ea00640 1 --2- 172.21.15.42:0/225515605 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd41c0a2bb0 0x7fd41c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:09.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.640+0000 7fd42ea00640 1 -- 172.21.15.42:0/225515605 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fd4280ceee0 con 0x7fd438103ba0 2024-08-26T00:02:09.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.640+0000 7fd435400640 1 --2- 172.21.15.42:0/225515605 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd41c0a2bb0 0x7fd41c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:09.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.641+0000 7fd435400640 1 --2- 172.21.15.42:0/225515605 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd41c0a2bb0 0x7fd41c0a5070 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd43819b330 tx=0x7fd42400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:09.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.644+0000 7fd42ea00640 1 -- 172.21.15.42:0/225515605 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd428021020 con 0x7fd438103ba0 2024-08-26T00:02:09.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.832+0000 7fd43ce00640 1 -- 172.21.15.42:0/225515605 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fd4380623d0 con 0x7fd438103ba0 2024-08-26T00:02:09.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.833+0000 7fd42ea00640 1 -- 172.21.15.42:0/225515605 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v80) ==== 56+0+5283 (secure 0 0 0) 0x7fd42809be00 con 0x7fd438103ba0 2024-08-26T00:02:09.834 INFO:teuthology.orchestra.run.smithi042.stdout:epoch 80 2024-08-26T00:02:09.834 INFO:teuthology.orchestra.run.smithi042.stdout:fsid f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-26T00:02:09.834 INFO:teuthology.orchestra.run.smithi042.stdout:created 2024-08-25T23:52:39.598509+0000 2024-08-26T00:02:09.834 INFO:teuthology.orchestra.run.smithi042.stdout:modified 2024-08-26T00:01:33.588911+0000 2024-08-26T00:02:09.834 INFO:teuthology.orchestra.run.smithi042.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-08-26T00:02:09.834 INFO:teuthology.orchestra.run.smithi042.stdout:crush_version 26 2024-08-26T00:02:09.834 INFO:teuthology.orchestra.run.smithi042.stdout:full_ratio 0.95 2024-08-26T00:02:09.835 INFO:teuthology.orchestra.run.smithi042.stdout:backfillfull_ratio 0.9 2024-08-26T00:02:09.835 INFO:teuthology.orchestra.run.smithi042.stdout:nearfull_ratio 0.85 2024-08-26T00:02:09.835 INFO:teuthology.orchestra.run.smithi042.stdout:require_min_compat_client luminous 2024-08-26T00:02:09.835 INFO:teuthology.orchestra.run.smithi042.stdout:min_compat_client luminous 2024-08-26T00:02:09.835 INFO:teuthology.orchestra.run.smithi042.stdout:require_osd_release squid 2024-08-26T00:02:09.835 INFO:teuthology.orchestra.run.smithi042.stdout:stretch_mode_enabled false 2024-08-26T00:02:09.835 INFO:teuthology.orchestra.run.smithi042.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-08-26T00:02:09.835 INFO:teuthology.orchestra.run.smithi042.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-08-26T00:02:09.835 INFO:teuthology.orchestra.run.smithi042.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-08-26T00:02:09.835 INFO:teuthology.orchestra.run.smithi042.stdout:max_osd 12 2024-08-26T00:02:09.835 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0 up in weight 1 up_from 8 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6802/2657450248,v1:172.21.15.42:6803/2657450248] [v2:172.21.15.42:6804/2657450248,v1:172.21.15.42:6805/2657450248] exists,up 980d8635-bca1-4c5a-b78e-4b44f9315d68 2024-08-26T00:02:09.835 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 up in weight 1 up_from 13 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.43:6800/2396081001,v1:172.21.15.43:6801/2396081001] [v2:172.21.15.43:6802/2396081001,v1:172.21.15.43:6803/2396081001] exists,up e5f8dc3b-876a-4bdd-b6b0-b0d99d098d95 2024-08-26T00:02:09.835 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 up in weight 1 up_from 17 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6800/189987070,v1:172.21.15.181:6801/189987070] [v2:172.21.15.181:6802/189987070,v1:172.21.15.181:6803/189987070] exists,up 06eb25af-8e3d-4f90-bc24-28a9bc224c0a 2024-08-26T00:02:09.836 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3 up in weight 1 up_from 23 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6810/251017896,v1:172.21.15.42:6811/251017896] [v2:172.21.15.42:6812/251017896,v1:172.21.15.42:6813/251017896] exists,up c78dbc49-b5c7-4f82-be36-c76a89496520 2024-08-26T00:02:09.836 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4 up in weight 1 up_from 30 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.43:6808/1315420796,v1:172.21.15.43:6809/1315420796] [v2:172.21.15.43:6810/1315420796,v1:172.21.15.43:6811/1315420796] exists,up ba633f66-25af-492f-bbf2-76032a4cd3d5 2024-08-26T00:02:09.836 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5 up in weight 1 up_from 35 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6808/246971403,v1:172.21.15.181:6809/246971403] [v2:172.21.15.181:6810/246971403,v1:172.21.15.181:6811/246971403] exists,up 04e47ad9-21ba-43da-9793-d5cf83150dc4 2024-08-26T00:02:09.836 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6 up in weight 1 up_from 42 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6818/2910656480,v1:172.21.15.42:6819/2910656480] [v2:172.21.15.42:6820/2910656480,v1:172.21.15.42:6821/2910656480] exists,up f48161cd-bc44-4d99-8248-1bb845111129 2024-08-26T00:02:09.836 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7 up in weight 1 up_from 46 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.43:6816/624542778,v1:172.21.15.43:6817/624542778] [v2:172.21.15.43:6818/624542778,v1:172.21.15.43:6819/624542778] exists,up 65470b06-b14d-4d8e-9bcb-e6927c37fda5 2024-08-26T00:02:09.836 INFO:teuthology.orchestra.run.smithi042.stdout:osd.8 up in weight 1 up_from 53 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6816/728226568,v1:172.21.15.181:6817/728226568] [v2:172.21.15.181:6818/728226568,v1:172.21.15.181:6819/728226568] exists,up 1f4c9152-4b7c-415f-9cb9-d1e926fad5ef 2024-08-26T00:02:09.836 INFO:teuthology.orchestra.run.smithi042.stdout:osd.9 up in weight 1 up_from 60 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6826/1052069444,v1:172.21.15.42:6827/1052069444] [v2:172.21.15.42:6828/1052069444,v1:172.21.15.42:6829/1052069444] exists,up fb387fbe-19b4-4a3e-8e40-81bd1363b55c 2024-08-26T00:02:09.836 INFO:teuthology.orchestra.run.smithi042.stdout:osd.10 up in weight 1 up_from 65 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.43:6824/3417487386,v1:172.21.15.43:6825/3417487386] [v2:172.21.15.43:6826/3417487386,v1:172.21.15.43:6827/3417487386] exists,up fe5bbeec-2341-4ea9-97ab-cc45d738d741 2024-08-26T00:02:09.836 INFO:teuthology.orchestra.run.smithi042.stdout:osd.11 up in weight 1 up_from 72 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6824/3817502913,v1:172.21.15.181:6825/3817502913] [v2:172.21.15.181:6826/3817502913,v1:172.21.15.181:6827/3817502913] exists,up cee07741-3ab7-481e-8477-54319f4f178a 2024-08-26T00:02:09.836 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 2.0 [8,4] 2024-08-26T00:02:09.836 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 2.5 [8,11] 2024-08-26T00:02:09.836 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 2.a [2,11] 2024-08-26T00:02:09.836 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 2.14 [2,4] 2024-08-26T00:02:09.837 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 3.0 [4,8] 2024-08-26T00:02:09.837 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 3.1 [4,9] 2024-08-26T00:02:09.837 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 3.10 [5,9] 2024-08-26T00:02:09.837 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 3.14 [4,6] 2024-08-26T00:02:09.837 INFO:teuthology.orchestra.run.smithi042.stdout:pg_upmap_items 3.2d [3,9] 2024-08-26T00:02:09.837 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:0/3711239085 expires 2024-08-26T23:53:05.122858+0000 2024-08-26T00:02:09.837 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:6801/723045064 expires 2024-08-26T23:53:32.406179+0000 2024-08-26T00:02:09.837 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:0/2983166615 expires 2024-08-26T23:53:05.122858+0000 2024-08-26T00:02:09.837 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:0/2974122891 expires 2024-08-26T23:53:32.406179+0000 2024-08-26T00:02:09.837 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:0/2980210051 expires 2024-08-26T23:53:05.122858+0000 2024-08-26T00:02:09.837 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:0/4227793902 expires 2024-08-26T23:53:32.406179+0000 2024-08-26T00:02:09.837 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:6801/1517739376 expires 2024-08-26T23:53:05.122858+0000 2024-08-26T00:02:09.837 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:6800/723045064 expires 2024-08-26T23:53:32.406179+0000 2024-08-26T00:02:09.837 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:0/1775009918 expires 2024-08-26T23:53:32.406179+0000 2024-08-26T00:02:09.838 INFO:teuthology.orchestra.run.smithi042.stdout:blocklist 172.21.15.42:6800/1517739376 expires 2024-08-26T23:53:05.122858+0000 2024-08-26T00:02:09.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.835+0000 7fd43ce00640 1 -- 172.21.15.42:0/225515605 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd41c0a2bb0 msgr2=0x7fd41c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:09.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.835+0000 7fd43ce00640 1 --2- 172.21.15.42:0/225515605 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd41c0a2bb0 0x7fd41c0a5070 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd43819b330 tx=0x7fd42400b390 comp rx=0 tx=0).stop 2024-08-26T00:02:09.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.836+0000 7fd43ce00640 1 -- 172.21.15.42:0/225515605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd438103ba0 msgr2=0x7fd438199e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:09.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.836+0000 7fd43ce00640 1 --2- 172.21.15.42:0/225515605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd438103ba0 0x7fd438199e10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd42800d950 tx=0x7fd42800de10 comp rx=0 tx=0).stop 2024-08-26T00:02:09.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.836+0000 7fd43ce00640 1 -- 172.21.15.42:0/225515605 shutdown_connections 2024-08-26T00:02:09.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.836+0000 7fd43ce00640 1 --2- 172.21.15.42:0/225515605 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd41c0a2bb0 0x7fd41c0a5070 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:09.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.836+0000 7fd43ce00640 1 --2- 172.21.15.42:0/225515605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd438105760 0x7fd4381a13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:09.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.836+0000 7fd43ce00640 1 --2- 172.21.15.42:0/225515605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd438104da0 0x7fd43819a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:09.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.836+0000 7fd43ce00640 1 --2- 172.21.15.42:0/225515605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd438103ba0 0x7fd438199e10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:09.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.836+0000 7fd43ce00640 1 -- 172.21.15.42:0/225515605 >> 172.21.15.42:0/225515605 conn(0x7fd4380ff350 msgr2=0x7fd4381080a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:09.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.836+0000 7fd43ce00640 1 -- 172.21.15.42:0/225515605 shutdown_connections 2024-08-26T00:02:09.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:09.836+0000 7fd43ce00640 1 -- 172.21.15.42:0/225515605 wait complete. 2024-08-26T00:02:10.489 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:10 smithi042 ceph-mon[17225]: pgmap v328: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-26T00:02:10.489 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:10 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/225515605' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-08-26T00:02:10.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:10 smithi043 ceph-mon[22091]: pgmap v328: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-26T00:02:10.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:10 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/225515605' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-08-26T00:02:10.527 INFO:teuthology.run_tasks:Running task fs.ready... 2024-08-26T00:02:10.578 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:02:10.578 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:10 smithi181 ceph-mon[22102]: pgmap v328: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-26T00:02:10.578 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:10 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/225515605' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-08-26T00:02:10.957 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:02:11.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.522+0000 7fd540400640 1 -- 172.21.15.42:0/2816397285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd538109c00 msgr2=0x7fd538109fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:11.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.522+0000 7fd540400640 1 --2- 172.21.15.42:0/2816397285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd538109c00 0x7fd538109fe0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009890 tx=0x7fd52c02a360 comp rx=0 tx=0).stop 2024-08-26T00:02:11.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.522+0000 7fd540400640 1 -- 172.21.15.42:0/2816397285 shutdown_connections 2024-08-26T00:02:11.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.522+0000 7fd540400640 1 --2- 172.21.15.42:0/2816397285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5381044f0 0x7fd5381109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:11.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.522+0000 7fd540400640 1 --2- 172.21.15.42:0/2816397285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd538103b50 0x7fd538103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:11.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.522+0000 7fd540400640 1 --2- 172.21.15.42:0/2816397285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd538109c00 0x7fd538109fe0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:11.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.522+0000 7fd540400640 1 -- 172.21.15.42:0/2816397285 >> 172.21.15.42:0/2816397285 conn(0x7fd5380ff830 msgr2=0x7fd538101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:11.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.522+0000 7fd540400640 1 -- 172.21.15.42:0/2816397285 shutdown_connections 2024-08-26T00:02:11.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.522+0000 7fd540400640 1 -- 172.21.15.42:0/2816397285 wait complete. 2024-08-26T00:02:11.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.523+0000 7fd540400640 1 Processor -- start 2024-08-26T00:02:11.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.523+0000 7fd540400640 1 -- start start 2024-08-26T00:02:11.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.523+0000 7fd540400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd538103b50 0x7fd53819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:11.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.524+0000 7fd540400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5381044f0 0x7fd53819a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:11.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.524+0000 7fd540400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd538109c00 0x7fd53819ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.524+0000 7fd540400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd538113f60 con 0x7fd538103b50 2024-08-26T00:02:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.524+0000 7fd540400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd538113de0 con 0x7fd5381044f0 2024-08-26T00:02:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.524+0000 7fd540400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd5381140e0 con 0x7fd538109c00 2024-08-26T00:02:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.524+0000 7fd53da00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd538103b50 0x7fd53819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.524+0000 7fd53da00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd538103b50 0x7fd53819a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58398/0 (socket says 172.21.15.42:58398) 2024-08-26T00:02:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.524+0000 7fd53da00640 1 -- 172.21.15.42:0/4164444397 learned_addr learned my addr 172.21.15.42:0/4164444397 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.524+0000 7fd53d000640 1 --2- 172.21.15.42:0/4164444397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5381044f0 0x7fd53819a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.524+0000 7fd53e400640 1 --2- 172.21.15.42:0/4164444397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd538109c00 0x7fd53819ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.524+0000 7fd53da00640 1 -- 172.21.15.42:0/4164444397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd538109c00 msgr2=0x7fd53819ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.524+0000 7fd53da00640 1 --2- 172.21.15.42:0/4164444397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd538109c00 0x7fd53819ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.524+0000 7fd53da00640 1 -- 172.21.15.42:0/4164444397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5381044f0 msgr2=0x7fd53819a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.524+0000 7fd53da00640 1 --2- 172.21.15.42:0/4164444397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5381044f0 0x7fd53819a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.524+0000 7fd53da00640 1 -- 172.21.15.42:0/4164444397 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd53819f310 con 0x7fd538103b50 2024-08-26T00:02:11.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.525+0000 7fd53da00640 1 --2- 172.21.15.42:0/4164444397 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd538103b50 0x7fd53819a360 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009860 tx=0x7fd52c033d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:11.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.525+0000 7fd536000640 1 -- 172.21.15.42:0/4164444397 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52c03f020 con 0x7fd538103b50 2024-08-26T00:02:11.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.525+0000 7fd536000640 1 -- 172.21.15.42:0/4164444397 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd52c032770 con 0x7fd538103b50 2024-08-26T00:02:11.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.525+0000 7fd540400640 1 -- 172.21.15.42:0/4164444397 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd53819f5a0 con 0x7fd538103b50 2024-08-26T00:02:11.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.525+0000 7fd536000640 1 -- 172.21.15.42:0/4164444397 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52c037040 con 0x7fd538103b50 2024-08-26T00:02:11.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.525+0000 7fd540400640 1 -- 172.21.15.42:0/4164444397 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5381a6ee0 con 0x7fd538103b50 2024-08-26T00:02:11.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.526+0000 7fd540400640 1 -- 172.21.15.42:0/4164444397 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd538105200 con 0x7fd538103b50 2024-08-26T00:02:11.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.528+0000 7fd536000640 1 -- 172.21.15.42:0/4164444397 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd52c042020 con 0x7fd538103b50 2024-08-26T00:02:11.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.530+0000 7fd536000640 1 --2- 172.21.15.42:0/4164444397 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd5200a2b80 0x7fd5200a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:11.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.530+0000 7fd536000640 1 -- 172.21.15.42:0/4164444397 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fd52c0ef110 con 0x7fd538103b50 2024-08-26T00:02:11.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.530+0000 7fd53d000640 1 --2- 172.21.15.42:0/4164444397 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd5200a2b80 0x7fd5200a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:11.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.531+0000 7fd53d000640 1 --2- 172.21.15.42:0/4164444397 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd5200a2b80 0x7fd5200a5040 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd538109200 tx=0x7fd524005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:11.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.534+0000 7fd536000640 1 -- 172.21.15.42:0/4164444397 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd52c049020 con 0x7fd538103b50 2024-08-26T00:02:11.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.757+0000 7fd540400640 1 -- 172.21.15.42:0/4164444397 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd53810c000 con 0x7fd538103b50 2024-08-26T00:02:11.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.758+0000 7fd536000640 1 -- 172.21.15.42:0/4164444397 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11909 (secure 0 0 0) 0x7fd52c0bc030 con 0x7fd538103b50 2024-08-26T00:02:11.758 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:02:11.758 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":23,"btime":"2024-08-26T00:00:42:404711+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3168581452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3168581452},{"type":"v1","addr":"172.21.15.42:6839","nonce":3168581452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/3533492491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":3533492491},{"type":"v1","addr":"172.21.15.42:6841","nonce":3533492491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-26T00:00:30.169633+0000","modified":"2024-08-26T00:00:42.314271+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24532,"mds_1":24527,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6839/2653014277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2653014277},{"type":"v1","addr":"172.21.15.43:6839","nonce":2653014277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24532,"qdb_cluster":[24514,24527,24532]},"id":1}]} 2024-08-26T00:02:11.759 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 23 2024-08-26T00:02:11.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.760+0000 7fd540400640 1 -- 172.21.15.42:0/4164444397 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd5200a2b80 msgr2=0x7fd5200a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:11.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.760+0000 7fd540400640 1 --2- 172.21.15.42:0/4164444397 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd5200a2b80 0x7fd5200a5040 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd538109200 tx=0x7fd524005f90 comp rx=0 tx=0).stop 2024-08-26T00:02:11.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.760+0000 7fd540400640 1 -- 172.21.15.42:0/4164444397 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd538103b50 msgr2=0x7fd53819a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:11.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.760+0000 7fd540400640 1 --2- 172.21.15.42:0/4164444397 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd538103b50 0x7fd53819a360 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009860 tx=0x7fd52c033d10 comp rx=0 tx=0).stop 2024-08-26T00:02:11.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.761+0000 7fd540400640 1 -- 172.21.15.42:0/4164444397 shutdown_connections 2024-08-26T00:02:11.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.761+0000 7fd540400640 1 --2- 172.21.15.42:0/4164444397 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd5200a2b80 0x7fd5200a5040 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:11.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.761+0000 7fd540400640 1 --2- 172.21.15.42:0/4164444397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd538109c00 0x7fd53819ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:11.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.761+0000 7fd540400640 1 --2- 172.21.15.42:0/4164444397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5381044f0 0x7fd53819a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:11.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.761+0000 7fd540400640 1 --2- 172.21.15.42:0/4164444397 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd538103b50 0x7fd53819a360 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:11.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.761+0000 7fd540400640 1 -- 172.21.15.42:0/4164444397 >> 172.21.15.42:0/4164444397 conn(0x7fd5380ff830 msgr2=0x7fd538100f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:11.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.761+0000 7fd540400640 1 -- 172.21.15.42:0/4164444397 shutdown_connections 2024-08-26T00:02:11.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:11.761+0000 7fd540400640 1 -- 172.21.15.42:0/4164444397 wait complete. 2024-08-26T00:02:12.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:12 smithi042 ceph-mon[17225]: pgmap v329: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-26T00:02:12.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:12 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/4164444397' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:02:12.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:12 smithi043 ceph-mon[22091]: pgmap v329: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-26T00:02:12.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:12 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/4164444397' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:02:12.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:12 smithi181 ceph-mon[22102]: pgmap v329: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-26T00:02:12.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:12 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/4164444397' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:02:12.604 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:02:12.983 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:02:13.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.506+0000 7f0037200640 1 -- 172.21.15.42:0/3647108470 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0030076de0 msgr2=0x7f0030112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:13.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.506+0000 7f0037200640 1 --2- 172.21.15.42:0/3647108470 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0030076de0 0x7f0030112290 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f001c009860 tx=0x7f001c02a340 comp rx=0 tx=0).stop 2024-08-26T00:02:13.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.506+0000 7f0037200640 1 -- 172.21.15.42:0/3647108470 shutdown_connections 2024-08-26T00:02:13.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.506+0000 7f0037200640 1 --2- 172.21.15.42:0/3647108470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00301127d0 0x7f0030114bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:13.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.506+0000 7f0037200640 1 --2- 172.21.15.42:0/3647108470 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0030076de0 0x7f0030112290 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:13.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.506+0000 7f0037200640 1 --2- 172.21.15.42:0/3647108470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00300764c0 0x7f00300768a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:13.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.506+0000 7f0037200640 1 -- 172.21.15.42:0/3647108470 >> 172.21.15.42:0/3647108470 conn(0x7f00300ff830 msgr2=0x7f0030101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:13.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.506+0000 7f0037200640 1 -- 172.21.15.42:0/3647108470 shutdown_connections 2024-08-26T00:02:13.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.506+0000 7f0037200640 1 -- 172.21.15.42:0/3647108470 wait complete. 2024-08-26T00:02:13.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.508+0000 7f0037200640 1 Processor -- start 2024-08-26T00:02:13.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.508+0000 7f0037200640 1 -- start start 2024-08-26T00:02:13.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.508+0000 7f0037200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00300764c0 0x7f00301a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:13.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.508+0000 7f0037200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0030076de0 0x7f00301a4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:13.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.508+0000 7f0037200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00301127d0 0x7f003019e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:13.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.508+0000 7f0037200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0030118340 con 0x7f00301127d0 2024-08-26T00:02:13.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.508+0000 7f0037200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f00301181c0 con 0x7f0030076de0 2024-08-26T00:02:13.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.508+0000 7f0037200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f00301184c0 con 0x7f00300764c0 2024-08-26T00:02:13.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.509+0000 7f0035200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00301127d0 0x7f003019e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:13.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.509+0000 7f0035200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00301127d0 0x7f003019e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58410/0 (socket says 172.21.15.42:58410) 2024-08-26T00:02:13.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.509+0000 7f0035200640 1 -- 172.21.15.42:0/521679895 learned_addr learned my addr 172.21.15.42:0/521679895 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:13.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.509+0000 7f002fe00640 1 --2- 172.21.15.42:0/521679895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00300764c0 0x7f00301a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:13.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.509+0000 7f002f400640 1 --2- 172.21.15.42:0/521679895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0030076de0 0x7f00301a4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:13.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.509+0000 7f0035200640 1 -- 172.21.15.42:0/521679895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00300764c0 msgr2=0x7f00301a4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:13.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.509+0000 7f0035200640 1 --2- 172.21.15.42:0/521679895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00300764c0 0x7f00301a4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:13.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.509+0000 7f0035200640 1 -- 172.21.15.42:0/521679895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0030076de0 msgr2=0x7f00301a4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:13.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.509+0000 7f0035200640 1 --2- 172.21.15.42:0/521679895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0030076de0 0x7f00301a4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:13.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.509+0000 7f0035200640 1 -- 172.21.15.42:0/521679895 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003019eec0 con 0x7f00301127d0 2024-08-26T00:02:13.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.509+0000 7f002f400640 1 --2- 172.21.15.42:0/521679895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0030076de0 0x7f00301a4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:13.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.510+0000 7f0035200640 1 --2- 172.21.15.42:0/521679895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00301127d0 0x7f003019e650 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0028009fd0 tx=0x7f002800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:13.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.510+0000 7f002cc00640 1 -- 172.21.15.42:0/521679895 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0028004d20 con 0x7f00301127d0 2024-08-26T00:02:13.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.510+0000 7f0037200640 1 -- 172.21.15.42:0/521679895 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f003019f1b0 con 0x7f00301127d0 2024-08-26T00:02:13.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.510+0000 7f002cc00640 1 -- 172.21.15.42:0/521679895 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0028005020 con 0x7f00301127d0 2024-08-26T00:02:13.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.510+0000 7f002cc00640 1 -- 172.21.15.42:0/521679895 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00280116d0 con 0x7f00301127d0 2024-08-26T00:02:13.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.510+0000 7f0037200640 1 -- 172.21.15.42:0/521679895 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00301ab330 con 0x7f00301127d0 2024-08-26T00:02:13.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.511+0000 7f0037200640 1 -- 172.21.15.42:0/521679895 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0030077c00 con 0x7f00301127d0 2024-08-26T00:02:13.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.513+0000 7f002cc00640 1 -- 172.21.15.42:0/521679895 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f00280051d0 con 0x7f00301127d0 2024-08-26T00:02:13.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.514+0000 7f002cc00640 1 --2- 172.21.15.42:0/521679895 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f00140a2b80 0x7f00140a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:13.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.515+0000 7f002cc00640 1 -- 172.21.15.42:0/521679895 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f00280cf540 con 0x7f00301127d0 2024-08-26T00:02:13.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.515+0000 7f002fe00640 1 --2- 172.21.15.42:0/521679895 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f00140a2b80 0x7f00140a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:13.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.515+0000 7f002fe00640 1 --2- 172.21.15.42:0/521679895 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f00140a2b80 0x7f00140a5040 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0020005fd0 tx=0x7f0020009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:13.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.519+0000 7f002cc00640 1 -- 172.21.15.42:0/521679895 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f0028016030 con 0x7f00301127d0 2024-08-26T00:02:13.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.743+0000 7f0037200640 1 -- 172.21.15.42:0/521679895 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00300768a0 con 0x7f00301127d0 2024-08-26T00:02:13.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.744+0000 7f002cc00640 1 -- 172.21.15.42:0/521679895 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11909 (secure 0 0 0) 0x7f00300768a0 con 0x7f00301127d0 2024-08-26T00:02:13.745 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 23 2024-08-26T00:02:13.745 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:02:13.746 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":23,"btime":"2024-08-26T00:00:42:404711+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3168581452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3168581452},{"type":"v1","addr":"172.21.15.42:6839","nonce":3168581452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/3533492491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":3533492491},{"type":"v1","addr":"172.21.15.42:6841","nonce":3533492491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-26T00:00:30.169633+0000","modified":"2024-08-26T00:00:42.314271+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24532,"mds_1":24527,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6839/2653014277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2653014277},{"type":"v1","addr":"172.21.15.43:6839","nonce":2653014277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24532,"qdb_cluster":[24514,24527,24532]},"id":1}]} 2024-08-26T00:02:13.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.747+0000 7f0037200640 1 -- 172.21.15.42:0/521679895 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f00140a2b80 msgr2=0x7f00140a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:13.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.747+0000 7f0037200640 1 --2- 172.21.15.42:0/521679895 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f00140a2b80 0x7f00140a5040 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0020005fd0 tx=0x7f0020009260 comp rx=0 tx=0).stop 2024-08-26T00:02:13.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.747+0000 7f0037200640 1 -- 172.21.15.42:0/521679895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00301127d0 msgr2=0x7f003019e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:13.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.747+0000 7f0037200640 1 --2- 172.21.15.42:0/521679895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00301127d0 0x7f003019e650 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0028009fd0 tx=0x7f002800eda0 comp rx=0 tx=0).stop 2024-08-26T00:02:13.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.747+0000 7f0037200640 1 -- 172.21.15.42:0/521679895 shutdown_connections 2024-08-26T00:02:13.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.747+0000 7f0037200640 1 --2- 172.21.15.42:0/521679895 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f00140a2b80 0x7f00140a5040 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:13.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.747+0000 7f0037200640 1 --2- 172.21.15.42:0/521679895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00301127d0 0x7f003019e650 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:13.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.747+0000 7f0037200640 1 --2- 172.21.15.42:0/521679895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0030076de0 0x7f00301a4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:13.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.747+0000 7f0037200640 1 --2- 172.21.15.42:0/521679895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00300764c0 0x7f00301a4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:13.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.747+0000 7f0037200640 1 -- 172.21.15.42:0/521679895 >> 172.21.15.42:0/521679895 conn(0x7f00300ff830 msgr2=0x7f0030101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:13.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.747+0000 7f0037200640 1 -- 172.21.15.42:0/521679895 shutdown_connections 2024-08-26T00:02:13.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:13.747+0000 7f0037200640 1 -- 172.21.15.42:0/521679895 wait complete. 2024-08-26T00:02:14.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:14 smithi043 ceph-mon[22091]: pgmap v330: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-26T00:02:14.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:14 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/521679895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:02:14.514 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:14 smithi042 ceph-mon[17225]: pgmap v330: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-26T00:02:14.515 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:14 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/521679895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:02:14.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:14 smithi181 ceph-mon[22102]: pgmap v330: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-26T00:02:14.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:14 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/521679895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:02:14.552 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd dump --format=json 2024-08-26T00:02:14.928 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:02:15.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.463+0000 7f1ebdc00640 1 -- 172.21.15.42:0/1430808068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb8104310 msgr2=0x7f1eb8110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:15.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.463+0000 7f1ebdc00640 1 --2- 172.21.15.42:0/1430808068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb8104310 0x7f1eb8110840 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0009cd0 tx=0x7f1eb002a8e0 comp rx=0 tx=0).stop 2024-08-26T00:02:15.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.463+0000 7f1ebdc00640 1 -- 172.21.15.42:0/1430808068 shutdown_connections 2024-08-26T00:02:15.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.463+0000 7f1ebdc00640 1 --2- 172.21.15.42:0/1430808068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb8104310 0x7f1eb8110840 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:15.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.463+0000 7f1ebdc00640 1 --2- 172.21.15.42:0/1430808068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1eb8103970 0x7f1eb8103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:15.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.463+0000 7f1ebdc00640 1 --2- 172.21.15.42:0/1430808068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1eb8109970 0x7f1eb8109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:15.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.463+0000 7f1ebdc00640 1 -- 172.21.15.42:0/1430808068 >> 172.21.15.42:0/1430808068 conn(0x7f1eb80ff670 msgr2=0x7f1eb8101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:15.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.464+0000 7f1ebdc00640 1 -- 172.21.15.42:0/1430808068 shutdown_connections 2024-08-26T00:02:15.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.464+0000 7f1ebdc00640 1 -- 172.21.15.42:0/1430808068 wait complete. 2024-08-26T00:02:15.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.465+0000 7f1ebdc00640 1 Processor -- start 2024-08-26T00:02:15.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.465+0000 7f1ebdc00640 1 -- start start 2024-08-26T00:02:15.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.465+0000 7f1ebdc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb8103970 0x7f1eb819a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:15.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.465+0000 7f1ebdc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1eb8104310 0x7f1eb819a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:15.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.465+0000 7f1ebdc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1eb8109970 0x7f1eb819eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:15.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.466+0000 7f1ebdc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb8113d70 con 0x7f1eb8103970 2024-08-26T00:02:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.466+0000 7f1ebdc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb8113bf0 con 0x7f1eb8104310 2024-08-26T00:02:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.466+0000 7f1ebdc00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb8113ef0 con 0x7f1eb8109970 2024-08-26T00:02:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.466+0000 7f1eb7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb8103970 0x7f1eb819a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.466+0000 7f1eafe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1eb8104310 0x7f1eb819a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.466+0000 7f1eb7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb8103970 0x7f1eb819a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55410/0 (socket says 172.21.15.42:55410) 2024-08-26T00:02:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.466+0000 7f1eb7e00640 1 -- 172.21.15.42:0/4195274759 learned_addr learned my addr 172.21.15.42:0/4195274759 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.466+0000 7f1ebd200640 1 --2- 172.21.15.42:0/4195274759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1eb8109970 0x7f1eb819eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.466+0000 7f1eb7e00640 1 -- 172.21.15.42:0/4195274759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1eb8109970 msgr2=0x7f1eb819eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.466+0000 7f1eb7e00640 1 --2- 172.21.15.42:0/4195274759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1eb8109970 0x7f1eb819eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.466+0000 7f1eb7e00640 1 -- 172.21.15.42:0/4195274759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1eb8104310 msgr2=0x7f1eb819a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.466+0000 7f1eb7e00640 1 --2- 172.21.15.42:0/4195274759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1eb8104310 0x7f1eb819a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.466+0000 7f1eb7e00640 1 -- 172.21.15.42:0/4195274759 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb819f1f0 con 0x7f1eb8103970 2024-08-26T00:02:15.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.466+0000 7f1eafe00640 1 --2- 172.21.15.42:0/4195274759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1eb8104310 0x7f1eb819a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:15.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.467+0000 7f1eb7e00640 1 --2- 172.21.15.42:0/4195274759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb8103970 0x7f1eb819a240 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1ea800e9f0 tx=0x7f1ea800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:15.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.467+0000 7f1eb5600640 1 -- 172.21.15.42:0/4195274759 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea800cd80 con 0x7f1eb8103970 2024-08-26T00:02:15.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.467+0000 7f1eb5600640 1 -- 172.21.15.42:0/4195274759 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ea8005500 con 0x7f1eb8103970 2024-08-26T00:02:15.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.467+0000 7f1ebdc00640 1 -- 172.21.15.42:0/4195274759 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb819f4e0 con 0x7f1eb8103970 2024-08-26T00:02:15.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.467+0000 7f1eb5600640 1 -- 172.21.15.42:0/4195274759 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8010690 con 0x7f1eb8103970 2024-08-26T00:02:15.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.467+0000 7f1ebdc00640 1 -- 172.21.15.42:0/4195274759 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eb81a6dc0 con 0x7f1eb8103970 2024-08-26T00:02:15.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.468+0000 7f1ebdc00640 1 -- 172.21.15.42:0/4195274759 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eb8103dd0 con 0x7f1eb8103970 2024-08-26T00:02:15.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.470+0000 7f1eb5600640 1 -- 172.21.15.42:0/4195274759 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1ea80046c0 con 0x7f1eb8103970 2024-08-26T00:02:15.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.471+0000 7f1eb5600640 1 --2- 172.21.15.42:0/4195274759 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1e9c0a2b80 0x7f1e9c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:15.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.472+0000 7f1eb5600640 1 -- 172.21.15.42:0/4195274759 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f1ea80cf420 con 0x7f1eb8103970 2024-08-26T00:02:15.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.472+0000 7f1eafe00640 1 --2- 172.21.15.42:0/4195274759 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1e9c0a2b80 0x7f1e9c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:15.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.472+0000 7f1eafe00640 1 --2- 172.21.15.42:0/4195274759 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1e9c0a2b80 0x7f1e9c0a5040 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8101c60 tx=0x7f1ea0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:15.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.475+0000 7f1eb5600640 1 -- 172.21.15.42:0/4195274759 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f1ea809c340 con 0x7f1eb8103970 2024-08-26T00:02:15.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.661+0000 7f1ebdc00640 1 -- 172.21.15.42:0/4195274759 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1eb819b5a0 con 0x7f1eb8103970 2024-08-26T00:02:15.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.663+0000 7f1eb5600640 1 -- 172.21.15.42:0/4195274759 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22625 (secure 0 0 0) 0x7f1ea809bc40 con 0x7f1eb8103970 2024-08-26T00:02:15.663 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:02:15.664 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":80,"fsid":"f89d317a-633c-11ef-bcd2-c7b262605968","created":"2024-08-25T23:52:39.598509+0000","modified":"2024-08-26T00:01:33.588911+0000","last_up_change":"2024-08-25T23:59:35.047575+0000","last_in_change":"2024-08-25T23:59:12.796940+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-25T23:55:51.022219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-26T00:00:25.606536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-26T00:00:28.322822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"980d8635-bca1-4c5a-b78e-4b44f9315d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6803","nonce":2657450248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6805","nonce":2657450248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6809","nonce":2657450248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6807","nonce":2657450248}]},"public_addr":"172.21.15.42:6803/2657450248","cluster_addr":"172.21.15.42:6805/2657450248","heartbeat_back_addr":"172.21.15.42:6809/2657450248","heartbeat_front_addr":"172.21.15.42:6807/2657450248","state":["exists","up"]},{"osd":1,"uuid":"e5f8dc3b-876a-4bdd-b6b0-b0d99d098d95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6801","nonce":2396081001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6803","nonce":2396081001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6807","nonce":2396081001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6805","nonce":2396081001}]},"public_addr":"172.21.15.43:6801/2396081001","cluster_addr":"172.21.15.43:6803/2396081001","heartbeat_back_addr":"172.21.15.43:6807/2396081001","heartbeat_front_addr":"172.21.15.43:6805/2396081001","state":["exists","up"]},{"osd":2,"uuid":"06eb25af-8e3d-4f90-bc24-28a9bc224c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6801","nonce":189987070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6803","nonce":189987070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6807","nonce":189987070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6805","nonce":189987070}]},"public_addr":"172.21.15.181:6801/189987070","cluster_addr":"172.21.15.181:6803/189987070","heartbeat_back_addr":"172.21.15.181:6807/189987070","heartbeat_front_addr":"172.21.15.181:6805/189987070","state":["exists","up"]},{"osd":3,"uuid":"c78dbc49-b5c7-4f82-be36-c76a89496520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6811","nonce":251017896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6813","nonce":251017896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6817","nonce":251017896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6815","nonce":251017896}]},"public_addr":"172.21.15.42:6811/251017896","cluster_addr":"172.21.15.42:6813/251017896","heartbeat_back_addr":"172.21.15.42:6817/251017896","heartbeat_front_addr":"172.21.15.42:6815/251017896","state":["exists","up"]},{"osd":4,"uuid":"ba633f66-25af-492f-bbf2-76032a4cd3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6809","nonce":1315420796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6811","nonce":1315420796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6815","nonce":1315420796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6813","nonce":1315420796}]},"public_addr":"172.21.15.43:6809/1315420796","cluster_addr":"172.21.15.43:6811/1315420796","heartbeat_back_addr":"172.21.15.43:6815/1315420796","heartbeat_front_addr":"172.21.15.43:6813/1315420796","state":["exists","up"]},{"osd":5,"uuid":"04e47ad9-21ba-43da-9793-d5cf83150dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6809","nonce":246971403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6811","nonce":246971403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6815","nonce":246971403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6813","nonce":246971403}]},"public_addr":"172.21.15.181:6809/246971403","cluster_addr":"172.21.15.181:6811/246971403","heartbeat_back_addr":"172.21.15.181:6815/246971403","heartbeat_front_addr":"172.21.15.181:6813/246971403","state":["exists","up"]},{"osd":6,"uuid":"f48161cd-bc44-4d99-8248-1bb845111129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6819","nonce":2910656480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6821","nonce":2910656480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6825","nonce":2910656480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6823","nonce":2910656480}]},"public_addr":"172.21.15.42:6819/2910656480","cluster_addr":"172.21.15.42:6821/2910656480","heartbeat_back_addr":"172.21.15.42:6825/2910656480","heartbeat_front_addr":"172.21.15.42:6823/2910656480","state":["exists","up"]},{"osd":7,"uuid":"65470b06-b14d-4d8e-9bcb-e6927c37fda5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6817","nonce":624542778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6819","nonce":624542778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6823","nonce":624542778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6821","nonce":624542778}]},"public_addr":"172.21.15.43:6817/624542778","cluster_addr":"172.21.15.43:6819/624542778","heartbeat_back_addr":"172.21.15.43:6823/624542778","heartbeat_front_addr":"172.21.15.43:6821/624542778","state":["exists","up"]},{"osd":8,"uuid":"1f4c9152-4b7c-415f-9cb9-d1e926fad5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6817","nonce":728226568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6819","nonce":728226568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6823","nonce":728226568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6821","nonce":728226568}]},"public_addr":"172.21.15.181:6817/728226568","cluster_addr":"172.21.15.181:6819/728226568","heartbeat_back_addr":"172.21.15.181:6823/728226568","heartbeat_front_addr":"172.21.15.181:6821/728226568","state":["exists","up"]},{"osd":9,"uuid":"fb387fbe-19b4-4a3e-8e40-81bd1363b55c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6827","nonce":1052069444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6829","nonce":1052069444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6833","nonce":1052069444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6831","nonce":1052069444}]},"public_addr":"172.21.15.42:6827/1052069444","cluster_addr":"172.21.15.42:6829/1052069444","heartbeat_back_addr":"172.21.15.42:6833/1052069444","heartbeat_front_addr":"172.21.15.42:6831/1052069444","state":["exists","up"]},{"osd":10,"uuid":"fe5bbeec-2341-4ea9-97ab-cc45d738d741","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6825","nonce":3417487386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6827","nonce":3417487386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6831","nonce":3417487386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6829","nonce":3417487386}]},"public_addr":"172.21.15.43:6825/3417487386","cluster_addr":"172.21.15.43:6827/3417487386","heartbeat_back_addr":"172.21.15.43:6831/3417487386","heartbeat_front_addr":"172.21.15.43:6829/3417487386","state":["exists","up"]},{"osd":11,"uuid":"cee07741-3ab7-481e-8477-54319f4f178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6825","nonce":3817502913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6827","nonce":3817502913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6831","nonce":3817502913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6829","nonce":3817502913}]},"public_addr":"172.21.15.181:6825/3817502913","cluster_addr":"172.21.15.181:6827/3817502913","heartbeat_back_addr":"172.21.15.181:6831/3817502913","heartbeat_front_addr":"172.21.15.181:6829/3817502913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:00.603592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:24.637326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:47.587859+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:14.978783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:39.025819+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:01.965471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:29.753475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:54.162377+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:17.970871+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:46.175576+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:10.590220+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:33.216701+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/3711239085":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6801/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2983166615":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/2974122891":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2980210051":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/4227793902":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6801/1517739376":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6800/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/1775009918":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6800/1517739376":"2024-08-26T23:53:05.122858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-26T00:02:15.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.666+0000 7f1ebdc00640 1 -- 172.21.15.42:0/4195274759 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1e9c0a2b80 msgr2=0x7f1e9c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:15.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.666+0000 7f1ebdc00640 1 --2- 172.21.15.42:0/4195274759 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1e9c0a2b80 0x7f1e9c0a5040 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8101c60 tx=0x7f1ea0005f90 comp rx=0 tx=0).stop 2024-08-26T00:02:15.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.666+0000 7f1ebdc00640 1 -- 172.21.15.42:0/4195274759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb8103970 msgr2=0x7f1eb819a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:15.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.666+0000 7f1ebdc00640 1 --2- 172.21.15.42:0/4195274759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb8103970 0x7f1eb819a240 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1ea800e9f0 tx=0x7f1ea800edf0 comp rx=0 tx=0).stop 2024-08-26T00:02:15.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.666+0000 7f1ebdc00640 1 -- 172.21.15.42:0/4195274759 shutdown_connections 2024-08-26T00:02:15.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.666+0000 7f1ebdc00640 1 --2- 172.21.15.42:0/4195274759 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1e9c0a2b80 0x7f1e9c0a5040 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:15.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.666+0000 7f1ebdc00640 1 --2- 172.21.15.42:0/4195274759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1eb8109970 0x7f1eb819eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:15.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.666+0000 7f1ebdc00640 1 --2- 172.21.15.42:0/4195274759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1eb8104310 0x7f1eb819a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:15.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.666+0000 7f1ebdc00640 1 --2- 172.21.15.42:0/4195274759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb8103970 0x7f1eb819a240 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:15.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.666+0000 7f1ebdc00640 1 -- 172.21.15.42:0/4195274759 >> 172.21.15.42:0/4195274759 conn(0x7f1eb80ff670 msgr2=0x7f1eb80fff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:15.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.666+0000 7f1ebdc00640 1 -- 172.21.15.42:0/4195274759 shutdown_connections 2024-08-26T00:02:15.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:15.666+0000 7f1ebdc00640 1 -- 172.21.15.42:0/4195274759 wait complete. 2024-08-26T00:02:16.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:16 smithi042 ceph-mon[17225]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-26T00:02:16.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:16 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/4195274759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:02:16.450 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-26T00:00:30.169633+0000', 'modified': '2024-08-26T00:00:42.314271+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24532, 'mds_1': 24527, 'mds_2': 24514}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24464': {'gid': 24464, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.43:6835/4195804691', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 4195804691}, {'type': 'v1', 'addr': '172.21.15.43:6835', 'nonce': 4195804691}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24494': {'gid': 24494, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.43:6837/2817851173', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6836', 'nonce': 2817851173}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 2817851173}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24502': {'gid': 24502, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6835/1496959020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 1496959020}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 1496959020}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24514': {'gid': 24514, 'name': 'c', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.181:6837/3332104552', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 3332104552}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 3332104552}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24527': {'gid': 24527, 'name': 'b', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.43:6839/2653014277', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6838', 'nonce': 2653014277}, {'type': 'v1', 'addr': '172.21.15.43:6839', 'nonce': 2653014277}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24532': {'gid': 24532, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.181:6839/351429985', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6838', 'nonce': 351429985}, {'type': 'v1', 'addr': '172.21.15.181:6839', 'nonce': 351429985}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24532, 'qdb_cluster': [24514, 24527, 24532]} 2024-08-26T00:02:16.450 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-08-26T00:02:16.450 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.c status 2024-08-26T00:02:16.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:16 smithi043 ceph-mon[22091]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-26T00:02:16.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:16 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/4195274759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:02:16.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:16 smithi181 ceph-mon[22102]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-26T00:02:16.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:16 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/4195274759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:02:16.829 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:02:17.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.375+0000 7f05fc200640 1 -- 172.21.15.42:0/2154962904 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05f4107930 msgr2=0x7f05f4107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:17.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.375+0000 7f05fc200640 1 --2- 172.21.15.42:0/2154962904 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05f4107930 0x7f05f4107d10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009cd0 tx=0x7f05e802a8e0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.375+0000 7f05fc200640 1 -- 172.21.15.42:0/2154962904 shutdown_connections 2024-08-26T00:02:17.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.375+0000 7f05fc200640 1 --2- 172.21.15.42:0/2154962904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05f41022d0 0x7f05f410e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.375+0000 7f05fc200640 1 --2- 172.21.15.42:0/2154962904 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05f4101930 0x7f05f4101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.375+0000 7f05fc200640 1 --2- 172.21.15.42:0/2154962904 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05f4107930 0x7f05f4107d10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.375+0000 7f05fc200640 1 -- 172.21.15.42:0/2154962904 >> 172.21.15.42:0/2154962904 conn(0x7f05f40fd650 msgr2=0x7f05f40ffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:17.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.375+0000 7f05fc200640 1 -- 172.21.15.42:0/2154962904 shutdown_connections 2024-08-26T00:02:17.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.375+0000 7f05fc200640 1 -- 172.21.15.42:0/2154962904 wait complete. 2024-08-26T00:02:17.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.376+0000 7f05fc200640 1 Processor -- start 2024-08-26T00:02:17.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.376+0000 7f05fc200640 1 -- start start 2024-08-26T00:02:17.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.377+0000 7f05fc200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05f4101930 0x7f05f419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:17.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.377+0000 7f05fc200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05f41022d0 0x7f05f419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:17.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.377+0000 7f05fc200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05f4107930 0x7f05f419ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:17.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.377+0000 7f05fc200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f05f4111d80 con 0x7f05f4101930 2024-08-26T00:02:17.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.377+0000 7f05fc200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f05f4111c00 con 0x7f05f41022d0 2024-08-26T00:02:17.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.377+0000 7f05fc200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f05f4111f00 con 0x7f05f4107930 2024-08-26T00:02:17.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.377+0000 7f05f8e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05f41022d0 0x7f05f419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:17.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.377+0000 7f05f9800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05f4101930 0x7f05f419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:17.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.377+0000 7f05f8e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05f41022d0 0x7f05f419a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:52072/0 (socket says 172.21.15.42:52072) 2024-08-26T00:02:17.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.377+0000 7f05f8e00640 1 -- 172.21.15.42:0/2375175342 learned_addr learned my addr 172.21.15.42:0/2375175342 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:17.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.377+0000 7f05fa200640 1 --2- 172.21.15.42:0/2375175342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05f4107930 0x7f05f419ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:17.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.378+0000 7f05f8e00640 1 -- 172.21.15.42:0/2375175342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05f4107930 msgr2=0x7f05f419ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:17.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.378+0000 7f05f8e00640 1 --2- 172.21.15.42:0/2375175342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05f4107930 0x7f05f419ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.378+0000 7f05f8e00640 1 -- 172.21.15.42:0/2375175342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05f4101930 msgr2=0x7f05f419a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:17.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.378+0000 7f05f8e00640 1 --2- 172.21.15.42:0/2375175342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05f4101930 0x7f05f419a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.378+0000 7f05f8e00640 1 -- 172.21.15.42:0/2375175342 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f419f420 con 0x7f05f41022d0 2024-08-26T00:02:17.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.378+0000 7f05f9800640 1 --2- 172.21.15.42:0/2375175342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05f4101930 0x7f05f419a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:17.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.378+0000 7f05f8e00640 1 --2- 172.21.15.42:0/2375175342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05f41022d0 0x7f05f419a9b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f05e000e9f0 tx=0x7f05e000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:17.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.378+0000 7f05f2000640 1 -- 172.21.15.42:0/2375175342 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e000cd80 con 0x7f05f41022d0 2024-08-26T00:02:17.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.378+0000 7f05fc200640 1 -- 172.21.15.42:0/2375175342 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05f419f710 con 0x7f05f41022d0 2024-08-26T00:02:17.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.378+0000 7f05f2000640 1 -- 172.21.15.42:0/2375175342 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05e0005500 con 0x7f05f41022d0 2024-08-26T00:02:17.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.378+0000 7f05f2000640 1 -- 172.21.15.42:0/2375175342 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e0010690 con 0x7f05f41022d0 2024-08-26T00:02:17.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.378+0000 7f05fc200640 1 -- 172.21.15.42:0/2375175342 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05f41a6ff0 con 0x7f05f41022d0 2024-08-26T00:02:17.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.381+0000 7f05f2000640 1 -- 172.21.15.42:0/2375175342 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f05e00046c0 con 0x7f05f41022d0 2024-08-26T00:02:17.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.381+0000 7f05fee7c740 1 Processor -- start 2024-08-26T00:02:17.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.382+0000 7f05fee7c740 1 -- start start 2024-08-26T00:02:17.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.382+0000 7f05fee7c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312215620 0x564312215a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:17.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.382+0000 7f05fee7c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215f40 0x5643122202c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:17.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.382+0000 7f05fee7c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564312220800 0x564312222bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:17.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.382+0000 7f05fee7c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56431217bdb0 con 0x564312215f40 2024-08-26T00:02:17.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.382+0000 7f05fee7c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5643121134a0 con 0x564312220800 2024-08-26T00:02:17.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.382+0000 7f05fee7c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564312177d70 con 0x564312215620 2024-08-26T00:02:17.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.382+0000 7f05f9800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215f40 0x5643122202c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:17.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.382+0000 7f05f9800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215f40 0x5643122202c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55442/0 (socket says 172.21.15.42:55442) 2024-08-26T00:02:17.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.382+0000 7f05f9800640 1 -- 172.21.15.42:0/3444907344 learned_addr learned my addr 172.21.15.42:0/3444907344 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:17.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.382+0000 7f05fa200640 1 --2- 172.21.15.42:0/3444907344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312215620 0x564312215a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:17.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.382+0000 7f05f8e00640 1 --2- 172.21.15.42:0/3444907344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564312220800 0x564312222bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:17.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.383+0000 7f05fa200640 1 -- 172.21.15.42:0/3444907344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564312220800 msgr2=0x564312222bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:17.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.383+0000 7f05fa200640 1 --2- 172.21.15.42:0/3444907344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564312220800 0x564312222bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.383+0000 7f05fa200640 1 -- 172.21.15.42:0/3444907344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215f40 msgr2=0x5643122202c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:17.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.383+0000 7f05fa200640 1 --2- 172.21.15.42:0/3444907344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215f40 0x5643122202c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.383+0000 7f05fa200640 1 -- 172.21.15.42:0/3444907344 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564311eed2b0 con 0x564312215620 2024-08-26T00:02:17.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.383+0000 7f05f9800640 1 --2- 172.21.15.42:0/3444907344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215f40 0x5643122202c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:17.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.383+0000 7f05f2000640 1 --2- 172.21.15.42:0/2375175342 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f05dc0a2b80 0x7f05dc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:17.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.383+0000 7f05fa200640 1 --2- 172.21.15.42:0/3444907344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312215620 0x564312215a00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f05ec004530 tx=0x7f05ec00ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2641bd82b324833 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:17.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.383+0000 7f05f2000640 1 -- 172.21.15.42:0/2375175342 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f05e00cf460 con 0x7f05f41022d0 2024-08-26T00:02:17.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.383+0000 7f05f9800640 1 --2- 172.21.15.42:0/2375175342 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f05dc0a2b80 0x7f05dc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:17.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.383+0000 7f05e6a00640 1 -- 172.21.15.42:0/3444907344 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec003ad0 con 0x564312215620 2024-08-26T00:02:17.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.383+0000 7f05e6a00640 1 -- 172.21.15.42:0/3444907344 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05ec015070 con 0x564312215620 2024-08-26T00:02:17.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.383+0000 7f05e6a00640 1 -- 172.21.15.42:0/3444907344 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec0106a0 con 0x564312215620 2024-08-26T00:02:17.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.384+0000 7f05fee7c740 1 -- 172.21.15.42:0/3444907344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312215620 msgr2=0x564312215a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:17.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.384+0000 7f05f9800640 1 --2- 172.21.15.42:0/2375175342 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f05dc0a2b80 0x7f05dc0a5040 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f05e8006010 tx=0x7f05e803d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:17.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.384+0000 7f05fee7c740 1 --2- 172.21.15.42:0/3444907344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312215620 0x564312215a00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f05ec004530 tx=0x7f05ec00ba50 comp rx=0 tx=0).stop 2024-08-26T00:02:17.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.384+0000 7f05fee7c740 1 -- 172.21.15.42:0/3444907344 shutdown_connections 2024-08-26T00:02:17.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.384+0000 7f05fee7c740 1 --2- 172.21.15.42:0/3444907344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564312220800 0x564312222bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.384+0000 7f05fee7c740 1 --2- 172.21.15.42:0/3444907344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215f40 0x5643122202c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.384+0000 7f05fee7c740 1 --2- 172.21.15.42:0/3444907344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312215620 0x564312215a00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.384+0000 7f05fee7c740 1 -- 172.21.15.42:0/3444907344 >> 172.21.15.42:0/3444907344 conn(0x564312211bb0 msgr2=0x564312211f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:17.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.384+0000 7f05fee7c740 1 -- 172.21.15.42:0/3444907344 shutdown_connections 2024-08-26T00:02:17.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.384+0000 7f05fee7c740 1 -- 172.21.15.42:0/3444907344 wait complete. 2024-08-26T00:02:17.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.385+0000 7f05fee7c740 1 -- start start 2024-08-26T00:02:17.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.385+0000 7f05fee7c740 1 Processor -- start 2024-08-26T00:02:17.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.386+0000 7f05fee7c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215620 0x56431221d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.386+0000 7f05fee7c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312215f40 0x56431221dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.386+0000 7f05fee7c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564312220800 0x56431221e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.386+0000 7f05fee7c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5643122233d0 con 0x564312215620 2024-08-26T00:02:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.386+0000 7f05fee7c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564312136bf0 con 0x564312220800 2024-08-26T00:02:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.386+0000 7f05fee7c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564312223550 con 0x564312215f40 2024-08-26T00:02:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.386+0000 7f05fee7c740 10 client.0 _ll_register_callbacks cb 0x564312122dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:02:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.386+0000 7f05f9800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215620 0x56431221d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.386+0000 7f05f9800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215620 0x56431221d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55454/0 (socket says 172.21.15.42:55454) 2024-08-26T00:02:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.386+0000 7f05f9800640 1 -- 172.21.15.42:0/2327755294 learned_addr learned my addr 172.21.15.42:0/2327755294 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.386+0000 7f05fa200640 1 --2- 172.21.15.42:0/2327755294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564312220800 0x56431221e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.386+0000 7f05f8e00640 1 --2- 172.21.15.42:0/2327755294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312215f40 0x56431221dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.386+0000 7f05fa200640 1 -- 172.21.15.42:0/2327755294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312215f40 msgr2=0x56431221dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:17.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.386+0000 7f05fa200640 1 --2- 172.21.15.42:0/2327755294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312215f40 0x56431221dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.386+0000 7f05fa200640 1 -- 172.21.15.42:0/2327755294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215620 msgr2=0x56431221d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:17.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.386+0000 7f05fa200640 1 --2- 172.21.15.42:0/2327755294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215620 0x56431221d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.386+0000 7f05fa200640 1 -- 172.21.15.42:0/2327755294 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56431222c920 con 0x564312220800 2024-08-26T00:02:17.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.387+0000 7f05fa200640 1 --2- 172.21.15.42:0/2327755294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564312220800 0x56431221e150 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f05ec000c00 tx=0x7f05ec0119c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8a5b4342b1fbf45 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:17.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.387+0000 7f05db400640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:02:17.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.387+0000 7f05db400640 1 -- 172.21.15.42:0/2327755294 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec011650 con 0x564312220800 2024-08-26T00:02:17.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.387+0000 7f05db400640 1 -- 172.21.15.42:0/2327755294 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f05ec0038d0 con 0x564312220800 2024-08-26T00:02:17.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.387+0000 7f05fee7c740 1 -- 172.21.15.42:0/2327755294 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05ec015070 con 0x564312220800 2024-08-26T00:02:17.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.387+0000 7f05db400640 1 -- 172.21.15.42:0/2327755294 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f05ec0117f0 con 0x564312220800 2024-08-26T00:02:17.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.387+0000 7f05fee7c740 10 client.24989 fetch_fsmap learned FSMap version 23 2024-08-26T00:02:17.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.387+0000 7f05fee7c740 1 -- 172.21.15.42:0/2327755294 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x56431222f290 con 0x564312220800 2024-08-26T00:02:17.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.388+0000 7f05db400640 1 -- 172.21.15.42:0/2327755294 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05ec015070 con 0x564312220800 2024-08-26T00:02:17.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.388+0000 7f05db400640 1 -- 172.21.15.42:0/2327755294 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f05ec02e050 con 0x564312220800 2024-08-26T00:02:17.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.388+0000 7f05fee7c740 10 client.24989 fetch_fsmap finished waiting for FSMap version 23 2024-08-26T00:02:17.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.388+0000 7f05fee7c740 10 client.24989 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-26T00:02:17.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.388+0000 7f05fee7c740 20 client.24989 populate_metadata read hostname 'smithi042' 2024-08-26T00:02:17.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.388+0000 7f05fee7c740 1 --2- 172.21.15.42:0/2327755294 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x5643122314b0 0x564312232920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:17.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.388+0000 7f05fee7c740 4 client.24989 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:02:17.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.388+0000 7f05fee7c740 1 -- 172.21.15.42:0/2327755294 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564312189320 con 0x5643122314b0 2024-08-26T00:02:17.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.388+0000 7f05f9800640 1 --2- 172.21.15.42:0/2327755294 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x5643122314b0 0x564312232920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:17.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.389+0000 7f05f9800640 1 --2- 172.21.15.42:0/2327755294 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x5643122314b0 0x564312232920 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=949e9c761fec0019 server_cookie=a41524ef4005af95 in_seq=0 out_seq=0 2024-08-26T00:02:17.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.389+0000 7f05db400640 10 client.24989 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:02:17.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.390+0000 7f05db400640 1 -- 172.21.15.42:0/2327755294 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564312189320 con 0x5643122314b0 2024-08-26T00:02:17.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.390+0000 7f05db400640 10 client.24989 handle_command_reply: tid=0 2024-08-26T00:02:17.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.390+0000 7f05fee7c740 1 client.24989 shutdown 2024-08-26T00:02:17.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.390+0000 7f05fee7c740 1 -- 172.21.15.42:0/2327755294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564312220800 msgr2=0x56431221e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:17.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.390+0000 7f05fee7c740 1 --2- 172.21.15.42:0/2327755294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564312220800 0x56431221e150 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f05ec000c00 tx=0x7f05ec0119c0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.390+0000 7f05fee7c740 1 -- 172.21.15.42:0/2327755294 shutdown_connections 2024-08-26T00:02:17.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.390+0000 7f05fee7c740 1 --2- 172.21.15.42:0/2327755294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564312220800 0x56431221e150 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.390+0000 7f05fee7c740 1 --2- 172.21.15.42:0/2327755294 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x5643122314b0 0x564312232920 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.390+0000 7f05fee7c740 1 --2- 172.21.15.42:0/2327755294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312215f40 0x56431221dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.390+0000 7f05fee7c740 1 --2- 172.21.15.42:0/2327755294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215620 0x56431221d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.390+0000 7f05fee7c740 1 -- 172.21.15.42:0/2327755294 >> 172.21.15.42:0/2327755294 conn(0x564312211bb0 msgr2=0x5643122178e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:17.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.390+0000 7f05db400640 0 client.24989 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:02:17.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.390+0000 7f05fee7c740 1 -- 172.21.15.42:0/2327755294 shutdown_connections 2024-08-26T00:02:17.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.390+0000 7f05fee7c740 1 -- 172.21.15.42:0/2327755294 wait complete. 2024-08-26T00:02:17.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.390+0000 7f05fee7c740 20 client.24989 trim_cache size 0 max 16384 2024-08-26T00:02:17.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.409+0000 7f05fee7c740 1 Processor -- start 2024-08-26T00:02:17.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.409+0000 7f05fee7c740 1 -- start start 2024-08-26T00:02:17.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.409+0000 7f05fee7c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312215620 0x564312230de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:17.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.409+0000 7f05fee7c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215f40 0x564312232920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:17.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.409+0000 7f05fee7c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564312220800 0x5643122306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:17.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.409+0000 7f05fee7c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564312230c60 con 0x564312215f40 2024-08-26T00:02:17.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.409+0000 7f05fee7c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564312231330 con 0x564312220800 2024-08-26T00:02:17.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.409+0000 7f05fee7c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564312231a00 con 0x564312215620 2024-08-26T00:02:17.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.410+0000 7f05f9800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312215620 0x564312230de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:17.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.410+0000 7f05f8e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215f40 0x564312232920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:17.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.410+0000 7f05f9800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312215620 0x564312230de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:37418/0 (socket says 172.21.15.42:37418) 2024-08-26T00:02:17.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.410+0000 7f05f9800640 1 -- 172.21.15.42:0/1245507154 learned_addr learned my addr 172.21.15.42:0/1245507154 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:17.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.410+0000 7f05fa200640 1 --2- 172.21.15.42:0/1245507154 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564312220800 0x5643122306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:17.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.410+0000 7f05f9800640 1 -- 172.21.15.42:0/1245507154 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564312220800 msgr2=0x5643122306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:17.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.410+0000 7f05f9800640 1 --2- 172.21.15.42:0/1245507154 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564312220800 0x5643122306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.410+0000 7f05f9800640 1 -- 172.21.15.42:0/1245507154 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215f40 msgr2=0x564312232920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:17.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.410+0000 7f05f9800640 1 --2- 172.21.15.42:0/1245507154 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215f40 0x564312232920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.410+0000 7f05f9800640 1 -- 172.21.15.42:0/1245507154 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564312215d70 con 0x564312215620 2024-08-26T00:02:17.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.410+0000 7f05fa200640 1 --2- 172.21.15.42:0/1245507154 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564312220800 0x5643122306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:02:17.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.410+0000 7f05f8e00640 1 --2- 172.21.15.42:0/1245507154 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215f40 0x564312232920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:17.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.410+0000 7f05f9800640 1 --2- 172.21.15.42:0/1245507154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312215620 0x564312230de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f05e802ae00 tx=0x7f05e8041000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=828d5d9813c42765 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:17.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.411+0000 7f05e6000640 1 -- 172.21.15.42:0/1245507154 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8004750 con 0x564312215620 2024-08-26T00:02:17.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.411+0000 7f05e6000640 1 -- 172.21.15.42:0/1245507154 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05e8036040 con 0x564312215620 2024-08-26T00:02:17.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.411+0000 7f05e6000640 1 -- 172.21.15.42:0/1245507154 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8030a30 con 0x564312215620 2024-08-26T00:02:17.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.411+0000 7f05fee7c740 1 -- 172.21.15.42:0/1245507154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312215620 msgr2=0x564312230de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:17.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.411+0000 7f05fee7c740 1 --2- 172.21.15.42:0/1245507154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312215620 0x564312230de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f05e802ae00 tx=0x7f05e8041000 comp rx=0 tx=0).stop 2024-08-26T00:02:17.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.411+0000 7f05fee7c740 1 -- 172.21.15.42:0/1245507154 shutdown_connections 2024-08-26T00:02:17.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.411+0000 7f05fee7c740 1 --2- 172.21.15.42:0/1245507154 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564312220800 0x5643122306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.411+0000 7f05fee7c740 1 --2- 172.21.15.42:0/1245507154 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215f40 0x564312232920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.411+0000 7f05fee7c740 1 --2- 172.21.15.42:0/1245507154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312215620 0x564312230de0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.411+0000 7f05fee7c740 1 -- 172.21.15.42:0/1245507154 >> 172.21.15.42:0/1245507154 conn(0x564312211bb0 msgr2=0x56431221bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:17.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.411+0000 7f05fee7c740 1 -- 172.21.15.42:0/1245507154 shutdown_connections 2024-08-26T00:02:17.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.411+0000 7f05fee7c740 1 -- 172.21.15.42:0/1245507154 wait complete. 2024-08-26T00:02:17.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.412+0000 7f05fee7c740 1 -- start start 2024-08-26T00:02:17.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.412+0000 7f05fee7c740 1 Processor -- start 2024-08-26T00:02:17.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.412+0000 7f05fee7c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215620 0x5643122340e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:17.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.412+0000 7f05fee7c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564312215f40 0x564312234620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:17.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.412+0000 7f05fee7c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312220800 0x564312299bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:17.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.412+0000 7f05fee7c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5643122327a0 con 0x564312215620 2024-08-26T00:02:17.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.412+0000 7f05fee7c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5643122320d0 con 0x564312215f40 2024-08-26T00:02:17.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.412+0000 7f05fee7c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564312232e70 con 0x564312220800 2024-08-26T00:02:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.413+0000 7f05fee7c740 10 client.0 _ll_register_callbacks cb 0x7f05ec0043b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:02:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.413+0000 7f05f9800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215620 0x5643122340e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.413+0000 7f05fa200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312220800 0x564312299bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.413+0000 7f05f8e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564312215f40 0x564312234620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.413+0000 7f05fa200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312220800 0x564312299bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:37428/0 (socket says 172.21.15.42:37428) 2024-08-26T00:02:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.413+0000 7f05fa200640 1 -- 172.21.15.42:0/1848461444 learned_addr learned my addr 172.21.15.42:0/1848461444 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.413+0000 7f05fa200640 1 -- 172.21.15.42:0/1848461444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564312215f40 msgr2=0x564312234620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.413+0000 7f05fa200640 1 --2- 172.21.15.42:0/1848461444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564312215f40 0x564312234620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.413+0000 7f05fa200640 1 -- 172.21.15.42:0/1848461444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215620 msgr2=0x5643122340e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.413+0000 7f05fa200640 1 --2- 172.21.15.42:0/1848461444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215620 0x5643122340e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.413+0000 7f05fa200640 1 -- 172.21.15.42:0/1848461444 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56431229a0f0 con 0x564312220800 2024-08-26T00:02:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.413+0000 7f05f8e00640 1 --2- 172.21.15.42:0/1848461444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564312215f40 0x564312234620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.413+0000 7f05fa200640 1 --2- 172.21.15.42:0/1848461444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312220800 0x564312299bb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f05ec004290 tx=0x7f05ec005350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acae0bea7a6b2f9a server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.413+0000 7f05db400640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:02:17.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.414+0000 7f05db400640 1 -- 172.21.15.42:0/1848461444 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec033070 con 0x564312220800 2024-08-26T00:02:17.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.414+0000 7f05fee7c740 1 -- 172.21.15.42:0/1848461444 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05e8036040 con 0x564312220800 2024-08-26T00:02:17.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.414+0000 7f05db400640 1 -- 172.21.15.42:0/1848461444 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f05ec01a680 con 0x564312220800 2024-08-26T00:02:17.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.414+0000 7f05db400640 1 -- 172.21.15.42:0/1848461444 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f05ec03e050 con 0x564312220800 2024-08-26T00:02:17.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.414+0000 7f05fee7c740 10 client.25021 fetch_fsmap learned FSMap version 23 2024-08-26T00:02:17.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.414+0000 7f05fee7c740 1 -- 172.21.15.42:0/1848461444 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x56431229b2d0 con 0x564312220800 2024-08-26T00:02:17.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.414+0000 7f05db400640 1 -- 172.21.15.42:0/1848461444 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05e8036040 con 0x564312220800 2024-08-26T00:02:17.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.414+0000 7f05db400640 1 -- 172.21.15.42:0/1848461444 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f05ec02e040 con 0x564312220800 2024-08-26T00:02:17.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.415+0000 7f05fee7c740 10 client.25021 fetch_fsmap finished waiting for FSMap version 23 2024-08-26T00:02:17.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.415+0000 7f05fee7c740 10 client.25021 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-26T00:02:17.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.415+0000 7f05fee7c740 20 client.25021 populate_metadata read hostname 'smithi042' 2024-08-26T00:02:17.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.415+0000 7f05fee7c740 1 --2- 172.21.15.42:0/1848461444 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x56431229fe50 0x56431229eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:17.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.415+0000 7f05fee7c740 4 client.25021 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-26T00:02:17.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.415+0000 7f05fee7c740 1 -- 172.21.15.42:0/1848461444 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "status"}) -- 0x564312183830 con 0x56431229fe50 2024-08-26T00:02:17.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.415+0000 7f05f9800640 1 --2- 172.21.15.42:0/1848461444 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x56431229fe50 0x56431229eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:17.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.415+0000 7f05f9800640 1 --2- 172.21.15.42:0/1848461444 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x56431229fe50 0x56431229eb60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=52476dc5d5d3683b server_cookie=d06fe57902c8a645 in_seq=0 out_seq=0 2024-08-26T00:02:17.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.415+0000 7f05db400640 10 client.25021 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:02:17.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.416+0000 7f05db400640 1 -- 172.21.15.42:0/1848461444 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x564312183830 con 0x56431229fe50 2024-08-26T00:02:17.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.416+0000 7f05db400640 10 client.25021 handle_command_reply: tid=0 2024-08-26T00:02:17.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.416+0000 7f05fee7c740 1 client.25021 shutdown 2024-08-26T00:02:17.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.416+0000 7f05fee7c740 1 -- 172.21.15.42:0/1848461444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312220800 msgr2=0x564312299bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:17.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.416+0000 7f05fee7c740 1 --2- 172.21.15.42:0/1848461444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312220800 0x564312299bb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f05ec004290 tx=0x7f05ec005350 comp rx=0 tx=0).stop 2024-08-26T00:02:17.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.416+0000 7f05fee7c740 1 -- 172.21.15.42:0/1848461444 shutdown_connections 2024-08-26T00:02:17.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.416+0000 7f05fee7c740 1 --2- 172.21.15.42:0/1848461444 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x56431229fe50 0x56431229eb60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.416+0000 7f05fee7c740 1 --2- 172.21.15.42:0/1848461444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564312220800 0x564312299bb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.416+0000 7f05fee7c740 1 --2- 172.21.15.42:0/1848461444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564312215f40 0x564312234620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.416+0000 7f05fee7c740 1 --2- 172.21.15.42:0/1848461444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564312215620 0x5643122340e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.416+0000 7f05fee7c740 1 -- 172.21.15.42:0/1848461444 >> 172.21.15.42:0/1848461444 conn(0x564312211bb0 msgr2=0x56431221ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:17.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.416+0000 7f05db400640 0 client.25021 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:02:17.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.416+0000 7f05fee7c740 1 -- 172.21.15.42:0/1848461444 shutdown_connections 2024-08-26T00:02:17.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.416+0000 7f05fee7c740 1 -- 172.21.15.42:0/1848461444 wait complete. 2024-08-26T00:02:17.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.416+0000 7f05fee7c740 20 client.25021 trim_cache size 0 max 16384 2024-08-26T00:02:17.422 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:02:17.422 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "f89d317a-633c-11ef-bcd2-c7b262605968", 2024-08-26T00:02:17.422 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 2, 2024-08-26T00:02:17.422 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24514, 2024-08-26T00:02:17.422 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-08-26T00:02:17.422 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-08-26T00:02:17.423 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-08-26T00:02:17.423 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 98.019242939999998, 2024-08-26T00:02:17.423 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 23, 2024-08-26T00:02:17.423 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 80, 2024-08-26T00:02:17.423 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 78, 2024-08-26T00:02:17.423 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 133.837626051 2024-08-26T00:02:17.423 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:02:17.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.417+0000 7f05fc200640 1 -- 172.21.15.42:0/2375175342 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f05dc0a2b80 msgr2=0x7f05dc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:17.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.417+0000 7f05fc200640 1 --2- 172.21.15.42:0/2375175342 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f05dc0a2b80 0x7f05dc0a5040 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f05e8006010 tx=0x7f05e803d040 comp rx=0 tx=0).stop 2024-08-26T00:02:17.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.417+0000 7f05fc200640 1 -- 172.21.15.42:0/2375175342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05f41022d0 msgr2=0x7f05f419a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:17.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.417+0000 7f05fc200640 1 --2- 172.21.15.42:0/2375175342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05f41022d0 0x7f05f419a9b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f05e000e9f0 tx=0x7f05e000edf0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.417+0000 7f05fc200640 1 -- 172.21.15.42:0/2375175342 shutdown_connections 2024-08-26T00:02:17.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.417+0000 7f05fc200640 1 --2- 172.21.15.42:0/2375175342 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f05dc0a2b80 0x7f05dc0a5040 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.417+0000 7f05fc200640 1 --2- 172.21.15.42:0/2375175342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05f4107930 0x7f05f419ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.417+0000 7f05fc200640 1 --2- 172.21.15.42:0/2375175342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05f41022d0 0x7f05f419a9b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.417+0000 7f05fc200640 1 --2- 172.21.15.42:0/2375175342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05f4101930 0x7f05f419a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:17.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.417+0000 7f05fc200640 1 -- 172.21.15.42:0/2375175342 >> 172.21.15.42:0/2375175342 conn(0x7f05f40fd650 msgr2=0x7f05f410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:17.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.417+0000 7f05fc200640 1 -- 172.21.15.42:0/2375175342 shutdown_connections 2024-08-26T00:02:17.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:17.417+0000 7f05fc200640 1 -- 172.21.15.42:0/2375175342 wait complete. 2024-08-26T00:02:18.120 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.b status 2024-08-26T00:02:18.498 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:02:18.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:18 smithi043 ceph-mon[22091]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-26T00:02:18.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:18 smithi042 ceph-mon[17225]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-26T00:02:18.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:18 smithi181 ceph-mon[22102]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-26T00:02:19.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.006+0000 7f34be400640 1 -- 172.21.15.42:0/473639387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34b8109c00 msgr2=0x7f34b8109fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:19.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.006+0000 7f34be400640 1 --2- 172.21.15.42:0/473639387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34b8109c00 0x7f34b8109fe0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009cd0 tx=0x7f34a802a8f0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.006+0000 7f34be400640 1 -- 172.21.15.42:0/473639387 shutdown_connections 2024-08-26T00:02:19.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.006+0000 7f34be400640 1 --2- 172.21.15.42:0/473639387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34b81044f0 0x7f34b81109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.006+0000 7f34be400640 1 --2- 172.21.15.42:0/473639387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34b8103b50 0x7f34b8103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.006+0000 7f34be400640 1 --2- 172.21.15.42:0/473639387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34b8109c00 0x7f34b8109fe0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.006+0000 7f34be400640 1 -- 172.21.15.42:0/473639387 >> 172.21.15.42:0/473639387 conn(0x7f34b80ff830 msgr2=0x7f34b8101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:19.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.006+0000 7f34be400640 1 -- 172.21.15.42:0/473639387 shutdown_connections 2024-08-26T00:02:19.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.006+0000 7f34be400640 1 -- 172.21.15.42:0/473639387 wait complete. 2024-08-26T00:02:19.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.007+0000 7f34be400640 1 Processor -- start 2024-08-26T00:02:19.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.007+0000 7f34be400640 1 -- start start 2024-08-26T00:02:19.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.007+0000 7f34be400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34b8103b50 0x7f34b819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:19.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.007+0000 7f34be400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34b81044f0 0x7f34b819a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:19.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.007+0000 7f34be400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34b8109c00 0x7f34b819ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:19.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.007+0000 7f34be400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f34b8113f60 con 0x7f34b8103b50 2024-08-26T00:02:19.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.008+0000 7f34be400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f34b8113de0 con 0x7f34b81044f0 2024-08-26T00:02:19.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.008+0000 7f34be400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f34b81140e0 con 0x7f34b8109c00 2024-08-26T00:02:19.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.008+0000 7f34b7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34b8103b50 0x7f34b819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:19.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.008+0000 7f34b7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34b8103b50 0x7f34b819a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55486/0 (socket says 172.21.15.42:55486) 2024-08-26T00:02:19.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.008+0000 7f34b7400640 1 -- 172.21.15.42:0/85724374 learned_addr learned my addr 172.21.15.42:0/85724374 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:19.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.008+0000 7f34aea00640 1 --2- 172.21.15.42:0/85724374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34b81044f0 0x7f34b819a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:19.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.008+0000 7f34b7e00640 1 --2- 172.21.15.42:0/85724374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34b8109c00 0x7f34b819ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:19.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.008+0000 7f34b7400640 1 -- 172.21.15.42:0/85724374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34b8109c00 msgr2=0x7f34b819ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:19.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.008+0000 7f34b7400640 1 --2- 172.21.15.42:0/85724374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34b8109c00 0x7f34b819ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.008+0000 7f34b7400640 1 -- 172.21.15.42:0/85724374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34b81044f0 msgr2=0x7f34b819a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:19.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.008+0000 7f34b7400640 1 --2- 172.21.15.42:0/85724374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34b81044f0 0x7f34b819a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.008+0000 7f34b7400640 1 -- 172.21.15.42:0/85724374 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b819f3f0 con 0x7f34b8103b50 2024-08-26T00:02:19.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.009+0000 7f34b7400640 1 --2- 172.21.15.42:0/85724374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34b8103b50 0x7f34b819a440 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009df0 tx=0x7f34a8030ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:19.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.009+0000 7f34b4c00640 1 -- 172.21.15.42:0/85724374 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a8003d80 con 0x7f34b8103b50 2024-08-26T00:02:19.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.009+0000 7f34b4c00640 1 -- 172.21.15.42:0/85724374 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34a8040070 con 0x7f34b8103b50 2024-08-26T00:02:19.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.009+0000 7f34b4c00640 1 -- 172.21.15.42:0/85724374 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a8031a30 con 0x7f34b8103b50 2024-08-26T00:02:19.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.009+0000 7f34be400640 1 -- 172.21.15.42:0/85724374 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b819f680 con 0x7f34b8103b50 2024-08-26T00:02:19.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.009+0000 7f34be400640 1 -- 172.21.15.42:0/85724374 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b81a6fc0 con 0x7f34b8103b50 2024-08-26T00:02:19.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.012+0000 7f34b4c00640 1 -- 172.21.15.42:0/85724374 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f34a8004690 con 0x7f34b8103b50 2024-08-26T00:02:19.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.012+0000 7f34c0dc2740 1 Processor -- start 2024-08-26T00:02:19.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.012+0000 7f34c0dc2740 1 -- start start 2024-08-26T00:02:19.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.012+0000 7f34c0dc2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7b6620 0x561b7d7b6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:19.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.013+0000 7f34c0dc2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6f40 0x561b7d7c12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:19.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.013+0000 7f34c0dc2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b7d7c1800 0x561b7d7c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:19.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.013+0000 7f34c0dc2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561b7d71cdb0 con 0x561b7d7b6620 2024-08-26T00:02:19.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.013+0000 7f34c0dc2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561b7d6b44a0 con 0x561b7d7b6f40 2024-08-26T00:02:19.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.013+0000 7f34c0dc2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561b7d718d70 con 0x561b7d7c1800 2024-08-26T00:02:19.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.013+0000 7f34b7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7b6620 0x561b7d7b6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:19.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.013+0000 7f34b7400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6f40 0x561b7d7c12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:19.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.013+0000 7f34b7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7b6620 0x561b7d7b6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55490/0 (socket says 172.21.15.42:55490) 2024-08-26T00:02:19.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.013+0000 7f34b7e00640 1 -- 172.21.15.42:0/2694452794 learned_addr learned my addr 172.21.15.42:0/2694452794 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:19.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.013+0000 7f34aea00640 1 --2- 172.21.15.42:0/2694452794 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b7d7c1800 0x561b7d7c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:19.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.013+0000 7f34b7e00640 1 -- 172.21.15.42:0/2694452794 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b7d7c1800 msgr2=0x561b7d7c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:19.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.013+0000 7f34b7e00640 1 --2- 172.21.15.42:0/2694452794 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b7d7c1800 0x561b7d7c3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.013+0000 7f34b7e00640 1 -- 172.21.15.42:0/2694452794 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6f40 msgr2=0x561b7d7c12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:19.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.013+0000 7f34b7e00640 1 --2- 172.21.15.42:0/2694452794 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6f40 0x561b7d7c12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.013+0000 7f34b7e00640 1 -- 172.21.15.42:0/2694452794 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b7d48e2b0 con 0x561b7d7b6620 2024-08-26T00:02:19.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.013+0000 7f34aea00640 1 --2- 172.21.15.42:0/2694452794 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b7d7c1800 0x561b7d7c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:02:19.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.013+0000 7f34b7400640 1 --2- 172.21.15.42:0/2694452794 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6f40 0x561b7d7c12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:19.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.014+0000 7f34b4c00640 1 --2- 172.21.15.42:0/85724374 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f349c0a2b80 0x7f349c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:19.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.014+0000 7f34b4c00640 1 -- 172.21.15.42:0/85724374 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f34a80f0160 con 0x7f34b8103b50 2024-08-26T00:02:19.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.014+0000 7f34b7e00640 1 --2- 172.21.15.42:0/2694452794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7b6620 0x561b7d7b6a00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f34b0009c20 tx=0x7f34b0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a700973d9392e8c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:19.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.014+0000 7f34b7400640 1 --2- 172.21.15.42:0/85724374 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f349c0a2b80 0x7f349c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:19.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.014+0000 7f34acc00640 1 -- 172.21.15.42:0/2694452794 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b001e070 con 0x561b7d7b6620 2024-08-26T00:02:19.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.014+0000 7f34acc00640 1 -- 172.21.15.42:0/2694452794 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34b0019b10 con 0x561b7d7b6620 2024-08-26T00:02:19.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.014+0000 7f34acc00640 1 -- 172.21.15.42:0/2694452794 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b000eae0 con 0x561b7d7b6620 2024-08-26T00:02:19.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.015+0000 7f34c0dc2740 1 -- 172.21.15.42:0/2694452794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7b6620 msgr2=0x561b7d7b6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:19.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.015+0000 7f34c0dc2740 1 --2- 172.21.15.42:0/2694452794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7b6620 0x561b7d7b6a00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f34b0009c20 tx=0x7f34b0011810 comp rx=0 tx=0).stop 2024-08-26T00:02:19.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.015+0000 7f34b7400640 1 --2- 172.21.15.42:0/85724374 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f349c0a2b80 0x7f349c0a5040 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f34a80bc910 tx=0x7f34a80f3ba0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:19.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.015+0000 7f34c0dc2740 1 -- 172.21.15.42:0/2694452794 shutdown_connections 2024-08-26T00:02:19.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.015+0000 7f34c0dc2740 1 --2- 172.21.15.42:0/2694452794 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b7d7c1800 0x561b7d7c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.015+0000 7f34c0dc2740 1 --2- 172.21.15.42:0/2694452794 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6f40 0x561b7d7c12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.015+0000 7f34c0dc2740 1 --2- 172.21.15.42:0/2694452794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7b6620 0x561b7d7b6a00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.015+0000 7f34c0dc2740 1 -- 172.21.15.42:0/2694452794 >> 172.21.15.42:0/2694452794 conn(0x561b7d7b2bb0 msgr2=0x561b7d7b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:19.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.015+0000 7f34c0dc2740 1 -- 172.21.15.42:0/2694452794 shutdown_connections 2024-08-26T00:02:19.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.015+0000 7f34c0dc2740 1 -- 172.21.15.42:0/2694452794 wait complete. 2024-08-26T00:02:19.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.016+0000 7f34c0dc2740 1 -- start start 2024-08-26T00:02:19.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.016+0000 7f34c0dc2740 1 Processor -- start 2024-08-26T00:02:19.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.017+0000 7f34c0dc2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6620 0x561b7d7be760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:19.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.017+0000 7f34c0dc2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b7d7b6f40 0x561b7d7beca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:19.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.017+0000 7f34c0dc2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7c1800 0x561b7d7bf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:19.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.017+0000 7f34c0dc2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561b7d7c43d0 con 0x561b7d7c1800 2024-08-26T00:02:19.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.017+0000 7f34c0dc2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561b7d6d7bf0 con 0x561b7d7b6620 2024-08-26T00:02:19.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.017+0000 7f34c0dc2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561b7d7c4550 con 0x561b7d7b6f40 2024-08-26T00:02:19.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.017+0000 7f34c0dc2740 10 client.0 _ll_register_callbacks cb 0x561b7d6c3dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:02:19.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.017+0000 7f34b7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6620 0x561b7d7be760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:19.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.017+0000 7f34b7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6620 0x561b7d7be760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:52156/0 (socket says 172.21.15.42:52156) 2024-08-26T00:02:19.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.017+0000 7f34b7e00640 1 -- 172.21.15.42:0/3135309672 learned_addr learned my addr 172.21.15.42:0/3135309672 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:19.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.017+0000 7f34aea00640 1 --2- 172.21.15.42:0/3135309672 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b7d7b6f40 0x561b7d7beca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:19.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.017+0000 7f34b7e00640 1 --2- 172.21.15.42:0/3135309672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7c1800 0x561b7d7bf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:19.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.017+0000 7f34aea00640 1 -- 172.21.15.42:0/3135309672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6620 msgr2=0x561b7d7be760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:19.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.017+0000 7f34aea00640 1 --2- 172.21.15.42:0/3135309672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6620 0x561b7d7be760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.017+0000 7f34aea00640 1 -- 172.21.15.42:0/3135309672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7c1800 msgr2=0x561b7d7bf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:19.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.017+0000 7f34aea00640 1 --2- 172.21.15.42:0/3135309672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7c1800 0x561b7d7bf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.017+0000 7f34aea00640 1 -- 172.21.15.42:0/3135309672 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b7d7cd940 con 0x561b7d7b6f40 2024-08-26T00:02:19.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.017+0000 7f34b7e00640 1 --2- 172.21.15.42:0/3135309672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6620 0x561b7d7be760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:19.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.018+0000 7f34aea00640 1 --2- 172.21.15.42:0/3135309672 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b7d7b6f40 0x561b7d7beca0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f34a00136e0 tx=0x7f34a0013ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4228cf0f01c1d1cc server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:19.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.018+0000 7f34a5600640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:02:19.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.018+0000 7f34a5600640 1 -- 172.21.15.42:0/3135309672 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a00119c0 con 0x561b7d7b6f40 2024-08-26T00:02:19.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.018+0000 7f34a5600640 1 -- 172.21.15.42:0/3135309672 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f34a0011b60 con 0x561b7d7b6f40 2024-08-26T00:02:19.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.018+0000 7f34c0dc2740 1 -- 172.21.15.42:0/3135309672 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34b0019b10 con 0x561b7d7b6f40 2024-08-26T00:02:19.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.018+0000 7f34a5600640 1 -- 172.21.15.42:0/3135309672 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f34a0011d60 con 0x561b7d7b6f40 2024-08-26T00:02:19.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.018+0000 7f34c0dc2740 10 client.25030 fetch_fsmap learned FSMap version 23 2024-08-26T00:02:19.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.018+0000 7f34c0dc2740 1 -- 172.21.15.42:0/3135309672 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x561b7d7d02a0 con 0x561b7d7b6f40 2024-08-26T00:02:19.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.019+0000 7f34a5600640 1 -- 172.21.15.42:0/3135309672 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34b0019b10 con 0x561b7d7b6f40 2024-08-26T00:02:19.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.019+0000 7f34a5600640 1 -- 172.21.15.42:0/3135309672 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f34a001a070 con 0x561b7d7b6f40 2024-08-26T00:02:19.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.019+0000 7f34c0dc2740 10 client.25030 fetch_fsmap finished waiting for FSMap version 23 2024-08-26T00:02:19.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.019+0000 7f34c0dc2740 10 client.25030 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-26T00:02:19.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.019+0000 7f34c0dc2740 20 client.25030 populate_metadata read hostname 'smithi042' 2024-08-26T00:02:19.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.019+0000 7f34c0dc2740 1 --2- 172.21.15.42:0/3135309672 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x561b7d7d28d0 0x561b7d7d3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:19.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.019+0000 7f34c0dc2740 4 client.25030 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:02:19.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.019+0000 7f34c0dc2740 1 -- 172.21.15.42:0/3135309672 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b7d72a320 con 0x561b7d7d28d0 2024-08-26T00:02:19.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.019+0000 7f34b7e00640 1 --2- 172.21.15.42:0/3135309672 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x561b7d7d28d0 0x561b7d7d3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:19.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.020+0000 7f34b7e00640 1 --2- 172.21.15.42:0/3135309672 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x561b7d7d28d0 0x561b7d7d3d40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cb5567f5fae6502b server_cookie=89b1a26db378d1b in_seq=0 out_seq=0 2024-08-26T00:02:19.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.020+0000 7f34a5600640 10 client.25030 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:02:19.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.021+0000 7f34a5600640 1 -- 172.21.15.42:0/3135309672 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561b7d72a320 con 0x561b7d7d28d0 2024-08-26T00:02:19.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.021+0000 7f34a5600640 10 client.25030 handle_command_reply: tid=0 2024-08-26T00:02:19.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.021+0000 7f34c0dc2740 1 client.25030 shutdown 2024-08-26T00:02:19.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.021+0000 7f34c0dc2740 1 -- 172.21.15.42:0/3135309672 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b7d7b6f40 msgr2=0x561b7d7beca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:19.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.021+0000 7f34c0dc2740 1 --2- 172.21.15.42:0/3135309672 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b7d7b6f40 0x561b7d7beca0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f34a00136e0 tx=0x7f34a0013ba0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.021+0000 7f34c0dc2740 1 -- 172.21.15.42:0/3135309672 shutdown_connections 2024-08-26T00:02:19.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.021+0000 7f34c0dc2740 1 --2- 172.21.15.42:0/3135309672 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x561b7d7d28d0 0x561b7d7d3d40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.021+0000 7f34c0dc2740 1 --2- 172.21.15.42:0/3135309672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7c1800 0x561b7d7bf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.021+0000 7f34c0dc2740 1 --2- 172.21.15.42:0/3135309672 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b7d7b6f40 0x561b7d7beca0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.021+0000 7f34c0dc2740 1 --2- 172.21.15.42:0/3135309672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6620 0x561b7d7be760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.021+0000 7f34a5600640 0 client.25030 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:02:19.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.021+0000 7f34c0dc2740 1 -- 172.21.15.42:0/3135309672 >> 172.21.15.42:0/3135309672 conn(0x561b7d7b2bb0 msgr2=0x561b7d7b88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:19.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.021+0000 7f34c0dc2740 1 -- 172.21.15.42:0/3135309672 shutdown_connections 2024-08-26T00:02:19.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.021+0000 7f34c0dc2740 1 -- 172.21.15.42:0/3135309672 wait complete. 2024-08-26T00:02:19.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.022+0000 7f34c0dc2740 20 client.25030 trim_cache size 0 max 16384 2024-08-26T00:02:19.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.041+0000 7f34c0dc2740 1 Processor -- start 2024-08-26T00:02:19.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.041+0000 7f34c0dc2740 1 -- start start 2024-08-26T00:02:19.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.041+0000 7f34c0dc2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b7d7b6620 0x561b7d7d3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:19.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.041+0000 7f34c0dc2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6f40 0x561b7d7b9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:19.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.041+0000 7f34c0dc2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7c1800 0x561b7d7c0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:19.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.041+0000 7f34c0dc2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561b7d7d2080 con 0x561b7d7c1800 2024-08-26T00:02:19.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.041+0000 7f34c0dc2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561b7d7d2750 con 0x561b7d7b6f40 2024-08-26T00:02:19.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.041+0000 7f34c0dc2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561b7d7d2e20 con 0x561b7d7b6620 2024-08-26T00:02:19.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.041+0000 7f34aea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6f40 0x561b7d7b9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:19.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.041+0000 7f34aea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6f40 0x561b7d7b9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:52166/0 (socket says 172.21.15.42:52166) 2024-08-26T00:02:19.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.041+0000 7f34aea00640 1 -- 172.21.15.42:0/1869046638 learned_addr learned my addr 172.21.15.42:0/1869046638 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:19.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.041+0000 7f34b7e00640 1 --2- 172.21.15.42:0/1869046638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7c1800 0x561b7d7c0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:19.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.041+0000 7f34b7e00640 1 --2- 172.21.15.42:0/1869046638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b7d7b6620 0x561b7d7d3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:19.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.042+0000 7f34aea00640 1 -- 172.21.15.42:0/1869046638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b7d7b6620 msgr2=0x561b7d7d3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:19.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.042+0000 7f34aea00640 1 --2- 172.21.15.42:0/1869046638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b7d7b6620 0x561b7d7d3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.042+0000 7f34aea00640 1 -- 172.21.15.42:0/1869046638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7c1800 msgr2=0x561b7d7c0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:19.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.042+0000 7f34aea00640 1 --2- 172.21.15.42:0/1869046638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7c1800 0x561b7d7c0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.042+0000 7f34aea00640 1 -- 172.21.15.42:0/1869046638 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b7d7c44e0 con 0x561b7d7b6f40 2024-08-26T00:02:19.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.042+0000 7f34b7e00640 1 --2- 172.21.15.42:0/1869046638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7c1800 0x561b7d7c0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:02:19.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.042+0000 7f34aea00640 1 --2- 172.21.15.42:0/1869046638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6f40 0x561b7d7b9080 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f34a00259c0 tx=0x7f34a0005c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0e3d92339fd7658 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:19.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.042+0000 7f34a7e00640 1 -- 172.21.15.42:0/1869046638 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a0005460 con 0x561b7d7b6f40 2024-08-26T00:02:19.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.042+0000 7f34a7e00640 1 -- 172.21.15.42:0/1869046638 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34a0005600 con 0x561b7d7b6f40 2024-08-26T00:02:19.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.042+0000 7f34a7e00640 1 -- 172.21.15.42:0/1869046638 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a0003d30 con 0x561b7d7b6f40 2024-08-26T00:02:19.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.043+0000 7f34c0dc2740 1 -- 172.21.15.42:0/1869046638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6f40 msgr2=0x561b7d7b9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:19.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.043+0000 7f34c0dc2740 1 --2- 172.21.15.42:0/1869046638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6f40 0x561b7d7b9080 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f34a00259c0 tx=0x7f34a0005c70 comp rx=0 tx=0).stop 2024-08-26T00:02:19.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.043+0000 7f34c0dc2740 1 -- 172.21.15.42:0/1869046638 shutdown_connections 2024-08-26T00:02:19.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.043+0000 7f34c0dc2740 1 --2- 172.21.15.42:0/1869046638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7c1800 0x561b7d7c0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.043+0000 7f34c0dc2740 1 --2- 172.21.15.42:0/1869046638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6f40 0x561b7d7b9080 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.043+0000 7f34c0dc2740 1 --2- 172.21.15.42:0/1869046638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b7d7b6620 0x561b7d7d3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.043+0000 7f34c0dc2740 1 -- 172.21.15.42:0/1869046638 >> 172.21.15.42:0/1869046638 conn(0x561b7d7b2bb0 msgr2=0x561b7d7b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:19.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.043+0000 7f34c0dc2740 1 -- 172.21.15.42:0/1869046638 shutdown_connections 2024-08-26T00:02:19.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.043+0000 7f34c0dc2740 1 -- 172.21.15.42:0/1869046638 wait complete. 2024-08-26T00:02:19.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.044+0000 7f34c0dc2740 1 -- start start 2024-08-26T00:02:19.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.044+0000 7f34c0dc2740 1 Processor -- start 2024-08-26T00:02:19.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.044+0000 7f34c0dc2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6620 0x561b7d7dc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:19.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.044+0000 7f34c0dc2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7b6f40 0x561b7d7dc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:19.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.044+0000 7f34c0dc2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b7d7c1800 0x561b7d7d5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:19.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.044+0000 7f34c0dc2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561b7d7d3bc0 con 0x561b7d7b6f40 2024-08-26T00:02:19.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.044+0000 7f34c0dc2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561b7d7d34f0 con 0x561b7d7b6620 2024-08-26T00:02:19.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.045+0000 7f34c0dc2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561b7d7d4290 con 0x561b7d7c1800 2024-08-26T00:02:19.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.045+0000 7f34c0dc2740 10 client.0 _ll_register_callbacks cb 0x7f34a0009d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:02:19.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.045+0000 7f34aea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7b6f40 0x561b7d7dc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:19.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.045+0000 7f34b7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b7d7c1800 0x561b7d7d5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:19.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.045+0000 7f34aea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7b6f40 0x561b7d7dc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55518/0 (socket says 172.21.15.42:55518) 2024-08-26T00:02:19.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.045+0000 7f34b7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b7d7c1800 0x561b7d7d5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:37476/0 (socket says 172.21.15.42:37476) 2024-08-26T00:02:19.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.045+0000 7f34aea00640 1 -- 172.21.15.42:0/2279173983 learned_addr learned my addr 172.21.15.42:0/2279173983 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:19.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.045+0000 7f34b7e00640 1 --2- 172.21.15.42:0/2279173983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6620 0x561b7d7dc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:19.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.045+0000 7f34aea00640 1 -- 172.21.15.42:0/2279173983 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b7d7c1800 msgr2=0x561b7d7d5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:19.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.045+0000 7f34aea00640 1 --2- 172.21.15.42:0/2279173983 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b7d7c1800 0x561b7d7d5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.045+0000 7f34aea00640 1 -- 172.21.15.42:0/2279173983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6620 msgr2=0x561b7d7dc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:19.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.045+0000 7f34aea00640 1 --2- 172.21.15.42:0/2279173983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6620 0x561b7d7dc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.045+0000 7f34aea00640 1 -- 172.21.15.42:0/2279173983 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b7d7d5d40 con 0x561b7d7b6f40 2024-08-26T00:02:19.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.046+0000 7f34aea00640 1 --2- 172.21.15.42:0/2279173983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7b6f40 0x561b7d7dc720 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f34a0025db0 tx=0x7f34a0025de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329fe28e73271feb server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:19.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.046+0000 7f34a5600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:02:19.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.046+0000 7f34a5600640 1 -- 172.21.15.42:0/2279173983 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a0005460 con 0x561b7d7b6f40 2024-08-26T00:02:19.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.046+0000 7f34a5600640 1 -- 172.21.15.42:0/2279173983 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f34a00037f0 con 0x561b7d7b6f40 2024-08-26T00:02:19.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.046+0000 7f34c0dc2740 1 -- 172.21.15.42:0/2279173983 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34a0005600 con 0x561b7d7b6f40 2024-08-26T00:02:19.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.046+0000 7f34a5600640 1 -- 172.21.15.42:0/2279173983 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f34a0025650 con 0x561b7d7b6f40 2024-08-26T00:02:19.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.046+0000 7f34c0dc2740 10 client.15009 fetch_fsmap learned FSMap version 23 2024-08-26T00:02:19.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.046+0000 7f34c0dc2740 1 -- 172.21.15.42:0/2279173983 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x561b7d7da820 con 0x561b7d7b6f40 2024-08-26T00:02:19.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.046+0000 7f34a5600640 1 -- 172.21.15.42:0/2279173983 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34a0005600 con 0x561b7d7b6f40 2024-08-26T00:02:19.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.047+0000 7f34a5600640 1 -- 172.21.15.42:0/2279173983 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f34a001a070 con 0x561b7d7b6f40 2024-08-26T00:02:19.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.047+0000 7f34c0dc2740 10 client.15009 fetch_fsmap finished waiting for FSMap version 23 2024-08-26T00:02:19.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.047+0000 7f34c0dc2740 10 client.15009 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-26T00:02:19.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.047+0000 7f34c0dc2740 20 client.15009 populate_metadata read hostname 'smithi042' 2024-08-26T00:02:19.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.047+0000 7f34c0dc2740 1 --2- 172.21.15.42:0/2279173983 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x561b7d841300 0x561b7d840010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:19.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.047+0000 7f34c0dc2740 4 client.15009 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-26T00:02:19.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.047+0000 7f34c0dc2740 1 -- 172.21.15.42:0/2279173983 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "status"}) -- 0x561b7d724830 con 0x561b7d841300 2024-08-26T00:02:19.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.047+0000 7f34b7e00640 1 --2- 172.21.15.42:0/2279173983 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x561b7d841300 0x561b7d840010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:19.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.047+0000 7f34b7e00640 1 --2- 172.21.15.42:0/2279173983 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x561b7d841300 0x561b7d840010 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=62451d2dc5ea64b2 server_cookie=196d0c09a6aef4a0 in_seq=0 out_seq=0 2024-08-26T00:02:19.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.048+0000 7f34a5600640 10 client.15009 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:02:19.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.048+0000 7f34a5600640 1 -- 172.21.15.42:0/2279173983 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x561b7d724830 con 0x561b7d841300 2024-08-26T00:02:19.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.048+0000 7f34a5600640 10 client.15009 handle_command_reply: tid=0 2024-08-26T00:02:19.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.048+0000 7f34c0dc2740 1 client.15009 shutdown 2024-08-26T00:02:19.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.048+0000 7f34c0dc2740 1 -- 172.21.15.42:0/2279173983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7b6f40 msgr2=0x561b7d7dc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:19.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.048+0000 7f34c0dc2740 1 --2- 172.21.15.42:0/2279173983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7b6f40 0x561b7d7dc720 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f34a0025db0 tx=0x7f34a0025de0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.048+0000 7f34c0dc2740 1 -- 172.21.15.42:0/2279173983 shutdown_connections 2024-08-26T00:02:19.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.048+0000 7f34c0dc2740 1 --2- 172.21.15.42:0/2279173983 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x561b7d841300 0x561b7d840010 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.048+0000 7f34c0dc2740 1 --2- 172.21.15.42:0/2279173983 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b7d7c1800 0x561b7d7d5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.048+0000 7f34c0dc2740 1 --2- 172.21.15.42:0/2279173983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b7d7b6f40 0x561b7d7dc720 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.048+0000 7f34a5600640 0 client.15009 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:02:19.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.048+0000 7f34c0dc2740 1 --2- 172.21.15.42:0/2279173983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b7d7b6620 0x561b7d7dc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.048+0000 7f34c0dc2740 1 -- 172.21.15.42:0/2279173983 >> 172.21.15.42:0/2279173983 conn(0x561b7d7b2bb0 msgr2=0x561b7d7bcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:19.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.048+0000 7f34c0dc2740 1 -- 172.21.15.42:0/2279173983 shutdown_connections 2024-08-26T00:02:19.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.048+0000 7f34c0dc2740 1 -- 172.21.15.42:0/2279173983 wait complete. 2024-08-26T00:02:19.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.048+0000 7f34c0dc2740 20 client.15009 trim_cache size 0 max 16384 2024-08-26T00:02:19.054 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:02:19.054 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "f89d317a-633c-11ef-bcd2-c7b262605968", 2024-08-26T00:02:19.054 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 1, 2024-08-26T00:02:19.054 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24527, 2024-08-26T00:02:19.054 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-08-26T00:02:19.054 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-08-26T00:02:19.054 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-08-26T00:02:19.054 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 100.660419129, 2024-08-26T00:02:19.054 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 23, 2024-08-26T00:02:19.054 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 80, 2024-08-26T00:02:19.054 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 78, 2024-08-26T00:02:19.054 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 120.97230354200001 2024-08-26T00:02:19.055 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:02:19.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.049+0000 7f34be400640 1 -- 172.21.15.42:0/85724374 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f349c0a2b80 msgr2=0x7f349c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:19.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.049+0000 7f34be400640 1 --2- 172.21.15.42:0/85724374 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f349c0a2b80 0x7f349c0a5040 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f34a80bc910 tx=0x7f34a80f3ba0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.049+0000 7f34be400640 1 -- 172.21.15.42:0/85724374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34b8103b50 msgr2=0x7f34b819a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:19.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.049+0000 7f34be400640 1 --2- 172.21.15.42:0/85724374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34b8103b50 0x7f34b819a440 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009df0 tx=0x7f34a8030ed0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.049+0000 7f34be400640 1 -- 172.21.15.42:0/85724374 shutdown_connections 2024-08-26T00:02:19.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.049+0000 7f34be400640 1 --2- 172.21.15.42:0/85724374 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f349c0a2b80 0x7f349c0a5040 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.049+0000 7f34be400640 1 --2- 172.21.15.42:0/85724374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34b8109c00 0x7f34b819ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.049+0000 7f34be400640 1 --2- 172.21.15.42:0/85724374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34b81044f0 0x7f34b819a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.049+0000 7f34be400640 1 --2- 172.21.15.42:0/85724374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34b8103b50 0x7f34b819a440 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:19.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.049+0000 7f34be400640 1 -- 172.21.15.42:0/85724374 >> 172.21.15.42:0/85724374 conn(0x7f34b80ff830 msgr2=0x7f34b8100f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:19.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.049+0000 7f34be400640 1 -- 172.21.15.42:0/85724374 shutdown_connections 2024-08-26T00:02:19.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:19.049+0000 7f34be400640 1 -- 172.21.15.42:0/85724374 wait complete. 2024-08-26T00:02:19.894 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.i status 2024-08-26T00:02:20.272 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:02:20.433 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:20 smithi042 ceph-mon[17225]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-26T00:02:20.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:20 smithi043 ceph-mon[22091]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-26T00:02:20.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:20 smithi181 ceph-mon[22102]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-26T00:02:20.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.814+0000 7fea21e00640 1 -- 172.21.15.42:0/1539497365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea1c1044f0 msgr2=0x7fea1c1109d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:20.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.814+0000 7fea21e00640 1 --2- 172.21.15.42:0/1539497365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea1c1044f0 0x7fea1c1109d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fea14009be0 tx=0x7fea1402a6c0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.814+0000 7fea21e00640 1 -- 172.21.15.42:0/1539497365 shutdown_connections 2024-08-26T00:02:20.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.815+0000 7fea21e00640 1 --2- 172.21.15.42:0/1539497365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea1c1044f0 0x7fea1c1109d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.815+0000 7fea21e00640 1 --2- 172.21.15.42:0/1539497365 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea1c103b50 0x7fea1c103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.815+0000 7fea21e00640 1 --2- 172.21.15.42:0/1539497365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea1c109c00 0x7fea1c109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.815+0000 7fea21e00640 1 -- 172.21.15.42:0/1539497365 >> 172.21.15.42:0/1539497365 conn(0x7fea1c0ff830 msgr2=0x7fea1c101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:20.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.815+0000 7fea21e00640 1 -- 172.21.15.42:0/1539497365 shutdown_connections 2024-08-26T00:02:20.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.815+0000 7fea21e00640 1 -- 172.21.15.42:0/1539497365 wait complete. 2024-08-26T00:02:20.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.815+0000 7fea21e00640 1 Processor -- start 2024-08-26T00:02:20.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.816+0000 7fea21e00640 1 -- start start 2024-08-26T00:02:20.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.816+0000 7fea21e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea1c103b50 0x7fea1c19a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:20.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.816+0000 7fea21e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea1c1044f0 0x7fea1c19a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:20.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.816+0000 7fea21e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea1c109c00 0x7fea1c19ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:20.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.816+0000 7fea21e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fea1c113f60 con 0x7fea1c1044f0 2024-08-26T00:02:20.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.816+0000 7fea21e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fea1c113de0 con 0x7fea1c103b50 2024-08-26T00:02:20.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.816+0000 7fea21e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fea1c1140e0 con 0x7fea1c109c00 2024-08-26T00:02:20.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.816+0000 7fea13e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea1c1044f0 0x7fea1c19a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:20.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.816+0000 7fea1b400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea1c109c00 0x7fea1c19ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:20.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.816+0000 7fea1b400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea1c109c00 0x7fea1c19ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:37494/0 (socket says 172.21.15.42:37494) 2024-08-26T00:02:20.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.816+0000 7fea1b400640 1 -- 172.21.15.42:0/88074844 learned_addr learned my addr 172.21.15.42:0/88074844 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:20.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.816+0000 7fea1aa00640 1 --2- 172.21.15.42:0/88074844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea1c103b50 0x7fea1c19a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:20.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.817+0000 7fea1b400640 1 -- 172.21.15.42:0/88074844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea1c103b50 msgr2=0x7fea1c19a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:20.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.817+0000 7fea1b400640 1 --2- 172.21.15.42:0/88074844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea1c103b50 0x7fea1c19a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.817+0000 7fea1b400640 1 -- 172.21.15.42:0/88074844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea1c1044f0 msgr2=0x7fea1c19a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:20.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.817+0000 7fea1b400640 1 --2- 172.21.15.42:0/88074844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea1c1044f0 0x7fea1c19a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.817+0000 7fea1b400640 1 -- 172.21.15.42:0/88074844 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea1c19f2d0 con 0x7fea1c109c00 2024-08-26T00:02:20.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.817+0000 7fea13e00640 1 --2- 172.21.15.42:0/88074844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea1c1044f0 0x7fea1c19a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:20.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.817+0000 7fea1b400640 1 --2- 172.21.15.42:0/88074844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea1c109c00 0x7fea1c19ebf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fea14034040 tx=0x7fea14030c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:20.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.817+0000 7fea20a00640 1 -- 172.21.15.42:0/88074844 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14040020 con 0x7fea1c109c00 2024-08-26T00:02:20.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.817+0000 7fea21e00640 1 -- 172.21.15.42:0/88074844 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea1c19f560 con 0x7fea1c109c00 2024-08-26T00:02:20.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.817+0000 7fea20a00640 1 -- 172.21.15.42:0/88074844 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea14030e80 con 0x7fea1c109c00 2024-08-26T00:02:20.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.817+0000 7fea20a00640 1 -- 172.21.15.42:0/88074844 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14036040 con 0x7fea1c109c00 2024-08-26T00:02:20.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.817+0000 7fea21e00640 1 -- 172.21.15.42:0/88074844 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea1c1a6ea0 con 0x7fea1c109c00 2024-08-26T00:02:20.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.820+0000 7fea20a00640 1 -- 172.21.15.42:0/88074844 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fea14043020 con 0x7fea1c109c00 2024-08-26T00:02:20.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.820+0000 7fea249da740 1 Processor -- start 2024-08-26T00:02:20.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.821+0000 7fea249da740 1 -- start start 2024-08-26T00:02:20.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.821+0000 7fea249da740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d654620 0x55d59d654a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:20.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.821+0000 7fea249da740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d654f40 0x55d59d65f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:20.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.821+0000 7fea249da740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d59d65f800 0x55d59d661bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:20.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.821+0000 7fea249da740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d59d5badb0 con 0x55d59d654f40 2024-08-26T00:02:20.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.821+0000 7fea249da740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d59d5524a0 con 0x55d59d654620 2024-08-26T00:02:20.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.821+0000 7fea249da740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d59d5b6d70 con 0x55d59d65f800 2024-08-26T00:02:20.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.821+0000 7fea1aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d654f40 0x55d59d65f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:20.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.821+0000 7fea13e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d654620 0x55d59d654a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:20.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.821+0000 7fea13e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d654620 0x55d59d654a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:52212/0 (socket says 172.21.15.42:52212) 2024-08-26T00:02:20.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.822+0000 7fea13e00640 1 -- 172.21.15.42:0/1770779387 learned_addr learned my addr 172.21.15.42:0/1770779387 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:20.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.822+0000 7fea13e00640 1 --2- 172.21.15.42:0/1770779387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d59d65f800 0x55d59d661bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:20.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.822+0000 7fea1aa00640 1 -- 172.21.15.42:0/1770779387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d59d65f800 msgr2=0x55d59d661bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:20.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.822+0000 7fea1aa00640 1 --2- 172.21.15.42:0/1770779387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d59d65f800 0x55d59d661bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.822+0000 7fea1aa00640 1 -- 172.21.15.42:0/1770779387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d654620 msgr2=0x55d59d654a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:20.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.822+0000 7fea1aa00640 1 --2- 172.21.15.42:0/1770779387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d654620 0x55d59d654a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.822+0000 7fea1aa00640 1 -- 172.21.15.42:0/1770779387 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d59d32c2b0 con 0x55d59d654f40 2024-08-26T00:02:20.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.822+0000 7fea13e00640 1 --2- 172.21.15.42:0/1770779387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d654620 0x55d59d654a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:20.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.822+0000 7fea1aa00640 1 --2- 172.21.15.42:0/1770779387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d654f40 0x55d59d65f2c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fea0c005fd0 tx=0x7fea0c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1667f463ac1c298b server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:20.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.822+0000 7fea0be00640 1 -- 172.21.15.42:0/1770779387 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c004020 con 0x55d59d654f40 2024-08-26T00:02:20.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.823+0000 7fea0be00640 1 -- 172.21.15.42:0/1770779387 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea0c0041c0 con 0x55d59d654f40 2024-08-26T00:02:20.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.823+0000 7fea0be00640 1 -- 172.21.15.42:0/1770779387 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c019830 con 0x55d59d654f40 2024-08-26T00:02:20.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.823+0000 7fea20a00640 1 --2- 172.21.15.42:0/88074844 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fea000a2b80 0x7fea000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:20.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.823+0000 7fea13e00640 1 --2- 172.21.15.42:0/88074844 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fea000a2b80 0x7fea000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:20.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.823+0000 7fea20a00640 1 -- 172.21.15.42:0/88074844 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fea140efc50 con 0x7fea1c109c00 2024-08-26T00:02:20.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.823+0000 7fea249da740 1 -- 172.21.15.42:0/1770779387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d654f40 msgr2=0x55d59d65f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:20.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.823+0000 7fea249da740 1 --2- 172.21.15.42:0/1770779387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d654f40 0x55d59d65f2c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fea0c005fd0 tx=0x7fea0c011810 comp rx=0 tx=0).stop 2024-08-26T00:02:20.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.824+0000 7fea249da740 1 -- 172.21.15.42:0/1770779387 shutdown_connections 2024-08-26T00:02:20.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.824+0000 7fea249da740 1 --2- 172.21.15.42:0/1770779387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d59d65f800 0x55d59d661bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.824+0000 7fea249da740 1 --2- 172.21.15.42:0/1770779387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d654f40 0x55d59d65f2c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.824+0000 7fea249da740 1 --2- 172.21.15.42:0/1770779387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d654620 0x55d59d654a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.824+0000 7fea249da740 1 -- 172.21.15.42:0/1770779387 >> 172.21.15.42:0/1770779387 conn(0x55d59d650bb0 msgr2=0x55d59d650f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:20.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.824+0000 7fea249da740 1 -- 172.21.15.42:0/1770779387 shutdown_connections 2024-08-26T00:02:20.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.824+0000 7fea13e00640 1 --2- 172.21.15.42:0/88074844 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fea000a2b80 0x7fea000a5040 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55d59d651f30 tx=0x7fea04009b80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:20.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.824+0000 7fea249da740 1 -- 172.21.15.42:0/1770779387 wait complete. 2024-08-26T00:02:20.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.824+0000 7fea249da740 1 -- start start 2024-08-26T00:02:20.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.824+0000 7fea249da740 1 Processor -- start 2024-08-26T00:02:20.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.825+0000 7fea249da740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d59d654620 0x55d59d65c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:20.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.825+0000 7fea249da740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d654f40 0x55d59d65cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:20.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.825+0000 7fea249da740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d65f800 0x55d59d65d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:20.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.825+0000 7fea249da740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d59d6623d0 con 0x55d59d65f800 2024-08-26T00:02:20.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.825+0000 7fea249da740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d59d575bf0 con 0x55d59d654f40 2024-08-26T00:02:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.825+0000 7fea249da740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d59d662550 con 0x55d59d654620 2024-08-26T00:02:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.825+0000 7fea249da740 10 client.0 _ll_register_callbacks cb 0x55d59d561dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:02:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.825+0000 7fea13e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d654f40 0x55d59d65cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.825+0000 7fea1b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d65f800 0x55d59d65d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.825+0000 7fea1aa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d59d654620 0x55d59d65c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.825+0000 7fea13e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d654f40 0x55d59d65cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:52224/0 (socket says 172.21.15.42:52224) 2024-08-26T00:02:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.825+0000 7fea1b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d65f800 0x55d59d65d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55568/0 (socket says 172.21.15.42:55568) 2024-08-26T00:02:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.825+0000 7fea13e00640 1 -- 172.21.15.42:0/1443074497 learned_addr learned my addr 172.21.15.42:0/1443074497 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.825+0000 7fea1b400640 1 -- 172.21.15.42:0/1443074497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d59d654620 msgr2=0x55d59d65c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.825+0000 7fea1b400640 1 --2- 172.21.15.42:0/1443074497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d59d654620 0x55d59d65c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.825+0000 7fea1b400640 1 -- 172.21.15.42:0/1443074497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d654f40 msgr2=0x55d59d65cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:20.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.825+0000 7fea1b400640 1 --2- 172.21.15.42:0/1443074497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d654f40 0x55d59d65cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.825+0000 7fea1b400640 1 -- 172.21.15.42:0/1443074497 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d59d66b8c0 con 0x55d59d65f800 2024-08-26T00:02:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.825+0000 7fea13e00640 1 --2- 172.21.15.42:0/1443074497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d654f40 0x55d59d65cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.826+0000 7fea1b400640 1 --2- 172.21.15.42:0/1443074497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d65f800 0x55d59d65d160 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fea140ed6e0 tx=0x7fea140bc030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f23ed4e62d432f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.826+0000 7fea08c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:02:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.826+0000 7fea08c00640 1 -- 172.21.15.42:0/1443074497 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea140d5060 con 0x55d59d65f800 2024-08-26T00:02:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.826+0000 7fea08c00640 1 -- 172.21.15.42:0/1443074497 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fea140d5200 con 0x55d59d65f800 2024-08-26T00:02:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.826+0000 7fea249da740 1 -- 172.21.15.42:0/1443074497 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea0c0041c0 con 0x55d59d65f800 2024-08-26T00:02:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.826+0000 7fea08c00640 1 -- 172.21.15.42:0/1443074497 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fea140c0820 con 0x55d59d65f800 2024-08-26T00:02:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.826+0000 7fea249da740 10 client.15021 fetch_fsmap learned FSMap version 23 2024-08-26T00:02:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.826+0000 7fea249da740 1 -- 172.21.15.42:0/1443074497 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55d59d66e250 con 0x55d59d65f800 2024-08-26T00:02:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.827+0000 7fea08c00640 1 -- 172.21.15.42:0/1443074497 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea0c0041c0 con 0x55d59d65f800 2024-08-26T00:02:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.827+0000 7fea08c00640 1 -- 172.21.15.42:0/1443074497 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fea140c4c50 con 0x55d59d65f800 2024-08-26T00:02:20.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.827+0000 7fea249da740 10 client.15021 fetch_fsmap finished waiting for FSMap version 23 2024-08-26T00:02:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.827+0000 7fea249da740 10 client.15021 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-26T00:02:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.827+0000 7fea249da740 20 client.15021 populate_metadata read hostname 'smithi042' 2024-08-26T00:02:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.827+0000 7fea249da740 1 --2- 172.21.15.42:0/1443074497 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d59d670890 0x55d59d671d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.827+0000 7fea249da740 4 client.15021 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:02:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.827+0000 7fea249da740 1 -- 172.21.15.42:0/1443074497 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d59d5c8320 con 0x55d59d670890 2024-08-26T00:02:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.827+0000 7fea1aa00640 1 --2- 172.21.15.42:0/1443074497 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d59d670890 0x55d59d671d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.828+0000 7fea1aa00640 1 --2- 172.21.15.42:0/1443074497 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d59d670890 0x55d59d671d00 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39e96f6031795219 server_cookie=c4c6b3ae8f659646 in_seq=0 out_seq=0 2024-08-26T00:02:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.828+0000 7fea08c00640 10 client.15021 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:02:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.829+0000 7fea08c00640 1 -- 172.21.15.42:0/1443074497 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d59d5c8320 con 0x55d59d670890 2024-08-26T00:02:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.829+0000 7fea08c00640 10 client.15021 handle_command_reply: tid=0 2024-08-26T00:02:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.829+0000 7fea249da740 1 client.15021 shutdown 2024-08-26T00:02:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.829+0000 7fea249da740 1 -- 172.21.15.42:0/1443074497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d65f800 msgr2=0x55d59d65d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:20.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.829+0000 7fea249da740 1 --2- 172.21.15.42:0/1443074497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d65f800 0x55d59d65d160 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fea140ed6e0 tx=0x7fea140bc030 comp rx=0 tx=0).stop 2024-08-26T00:02:20.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.829+0000 7fea249da740 1 -- 172.21.15.42:0/1443074497 shutdown_connections 2024-08-26T00:02:20.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.829+0000 7fea249da740 1 --2- 172.21.15.42:0/1443074497 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d59d670890 0x55d59d671d00 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.829+0000 7fea249da740 1 --2- 172.21.15.42:0/1443074497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d65f800 0x55d59d65d160 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.829+0000 7fea249da740 1 --2- 172.21.15.42:0/1443074497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d654f40 0x55d59d65cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.829+0000 7fea249da740 1 --2- 172.21.15.42:0/1443074497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d59d654620 0x55d59d65c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.829+0000 7fea249da740 1 -- 172.21.15.42:0/1443074497 >> 172.21.15.42:0/1443074497 conn(0x55d59d650bb0 msgr2=0x55d59d6568e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:20.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.829+0000 7fea08c00640 0 client.15021 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:02:20.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.829+0000 7fea249da740 1 -- 172.21.15.42:0/1443074497 shutdown_connections 2024-08-26T00:02:20.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.829+0000 7fea249da740 1 -- 172.21.15.42:0/1443074497 wait complete. 2024-08-26T00:02:20.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.829+0000 7fea249da740 20 client.15021 trim_cache size 0 max 16384 2024-08-26T00:02:20.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.848+0000 7fea249da740 1 Processor -- start 2024-08-26T00:02:20.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.849+0000 7fea249da740 1 -- start start 2024-08-26T00:02:20.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.849+0000 7fea249da740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d654620 0x55d59d670f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:20.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.849+0000 7fea249da740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d59d654f40 0x55d59d6570d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:20.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.849+0000 7fea249da740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d65f800 0x55d59d650480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:20.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.849+0000 7fea249da740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d59d670040 con 0x55d59d654620 2024-08-26T00:02:20.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.849+0000 7fea249da740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d59d670710 con 0x55d59d65f800 2024-08-26T00:02:20.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.849+0000 7fea249da740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d59d670de0 con 0x55d59d654f40 2024-08-26T00:02:20.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.849+0000 7fea1aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d654620 0x55d59d670f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:20.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.849+0000 7fea1aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d654620 0x55d59d670f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55580/0 (socket says 172.21.15.42:55580) 2024-08-26T00:02:20.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.849+0000 7fea1aa00640 1 -- 172.21.15.42:0/1457381201 learned_addr learned my addr 172.21.15.42:0/1457381201 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:20.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.849+0000 7fea13e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d59d654f40 0x55d59d6570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:20.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.849+0000 7fea1b400640 1 --2- 172.21.15.42:0/1457381201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d65f800 0x55d59d650480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:20.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.849+0000 7fea1aa00640 1 -- 172.21.15.42:0/1457381201 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d59d654f40 msgr2=0x55d59d6570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:20.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.849+0000 7fea1aa00640 1 --2- 172.21.15.42:0/1457381201 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d59d654f40 0x55d59d6570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.849+0000 7fea1aa00640 1 -- 172.21.15.42:0/1457381201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d65f800 msgr2=0x55d59d650480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:20.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.849+0000 7fea1aa00640 1 --2- 172.21.15.42:0/1457381201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d65f800 0x55d59d650480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.849+0000 7fea1aa00640 1 -- 172.21.15.42:0/1457381201 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d59d661f50 con 0x55d59d654620 2024-08-26T00:02:20.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.850+0000 7fea1aa00640 1 --2- 172.21.15.42:0/1457381201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d654620 0x55d59d670f60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fea0c005fd0 tx=0x7fea0c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2f3571ba0132a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:20.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.850+0000 7fea0b400640 1 -- 172.21.15.42:0/1457381201 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c009db0 con 0x55d59d654620 2024-08-26T00:02:20.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.850+0000 7fea0b400640 1 -- 172.21.15.42:0/1457381201 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea0c003ad0 con 0x55d59d654620 2024-08-26T00:02:20.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.850+0000 7fea0b400640 1 -- 172.21.15.42:0/1457381201 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c0052e0 con 0x55d59d654620 2024-08-26T00:02:20.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.851+0000 7fea249da740 1 -- 172.21.15.42:0/1457381201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d654620 msgr2=0x55d59d670f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:20.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.851+0000 7fea249da740 1 --2- 172.21.15.42:0/1457381201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d654620 0x55d59d670f60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fea0c005fd0 tx=0x7fea0c009260 comp rx=0 tx=0).stop 2024-08-26T00:02:20.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.851+0000 7fea249da740 1 -- 172.21.15.42:0/1457381201 shutdown_connections 2024-08-26T00:02:20.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.851+0000 7fea249da740 1 --2- 172.21.15.42:0/1457381201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d65f800 0x55d59d650480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.851+0000 7fea249da740 1 --2- 172.21.15.42:0/1457381201 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d59d654f40 0x55d59d6570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.851+0000 7fea249da740 1 --2- 172.21.15.42:0/1457381201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d654620 0x55d59d670f60 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.851+0000 7fea249da740 1 -- 172.21.15.42:0/1457381201 >> 172.21.15.42:0/1457381201 conn(0x55d59d650bb0 msgr2=0x55d59d6579e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:20.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.851+0000 7fea249da740 1 -- 172.21.15.42:0/1457381201 shutdown_connections 2024-08-26T00:02:20.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.851+0000 7fea249da740 1 -- 172.21.15.42:0/1457381201 wait complete. 2024-08-26T00:02:20.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.852+0000 7fea249da740 1 -- start start 2024-08-26T00:02:20.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.852+0000 7fea249da740 1 Processor -- start 2024-08-26T00:02:20.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.852+0000 7fea249da740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d654620 0x55d59d673000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:20.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.852+0000 7fea249da740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d654f40 0x55d59d673540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:20.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.852+0000 7fea249da740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d59d65f800 0x55d59d6d8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:20.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.852+0000 7fea249da740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d59d671b80 con 0x55d59d654f40 2024-08-26T00:02:20.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.852+0000 7fea249da740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d59d6714b0 con 0x55d59d654620 2024-08-26T00:02:20.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.852+0000 7fea249da740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d59d672250 con 0x55d59d65f800 2024-08-26T00:02:20.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.852+0000 7fea249da740 10 client.0 _ll_register_callbacks cb 0x7fea140bc240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:02:20.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.853+0000 7fea1aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d654620 0x55d59d673000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:20.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.853+0000 7fea1aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d654620 0x55d59d673000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:52230/0 (socket says 172.21.15.42:52230) 2024-08-26T00:02:20.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.853+0000 7fea1aa00640 1 -- 172.21.15.42:0/690825638 learned_addr learned my addr 172.21.15.42:0/690825638 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:20.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.853+0000 7fea13e00640 1 --2- 172.21.15.42:0/690825638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d654f40 0x55d59d673540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:20.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.853+0000 7fea1b400640 1 --2- 172.21.15.42:0/690825638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d59d65f800 0x55d59d6d8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:20.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.853+0000 7fea1aa00640 1 -- 172.21.15.42:0/690825638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d59d65f800 msgr2=0x55d59d6d8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:20.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.853+0000 7fea1aa00640 1 --2- 172.21.15.42:0/690825638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d59d65f800 0x55d59d6d8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.853+0000 7fea1aa00640 1 -- 172.21.15.42:0/690825638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d654f40 msgr2=0x55d59d673540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:20.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.853+0000 7fea1aa00640 1 --2- 172.21.15.42:0/690825638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d654f40 0x55d59d673540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.853+0000 7fea1aa00640 1 -- 172.21.15.42:0/690825638 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d59d673da0 con 0x55d59d654620 2024-08-26T00:02:20.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.853+0000 7fea1aa00640 1 --2- 172.21.15.42:0/690825638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d654620 0x55d59d673000 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fea0c005e10 tx=0x7fea0c009680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8aec5fb21d4e197f server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:20.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.853+0000 7fea08c00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:02:20.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.854+0000 7fea08c00640 1 -- 172.21.15.42:0/690825638 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c03a020 con 0x55d59d654620 2024-08-26T00:02:20.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.854+0000 7fea249da740 1 -- 172.21.15.42:0/690825638 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea0c003ad0 con 0x55d59d654620 2024-08-26T00:02:20.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.854+0000 7fea08c00640 1 -- 172.21.15.42:0/690825638 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fea0c0041c0 con 0x55d59d654620 2024-08-26T00:02:20.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.854+0000 7fea08c00640 1 -- 172.21.15.42:0/690825638 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fea0c009870 con 0x55d59d654620 2024-08-26T00:02:20.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.854+0000 7fea249da740 10 client.25031 fetch_fsmap learned FSMap version 23 2024-08-26T00:02:20.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.854+0000 7fea249da740 1 -- 172.21.15.42:0/690825638 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55d59d6da560 con 0x55d59d654620 2024-08-26T00:02:20.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.855+0000 7fea08c00640 1 -- 172.21.15.42:0/690825638 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea0c003ad0 con 0x55d59d654620 2024-08-26T00:02:20.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.855+0000 7fea08c00640 1 -- 172.21.15.42:0/690825638 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fea0c004780 con 0x55d59d654620 2024-08-26T00:02:20.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.855+0000 7fea249da740 10 client.25031 fetch_fsmap finished waiting for FSMap version 23 2024-08-26T00:02:20.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.855+0000 7fea249da740 10 client.25031 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-26T00:02:20.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.855+0000 7fea249da740 20 client.25031 populate_metadata read hostname 'smithi042' 2024-08-26T00:02:20.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.855+0000 7fea249da740 1 --2- 172.21.15.42:0/690825638 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d59d6de9f0 0x55d59d6dd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:20.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.855+0000 7fea249da740 4 client.25031 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-26T00:02:20.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.855+0000 7fea249da740 1 -- 172.21.15.42:0/690825638 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "status"}) -- 0x55d59d5c2830 con 0x55d59d6de9f0 2024-08-26T00:02:20.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.855+0000 7fea13e00640 1 --2- 172.21.15.42:0/690825638 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d59d6de9f0 0x55d59d6dd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:20.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.856+0000 7fea13e00640 1 --2- 172.21.15.42:0/690825638 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d59d6de9f0 0x55d59d6dd700 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2896451ba0cdb961 server_cookie=672ad1b9bbb43e30 in_seq=0 out_seq=0 2024-08-26T00:02:20.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.856+0000 7fea08c00640 10 client.25031 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:02:20.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.856+0000 7fea08c00640 1 -- 172.21.15.42:0/690825638 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55d59d5c2830 con 0x55d59d6de9f0 2024-08-26T00:02:20.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.856+0000 7fea08c00640 10 client.25031 handle_command_reply: tid=0 2024-08-26T00:02:20.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.856+0000 7fea249da740 1 client.25031 shutdown 2024-08-26T00:02:20.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.856+0000 7fea249da740 1 -- 172.21.15.42:0/690825638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d654620 msgr2=0x55d59d673000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:20.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.856+0000 7fea249da740 1 --2- 172.21.15.42:0/690825638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d654620 0x55d59d673000 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fea0c005e10 tx=0x7fea0c009680 comp rx=0 tx=0).stop 2024-08-26T00:02:20.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.856+0000 7fea249da740 1 -- 172.21.15.42:0/690825638 shutdown_connections 2024-08-26T00:02:20.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.856+0000 7fea249da740 1 --2- 172.21.15.42:0/690825638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d59d65f800 0x55d59d6d8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.856+0000 7fea249da740 1 --2- 172.21.15.42:0/690825638 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d59d6de9f0 0x55d59d6dd700 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.856+0000 7fea249da740 1 --2- 172.21.15.42:0/690825638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d59d654f40 0x55d59d673540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.857+0000 7fea249da740 1 --2- 172.21.15.42:0/690825638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d59d654620 0x55d59d673000 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.857+0000 7fea249da740 1 -- 172.21.15.42:0/690825638 >> 172.21.15.42:0/690825638 conn(0x55d59d650bb0 msgr2=0x55d59d65af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:20.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.857+0000 7fea08c00640 0 client.25031 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:02:20.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.857+0000 7fea249da740 1 -- 172.21.15.42:0/690825638 shutdown_connections 2024-08-26T00:02:20.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.857+0000 7fea249da740 1 -- 172.21.15.42:0/690825638 wait complete. 2024-08-26T00:02:20.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.857+0000 7fea249da740 20 client.25031 trim_cache size 0 max 16384 2024-08-26T00:02:20.874 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:02:20.874 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "f89d317a-633c-11ef-bcd2-c7b262605968", 2024-08-26T00:02:20.874 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-08-26T00:02:20.874 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 24532, 2024-08-26T00:02:20.874 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-08-26T00:02:20.874 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-08-26T00:02:20.874 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-08-26T00:02:20.874 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 110.51767145300001, 2024-08-26T00:02:20.875 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 23, 2024-08-26T00:02:20.875 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 80, 2024-08-26T00:02:20.875 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 78, 2024-08-26T00:02:20.875 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 132.00908078699999 2024-08-26T00:02:20.875 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:02:20.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.857+0000 7fea21e00640 1 -- 172.21.15.42:0/88074844 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fea000a2b80 msgr2=0x7fea000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:20.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.857+0000 7fea21e00640 1 --2- 172.21.15.42:0/88074844 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fea000a2b80 0x7fea000a5040 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55d59d651f30 tx=0x7fea04009b80 comp rx=0 tx=0).stop 2024-08-26T00:02:20.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.857+0000 7fea21e00640 1 -- 172.21.15.42:0/88074844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea1c109c00 msgr2=0x7fea1c19ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:20.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.857+0000 7fea21e00640 1 --2- 172.21.15.42:0/88074844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea1c109c00 0x7fea1c19ebf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fea14034040 tx=0x7fea14030c50 comp rx=0 tx=0).stop 2024-08-26T00:02:20.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.858+0000 7fea21e00640 1 -- 172.21.15.42:0/88074844 shutdown_connections 2024-08-26T00:02:20.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.858+0000 7fea21e00640 1 --2- 172.21.15.42:0/88074844 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fea000a2b80 0x7fea000a5040 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.858+0000 7fea21e00640 1 --2- 172.21.15.42:0/88074844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea1c109c00 0x7fea1c19ebf0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.858+0000 7fea21e00640 1 --2- 172.21.15.42:0/88074844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea1c1044f0 0x7fea1c19a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.858+0000 7fea21e00640 1 --2- 172.21.15.42:0/88074844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea1c103b50 0x7fea1c19a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:20.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.858+0000 7fea21e00640 1 -- 172.21.15.42:0/88074844 >> 172.21.15.42:0/88074844 conn(0x7fea1c0ff830 msgr2=0x7fea1c100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:20.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.858+0000 7fea21e00640 1 -- 172.21.15.42:0/88074844 shutdown_connections 2024-08-26T00:02:20.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:20.858+0000 7fea21e00640 1 -- 172.21.15.42:0/88074844 wait complete. 2024-08-26T00:02:21.679 INFO:teuthology.run_tasks:Running task sequential... 2024-08-26T00:02:21.729 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-08-26T00:02:21.729 INFO:teuthology.task.sequential:In sequential, running task print... 2024-08-26T00:02:21.729 INFO:teuthology.task.print:Enabling mgr modules 2024-08-26T00:02:21.729 INFO:teuthology.run_tasks:Running task kclient... 2024-08-26T00:02:21.757 INFO:tasks.kclient:Mounting kernel clients... 2024-08-26T00:02:21.757 INFO:tasks.kclient:config is {'client.0': {}} 2024-08-26T00:02:21.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-26T00:02:21.758 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-08-26T00:02:21.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-26T00:02:21.795 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-08-26T00:02:21.894 INFO:teuthology.orchestra.run.smithi042.stderr:Cannot find device "ceph-brx" 2024-08-26T00:02:21.896 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-26T00:02:21.897 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-08-26T00:02:21.897 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-26T00:02:21.897 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-26T00:02:21.897 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs ls 2024-08-26T00:02:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:02:22.450 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:22 smithi042 ceph-mon[17225]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-26T00:02:22.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:22 smithi043 ceph-mon[22091]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-26T00:02:22.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:22 smithi181 ceph-mon[22102]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-26T00:02:22.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.891+0000 7f657c200640 1 -- 172.21.15.42:0/1329543631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65740764c0 msgr2=0x7f65740768a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:22.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.891+0000 7f657c200640 1 --2- 172.21.15.42:0/1329543631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65740764c0 0x7f65740768a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6568009900 tx=0x7f656802a410 comp rx=0 tx=0).stop 2024-08-26T00:02:22.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.891+0000 7f657c200640 1 -- 172.21.15.42:0/1329543631 shutdown_connections 2024-08-26T00:02:22.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.891+0000 7f657c200640 1 --2- 172.21.15.42:0/1329543631 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f65741127d0 0x7f6574114bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:22.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.891+0000 7f657c200640 1 --2- 172.21.15.42:0/1329543631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6574076de0 0x7f6574112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:22.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.891+0000 7f657c200640 1 --2- 172.21.15.42:0/1329543631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65740764c0 0x7f65740768a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:22.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.891+0000 7f657c200640 1 -- 172.21.15.42:0/1329543631 >> 172.21.15.42:0/1329543631 conn(0x7f65740ff830 msgr2=0x7f6574101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:22.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.891+0000 7f657c200640 1 -- 172.21.15.42:0/1329543631 shutdown_connections 2024-08-26T00:02:22.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.891+0000 7f657c200640 1 -- 172.21.15.42:0/1329543631 wait complete. 2024-08-26T00:02:22.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.892+0000 7f657c200640 1 Processor -- start 2024-08-26T00:02:22.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.892+0000 7f657c200640 1 -- start start 2024-08-26T00:02:22.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.893+0000 7f657c200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65740764c0 0x7f65741a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:22.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.893+0000 7f657c200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6574076de0 0x7f65741a4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:22.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.893+0000 7f657c200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f65741127d0 0x7f657419e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:22.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.893+0000 7f657c200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f65741183b0 con 0x7f65740764c0 2024-08-26T00:02:22.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.893+0000 7f657c200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6574118230 con 0x7f6574076de0 2024-08-26T00:02:22.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.893+0000 7f657c200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6574118530 con 0x7f65741127d0 2024-08-26T00:02:22.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.893+0000 7f6579800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65740764c0 0x7f65741a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:22.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.893+0000 7f6579800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65740764c0 0x7f65741a4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55594/0 (socket says 172.21.15.42:55594) 2024-08-26T00:02:22.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.893+0000 7f6578e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6574076de0 0x7f65741a4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:22.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.893+0000 7f6579800640 1 -- 172.21.15.42:0/2973990219 learned_addr learned my addr 172.21.15.42:0/2973990219 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:22.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.893+0000 7f657a200640 1 --2- 172.21.15.42:0/2973990219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f65741127d0 0x7f657419e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:22.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.894+0000 7f6579800640 1 -- 172.21.15.42:0/2973990219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f65741127d0 msgr2=0x7f657419e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:22.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.894+0000 7f6579800640 1 --2- 172.21.15.42:0/2973990219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f65741127d0 0x7f657419e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:22.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.894+0000 7f6579800640 1 -- 172.21.15.42:0/2973990219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6574076de0 msgr2=0x7f65741a4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:22.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.894+0000 7f6579800640 1 --2- 172.21.15.42:0/2973990219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6574076de0 0x7f65741a4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:22.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.894+0000 7f6579800640 1 -- 172.21.15.42:0/2973990219 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657419ed40 con 0x7f65740764c0 2024-08-26T00:02:22.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.894+0000 7f6578e00640 1 --2- 172.21.15.42:0/2973990219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6574076de0 0x7f65741a4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:22.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.894+0000 7f6579800640 1 --2- 172.21.15.42:0/2973990219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65740764c0 0x7f65741a4450 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6568004770 tx=0x7f6568003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:22.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.894+0000 7f6572000640 1 -- 172.21.15.42:0/2973990219 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656803f070 con 0x7f65740764c0 2024-08-26T00:02:22.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.894+0000 7f6572000640 1 -- 172.21.15.42:0/2973990219 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6568031ca0 con 0x7f65740764c0 2024-08-26T00:02:22.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.894+0000 7f657c200640 1 -- 172.21.15.42:0/2973990219 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f657419efd0 con 0x7f65740764c0 2024-08-26T00:02:22.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.894+0000 7f6572000640 1 -- 172.21.15.42:0/2973990219 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6568035030 con 0x7f65740764c0 2024-08-26T00:02:22.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.894+0000 7f657c200640 1 -- 172.21.15.42:0/2973990219 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65741ab320 con 0x7f65740764c0 2024-08-26T00:02:22.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.895+0000 7f657c200640 1 -- 172.21.15.42:0/2973990219 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65740768a0 con 0x7f65740764c0 2024-08-26T00:02:22.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.899+0000 7f6572000640 1 -- 172.21.15.42:0/2973990219 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6568042070 con 0x7f65740764c0 2024-08-26T00:02:22.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.900+0000 7f6572000640 1 --2- 172.21.15.42:0/2973990219 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f655c0a2b80 0x7f655c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:22.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.900+0000 7f6572000640 1 -- 172.21.15.42:0/2973990219 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f65680efc00 con 0x7f65740764c0 2024-08-26T00:02:22.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.900+0000 7f6578e00640 1 --2- 172.21.15.42:0/2973990219 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f655c0a2b80 0x7f655c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:22.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.901+0000 7f6578e00640 1 --2- 172.21.15.42:0/2973990219 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f655c0a2b80 0x7f655c0a5040 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6574079110 tx=0x7f6560005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:22.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:22.903+0000 7f6572000640 1 -- 172.21.15.42:0/2973990219 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f65680bc590 con 0x7f65740764c0 2024-08-26T00:02:23.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:23.124+0000 7f657c200640 1 -- 172.21.15.42:0/2973990219 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f657410d960 con 0x7f65740764c0 2024-08-26T00:02:23.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:23.125+0000 7f6572000640 1 -- 172.21.15.42:0/2973990219 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) ==== 53+0+73 (secure 0 0 0) 0x7f65680c0890 con 0x7f65740764c0 2024-08-26T00:02:23.126 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-26T00:02:23.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:23.127+0000 7f657c200640 1 -- 172.21.15.42:0/2973990219 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f655c0a2b80 msgr2=0x7f655c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:23.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:23.127+0000 7f657c200640 1 --2- 172.21.15.42:0/2973990219 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f655c0a2b80 0x7f655c0a5040 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6574079110 tx=0x7f6560005f90 comp rx=0 tx=0).stop 2024-08-26T00:02:23.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:23.127+0000 7f657c200640 1 -- 172.21.15.42:0/2973990219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65740764c0 msgr2=0x7f65741a4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:23.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:23.127+0000 7f657c200640 1 --2- 172.21.15.42:0/2973990219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65740764c0 0x7f65741a4450 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6568004770 tx=0x7f6568003c10 comp rx=0 tx=0).stop 2024-08-26T00:02:23.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:23.128+0000 7f657c200640 1 -- 172.21.15.42:0/2973990219 shutdown_connections 2024-08-26T00:02:23.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:23.128+0000 7f657c200640 1 --2- 172.21.15.42:0/2973990219 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f655c0a2b80 0x7f655c0a5040 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:23.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:23.128+0000 7f657c200640 1 --2- 172.21.15.42:0/2973990219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f65741127d0 0x7f657419e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:23.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:23.128+0000 7f657c200640 1 --2- 172.21.15.42:0/2973990219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6574076de0 0x7f65741a4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:23.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:23.128+0000 7f657c200640 1 --2- 172.21.15.42:0/2973990219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65740764c0 0x7f65741a4450 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:23.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:23.128+0000 7f657c200640 1 -- 172.21.15.42:0/2973990219 >> 172.21.15.42:0/2973990219 conn(0x7f65740ff830 msgr2=0x7f6574101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:23.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:23.128+0000 7f657c200640 1 -- 172.21.15.42:0/2973990219 shutdown_connections 2024-08-26T00:02:23.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:23.128+0000 7f657c200640 1 -- 172.21.15.42:0/2973990219 wait complete. 2024-08-26T00:02:23.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:23 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2973990219' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-26T00:02:23.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:23 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/2973990219' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-26T00:02:23.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:23 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/2973990219' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-26T00:02:23.971 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-26T00:02:23.971 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-26T00:02:23.971 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-08-26T00:02:23.971 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-26T00:02:23.971 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-26T00:02:23.972 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-26T00:02:23.972 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-26T00:02:23.972 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-26T00:02:23.972 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-26T00:02:23.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-26T00:02:23.972 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-08-26T00:02:24.009 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-26T00:02:24.009 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-26T00:02:24.009 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-08-26T00:02:24.009 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-26T00:02:24.009 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-08-26T00:02:24.009 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-26T00:02:24.009 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-26T00:02:24.010 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-08-26T00:02:24.010 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-08-26T00:02:24.010 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-26T00:02:24.010 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-08-26T00:02:24.010 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-08-26T00:02:24.010 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-26T00:02:24.010 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-08-26T00:02:24.010 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-08-26T00:02:24.010 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-26T00:02:24.010 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42307sec preferred_lft 42307sec 2024-08-26T00:02:24.010 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-08-26T00:02:24.010 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-26T00:02:24.011 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-26T00:02:24.011 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-08-26T00:02:24.011 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-08-26T00:02:24.011 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-26T00:02:24.011 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-26T00:02:24.011 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-08-26T00:02:24.011 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add name ceph-brx type bridge 2024-08-26T00:02:24.012 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr flush dev ceph-brx 2024-08-26T00:02:24.012 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set ceph-brx up 2024-08-26T00:02:24.012 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-26T00:02:24.012 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-08-26T00:02:24.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-26T00:02:24.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-26T00:02:24.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-26T00:02:24.425 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-26T00:02:24.442 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:24 smithi042 ceph-mon[17225]: pgmap v335: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:02:24.482 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-08-26T00:02:24.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-26T00:02:24.486 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-08-26T00:02:24.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:24 smithi043 ceph-mon[22091]: pgmap v335: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:02:24.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:24 smithi181 ceph-mon[22102]: pgmap v335: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:02:24.584 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-08-26T00:02:24.585 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-26T00:02:24.585 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-26T00:02:24.585 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-26T00:02:24.585 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-26T00:02:24.585 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-26T00:02:24.585 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-08-26T00:02:24.586 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-26T00:02:24.586 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-26T00:02:24.586 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-26T00:02:24.586 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-08-26T00:02:24.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-26T00:02:25.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-26T00:02:25.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-26T00:02:25.215 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-08-26T00:02:25.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-26T00:02:25.252 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list-id 2024-08-26T00:02:25.328 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-26T00:02:25.328 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-08-26T00:02:25.328 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-26T00:02:25.328 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-26T00:02:25.328 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-08-26T00:02:25.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-26T00:02:25.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-26T00:02:25.506 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-26T00:02:25.506 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-26T00:02:25.507 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-08-26T00:02:25.507 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-26T00:02:25.507 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-26T00:02:25.507 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-26T00:02:25.507 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-26T00:02:25.507 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-26T00:02:25.507 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-08-26T00:02:25.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-26T00:02:25.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-26T00:02:25.765 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-26T00:02:25.765 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-08-26T00:02:25.765 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-08-26T00:02:25.766 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set dev brx.0 master ceph-brx 2024-08-26T00:02:25.766 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-08-26T00:02:25.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-26T00:02:25.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-26T00:02:25.933 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-26T00:02:25.933 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-26T00:02:25.969 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-26T00:02:25.969 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-26T00:02:25.969 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-26T00:02:26.044 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-08-26T00:02:26.044 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-08-26T00:02:26.044 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750 2024-08-26T00:02:26.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-26T00:02:26.044 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,nofallback 2024-08-26T00:02:26.191 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,nofallback 2024-08-26T00:02:26.192 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync". 2024-08-26T00:02:26.401 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:26 smithi042 ceph-mon[17225]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:02:26.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:26 smithi043 ceph-mon[22091]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:02:26.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:26 smithi181 ceph-mon[22102]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:02:26.814 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,nofallback 2024-08-26T00:02:26.815 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync". 2024-08-26T00:02:26.815 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.181:3300" 2024-08-26T00:02:26.815 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with new device syntax: 0@f89d317a-633c-11ef-bcd2-c7b262605968.cephfs=/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750 2024-08-26T00:02:26.815 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync,name=0,key=0,mon_addr=172.21.15.42:3300/172.21.15.43:3300/172.21.15.181:3300" will pass to kernel 2024-08-26T00:02:26.817 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-26T00:02:26.818 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-08-26T00:02:26.818 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-26T00:02:26.818 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-08-26T00:02:26.818 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-26T00:02:26.821 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-26T00:02:26.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-26T00:02:26.821 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-26T00:02:26.884 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-26T00:02:26.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-26T00:02:26.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-26T00:02:26.976 INFO:teuthology.orchestra.run.smithi042.stdout:client25040 2024-08-26T00:02:26.977 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-26T00:02:26.977 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-26T00:02:27.014 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-26T00:02:27.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-26T00:02:27.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-26T00:02:27.147 INFO:teuthology.orchestra.run.smithi042.stdout:client25040 2024-08-26T00:02:27.147 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-26T00:02:27.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-26T00:02:27.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-26T00:02:27.238 INFO:teuthology.orchestra.run.smithi042.stdout:client25040 2024-08-26T00:02:27.238 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f89d317a-633c-11ef-bcd2-c7b262605968.client25040/status') 2024-08-26T00:02:27.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-26T00:02:27.339 INFO:teuthology.orchestra.run.smithi042.stdout:instance: client.25040 (3)172.21.15.42:0/970673996 2024-08-26T00:02:27.339 INFO:teuthology.orchestra.run.smithi042.stdout:blocklisted: false 2024-08-26T00:02:27.339 INFO:teuthology.orchestra.run.smithi042.stderr:0+1 records in 2024-08-26T00:02:27.339 INFO:teuthology.orchestra.run.smithi042.stderr:0+1 records out 2024-08-26T00:02:27.339 INFO:teuthology.orchestra.run.smithi042.stderr:70 bytes copied, 7.3019e-05 s, 959 kB/s 2024-08-26T00:02:27.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-26T00:02:27.350 INFO:teuthology.run_tasks:Running task exec... 2024-08-26T00:02:27.359 INFO:teuthology.task.exec:Executing custom commands... 2024-08-26T00:02:27.359 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi042.front.sepia.ceph.com 2024-08-26T00:02:27.359 DEBUG:teuthology.orchestra.run.smithi042:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-08-26T00:02:27.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.515+0000 7f4051400640 1 -- 172.21.15.42:0/842905411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f404c1056b0 msgr2=0x7f404c10bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:27.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.515+0000 7f4051400640 1 --2- 172.21.15.42:0/842905411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f404c1056b0 0x7f404c10bf40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4044009ca0 tx=0x7f404402a8c0 comp rx=0 tx=0).stop 2024-08-26T00:02:27.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.515+0000 7f4051400640 1 -- 172.21.15.42:0/842905411 shutdown_connections 2024-08-26T00:02:27.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.515+0000 7f4051400640 1 --2- 172.21.15.42:0/842905411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f404c1056b0 0x7f404c10bf40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:27.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.515+0000 7f4051400640 1 --2- 172.21.15.42:0/842905411 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f404c104cf0 0x7f404c105170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:27.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.515+0000 7f4051400640 1 --2- 172.21.15.42:0/842905411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f404c103b00 0x7f404c103f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:27.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.515+0000 7f4051400640 1 -- 172.21.15.42:0/842905411 >> 172.21.15.42:0/842905411 conn(0x7f404c0ff280 msgr2=0x7f404c1016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:27.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.515+0000 7f4051400640 1 -- 172.21.15.42:0/842905411 shutdown_connections 2024-08-26T00:02:27.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.515+0000 7f4051400640 1 -- 172.21.15.42:0/842905411 wait complete. 2024-08-26T00:02:27.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.516+0000 7f4051400640 1 Processor -- start 2024-08-26T00:02:27.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.516+0000 7f4051400640 1 -- start start 2024-08-26T00:02:27.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.517+0000 7f4051400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f404c103b00 0x7f404c199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:27.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.517+0000 7f4051400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f404c104cf0 0x7f404c19a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:27.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.517+0000 7f4051400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f404c1056b0 0x7f404c1a1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:27.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.517+0000 7f4051400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f404c10f7d0 con 0x7f404c104cf0 2024-08-26T00:02:27.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.517+0000 7f4051400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f404c10f650 con 0x7f404c1056b0 2024-08-26T00:02:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.517+0000 7f4051400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f404c10f950 con 0x7f404c103b00 2024-08-26T00:02:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.517+0000 7f4043e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f404c104cf0 0x7f404c19a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.517+0000 7f4043e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f404c104cf0 0x7f404c19a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41984/0 (socket says 172.21.15.42:41984) 2024-08-26T00:02:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.517+0000 7f4043e00640 1 -- 172.21.15.42:0/4038483222 learned_addr learned my addr 172.21.15.42:0/4038483222 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.517+0000 7f404b200640 1 --2- 172.21.15.42:0/4038483222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f404c1056b0 0x7f404c1a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.517+0000 7f404a800640 1 --2- 172.21.15.42:0/4038483222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f404c103b00 0x7f404c199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.517+0000 7f4043e00640 1 -- 172.21.15.42:0/4038483222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f404c103b00 msgr2=0x7f404c199d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.517+0000 7f4043e00640 1 --2- 172.21.15.42:0/4038483222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f404c103b00 0x7f404c199d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.517+0000 7f4043e00640 1 -- 172.21.15.42:0/4038483222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f404c1056b0 msgr2=0x7f404c1a1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.517+0000 7f4043e00640 1 --2- 172.21.15.42:0/4038483222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f404c1056b0 0x7f404c1a1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.517+0000 7f4043e00640 1 -- 172.21.15.42:0/4038483222 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f404c1a1930 con 0x7f404c104cf0 2024-08-26T00:02:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.517+0000 7f404a800640 1 --2- 172.21.15.42:0/4038483222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f404c103b00 0x7f404c199d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:02:27.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.518+0000 7f4043e00640 1 --2- 172.21.15.42:0/4038483222 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f404c104cf0 0x7f404c19a260 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f403400e9f0 tx=0x7f403400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:27.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.518+0000 7f4043400640 1 -- 172.21.15.42:0/4038483222 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403400cd80 con 0x7f404c104cf0 2024-08-26T00:02:27.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.518+0000 7f4043400640 1 -- 172.21.15.42:0/4038483222 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4034005500 con 0x7f404c104cf0 2024-08-26T00:02:27.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.518+0000 7f4043400640 1 -- 172.21.15.42:0/4038483222 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4034010690 con 0x7f404c104cf0 2024-08-26T00:02:27.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.518+0000 7f4051400640 1 -- 172.21.15.42:0/4038483222 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f404c1a1c20 con 0x7f404c104cf0 2024-08-26T00:02:27.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.518+0000 7f4051400640 1 -- 172.21.15.42:0/4038483222 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f404c1a2120 con 0x7f404c104cf0 2024-08-26T00:02:27.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.519+0000 7f4051400640 1 -- 172.21.15.42:0/4038483222 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f404c10ad50 con 0x7f404c104cf0 2024-08-26T00:02:27.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.521+0000 7f4043400640 1 -- 172.21.15.42:0/4038483222 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f40340046c0 con 0x7f404c104cf0 2024-08-26T00:02:27.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.522+0000 7f4043400640 1 --2- 172.21.15.42:0/4038483222 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f40300a2cb0 0x7f40300a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:27.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.522+0000 7f4043400640 1 -- 172.21.15.42:0/4038483222 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f40340cf540 con 0x7f404c104cf0 2024-08-26T00:02:27.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.522+0000 7f404a800640 1 --2- 172.21.15.42:0/4038483222 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f40300a2cb0 0x7f40300a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:27.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.523+0000 7f404a800640 1 --2- 172.21.15.42:0/4038483222 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f40300a2cb0 0x7f40300a5170 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f404c19b1f0 tx=0x7f403c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:27.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.526+0000 7f4043400640 1 -- 172.21.15.42:0/4038483222 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f403409c460 con 0x7f404c104cf0 2024-08-26T00:02:27.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:27.751+0000 7f4051400640 1 -- 172.21.15.42:0/4038483222 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f404c062c30 con 0x7f404c104cf0 2024-08-26T00:02:28.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.194+0000 7f4043400640 1 -- 172.21.15.42:0/4038483222 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v24) ==== 117+0+0 (secure 0 0 0) 0x7f403409bd60 con 0x7f404c104cf0 2024-08-26T00:02:28.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.197+0000 7f4051400640 1 -- 172.21.15.42:0/4038483222 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f40300a2cb0 msgr2=0x7f40300a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:28.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.197+0000 7f4051400640 1 --2- 172.21.15.42:0/4038483222 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f40300a2cb0 0x7f40300a5170 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f404c19b1f0 tx=0x7f403c005f90 comp rx=0 tx=0).stop 2024-08-26T00:02:28.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.197+0000 7f4051400640 1 -- 172.21.15.42:0/4038483222 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f404c104cf0 msgr2=0x7f404c19a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:28.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.197+0000 7f4051400640 1 --2- 172.21.15.42:0/4038483222 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f404c104cf0 0x7f404c19a260 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f403400e9f0 tx=0x7f403400edf0 comp rx=0 tx=0).stop 2024-08-26T00:02:28.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.197+0000 7f4051400640 1 -- 172.21.15.42:0/4038483222 shutdown_connections 2024-08-26T00:02:28.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.197+0000 7f4051400640 1 --2- 172.21.15.42:0/4038483222 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f40300a2cb0 0x7f40300a5170 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:28.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.197+0000 7f4051400640 1 --2- 172.21.15.42:0/4038483222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f404c1056b0 0x7f404c1a1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:28.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.197+0000 7f4051400640 1 --2- 172.21.15.42:0/4038483222 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f404c104cf0 0x7f404c19a260 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:28.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.197+0000 7f4051400640 1 --2- 172.21.15.42:0/4038483222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f404c103b00 0x7f404c199d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:28.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.197+0000 7f4051400640 1 -- 172.21.15.42:0/4038483222 >> 172.21.15.42:0/4038483222 conn(0x7f404c0ff280 msgr2=0x7f404c107f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:28.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.197+0000 7f4051400640 1 -- 172.21.15.42:0/4038483222 shutdown_connections 2024-08-26T00:02:28.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.197+0000 7f4051400640 1 -- 172.21.15.42:0/4038483222 wait complete. 2024-08-26T00:02:28.215 INFO:teuthology.run_tasks:Running task check-counter... 2024-08-26T00:02:28.245 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-08-26T00:02:28.265 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-26T00:02:28.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.424+0000 7f075d600640 1 -- 172.21.15.42:0/3405588282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0758102180 msgr2=0x7f0758104570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:28.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.424+0000 7f075d600640 1 --2- 172.21.15.42:0/3405588282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0758102180 0x7f0758104570 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0748009900 tx=0x7f074802a3f0 comp rx=0 tx=0).stop 2024-08-26T00:02:28.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.424+0000 7f075d600640 1 -- 172.21.15.42:0/3405588282 shutdown_connections 2024-08-26T00:02:28.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.424+0000 7f075d600640 1 --2- 172.21.15.42:0/3405588282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07581073e0 0x7f0758109850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:28.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.424+0000 7f075d600640 1 --2- 172.21.15.42:0/3405588282 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0758104ab0 0x7f0758106ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:28.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.424+0000 7f075d600640 1 --2- 172.21.15.42:0/3405588282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0758102180 0x7f0758104570 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:28.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.424+0000 7f075d600640 1 -- 172.21.15.42:0/3405588282 >> 172.21.15.42:0/3405588282 conn(0x7f07580fbda0 msgr2=0x7f07580fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:28.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.424+0000 7f075d600640 1 -- 172.21.15.42:0/3405588282 shutdown_connections 2024-08-26T00:02:28.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.424+0000 7f075d600640 1 -- 172.21.15.42:0/3405588282 wait complete. 2024-08-26T00:02:28.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.425+0000 7f075d600640 1 Processor -- start 2024-08-26T00:02:28.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.425+0000 7f075d600640 1 -- start start 2024-08-26T00:02:28.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.425+0000 7f075d600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0758102180 0x7f0758199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:28.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.426+0000 7f075d600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0758104ab0 0x7f075819a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:28.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.426+0000 7f075d600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07581073e0 0x7f07581a1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:28.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.426+0000 7f075d600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f075810d430 con 0x7f0758104ab0 2024-08-26T00:02:28.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.426+0000 7f075d600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f075810d2b0 con 0x7f0758102180 2024-08-26T00:02:28.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.426+0000 7f075d600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f075810d5b0 con 0x7f07581073e0 2024-08-26T00:02:28.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.426+0000 7f0757400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0758104ab0 0x7f075819a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:28.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.426+0000 7f0757400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0758104ab0 0x7f075819a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41994/0 (socket says 172.21.15.42:41994) 2024-08-26T00:02:28.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.426+0000 7f0757400640 1 -- 172.21.15.42:0/1755404066 learned_addr learned my addr 172.21.15.42:0/1755404066 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:28.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.426+0000 7f0757e00640 1 --2- 172.21.15.42:0/1755404066 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0758102180 0x7f0758199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:28.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.426+0000 7f075cc00640 1 --2- 172.21.15.42:0/1755404066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07581073e0 0x7f07581a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:28.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.426+0000 7f0757400640 1 -- 172.21.15.42:0/1755404066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07581073e0 msgr2=0x7f07581a1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:28.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.426+0000 7f0757400640 1 --2- 172.21.15.42:0/1755404066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07581073e0 0x7f07581a1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:28.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.426+0000 7f0757400640 1 -- 172.21.15.42:0/1755404066 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0758102180 msgr2=0x7f0758199d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:28.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.426+0000 7f0757400640 1 --2- 172.21.15.42:0/1755404066 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0758102180 0x7f0758199d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:28.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.426+0000 7f0757400640 1 -- 172.21.15.42:0/1755404066 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07581a1920 con 0x7f0758104ab0 2024-08-26T00:02:28.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.427+0000 7f0757400640 1 --2- 172.21.15.42:0/1755404066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0758104ab0 0x7f075819a250 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f074400e9f0 tx=0x7f074400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:28.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.427+0000 7f0754c00640 1 -- 172.21.15.42:0/1755404066 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074400ccc0 con 0x7f0758104ab0 2024-08-26T00:02:28.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.427+0000 7f0754c00640 1 -- 172.21.15.42:0/1755404066 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0744005500 con 0x7f0758104ab0 2024-08-26T00:02:28.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.427+0000 7f075d600640 1 -- 172.21.15.42:0/1755404066 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07581a1c10 con 0x7f0758104ab0 2024-08-26T00:02:28.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.427+0000 7f0754c00640 1 -- 172.21.15.42:0/1755404066 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0744010690 con 0x7f0758104ab0 2024-08-26T00:02:28.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.427+0000 7f075d600640 1 -- 172.21.15.42:0/1755404066 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07581a2130 con 0x7f0758104ab0 2024-08-26T00:02:28.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.428+0000 7f075d600640 1 -- 172.21.15.42:0/1755404066 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0758108f20 con 0x7f0758104ab0 2024-08-26T00:02:28.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.430+0000 7f0754c00640 1 -- 172.21.15.42:0/1755404066 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f07440046c0 con 0x7f0758104ab0 2024-08-26T00:02:28.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.432+0000 7f0754c00640 1 --2- 172.21.15.42:0/1755404066 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f073c0a2c10 0x7f073c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:28.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.432+0000 7f0754c00640 1 -- 172.21.15.42:0/1755404066 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f07440cf3e0 con 0x7f0758104ab0 2024-08-26T00:02:28.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.432+0000 7f0757e00640 1 --2- 172.21.15.42:0/1755404066 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f073c0a2c10 0x7f073c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:28.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.433+0000 7f0757e00640 1 --2- 172.21.15.42:0/1755404066 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f073c0a2c10 0x7f073c0a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0748031440 tx=0x7f07480315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:28.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.436+0000 7f0754c00640 1 -- 172.21.15.42:0/1755404066 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f074409c300 con 0x7f0758104ab0 2024-08-26T00:02:28.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:28 smithi043 ceph-mon[22091]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:02:28.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:28 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/4038483222' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-08-26T00:02:28.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:28 smithi042 ceph-mon[17225]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:02:28.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:28 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/4038483222' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-08-26T00:02:28.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:28 smithi181 ceph-mon[22102]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:02:28.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:28 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/4038483222' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-08-26T00:02:28.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.626+0000 7f075d600640 1 -- 172.21.15.42:0/1755404066 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0758062c30 con 0x7f0758104ab0 2024-08-26T00:02:28.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.628+0000 7f0754c00640 1 -- 172.21.15.42:0/1755404066 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22625 (secure 0 0 0) 0x7f074409bc00 con 0x7f0758104ab0 2024-08-26T00:02:28.629 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:02:28.629 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":80,"fsid":"f89d317a-633c-11ef-bcd2-c7b262605968","created":"2024-08-25T23:52:39.598509+0000","modified":"2024-08-26T00:01:33.588911+0000","last_up_change":"2024-08-25T23:59:35.047575+0000","last_in_change":"2024-08-25T23:59:12.796940+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-25T23:55:51.022219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-26T00:00:25.606536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-26T00:00:28.322822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"980d8635-bca1-4c5a-b78e-4b44f9315d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6803","nonce":2657450248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6805","nonce":2657450248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6809","nonce":2657450248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6807","nonce":2657450248}]},"public_addr":"172.21.15.42:6803/2657450248","cluster_addr":"172.21.15.42:6805/2657450248","heartbeat_back_addr":"172.21.15.42:6809/2657450248","heartbeat_front_addr":"172.21.15.42:6807/2657450248","state":["exists","up"]},{"osd":1,"uuid":"e5f8dc3b-876a-4bdd-b6b0-b0d99d098d95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6801","nonce":2396081001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6803","nonce":2396081001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6807","nonce":2396081001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6805","nonce":2396081001}]},"public_addr":"172.21.15.43:6801/2396081001","cluster_addr":"172.21.15.43:6803/2396081001","heartbeat_back_addr":"172.21.15.43:6807/2396081001","heartbeat_front_addr":"172.21.15.43:6805/2396081001","state":["exists","up"]},{"osd":2,"uuid":"06eb25af-8e3d-4f90-bc24-28a9bc224c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6801","nonce":189987070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6803","nonce":189987070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6807","nonce":189987070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6805","nonce":189987070}]},"public_addr":"172.21.15.181:6801/189987070","cluster_addr":"172.21.15.181:6803/189987070","heartbeat_back_addr":"172.21.15.181:6807/189987070","heartbeat_front_addr":"172.21.15.181:6805/189987070","state":["exists","up"]},{"osd":3,"uuid":"c78dbc49-b5c7-4f82-be36-c76a89496520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6811","nonce":251017896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6813","nonce":251017896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6817","nonce":251017896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6815","nonce":251017896}]},"public_addr":"172.21.15.42:6811/251017896","cluster_addr":"172.21.15.42:6813/251017896","heartbeat_back_addr":"172.21.15.42:6817/251017896","heartbeat_front_addr":"172.21.15.42:6815/251017896","state":["exists","up"]},{"osd":4,"uuid":"ba633f66-25af-492f-bbf2-76032a4cd3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6809","nonce":1315420796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6811","nonce":1315420796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6815","nonce":1315420796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6813","nonce":1315420796}]},"public_addr":"172.21.15.43:6809/1315420796","cluster_addr":"172.21.15.43:6811/1315420796","heartbeat_back_addr":"172.21.15.43:6815/1315420796","heartbeat_front_addr":"172.21.15.43:6813/1315420796","state":["exists","up"]},{"osd":5,"uuid":"04e47ad9-21ba-43da-9793-d5cf83150dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6809","nonce":246971403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6811","nonce":246971403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6815","nonce":246971403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6813","nonce":246971403}]},"public_addr":"172.21.15.181:6809/246971403","cluster_addr":"172.21.15.181:6811/246971403","heartbeat_back_addr":"172.21.15.181:6815/246971403","heartbeat_front_addr":"172.21.15.181:6813/246971403","state":["exists","up"]},{"osd":6,"uuid":"f48161cd-bc44-4d99-8248-1bb845111129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6819","nonce":2910656480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6821","nonce":2910656480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6825","nonce":2910656480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6823","nonce":2910656480}]},"public_addr":"172.21.15.42:6819/2910656480","cluster_addr":"172.21.15.42:6821/2910656480","heartbeat_back_addr":"172.21.15.42:6825/2910656480","heartbeat_front_addr":"172.21.15.42:6823/2910656480","state":["exists","up"]},{"osd":7,"uuid":"65470b06-b14d-4d8e-9bcb-e6927c37fda5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6817","nonce":624542778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6819","nonce":624542778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6823","nonce":624542778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6821","nonce":624542778}]},"public_addr":"172.21.15.43:6817/624542778","cluster_addr":"172.21.15.43:6819/624542778","heartbeat_back_addr":"172.21.15.43:6823/624542778","heartbeat_front_addr":"172.21.15.43:6821/624542778","state":["exists","up"]},{"osd":8,"uuid":"1f4c9152-4b7c-415f-9cb9-d1e926fad5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6817","nonce":728226568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6819","nonce":728226568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6823","nonce":728226568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6821","nonce":728226568}]},"public_addr":"172.21.15.181:6817/728226568","cluster_addr":"172.21.15.181:6819/728226568","heartbeat_back_addr":"172.21.15.181:6823/728226568","heartbeat_front_addr":"172.21.15.181:6821/728226568","state":["exists","up"]},{"osd":9,"uuid":"fb387fbe-19b4-4a3e-8e40-81bd1363b55c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6827","nonce":1052069444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6829","nonce":1052069444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6833","nonce":1052069444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6831","nonce":1052069444}]},"public_addr":"172.21.15.42:6827/1052069444","cluster_addr":"172.21.15.42:6829/1052069444","heartbeat_back_addr":"172.21.15.42:6833/1052069444","heartbeat_front_addr":"172.21.15.42:6831/1052069444","state":["exists","up"]},{"osd":10,"uuid":"fe5bbeec-2341-4ea9-97ab-cc45d738d741","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6825","nonce":3417487386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6827","nonce":3417487386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6831","nonce":3417487386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6829","nonce":3417487386}]},"public_addr":"172.21.15.43:6825/3417487386","cluster_addr":"172.21.15.43:6827/3417487386","heartbeat_back_addr":"172.21.15.43:6831/3417487386","heartbeat_front_addr":"172.21.15.43:6829/3417487386","state":["exists","up"]},{"osd":11,"uuid":"cee07741-3ab7-481e-8477-54319f4f178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6825","nonce":3817502913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6827","nonce":3817502913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6831","nonce":3817502913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6829","nonce":3817502913}]},"public_addr":"172.21.15.181:6825/3817502913","cluster_addr":"172.21.15.181:6827/3817502913","heartbeat_back_addr":"172.21.15.181:6831/3817502913","heartbeat_front_addr":"172.21.15.181:6829/3817502913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:00.603592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:24.637326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:47.587859+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:14.978783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:39.025819+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:01.965471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:29.753475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:54.162377+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:17.970871+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:46.175576+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:10.590220+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:33.216701+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/3711239085":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6801/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2983166615":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/2974122891":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2980210051":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/4227793902":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6801/1517739376":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6800/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/1775009918":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6800/1517739376":"2024-08-26T23:53:05.122858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-26T00:02:28.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.630+0000 7f075d600640 1 -- 172.21.15.42:0/1755404066 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f073c0a2c10 msgr2=0x7f073c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:28.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.630+0000 7f075d600640 1 --2- 172.21.15.42:0/1755404066 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f073c0a2c10 0x7f073c0a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0748031440 tx=0x7f07480315b0 comp rx=0 tx=0).stop 2024-08-26T00:02:28.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.630+0000 7f075d600640 1 -- 172.21.15.42:0/1755404066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0758104ab0 msgr2=0x7f075819a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:28.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.630+0000 7f075d600640 1 --2- 172.21.15.42:0/1755404066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0758104ab0 0x7f075819a250 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f074400e9f0 tx=0x7f074400eeb0 comp rx=0 tx=0).stop 2024-08-26T00:02:28.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.630+0000 7f075d600640 1 -- 172.21.15.42:0/1755404066 shutdown_connections 2024-08-26T00:02:28.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.630+0000 7f075d600640 1 --2- 172.21.15.42:0/1755404066 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f073c0a2c10 0x7f073c0a50d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:28.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.630+0000 7f075d600640 1 --2- 172.21.15.42:0/1755404066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07581073e0 0x7f07581a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:28.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.630+0000 7f075d600640 1 --2- 172.21.15.42:0/1755404066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0758104ab0 0x7f075819a250 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:28.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.630+0000 7f075d600640 1 --2- 172.21.15.42:0/1755404066 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0758102180 0x7f0758199d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:28.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.630+0000 7f075d600640 1 -- 172.21.15.42:0/1755404066 >> 172.21.15.42:0/1755404066 conn(0x7f07580fbda0 msgr2=0x7f0758101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:28.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.630+0000 7f075d600640 1 -- 172.21.15.42:0/1755404066 shutdown_connections 2024-08-26T00:02:28.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.630+0000 7f075d600640 1 -- 172.21.15.42:0/1755404066 wait complete. 2024-08-26T00:02:28.648 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-25T23:55:51.022219+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-26T00:00:25.606536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-26T00:00:28.322822+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-26T00:02:28.649 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-26T00:02:28.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.809+0000 7fa33be00640 1 -- 172.21.15.42:0/1625192815 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa33c104ba0 msgr2=0x7fa33c105020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:28.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.809+0000 7fa33be00640 1 --2- 172.21.15.42:0/1625192815 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa33c104ba0 0x7fa33c105020 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa328009860 tx=0x7fa32802a340 comp rx=0 tx=0).stop 2024-08-26T00:02:28.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.809+0000 7fa33be00640 1 -- 172.21.15.42:0/1625192815 shutdown_connections 2024-08-26T00:02:28.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.809+0000 7fa33be00640 1 --2- 172.21.15.42:0/1625192815 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa33c105560 0x7fa33c10bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:28.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.809+0000 7fa33be00640 1 --2- 172.21.15.42:0/1625192815 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa33c104ba0 0x7fa33c105020 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:28.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.809+0000 7fa33be00640 1 --2- 172.21.15.42:0/1625192815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa33c1039b0 0x7fa33c103db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:28.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.809+0000 7fa33be00640 1 -- 172.21.15.42:0/1625192815 >> 172.21.15.42:0/1625192815 conn(0x7fa33c0ff130 msgr2=0x7fa33c101550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:28.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.809+0000 7fa33be00640 1 -- 172.21.15.42:0/1625192815 shutdown_connections 2024-08-26T00:02:28.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.810+0000 7fa33be00640 1 -- 172.21.15.42:0/1625192815 wait complete. 2024-08-26T00:02:28.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.810+0000 7fa33be00640 1 Processor -- start 2024-08-26T00:02:28.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.811+0000 7fa33be00640 1 -- start start 2024-08-26T00:02:28.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.811+0000 7fa33be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa33c1039b0 0x7fa33c199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:28.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.811+0000 7fa33be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa33c104ba0 0x7fa33c19a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:28.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.811+0000 7fa33be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa33c105560 0x7fa33c1a1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:28.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.811+0000 7fa33be00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa33c10f630 con 0x7fa33c104ba0 2024-08-26T00:02:28.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.811+0000 7fa33be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa33c10f4b0 con 0x7fa33c1039b0 2024-08-26T00:02:28.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.811+0000 7fa33be00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa33c10f7b0 con 0x7fa33c105560 2024-08-26T00:02:28.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.811+0000 7fa33a000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa33c104ba0 0x7fa33c19a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:28.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.811+0000 7fa33a000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa33c104ba0 0x7fa33c19a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42012/0 (socket says 172.21.15.42:42012) 2024-08-26T00:02:28.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.811+0000 7fa33a000640 1 -- 172.21.15.42:0/2733850195 learned_addr learned my addr 172.21.15.42:0/2733850195 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:28.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.811+0000 7fa33aa00640 1 --2- 172.21.15.42:0/2733850195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa33c1039b0 0x7fa33c199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:28.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.811+0000 7fa33b400640 1 --2- 172.21.15.42:0/2733850195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa33c105560 0x7fa33c1a1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:28.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.811+0000 7fa33a000640 1 -- 172.21.15.42:0/2733850195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa33c105560 msgr2=0x7fa33c1a1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:28.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.812+0000 7fa33a000640 1 --2- 172.21.15.42:0/2733850195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa33c105560 0x7fa33c1a1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:28.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.812+0000 7fa33a000640 1 -- 172.21.15.42:0/2733850195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa33c1039b0 msgr2=0x7fa33c199cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:28.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.812+0000 7fa33a000640 1 --2- 172.21.15.42:0/2733850195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa33c1039b0 0x7fa33c199cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:28.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.812+0000 7fa33a000640 1 -- 172.21.15.42:0/2733850195 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa33c1a1900 con 0x7fa33c104ba0 2024-08-26T00:02:28.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.812+0000 7fa33a000640 1 --2- 172.21.15.42:0/2733850195 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa33c104ba0 0x7fa33c19a200 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa328035040 tx=0x7fa328033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:28.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.812+0000 7fa333400640 1 -- 172.21.15.42:0/2733850195 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa328037040 con 0x7fa33c104ba0 2024-08-26T00:02:28.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.812+0000 7fa333400640 1 -- 172.21.15.42:0/2733850195 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa328030850 con 0x7fa33c104ba0 2024-08-26T00:02:28.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.812+0000 7fa333400640 1 -- 172.21.15.42:0/2733850195 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa328004920 con 0x7fa33c104ba0 2024-08-26T00:02:28.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.812+0000 7fa33be00640 1 -- 172.21.15.42:0/2733850195 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa33c1a1b90 con 0x7fa33c104ba0 2024-08-26T00:02:28.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.812+0000 7fa33be00640 1 -- 172.21.15.42:0/2733850195 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa33c1a2030 con 0x7fa33c104ba0 2024-08-26T00:02:28.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.813+0000 7fa33be00640 1 -- 172.21.15.42:0/2733850195 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa33c10ad90 con 0x7fa33c104ba0 2024-08-26T00:02:28.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.815+0000 7fa333400640 1 -- 172.21.15.42:0/2733850195 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa328004050 con 0x7fa33c104ba0 2024-08-26T00:02:28.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.816+0000 7fa333400640 1 --2- 172.21.15.42:0/2733850195 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa3200a2b90 0x7fa3200a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:28.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.817+0000 7fa333400640 1 -- 172.21.15.42:0/2733850195 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fa3280ef070 con 0x7fa33c104ba0 2024-08-26T00:02:28.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.817+0000 7fa33aa00640 1 --2- 172.21.15.42:0/2733850195 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa3200a2b90 0x7fa3200a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:28.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.818+0000 7fa33aa00640 1 --2- 172.21.15.42:0/2733850195 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa3200a2b90 0x7fa3200a5050 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa33c19ab90 tx=0x7fa32c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:28.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:28.821+0000 7fa333400640 1 -- 172.21.15.42:0/2733850195 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa3280bbf90 con 0x7fa33c104ba0 2024-08-26T00:02:29.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.009+0000 7fa33be00640 1 -- 172.21.15.42:0/2733850195 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa33c062b90 con 0x7fa33c104ba0 2024-08-26T00:02:29.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.009+0000 7fa333400640 1 -- 172.21.15.42:0/2733850195 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) ==== 93+0+10 (secure 0 0 0) 0x7fa3280a4e20 con 0x7fa33c104ba0 2024-08-26T00:02:29.011 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-08-26T00:02:29.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.012+0000 7fa33be00640 1 -- 172.21.15.42:0/2733850195 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa3200a2b90 msgr2=0x7fa3200a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:29.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.012+0000 7fa33be00640 1 --2- 172.21.15.42:0/2733850195 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa3200a2b90 0x7fa3200a5050 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa33c19ab90 tx=0x7fa32c005f90 comp rx=0 tx=0).stop 2024-08-26T00:02:29.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.012+0000 7fa33be00640 1 -- 172.21.15.42:0/2733850195 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa33c104ba0 msgr2=0x7fa33c19a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:29.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.012+0000 7fa33be00640 1 --2- 172.21.15.42:0/2733850195 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa33c104ba0 0x7fa33c19a200 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa328035040 tx=0x7fa328033d90 comp rx=0 tx=0).stop 2024-08-26T00:02:29.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.012+0000 7fa33be00640 1 -- 172.21.15.42:0/2733850195 shutdown_connections 2024-08-26T00:02:29.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.012+0000 7fa33be00640 1 --2- 172.21.15.42:0/2733850195 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa3200a2b90 0x7fa3200a5050 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.012+0000 7fa33be00640 1 --2- 172.21.15.42:0/2733850195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa33c105560 0x7fa33c1a1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.012+0000 7fa33be00640 1 --2- 172.21.15.42:0/2733850195 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa33c104ba0 0x7fa33c19a200 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.012+0000 7fa33be00640 1 --2- 172.21.15.42:0/2733850195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa33c1039b0 0x7fa33c199cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.012+0000 7fa33be00640 1 -- 172.21.15.42:0/2733850195 >> 172.21.15.42:0/2733850195 conn(0x7fa33c0ff130 msgr2=0x7fa33c107f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:29.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.012+0000 7fa33be00640 1 -- 172.21.15.42:0/2733850195 shutdown_connections 2024-08-26T00:02:29.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.012+0000 7fa33be00640 1 -- 172.21.15.42:0/2733850195 wait complete. 2024-08-26T00:02:29.030 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-26T00:02:29.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.191+0000 7fd306e00640 1 -- 172.21.15.42:0/14367290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd300103ac0 msgr2=0x7fd300103ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:29.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.191+0000 7fd306e00640 1 --2- 172.21.15.42:0/14367290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd300103ac0 0x7fd300103ec0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009900 tx=0x7fd2f002a3f0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.191+0000 7fd306e00640 1 -- 172.21.15.42:0/14367290 shutdown_connections 2024-08-26T00:02:29.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.191+0000 7fd306e00640 1 --2- 172.21.15.42:0/14367290 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd300105670 0x7fd30010bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.191+0000 7fd306e00640 1 --2- 172.21.15.42:0/14367290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd300104cb0 0x7fd300105130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.191+0000 7fd306e00640 1 --2- 172.21.15.42:0/14367290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd300103ac0 0x7fd300103ec0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.191+0000 7fd306e00640 1 -- 172.21.15.42:0/14367290 >> 172.21.15.42:0/14367290 conn(0x7fd3000ff240 msgr2=0x7fd300101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:29.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.191+0000 7fd306e00640 1 -- 172.21.15.42:0/14367290 shutdown_connections 2024-08-26T00:02:29.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.191+0000 7fd306e00640 1 -- 172.21.15.42:0/14367290 wait complete. 2024-08-26T00:02:29.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.192+0000 7fd306e00640 1 Processor -- start 2024-08-26T00:02:29.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.192+0000 7fd306e00640 1 -- start start 2024-08-26T00:02:29.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.192+0000 7fd306e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd300103ac0 0x7fd300199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:29.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.192+0000 7fd306e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd300104cb0 0x7fd30019a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:29.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.192+0000 7fd306e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd300105670 0x7fd3001a1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:29.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.192+0000 7fd306e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd30010f790 con 0x7fd300104cb0 2024-08-26T00:02:29.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.192+0000 7fd306e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd30010f610 con 0x7fd300103ac0 2024-08-26T00:02:29.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.192+0000 7fd306e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd30010f910 con 0x7fd300105670 2024-08-26T00:02:29.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.193+0000 7fd2ff400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd300104cb0 0x7fd30019a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:29.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.193+0000 7fd2ff400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd300104cb0 0x7fd30019a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42040/0 (socket says 172.21.15.42:42040) 2024-08-26T00:02:29.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.193+0000 7fd2ff400640 1 -- 172.21.15.42:0/4271498692 learned_addr learned my addr 172.21.15.42:0/4271498692 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:29.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.193+0000 7fd2ffe00640 1 --2- 172.21.15.42:0/4271498692 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd300103ac0 0x7fd300199e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:29.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.193+0000 7fd304e00640 1 --2- 172.21.15.42:0/4271498692 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd300105670 0x7fd3001a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:29.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.193+0000 7fd2ff400640 1 -- 172.21.15.42:0/4271498692 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd300105670 msgr2=0x7fd3001a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:29.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.193+0000 7fd2ff400640 1 --2- 172.21.15.42:0/4271498692 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd300105670 0x7fd3001a1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.193+0000 7fd2ff400640 1 -- 172.21.15.42:0/4271498692 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd300103ac0 msgr2=0x7fd300199e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:29.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.193+0000 7fd2ff400640 1 --2- 172.21.15.42:0/4271498692 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd300103ac0 0x7fd300199e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.193+0000 7fd2ff400640 1 -- 172.21.15.42:0/4271498692 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3001a1a70 con 0x7fd300104cb0 2024-08-26T00:02:29.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.193+0000 7fd2ff400640 1 --2- 172.21.15.42:0/4271498692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd300104cb0 0x7fd30019a390 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec00e9f0 tx=0x7fd2ec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:29.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.194+0000 7fd2fcc00640 1 -- 172.21.15.42:0/4271498692 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec00cd80 con 0x7fd300104cb0 2024-08-26T00:02:29.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.194+0000 7fd306e00640 1 -- 172.21.15.42:0/4271498692 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3001a1d60 con 0x7fd300104cb0 2024-08-26T00:02:29.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.194+0000 7fd306e00640 1 -- 172.21.15.42:0/4271498692 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3001a2250 con 0x7fd300104cb0 2024-08-26T00:02:29.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.194+0000 7fd2fcc00640 1 -- 172.21.15.42:0/4271498692 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2ec005500 con 0x7fd300104cb0 2024-08-26T00:02:29.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.194+0000 7fd2fcc00640 1 -- 172.21.15.42:0/4271498692 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec010690 con 0x7fd300104cb0 2024-08-26T00:02:29.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.195+0000 7fd306e00640 1 -- 172.21.15.42:0/4271498692 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e00052c0 con 0x7fd300104cb0 2024-08-26T00:02:29.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.198+0000 7fd2fcc00640 1 -- 172.21.15.42:0/4271498692 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd2ec0046c0 con 0x7fd300104cb0 2024-08-26T00:02:29.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.199+0000 7fd2fcc00640 1 --2- 172.21.15.42:0/4271498692 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd2e40a2c10 0x7fd2e40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:29.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.199+0000 7fd2fcc00640 1 -- 172.21.15.42:0/4271498692 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fd2ec0cf2b0 con 0x7fd300104cb0 2024-08-26T00:02:29.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.199+0000 7fd2ffe00640 1 --2- 172.21.15.42:0/4271498692 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd2e40a2c10 0x7fd2e40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:29.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.200+0000 7fd2ffe00640 1 --2- 172.21.15.42:0/4271498692 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd2e40a2c10 0x7fd2e40a50d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd2f002a9e0 tx=0x7fd2f00315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:29.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.203+0000 7fd2fcc00640 1 -- 172.21.15.42:0/4271498692 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd2ec09c210 con 0x7fd300104cb0 2024-08-26T00:02:29.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:29 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/4038483222' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-26T00:02:29.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:29 smithi042 ceph-mon[17225]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:02:29.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:29 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1755404066' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:02:29.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:29 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2733850195' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-26T00:02:29.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.393+0000 7fd306e00640 1 -- 172.21.15.42:0/4271498692 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd2e0005dc0 con 0x7fd300104cb0 2024-08-26T00:02:29.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.394+0000 7fd2fcc00640 1 -- 172.21.15.42:0/4271498692 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) ==== 104+0+11 (secure 0 0 0) 0x7fd2ec09bb10 con 0x7fd300104cb0 2024-08-26T00:02:29.395 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-08-26T00:02:29.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.396+0000 7fd306e00640 1 -- 172.21.15.42:0/4271498692 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd2e40a2c10 msgr2=0x7fd2e40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:29.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.396+0000 7fd306e00640 1 --2- 172.21.15.42:0/4271498692 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd2e40a2c10 0x7fd2e40a50d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd2f002a9e0 tx=0x7fd2f00315b0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.396+0000 7fd306e00640 1 -- 172.21.15.42:0/4271498692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd300104cb0 msgr2=0x7fd30019a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:29.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.396+0000 7fd306e00640 1 --2- 172.21.15.42:0/4271498692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd300104cb0 0x7fd30019a390 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec00e9f0 tx=0x7fd2ec00edf0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.396+0000 7fd306e00640 1 -- 172.21.15.42:0/4271498692 shutdown_connections 2024-08-26T00:02:29.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.396+0000 7fd306e00640 1 --2- 172.21.15.42:0/4271498692 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd2e40a2c10 0x7fd2e40a50d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.396+0000 7fd306e00640 1 --2- 172.21.15.42:0/4271498692 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd300105670 0x7fd3001a1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.396+0000 7fd306e00640 1 --2- 172.21.15.42:0/4271498692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd300104cb0 0x7fd30019a390 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.396+0000 7fd306e00640 1 --2- 172.21.15.42:0/4271498692 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd300103ac0 0x7fd300199e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.396+0000 7fd306e00640 1 -- 172.21.15.42:0/4271498692 >> 172.21.15.42:0/4271498692 conn(0x7fd3000ff240 msgr2=0x7fd300108070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:29.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.396+0000 7fd306e00640 1 -- 172.21.15.42:0/4271498692 shutdown_connections 2024-08-26T00:02:29.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.396+0000 7fd306e00640 1 -- 172.21.15.42:0/4271498692 wait complete. 2024-08-26T00:02:29.413 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-26T00:02:29.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:29 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/4038483222' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-26T00:02:29.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:29 smithi043 ceph-mon[22091]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:02:29.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:29 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1755404066' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:02:29.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:29 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/2733850195' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-26T00:02:29.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:29 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/4038483222' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-26T00:02:29.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:29 smithi181 ceph-mon[22102]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:02:29.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:29 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1755404066' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:02:29.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:29 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/2733850195' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-26T00:02:29.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.573+0000 7f3a1a800640 1 -- 172.21.15.42:0/1522529452 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a141039b0 msgr2=0x7f3a14103db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:29.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.573+0000 7f3a1a800640 1 --2- 172.21.15.42:0/1522529452 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a141039b0 0x7f3a14103db0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3a08009900 tx=0x7f3a0802a410 comp rx=0 tx=0).stop 2024-08-26T00:02:29.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.574+0000 7f3a1a800640 1 -- 172.21.15.42:0/1522529452 shutdown_connections 2024-08-26T00:02:29.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.574+0000 7f3a1a800640 1 --2- 172.21.15.42:0/1522529452 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a14105560 0x7f3a1410bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.574+0000 7f3a1a800640 1 --2- 172.21.15.42:0/1522529452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a14104ba0 0x7f3a14105020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.574+0000 7f3a1a800640 1 --2- 172.21.15.42:0/1522529452 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a141039b0 0x7f3a14103db0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.574+0000 7f3a1a800640 1 -- 172.21.15.42:0/1522529452 >> 172.21.15.42:0/1522529452 conn(0x7f3a140ff130 msgr2=0x7f3a14101550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:29.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.574+0000 7f3a1a800640 1 -- 172.21.15.42:0/1522529452 shutdown_connections 2024-08-26T00:02:29.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.574+0000 7f3a1a800640 1 -- 172.21.15.42:0/1522529452 wait complete. 2024-08-26T00:02:29.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.574+0000 7f3a1a800640 1 Processor -- start 2024-08-26T00:02:29.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.575+0000 7f3a1a800640 1 -- start start 2024-08-26T00:02:29.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.575+0000 7f3a1a800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a141039b0 0x7f3a14199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:29.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.575+0000 7f3a1a800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a14104ba0 0x7f3a1419a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:29.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.575+0000 7f3a1a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a14105560 0x7f3a141a1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:29.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.575+0000 7f3a1a800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1410f630 con 0x7f3a14105560 2024-08-26T00:02:29.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.575+0000 7f3a1a800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1410f4b0 con 0x7f3a14104ba0 2024-08-26T00:02:29.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.575+0000 7f3a1a800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1410f7b0 con 0x7f3a141039b0 2024-08-26T00:02:29.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.575+0000 7f3a18a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a14104ba0 0x7f3a1419a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:29.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.575+0000 7f3a19e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a14105560 0x7f3a141a1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:29.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.575+0000 7f3a18a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a14104ba0 0x7f3a1419a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:34010/0 (socket says 172.21.15.42:34010) 2024-08-26T00:02:29.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.575+0000 7f3a18a00640 1 -- 172.21.15.42:0/3476081827 learned_addr learned my addr 172.21.15.42:0/3476081827 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:29.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.575+0000 7f3a19400640 1 --2- 172.21.15.42:0/3476081827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a141039b0 0x7f3a14199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:29.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.576+0000 7f3a18a00640 1 -- 172.21.15.42:0/3476081827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a141039b0 msgr2=0x7f3a14199d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:29.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.576+0000 7f3a18a00640 1 --2- 172.21.15.42:0/3476081827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a141039b0 0x7f3a14199d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.576+0000 7f3a18a00640 1 -- 172.21.15.42:0/3476081827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a14105560 msgr2=0x7f3a141a1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:29.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.576+0000 7f3a18a00640 1 --2- 172.21.15.42:0/3476081827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a14105560 0x7f3a141a1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.576+0000 7f3a18a00640 1 -- 172.21.15.42:0/3476081827 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a141a1910 con 0x7f3a14104ba0 2024-08-26T00:02:29.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.576+0000 7f3a19e00640 1 --2- 172.21.15.42:0/3476081827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a14105560 0x7f3a141a1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:29.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.576+0000 7f3a19400640 1 --2- 172.21.15.42:0/3476081827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a141039b0 0x7f3a14199d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:02:29.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.576+0000 7f3a18a00640 1 --2- 172.21.15.42:0/3476081827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a14104ba0 0x7f3a1419a240 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3a0000ea60 tx=0x7f3a0000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:29.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.576+0000 7f3a12000640 1 -- 172.21.15.42:0/3476081827 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0000cde0 con 0x7f3a14104ba0 2024-08-26T00:02:29.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.576+0000 7f3a1a800640 1 -- 172.21.15.42:0/3476081827 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a141a1c00 con 0x7f3a14104ba0 2024-08-26T00:02:29.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.576+0000 7f3a12000640 1 -- 172.21.15.42:0/3476081827 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a000035f0 con 0x7f3a14104ba0 2024-08-26T00:02:29.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.576+0000 7f3a12000640 1 -- 172.21.15.42:0/3476081827 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a00010670 con 0x7f3a14104ba0 2024-08-26T00:02:29.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.576+0000 7f3a1a800640 1 -- 172.21.15.42:0/3476081827 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a141a21a0 con 0x7f3a14104ba0 2024-08-26T00:02:29.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.577+0000 7f3a1a800640 1 -- 172.21.15.42:0/3476081827 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a1410ada0 con 0x7f3a14104ba0 2024-08-26T00:02:29.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.580+0000 7f3a12000640 1 -- 172.21.15.42:0/3476081827 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3a000037a0 con 0x7f3a14104ba0 2024-08-26T00:02:29.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.581+0000 7f3a12000640 1 --2- 172.21.15.42:0/3476081827 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f39fc0a2c10 0x7f39fc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:29.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.581+0000 7f3a12000640 1 -- 172.21.15.42:0/3476081827 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f3a000cf610 con 0x7f3a14104ba0 2024-08-26T00:02:29.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.582+0000 7f3a19400640 1 --2- 172.21.15.42:0/3476081827 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f39fc0a2c10 0x7f39fc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:29.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.582+0000 7f3a19400640 1 --2- 172.21.15.42:0/3476081827 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f39fc0a2c10 0x7f39fc0a50d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3a080314e0 tx=0x7f3a08032cf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:29.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.583+0000 7f3a12000640 1 -- 172.21.15.42:0/3476081827 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f3a00053df0 con 0x7f3a14104ba0 2024-08-26T00:02:29.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.768+0000 7f3a1a800640 1 -- 172.21.15.42:0/3476081827 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3a1402d8f0 con 0x7f3a14104ba0 2024-08-26T00:02:29.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.768+0000 7f3a12000640 1 -- 172.21.15.42:0/3476081827 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) ==== 100+0+11 (secure 0 0 0) 0x7f3a0009c530 con 0x7f3a14104ba0 2024-08-26T00:02:29.770 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-08-26T00:02:29.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.771+0000 7f3a1a800640 1 -- 172.21.15.42:0/3476081827 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f39fc0a2c10 msgr2=0x7f39fc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:29.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.771+0000 7f3a1a800640 1 --2- 172.21.15.42:0/3476081827 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f39fc0a2c10 0x7f39fc0a50d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3a080314e0 tx=0x7f3a08032cf0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.771+0000 7f3a1a800640 1 -- 172.21.15.42:0/3476081827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a14104ba0 msgr2=0x7f3a1419a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:29.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.771+0000 7f3a1a800640 1 --2- 172.21.15.42:0/3476081827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a14104ba0 0x7f3a1419a240 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3a0000ea60 tx=0x7f3a0000ef20 comp rx=0 tx=0).stop 2024-08-26T00:02:29.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.771+0000 7f3a1a800640 1 -- 172.21.15.42:0/3476081827 shutdown_connections 2024-08-26T00:02:29.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.771+0000 7f3a1a800640 1 --2- 172.21.15.42:0/3476081827 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f39fc0a2c10 0x7f39fc0a50d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.771+0000 7f3a1a800640 1 --2- 172.21.15.42:0/3476081827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a14105560 0x7f3a141a1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.771+0000 7f3a1a800640 1 --2- 172.21.15.42:0/3476081827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a14104ba0 0x7f3a1419a240 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.771+0000 7f3a1a800640 1 --2- 172.21.15.42:0/3476081827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a141039b0 0x7f3a14199d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:29.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.771+0000 7f3a1a800640 1 -- 172.21.15.42:0/3476081827 >> 172.21.15.42:0/3476081827 conn(0x7f3a140ff130 msgr2=0x7f3a14107f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:29.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.771+0000 7f3a1a800640 1 -- 172.21.15.42:0/3476081827 shutdown_connections 2024-08-26T00:02:29.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:29.771+0000 7f3a1a800640 1 -- 172.21.15.42:0/3476081827 wait complete. 2024-08-26T00:02:29.789 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-08-26T00:02:29.789 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:02:30.168 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:02:30.497 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:30 smithi042 ceph-mon[17225]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-26T00:02:30.497 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:30 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/4271498692' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-08-26T00:02:30.497 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:30 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/3476081827' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-08-26T00:02:30.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:30 smithi043 ceph-mon[22091]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-26T00:02:30.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:30 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/4271498692' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-08-26T00:02:30.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:30 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/3476081827' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-08-26T00:02:30.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:30 smithi181 ceph-mon[22102]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-26T00:02:30.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:30 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/4271498692' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-08-26T00:02:30.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:30 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/3476081827' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-08-26T00:02:30.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.769+0000 7f5a3fa00640 1 -- 172.21.15.42:0/935817897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a381022c0 msgr2=0x7f5a3810e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:30.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.769+0000 7f5a3fa00640 1 --2- 172.21.15.42:0/935817897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a381022c0 0x7f5a3810e7f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009cd0 tx=0x7f5a3002a8e0 comp rx=0 tx=0).stop 2024-08-26T00:02:30.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.769+0000 7f5a3fa00640 1 -- 172.21.15.42:0/935817897 shutdown_connections 2024-08-26T00:02:30.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.769+0000 7f5a3fa00640 1 --2- 172.21.15.42:0/935817897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a381022c0 0x7f5a3810e7f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:30.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.769+0000 7f5a3fa00640 1 --2- 172.21.15.42:0/935817897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a38101920 0x7f5a38101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:30.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.769+0000 7f5a3fa00640 1 --2- 172.21.15.42:0/935817897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a38107920 0x7f5a38107d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:30.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.769+0000 7f5a3fa00640 1 -- 172.21.15.42:0/935817897 >> 172.21.15.42:0/935817897 conn(0x7f5a380fd660 msgr2=0x7f5a380ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:30.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.769+0000 7f5a3fa00640 1 -- 172.21.15.42:0/935817897 shutdown_connections 2024-08-26T00:02:30.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.769+0000 7f5a3fa00640 1 -- 172.21.15.42:0/935817897 wait complete. 2024-08-26T00:02:30.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.770+0000 7f5a3fa00640 1 Processor -- start 2024-08-26T00:02:30.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.770+0000 7f5a3fa00640 1 -- start start 2024-08-26T00:02:30.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.771+0000 7f5a3fa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a38101920 0x7f5a3819a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:30.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.771+0000 7f5a3fa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a381022c0 0x7f5a3819a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:30.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.771+0000 7f5a3fa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a38107920 0x7f5a3819ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:30.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.771+0000 7f5a3fa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5a38111d70 con 0x7f5a381022c0 2024-08-26T00:02:30.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.771+0000 7f5a3fa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5a38111bf0 con 0x7f5a38107920 2024-08-26T00:02:30.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.771+0000 7f5a3fa00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5a38111ef0 con 0x7f5a38101920 2024-08-26T00:02:30.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.771+0000 7f5a2fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a381022c0 0x7f5a3819a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:30.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.771+0000 7f5a2fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a381022c0 0x7f5a3819a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42068/0 (socket says 172.21.15.42:42068) 2024-08-26T00:02:30.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.771+0000 7f5a2fe00640 1 -- 172.21.15.42:0/144638982 learned_addr learned my addr 172.21.15.42:0/144638982 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:30.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.771+0000 7f5a3da00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a38107920 0x7f5a3819ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:30.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.771+0000 7f5a3d000640 1 --2- 172.21.15.42:0/144638982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a38101920 0x7f5a3819a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:30.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.771+0000 7f5a2fe00640 1 -- 172.21.15.42:0/144638982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a38101920 msgr2=0x7f5a3819a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:30.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.771+0000 7f5a2fe00640 1 --2- 172.21.15.42:0/144638982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a38101920 0x7f5a3819a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:30.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.771+0000 7f5a2fe00640 1 -- 172.21.15.42:0/144638982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a38107920 msgr2=0x7f5a3819ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:30.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.772+0000 7f5a2fe00640 1 --2- 172.21.15.42:0/144638982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a38107920 0x7f5a3819ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:30.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.772+0000 7f5a2fe00640 1 -- 172.21.15.42:0/144638982 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3819f360 con 0x7f5a381022c0 2024-08-26T00:02:30.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.772+0000 7f5a3da00640 1 --2- 172.21.15.42:0/144638982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a38107920 0x7f5a3819ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:30.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.772+0000 7f5a2fe00640 1 --2- 172.21.15.42:0/144638982 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a381022c0 0x7f5a3819a8f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5a2000d950 tx=0x7f5a2000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:30.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.772+0000 7f5a36000640 1 -- 172.21.15.42:0/144638982 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a20017030 con 0x7f5a381022c0 2024-08-26T00:02:30.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.772+0000 7f5a36000640 1 -- 172.21.15.42:0/144638982 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a20004020 con 0x7f5a381022c0 2024-08-26T00:02:30.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.772+0000 7f5a3fa00640 1 -- 172.21.15.42:0/144638982 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a3819f650 con 0x7f5a381022c0 2024-08-26T00:02:30.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.772+0000 7f5a36000640 1 -- 172.21.15.42:0/144638982 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a200047a0 con 0x7f5a381022c0 2024-08-26T00:02:30.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.772+0000 7f5a3fa00640 1 -- 172.21.15.42:0/144638982 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a381a6f30 con 0x7f5a381022c0 2024-08-26T00:02:30.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.773+0000 7f5a3fa00640 1 -- 172.21.15.42:0/144638982 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a38101d80 con 0x7f5a381022c0 2024-08-26T00:02:30.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.775+0000 7f5a36000640 1 -- 172.21.15.42:0/144638982 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5a200041d0 con 0x7f5a381022c0 2024-08-26T00:02:30.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.776+0000 7f5a36000640 1 --2- 172.21.15.42:0/144638982 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5a1c0a2b80 0x7f5a1c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:30.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.777+0000 7f5a36000640 1 -- 172.21.15.42:0/144638982 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f5a200ce9d0 con 0x7f5a381022c0 2024-08-26T00:02:30.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.777+0000 7f5a3d000640 1 --2- 172.21.15.42:0/144638982 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5a1c0a2b80 0x7f5a1c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:30.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.777+0000 7f5a3d000640 1 --2- 172.21.15.42:0/144638982 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5a1c0a2b80 0x7f5a1c0a5040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5a28005d00 tx=0x7f5a2800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:30.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:30.781+0000 7f5a36000640 1 -- 172.21.15.42:0/144638982 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5a2009b8f0 con 0x7f5a381022c0 2024-08-26T00:02:31.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.004+0000 7f5a3fa00640 1 -- 172.21.15.42:0/144638982 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a3819b710 con 0x7f5a381022c0 2024-08-26T00:02:31.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.005+0000 7f5a36000640 1 -- 172.21.15.42:0/144638982 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11909 (secure 0 0 0) 0x7f5a3819b710 con 0x7f5a381022c0 2024-08-26T00:02:31.006 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:02:31.006 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":24,"btime":"2024-08-26T00:02:28:193800+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3168581452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3168581452},{"type":"v1","addr":"172.21.15.42:6839","nonce":3168581452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/3533492491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":3533492491},{"type":"v1","addr":"172.21.15.42:6841","nonce":3533492491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-26T00:00:30.169633+0000","modified":"2024-08-26T00:02:27.753317+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24532,"mds_1":24527,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6839/2653014277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2653014277},{"type":"v1","addr":"172.21.15.43:6839","nonce":2653014277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24532,"qdb_cluster":[24532,24527,24514]},"id":1}]} 2024-08-26T00:02:31.007 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 24 2024-08-26T00:02:31.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.007+0000 7f5a3fa00640 1 -- 172.21.15.42:0/144638982 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5a1c0a2b80 msgr2=0x7f5a1c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:31.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.007+0000 7f5a3fa00640 1 --2- 172.21.15.42:0/144638982 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5a1c0a2b80 0x7f5a1c0a5040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5a28005d00 tx=0x7f5a2800b410 comp rx=0 tx=0).stop 2024-08-26T00:02:31.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.007+0000 7f5a3fa00640 1 -- 172.21.15.42:0/144638982 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a381022c0 msgr2=0x7f5a3819a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:31.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.007+0000 7f5a3fa00640 1 --2- 172.21.15.42:0/144638982 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a381022c0 0x7f5a3819a8f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5a2000d950 tx=0x7f5a2000de10 comp rx=0 tx=0).stop 2024-08-26T00:02:31.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.007+0000 7f5a3fa00640 1 -- 172.21.15.42:0/144638982 shutdown_connections 2024-08-26T00:02:31.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.007+0000 7f5a3fa00640 1 --2- 172.21.15.42:0/144638982 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5a1c0a2b80 0x7f5a1c0a5040 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:31.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.007+0000 7f5a3fa00640 1 --2- 172.21.15.42:0/144638982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a38107920 0x7f5a3819ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:31.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.007+0000 7f5a3fa00640 1 --2- 172.21.15.42:0/144638982 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a381022c0 0x7f5a3819a8f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:31.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.007+0000 7f5a3fa00640 1 --2- 172.21.15.42:0/144638982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a38101920 0x7f5a3819a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:31.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.007+0000 7f5a3fa00640 1 -- 172.21.15.42:0/144638982 >> 172.21.15.42:0/144638982 conn(0x7f5a380fd660 msgr2=0x7f5a380feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:31.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.008+0000 7f5a3fa00640 1 -- 172.21.15.42:0/144638982 shutdown_connections 2024-08-26T00:02:31.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.008+0000 7f5a3fa00640 1 -- 172.21.15.42:0/144638982 wait complete. 2024-08-26T00:02:31.790 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-08-26T00:02:31.790 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-08-26T00:02:31.790 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-26T00:02:31.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.951+0000 7f4742400640 1 -- 172.21.15.42:0/1623783037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f473c104cc0 msgr2=0x7f473c105140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:31.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.951+0000 7f4742400640 1 --2- 172.21.15.42:0/1623783037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f473c104cc0 0x7f473c105140 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4728009900 tx=0x7f472802a3f0 comp rx=0 tx=0).stop 2024-08-26T00:02:31.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.951+0000 7f4742400640 1 -- 172.21.15.42:0/1623783037 shutdown_connections 2024-08-26T00:02:31.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.951+0000 7f4742400640 1 --2- 172.21.15.42:0/1623783037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f473c105680 0x7f473c10bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:31.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.951+0000 7f4742400640 1 --2- 172.21.15.42:0/1623783037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f473c104cc0 0x7f473c105140 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:31.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.951+0000 7f4742400640 1 --2- 172.21.15.42:0/1623783037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f473c103ad0 0x7f473c103ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:31.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.951+0000 7f4742400640 1 -- 172.21.15.42:0/1623783037 >> 172.21.15.42:0/1623783037 conn(0x7f473c0ff250 msgr2=0x7f473c101670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:31.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.952+0000 7f4742400640 1 -- 172.21.15.42:0/1623783037 shutdown_connections 2024-08-26T00:02:31.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.952+0000 7f4742400640 1 -- 172.21.15.42:0/1623783037 wait complete. 2024-08-26T00:02:31.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.952+0000 7f4742400640 1 Processor -- start 2024-08-26T00:02:31.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.953+0000 7f4742400640 1 -- start start 2024-08-26T00:02:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.953+0000 7f4742400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f473c103ad0 0x7f473c199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.953+0000 7f4742400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f473c104cc0 0x7f473c19a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.953+0000 7f4742400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f473c105680 0x7f473c1a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.953+0000 7f4742400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f473c10f7a0 con 0x7f473c105680 2024-08-26T00:02:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.953+0000 7f4742400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f473c10f620 con 0x7f473c104cc0 2024-08-26T00:02:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.953+0000 7f4742400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f473c10f920 con 0x7f473c103ad0 2024-08-26T00:02:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.953+0000 7f473be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f473c105680 0x7f473c1a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.953+0000 7f473aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f473c104cc0 0x7f473c19a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.953+0000 7f473be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f473c105680 0x7f473c1a13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42080/0 (socket says 172.21.15.42:42080) 2024-08-26T00:02:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.953+0000 7f473be00640 1 -- 172.21.15.42:0/3393880149 learned_addr learned my addr 172.21.15.42:0/3393880149 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.953+0000 7f473aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f473c104cc0 0x7f473c19a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:34042/0 (socket says 172.21.15.42:34042) 2024-08-26T00:02:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.953+0000 7f473b400640 1 --2- 172.21.15.42:0/3393880149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f473c103ad0 0x7f473c199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.954+0000 7f473aa00640 1 -- 172.21.15.42:0/3393880149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f473c103ad0 msgr2=0x7f473c199e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.954+0000 7f473aa00640 1 --2- 172.21.15.42:0/3393880149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f473c103ad0 0x7f473c199e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.954+0000 7f473aa00640 1 -- 172.21.15.42:0/3393880149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f473c105680 msgr2=0x7f473c1a13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.954+0000 7f473aa00640 1 --2- 172.21.15.42:0/3393880149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f473c105680 0x7f473c1a13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.954+0000 7f473aa00640 1 -- 172.21.15.42:0/3393880149 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473c1a1a20 con 0x7f473c104cc0 2024-08-26T00:02:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.954+0000 7f473be00640 1 --2- 172.21.15.42:0/3393880149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f473c105680 0x7f473c1a13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.954+0000 7f473aa00640 1 --2- 172.21.15.42:0/3393880149 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f473c104cc0 0x7f473c19a340 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f472802a910 tx=0x7f4728032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.954+0000 7f4733e00640 1 -- 172.21.15.42:0/3393880149 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472803f030 con 0x7f473c104cc0 2024-08-26T00:02:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.954+0000 7f4733e00640 1 -- 172.21.15.42:0/3393880149 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4728003ce0 con 0x7f473c104cc0 2024-08-26T00:02:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.954+0000 7f4742400640 1 -- 172.21.15.42:0/3393880149 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f473c1a1cb0 con 0x7f473c104cc0 2024-08-26T00:02:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.954+0000 7f4733e00640 1 -- 172.21.15.42:0/3393880149 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728035070 con 0x7f473c104cc0 2024-08-26T00:02:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.954+0000 7f4742400640 1 -- 172.21.15.42:0/3393880149 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f473c1a2170 con 0x7f473c104cc0 2024-08-26T00:02:31.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.955+0000 7f4742400640 1 -- 172.21.15.42:0/3393880149 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f473c10aec0 con 0x7f473c104cc0 2024-08-26T00:02:31.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.957+0000 7f4733e00640 1 -- 172.21.15.42:0/3393880149 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4728042030 con 0x7f473c104cc0 2024-08-26T00:02:31.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.959+0000 7f4733e00640 1 --2- 172.21.15.42:0/3393880149 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47200a2b90 0x7f47200a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:31.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.959+0000 7f4733e00640 1 -- 172.21.15.42:0/3393880149 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f47280ef710 con 0x7f473c104cc0 2024-08-26T00:02:31.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.959+0000 7f473b400640 1 --2- 172.21.15.42:0/3393880149 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47200a2b90 0x7f47200a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:31.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.959+0000 7f473b400640 1 --2- 172.21.15.42:0/3393880149 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47200a2b90 0x7f47200a5050 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f472c005fd0 tx=0x7f472c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:31.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:31.961+0000 7f4733e00640 1 -- 172.21.15.42:0/3393880149 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f47280bbfe0 con 0x7f473c104cc0 2024-08-26T00:02:32.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:31 smithi042 ceph-mon[17225]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-26T00:02:32.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:31 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/144638982' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:02:32.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.145+0000 7f4742400640 1 -- 172.21.15.42:0/3393880149 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f473c0623d0 con 0x7f47200a2b90 2024-08-26T00:02:32.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.153+0000 7f4733e00640 1 -- 172.21.15.42:0/3393880149 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258835 (secure 0 0 0) 0x7f473c0623d0 con 0x7f47200a2b90 2024-08-26T00:02:32.158 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:02:32.160 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-08-26T00:02:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.157+0000 7f4742400640 1 -- 172.21.15.42:0/3393880149 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47200a2b90 msgr2=0x7f47200a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.157+0000 7f4742400640 1 --2- 172.21.15.42:0/3393880149 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47200a2b90 0x7f47200a5050 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f472c005fd0 tx=0x7f472c00b390 comp rx=0 tx=0).stop 2024-08-26T00:02:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.157+0000 7f4742400640 1 -- 172.21.15.42:0/3393880149 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f473c104cc0 msgr2=0x7f473c19a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.157+0000 7f4742400640 1 --2- 172.21.15.42:0/3393880149 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f473c104cc0 0x7f473c19a340 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f472802a910 tx=0x7f4728032ce0 comp rx=0 tx=0).stop 2024-08-26T00:02:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.157+0000 7f4742400640 1 -- 172.21.15.42:0/3393880149 shutdown_connections 2024-08-26T00:02:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.157+0000 7f4742400640 1 --2- 172.21.15.42:0/3393880149 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47200a2b90 0x7f47200a5050 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.157+0000 7f4742400640 1 --2- 172.21.15.42:0/3393880149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f473c105680 0x7f473c1a13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.157+0000 7f4742400640 1 --2- 172.21.15.42:0/3393880149 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f473c104cc0 0x7f473c19a340 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.157+0000 7f4742400640 1 --2- 172.21.15.42:0/3393880149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f473c103ad0 0x7f473c199e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.157+0000 7f4742400640 1 -- 172.21.15.42:0/3393880149 >> 172.21.15.42:0/3393880149 conn(0x7f473c0ff250 msgr2=0x7f473c108090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.157+0000 7f4742400640 1 -- 172.21.15.42:0/3393880149 shutdown_connections 2024-08-26T00:02:32.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.157+0000 7f4742400640 1 -- 172.21.15.42:0/3393880149 wait complete. 2024-08-26T00:02:32.175 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2024-08-26T00:02:30.521659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655917,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":794,"num_read_kb":511,"num_write":359,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1241373,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":788,"ondisk_log_size":788,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":399132,"kb_used_data":12444,"kb_used_omap":18,"kb_used_meta":386477,"kb_avail":1124542692,"statfs":{"total":1151940427776,"available":1151531716608,"internally_reserved":0,"allocated":12742656,"data_stored":7077508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19137,"internal_metadata":395752767},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":311,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":31,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002987"},"pg_stats":[{"pgid":"3.3f","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535385+0000","last_change":"2024-08-26T00:00:29.365654+0000","last_active":"2024-08-26T00:02:02.535385+0000","last_peered":"2024-08-26T00:02:02.535385+0000","last_clean":"2024-08-26T00:02:02.535385+0000","last_became_active":"2024-08-26T00:00:29.364609+0000","last_became_peered":"2024-08-26T00:00:29.364609+0000","last_unstale":"2024-08-26T00:02:02.535385+0000","last_undegraded":"2024-08-26T00:02:02.535385+0000","last_fullsized":"2024-08-26T00:02:02.535385+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:54:39.886248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.520050+0000","last_change":"2024-08-26T00:00:29.367657+0000","last_active":"2024-08-26T00:02:02.520050+0000","last_peered":"2024-08-26T00:02:02.520050+0000","last_clean":"2024-08-26T00:02:02.520050+0000","last_became_active":"2024-08-26T00:00:29.367376+0000","last_became_peered":"2024-08-26T00:00:29.367376+0000","last_unstale":"2024-08-26T00:02:02.520050+0000","last_undegraded":"2024-08-26T00:02:02.520050+0000","last_fullsized":"2024-08-26T00:02:02.520050+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:16:13.414883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.534577+0000","last_change":"2024-08-26T00:00:29.369219+0000","last_active":"2024-08-26T00:02:02.534577+0000","last_peered":"2024-08-26T00:02:02.534577+0000","last_clean":"2024-08-26T00:02:02.534577+0000","last_became_active":"2024-08-26T00:00:29.368902+0000","last_became_peered":"2024-08-26T00:00:29.368902+0000","last_unstale":"2024-08-26T00:02:02.534577+0000","last_undegraded":"2024-08-26T00:02:02.534577+0000","last_fullsized":"2024-08-26T00:02:02.534577+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:53:28.636658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.530706+0000","last_change":"2024-08-26T00:00:29.359501+0000","last_active":"2024-08-26T00:02:02.530706+0000","last_peered":"2024-08-26T00:02:02.530706+0000","last_clean":"2024-08-26T00:02:02.530706+0000","last_became_active":"2024-08-26T00:00:29.358778+0000","last_became_peered":"2024-08-26T00:00:29.358778+0000","last_unstale":"2024-08-26T00:02:02.530706+0000","last_undegraded":"2024-08-26T00:02:02.530706+0000","last_fullsized":"2024-08-26T00:02:02.530706+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:20:40.200105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.514251+0000","last_change":"2024-08-26T00:00:29.358387+0000","last_active":"2024-08-26T00:02:02.514251+0000","last_peered":"2024-08-26T00:02:02.514251+0000","last_clean":"2024-08-26T00:02:02.514251+0000","last_became_active":"2024-08-26T00:00:29.357839+0000","last_became_peered":"2024-08-26T00:00:29.357839+0000","last_unstale":"2024-08-26T00:02:02.514251+0000","last_undegraded":"2024-08-26T00:02:02.514251+0000","last_fullsized":"2024-08-26T00:02:02.514251+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:05:21.065258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.530387+0000","last_change":"2024-08-26T00:00:29.354429+0000","last_active":"2024-08-26T00:02:02.530387+0000","last_peered":"2024-08-26T00:02:02.530387+0000","last_clean":"2024-08-26T00:02:02.530387+0000","last_became_active":"2024-08-26T00:00:29.354108+0000","last_became_peered":"2024-08-26T00:00:29.354108+0000","last_unstale":"2024-08-26T00:02:02.530387+0000","last_undegraded":"2024-08-26T00:02:02.530387+0000","last_fullsized":"2024-08-26T00:02:02.530387+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:58:07.912980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.528778+0000","last_change":"2024-08-26T00:00:29.360127+0000","last_active":"2024-08-26T00:02:02.528778+0000","last_peered":"2024-08-26T00:02:02.528778+0000","last_clean":"2024-08-26T00:02:02.528778+0000","last_became_active":"2024-08-26T00:00:29.359730+0000","last_became_peered":"2024-08-26T00:00:29.359730+0000","last_unstale":"2024-08-26T00:02:02.528778+0000","last_undegraded":"2024-08-26T00:02:02.528778+0000","last_fullsized":"2024-08-26T00:02:02.528778+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:38:16.377861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.524984+0000","last_change":"2024-08-26T00:00:29.362117+0000","last_active":"2024-08-26T00:02:02.524984+0000","last_peered":"2024-08-26T00:02:02.524984+0000","last_clean":"2024-08-26T00:02:02.524984+0000","last_became_active":"2024-08-26T00:00:29.361738+0000","last_became_peered":"2024-08-26T00:00:29.361738+0000","last_unstale":"2024-08-26T00:02:02.524984+0000","last_undegraded":"2024-08-26T00:02:02.524984+0000","last_fullsized":"2024-08-26T00:02:02.524984+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:38:15.468364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535176+0000","last_change":"2024-08-26T00:00:29.363693+0000","last_active":"2024-08-26T00:02:02.535176+0000","last_peered":"2024-08-26T00:02:02.535176+0000","last_clean":"2024-08-26T00:02:02.535176+0000","last_became_active":"2024-08-26T00:00:29.363356+0000","last_became_peered":"2024-08-26T00:00:29.363356+0000","last_unstale":"2024-08-26T00:02:02.535176+0000","last_undegraded":"2024-08-26T00:02:02.535176+0000","last_fullsized":"2024-08-26T00:02:02.535176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:18:46.180255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"80'16","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.527282+0000","last_change":"2024-08-26T00:00:29.363401+0000","last_active":"2024-08-26T00:02:02.527282+0000","last_peered":"2024-08-26T00:02:02.527282+0000","last_clean":"2024-08-26T00:02:02.527282+0000","last_became_active":"2024-08-26T00:00:29.363045+0000","last_became_peered":"2024-08-26T00:00:29.363045+0000","last_unstale":"2024-08-26T00:02:02.527282+0000","last_undegraded":"2024-08-26T00:02:02.527282+0000","last_fullsized":"2024-08-26T00:02:02.527282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:18:24.931121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.534547+0000","last_change":"2024-08-26T00:00:29.356440+0000","last_active":"2024-08-26T00:02:02.534547+0000","last_peered":"2024-08-26T00:02:02.534547+0000","last_clean":"2024-08-26T00:02:02.534547+0000","last_became_active":"2024-08-26T00:00:29.355498+0000","last_became_peered":"2024-08-26T00:00:29.355498+0000","last_unstale":"2024-08-26T00:02:02.534547+0000","last_undegraded":"2024-08-26T00:02:02.534547+0000","last_fullsized":"2024-08-26T00:02:02.534547+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:27:31.363962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.531100+0000","last_change":"2024-08-26T00:00:29.359185+0000","last_active":"2024-08-26T00:02:02.531100+0000","last_peered":"2024-08-26T00:02:02.531100+0000","last_clean":"2024-08-26T00:02:02.531100+0000","last_became_active":"2024-08-26T00:00:29.358670+0000","last_became_peered":"2024-08-26T00:00:29.358670+0000","last_unstale":"2024-08-26T00:02:02.531100+0000","last_undegraded":"2024-08-26T00:02:02.531100+0000","last_fullsized":"2024-08-26T00:02:02.531100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:15:31.327823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.522302+0000","last_change":"2024-08-26T00:00:29.361477+0000","last_active":"2024-08-26T00:02:02.522302+0000","last_peered":"2024-08-26T00:02:02.522302+0000","last_clean":"2024-08-26T00:02:02.522302+0000","last_became_active":"2024-08-26T00:00:29.360870+0000","last_became_peered":"2024-08-26T00:00:29.360870+0000","last_unstale":"2024-08-26T00:02:02.522302+0000","last_undegraded":"2024-08-26T00:02:02.522302+0000","last_fullsized":"2024-08-26T00:02:02.522302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:37:01.434606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.523866+0000","last_change":"2024-08-26T00:00:29.362301+0000","last_active":"2024-08-26T00:02:02.523866+0000","last_peered":"2024-08-26T00:02:02.523866+0000","last_clean":"2024-08-26T00:02:02.523866+0000","last_became_active":"2024-08-26T00:00:29.359613+0000","last_became_peered":"2024-08-26T00:00:29.359613+0000","last_unstale":"2024-08-26T00:02:02.523866+0000","last_undegraded":"2024-08-26T00:02:02.523866+0000","last_fullsized":"2024-08-26T00:02:02.523866+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:24:09.515352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.528299+0000","last_change":"2024-08-26T00:00:29.365553+0000","last_active":"2024-08-26T00:02:02.528299+0000","last_peered":"2024-08-26T00:02:02.528299+0000","last_clean":"2024-08-26T00:02:02.528299+0000","last_became_active":"2024-08-26T00:00:29.363344+0000","last_became_peered":"2024-08-26T00:00:29.363344+0000","last_unstale":"2024-08-26T00:02:02.528299+0000","last_undegraded":"2024-08-26T00:02:02.528299+0000","last_fullsized":"2024-08-26T00:02:02.528299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:27:43.172749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535411+0000","last_change":"2024-08-26T00:00:29.362061+0000","last_active":"2024-08-26T00:02:02.535411+0000","last_peered":"2024-08-26T00:02:02.535411+0000","last_clean":"2024-08-26T00:02:02.535411+0000","last_became_active":"2024-08-26T00:00:29.361712+0000","last_became_peered":"2024-08-26T00:00:29.361712+0000","last_unstale":"2024-08-26T00:02:02.535411+0000","last_undegraded":"2024-08-26T00:02:02.535411+0000","last_fullsized":"2024-08-26T00:02:02.535411+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:20:14.944167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535500+0000","last_change":"2024-08-26T00:00:29.365160+0000","last_active":"2024-08-26T00:02:02.535500+0000","last_peered":"2024-08-26T00:02:02.535500+0000","last_clean":"2024-08-26T00:02:02.535500+0000","last_became_active":"2024-08-26T00:00:29.364541+0000","last_became_peered":"2024-08-26T00:00:29.364541+0000","last_unstale":"2024-08-26T00:02:02.535500+0000","last_undegraded":"2024-08-26T00:02:02.535500+0000","last_fullsized":"2024-08-26T00:02:02.535500+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:59:54.417495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.522632+0000","last_change":"2024-08-26T00:00:29.361264+0000","last_active":"2024-08-26T00:02:02.522632+0000","last_peered":"2024-08-26T00:02:02.522632+0000","last_clean":"2024-08-26T00:02:02.522632+0000","last_became_active":"2024-08-26T00:00:29.358501+0000","last_became_peered":"2024-08-26T00:00:29.358501+0000","last_unstale":"2024-08-26T00:02:02.522632+0000","last_undegraded":"2024-08-26T00:02:02.522632+0000","last_fullsized":"2024-08-26T00:02:02.522632+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:04:44.930112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"80'7","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.518570+0000","last_change":"2024-08-26T00:01:33.601117+0000","last_active":"2024-08-26T00:02:02.518570+0000","last_peered":"2024-08-26T00:02:02.518570+0000","last_clean":"2024-08-26T00:02:02.518570+0000","last_became_active":"2024-08-26T00:01:33.600696+0000","last_became_peered":"2024-08-26T00:01:33.600696+0000","last_unstale":"2024-08-26T00:02:02.518570+0000","last_undegraded":"2024-08-26T00:02:02.518570+0000","last_fullsized":"2024-08-26T00:02:02.518570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:43:46.062253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.532661+0000","last_change":"2024-08-26T00:00:29.363072+0000","last_active":"2024-08-26T00:02:02.532661+0000","last_peered":"2024-08-26T00:02:02.532661+0000","last_clean":"2024-08-26T00:02:02.532661+0000","last_became_active":"2024-08-26T00:00:29.362751+0000","last_became_peered":"2024-08-26T00:00:29.362751+0000","last_unstale":"2024-08-26T00:02:02.532661+0000","last_undegraded":"2024-08-26T00:02:02.532661+0000","last_fullsized":"2024-08-26T00:02:02.532661+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:49:14.455371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.529205+0000","last_change":"2024-08-26T00:00:29.367489+0000","last_active":"2024-08-26T00:02:02.529205+0000","last_peered":"2024-08-26T00:02:02.529205+0000","last_clean":"2024-08-26T00:02:02.529205+0000","last_became_active":"2024-08-26T00:00:29.367183+0000","last_became_peered":"2024-08-26T00:00:29.367183+0000","last_unstale":"2024-08-26T00:02:02.529205+0000","last_undegraded":"2024-08-26T00:02:02.529205+0000","last_fullsized":"2024-08-26T00:02:02.529205+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:05:53.736139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535772+0000","last_change":"2024-08-26T00:00:29.356751+0000","last_active":"2024-08-26T00:02:02.535772+0000","last_peered":"2024-08-26T00:02:02.535772+0000","last_clean":"2024-08-26T00:02:02.535772+0000","last_became_active":"2024-08-26T00:00:29.356291+0000","last_became_peered":"2024-08-26T00:00:29.356291+0000","last_unstale":"2024-08-26T00:02:02.535772+0000","last_undegraded":"2024-08-26T00:02:02.535772+0000","last_fullsized":"2024-08-26T00:02:02.535772+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:32:50.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.526003+0000","last_change":"2024-08-26T00:00:29.356965+0000","last_active":"2024-08-26T00:02:02.526003+0000","last_peered":"2024-08-26T00:02:02.526003+0000","last_clean":"2024-08-26T00:02:02.526003+0000","last_became_active":"2024-08-26T00:00:29.356588+0000","last_became_peered":"2024-08-26T00:00:29.356588+0000","last_unstale":"2024-08-26T00:02:02.526003+0000","last_undegraded":"2024-08-26T00:02:02.526003+0000","last_fullsized":"2024-08-26T00:02:02.526003+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:02:25.833139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.523337+0000","last_change":"2024-08-26T00:00:29.352304+0000","last_active":"2024-08-26T00:02:02.523337+0000","last_peered":"2024-08-26T00:02:02.523337+0000","last_clean":"2024-08-26T00:02:02.523337+0000","last_became_active":"2024-08-26T00:00:29.351981+0000","last_became_peered":"2024-08-26T00:00:29.351981+0000","last_unstale":"2024-08-26T00:02:02.523337+0000","last_undegraded":"2024-08-26T00:02:02.523337+0000","last_fullsized":"2024-08-26T00:02:02.523337+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:06:29.105905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"80'2","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.525092+0000","last_change":"2024-08-26T00:00:29.354424+0000","last_active":"2024-08-26T00:02:02.525092+0000","last_peered":"2024-08-26T00:02:02.525092+0000","last_clean":"2024-08-26T00:02:02.525092+0000","last_became_active":"2024-08-26T00:00:29.352687+0000","last_became_peered":"2024-08-26T00:00:29.352687+0000","last_unstale":"2024-08-26T00:02:02.525092+0000","last_undegraded":"2024-08-26T00:02:02.525092+0000","last_fullsized":"2024-08-26T00:02:02.525092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:26:21.769928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.522471+0000","last_change":"2024-08-26T00:00:29.355680+0000","last_active":"2024-08-26T00:02:02.522471+0000","last_peered":"2024-08-26T00:02:02.522471+0000","last_clean":"2024-08-26T00:02:02.522471+0000","last_became_active":"2024-08-26T00:00:29.355335+0000","last_became_peered":"2024-08-26T00:00:29.355335+0000","last_unstale":"2024-08-26T00:02:02.522471+0000","last_undegraded":"2024-08-26T00:02:02.522471+0000","last_fullsized":"2024-08-26T00:02:02.522471+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:16:04.085892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.522793+0000","last_change":"2024-08-26T00:00:29.357564+0000","last_active":"2024-08-26T00:02:02.522793+0000","last_peered":"2024-08-26T00:02:02.522793+0000","last_clean":"2024-08-26T00:02:02.522793+0000","last_became_active":"2024-08-26T00:00:29.357215+0000","last_became_peered":"2024-08-26T00:00:29.357215+0000","last_unstale":"2024-08-26T00:02:02.522793+0000","last_undegraded":"2024-08-26T00:02:02.522793+0000","last_fullsized":"2024-08-26T00:02:02.522793+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:47:32.969629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.529042+0000","last_change":"2024-08-26T00:00:29.368272+0000","last_active":"2024-08-26T00:02:02.529042+0000","last_peered":"2024-08-26T00:02:02.529042+0000","last_clean":"2024-08-26T00:02:02.529042+0000","last_became_active":"2024-08-26T00:00:29.367920+0000","last_became_peered":"2024-08-26T00:00:29.367920+0000","last_unstale":"2024-08-26T00:02:02.529042+0000","last_undegraded":"2024-08-26T00:02:02.529042+0000","last_fullsized":"2024-08-26T00:02:02.529042+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:35:19.373782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.525599+0000","last_change":"2024-08-26T00:00:29.371609+0000","last_active":"2024-08-26T00:02:02.525599+0000","last_peered":"2024-08-26T00:02:02.525599+0000","last_clean":"2024-08-26T00:02:02.525599+0000","last_became_active":"2024-08-26T00:00:29.371199+0000","last_became_peered":"2024-08-26T00:00:29.371199+0000","last_unstale":"2024-08-26T00:02:02.525599+0000","last_undegraded":"2024-08-26T00:02:02.525599+0000","last_fullsized":"2024-08-26T00:02:02.525599+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:03:43.542718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.528791+0000","last_change":"2024-08-26T00:00:29.362222+0000","last_active":"2024-08-26T00:02:02.528791+0000","last_peered":"2024-08-26T00:02:02.528791+0000","last_clean":"2024-08-26T00:02:02.528791+0000","last_became_active":"2024-08-26T00:00:29.361767+0000","last_became_peered":"2024-08-26T00:00:29.361767+0000","last_unstale":"2024-08-26T00:02:02.528791+0000","last_undegraded":"2024-08-26T00:02:02.528791+0000","last_fullsized":"2024-08-26T00:02:02.528791+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:42:17.032034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"80'12","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.519131+0000","last_change":"2024-08-26T00:00:29.357997+0000","last_active":"2024-08-26T00:02:02.519131+0000","last_peered":"2024-08-26T00:02:02.519131+0000","last_clean":"2024-08-26T00:02:02.519131+0000","last_became_active":"2024-08-26T00:00:29.357693+0000","last_became_peered":"2024-08-26T00:00:29.357693+0000","last_unstale":"2024-08-26T00:02:02.519131+0000","last_undegraded":"2024-08-26T00:02:02.519131+0000","last_fullsized":"2024-08-26T00:02:02.519131+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:02:49.074234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.519300+0000","last_change":"2024-08-26T00:00:29.358305+0000","last_active":"2024-08-26T00:02:02.519300+0000","last_peered":"2024-08-26T00:02:02.519300+0000","last_clean":"2024-08-26T00:02:02.519300+0000","last_became_active":"2024-08-26T00:00:29.357928+0000","last_became_peered":"2024-08-26T00:00:29.357928+0000","last_unstale":"2024-08-26T00:02:02.519300+0000","last_undegraded":"2024-08-26T00:02:02.519300+0000","last_fullsized":"2024-08-26T00:02:02.519300+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:34:47.609170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.520949+0000","last_change":"2024-08-26T00:00:29.357931+0000","last_active":"2024-08-26T00:02:02.520949+0000","last_peered":"2024-08-26T00:02:02.520949+0000","last_clean":"2024-08-26T00:02:02.520949+0000","last_became_active":"2024-08-26T00:00:29.357408+0000","last_became_peered":"2024-08-26T00:00:29.357408+0000","last_unstale":"2024-08-26T00:02:02.520949+0000","last_undegraded":"2024-08-26T00:02:02.520949+0000","last_fullsized":"2024-08-26T00:02:02.520949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:21:10.230267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'5","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:26.560688+0000","last_change":"2024-08-26T00:00:26.993942+0000","last_active":"2024-08-26T00:02:26.560688+0000","last_peered":"2024-08-26T00:02:26.560688+0000","last_clean":"2024-08-26T00:02:26.560688+0000","last_became_active":"2024-08-26T00:00:26.993136+0000","last_became_peered":"2024-08-26T00:00:26.993136+0000","last_unstale":"2024-08-26T00:02:26.560688+0000","last_undegraded":"2024-08-26T00:02:26.560688+0000","last_fullsized":"2024-08-26T00:02:26.560688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:30:31.890643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.531080+0000","last_change":"2024-08-26T00:00:29.351174+0000","last_active":"2024-08-26T00:02:02.531080+0000","last_peered":"2024-08-26T00:02:02.531080+0000","last_clean":"2024-08-26T00:02:02.531080+0000","last_became_active":"2024-08-26T00:00:29.350758+0000","last_became_peered":"2024-08-26T00:00:29.350758+0000","last_unstale":"2024-08-26T00:02:02.531080+0000","last_undegraded":"2024-08-26T00:02:02.531080+0000","last_fullsized":"2024-08-26T00:02:02.531080+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:02:56.986251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.593069+0000","last_change":"2024-08-26T00:00:26.991547+0000","last_active":"2024-08-26T00:01:33.593069+0000","last_peered":"2024-08-26T00:01:33.593069+0000","last_clean":"2024-08-26T00:01:33.593069+0000","last_became_active":"2024-08-26T00:00:26.991120+0000","last_became_peered":"2024-08-26T00:00:26.991120+0000","last_unstale":"2024-08-26T00:01:33.593069+0000","last_undegraded":"2024-08-26T00:01:33.593069+0000","last_fullsized":"2024-08-26T00:01:33.593069+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:42:12.381882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.594735+0000","last_change":"2024-08-26T00:00:26.988477+0000","last_active":"2024-08-26T00:01:33.594735+0000","last_peered":"2024-08-26T00:01:33.594735+0000","last_clean":"2024-08-26T00:01:33.594735+0000","last_became_active":"2024-08-26T00:00:26.988180+0000","last_became_peered":"2024-08-26T00:00:26.988180+0000","last_unstale":"2024-08-26T00:01:33.594735+0000","last_undegraded":"2024-08-26T00:01:33.594735+0000","last_fullsized":"2024-08-26T00:01:33.594735+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:00:35.586628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.523904+0000","last_change":"2024-08-26T00:00:29.360687+0000","last_active":"2024-08-26T00:02:02.523904+0000","last_peered":"2024-08-26T00:02:02.523904+0000","last_clean":"2024-08-26T00:02:02.523904+0000","last_became_active":"2024-08-26T00:00:29.358427+0000","last_became_peered":"2024-08-26T00:00:29.358427+0000","last_unstale":"2024-08-26T00:02:02.523904+0000","last_undegraded":"2024-08-26T00:02:02.523904+0000","last_fullsized":"2024-08-26T00:02:02.523904+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:15:41.175510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599569+0000","last_change":"2024-08-26T00:00:26.995054+0000","last_active":"2024-08-26T00:01:33.599569+0000","last_peered":"2024-08-26T00:01:33.599569+0000","last_clean":"2024-08-26T00:01:33.599569+0000","last_became_active":"2024-08-26T00:00:26.994742+0000","last_became_peered":"2024-08-26T00:00:26.994742+0000","last_unstale":"2024-08-26T00:01:33.599569+0000","last_undegraded":"2024-08-26T00:01:33.599569+0000","last_fullsized":"2024-08-26T00:01:33.599569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:02:30.509497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.524712+0000","last_change":"2024-08-26T00:00:29.352343+0000","last_active":"2024-08-26T00:02:02.524712+0000","last_peered":"2024-08-26T00:02:02.524712+0000","last_clean":"2024-08-26T00:02:02.524712+0000","last_became_active":"2024-08-26T00:00:29.352036+0000","last_became_peered":"2024-08-26T00:00:29.352036+0000","last_unstale":"2024-08-26T00:02:02.524712+0000","last_undegraded":"2024-08-26T00:02:02.524712+0000","last_fullsized":"2024-08-26T00:02:02.524712+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:28:14.399870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:25.558616+0000","last_change":"2024-08-26T00:00:26.989828+0000","last_active":"2024-08-26T00:02:25.558616+0000","last_peered":"2024-08-26T00:02:25.558616+0000","last_clean":"2024-08-26T00:02:25.558616+0000","last_became_active":"2024-08-26T00:00:26.989365+0000","last_became_peered":"2024-08-26T00:00:26.989365+0000","last_unstale":"2024-08-26T00:02:25.558616+0000","last_undegraded":"2024-08-26T00:02:25.558616+0000","last_fullsized":"2024-08-26T00:02:25.558616+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:00:40.821500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535546+0000","last_change":"2024-08-26T00:00:29.359506+0000","last_active":"2024-08-26T00:02:02.535546+0000","last_peered":"2024-08-26T00:02:02.535546+0000","last_clean":"2024-08-26T00:02:02.535546+0000","last_became_active":"2024-08-26T00:00:29.359042+0000","last_became_peered":"2024-08-26T00:00:29.359042+0000","last_unstale":"2024-08-26T00:02:02.535546+0000","last_undegraded":"2024-08-26T00:02:02.535546+0000","last_fullsized":"2024-08-26T00:02:02.535546+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:38:34.661823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595861+0000","last_change":"2024-08-26T00:00:26.994272+0000","last_active":"2024-08-26T00:01:33.595861+0000","last_peered":"2024-08-26T00:01:33.595861+0000","last_clean":"2024-08-26T00:01:33.595861+0000","last_became_active":"2024-08-26T00:00:26.993769+0000","last_became_peered":"2024-08-26T00:00:26.993769+0000","last_unstale":"2024-08-26T00:01:33.595861+0000","last_undegraded":"2024-08-26T00:01:33.595861+0000","last_fullsized":"2024-08-26T00:01:33.595861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:03:39.816595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.528626+0000","last_change":"2024-08-26T00:00:29.372236+0000","last_active":"2024-08-26T00:02:02.528626+0000","last_peered":"2024-08-26T00:02:02.528626+0000","last_clean":"2024-08-26T00:02:02.528626+0000","last_became_active":"2024-08-26T00:00:29.371632+0000","last_became_peered":"2024-08-26T00:00:29.371632+0000","last_unstale":"2024-08-26T00:02:02.528626+0000","last_undegraded":"2024-08-26T00:02:02.528626+0000","last_fullsized":"2024-08-26T00:02:02.528626+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:46:10.735550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598661+0000","last_change":"2024-08-26T00:00:27.080074+0000","last_active":"2024-08-26T00:01:33.598661+0000","last_peered":"2024-08-26T00:01:33.598661+0000","last_clean":"2024-08-26T00:01:33.598661+0000","last_became_active":"2024-08-26T00:00:27.079646+0000","last_became_peered":"2024-08-26T00:00:27.079646+0000","last_unstale":"2024-08-26T00:01:33.598661+0000","last_undegraded":"2024-08-26T00:01:33.598661+0000","last_fullsized":"2024-08-26T00:01:33.598661+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:22:42.677747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"80'11","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535811+0000","last_change":"2024-08-26T00:01:33.600131+0000","last_active":"2024-08-26T00:02:02.535811+0000","last_peered":"2024-08-26T00:02:02.535811+0000","last_clean":"2024-08-26T00:02:02.535811+0000","last_became_active":"2024-08-26T00:01:33.599594+0000","last_became_peered":"2024-08-26T00:01:33.599594+0000","last_unstale":"2024-08-26T00:02:02.535811+0000","last_undegraded":"2024-08-26T00:02:02.535811+0000","last_fullsized":"2024-08-26T00:02:02.535811+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:33:33.573513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'33","reported_seq":298,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:26.978341+0000","last_change":"2024-08-26T00:01:33.901247+0000","last_active":"2024-08-26T00:02:26.978341+0000","last_peered":"2024-08-26T00:02:26.978341+0000","last_clean":"2024-08-26T00:02:26.978341+0000","last_became_active":"2024-08-26T00:01:33.892141+0000","last_became_peered":"2024-08-26T00:01:33.892141+0000","last_unstale":"2024-08-26T00:02:26.978341+0000","last_undegraded":"2024-08-26T00:02:26.978341+0000","last_fullsized":"2024-08-26T00:02:26.978341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:08:05.209223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61175,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":221,"num_read_kb":169,"num_write":34,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":60615,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.520296+0000","last_change":"2024-08-26T00:00:29.356969+0000","last_active":"2024-08-26T00:02:02.520296+0000","last_peered":"2024-08-26T00:02:02.520296+0000","last_clean":"2024-08-26T00:02:02.520296+0000","last_became_active":"2024-08-26T00:00:29.356493+0000","last_became_peered":"2024-08-26T00:00:29.356493+0000","last_unstale":"2024-08-26T00:02:02.520296+0000","last_undegraded":"2024-08-26T00:02:02.520296+0000","last_fullsized":"2024-08-26T00:02:02.520296+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:42:29.663933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596334+0000","last_change":"2024-08-26T00:00:26.993733+0000","last_active":"2024-08-26T00:01:33.596334+0000","last_peered":"2024-08-26T00:01:33.596334+0000","last_clean":"2024-08-26T00:01:33.596334+0000","last_became_active":"2024-08-26T00:00:26.991196+0000","last_became_peered":"2024-08-26T00:00:26.991196+0000","last_unstale":"2024-08-26T00:01:33.596334+0000","last_undegraded":"2024-08-26T00:01:33.596334+0000","last_fullsized":"2024-08-26T00:01:33.596334+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:53:49.056228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.521316+0000","last_change":"2024-08-26T00:00:29.363095+0000","last_active":"2024-08-26T00:02:02.521316+0000","last_peered":"2024-08-26T00:02:02.521316+0000","last_clean":"2024-08-26T00:02:02.521316+0000","last_became_active":"2024-08-26T00:00:29.361374+0000","last_became_peered":"2024-08-26T00:00:29.361374+0000","last_unstale":"2024-08-26T00:02:02.521316+0000","last_undegraded":"2024-08-26T00:02:02.521316+0000","last_fullsized":"2024-08-26T00:02:02.521316+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:30:34.072712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598243+0000","last_change":"2024-08-26T00:00:26.993920+0000","last_active":"2024-08-26T00:01:33.598243+0000","last_peered":"2024-08-26T00:01:33.598243+0000","last_clean":"2024-08-26T00:01:33.598243+0000","last_became_active":"2024-08-26T00:00:26.993578+0000","last_became_peered":"2024-08-26T00:00:26.993578+0000","last_unstale":"2024-08-26T00:01:33.598243+0000","last_undegraded":"2024-08-26T00:01:33.598243+0000","last_fullsized":"2024-08-26T00:01:33.598243+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:29:49.751384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.522031+0000","last_change":"2024-08-26T00:00:29.362535+0000","last_active":"2024-08-26T00:02:02.522031+0000","last_peered":"2024-08-26T00:02:02.522031+0000","last_clean":"2024-08-26T00:02:02.522031+0000","last_became_active":"2024-08-26T00:00:29.362167+0000","last_became_peered":"2024-08-26T00:00:29.362167+0000","last_unstale":"2024-08-26T00:02:02.522031+0000","last_undegraded":"2024-08-26T00:02:02.522031+0000","last_fullsized":"2024-08-26T00:02:02.522031+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:21:54.020323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'5","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:24.558457+0000","last_change":"2024-08-26T00:00:26.993988+0000","last_active":"2024-08-26T00:02:24.558457+0000","last_peered":"2024-08-26T00:02:24.558457+0000","last_clean":"2024-08-26T00:02:24.558457+0000","last_became_active":"2024-08-26T00:00:26.993485+0000","last_became_peered":"2024-08-26T00:00:26.993485+0000","last_unstale":"2024-08-26T00:02:24.558457+0000","last_undegraded":"2024-08-26T00:02:24.558457+0000","last_fullsized":"2024-08-26T00:02:24.558457+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:46:29.475574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1118,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"80'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.527020+0000","last_change":"2024-08-26T00:01:33.599944+0000","last_active":"2024-08-26T00:02:02.527020+0000","last_peered":"2024-08-26T00:02:02.527020+0000","last_clean":"2024-08-26T00:02:02.527020+0000","last_became_active":"2024-08-26T00:01:33.599457+0000","last_became_peered":"2024-08-26T00:01:33.599457+0000","last_unstale":"2024-08-26T00:02:02.527020+0000","last_undegraded":"2024-08-26T00:02:02.527020+0000","last_fullsized":"2024-08-26T00:02:02.527020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:12:33.747334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598056+0000","last_change":"2024-08-26T00:00:27.077517+0000","last_active":"2024-08-26T00:01:33.598056+0000","last_peered":"2024-08-26T00:01:33.598056+0000","last_clean":"2024-08-26T00:01:33.598056+0000","last_became_active":"2024-08-26T00:00:27.077083+0000","last_became_peered":"2024-08-26T00:00:27.077083+0000","last_unstale":"2024-08-26T00:01:33.598056+0000","last_undegraded":"2024-08-26T00:01:33.598056+0000","last_fullsized":"2024-08-26T00:01:33.598056+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:27:43.522233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.530797+0000","last_change":"2024-08-26T00:00:29.355532+0000","last_active":"2024-08-26T00:02:02.530797+0000","last_peered":"2024-08-26T00:02:02.530797+0000","last_clean":"2024-08-26T00:02:02.530797+0000","last_became_active":"2024-08-26T00:00:29.355211+0000","last_became_peered":"2024-08-26T00:00:29.355211+0000","last_unstale":"2024-08-26T00:02:02.530797+0000","last_undegraded":"2024-08-26T00:02:02.530797+0000","last_fullsized":"2024-08-26T00:02:02.530797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:08:51.419634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598646+0000","last_change":"2024-08-26T00:00:26.992613+0000","last_active":"2024-08-26T00:01:33.598646+0000","last_peered":"2024-08-26T00:01:33.598646+0000","last_clean":"2024-08-26T00:01:33.598646+0000","last_became_active":"2024-08-26T00:00:26.992137+0000","last_became_peered":"2024-08-26T00:00:26.992137+0000","last_unstale":"2024-08-26T00:01:33.598646+0000","last_undegraded":"2024-08-26T00:01:33.598646+0000","last_fullsized":"2024-08-26T00:01:33.598646+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:30:32.586859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.532951+0000","last_change":"2024-08-26T00:00:29.362342+0000","last_active":"2024-08-26T00:02:02.532951+0000","last_peered":"2024-08-26T00:02:02.532951+0000","last_clean":"2024-08-26T00:02:02.532951+0000","last_became_active":"2024-08-26T00:00:29.362017+0000","last_became_peered":"2024-08-26T00:00:29.362017+0000","last_unstale":"2024-08-26T00:02:02.532951+0000","last_undegraded":"2024-08-26T00:02:02.532951+0000","last_fullsized":"2024-08-26T00:02:02.532951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:01:55.507893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595105+0000","last_change":"2024-08-26T00:00:26.989977+0000","last_active":"2024-08-26T00:01:33.595105+0000","last_peered":"2024-08-26T00:01:33.595105+0000","last_clean":"2024-08-26T00:01:33.595105+0000","last_became_active":"2024-08-26T00:00:26.989535+0000","last_became_peered":"2024-08-26T00:00:26.989535+0000","last_unstale":"2024-08-26T00:01:33.595105+0000","last_undegraded":"2024-08-26T00:01:33.595105+0000","last_fullsized":"2024-08-26T00:01:33.595105+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:33:20.347005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.518416+0000","last_change":"2024-08-26T00:00:29.355928+0000","last_active":"2024-08-26T00:02:02.518416+0000","last_peered":"2024-08-26T00:02:02.518416+0000","last_clean":"2024-08-26T00:02:02.518416+0000","last_became_active":"2024-08-26T00:00:29.355546+0000","last_became_peered":"2024-08-26T00:00:29.355546+0000","last_unstale":"2024-08-26T00:02:02.518416+0000","last_undegraded":"2024-08-26T00:02:02.518416+0000","last_fullsized":"2024-08-26T00:02:02.518416+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:15:06.116141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598775+0000","last_change":"2024-08-26T00:00:26.992523+0000","last_active":"2024-08-26T00:01:33.598775+0000","last_peered":"2024-08-26T00:01:33.598775+0000","last_clean":"2024-08-26T00:01:33.598775+0000","last_became_active":"2024-08-26T00:00:26.992193+0000","last_became_peered":"2024-08-26T00:00:26.992193+0000","last_unstale":"2024-08-26T00:01:33.598775+0000","last_undegraded":"2024-08-26T00:01:33.598775+0000","last_fullsized":"2024-08-26T00:01:33.598775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:34:21.879373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.522820+0000","last_change":"2024-08-26T00:00:29.358826+0000","last_active":"2024-08-26T00:02:02.522820+0000","last_peered":"2024-08-26T00:02:02.522820+0000","last_clean":"2024-08-26T00:02:02.522820+0000","last_became_active":"2024-08-26T00:00:29.358478+0000","last_became_peered":"2024-08-26T00:00:29.358478+0000","last_unstale":"2024-08-26T00:02:02.522820+0000","last_undegraded":"2024-08-26T00:02:02.522820+0000","last_fullsized":"2024-08-26T00:02:02.522820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:30:39.484666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596872+0000","last_change":"2024-08-26T00:00:27.077599+0000","last_active":"2024-08-26T00:01:33.596872+0000","last_peered":"2024-08-26T00:01:33.596872+0000","last_clean":"2024-08-26T00:01:33.596872+0000","last_became_active":"2024-08-26T00:00:27.077094+0000","last_became_peered":"2024-08-26T00:00:27.077094+0000","last_unstale":"2024-08-26T00:01:33.596872+0000","last_undegraded":"2024-08-26T00:01:33.596872+0000","last_fullsized":"2024-08-26T00:01:33.596872+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:06:47.966097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535039+0000","last_change":"2024-08-26T00:00:29.355243+0000","last_active":"2024-08-26T00:02:02.535039+0000","last_peered":"2024-08-26T00:02:02.535039+0000","last_clean":"2024-08-26T00:02:02.535039+0000","last_became_active":"2024-08-26T00:00:29.354151+0000","last_became_peered":"2024-08-26T00:00:29.354151+0000","last_unstale":"2024-08-26T00:02:02.535039+0000","last_undegraded":"2024-08-26T00:02:02.535039+0000","last_fullsized":"2024-08-26T00:02:02.535039+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:00:12.520736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":335,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596237+0000","last_change":"2024-08-25T23:59:16.227980+0000","last_active":"2024-08-26T00:01:33.596237+0000","last_peered":"2024-08-26T00:01:33.596237+0000","last_clean":"2024-08-26T00:01:33.596237+0000","last_became_active":"2024-08-25T23:59:16.227550+0000","last_became_peered":"2024-08-25T23:59:16.227550+0000","last_unstale":"2024-08-26T00:01:33.596237+0000","last_undegraded":"2024-08-26T00:01:33.596237+0000","last_fullsized":"2024-08-26T00:01:33.596237+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-25T23:55:51.247914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-25T23:55:51.247914+0000","last_clean_scrub_stamp":"2024-08-25T23:55:51.247914+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:39:34.184312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.890555+0000","last_change":"2024-08-26T00:00:26.992675+0000","last_active":"2024-08-26T00:01:33.890555+0000","last_peered":"2024-08-26T00:01:33.890555+0000","last_clean":"2024-08-26T00:01:33.890555+0000","last_became_active":"2024-08-26T00:00:26.992322+0000","last_became_peered":"2024-08-26T00:00:26.992322+0000","last_unstale":"2024-08-26T00:01:33.890555+0000","last_undegraded":"2024-08-26T00:01:33.890555+0000","last_fullsized":"2024-08-26T00:01:33.890555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:38:26.016220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.534623+0000","last_change":"2024-08-26T00:00:29.362617+0000","last_active":"2024-08-26T00:02:02.534623+0000","last_peered":"2024-08-26T00:02:02.534623+0000","last_clean":"2024-08-26T00:02:02.534623+0000","last_became_active":"2024-08-26T00:00:29.362245+0000","last_became_peered":"2024-08-26T00:00:29.362245+0000","last_unstale":"2024-08-26T00:02:02.534623+0000","last_undegraded":"2024-08-26T00:02:02.534623+0000","last_fullsized":"2024-08-26T00:02:02.534623+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:30:12.309213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.895870+0000","last_change":"2024-08-26T00:01:33.895296+0000","last_active":"2024-08-26T00:01:33.895870+0000","last_peered":"2024-08-26T00:01:33.895870+0000","last_clean":"2024-08-26T00:01:33.895870+0000","last_became_active":"2024-08-26T00:01:33.891598+0000","last_became_peered":"2024-08-26T00:01:33.891598+0000","last_unstale":"2024-08-26T00:01:33.895870+0000","last_undegraded":"2024-08-26T00:01:33.895870+0000","last_fullsized":"2024-08-26T00:01:33.895870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:26:31.794735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"80'5","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.519184+0000","last_change":"2024-08-26T00:01:33.601137+0000","last_active":"2024-08-26T00:02:02.519184+0000","last_peered":"2024-08-26T00:02:02.519184+0000","last_clean":"2024-08-26T00:02:02.519184+0000","last_became_active":"2024-08-26T00:01:33.600397+0000","last_became_peered":"2024-08-26T00:01:33.600397+0000","last_unstale":"2024-08-26T00:02:02.519184+0000","last_undegraded":"2024-08-26T00:02:02.519184+0000","last_fullsized":"2024-08-26T00:02:02.519184+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:42:21.507880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'6","reported_seq":135,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:26.560704+0000","last_change":"2024-08-26T00:00:27.077840+0000","last_active":"2024-08-26T00:02:26.560704+0000","last_peered":"2024-08-26T00:02:26.560704+0000","last_clean":"2024-08-26T00:02:26.560704+0000","last_became_active":"2024-08-26T00:00:27.077355+0000","last_became_peered":"2024-08-26T00:00:27.077355+0000","last_unstale":"2024-08-26T00:02:26.560704+0000","last_undegraded":"2024-08-26T00:02:26.560704+0000","last_fullsized":"2024-08-26T00:02:26.560704+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:03:30.718962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"80'8","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.521970+0000","last_change":"2024-08-26T00:01:33.603558+0000","last_active":"2024-08-26T00:02:02.521970+0000","last_peered":"2024-08-26T00:02:02.521970+0000","last_clean":"2024-08-26T00:02:02.521970+0000","last_became_active":"2024-08-26T00:01:33.603177+0000","last_became_peered":"2024-08-26T00:01:33.603177+0000","last_unstale":"2024-08-26T00:02:02.521970+0000","last_undegraded":"2024-08-26T00:02:02.521970+0000","last_fullsized":"2024-08-26T00:02:02.521970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:21:33.913812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595978+0000","last_change":"2024-08-26T00:00:26.994187+0000","last_active":"2024-08-26T00:01:33.595978+0000","last_peered":"2024-08-26T00:01:33.595978+0000","last_clean":"2024-08-26T00:01:33.595978+0000","last_became_active":"2024-08-26T00:00:26.993699+0000","last_became_peered":"2024-08-26T00:00:26.993699+0000","last_unstale":"2024-08-26T00:01:33.595978+0000","last_undegraded":"2024-08-26T00:01:33.595978+0000","last_fullsized":"2024-08-26T00:01:33.595978+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:19:50.412724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.532714+0000","last_change":"2024-08-26T00:00:29.364507+0000","last_active":"2024-08-26T00:02:02.532714+0000","last_peered":"2024-08-26T00:02:02.532714+0000","last_clean":"2024-08-26T00:02:02.532714+0000","last_became_active":"2024-08-26T00:00:29.364129+0000","last_became_peered":"2024-08-26T00:00:29.364129+0000","last_unstale":"2024-08-26T00:02:02.532714+0000","last_undegraded":"2024-08-26T00:02:02.532714+0000","last_fullsized":"2024-08-26T00:02:02.532714+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:17:36.837206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599893+0000","last_change":"2024-08-26T00:00:27.076977+0000","last_active":"2024-08-26T00:01:33.599893+0000","last_peered":"2024-08-26T00:01:33.599893+0000","last_clean":"2024-08-26T00:01:33.599893+0000","last_became_active":"2024-08-26T00:00:27.076524+0000","last_became_peered":"2024-08-26T00:00:27.076524+0000","last_unstale":"2024-08-26T00:01:33.599893+0000","last_undegraded":"2024-08-26T00:01:33.599893+0000","last_fullsized":"2024-08-26T00:01:33.599893+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:22:21.820009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.523841+0000","last_change":"2024-08-26T00:00:29.363880+0000","last_active":"2024-08-26T00:02:02.523841+0000","last_peered":"2024-08-26T00:02:02.523841+0000","last_clean":"2024-08-26T00:02:02.523841+0000","last_became_active":"2024-08-26T00:00:29.363475+0000","last_became_peered":"2024-08-26T00:00:29.363475+0000","last_unstale":"2024-08-26T00:02:02.523841+0000","last_undegraded":"2024-08-26T00:02:02.523841+0000","last_fullsized":"2024-08-26T00:02:02.523841+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:30:55.875922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.606790+0000","last_change":"2024-08-26T00:01:33.606353+0000","last_active":"2024-08-26T00:01:33.606790+0000","last_peered":"2024-08-26T00:01:33.606790+0000","last_clean":"2024-08-26T00:01:33.606790+0000","last_became_active":"2024-08-26T00:01:33.599903+0000","last_became_peered":"2024-08-26T00:01:33.599903+0000","last_unstale":"2024-08-26T00:01:33.606790+0000","last_undegraded":"2024-08-26T00:01:33.606790+0000","last_fullsized":"2024-08-26T00:01:33.606790+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:02:09.033915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.519061+0000","last_change":"2024-08-26T00:00:29.360285+0000","last_active":"2024-08-26T00:02:02.519061+0000","last_peered":"2024-08-26T00:02:02.519061+0000","last_clean":"2024-08-26T00:02:02.519061+0000","last_became_active":"2024-08-26T00:00:29.359879+0000","last_became_peered":"2024-08-26T00:00:29.359879+0000","last_unstale":"2024-08-26T00:02:02.519061+0000","last_undegraded":"2024-08-26T00:02:02.519061+0000","last_fullsized":"2024-08-26T00:02:02.519061+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:49:10.691817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'13","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599894+0000","last_change":"2024-08-26T00:00:26.990419+0000","last_active":"2024-08-26T00:01:33.599894+0000","last_peered":"2024-08-26T00:01:33.599894+0000","last_clean":"2024-08-26T00:01:33.599894+0000","last_became_active":"2024-08-26T00:00:26.990052+0000","last_became_peered":"2024-08-26T00:00:26.990052+0000","last_unstale":"2024-08-26T00:01:33.599894+0000","last_undegraded":"2024-08-26T00:01:33.599894+0000","last_fullsized":"2024-08-26T00:01:33.599894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:27:41.229418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.524365+0000","last_change":"2024-08-26T00:00:29.354671+0000","last_active":"2024-08-26T00:02:02.524365+0000","last_peered":"2024-08-26T00:02:02.524365+0000","last_clean":"2024-08-26T00:02:02.524365+0000","last_became_active":"2024-08-26T00:00:29.354071+0000","last_became_peered":"2024-08-26T00:00:29.354071+0000","last_unstale":"2024-08-26T00:02:02.524365+0000","last_undegraded":"2024-08-26T00:02:02.524365+0000","last_fullsized":"2024-08-26T00:02:02.524365+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:50:09.097757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.890786+0000","last_change":"2024-08-26T00:00:26.991622+0000","last_active":"2024-08-26T00:01:33.890786+0000","last_peered":"2024-08-26T00:01:33.890786+0000","last_clean":"2024-08-26T00:01:33.890786+0000","last_became_active":"2024-08-26T00:00:26.991244+0000","last_became_peered":"2024-08-26T00:00:26.991244+0000","last_unstale":"2024-08-26T00:01:33.890786+0000","last_undegraded":"2024-08-26T00:01:33.890786+0000","last_fullsized":"2024-08-26T00:01:33.890786+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:58:25.676985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.526109+0000","last_change":"2024-08-26T00:00:29.367033+0000","last_active":"2024-08-26T00:02:02.526109+0000","last_peered":"2024-08-26T00:02:02.526109+0000","last_clean":"2024-08-26T00:02:02.526109+0000","last_became_active":"2024-08-26T00:00:29.365572+0000","last_became_peered":"2024-08-26T00:00:29.365572+0000","last_unstale":"2024-08-26T00:02:02.526109+0000","last_undegraded":"2024-08-26T00:02:02.526109+0000","last_fullsized":"2024-08-26T00:02:02.526109+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:16:49.116721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596764+0000","last_change":"2024-08-26T00:00:27.076562+0000","last_active":"2024-08-26T00:01:33.596764+0000","last_peered":"2024-08-26T00:01:33.596764+0000","last_clean":"2024-08-26T00:01:33.596764+0000","last_became_active":"2024-08-26T00:00:27.076163+0000","last_became_peered":"2024-08-26T00:00:27.076163+0000","last_unstale":"2024-08-26T00:01:33.596764+0000","last_undegraded":"2024-08-26T00:01:33.596764+0000","last_fullsized":"2024-08-26T00:01:33.596764+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:25:03.222457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"80'2","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.491274+0000","last_change":"2024-08-26T00:00:29.352787+0000","last_active":"2024-08-26T00:02:02.491274+0000","last_peered":"2024-08-26T00:02:02.491274+0000","last_clean":"2024-08-26T00:02:02.491274+0000","last_became_active":"2024-08-26T00:00:29.352429+0000","last_became_peered":"2024-08-26T00:00:29.352429+0000","last_unstale":"2024-08-26T00:02:02.491274+0000","last_undegraded":"2024-08-26T00:02:02.491274+0000","last_fullsized":"2024-08-26T00:02:02.491274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:39:45.080372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.592534+0000","last_change":"2024-08-26T00:00:26.989778+0000","last_active":"2024-08-26T00:01:33.592534+0000","last_peered":"2024-08-26T00:01:33.592534+0000","last_clean":"2024-08-26T00:01:33.592534+0000","last_became_active":"2024-08-26T00:00:26.989433+0000","last_became_peered":"2024-08-26T00:00:26.989433+0000","last_unstale":"2024-08-26T00:01:33.592534+0000","last_undegraded":"2024-08-26T00:01:33.592534+0000","last_fullsized":"2024-08-26T00:01:33.592534+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:36:16.684252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.525073+0000","last_change":"2024-08-26T00:00:29.362705+0000","last_active":"2024-08-26T00:02:02.525073+0000","last_peered":"2024-08-26T00:02:02.525073+0000","last_clean":"2024-08-26T00:02:02.525073+0000","last_became_active":"2024-08-26T00:00:29.362341+0000","last_became_peered":"2024-08-26T00:00:29.362341+0000","last_unstale":"2024-08-26T00:02:02.525073+0000","last_undegraded":"2024-08-26T00:02:02.525073+0000","last_fullsized":"2024-08-26T00:02:02.525073+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:10:47.051351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.609432+0000","last_change":"2024-08-26T00:01:33.608894+0000","last_active":"2024-08-26T00:01:33.609432+0000","last_peered":"2024-08-26T00:01:33.609432+0000","last_clean":"2024-08-26T00:01:33.609432+0000","last_became_active":"2024-08-26T00:01:33.601976+0000","last_became_peered":"2024-08-26T00:01:33.601976+0000","last_unstale":"2024-08-26T00:01:33.609432+0000","last_undegraded":"2024-08-26T00:01:33.609432+0000","last_fullsized":"2024-08-26T00:01:33.609432+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:03:17.367456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.528063+0000","last_change":"2024-08-26T00:00:29.365553+0000","last_active":"2024-08-26T00:02:02.528063+0000","last_peered":"2024-08-26T00:02:02.528063+0000","last_clean":"2024-08-26T00:02:02.528063+0000","last_became_active":"2024-08-26T00:00:29.365215+0000","last_became_peered":"2024-08-26T00:00:29.365215+0000","last_unstale":"2024-08-26T00:02:02.528063+0000","last_undegraded":"2024-08-26T00:02:02.528063+0000","last_fullsized":"2024-08-26T00:02:02.528063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:55:01.505530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598744+0000","last_change":"2024-08-26T00:00:26.995228+0000","last_active":"2024-08-26T00:01:33.598744+0000","last_peered":"2024-08-26T00:01:33.598744+0000","last_clean":"2024-08-26T00:01:33.598744+0000","last_became_active":"2024-08-26T00:00:26.994875+0000","last_became_peered":"2024-08-26T00:00:26.994875+0000","last_unstale":"2024-08-26T00:01:33.598744+0000","last_undegraded":"2024-08-26T00:01:33.598744+0000","last_fullsized":"2024-08-26T00:01:33.598744+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:27:21.110162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.528622+0000","last_change":"2024-08-26T00:00:29.361598+0000","last_active":"2024-08-26T00:02:02.528622+0000","last_peered":"2024-08-26T00:02:02.528622+0000","last_clean":"2024-08-26T00:02:02.528622+0000","last_became_active":"2024-08-26T00:00:29.361237+0000","last_became_peered":"2024-08-26T00:00:29.361237+0000","last_unstale":"2024-08-26T00:02:02.528622+0000","last_undegraded":"2024-08-26T00:02:02.528622+0000","last_fullsized":"2024-08-26T00:02:02.528622+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:21:30.126060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.531764+0000","last_change":"2024-08-26T00:00:29.355240+0000","last_active":"2024-08-26T00:02:02.531764+0000","last_peered":"2024-08-26T00:02:02.531764+0000","last_clean":"2024-08-26T00:02:02.531764+0000","last_became_active":"2024-08-26T00:00:29.354165+0000","last_became_peered":"2024-08-26T00:00:29.354165+0000","last_unstale":"2024-08-26T00:02:02.531764+0000","last_undegraded":"2024-08-26T00:02:02.531764+0000","last_fullsized":"2024-08-26T00:02:02.531764+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:07:56.573032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598465+0000","last_change":"2024-08-26T00:00:26.992240+0000","last_active":"2024-08-26T00:01:33.598465+0000","last_peered":"2024-08-26T00:01:33.598465+0000","last_clean":"2024-08-26T00:01:33.598465+0000","last_became_active":"2024-08-26T00:00:26.991866+0000","last_became_peered":"2024-08-26T00:00:26.991866+0000","last_unstale":"2024-08-26T00:01:33.598465+0000","last_undegraded":"2024-08-26T00:01:33.598465+0000","last_fullsized":"2024-08-26T00:01:33.598465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:25:50.815151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535915+0000","last_change":"2024-08-26T00:00:29.370358+0000","last_active":"2024-08-26T00:02:02.535915+0000","last_peered":"2024-08-26T00:02:02.535915+0000","last_clean":"2024-08-26T00:02:02.535915+0000","last_became_active":"2024-08-26T00:00:29.369910+0000","last_became_peered":"2024-08-26T00:00:29.369910+0000","last_unstale":"2024-08-26T00:02:02.535915+0000","last_undegraded":"2024-08-26T00:02:02.535915+0000","last_fullsized":"2024-08-26T00:02:02.535915+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:49:11.351575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599966+0000","last_change":"2024-08-26T00:00:26.989759+0000","last_active":"2024-08-26T00:01:33.599966+0000","last_peered":"2024-08-26T00:01:33.599966+0000","last_clean":"2024-08-26T00:01:33.599966+0000","last_became_active":"2024-08-26T00:00:26.989376+0000","last_became_peered":"2024-08-26T00:00:26.989376+0000","last_unstale":"2024-08-26T00:01:33.599966+0000","last_undegraded":"2024-08-26T00:01:33.599966+0000","last_fullsized":"2024-08-26T00:01:33.599966+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:44:36.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535350+0000","last_change":"2024-08-26T00:00:29.367050+0000","last_active":"2024-08-26T00:02:02.535350+0000","last_peered":"2024-08-26T00:02:02.535350+0000","last_clean":"2024-08-26T00:02:02.535350+0000","last_became_active":"2024-08-26T00:00:29.366737+0000","last_became_peered":"2024-08-26T00:00:29.366737+0000","last_unstale":"2024-08-26T00:02:02.535350+0000","last_undegraded":"2024-08-26T00:02:02.535350+0000","last_fullsized":"2024-08-26T00:02:02.535350+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:00:54.461716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.593279+0000","last_change":"2024-08-26T00:00:27.078078+0000","last_active":"2024-08-26T00:01:33.593279+0000","last_peered":"2024-08-26T00:01:33.593279+0000","last_clean":"2024-08-26T00:01:33.593279+0000","last_became_active":"2024-08-26T00:00:27.077036+0000","last_became_peered":"2024-08-26T00:00:27.077036+0000","last_unstale":"2024-08-26T00:01:33.593279+0000","last_undegraded":"2024-08-26T00:01:33.593279+0000","last_fullsized":"2024-08-26T00:01:33.593279+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:47:44.674548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.525496+0000","last_change":"2024-08-26T00:00:29.363867+0000","last_active":"2024-08-26T00:02:02.525496+0000","last_peered":"2024-08-26T00:02:02.525496+0000","last_clean":"2024-08-26T00:02:02.525496+0000","last_became_active":"2024-08-26T00:00:29.363556+0000","last_became_peered":"2024-08-26T00:00:29.363556+0000","last_unstale":"2024-08-26T00:02:02.525496+0000","last_undegraded":"2024-08-26T00:02:02.525496+0000","last_fullsized":"2024-08-26T00:02:02.525496+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:50:04.009177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.600007+0000","last_change":"2024-08-26T00:00:26.990557+0000","last_active":"2024-08-26T00:01:33.600007+0000","last_peered":"2024-08-26T00:01:33.600007+0000","last_clean":"2024-08-26T00:01:33.600007+0000","last_became_active":"2024-08-26T00:00:26.989945+0000","last_became_peered":"2024-08-26T00:00:26.989945+0000","last_unstale":"2024-08-26T00:01:33.600007+0000","last_undegraded":"2024-08-26T00:01:33.600007+0000","last_fullsized":"2024-08-26T00:01:33.600007+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:26:54.388359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65315,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":668,"num_read_kb":402,"num_write":176,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":60637,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":195634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645350,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":426443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874281,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41044,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704108,"statfs":{"total":95995035648,"available":95953006592,"internally_reserved":0,"allocated":1576960,"data_stored":1079918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037807,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":426657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266742,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":426555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495673,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40960,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704192,"statfs":{"total":95995035648,"available":95953092608,"internally_reserved":0,"allocated":1490944,"data_stored":1018646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626494,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":884736,"data_stored":426046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855428,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28492,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716660,"statfs":{"total":95995035648,"available":95965859840,"internally_reserved":0,"allocated":1503232,"data_stored":1017800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018951,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":487877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247885,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":426357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444116,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":427189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40428,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704724,"statfs":{"total":95995035648,"available":95953637376,"internally_reserved":0,"allocated":946176,"data_stored":486703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":427317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-26T00:02:32.181 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-26T00:02:32.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:31 smithi043 ceph-mon[22091]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-26T00:02:32.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:31 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/144638982' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:02:32.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:31 smithi181 ceph-mon[22102]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-26T00:02:32.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:31 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/144638982' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:02:32.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.374+0000 7f09cba00640 1 -- 172.21.15.42:0/373864513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09c4105680 msgr2=0x7f09c410bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:32.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.374+0000 7f09cba00640 1 --2- 172.21.15.42:0/373864513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09c4105680 0x7f09c410bf10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f09bc009ca0 tx=0x7f09bc02a8c0 comp rx=0 tx=0).stop 2024-08-26T00:02:32.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.374+0000 7f09cba00640 1 -- 172.21.15.42:0/373864513 shutdown_connections 2024-08-26T00:02:32.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.374+0000 7f09cba00640 1 --2- 172.21.15.42:0/373864513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09c4105680 0x7f09c410bf10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:32.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.374+0000 7f09cba00640 1 --2- 172.21.15.42:0/373864513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f09c4104cc0 0x7f09c4105140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:32.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.374+0000 7f09cba00640 1 --2- 172.21.15.42:0/373864513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09c4103ad0 0x7f09c4103ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:32.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.374+0000 7f09cba00640 1 -- 172.21.15.42:0/373864513 >> 172.21.15.42:0/373864513 conn(0x7f09c40ff250 msgr2=0x7f09c4101670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:32.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.374+0000 7f09cba00640 1 -- 172.21.15.42:0/373864513 shutdown_connections 2024-08-26T00:02:32.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.374+0000 7f09cba00640 1 -- 172.21.15.42:0/373864513 wait complete. 2024-08-26T00:02:32.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.375+0000 7f09cba00640 1 Processor -- start 2024-08-26T00:02:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.375+0000 7f09cba00640 1 -- start start 2024-08-26T00:02:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.375+0000 7f09cba00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09c4103ad0 0x7f09c4199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.375+0000 7f09cba00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09c4104cc0 0x7f09c419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.375+0000 7f09cba00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f09c4105680 0x7f09c41a12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.376+0000 7f09cba00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f09c410f780 con 0x7f09c4104cc0 2024-08-26T00:02:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.376+0000 7f09cba00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f09c410f600 con 0x7f09c4103ad0 2024-08-26T00:02:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.376+0000 7f09cba00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f09c410f900 con 0x7f09c4105680 2024-08-26T00:02:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.376+0000 7f09c3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09c4104cc0 0x7f09c419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.376+0000 7f09c3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09c4104cc0 0x7f09c419a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42090/0 (socket says 172.21.15.42:42090) 2024-08-26T00:02:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.376+0000 7f09c3e00640 1 -- 172.21.15.42:0/3070437014 learned_addr learned my addr 172.21.15.42:0/3070437014 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.376+0000 7f09c9000640 1 --2- 172.21.15.42:0/3070437014 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09c4103ad0 0x7f09c4199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.376+0000 7f09c9a00640 1 --2- 172.21.15.42:0/3070437014 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f09c4105680 0x7f09c41a12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.376+0000 7f09c3e00640 1 -- 172.21.15.42:0/3070437014 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f09c4105680 msgr2=0x7f09c41a12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:32.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.376+0000 7f09c3e00640 1 --2- 172.21.15.42:0/3070437014 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f09c4105680 0x7f09c41a12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:32.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.376+0000 7f09c3e00640 1 -- 172.21.15.42:0/3070437014 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09c4103ad0 msgr2=0x7f09c4199d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:32.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.376+0000 7f09c3e00640 1 --2- 172.21.15.42:0/3070437014 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09c4103ad0 0x7f09c4199d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:32.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.376+0000 7f09c3e00640 1 -- 172.21.15.42:0/3070437014 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c41a1960 con 0x7f09c4104cc0 2024-08-26T00:02:32.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.377+0000 7f09c3e00640 1 --2- 172.21.15.42:0/3070437014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09c4104cc0 0x7f09c419a280 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f09b000ea60 tx=0x7f09b000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:32.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.377+0000 7f09c1600640 1 -- 172.21.15.42:0/3070437014 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b000cde0 con 0x7f09c4104cc0 2024-08-26T00:02:32.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.377+0000 7f09c1600640 1 -- 172.21.15.42:0/3070437014 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09b00035f0 con 0x7f09c4104cc0 2024-08-26T00:02:32.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.377+0000 7f09c1600640 1 -- 172.21.15.42:0/3070437014 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b0010670 con 0x7f09c4104cc0 2024-08-26T00:02:32.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.377+0000 7f09cba00640 1 -- 172.21.15.42:0/3070437014 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c41a1c50 con 0x7f09c4104cc0 2024-08-26T00:02:32.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.377+0000 7f09cba00640 1 -- 172.21.15.42:0/3070437014 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c41a21a0 con 0x7f09c4104cc0 2024-08-26T00:02:32.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.378+0000 7f09cba00640 1 -- 172.21.15.42:0/3070437014 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09c410ae40 con 0x7f09c4104cc0 2024-08-26T00:02:32.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.380+0000 7f09c1600640 1 -- 172.21.15.42:0/3070437014 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f09b00037a0 con 0x7f09c4104cc0 2024-08-26T00:02:32.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.382+0000 7f09c1600640 1 --2- 172.21.15.42:0/3070437014 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f09ac0a2c10 0x7f09ac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:32.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.382+0000 7f09c1600640 1 -- 172.21.15.42:0/3070437014 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f09b00cf3a0 con 0x7f09c4104cc0 2024-08-26T00:02:32.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.382+0000 7f09c9000640 1 --2- 172.21.15.42:0/3070437014 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f09ac0a2c10 0x7f09ac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:32.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.383+0000 7f09c9000640 1 --2- 172.21.15.42:0/3070437014 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f09ac0a2c10 0x7f09ac0a50d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f09c4104b20 tx=0x7f09b8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:32.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.386+0000 7f09c1600640 1 -- 172.21.15.42:0/3070437014 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f09b009c2c0 con 0x7f09c4104cc0 2024-08-26T00:02:32.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.573+0000 7f09cba00640 1 -- 172.21.15.42:0/3070437014 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f09c40623d0 con 0x7f09ac0a2c10 2024-08-26T00:02:32.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.579+0000 7f09c1600640 1 -- 172.21.15.42:0/3070437014 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258837 (secure 0 0 0) 0x7f09c40623d0 con 0x7f09ac0a2c10 2024-08-26T00:02:32.584 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:02:32.585 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-08-26T00:02:32.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.584+0000 7f09cba00640 1 -- 172.21.15.42:0/3070437014 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f09ac0a2c10 msgr2=0x7f09ac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:32.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.584+0000 7f09cba00640 1 --2- 172.21.15.42:0/3070437014 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f09ac0a2c10 0x7f09ac0a50d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f09c4104b20 tx=0x7f09b8005f90 comp rx=0 tx=0).stop 2024-08-26T00:02:32.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.584+0000 7f09cba00640 1 -- 172.21.15.42:0/3070437014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09c4104cc0 msgr2=0x7f09c419a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:32.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.584+0000 7f09cba00640 1 --2- 172.21.15.42:0/3070437014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09c4104cc0 0x7f09c419a280 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f09b000ea60 tx=0x7f09b000ef20 comp rx=0 tx=0).stop 2024-08-26T00:02:32.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.584+0000 7f09cba00640 1 -- 172.21.15.42:0/3070437014 shutdown_connections 2024-08-26T00:02:32.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.584+0000 7f09cba00640 1 --2- 172.21.15.42:0/3070437014 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f09ac0a2c10 0x7f09ac0a50d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:32.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.584+0000 7f09cba00640 1 --2- 172.21.15.42:0/3070437014 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f09c4105680 0x7f09c41a12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:32.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.584+0000 7f09cba00640 1 --2- 172.21.15.42:0/3070437014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09c4104cc0 0x7f09c419a280 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:32.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.584+0000 7f09cba00640 1 --2- 172.21.15.42:0/3070437014 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09c4103ad0 0x7f09c4199d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:32.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.584+0000 7f09cba00640 1 -- 172.21.15.42:0/3070437014 >> 172.21.15.42:0/3070437014 conn(0x7f09c40ff250 msgr2=0x7f09c4108010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:32.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.584+0000 7f09cba00640 1 -- 172.21.15.42:0/3070437014 shutdown_connections 2024-08-26T00:02:32.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.584+0000 7f09cba00640 1 -- 172.21.15.42:0/3070437014 wait complete. 2024-08-26T00:02:32.600 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2024-08-26T00:02:32.522159+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660542,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":821,"num_read_kb":532,"num_write":363,"num_write_kb":3065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1241373,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":791,"ondisk_log_size":791,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":399144,"kb_used_data":12456,"kb_used_omap":18,"kb_used_meta":386477,"kb_avail":1124542680,"statfs":{"total":1151940427776,"available":1151531704320,"internally_reserved":0,"allocated":12754944,"data_stored":7091694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19137,"internal_metadata":395752767},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4936,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":52,"num_write":9,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002892"},"pg_stats":[{"pgid":"3.3f","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535385+0000","last_change":"2024-08-26T00:00:29.365654+0000","last_active":"2024-08-26T00:02:02.535385+0000","last_peered":"2024-08-26T00:02:02.535385+0000","last_clean":"2024-08-26T00:02:02.535385+0000","last_became_active":"2024-08-26T00:00:29.364609+0000","last_became_peered":"2024-08-26T00:00:29.364609+0000","last_unstale":"2024-08-26T00:02:02.535385+0000","last_undegraded":"2024-08-26T00:02:02.535385+0000","last_fullsized":"2024-08-26T00:02:02.535385+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:54:39.886248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.520050+0000","last_change":"2024-08-26T00:00:29.367657+0000","last_active":"2024-08-26T00:02:02.520050+0000","last_peered":"2024-08-26T00:02:02.520050+0000","last_clean":"2024-08-26T00:02:02.520050+0000","last_became_active":"2024-08-26T00:00:29.367376+0000","last_became_peered":"2024-08-26T00:00:29.367376+0000","last_unstale":"2024-08-26T00:02:02.520050+0000","last_undegraded":"2024-08-26T00:02:02.520050+0000","last_fullsized":"2024-08-26T00:02:02.520050+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:16:13.414883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.534577+0000","last_change":"2024-08-26T00:00:29.369219+0000","last_active":"2024-08-26T00:02:02.534577+0000","last_peered":"2024-08-26T00:02:02.534577+0000","last_clean":"2024-08-26T00:02:02.534577+0000","last_became_active":"2024-08-26T00:00:29.368902+0000","last_became_peered":"2024-08-26T00:00:29.368902+0000","last_unstale":"2024-08-26T00:02:02.534577+0000","last_undegraded":"2024-08-26T00:02:02.534577+0000","last_fullsized":"2024-08-26T00:02:02.534577+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:53:28.636658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"80'8","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.530982+0000","last_change":"2024-08-26T00:00:29.359501+0000","last_active":"2024-08-26T00:02:02.530982+0000","last_peered":"2024-08-26T00:02:02.530982+0000","last_clean":"2024-08-26T00:02:02.530982+0000","last_became_active":"2024-08-26T00:00:29.358778+0000","last_became_peered":"2024-08-26T00:00:29.358778+0000","last_unstale":"2024-08-26T00:02:02.530982+0000","last_undegraded":"2024-08-26T00:02:02.530982+0000","last_fullsized":"2024-08-26T00:02:02.530982+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:20:40.200105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.514251+0000","last_change":"2024-08-26T00:00:29.358387+0000","last_active":"2024-08-26T00:02:02.514251+0000","last_peered":"2024-08-26T00:02:02.514251+0000","last_clean":"2024-08-26T00:02:02.514251+0000","last_became_active":"2024-08-26T00:00:29.357839+0000","last_became_peered":"2024-08-26T00:00:29.357839+0000","last_unstale":"2024-08-26T00:02:02.514251+0000","last_undegraded":"2024-08-26T00:02:02.514251+0000","last_fullsized":"2024-08-26T00:02:02.514251+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:05:21.065258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.530387+0000","last_change":"2024-08-26T00:00:29.354429+0000","last_active":"2024-08-26T00:02:02.530387+0000","last_peered":"2024-08-26T00:02:02.530387+0000","last_clean":"2024-08-26T00:02:02.530387+0000","last_became_active":"2024-08-26T00:00:29.354108+0000","last_became_peered":"2024-08-26T00:00:29.354108+0000","last_unstale":"2024-08-26T00:02:02.530387+0000","last_undegraded":"2024-08-26T00:02:02.530387+0000","last_fullsized":"2024-08-26T00:02:02.530387+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:58:07.912980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.528778+0000","last_change":"2024-08-26T00:00:29.360127+0000","last_active":"2024-08-26T00:02:02.528778+0000","last_peered":"2024-08-26T00:02:02.528778+0000","last_clean":"2024-08-26T00:02:02.528778+0000","last_became_active":"2024-08-26T00:00:29.359730+0000","last_became_peered":"2024-08-26T00:00:29.359730+0000","last_unstale":"2024-08-26T00:02:02.528778+0000","last_undegraded":"2024-08-26T00:02:02.528778+0000","last_fullsized":"2024-08-26T00:02:02.528778+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:38:16.377861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.524984+0000","last_change":"2024-08-26T00:00:29.362117+0000","last_active":"2024-08-26T00:02:02.524984+0000","last_peered":"2024-08-26T00:02:02.524984+0000","last_clean":"2024-08-26T00:02:02.524984+0000","last_became_active":"2024-08-26T00:00:29.361738+0000","last_became_peered":"2024-08-26T00:00:29.361738+0000","last_unstale":"2024-08-26T00:02:02.524984+0000","last_undegraded":"2024-08-26T00:02:02.524984+0000","last_fullsized":"2024-08-26T00:02:02.524984+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:38:15.468364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535176+0000","last_change":"2024-08-26T00:00:29.363693+0000","last_active":"2024-08-26T00:02:02.535176+0000","last_peered":"2024-08-26T00:02:02.535176+0000","last_clean":"2024-08-26T00:02:02.535176+0000","last_became_active":"2024-08-26T00:00:29.363356+0000","last_became_peered":"2024-08-26T00:00:29.363356+0000","last_unstale":"2024-08-26T00:02:02.535176+0000","last_undegraded":"2024-08-26T00:02:02.535176+0000","last_fullsized":"2024-08-26T00:02:02.535176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:18:46.180255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"80'16","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.527282+0000","last_change":"2024-08-26T00:00:29.363401+0000","last_active":"2024-08-26T00:02:02.527282+0000","last_peered":"2024-08-26T00:02:02.527282+0000","last_clean":"2024-08-26T00:02:02.527282+0000","last_became_active":"2024-08-26T00:00:29.363045+0000","last_became_peered":"2024-08-26T00:00:29.363045+0000","last_unstale":"2024-08-26T00:02:02.527282+0000","last_undegraded":"2024-08-26T00:02:02.527282+0000","last_fullsized":"2024-08-26T00:02:02.527282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:18:24.931121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.534547+0000","last_change":"2024-08-26T00:00:29.356440+0000","last_active":"2024-08-26T00:02:02.534547+0000","last_peered":"2024-08-26T00:02:02.534547+0000","last_clean":"2024-08-26T00:02:02.534547+0000","last_became_active":"2024-08-26T00:00:29.355498+0000","last_became_peered":"2024-08-26T00:00:29.355498+0000","last_unstale":"2024-08-26T00:02:02.534547+0000","last_undegraded":"2024-08-26T00:02:02.534547+0000","last_fullsized":"2024-08-26T00:02:02.534547+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:27:31.363962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.531100+0000","last_change":"2024-08-26T00:00:29.359185+0000","last_active":"2024-08-26T00:02:02.531100+0000","last_peered":"2024-08-26T00:02:02.531100+0000","last_clean":"2024-08-26T00:02:02.531100+0000","last_became_active":"2024-08-26T00:00:29.358670+0000","last_became_peered":"2024-08-26T00:00:29.358670+0000","last_unstale":"2024-08-26T00:02:02.531100+0000","last_undegraded":"2024-08-26T00:02:02.531100+0000","last_fullsized":"2024-08-26T00:02:02.531100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:15:31.327823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.522302+0000","last_change":"2024-08-26T00:00:29.361477+0000","last_active":"2024-08-26T00:02:02.522302+0000","last_peered":"2024-08-26T00:02:02.522302+0000","last_clean":"2024-08-26T00:02:02.522302+0000","last_became_active":"2024-08-26T00:00:29.360870+0000","last_became_peered":"2024-08-26T00:00:29.360870+0000","last_unstale":"2024-08-26T00:02:02.522302+0000","last_undegraded":"2024-08-26T00:02:02.522302+0000","last_fullsized":"2024-08-26T00:02:02.522302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:37:01.434606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.523866+0000","last_change":"2024-08-26T00:00:29.362301+0000","last_active":"2024-08-26T00:02:02.523866+0000","last_peered":"2024-08-26T00:02:02.523866+0000","last_clean":"2024-08-26T00:02:02.523866+0000","last_became_active":"2024-08-26T00:00:29.359613+0000","last_became_peered":"2024-08-26T00:00:29.359613+0000","last_unstale":"2024-08-26T00:02:02.523866+0000","last_undegraded":"2024-08-26T00:02:02.523866+0000","last_fullsized":"2024-08-26T00:02:02.523866+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:24:09.515352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.528299+0000","last_change":"2024-08-26T00:00:29.365553+0000","last_active":"2024-08-26T00:02:02.528299+0000","last_peered":"2024-08-26T00:02:02.528299+0000","last_clean":"2024-08-26T00:02:02.528299+0000","last_became_active":"2024-08-26T00:00:29.363344+0000","last_became_peered":"2024-08-26T00:00:29.363344+0000","last_unstale":"2024-08-26T00:02:02.528299+0000","last_undegraded":"2024-08-26T00:02:02.528299+0000","last_fullsized":"2024-08-26T00:02:02.528299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:27:43.172749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535411+0000","last_change":"2024-08-26T00:00:29.362061+0000","last_active":"2024-08-26T00:02:02.535411+0000","last_peered":"2024-08-26T00:02:02.535411+0000","last_clean":"2024-08-26T00:02:02.535411+0000","last_became_active":"2024-08-26T00:00:29.361712+0000","last_became_peered":"2024-08-26T00:00:29.361712+0000","last_unstale":"2024-08-26T00:02:02.535411+0000","last_undegraded":"2024-08-26T00:02:02.535411+0000","last_fullsized":"2024-08-26T00:02:02.535411+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:20:14.944167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535500+0000","last_change":"2024-08-26T00:00:29.365160+0000","last_active":"2024-08-26T00:02:02.535500+0000","last_peered":"2024-08-26T00:02:02.535500+0000","last_clean":"2024-08-26T00:02:02.535500+0000","last_became_active":"2024-08-26T00:00:29.364541+0000","last_became_peered":"2024-08-26T00:00:29.364541+0000","last_unstale":"2024-08-26T00:02:02.535500+0000","last_undegraded":"2024-08-26T00:02:02.535500+0000","last_fullsized":"2024-08-26T00:02:02.535500+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:59:54.417495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.522632+0000","last_change":"2024-08-26T00:00:29.361264+0000","last_active":"2024-08-26T00:02:02.522632+0000","last_peered":"2024-08-26T00:02:02.522632+0000","last_clean":"2024-08-26T00:02:02.522632+0000","last_became_active":"2024-08-26T00:00:29.358501+0000","last_became_peered":"2024-08-26T00:00:29.358501+0000","last_unstale":"2024-08-26T00:02:02.522632+0000","last_undegraded":"2024-08-26T00:02:02.522632+0000","last_fullsized":"2024-08-26T00:02:02.522632+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:04:44.930112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"80'7","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.518570+0000","last_change":"2024-08-26T00:01:33.601117+0000","last_active":"2024-08-26T00:02:02.518570+0000","last_peered":"2024-08-26T00:02:02.518570+0000","last_clean":"2024-08-26T00:02:02.518570+0000","last_became_active":"2024-08-26T00:01:33.600696+0000","last_became_peered":"2024-08-26T00:01:33.600696+0000","last_unstale":"2024-08-26T00:02:02.518570+0000","last_undegraded":"2024-08-26T00:02:02.518570+0000","last_fullsized":"2024-08-26T00:02:02.518570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:43:46.062253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.532661+0000","last_change":"2024-08-26T00:00:29.363072+0000","last_active":"2024-08-26T00:02:02.532661+0000","last_peered":"2024-08-26T00:02:02.532661+0000","last_clean":"2024-08-26T00:02:02.532661+0000","last_became_active":"2024-08-26T00:00:29.362751+0000","last_became_peered":"2024-08-26T00:00:29.362751+0000","last_unstale":"2024-08-26T00:02:02.532661+0000","last_undegraded":"2024-08-26T00:02:02.532661+0000","last_fullsized":"2024-08-26T00:02:02.532661+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:49:14.455371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.529205+0000","last_change":"2024-08-26T00:00:29.367489+0000","last_active":"2024-08-26T00:02:02.529205+0000","last_peered":"2024-08-26T00:02:02.529205+0000","last_clean":"2024-08-26T00:02:02.529205+0000","last_became_active":"2024-08-26T00:00:29.367183+0000","last_became_peered":"2024-08-26T00:00:29.367183+0000","last_unstale":"2024-08-26T00:02:02.529205+0000","last_undegraded":"2024-08-26T00:02:02.529205+0000","last_fullsized":"2024-08-26T00:02:02.529205+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:05:53.736139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535772+0000","last_change":"2024-08-26T00:00:29.356751+0000","last_active":"2024-08-26T00:02:02.535772+0000","last_peered":"2024-08-26T00:02:02.535772+0000","last_clean":"2024-08-26T00:02:02.535772+0000","last_became_active":"2024-08-26T00:00:29.356291+0000","last_became_peered":"2024-08-26T00:00:29.356291+0000","last_unstale":"2024-08-26T00:02:02.535772+0000","last_undegraded":"2024-08-26T00:02:02.535772+0000","last_fullsized":"2024-08-26T00:02:02.535772+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:32:50.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.526003+0000","last_change":"2024-08-26T00:00:29.356965+0000","last_active":"2024-08-26T00:02:02.526003+0000","last_peered":"2024-08-26T00:02:02.526003+0000","last_clean":"2024-08-26T00:02:02.526003+0000","last_became_active":"2024-08-26T00:00:29.356588+0000","last_became_peered":"2024-08-26T00:00:29.356588+0000","last_unstale":"2024-08-26T00:02:02.526003+0000","last_undegraded":"2024-08-26T00:02:02.526003+0000","last_fullsized":"2024-08-26T00:02:02.526003+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:02:25.833139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.523337+0000","last_change":"2024-08-26T00:00:29.352304+0000","last_active":"2024-08-26T00:02:02.523337+0000","last_peered":"2024-08-26T00:02:02.523337+0000","last_clean":"2024-08-26T00:02:02.523337+0000","last_became_active":"2024-08-26T00:00:29.351981+0000","last_became_peered":"2024-08-26T00:00:29.351981+0000","last_unstale":"2024-08-26T00:02:02.523337+0000","last_undegraded":"2024-08-26T00:02:02.523337+0000","last_fullsized":"2024-08-26T00:02:02.523337+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:06:29.105905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"80'2","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.525092+0000","last_change":"2024-08-26T00:00:29.354424+0000","last_active":"2024-08-26T00:02:02.525092+0000","last_peered":"2024-08-26T00:02:02.525092+0000","last_clean":"2024-08-26T00:02:02.525092+0000","last_became_active":"2024-08-26T00:00:29.352687+0000","last_became_peered":"2024-08-26T00:00:29.352687+0000","last_unstale":"2024-08-26T00:02:02.525092+0000","last_undegraded":"2024-08-26T00:02:02.525092+0000","last_fullsized":"2024-08-26T00:02:02.525092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:26:21.769928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.522471+0000","last_change":"2024-08-26T00:00:29.355680+0000","last_active":"2024-08-26T00:02:02.522471+0000","last_peered":"2024-08-26T00:02:02.522471+0000","last_clean":"2024-08-26T00:02:02.522471+0000","last_became_active":"2024-08-26T00:00:29.355335+0000","last_became_peered":"2024-08-26T00:00:29.355335+0000","last_unstale":"2024-08-26T00:02:02.522471+0000","last_undegraded":"2024-08-26T00:02:02.522471+0000","last_fullsized":"2024-08-26T00:02:02.522471+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:16:04.085892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.522793+0000","last_change":"2024-08-26T00:00:29.357564+0000","last_active":"2024-08-26T00:02:02.522793+0000","last_peered":"2024-08-26T00:02:02.522793+0000","last_clean":"2024-08-26T00:02:02.522793+0000","last_became_active":"2024-08-26T00:00:29.357215+0000","last_became_peered":"2024-08-26T00:00:29.357215+0000","last_unstale":"2024-08-26T00:02:02.522793+0000","last_undegraded":"2024-08-26T00:02:02.522793+0000","last_fullsized":"2024-08-26T00:02:02.522793+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:47:32.969629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.529042+0000","last_change":"2024-08-26T00:00:29.368272+0000","last_active":"2024-08-26T00:02:02.529042+0000","last_peered":"2024-08-26T00:02:02.529042+0000","last_clean":"2024-08-26T00:02:02.529042+0000","last_became_active":"2024-08-26T00:00:29.367920+0000","last_became_peered":"2024-08-26T00:00:29.367920+0000","last_unstale":"2024-08-26T00:02:02.529042+0000","last_undegraded":"2024-08-26T00:02:02.529042+0000","last_fullsized":"2024-08-26T00:02:02.529042+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:35:19.373782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.525599+0000","last_change":"2024-08-26T00:00:29.371609+0000","last_active":"2024-08-26T00:02:02.525599+0000","last_peered":"2024-08-26T00:02:02.525599+0000","last_clean":"2024-08-26T00:02:02.525599+0000","last_became_active":"2024-08-26T00:00:29.371199+0000","last_became_peered":"2024-08-26T00:00:29.371199+0000","last_unstale":"2024-08-26T00:02:02.525599+0000","last_undegraded":"2024-08-26T00:02:02.525599+0000","last_fullsized":"2024-08-26T00:02:02.525599+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:03:43.542718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.528791+0000","last_change":"2024-08-26T00:00:29.362222+0000","last_active":"2024-08-26T00:02:02.528791+0000","last_peered":"2024-08-26T00:02:02.528791+0000","last_clean":"2024-08-26T00:02:02.528791+0000","last_became_active":"2024-08-26T00:00:29.361767+0000","last_became_peered":"2024-08-26T00:00:29.361767+0000","last_unstale":"2024-08-26T00:02:02.528791+0000","last_undegraded":"2024-08-26T00:02:02.528791+0000","last_fullsized":"2024-08-26T00:02:02.528791+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:42:17.032034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"80'12","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.519131+0000","last_change":"2024-08-26T00:00:29.357997+0000","last_active":"2024-08-26T00:02:02.519131+0000","last_peered":"2024-08-26T00:02:02.519131+0000","last_clean":"2024-08-26T00:02:02.519131+0000","last_became_active":"2024-08-26T00:00:29.357693+0000","last_became_peered":"2024-08-26T00:00:29.357693+0000","last_unstale":"2024-08-26T00:02:02.519131+0000","last_undegraded":"2024-08-26T00:02:02.519131+0000","last_fullsized":"2024-08-26T00:02:02.519131+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:02:49.074234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.519300+0000","last_change":"2024-08-26T00:00:29.358305+0000","last_active":"2024-08-26T00:02:02.519300+0000","last_peered":"2024-08-26T00:02:02.519300+0000","last_clean":"2024-08-26T00:02:02.519300+0000","last_became_active":"2024-08-26T00:00:29.357928+0000","last_became_peered":"2024-08-26T00:00:29.357928+0000","last_unstale":"2024-08-26T00:02:02.519300+0000","last_undegraded":"2024-08-26T00:02:02.519300+0000","last_fullsized":"2024-08-26T00:02:02.519300+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:34:47.609170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.520949+0000","last_change":"2024-08-26T00:00:29.357931+0000","last_active":"2024-08-26T00:02:02.520949+0000","last_peered":"2024-08-26T00:02:02.520949+0000","last_clean":"2024-08-26T00:02:02.520949+0000","last_became_active":"2024-08-26T00:00:29.357408+0000","last_became_peered":"2024-08-26T00:00:29.357408+0000","last_unstale":"2024-08-26T00:02:02.520949+0000","last_undegraded":"2024-08-26T00:02:02.520949+0000","last_fullsized":"2024-08-26T00:02:02.520949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:21:10.230267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'5","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:26.560688+0000","last_change":"2024-08-26T00:00:26.993942+0000","last_active":"2024-08-26T00:02:26.560688+0000","last_peered":"2024-08-26T00:02:26.560688+0000","last_clean":"2024-08-26T00:02:26.560688+0000","last_became_active":"2024-08-26T00:00:26.993136+0000","last_became_peered":"2024-08-26T00:00:26.993136+0000","last_unstale":"2024-08-26T00:02:26.560688+0000","last_undegraded":"2024-08-26T00:02:26.560688+0000","last_fullsized":"2024-08-26T00:02:26.560688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:30:31.890643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.531080+0000","last_change":"2024-08-26T00:00:29.351174+0000","last_active":"2024-08-26T00:02:02.531080+0000","last_peered":"2024-08-26T00:02:02.531080+0000","last_clean":"2024-08-26T00:02:02.531080+0000","last_became_active":"2024-08-26T00:00:29.350758+0000","last_became_peered":"2024-08-26T00:00:29.350758+0000","last_unstale":"2024-08-26T00:02:02.531080+0000","last_undegraded":"2024-08-26T00:02:02.531080+0000","last_fullsized":"2024-08-26T00:02:02.531080+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:02:56.986251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.593069+0000","last_change":"2024-08-26T00:00:26.991547+0000","last_active":"2024-08-26T00:01:33.593069+0000","last_peered":"2024-08-26T00:01:33.593069+0000","last_clean":"2024-08-26T00:01:33.593069+0000","last_became_active":"2024-08-26T00:00:26.991120+0000","last_became_peered":"2024-08-26T00:00:26.991120+0000","last_unstale":"2024-08-26T00:01:33.593069+0000","last_undegraded":"2024-08-26T00:01:33.593069+0000","last_fullsized":"2024-08-26T00:01:33.593069+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:42:12.381882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.594735+0000","last_change":"2024-08-26T00:00:26.988477+0000","last_active":"2024-08-26T00:01:33.594735+0000","last_peered":"2024-08-26T00:01:33.594735+0000","last_clean":"2024-08-26T00:01:33.594735+0000","last_became_active":"2024-08-26T00:00:26.988180+0000","last_became_peered":"2024-08-26T00:00:26.988180+0000","last_unstale":"2024-08-26T00:01:33.594735+0000","last_undegraded":"2024-08-26T00:01:33.594735+0000","last_fullsized":"2024-08-26T00:01:33.594735+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:00:35.586628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.523904+0000","last_change":"2024-08-26T00:00:29.360687+0000","last_active":"2024-08-26T00:02:02.523904+0000","last_peered":"2024-08-26T00:02:02.523904+0000","last_clean":"2024-08-26T00:02:02.523904+0000","last_became_active":"2024-08-26T00:00:29.358427+0000","last_became_peered":"2024-08-26T00:00:29.358427+0000","last_unstale":"2024-08-26T00:02:02.523904+0000","last_undegraded":"2024-08-26T00:02:02.523904+0000","last_fullsized":"2024-08-26T00:02:02.523904+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:15:41.175510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599569+0000","last_change":"2024-08-26T00:00:26.995054+0000","last_active":"2024-08-26T00:01:33.599569+0000","last_peered":"2024-08-26T00:01:33.599569+0000","last_clean":"2024-08-26T00:01:33.599569+0000","last_became_active":"2024-08-26T00:00:26.994742+0000","last_became_peered":"2024-08-26T00:00:26.994742+0000","last_unstale":"2024-08-26T00:01:33.599569+0000","last_undegraded":"2024-08-26T00:01:33.599569+0000","last_fullsized":"2024-08-26T00:01:33.599569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:02:30.509497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.524712+0000","last_change":"2024-08-26T00:00:29.352343+0000","last_active":"2024-08-26T00:02:02.524712+0000","last_peered":"2024-08-26T00:02:02.524712+0000","last_clean":"2024-08-26T00:02:02.524712+0000","last_became_active":"2024-08-26T00:00:29.352036+0000","last_became_peered":"2024-08-26T00:00:29.352036+0000","last_unstale":"2024-08-26T00:02:02.524712+0000","last_undegraded":"2024-08-26T00:02:02.524712+0000","last_fullsized":"2024-08-26T00:02:02.524712+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:28:14.399870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:30.566233+0000","last_change":"2024-08-26T00:00:26.989828+0000","last_active":"2024-08-26T00:02:30.566233+0000","last_peered":"2024-08-26T00:02:30.566233+0000","last_clean":"2024-08-26T00:02:30.566233+0000","last_became_active":"2024-08-26T00:00:26.989365+0000","last_became_peered":"2024-08-26T00:00:26.989365+0000","last_unstale":"2024-08-26T00:02:30.566233+0000","last_undegraded":"2024-08-26T00:02:30.566233+0000","last_fullsized":"2024-08-26T00:02:30.566233+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:00:40.821500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":112,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535546+0000","last_change":"2024-08-26T00:00:29.359506+0000","last_active":"2024-08-26T00:02:02.535546+0000","last_peered":"2024-08-26T00:02:02.535546+0000","last_clean":"2024-08-26T00:02:02.535546+0000","last_became_active":"2024-08-26T00:00:29.359042+0000","last_became_peered":"2024-08-26T00:00:29.359042+0000","last_unstale":"2024-08-26T00:02:02.535546+0000","last_undegraded":"2024-08-26T00:02:02.535546+0000","last_fullsized":"2024-08-26T00:02:02.535546+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:38:34.661823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595861+0000","last_change":"2024-08-26T00:00:26.994272+0000","last_active":"2024-08-26T00:01:33.595861+0000","last_peered":"2024-08-26T00:01:33.595861+0000","last_clean":"2024-08-26T00:01:33.595861+0000","last_became_active":"2024-08-26T00:00:26.993769+0000","last_became_peered":"2024-08-26T00:00:26.993769+0000","last_unstale":"2024-08-26T00:01:33.595861+0000","last_undegraded":"2024-08-26T00:01:33.595861+0000","last_fullsized":"2024-08-26T00:01:33.595861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:03:39.816595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.528626+0000","last_change":"2024-08-26T00:00:29.372236+0000","last_active":"2024-08-26T00:02:02.528626+0000","last_peered":"2024-08-26T00:02:02.528626+0000","last_clean":"2024-08-26T00:02:02.528626+0000","last_became_active":"2024-08-26T00:00:29.371632+0000","last_became_peered":"2024-08-26T00:00:29.371632+0000","last_unstale":"2024-08-26T00:02:02.528626+0000","last_undegraded":"2024-08-26T00:02:02.528626+0000","last_fullsized":"2024-08-26T00:02:02.528626+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:46:10.735550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598661+0000","last_change":"2024-08-26T00:00:27.080074+0000","last_active":"2024-08-26T00:01:33.598661+0000","last_peered":"2024-08-26T00:01:33.598661+0000","last_clean":"2024-08-26T00:01:33.598661+0000","last_became_active":"2024-08-26T00:00:27.079646+0000","last_became_peered":"2024-08-26T00:00:27.079646+0000","last_unstale":"2024-08-26T00:01:33.598661+0000","last_undegraded":"2024-08-26T00:01:33.598661+0000","last_fullsized":"2024-08-26T00:01:33.598661+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:22:42.677747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"80'11","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535811+0000","last_change":"2024-08-26T00:01:33.600131+0000","last_active":"2024-08-26T00:02:02.535811+0000","last_peered":"2024-08-26T00:02:02.535811+0000","last_clean":"2024-08-26T00:02:02.535811+0000","last_became_active":"2024-08-26T00:01:33.599594+0000","last_became_peered":"2024-08-26T00:01:33.599594+0000","last_unstale":"2024-08-26T00:02:02.535811+0000","last_undegraded":"2024-08-26T00:02:02.535811+0000","last_fullsized":"2024-08-26T00:02:02.535811+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:33:33.573513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'34","reported_seq":310,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:31.986822+0000","last_change":"2024-08-26T00:01:33.901247+0000","last_active":"2024-08-26T00:02:31.986822+0000","last_peered":"2024-08-26T00:02:31.986822+0000","last_clean":"2024-08-26T00:02:31.986822+0000","last_became_active":"2024-08-26T00:01:33.892141+0000","last_became_peered":"2024-08-26T00:01:33.892141+0000","last_unstale":"2024-08-26T00:02:31.986822+0000","last_undegraded":"2024-08-26T00:02:31.986822+0000","last_fullsized":"2024-08-26T00:02:31.986822+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:08:05.209223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65489,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":232,"num_read_kb":179,"num_write":35,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":60615,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.520296+0000","last_change":"2024-08-26T00:00:29.356969+0000","last_active":"2024-08-26T00:02:02.520296+0000","last_peered":"2024-08-26T00:02:02.520296+0000","last_clean":"2024-08-26T00:02:02.520296+0000","last_became_active":"2024-08-26T00:00:29.356493+0000","last_became_peered":"2024-08-26T00:00:29.356493+0000","last_unstale":"2024-08-26T00:02:02.520296+0000","last_undegraded":"2024-08-26T00:02:02.520296+0000","last_fullsized":"2024-08-26T00:02:02.520296+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:42:29.663933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596334+0000","last_change":"2024-08-26T00:00:26.993733+0000","last_active":"2024-08-26T00:01:33.596334+0000","last_peered":"2024-08-26T00:01:33.596334+0000","last_clean":"2024-08-26T00:01:33.596334+0000","last_became_active":"2024-08-26T00:00:26.991196+0000","last_became_peered":"2024-08-26T00:00:26.991196+0000","last_unstale":"2024-08-26T00:01:33.596334+0000","last_undegraded":"2024-08-26T00:01:33.596334+0000","last_fullsized":"2024-08-26T00:01:33.596334+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:53:49.056228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.521316+0000","last_change":"2024-08-26T00:00:29.363095+0000","last_active":"2024-08-26T00:02:02.521316+0000","last_peered":"2024-08-26T00:02:02.521316+0000","last_clean":"2024-08-26T00:02:02.521316+0000","last_became_active":"2024-08-26T00:00:29.361374+0000","last_became_peered":"2024-08-26T00:00:29.361374+0000","last_unstale":"2024-08-26T00:02:02.521316+0000","last_undegraded":"2024-08-26T00:02:02.521316+0000","last_fullsized":"2024-08-26T00:02:02.521316+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:30:34.072712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598243+0000","last_change":"2024-08-26T00:00:26.993920+0000","last_active":"2024-08-26T00:01:33.598243+0000","last_peered":"2024-08-26T00:01:33.598243+0000","last_clean":"2024-08-26T00:01:33.598243+0000","last_became_active":"2024-08-26T00:00:26.993578+0000","last_became_peered":"2024-08-26T00:00:26.993578+0000","last_unstale":"2024-08-26T00:01:33.598243+0000","last_undegraded":"2024-08-26T00:01:33.598243+0000","last_fullsized":"2024-08-26T00:01:33.598243+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:29:49.751384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.522031+0000","last_change":"2024-08-26T00:00:29.362535+0000","last_active":"2024-08-26T00:02:02.522031+0000","last_peered":"2024-08-26T00:02:02.522031+0000","last_clean":"2024-08-26T00:02:02.522031+0000","last_became_active":"2024-08-26T00:00:29.362167+0000","last_became_peered":"2024-08-26T00:00:29.362167+0000","last_unstale":"2024-08-26T00:02:02.522031+0000","last_undegraded":"2024-08-26T00:02:02.522031+0000","last_fullsized":"2024-08-26T00:02:02.522031+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:21:54.020323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'6","reported_seq":144,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:29.565361+0000","last_change":"2024-08-26T00:00:26.993988+0000","last_active":"2024-08-26T00:02:29.565361+0000","last_peered":"2024-08-26T00:02:29.565361+0000","last_clean":"2024-08-26T00:02:29.565361+0000","last_became_active":"2024-08-26T00:00:26.993485+0000","last_became_peered":"2024-08-26T00:00:26.993485+0000","last_unstale":"2024-08-26T00:02:29.565361+0000","last_undegraded":"2024-08-26T00:02:29.565361+0000","last_fullsized":"2024-08-26T00:02:29.565361+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:46:29.475574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"80'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.527020+0000","last_change":"2024-08-26T00:01:33.599944+0000","last_active":"2024-08-26T00:02:02.527020+0000","last_peered":"2024-08-26T00:02:02.527020+0000","last_clean":"2024-08-26T00:02:02.527020+0000","last_became_active":"2024-08-26T00:01:33.599457+0000","last_became_peered":"2024-08-26T00:01:33.599457+0000","last_unstale":"2024-08-26T00:02:02.527020+0000","last_undegraded":"2024-08-26T00:02:02.527020+0000","last_fullsized":"2024-08-26T00:02:02.527020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:12:33.747334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598056+0000","last_change":"2024-08-26T00:00:27.077517+0000","last_active":"2024-08-26T00:01:33.598056+0000","last_peered":"2024-08-26T00:01:33.598056+0000","last_clean":"2024-08-26T00:01:33.598056+0000","last_became_active":"2024-08-26T00:00:27.077083+0000","last_became_peered":"2024-08-26T00:00:27.077083+0000","last_unstale":"2024-08-26T00:01:33.598056+0000","last_undegraded":"2024-08-26T00:01:33.598056+0000","last_fullsized":"2024-08-26T00:01:33.598056+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:27:43.522233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.530797+0000","last_change":"2024-08-26T00:00:29.355532+0000","last_active":"2024-08-26T00:02:02.530797+0000","last_peered":"2024-08-26T00:02:02.530797+0000","last_clean":"2024-08-26T00:02:02.530797+0000","last_became_active":"2024-08-26T00:00:29.355211+0000","last_became_peered":"2024-08-26T00:00:29.355211+0000","last_unstale":"2024-08-26T00:02:02.530797+0000","last_undegraded":"2024-08-26T00:02:02.530797+0000","last_fullsized":"2024-08-26T00:02:02.530797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:08:51.419634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598646+0000","last_change":"2024-08-26T00:00:26.992613+0000","last_active":"2024-08-26T00:01:33.598646+0000","last_peered":"2024-08-26T00:01:33.598646+0000","last_clean":"2024-08-26T00:01:33.598646+0000","last_became_active":"2024-08-26T00:00:26.992137+0000","last_became_peered":"2024-08-26T00:00:26.992137+0000","last_unstale":"2024-08-26T00:01:33.598646+0000","last_undegraded":"2024-08-26T00:01:33.598646+0000","last_fullsized":"2024-08-26T00:01:33.598646+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:30:32.586859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.532951+0000","last_change":"2024-08-26T00:00:29.362342+0000","last_active":"2024-08-26T00:02:02.532951+0000","last_peered":"2024-08-26T00:02:02.532951+0000","last_clean":"2024-08-26T00:02:02.532951+0000","last_became_active":"2024-08-26T00:00:29.362017+0000","last_became_peered":"2024-08-26T00:00:29.362017+0000","last_unstale":"2024-08-26T00:02:02.532951+0000","last_undegraded":"2024-08-26T00:02:02.532951+0000","last_fullsized":"2024-08-26T00:02:02.532951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:01:55.507893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595105+0000","last_change":"2024-08-26T00:00:26.989977+0000","last_active":"2024-08-26T00:01:33.595105+0000","last_peered":"2024-08-26T00:01:33.595105+0000","last_clean":"2024-08-26T00:01:33.595105+0000","last_became_active":"2024-08-26T00:00:26.989535+0000","last_became_peered":"2024-08-26T00:00:26.989535+0000","last_unstale":"2024-08-26T00:01:33.595105+0000","last_undegraded":"2024-08-26T00:01:33.595105+0000","last_fullsized":"2024-08-26T00:01:33.595105+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:33:20.347005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.518416+0000","last_change":"2024-08-26T00:00:29.355928+0000","last_active":"2024-08-26T00:02:02.518416+0000","last_peered":"2024-08-26T00:02:02.518416+0000","last_clean":"2024-08-26T00:02:02.518416+0000","last_became_active":"2024-08-26T00:00:29.355546+0000","last_became_peered":"2024-08-26T00:00:29.355546+0000","last_unstale":"2024-08-26T00:02:02.518416+0000","last_undegraded":"2024-08-26T00:02:02.518416+0000","last_fullsized":"2024-08-26T00:02:02.518416+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:15:06.116141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598775+0000","last_change":"2024-08-26T00:00:26.992523+0000","last_active":"2024-08-26T00:01:33.598775+0000","last_peered":"2024-08-26T00:01:33.598775+0000","last_clean":"2024-08-26T00:01:33.598775+0000","last_became_active":"2024-08-26T00:00:26.992193+0000","last_became_peered":"2024-08-26T00:00:26.992193+0000","last_unstale":"2024-08-26T00:01:33.598775+0000","last_undegraded":"2024-08-26T00:01:33.598775+0000","last_fullsized":"2024-08-26T00:01:33.598775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:34:21.879373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.522820+0000","last_change":"2024-08-26T00:00:29.358826+0000","last_active":"2024-08-26T00:02:02.522820+0000","last_peered":"2024-08-26T00:02:02.522820+0000","last_clean":"2024-08-26T00:02:02.522820+0000","last_became_active":"2024-08-26T00:00:29.358478+0000","last_became_peered":"2024-08-26T00:00:29.358478+0000","last_unstale":"2024-08-26T00:02:02.522820+0000","last_undegraded":"2024-08-26T00:02:02.522820+0000","last_fullsized":"2024-08-26T00:02:02.522820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:30:39.484666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596872+0000","last_change":"2024-08-26T00:00:27.077599+0000","last_active":"2024-08-26T00:01:33.596872+0000","last_peered":"2024-08-26T00:01:33.596872+0000","last_clean":"2024-08-26T00:01:33.596872+0000","last_became_active":"2024-08-26T00:00:27.077094+0000","last_became_peered":"2024-08-26T00:00:27.077094+0000","last_unstale":"2024-08-26T00:01:33.596872+0000","last_undegraded":"2024-08-26T00:01:33.596872+0000","last_fullsized":"2024-08-26T00:01:33.596872+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:06:47.966097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535039+0000","last_change":"2024-08-26T00:00:29.355243+0000","last_active":"2024-08-26T00:02:02.535039+0000","last_peered":"2024-08-26T00:02:02.535039+0000","last_clean":"2024-08-26T00:02:02.535039+0000","last_became_active":"2024-08-26T00:00:29.354151+0000","last_became_peered":"2024-08-26T00:00:29.354151+0000","last_unstale":"2024-08-26T00:02:02.535039+0000","last_undegraded":"2024-08-26T00:02:02.535039+0000","last_fullsized":"2024-08-26T00:02:02.535039+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:00:12.520736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":335,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596237+0000","last_change":"2024-08-25T23:59:16.227980+0000","last_active":"2024-08-26T00:01:33.596237+0000","last_peered":"2024-08-26T00:01:33.596237+0000","last_clean":"2024-08-26T00:01:33.596237+0000","last_became_active":"2024-08-25T23:59:16.227550+0000","last_became_peered":"2024-08-25T23:59:16.227550+0000","last_unstale":"2024-08-26T00:01:33.596237+0000","last_undegraded":"2024-08-26T00:01:33.596237+0000","last_fullsized":"2024-08-26T00:01:33.596237+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-25T23:55:51.247914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-25T23:55:51.247914+0000","last_clean_scrub_stamp":"2024-08-25T23:55:51.247914+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:39:34.184312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.890555+0000","last_change":"2024-08-26T00:00:26.992675+0000","last_active":"2024-08-26T00:01:33.890555+0000","last_peered":"2024-08-26T00:01:33.890555+0000","last_clean":"2024-08-26T00:01:33.890555+0000","last_became_active":"2024-08-26T00:00:26.992322+0000","last_became_peered":"2024-08-26T00:00:26.992322+0000","last_unstale":"2024-08-26T00:01:33.890555+0000","last_undegraded":"2024-08-26T00:01:33.890555+0000","last_fullsized":"2024-08-26T00:01:33.890555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:38:26.016220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.534623+0000","last_change":"2024-08-26T00:00:29.362617+0000","last_active":"2024-08-26T00:02:02.534623+0000","last_peered":"2024-08-26T00:02:02.534623+0000","last_clean":"2024-08-26T00:02:02.534623+0000","last_became_active":"2024-08-26T00:00:29.362245+0000","last_became_peered":"2024-08-26T00:00:29.362245+0000","last_unstale":"2024-08-26T00:02:02.534623+0000","last_undegraded":"2024-08-26T00:02:02.534623+0000","last_fullsized":"2024-08-26T00:02:02.534623+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:30:12.309213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.895870+0000","last_change":"2024-08-26T00:01:33.895296+0000","last_active":"2024-08-26T00:01:33.895870+0000","last_peered":"2024-08-26T00:01:33.895870+0000","last_clean":"2024-08-26T00:01:33.895870+0000","last_became_active":"2024-08-26T00:01:33.891598+0000","last_became_peered":"2024-08-26T00:01:33.891598+0000","last_unstale":"2024-08-26T00:01:33.895870+0000","last_undegraded":"2024-08-26T00:01:33.895870+0000","last_fullsized":"2024-08-26T00:01:33.895870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:26:31.794735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"80'5","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.519184+0000","last_change":"2024-08-26T00:01:33.601137+0000","last_active":"2024-08-26T00:02:02.519184+0000","last_peered":"2024-08-26T00:02:02.519184+0000","last_clean":"2024-08-26T00:02:02.519184+0000","last_became_active":"2024-08-26T00:01:33.600397+0000","last_became_peered":"2024-08-26T00:01:33.600397+0000","last_unstale":"2024-08-26T00:02:02.519184+0000","last_undegraded":"2024-08-26T00:02:02.519184+0000","last_fullsized":"2024-08-26T00:02:02.519184+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:42:21.507880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'6","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:31.567634+0000","last_change":"2024-08-26T00:00:27.077840+0000","last_active":"2024-08-26T00:02:31.567634+0000","last_peered":"2024-08-26T00:02:31.567634+0000","last_clean":"2024-08-26T00:02:31.567634+0000","last_became_active":"2024-08-26T00:00:27.077355+0000","last_became_peered":"2024-08-26T00:00:27.077355+0000","last_unstale":"2024-08-26T00:02:31.567634+0000","last_undegraded":"2024-08-26T00:02:31.567634+0000","last_fullsized":"2024-08-26T00:02:31.567634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:03:30.718962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":112,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"80'8","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.521970+0000","last_change":"2024-08-26T00:01:33.603558+0000","last_active":"2024-08-26T00:02:02.521970+0000","last_peered":"2024-08-26T00:02:02.521970+0000","last_clean":"2024-08-26T00:02:02.521970+0000","last_became_active":"2024-08-26T00:01:33.603177+0000","last_became_peered":"2024-08-26T00:01:33.603177+0000","last_unstale":"2024-08-26T00:02:02.521970+0000","last_undegraded":"2024-08-26T00:02:02.521970+0000","last_fullsized":"2024-08-26T00:02:02.521970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:21:33.913812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596032+0000","last_change":"2024-08-26T00:00:26.994187+0000","last_active":"2024-08-26T00:01:33.596032+0000","last_peered":"2024-08-26T00:01:33.596032+0000","last_clean":"2024-08-26T00:01:33.596032+0000","last_became_active":"2024-08-26T00:00:26.993699+0000","last_became_peered":"2024-08-26T00:00:26.993699+0000","last_unstale":"2024-08-26T00:01:33.596032+0000","last_undegraded":"2024-08-26T00:01:33.596032+0000","last_fullsized":"2024-08-26T00:01:33.596032+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:19:50.412724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.532714+0000","last_change":"2024-08-26T00:00:29.364507+0000","last_active":"2024-08-26T00:02:02.532714+0000","last_peered":"2024-08-26T00:02:02.532714+0000","last_clean":"2024-08-26T00:02:02.532714+0000","last_became_active":"2024-08-26T00:00:29.364129+0000","last_became_peered":"2024-08-26T00:00:29.364129+0000","last_unstale":"2024-08-26T00:02:02.532714+0000","last_undegraded":"2024-08-26T00:02:02.532714+0000","last_fullsized":"2024-08-26T00:02:02.532714+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:17:36.837206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.600201+0000","last_change":"2024-08-26T00:00:27.076977+0000","last_active":"2024-08-26T00:01:33.600201+0000","last_peered":"2024-08-26T00:01:33.600201+0000","last_clean":"2024-08-26T00:01:33.600201+0000","last_became_active":"2024-08-26T00:00:27.076524+0000","last_became_peered":"2024-08-26T00:00:27.076524+0000","last_unstale":"2024-08-26T00:01:33.600201+0000","last_undegraded":"2024-08-26T00:01:33.600201+0000","last_fullsized":"2024-08-26T00:01:33.600201+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:22:21.820009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.523841+0000","last_change":"2024-08-26T00:00:29.363880+0000","last_active":"2024-08-26T00:02:02.523841+0000","last_peered":"2024-08-26T00:02:02.523841+0000","last_clean":"2024-08-26T00:02:02.523841+0000","last_became_active":"2024-08-26T00:00:29.363475+0000","last_became_peered":"2024-08-26T00:00:29.363475+0000","last_unstale":"2024-08-26T00:02:02.523841+0000","last_undegraded":"2024-08-26T00:02:02.523841+0000","last_fullsized":"2024-08-26T00:02:02.523841+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:30:55.875922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.606790+0000","last_change":"2024-08-26T00:01:33.606353+0000","last_active":"2024-08-26T00:01:33.606790+0000","last_peered":"2024-08-26T00:01:33.606790+0000","last_clean":"2024-08-26T00:01:33.606790+0000","last_became_active":"2024-08-26T00:01:33.599903+0000","last_became_peered":"2024-08-26T00:01:33.599903+0000","last_unstale":"2024-08-26T00:01:33.606790+0000","last_undegraded":"2024-08-26T00:01:33.606790+0000","last_fullsized":"2024-08-26T00:01:33.606790+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:02:09.033915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.519061+0000","last_change":"2024-08-26T00:00:29.360285+0000","last_active":"2024-08-26T00:02:02.519061+0000","last_peered":"2024-08-26T00:02:02.519061+0000","last_clean":"2024-08-26T00:02:02.519061+0000","last_became_active":"2024-08-26T00:00:29.359879+0000","last_became_peered":"2024-08-26T00:00:29.359879+0000","last_unstale":"2024-08-26T00:02:02.519061+0000","last_undegraded":"2024-08-26T00:02:02.519061+0000","last_fullsized":"2024-08-26T00:02:02.519061+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:49:10.691817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'14","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:03.359394+0000","last_change":"2024-08-26T00:00:26.990419+0000","last_active":"2024-08-26T00:02:03.359394+0000","last_peered":"2024-08-26T00:02:03.359394+0000","last_clean":"2024-08-26T00:02:03.359394+0000","last_became_active":"2024-08-26T00:00:26.990052+0000","last_became_peered":"2024-08-26T00:00:26.990052+0000","last_unstale":"2024-08-26T00:02:03.359394+0000","last_undegraded":"2024-08-26T00:02:03.359394+0000","last_fullsized":"2024-08-26T00:02:03.359394+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:27:41.229418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.524365+0000","last_change":"2024-08-26T00:00:29.354671+0000","last_active":"2024-08-26T00:02:02.524365+0000","last_peered":"2024-08-26T00:02:02.524365+0000","last_clean":"2024-08-26T00:02:02.524365+0000","last_became_active":"2024-08-26T00:00:29.354071+0000","last_became_peered":"2024-08-26T00:00:29.354071+0000","last_unstale":"2024-08-26T00:02:02.524365+0000","last_undegraded":"2024-08-26T00:02:02.524365+0000","last_fullsized":"2024-08-26T00:02:02.524365+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:50:09.097757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.890786+0000","last_change":"2024-08-26T00:00:26.991622+0000","last_active":"2024-08-26T00:01:33.890786+0000","last_peered":"2024-08-26T00:01:33.890786+0000","last_clean":"2024-08-26T00:01:33.890786+0000","last_became_active":"2024-08-26T00:00:26.991244+0000","last_became_peered":"2024-08-26T00:00:26.991244+0000","last_unstale":"2024-08-26T00:01:33.890786+0000","last_undegraded":"2024-08-26T00:01:33.890786+0000","last_fullsized":"2024-08-26T00:01:33.890786+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:58:25.676985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.526109+0000","last_change":"2024-08-26T00:00:29.367033+0000","last_active":"2024-08-26T00:02:02.526109+0000","last_peered":"2024-08-26T00:02:02.526109+0000","last_clean":"2024-08-26T00:02:02.526109+0000","last_became_active":"2024-08-26T00:00:29.365572+0000","last_became_peered":"2024-08-26T00:00:29.365572+0000","last_unstale":"2024-08-26T00:02:02.526109+0000","last_undegraded":"2024-08-26T00:02:02.526109+0000","last_fullsized":"2024-08-26T00:02:02.526109+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:16:49.116721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596764+0000","last_change":"2024-08-26T00:00:27.076562+0000","last_active":"2024-08-26T00:01:33.596764+0000","last_peered":"2024-08-26T00:01:33.596764+0000","last_clean":"2024-08-26T00:01:33.596764+0000","last_became_active":"2024-08-26T00:00:27.076163+0000","last_became_peered":"2024-08-26T00:00:27.076163+0000","last_unstale":"2024-08-26T00:01:33.596764+0000","last_undegraded":"2024-08-26T00:01:33.596764+0000","last_fullsized":"2024-08-26T00:01:33.596764+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:25:03.222457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"80'2","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.491274+0000","last_change":"2024-08-26T00:00:29.352787+0000","last_active":"2024-08-26T00:02:02.491274+0000","last_peered":"2024-08-26T00:02:02.491274+0000","last_clean":"2024-08-26T00:02:02.491274+0000","last_became_active":"2024-08-26T00:00:29.352429+0000","last_became_peered":"2024-08-26T00:00:29.352429+0000","last_unstale":"2024-08-26T00:02:02.491274+0000","last_undegraded":"2024-08-26T00:02:02.491274+0000","last_fullsized":"2024-08-26T00:02:02.491274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:39:45.080372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.592534+0000","last_change":"2024-08-26T00:00:26.989778+0000","last_active":"2024-08-26T00:01:33.592534+0000","last_peered":"2024-08-26T00:01:33.592534+0000","last_clean":"2024-08-26T00:01:33.592534+0000","last_became_active":"2024-08-26T00:00:26.989433+0000","last_became_peered":"2024-08-26T00:00:26.989433+0000","last_unstale":"2024-08-26T00:01:33.592534+0000","last_undegraded":"2024-08-26T00:01:33.592534+0000","last_fullsized":"2024-08-26T00:01:33.592534+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:36:16.684252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.525073+0000","last_change":"2024-08-26T00:00:29.362705+0000","last_active":"2024-08-26T00:02:02.525073+0000","last_peered":"2024-08-26T00:02:02.525073+0000","last_clean":"2024-08-26T00:02:02.525073+0000","last_became_active":"2024-08-26T00:00:29.362341+0000","last_became_peered":"2024-08-26T00:00:29.362341+0000","last_unstale":"2024-08-26T00:02:02.525073+0000","last_undegraded":"2024-08-26T00:02:02.525073+0000","last_fullsized":"2024-08-26T00:02:02.525073+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:10:47.051351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.609432+0000","last_change":"2024-08-26T00:01:33.608894+0000","last_active":"2024-08-26T00:01:33.609432+0000","last_peered":"2024-08-26T00:01:33.609432+0000","last_clean":"2024-08-26T00:01:33.609432+0000","last_became_active":"2024-08-26T00:01:33.601976+0000","last_became_peered":"2024-08-26T00:01:33.601976+0000","last_unstale":"2024-08-26T00:01:33.609432+0000","last_undegraded":"2024-08-26T00:01:33.609432+0000","last_fullsized":"2024-08-26T00:01:33.609432+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:03:17.367456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.528063+0000","last_change":"2024-08-26T00:00:29.365553+0000","last_active":"2024-08-26T00:02:02.528063+0000","last_peered":"2024-08-26T00:02:02.528063+0000","last_clean":"2024-08-26T00:02:02.528063+0000","last_became_active":"2024-08-26T00:00:29.365215+0000","last_became_peered":"2024-08-26T00:00:29.365215+0000","last_unstale":"2024-08-26T00:02:02.528063+0000","last_undegraded":"2024-08-26T00:02:02.528063+0000","last_fullsized":"2024-08-26T00:02:02.528063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:55:01.505530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598744+0000","last_change":"2024-08-26T00:00:26.995228+0000","last_active":"2024-08-26T00:01:33.598744+0000","last_peered":"2024-08-26T00:01:33.598744+0000","last_clean":"2024-08-26T00:01:33.598744+0000","last_became_active":"2024-08-26T00:00:26.994875+0000","last_became_peered":"2024-08-26T00:00:26.994875+0000","last_unstale":"2024-08-26T00:01:33.598744+0000","last_undegraded":"2024-08-26T00:01:33.598744+0000","last_fullsized":"2024-08-26T00:01:33.598744+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:27:21.110162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.528622+0000","last_change":"2024-08-26T00:00:29.361598+0000","last_active":"2024-08-26T00:02:02.528622+0000","last_peered":"2024-08-26T00:02:02.528622+0000","last_clean":"2024-08-26T00:02:02.528622+0000","last_became_active":"2024-08-26T00:00:29.361237+0000","last_became_peered":"2024-08-26T00:00:29.361237+0000","last_unstale":"2024-08-26T00:02:02.528622+0000","last_undegraded":"2024-08-26T00:02:02.528622+0000","last_fullsized":"2024-08-26T00:02:02.528622+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:21:30.126060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.531764+0000","last_change":"2024-08-26T00:00:29.355240+0000","last_active":"2024-08-26T00:02:02.531764+0000","last_peered":"2024-08-26T00:02:02.531764+0000","last_clean":"2024-08-26T00:02:02.531764+0000","last_became_active":"2024-08-26T00:00:29.354165+0000","last_became_peered":"2024-08-26T00:00:29.354165+0000","last_unstale":"2024-08-26T00:02:02.531764+0000","last_undegraded":"2024-08-26T00:02:02.531764+0000","last_fullsized":"2024-08-26T00:02:02.531764+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:07:56.573032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598465+0000","last_change":"2024-08-26T00:00:26.992240+0000","last_active":"2024-08-26T00:01:33.598465+0000","last_peered":"2024-08-26T00:01:33.598465+0000","last_clean":"2024-08-26T00:01:33.598465+0000","last_became_active":"2024-08-26T00:00:26.991866+0000","last_became_peered":"2024-08-26T00:00:26.991866+0000","last_unstale":"2024-08-26T00:01:33.598465+0000","last_undegraded":"2024-08-26T00:01:33.598465+0000","last_fullsized":"2024-08-26T00:01:33.598465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:25:50.815151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535915+0000","last_change":"2024-08-26T00:00:29.370358+0000","last_active":"2024-08-26T00:02:02.535915+0000","last_peered":"2024-08-26T00:02:02.535915+0000","last_clean":"2024-08-26T00:02:02.535915+0000","last_became_active":"2024-08-26T00:00:29.369910+0000","last_became_peered":"2024-08-26T00:00:29.369910+0000","last_unstale":"2024-08-26T00:02:02.535915+0000","last_undegraded":"2024-08-26T00:02:02.535915+0000","last_fullsized":"2024-08-26T00:02:02.535915+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:49:11.351575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599966+0000","last_change":"2024-08-26T00:00:26.989759+0000","last_active":"2024-08-26T00:01:33.599966+0000","last_peered":"2024-08-26T00:01:33.599966+0000","last_clean":"2024-08-26T00:01:33.599966+0000","last_became_active":"2024-08-26T00:00:26.989376+0000","last_became_peered":"2024-08-26T00:00:26.989376+0000","last_unstale":"2024-08-26T00:01:33.599966+0000","last_undegraded":"2024-08-26T00:01:33.599966+0000","last_fullsized":"2024-08-26T00:01:33.599966+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:44:36.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535350+0000","last_change":"2024-08-26T00:00:29.367050+0000","last_active":"2024-08-26T00:02:02.535350+0000","last_peered":"2024-08-26T00:02:02.535350+0000","last_clean":"2024-08-26T00:02:02.535350+0000","last_became_active":"2024-08-26T00:00:29.366737+0000","last_became_peered":"2024-08-26T00:00:29.366737+0000","last_unstale":"2024-08-26T00:02:02.535350+0000","last_undegraded":"2024-08-26T00:02:02.535350+0000","last_fullsized":"2024-08-26T00:02:02.535350+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:00:54.461716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.593279+0000","last_change":"2024-08-26T00:00:27.078078+0000","last_active":"2024-08-26T00:01:33.593279+0000","last_peered":"2024-08-26T00:01:33.593279+0000","last_clean":"2024-08-26T00:01:33.593279+0000","last_became_active":"2024-08-26T00:00:27.077036+0000","last_became_peered":"2024-08-26T00:00:27.077036+0000","last_unstale":"2024-08-26T00:01:33.593279+0000","last_undegraded":"2024-08-26T00:01:33.593279+0000","last_fullsized":"2024-08-26T00:01:33.593279+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:47:44.674548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"80'5","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.525643+0000","last_change":"2024-08-26T00:00:29.363867+0000","last_active":"2024-08-26T00:02:02.525643+0000","last_peered":"2024-08-26T00:02:02.525643+0000","last_clean":"2024-08-26T00:02:02.525643+0000","last_became_active":"2024-08-26T00:00:29.363556+0000","last_became_peered":"2024-08-26T00:00:29.363556+0000","last_unstale":"2024-08-26T00:02:02.525643+0000","last_undegraded":"2024-08-26T00:02:02.525643+0000","last_fullsized":"2024-08-26T00:02:02.525643+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:50:04.009177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.600056+0000","last_change":"2024-08-26T00:00:26.990557+0000","last_active":"2024-08-26T00:01:33.600056+0000","last_peered":"2024-08-26T00:01:33.600056+0000","last_clean":"2024-08-26T00:01:33.600056+0000","last_became_active":"2024-08-26T00:00:26.989945+0000","last_became_peered":"2024-08-26T00:00:26.989945+0000","last_unstale":"2024-08-26T00:01:33.600056+0000","last_undegraded":"2024-08-26T00:01:33.600056+0000","last_fullsized":"2024-08-26T00:01:33.600056+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:26:54.388359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69940,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":695,"num_read_kb":423,"num_write":180,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":60637,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":209820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645350,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":426443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874282,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41048,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704104,"statfs":{"total":95995035648,"available":95953002496,"internally_reserved":0,"allocated":1581056,"data_stored":1084232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037808,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":426657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266742,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":426555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495674,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40960,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704192,"statfs":{"total":95995035648,"available":95953092608,"internally_reserved":0,"allocated":1490944,"data_stored":1018957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626495,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":884736,"data_stored":426046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855428,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28492,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716660,"statfs":{"total":95995035648,"available":95965859840,"internally_reserved":0,"allocated":1503232,"data_stored":1017800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018952,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":492813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247886,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":426357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444116,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":427189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40432,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704720,"statfs":{"total":95995035648,"available":95953633280,"internally_reserved":0,"allocated":950272,"data_stored":491328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":427317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-26T00:02:32.655 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-08-26T00:02:32.655 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-26T00:02:32.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.812+0000 7f7f13600640 1 -- 172.21.15.42:0/1050817655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f0c105680 msgr2=0x7f7f0c10bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:32.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.812+0000 7f7f13600640 1 --2- 172.21.15.42:0/1050817655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f0c105680 0x7f7f0c10bf10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009ca0 tx=0x7f7f0402a8c0 comp rx=0 tx=0).stop 2024-08-26T00:02:32.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.812+0000 7f7f13600640 1 -- 172.21.15.42:0/1050817655 shutdown_connections 2024-08-26T00:02:32.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.812+0000 7f7f13600640 1 --2- 172.21.15.42:0/1050817655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f0c105680 0x7f7f0c10bf10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:32.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.812+0000 7f7f13600640 1 --2- 172.21.15.42:0/1050817655 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f0c104cc0 0x7f7f0c105140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:32.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.812+0000 7f7f13600640 1 --2- 172.21.15.42:0/1050817655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f0c103ad0 0x7f7f0c103ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:32.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.812+0000 7f7f13600640 1 -- 172.21.15.42:0/1050817655 >> 172.21.15.42:0/1050817655 conn(0x7f7f0c0ff250 msgr2=0x7f7f0c101670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:32.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.813+0000 7f7f13600640 1 -- 172.21.15.42:0/1050817655 shutdown_connections 2024-08-26T00:02:32.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.813+0000 7f7f13600640 1 -- 172.21.15.42:0/1050817655 wait complete. 2024-08-26T00:02:32.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.813+0000 7f7f13600640 1 Processor -- start 2024-08-26T00:02:32.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.813+0000 7f7f13600640 1 -- start start 2024-08-26T00:02:32.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.814+0000 7f7f13600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f0c103ad0 0x7f7f0c199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:32.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.814+0000 7f7f13600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f0c104cc0 0x7f7f0c19a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:32.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.814+0000 7f7f13600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f0c105680 0x7f7f0c1a1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:32.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.814+0000 7f7f13600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c10f7a0 con 0x7f7f0c105680 2024-08-26T00:02:32.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.814+0000 7f7f13600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c10f620 con 0x7f7f0c103ad0 2024-08-26T00:02:32.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.814+0000 7f7f13600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c10f920 con 0x7f7f0c104cc0 2024-08-26T00:02:32.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.814+0000 7f7f10c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f0c103ad0 0x7f7f0c199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:32.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.814+0000 7f7f11600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f0c105680 0x7f7f0c1a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:32.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.814+0000 7f7f0be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f0c104cc0 0x7f7f0c19a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:32.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.814+0000 7f7f10c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f0c103ad0 0x7f7f0c199db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:34060/0 (socket says 172.21.15.42:34060) 2024-08-26T00:02:32.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.814+0000 7f7f10c00640 1 -- 172.21.15.42:0/3189586632 learned_addr learned my addr 172.21.15.42:0/3189586632 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:32.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.814+0000 7f7f10c00640 1 -- 172.21.15.42:0/3189586632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f0c104cc0 msgr2=0x7f7f0c19a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:32.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.814+0000 7f7f10c00640 1 --2- 172.21.15.42:0/3189586632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f0c104cc0 0x7f7f0c19a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:32.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.814+0000 7f7f10c00640 1 -- 172.21.15.42:0/3189586632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f0c105680 msgr2=0x7f7f0c1a1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:32.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.814+0000 7f7f10c00640 1 --2- 172.21.15.42:0/3189586632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f0c105680 0x7f7f0c1a1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:32.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.814+0000 7f7f10c00640 1 -- 172.21.15.42:0/3189586632 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0c1a19c0 con 0x7f7f0c103ad0 2024-08-26T00:02:32.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.815+0000 7f7f10c00640 1 --2- 172.21.15.42:0/3189586632 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f0c103ad0 0x7f7f0c199db0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000e9c0 tx=0x7f7f0000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:32.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.815+0000 7f7f09600640 1 -- 172.21.15.42:0/3189586632 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0000cd80 con 0x7f7f0c103ad0 2024-08-26T00:02:32.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.815+0000 7f7f13600640 1 -- 172.21.15.42:0/3189586632 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f0c1a1cb0 con 0x7f7f0c103ad0 2024-08-26T00:02:32.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.815+0000 7f7f09600640 1 -- 172.21.15.42:0/3189586632 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f000035f0 con 0x7f7f0c103ad0 2024-08-26T00:02:32.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.815+0000 7f7f09600640 1 -- 172.21.15.42:0/3189586632 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f00010690 con 0x7f7f0c103ad0 2024-08-26T00:02:32.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.815+0000 7f7f13600640 1 -- 172.21.15.42:0/3189586632 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f0c1a21a0 con 0x7f7f0c103ad0 2024-08-26T00:02:32.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.816+0000 7f7f13600640 1 -- 172.21.15.42:0/3189586632 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f0c10adf0 con 0x7f7f0c103ad0 2024-08-26T00:02:32.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.818+0000 7f7f09600640 1 -- 172.21.15.42:0/3189586632 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7f000037a0 con 0x7f7f0c103ad0 2024-08-26T00:02:32.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.820+0000 7f7f09600640 1 --2- 172.21.15.42:0/3189586632 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7ef40a2b90 0x7f7ef40a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:32.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.820+0000 7f7f09600640 1 -- 172.21.15.42:0/3189586632 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f7f000cf530 con 0x7f7f0c103ad0 2024-08-26T00:02:32.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.820+0000 7f7f0be00640 1 --2- 172.21.15.42:0/3189586632 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7ef40a2b90 0x7f7ef40a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:32.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.820+0000 7f7f0be00640 1 --2- 172.21.15.42:0/3189586632 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7ef40a2b90 0x7f7ef40a5050 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009bd0 tx=0x7f7ef8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:32.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:32.822+0000 7f7f09600640 1 -- 172.21.15.42:0/3189586632 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f7f0009c450 con 0x7f7f0c103ad0 2024-08-26T00:02:33.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:33.005+0000 7f7f13600640 1 -- 172.21.15.42:0/3189586632 --> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7f0c0623d0 con 0x7f7ef40a2b90 2024-08-26T00:02:33.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:33.011+0000 7f7f09600640 1 -- 172.21.15.42:0/3189586632 <== mgr.14150 v2:172.21.15.42:6800/22448279 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258837 (secure 0 0 0) 0x7f7f0c0623d0 con 0x7f7ef40a2b90 2024-08-26T00:02:33.017 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:02:33.019 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-08-26T00:02:33.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:33.015+0000 7f7f13600640 1 -- 172.21.15.42:0/3189586632 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7ef40a2b90 msgr2=0x7f7ef40a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:33.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:33.015+0000 7f7f13600640 1 --2- 172.21.15.42:0/3189586632 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7ef40a2b90 0x7f7ef40a5050 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009bd0 tx=0x7f7ef8005f90 comp rx=0 tx=0).stop 2024-08-26T00:02:33.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:33.015+0000 7f7f13600640 1 -- 172.21.15.42:0/3189586632 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f0c103ad0 msgr2=0x7f7f0c199db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:33.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:33.015+0000 7f7f13600640 1 --2- 172.21.15.42:0/3189586632 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f0c103ad0 0x7f7f0c199db0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000e9c0 tx=0x7f7f0000ee80 comp rx=0 tx=0).stop 2024-08-26T00:02:33.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:33.015+0000 7f7f13600640 1 -- 172.21.15.42:0/3189586632 shutdown_connections 2024-08-26T00:02:33.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:33.015+0000 7f7f13600640 1 --2- 172.21.15.42:0/3189586632 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7ef40a2b90 0x7f7ef40a5050 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:33.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:33.015+0000 7f7f13600640 1 --2- 172.21.15.42:0/3189586632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f0c105680 0x7f7f0c1a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:33.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:33.015+0000 7f7f13600640 1 --2- 172.21.15.42:0/3189586632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f0c104cc0 0x7f7f0c19a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:33.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:33.015+0000 7f7f13600640 1 --2- 172.21.15.42:0/3189586632 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f0c103ad0 0x7f7f0c199db0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:33.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:33.015+0000 7f7f13600640 1 -- 172.21.15.42:0/3189586632 >> 172.21.15.42:0/3189586632 conn(0x7f7f0c0ff250 msgr2=0x7f7f0c107fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:33.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:33.015+0000 7f7f13600640 1 -- 172.21.15.42:0/3189586632 shutdown_connections 2024-08-26T00:02:33.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:33.015+0000 7f7f13600640 1 -- 172.21.15.42:0/3189586632 wait complete. 2024-08-26T00:02:33.033 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2024-08-26T00:02:32.522159+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660542,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":821,"num_read_kb":532,"num_write":363,"num_write_kb":3065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1241373,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":791,"ondisk_log_size":791,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":399144,"kb_used_data":12456,"kb_used_omap":18,"kb_used_meta":386477,"kb_avail":1124542680,"statfs":{"total":1151940427776,"available":1151531704320,"internally_reserved":0,"allocated":12754944,"data_stored":7091694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19137,"internal_metadata":395752767},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4936,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":52,"num_write":9,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002892"},"pg_stats":[{"pgid":"3.3f","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535385+0000","last_change":"2024-08-26T00:00:29.365654+0000","last_active":"2024-08-26T00:02:02.535385+0000","last_peered":"2024-08-26T00:02:02.535385+0000","last_clean":"2024-08-26T00:02:02.535385+0000","last_became_active":"2024-08-26T00:00:29.364609+0000","last_became_peered":"2024-08-26T00:00:29.364609+0000","last_unstale":"2024-08-26T00:02:02.535385+0000","last_undegraded":"2024-08-26T00:02:02.535385+0000","last_fullsized":"2024-08-26T00:02:02.535385+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:54:39.886248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.520050+0000","last_change":"2024-08-26T00:00:29.367657+0000","last_active":"2024-08-26T00:02:02.520050+0000","last_peered":"2024-08-26T00:02:02.520050+0000","last_clean":"2024-08-26T00:02:02.520050+0000","last_became_active":"2024-08-26T00:00:29.367376+0000","last_became_peered":"2024-08-26T00:00:29.367376+0000","last_unstale":"2024-08-26T00:02:02.520050+0000","last_undegraded":"2024-08-26T00:02:02.520050+0000","last_fullsized":"2024-08-26T00:02:02.520050+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:16:13.414883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.534577+0000","last_change":"2024-08-26T00:00:29.369219+0000","last_active":"2024-08-26T00:02:02.534577+0000","last_peered":"2024-08-26T00:02:02.534577+0000","last_clean":"2024-08-26T00:02:02.534577+0000","last_became_active":"2024-08-26T00:00:29.368902+0000","last_became_peered":"2024-08-26T00:00:29.368902+0000","last_unstale":"2024-08-26T00:02:02.534577+0000","last_undegraded":"2024-08-26T00:02:02.534577+0000","last_fullsized":"2024-08-26T00:02:02.534577+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:53:28.636658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"80'8","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.530982+0000","last_change":"2024-08-26T00:00:29.359501+0000","last_active":"2024-08-26T00:02:02.530982+0000","last_peered":"2024-08-26T00:02:02.530982+0000","last_clean":"2024-08-26T00:02:02.530982+0000","last_became_active":"2024-08-26T00:00:29.358778+0000","last_became_peered":"2024-08-26T00:00:29.358778+0000","last_unstale":"2024-08-26T00:02:02.530982+0000","last_undegraded":"2024-08-26T00:02:02.530982+0000","last_fullsized":"2024-08-26T00:02:02.530982+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:20:40.200105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.514251+0000","last_change":"2024-08-26T00:00:29.358387+0000","last_active":"2024-08-26T00:02:02.514251+0000","last_peered":"2024-08-26T00:02:02.514251+0000","last_clean":"2024-08-26T00:02:02.514251+0000","last_became_active":"2024-08-26T00:00:29.357839+0000","last_became_peered":"2024-08-26T00:00:29.357839+0000","last_unstale":"2024-08-26T00:02:02.514251+0000","last_undegraded":"2024-08-26T00:02:02.514251+0000","last_fullsized":"2024-08-26T00:02:02.514251+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:05:21.065258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.530387+0000","last_change":"2024-08-26T00:00:29.354429+0000","last_active":"2024-08-26T00:02:02.530387+0000","last_peered":"2024-08-26T00:02:02.530387+0000","last_clean":"2024-08-26T00:02:02.530387+0000","last_became_active":"2024-08-26T00:00:29.354108+0000","last_became_peered":"2024-08-26T00:00:29.354108+0000","last_unstale":"2024-08-26T00:02:02.530387+0000","last_undegraded":"2024-08-26T00:02:02.530387+0000","last_fullsized":"2024-08-26T00:02:02.530387+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:58:07.912980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.528778+0000","last_change":"2024-08-26T00:00:29.360127+0000","last_active":"2024-08-26T00:02:02.528778+0000","last_peered":"2024-08-26T00:02:02.528778+0000","last_clean":"2024-08-26T00:02:02.528778+0000","last_became_active":"2024-08-26T00:00:29.359730+0000","last_became_peered":"2024-08-26T00:00:29.359730+0000","last_unstale":"2024-08-26T00:02:02.528778+0000","last_undegraded":"2024-08-26T00:02:02.528778+0000","last_fullsized":"2024-08-26T00:02:02.528778+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:38:16.377861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.524984+0000","last_change":"2024-08-26T00:00:29.362117+0000","last_active":"2024-08-26T00:02:02.524984+0000","last_peered":"2024-08-26T00:02:02.524984+0000","last_clean":"2024-08-26T00:02:02.524984+0000","last_became_active":"2024-08-26T00:00:29.361738+0000","last_became_peered":"2024-08-26T00:00:29.361738+0000","last_unstale":"2024-08-26T00:02:02.524984+0000","last_undegraded":"2024-08-26T00:02:02.524984+0000","last_fullsized":"2024-08-26T00:02:02.524984+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:38:15.468364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535176+0000","last_change":"2024-08-26T00:00:29.363693+0000","last_active":"2024-08-26T00:02:02.535176+0000","last_peered":"2024-08-26T00:02:02.535176+0000","last_clean":"2024-08-26T00:02:02.535176+0000","last_became_active":"2024-08-26T00:00:29.363356+0000","last_became_peered":"2024-08-26T00:00:29.363356+0000","last_unstale":"2024-08-26T00:02:02.535176+0000","last_undegraded":"2024-08-26T00:02:02.535176+0000","last_fullsized":"2024-08-26T00:02:02.535176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:18:46.180255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"80'16","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.527282+0000","last_change":"2024-08-26T00:00:29.363401+0000","last_active":"2024-08-26T00:02:02.527282+0000","last_peered":"2024-08-26T00:02:02.527282+0000","last_clean":"2024-08-26T00:02:02.527282+0000","last_became_active":"2024-08-26T00:00:29.363045+0000","last_became_peered":"2024-08-26T00:00:29.363045+0000","last_unstale":"2024-08-26T00:02:02.527282+0000","last_undegraded":"2024-08-26T00:02:02.527282+0000","last_fullsized":"2024-08-26T00:02:02.527282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:18:24.931121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.534547+0000","last_change":"2024-08-26T00:00:29.356440+0000","last_active":"2024-08-26T00:02:02.534547+0000","last_peered":"2024-08-26T00:02:02.534547+0000","last_clean":"2024-08-26T00:02:02.534547+0000","last_became_active":"2024-08-26T00:00:29.355498+0000","last_became_peered":"2024-08-26T00:00:29.355498+0000","last_unstale":"2024-08-26T00:02:02.534547+0000","last_undegraded":"2024-08-26T00:02:02.534547+0000","last_fullsized":"2024-08-26T00:02:02.534547+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:27:31.363962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.531100+0000","last_change":"2024-08-26T00:00:29.359185+0000","last_active":"2024-08-26T00:02:02.531100+0000","last_peered":"2024-08-26T00:02:02.531100+0000","last_clean":"2024-08-26T00:02:02.531100+0000","last_became_active":"2024-08-26T00:00:29.358670+0000","last_became_peered":"2024-08-26T00:00:29.358670+0000","last_unstale":"2024-08-26T00:02:02.531100+0000","last_undegraded":"2024-08-26T00:02:02.531100+0000","last_fullsized":"2024-08-26T00:02:02.531100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:15:31.327823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.522302+0000","last_change":"2024-08-26T00:00:29.361477+0000","last_active":"2024-08-26T00:02:02.522302+0000","last_peered":"2024-08-26T00:02:02.522302+0000","last_clean":"2024-08-26T00:02:02.522302+0000","last_became_active":"2024-08-26T00:00:29.360870+0000","last_became_peered":"2024-08-26T00:00:29.360870+0000","last_unstale":"2024-08-26T00:02:02.522302+0000","last_undegraded":"2024-08-26T00:02:02.522302+0000","last_fullsized":"2024-08-26T00:02:02.522302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:37:01.434606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.523866+0000","last_change":"2024-08-26T00:00:29.362301+0000","last_active":"2024-08-26T00:02:02.523866+0000","last_peered":"2024-08-26T00:02:02.523866+0000","last_clean":"2024-08-26T00:02:02.523866+0000","last_became_active":"2024-08-26T00:00:29.359613+0000","last_became_peered":"2024-08-26T00:00:29.359613+0000","last_unstale":"2024-08-26T00:02:02.523866+0000","last_undegraded":"2024-08-26T00:02:02.523866+0000","last_fullsized":"2024-08-26T00:02:02.523866+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:24:09.515352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.528299+0000","last_change":"2024-08-26T00:00:29.365553+0000","last_active":"2024-08-26T00:02:02.528299+0000","last_peered":"2024-08-26T00:02:02.528299+0000","last_clean":"2024-08-26T00:02:02.528299+0000","last_became_active":"2024-08-26T00:00:29.363344+0000","last_became_peered":"2024-08-26T00:00:29.363344+0000","last_unstale":"2024-08-26T00:02:02.528299+0000","last_undegraded":"2024-08-26T00:02:02.528299+0000","last_fullsized":"2024-08-26T00:02:02.528299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:27:43.172749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535411+0000","last_change":"2024-08-26T00:00:29.362061+0000","last_active":"2024-08-26T00:02:02.535411+0000","last_peered":"2024-08-26T00:02:02.535411+0000","last_clean":"2024-08-26T00:02:02.535411+0000","last_became_active":"2024-08-26T00:00:29.361712+0000","last_became_peered":"2024-08-26T00:00:29.361712+0000","last_unstale":"2024-08-26T00:02:02.535411+0000","last_undegraded":"2024-08-26T00:02:02.535411+0000","last_fullsized":"2024-08-26T00:02:02.535411+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:20:14.944167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535500+0000","last_change":"2024-08-26T00:00:29.365160+0000","last_active":"2024-08-26T00:02:02.535500+0000","last_peered":"2024-08-26T00:02:02.535500+0000","last_clean":"2024-08-26T00:02:02.535500+0000","last_became_active":"2024-08-26T00:00:29.364541+0000","last_became_peered":"2024-08-26T00:00:29.364541+0000","last_unstale":"2024-08-26T00:02:02.535500+0000","last_undegraded":"2024-08-26T00:02:02.535500+0000","last_fullsized":"2024-08-26T00:02:02.535500+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:59:54.417495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.522632+0000","last_change":"2024-08-26T00:00:29.361264+0000","last_active":"2024-08-26T00:02:02.522632+0000","last_peered":"2024-08-26T00:02:02.522632+0000","last_clean":"2024-08-26T00:02:02.522632+0000","last_became_active":"2024-08-26T00:00:29.358501+0000","last_became_peered":"2024-08-26T00:00:29.358501+0000","last_unstale":"2024-08-26T00:02:02.522632+0000","last_undegraded":"2024-08-26T00:02:02.522632+0000","last_fullsized":"2024-08-26T00:02:02.522632+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:04:44.930112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"80'7","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.518570+0000","last_change":"2024-08-26T00:01:33.601117+0000","last_active":"2024-08-26T00:02:02.518570+0000","last_peered":"2024-08-26T00:02:02.518570+0000","last_clean":"2024-08-26T00:02:02.518570+0000","last_became_active":"2024-08-26T00:01:33.600696+0000","last_became_peered":"2024-08-26T00:01:33.600696+0000","last_unstale":"2024-08-26T00:02:02.518570+0000","last_undegraded":"2024-08-26T00:02:02.518570+0000","last_fullsized":"2024-08-26T00:02:02.518570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:43:46.062253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.532661+0000","last_change":"2024-08-26T00:00:29.363072+0000","last_active":"2024-08-26T00:02:02.532661+0000","last_peered":"2024-08-26T00:02:02.532661+0000","last_clean":"2024-08-26T00:02:02.532661+0000","last_became_active":"2024-08-26T00:00:29.362751+0000","last_became_peered":"2024-08-26T00:00:29.362751+0000","last_unstale":"2024-08-26T00:02:02.532661+0000","last_undegraded":"2024-08-26T00:02:02.532661+0000","last_fullsized":"2024-08-26T00:02:02.532661+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:49:14.455371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.529205+0000","last_change":"2024-08-26T00:00:29.367489+0000","last_active":"2024-08-26T00:02:02.529205+0000","last_peered":"2024-08-26T00:02:02.529205+0000","last_clean":"2024-08-26T00:02:02.529205+0000","last_became_active":"2024-08-26T00:00:29.367183+0000","last_became_peered":"2024-08-26T00:00:29.367183+0000","last_unstale":"2024-08-26T00:02:02.529205+0000","last_undegraded":"2024-08-26T00:02:02.529205+0000","last_fullsized":"2024-08-26T00:02:02.529205+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:05:53.736139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535772+0000","last_change":"2024-08-26T00:00:29.356751+0000","last_active":"2024-08-26T00:02:02.535772+0000","last_peered":"2024-08-26T00:02:02.535772+0000","last_clean":"2024-08-26T00:02:02.535772+0000","last_became_active":"2024-08-26T00:00:29.356291+0000","last_became_peered":"2024-08-26T00:00:29.356291+0000","last_unstale":"2024-08-26T00:02:02.535772+0000","last_undegraded":"2024-08-26T00:02:02.535772+0000","last_fullsized":"2024-08-26T00:02:02.535772+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:32:50.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.526003+0000","last_change":"2024-08-26T00:00:29.356965+0000","last_active":"2024-08-26T00:02:02.526003+0000","last_peered":"2024-08-26T00:02:02.526003+0000","last_clean":"2024-08-26T00:02:02.526003+0000","last_became_active":"2024-08-26T00:00:29.356588+0000","last_became_peered":"2024-08-26T00:00:29.356588+0000","last_unstale":"2024-08-26T00:02:02.526003+0000","last_undegraded":"2024-08-26T00:02:02.526003+0000","last_fullsized":"2024-08-26T00:02:02.526003+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:02:25.833139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.523337+0000","last_change":"2024-08-26T00:00:29.352304+0000","last_active":"2024-08-26T00:02:02.523337+0000","last_peered":"2024-08-26T00:02:02.523337+0000","last_clean":"2024-08-26T00:02:02.523337+0000","last_became_active":"2024-08-26T00:00:29.351981+0000","last_became_peered":"2024-08-26T00:00:29.351981+0000","last_unstale":"2024-08-26T00:02:02.523337+0000","last_undegraded":"2024-08-26T00:02:02.523337+0000","last_fullsized":"2024-08-26T00:02:02.523337+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:06:29.105905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"80'2","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.525092+0000","last_change":"2024-08-26T00:00:29.354424+0000","last_active":"2024-08-26T00:02:02.525092+0000","last_peered":"2024-08-26T00:02:02.525092+0000","last_clean":"2024-08-26T00:02:02.525092+0000","last_became_active":"2024-08-26T00:00:29.352687+0000","last_became_peered":"2024-08-26T00:00:29.352687+0000","last_unstale":"2024-08-26T00:02:02.525092+0000","last_undegraded":"2024-08-26T00:02:02.525092+0000","last_fullsized":"2024-08-26T00:02:02.525092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:26:21.769928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.522471+0000","last_change":"2024-08-26T00:00:29.355680+0000","last_active":"2024-08-26T00:02:02.522471+0000","last_peered":"2024-08-26T00:02:02.522471+0000","last_clean":"2024-08-26T00:02:02.522471+0000","last_became_active":"2024-08-26T00:00:29.355335+0000","last_became_peered":"2024-08-26T00:00:29.355335+0000","last_unstale":"2024-08-26T00:02:02.522471+0000","last_undegraded":"2024-08-26T00:02:02.522471+0000","last_fullsized":"2024-08-26T00:02:02.522471+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:16:04.085892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.522793+0000","last_change":"2024-08-26T00:00:29.357564+0000","last_active":"2024-08-26T00:02:02.522793+0000","last_peered":"2024-08-26T00:02:02.522793+0000","last_clean":"2024-08-26T00:02:02.522793+0000","last_became_active":"2024-08-26T00:00:29.357215+0000","last_became_peered":"2024-08-26T00:00:29.357215+0000","last_unstale":"2024-08-26T00:02:02.522793+0000","last_undegraded":"2024-08-26T00:02:02.522793+0000","last_fullsized":"2024-08-26T00:02:02.522793+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:47:32.969629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.529042+0000","last_change":"2024-08-26T00:00:29.368272+0000","last_active":"2024-08-26T00:02:02.529042+0000","last_peered":"2024-08-26T00:02:02.529042+0000","last_clean":"2024-08-26T00:02:02.529042+0000","last_became_active":"2024-08-26T00:00:29.367920+0000","last_became_peered":"2024-08-26T00:00:29.367920+0000","last_unstale":"2024-08-26T00:02:02.529042+0000","last_undegraded":"2024-08-26T00:02:02.529042+0000","last_fullsized":"2024-08-26T00:02:02.529042+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:35:19.373782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.525599+0000","last_change":"2024-08-26T00:00:29.371609+0000","last_active":"2024-08-26T00:02:02.525599+0000","last_peered":"2024-08-26T00:02:02.525599+0000","last_clean":"2024-08-26T00:02:02.525599+0000","last_became_active":"2024-08-26T00:00:29.371199+0000","last_became_peered":"2024-08-26T00:00:29.371199+0000","last_unstale":"2024-08-26T00:02:02.525599+0000","last_undegraded":"2024-08-26T00:02:02.525599+0000","last_fullsized":"2024-08-26T00:02:02.525599+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:03:43.542718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.528791+0000","last_change":"2024-08-26T00:00:29.362222+0000","last_active":"2024-08-26T00:02:02.528791+0000","last_peered":"2024-08-26T00:02:02.528791+0000","last_clean":"2024-08-26T00:02:02.528791+0000","last_became_active":"2024-08-26T00:00:29.361767+0000","last_became_peered":"2024-08-26T00:00:29.361767+0000","last_unstale":"2024-08-26T00:02:02.528791+0000","last_undegraded":"2024-08-26T00:02:02.528791+0000","last_fullsized":"2024-08-26T00:02:02.528791+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:42:17.032034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"80'12","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.519131+0000","last_change":"2024-08-26T00:00:29.357997+0000","last_active":"2024-08-26T00:02:02.519131+0000","last_peered":"2024-08-26T00:02:02.519131+0000","last_clean":"2024-08-26T00:02:02.519131+0000","last_became_active":"2024-08-26T00:00:29.357693+0000","last_became_peered":"2024-08-26T00:00:29.357693+0000","last_unstale":"2024-08-26T00:02:02.519131+0000","last_undegraded":"2024-08-26T00:02:02.519131+0000","last_fullsized":"2024-08-26T00:02:02.519131+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:02:49.074234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.519300+0000","last_change":"2024-08-26T00:00:29.358305+0000","last_active":"2024-08-26T00:02:02.519300+0000","last_peered":"2024-08-26T00:02:02.519300+0000","last_clean":"2024-08-26T00:02:02.519300+0000","last_became_active":"2024-08-26T00:00:29.357928+0000","last_became_peered":"2024-08-26T00:00:29.357928+0000","last_unstale":"2024-08-26T00:02:02.519300+0000","last_undegraded":"2024-08-26T00:02:02.519300+0000","last_fullsized":"2024-08-26T00:02:02.519300+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:34:47.609170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.520949+0000","last_change":"2024-08-26T00:00:29.357931+0000","last_active":"2024-08-26T00:02:02.520949+0000","last_peered":"2024-08-26T00:02:02.520949+0000","last_clean":"2024-08-26T00:02:02.520949+0000","last_became_active":"2024-08-26T00:00:29.357408+0000","last_became_peered":"2024-08-26T00:00:29.357408+0000","last_unstale":"2024-08-26T00:02:02.520949+0000","last_undegraded":"2024-08-26T00:02:02.520949+0000","last_fullsized":"2024-08-26T00:02:02.520949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:21:10.230267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'5","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:26.560688+0000","last_change":"2024-08-26T00:00:26.993942+0000","last_active":"2024-08-26T00:02:26.560688+0000","last_peered":"2024-08-26T00:02:26.560688+0000","last_clean":"2024-08-26T00:02:26.560688+0000","last_became_active":"2024-08-26T00:00:26.993136+0000","last_became_peered":"2024-08-26T00:00:26.993136+0000","last_unstale":"2024-08-26T00:02:26.560688+0000","last_undegraded":"2024-08-26T00:02:26.560688+0000","last_fullsized":"2024-08-26T00:02:26.560688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:30:31.890643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.531080+0000","last_change":"2024-08-26T00:00:29.351174+0000","last_active":"2024-08-26T00:02:02.531080+0000","last_peered":"2024-08-26T00:02:02.531080+0000","last_clean":"2024-08-26T00:02:02.531080+0000","last_became_active":"2024-08-26T00:00:29.350758+0000","last_became_peered":"2024-08-26T00:00:29.350758+0000","last_unstale":"2024-08-26T00:02:02.531080+0000","last_undegraded":"2024-08-26T00:02:02.531080+0000","last_fullsized":"2024-08-26T00:02:02.531080+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:02:56.986251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.593069+0000","last_change":"2024-08-26T00:00:26.991547+0000","last_active":"2024-08-26T00:01:33.593069+0000","last_peered":"2024-08-26T00:01:33.593069+0000","last_clean":"2024-08-26T00:01:33.593069+0000","last_became_active":"2024-08-26T00:00:26.991120+0000","last_became_peered":"2024-08-26T00:00:26.991120+0000","last_unstale":"2024-08-26T00:01:33.593069+0000","last_undegraded":"2024-08-26T00:01:33.593069+0000","last_fullsized":"2024-08-26T00:01:33.593069+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:42:12.381882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.594735+0000","last_change":"2024-08-26T00:00:26.988477+0000","last_active":"2024-08-26T00:01:33.594735+0000","last_peered":"2024-08-26T00:01:33.594735+0000","last_clean":"2024-08-26T00:01:33.594735+0000","last_became_active":"2024-08-26T00:00:26.988180+0000","last_became_peered":"2024-08-26T00:00:26.988180+0000","last_unstale":"2024-08-26T00:01:33.594735+0000","last_undegraded":"2024-08-26T00:01:33.594735+0000","last_fullsized":"2024-08-26T00:01:33.594735+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:00:35.586628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.523904+0000","last_change":"2024-08-26T00:00:29.360687+0000","last_active":"2024-08-26T00:02:02.523904+0000","last_peered":"2024-08-26T00:02:02.523904+0000","last_clean":"2024-08-26T00:02:02.523904+0000","last_became_active":"2024-08-26T00:00:29.358427+0000","last_became_peered":"2024-08-26T00:00:29.358427+0000","last_unstale":"2024-08-26T00:02:02.523904+0000","last_undegraded":"2024-08-26T00:02:02.523904+0000","last_fullsized":"2024-08-26T00:02:02.523904+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:15:41.175510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599569+0000","last_change":"2024-08-26T00:00:26.995054+0000","last_active":"2024-08-26T00:01:33.599569+0000","last_peered":"2024-08-26T00:01:33.599569+0000","last_clean":"2024-08-26T00:01:33.599569+0000","last_became_active":"2024-08-26T00:00:26.994742+0000","last_became_peered":"2024-08-26T00:00:26.994742+0000","last_unstale":"2024-08-26T00:01:33.599569+0000","last_undegraded":"2024-08-26T00:01:33.599569+0000","last_fullsized":"2024-08-26T00:01:33.599569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:02:30.509497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.524712+0000","last_change":"2024-08-26T00:00:29.352343+0000","last_active":"2024-08-26T00:02:02.524712+0000","last_peered":"2024-08-26T00:02:02.524712+0000","last_clean":"2024-08-26T00:02:02.524712+0000","last_became_active":"2024-08-26T00:00:29.352036+0000","last_became_peered":"2024-08-26T00:00:29.352036+0000","last_unstale":"2024-08-26T00:02:02.524712+0000","last_undegraded":"2024-08-26T00:02:02.524712+0000","last_fullsized":"2024-08-26T00:02:02.524712+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:28:14.399870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:30.566233+0000","last_change":"2024-08-26T00:00:26.989828+0000","last_active":"2024-08-26T00:02:30.566233+0000","last_peered":"2024-08-26T00:02:30.566233+0000","last_clean":"2024-08-26T00:02:30.566233+0000","last_became_active":"2024-08-26T00:00:26.989365+0000","last_became_peered":"2024-08-26T00:00:26.989365+0000","last_unstale":"2024-08-26T00:02:30.566233+0000","last_undegraded":"2024-08-26T00:02:30.566233+0000","last_fullsized":"2024-08-26T00:02:30.566233+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:00:40.821500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":112,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535546+0000","last_change":"2024-08-26T00:00:29.359506+0000","last_active":"2024-08-26T00:02:02.535546+0000","last_peered":"2024-08-26T00:02:02.535546+0000","last_clean":"2024-08-26T00:02:02.535546+0000","last_became_active":"2024-08-26T00:00:29.359042+0000","last_became_peered":"2024-08-26T00:00:29.359042+0000","last_unstale":"2024-08-26T00:02:02.535546+0000","last_undegraded":"2024-08-26T00:02:02.535546+0000","last_fullsized":"2024-08-26T00:02:02.535546+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:38:34.661823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595861+0000","last_change":"2024-08-26T00:00:26.994272+0000","last_active":"2024-08-26T00:01:33.595861+0000","last_peered":"2024-08-26T00:01:33.595861+0000","last_clean":"2024-08-26T00:01:33.595861+0000","last_became_active":"2024-08-26T00:00:26.993769+0000","last_became_peered":"2024-08-26T00:00:26.993769+0000","last_unstale":"2024-08-26T00:01:33.595861+0000","last_undegraded":"2024-08-26T00:01:33.595861+0000","last_fullsized":"2024-08-26T00:01:33.595861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:03:39.816595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.528626+0000","last_change":"2024-08-26T00:00:29.372236+0000","last_active":"2024-08-26T00:02:02.528626+0000","last_peered":"2024-08-26T00:02:02.528626+0000","last_clean":"2024-08-26T00:02:02.528626+0000","last_became_active":"2024-08-26T00:00:29.371632+0000","last_became_peered":"2024-08-26T00:00:29.371632+0000","last_unstale":"2024-08-26T00:02:02.528626+0000","last_undegraded":"2024-08-26T00:02:02.528626+0000","last_fullsized":"2024-08-26T00:02:02.528626+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:46:10.735550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598661+0000","last_change":"2024-08-26T00:00:27.080074+0000","last_active":"2024-08-26T00:01:33.598661+0000","last_peered":"2024-08-26T00:01:33.598661+0000","last_clean":"2024-08-26T00:01:33.598661+0000","last_became_active":"2024-08-26T00:00:27.079646+0000","last_became_peered":"2024-08-26T00:00:27.079646+0000","last_unstale":"2024-08-26T00:01:33.598661+0000","last_undegraded":"2024-08-26T00:01:33.598661+0000","last_fullsized":"2024-08-26T00:01:33.598661+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:22:42.677747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"80'11","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535811+0000","last_change":"2024-08-26T00:01:33.600131+0000","last_active":"2024-08-26T00:02:02.535811+0000","last_peered":"2024-08-26T00:02:02.535811+0000","last_clean":"2024-08-26T00:02:02.535811+0000","last_became_active":"2024-08-26T00:01:33.599594+0000","last_became_peered":"2024-08-26T00:01:33.599594+0000","last_unstale":"2024-08-26T00:02:02.535811+0000","last_undegraded":"2024-08-26T00:02:02.535811+0000","last_fullsized":"2024-08-26T00:02:02.535811+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:33:33.573513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'34","reported_seq":310,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:31.986822+0000","last_change":"2024-08-26T00:01:33.901247+0000","last_active":"2024-08-26T00:02:31.986822+0000","last_peered":"2024-08-26T00:02:31.986822+0000","last_clean":"2024-08-26T00:02:31.986822+0000","last_became_active":"2024-08-26T00:01:33.892141+0000","last_became_peered":"2024-08-26T00:01:33.892141+0000","last_unstale":"2024-08-26T00:02:31.986822+0000","last_undegraded":"2024-08-26T00:02:31.986822+0000","last_fullsized":"2024-08-26T00:02:31.986822+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:08:05.209223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65489,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":232,"num_read_kb":179,"num_write":35,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":60615,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.520296+0000","last_change":"2024-08-26T00:00:29.356969+0000","last_active":"2024-08-26T00:02:02.520296+0000","last_peered":"2024-08-26T00:02:02.520296+0000","last_clean":"2024-08-26T00:02:02.520296+0000","last_became_active":"2024-08-26T00:00:29.356493+0000","last_became_peered":"2024-08-26T00:00:29.356493+0000","last_unstale":"2024-08-26T00:02:02.520296+0000","last_undegraded":"2024-08-26T00:02:02.520296+0000","last_fullsized":"2024-08-26T00:02:02.520296+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:42:29.663933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596334+0000","last_change":"2024-08-26T00:00:26.993733+0000","last_active":"2024-08-26T00:01:33.596334+0000","last_peered":"2024-08-26T00:01:33.596334+0000","last_clean":"2024-08-26T00:01:33.596334+0000","last_became_active":"2024-08-26T00:00:26.991196+0000","last_became_peered":"2024-08-26T00:00:26.991196+0000","last_unstale":"2024-08-26T00:01:33.596334+0000","last_undegraded":"2024-08-26T00:01:33.596334+0000","last_fullsized":"2024-08-26T00:01:33.596334+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:53:49.056228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.521316+0000","last_change":"2024-08-26T00:00:29.363095+0000","last_active":"2024-08-26T00:02:02.521316+0000","last_peered":"2024-08-26T00:02:02.521316+0000","last_clean":"2024-08-26T00:02:02.521316+0000","last_became_active":"2024-08-26T00:00:29.361374+0000","last_became_peered":"2024-08-26T00:00:29.361374+0000","last_unstale":"2024-08-26T00:02:02.521316+0000","last_undegraded":"2024-08-26T00:02:02.521316+0000","last_fullsized":"2024-08-26T00:02:02.521316+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:30:34.072712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598243+0000","last_change":"2024-08-26T00:00:26.993920+0000","last_active":"2024-08-26T00:01:33.598243+0000","last_peered":"2024-08-26T00:01:33.598243+0000","last_clean":"2024-08-26T00:01:33.598243+0000","last_became_active":"2024-08-26T00:00:26.993578+0000","last_became_peered":"2024-08-26T00:00:26.993578+0000","last_unstale":"2024-08-26T00:01:33.598243+0000","last_undegraded":"2024-08-26T00:01:33.598243+0000","last_fullsized":"2024-08-26T00:01:33.598243+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:29:49.751384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.522031+0000","last_change":"2024-08-26T00:00:29.362535+0000","last_active":"2024-08-26T00:02:02.522031+0000","last_peered":"2024-08-26T00:02:02.522031+0000","last_clean":"2024-08-26T00:02:02.522031+0000","last_became_active":"2024-08-26T00:00:29.362167+0000","last_became_peered":"2024-08-26T00:00:29.362167+0000","last_unstale":"2024-08-26T00:02:02.522031+0000","last_undegraded":"2024-08-26T00:02:02.522031+0000","last_fullsized":"2024-08-26T00:02:02.522031+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:21:54.020323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'6","reported_seq":144,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:29.565361+0000","last_change":"2024-08-26T00:00:26.993988+0000","last_active":"2024-08-26T00:02:29.565361+0000","last_peered":"2024-08-26T00:02:29.565361+0000","last_clean":"2024-08-26T00:02:29.565361+0000","last_became_active":"2024-08-26T00:00:26.993485+0000","last_became_peered":"2024-08-26T00:00:26.993485+0000","last_unstale":"2024-08-26T00:02:29.565361+0000","last_undegraded":"2024-08-26T00:02:29.565361+0000","last_fullsized":"2024-08-26T00:02:29.565361+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:46:29.475574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"80'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.527020+0000","last_change":"2024-08-26T00:01:33.599944+0000","last_active":"2024-08-26T00:02:02.527020+0000","last_peered":"2024-08-26T00:02:02.527020+0000","last_clean":"2024-08-26T00:02:02.527020+0000","last_became_active":"2024-08-26T00:01:33.599457+0000","last_became_peered":"2024-08-26T00:01:33.599457+0000","last_unstale":"2024-08-26T00:02:02.527020+0000","last_undegraded":"2024-08-26T00:02:02.527020+0000","last_fullsized":"2024-08-26T00:02:02.527020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:12:33.747334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598056+0000","last_change":"2024-08-26T00:00:27.077517+0000","last_active":"2024-08-26T00:01:33.598056+0000","last_peered":"2024-08-26T00:01:33.598056+0000","last_clean":"2024-08-26T00:01:33.598056+0000","last_became_active":"2024-08-26T00:00:27.077083+0000","last_became_peered":"2024-08-26T00:00:27.077083+0000","last_unstale":"2024-08-26T00:01:33.598056+0000","last_undegraded":"2024-08-26T00:01:33.598056+0000","last_fullsized":"2024-08-26T00:01:33.598056+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:27:43.522233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.530797+0000","last_change":"2024-08-26T00:00:29.355532+0000","last_active":"2024-08-26T00:02:02.530797+0000","last_peered":"2024-08-26T00:02:02.530797+0000","last_clean":"2024-08-26T00:02:02.530797+0000","last_became_active":"2024-08-26T00:00:29.355211+0000","last_became_peered":"2024-08-26T00:00:29.355211+0000","last_unstale":"2024-08-26T00:02:02.530797+0000","last_undegraded":"2024-08-26T00:02:02.530797+0000","last_fullsized":"2024-08-26T00:02:02.530797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:08:51.419634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598646+0000","last_change":"2024-08-26T00:00:26.992613+0000","last_active":"2024-08-26T00:01:33.598646+0000","last_peered":"2024-08-26T00:01:33.598646+0000","last_clean":"2024-08-26T00:01:33.598646+0000","last_became_active":"2024-08-26T00:00:26.992137+0000","last_became_peered":"2024-08-26T00:00:26.992137+0000","last_unstale":"2024-08-26T00:01:33.598646+0000","last_undegraded":"2024-08-26T00:01:33.598646+0000","last_fullsized":"2024-08-26T00:01:33.598646+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:30:32.586859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.532951+0000","last_change":"2024-08-26T00:00:29.362342+0000","last_active":"2024-08-26T00:02:02.532951+0000","last_peered":"2024-08-26T00:02:02.532951+0000","last_clean":"2024-08-26T00:02:02.532951+0000","last_became_active":"2024-08-26T00:00:29.362017+0000","last_became_peered":"2024-08-26T00:00:29.362017+0000","last_unstale":"2024-08-26T00:02:02.532951+0000","last_undegraded":"2024-08-26T00:02:02.532951+0000","last_fullsized":"2024-08-26T00:02:02.532951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:01:55.507893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.595105+0000","last_change":"2024-08-26T00:00:26.989977+0000","last_active":"2024-08-26T00:01:33.595105+0000","last_peered":"2024-08-26T00:01:33.595105+0000","last_clean":"2024-08-26T00:01:33.595105+0000","last_became_active":"2024-08-26T00:00:26.989535+0000","last_became_peered":"2024-08-26T00:00:26.989535+0000","last_unstale":"2024-08-26T00:01:33.595105+0000","last_undegraded":"2024-08-26T00:01:33.595105+0000","last_fullsized":"2024-08-26T00:01:33.595105+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:33:20.347005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.518416+0000","last_change":"2024-08-26T00:00:29.355928+0000","last_active":"2024-08-26T00:02:02.518416+0000","last_peered":"2024-08-26T00:02:02.518416+0000","last_clean":"2024-08-26T00:02:02.518416+0000","last_became_active":"2024-08-26T00:00:29.355546+0000","last_became_peered":"2024-08-26T00:00:29.355546+0000","last_unstale":"2024-08-26T00:02:02.518416+0000","last_undegraded":"2024-08-26T00:02:02.518416+0000","last_fullsized":"2024-08-26T00:02:02.518416+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:15:06.116141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598775+0000","last_change":"2024-08-26T00:00:26.992523+0000","last_active":"2024-08-26T00:01:33.598775+0000","last_peered":"2024-08-26T00:01:33.598775+0000","last_clean":"2024-08-26T00:01:33.598775+0000","last_became_active":"2024-08-26T00:00:26.992193+0000","last_became_peered":"2024-08-26T00:00:26.992193+0000","last_unstale":"2024-08-26T00:01:33.598775+0000","last_undegraded":"2024-08-26T00:01:33.598775+0000","last_fullsized":"2024-08-26T00:01:33.598775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:34:21.879373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.522820+0000","last_change":"2024-08-26T00:00:29.358826+0000","last_active":"2024-08-26T00:02:02.522820+0000","last_peered":"2024-08-26T00:02:02.522820+0000","last_clean":"2024-08-26T00:02:02.522820+0000","last_became_active":"2024-08-26T00:00:29.358478+0000","last_became_peered":"2024-08-26T00:00:29.358478+0000","last_unstale":"2024-08-26T00:02:02.522820+0000","last_undegraded":"2024-08-26T00:02:02.522820+0000","last_fullsized":"2024-08-26T00:02:02.522820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T11:30:39.484666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596872+0000","last_change":"2024-08-26T00:00:27.077599+0000","last_active":"2024-08-26T00:01:33.596872+0000","last_peered":"2024-08-26T00:01:33.596872+0000","last_clean":"2024-08-26T00:01:33.596872+0000","last_became_active":"2024-08-26T00:00:27.077094+0000","last_became_peered":"2024-08-26T00:00:27.077094+0000","last_unstale":"2024-08-26T00:01:33.596872+0000","last_undegraded":"2024-08-26T00:01:33.596872+0000","last_fullsized":"2024-08-26T00:01:33.596872+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:06:47.966097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535039+0000","last_change":"2024-08-26T00:00:29.355243+0000","last_active":"2024-08-26T00:02:02.535039+0000","last_peered":"2024-08-26T00:02:02.535039+0000","last_clean":"2024-08-26T00:02:02.535039+0000","last_became_active":"2024-08-26T00:00:29.354151+0000","last_became_peered":"2024-08-26T00:00:29.354151+0000","last_unstale":"2024-08-26T00:02:02.535039+0000","last_undegraded":"2024-08-26T00:02:02.535039+0000","last_fullsized":"2024-08-26T00:02:02.535039+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:00:12.520736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":335,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596237+0000","last_change":"2024-08-25T23:59:16.227980+0000","last_active":"2024-08-26T00:01:33.596237+0000","last_peered":"2024-08-26T00:01:33.596237+0000","last_clean":"2024-08-26T00:01:33.596237+0000","last_became_active":"2024-08-25T23:59:16.227550+0000","last_became_peered":"2024-08-25T23:59:16.227550+0000","last_unstale":"2024-08-26T00:01:33.596237+0000","last_undegraded":"2024-08-26T00:01:33.596237+0000","last_fullsized":"2024-08-26T00:01:33.596237+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-25T23:55:51.247914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-25T23:55:51.247914+0000","last_clean_scrub_stamp":"2024-08-25T23:55:51.247914+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:39:34.184312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.890555+0000","last_change":"2024-08-26T00:00:26.992675+0000","last_active":"2024-08-26T00:01:33.890555+0000","last_peered":"2024-08-26T00:01:33.890555+0000","last_clean":"2024-08-26T00:01:33.890555+0000","last_became_active":"2024-08-26T00:00:26.992322+0000","last_became_peered":"2024-08-26T00:00:26.992322+0000","last_unstale":"2024-08-26T00:01:33.890555+0000","last_undegraded":"2024-08-26T00:01:33.890555+0000","last_fullsized":"2024-08-26T00:01:33.890555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:38:26.016220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.534623+0000","last_change":"2024-08-26T00:00:29.362617+0000","last_active":"2024-08-26T00:02:02.534623+0000","last_peered":"2024-08-26T00:02:02.534623+0000","last_clean":"2024-08-26T00:02:02.534623+0000","last_became_active":"2024-08-26T00:00:29.362245+0000","last_became_peered":"2024-08-26T00:00:29.362245+0000","last_unstale":"2024-08-26T00:02:02.534623+0000","last_undegraded":"2024-08-26T00:02:02.534623+0000","last_fullsized":"2024-08-26T00:02:02.534623+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:30:12.309213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.895870+0000","last_change":"2024-08-26T00:01:33.895296+0000","last_active":"2024-08-26T00:01:33.895870+0000","last_peered":"2024-08-26T00:01:33.895870+0000","last_clean":"2024-08-26T00:01:33.895870+0000","last_became_active":"2024-08-26T00:01:33.891598+0000","last_became_peered":"2024-08-26T00:01:33.891598+0000","last_unstale":"2024-08-26T00:01:33.895870+0000","last_undegraded":"2024-08-26T00:01:33.895870+0000","last_fullsized":"2024-08-26T00:01:33.895870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:26:31.794735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"80'5","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.519184+0000","last_change":"2024-08-26T00:01:33.601137+0000","last_active":"2024-08-26T00:02:02.519184+0000","last_peered":"2024-08-26T00:02:02.519184+0000","last_clean":"2024-08-26T00:02:02.519184+0000","last_became_active":"2024-08-26T00:01:33.600397+0000","last_became_peered":"2024-08-26T00:01:33.600397+0000","last_unstale":"2024-08-26T00:02:02.519184+0000","last_undegraded":"2024-08-26T00:02:02.519184+0000","last_fullsized":"2024-08-26T00:02:02.519184+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:42:21.507880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'6","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:31.567634+0000","last_change":"2024-08-26T00:00:27.077840+0000","last_active":"2024-08-26T00:02:31.567634+0000","last_peered":"2024-08-26T00:02:31.567634+0000","last_clean":"2024-08-26T00:02:31.567634+0000","last_became_active":"2024-08-26T00:00:27.077355+0000","last_became_peered":"2024-08-26T00:00:27.077355+0000","last_unstale":"2024-08-26T00:02:31.567634+0000","last_undegraded":"2024-08-26T00:02:31.567634+0000","last_fullsized":"2024-08-26T00:02:31.567634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:03:30.718962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":112,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"80'8","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.521970+0000","last_change":"2024-08-26T00:01:33.603558+0000","last_active":"2024-08-26T00:02:02.521970+0000","last_peered":"2024-08-26T00:02:02.521970+0000","last_clean":"2024-08-26T00:02:02.521970+0000","last_became_active":"2024-08-26T00:01:33.603177+0000","last_became_peered":"2024-08-26T00:01:33.603177+0000","last_unstale":"2024-08-26T00:02:02.521970+0000","last_undegraded":"2024-08-26T00:02:02.521970+0000","last_fullsized":"2024-08-26T00:02:02.521970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:21:33.913812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596032+0000","last_change":"2024-08-26T00:00:26.994187+0000","last_active":"2024-08-26T00:01:33.596032+0000","last_peered":"2024-08-26T00:01:33.596032+0000","last_clean":"2024-08-26T00:01:33.596032+0000","last_became_active":"2024-08-26T00:00:26.993699+0000","last_became_peered":"2024-08-26T00:00:26.993699+0000","last_unstale":"2024-08-26T00:01:33.596032+0000","last_undegraded":"2024-08-26T00:01:33.596032+0000","last_fullsized":"2024-08-26T00:01:33.596032+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:19:50.412724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.532714+0000","last_change":"2024-08-26T00:00:29.364507+0000","last_active":"2024-08-26T00:02:02.532714+0000","last_peered":"2024-08-26T00:02:02.532714+0000","last_clean":"2024-08-26T00:02:02.532714+0000","last_became_active":"2024-08-26T00:00:29.364129+0000","last_became_peered":"2024-08-26T00:00:29.364129+0000","last_unstale":"2024-08-26T00:02:02.532714+0000","last_undegraded":"2024-08-26T00:02:02.532714+0000","last_fullsized":"2024-08-26T00:02:02.532714+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:17:36.837206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.600201+0000","last_change":"2024-08-26T00:00:27.076977+0000","last_active":"2024-08-26T00:01:33.600201+0000","last_peered":"2024-08-26T00:01:33.600201+0000","last_clean":"2024-08-26T00:01:33.600201+0000","last_became_active":"2024-08-26T00:00:27.076524+0000","last_became_peered":"2024-08-26T00:00:27.076524+0000","last_unstale":"2024-08-26T00:01:33.600201+0000","last_undegraded":"2024-08-26T00:01:33.600201+0000","last_fullsized":"2024-08-26T00:01:33.600201+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:22:21.820009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.523841+0000","last_change":"2024-08-26T00:00:29.363880+0000","last_active":"2024-08-26T00:02:02.523841+0000","last_peered":"2024-08-26T00:02:02.523841+0000","last_clean":"2024-08-26T00:02:02.523841+0000","last_became_active":"2024-08-26T00:00:29.363475+0000","last_became_peered":"2024-08-26T00:00:29.363475+0000","last_unstale":"2024-08-26T00:02:02.523841+0000","last_undegraded":"2024-08-26T00:02:02.523841+0000","last_fullsized":"2024-08-26T00:02:02.523841+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:30:55.875922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.606790+0000","last_change":"2024-08-26T00:01:33.606353+0000","last_active":"2024-08-26T00:01:33.606790+0000","last_peered":"2024-08-26T00:01:33.606790+0000","last_clean":"2024-08-26T00:01:33.606790+0000","last_became_active":"2024-08-26T00:01:33.599903+0000","last_became_peered":"2024-08-26T00:01:33.599903+0000","last_unstale":"2024-08-26T00:01:33.606790+0000","last_undegraded":"2024-08-26T00:01:33.606790+0000","last_fullsized":"2024-08-26T00:01:33.606790+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T08:02:09.033915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.519061+0000","last_change":"2024-08-26T00:00:29.360285+0000","last_active":"2024-08-26T00:02:02.519061+0000","last_peered":"2024-08-26T00:02:02.519061+0000","last_clean":"2024-08-26T00:02:02.519061+0000","last_became_active":"2024-08-26T00:00:29.359879+0000","last_became_peered":"2024-08-26T00:00:29.359879+0000","last_unstale":"2024-08-26T00:02:02.519061+0000","last_undegraded":"2024-08-26T00:02:02.519061+0000","last_fullsized":"2024-08-26T00:02:02.519061+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:49:10.691817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'14","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:03.359394+0000","last_change":"2024-08-26T00:00:26.990419+0000","last_active":"2024-08-26T00:02:03.359394+0000","last_peered":"2024-08-26T00:02:03.359394+0000","last_clean":"2024-08-26T00:02:03.359394+0000","last_became_active":"2024-08-26T00:00:26.990052+0000","last_became_peered":"2024-08-26T00:00:26.990052+0000","last_unstale":"2024-08-26T00:02:03.359394+0000","last_undegraded":"2024-08-26T00:02:03.359394+0000","last_fullsized":"2024-08-26T00:02:03.359394+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:27:41.229418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.524365+0000","last_change":"2024-08-26T00:00:29.354671+0000","last_active":"2024-08-26T00:02:02.524365+0000","last_peered":"2024-08-26T00:02:02.524365+0000","last_clean":"2024-08-26T00:02:02.524365+0000","last_became_active":"2024-08-26T00:00:29.354071+0000","last_became_peered":"2024-08-26T00:00:29.354071+0000","last_unstale":"2024-08-26T00:02:02.524365+0000","last_undegraded":"2024-08-26T00:02:02.524365+0000","last_fullsized":"2024-08-26T00:02:02.524365+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:50:09.097757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.890786+0000","last_change":"2024-08-26T00:00:26.991622+0000","last_active":"2024-08-26T00:01:33.890786+0000","last_peered":"2024-08-26T00:01:33.890786+0000","last_clean":"2024-08-26T00:01:33.890786+0000","last_became_active":"2024-08-26T00:00:26.991244+0000","last_became_peered":"2024-08-26T00:00:26.991244+0000","last_unstale":"2024-08-26T00:01:33.890786+0000","last_undegraded":"2024-08-26T00:01:33.890786+0000","last_fullsized":"2024-08-26T00:01:33.890786+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:58:25.676985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.526109+0000","last_change":"2024-08-26T00:00:29.367033+0000","last_active":"2024-08-26T00:02:02.526109+0000","last_peered":"2024-08-26T00:02:02.526109+0000","last_clean":"2024-08-26T00:02:02.526109+0000","last_became_active":"2024-08-26T00:00:29.365572+0000","last_became_peered":"2024-08-26T00:00:29.365572+0000","last_unstale":"2024-08-26T00:02:02.526109+0000","last_undegraded":"2024-08-26T00:02:02.526109+0000","last_fullsized":"2024-08-26T00:02:02.526109+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:16:49.116721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.596764+0000","last_change":"2024-08-26T00:00:27.076562+0000","last_active":"2024-08-26T00:01:33.596764+0000","last_peered":"2024-08-26T00:01:33.596764+0000","last_clean":"2024-08-26T00:01:33.596764+0000","last_became_active":"2024-08-26T00:00:27.076163+0000","last_became_peered":"2024-08-26T00:00:27.076163+0000","last_unstale":"2024-08-26T00:01:33.596764+0000","last_undegraded":"2024-08-26T00:01:33.596764+0000","last_fullsized":"2024-08-26T00:01:33.596764+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:25:03.222457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"80'2","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.491274+0000","last_change":"2024-08-26T00:00:29.352787+0000","last_active":"2024-08-26T00:02:02.491274+0000","last_peered":"2024-08-26T00:02:02.491274+0000","last_clean":"2024-08-26T00:02:02.491274+0000","last_became_active":"2024-08-26T00:00:29.352429+0000","last_became_peered":"2024-08-26T00:00:29.352429+0000","last_unstale":"2024-08-26T00:02:02.491274+0000","last_undegraded":"2024-08-26T00:02:02.491274+0000","last_fullsized":"2024-08-26T00:02:02.491274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:39:45.080372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.592534+0000","last_change":"2024-08-26T00:00:26.989778+0000","last_active":"2024-08-26T00:01:33.592534+0000","last_peered":"2024-08-26T00:01:33.592534+0000","last_clean":"2024-08-26T00:01:33.592534+0000","last_became_active":"2024-08-26T00:00:26.989433+0000","last_became_peered":"2024-08-26T00:00:26.989433+0000","last_unstale":"2024-08-26T00:01:33.592534+0000","last_undegraded":"2024-08-26T00:01:33.592534+0000","last_fullsized":"2024-08-26T00:01:33.592534+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T04:36:16.684252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.525073+0000","last_change":"2024-08-26T00:00:29.362705+0000","last_active":"2024-08-26T00:02:02.525073+0000","last_peered":"2024-08-26T00:02:02.525073+0000","last_clean":"2024-08-26T00:02:02.525073+0000","last_became_active":"2024-08-26T00:00:29.362341+0000","last_became_peered":"2024-08-26T00:00:29.362341+0000","last_unstale":"2024-08-26T00:02:02.525073+0000","last_undegraded":"2024-08-26T00:02:02.525073+0000","last_fullsized":"2024-08-26T00:02:02.525073+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:10:47.051351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.609432+0000","last_change":"2024-08-26T00:01:33.608894+0000","last_active":"2024-08-26T00:01:33.609432+0000","last_peered":"2024-08-26T00:01:33.609432+0000","last_clean":"2024-08-26T00:01:33.609432+0000","last_became_active":"2024-08-26T00:01:33.601976+0000","last_became_peered":"2024-08-26T00:01:33.601976+0000","last_unstale":"2024-08-26T00:01:33.609432+0000","last_undegraded":"2024-08-26T00:01:33.609432+0000","last_fullsized":"2024-08-26T00:01:33.609432+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T05:03:17.367456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.528063+0000","last_change":"2024-08-26T00:00:29.365553+0000","last_active":"2024-08-26T00:02:02.528063+0000","last_peered":"2024-08-26T00:02:02.528063+0000","last_clean":"2024-08-26T00:02:02.528063+0000","last_became_active":"2024-08-26T00:00:29.365215+0000","last_became_peered":"2024-08-26T00:00:29.365215+0000","last_unstale":"2024-08-26T00:02:02.528063+0000","last_undegraded":"2024-08-26T00:02:02.528063+0000","last_fullsized":"2024-08-26T00:02:02.528063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:55:01.505530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598744+0000","last_change":"2024-08-26T00:00:26.995228+0000","last_active":"2024-08-26T00:01:33.598744+0000","last_peered":"2024-08-26T00:01:33.598744+0000","last_clean":"2024-08-26T00:01:33.598744+0000","last_became_active":"2024-08-26T00:00:26.994875+0000","last_became_peered":"2024-08-26T00:00:26.994875+0000","last_unstale":"2024-08-26T00:01:33.598744+0000","last_undegraded":"2024-08-26T00:01:33.598744+0000","last_fullsized":"2024-08-26T00:01:33.598744+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:27:21.110162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.528622+0000","last_change":"2024-08-26T00:00:29.361598+0000","last_active":"2024-08-26T00:02:02.528622+0000","last_peered":"2024-08-26T00:02:02.528622+0000","last_clean":"2024-08-26T00:02:02.528622+0000","last_became_active":"2024-08-26T00:00:29.361237+0000","last_became_peered":"2024-08-26T00:00:29.361237+0000","last_unstale":"2024-08-26T00:02:02.528622+0000","last_undegraded":"2024-08-26T00:02:02.528622+0000","last_fullsized":"2024-08-26T00:02:02.528622+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:21:30.126060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.531764+0000","last_change":"2024-08-26T00:00:29.355240+0000","last_active":"2024-08-26T00:02:02.531764+0000","last_peered":"2024-08-26T00:02:02.531764+0000","last_clean":"2024-08-26T00:02:02.531764+0000","last_became_active":"2024-08-26T00:00:29.354165+0000","last_became_peered":"2024-08-26T00:00:29.354165+0000","last_unstale":"2024-08-26T00:02:02.531764+0000","last_undegraded":"2024-08-26T00:02:02.531764+0000","last_fullsized":"2024-08-26T00:02:02.531764+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T02:07:56.573032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.598465+0000","last_change":"2024-08-26T00:00:26.992240+0000","last_active":"2024-08-26T00:01:33.598465+0000","last_peered":"2024-08-26T00:01:33.598465+0000","last_clean":"2024-08-26T00:01:33.598465+0000","last_became_active":"2024-08-26T00:00:26.991866+0000","last_became_peered":"2024-08-26T00:00:26.991866+0000","last_unstale":"2024-08-26T00:01:33.598465+0000","last_undegraded":"2024-08-26T00:01:33.598465+0000","last_fullsized":"2024-08-26T00:01:33.598465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T07:25:50.815151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535915+0000","last_change":"2024-08-26T00:00:29.370358+0000","last_active":"2024-08-26T00:02:02.535915+0000","last_peered":"2024-08-26T00:02:02.535915+0000","last_clean":"2024-08-26T00:02:02.535915+0000","last_became_active":"2024-08-26T00:00:29.369910+0000","last_became_peered":"2024-08-26T00:00:29.369910+0000","last_unstale":"2024-08-26T00:02:02.535915+0000","last_undegraded":"2024-08-26T00:02:02.535915+0000","last_fullsized":"2024-08-26T00:02:02.535915+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T01:49:11.351575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.599966+0000","last_change":"2024-08-26T00:00:26.989759+0000","last_active":"2024-08-26T00:01:33.599966+0000","last_peered":"2024-08-26T00:01:33.599966+0000","last_clean":"2024-08-26T00:01:33.599966+0000","last_became_active":"2024-08-26T00:00:26.989376+0000","last_became_peered":"2024-08-26T00:00:26.989376+0000","last_unstale":"2024-08-26T00:01:33.599966+0000","last_undegraded":"2024-08-26T00:01:33.599966+0000","last_fullsized":"2024-08-26T00:01:33.599966+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T10:44:36.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.535350+0000","last_change":"2024-08-26T00:00:29.367050+0000","last_active":"2024-08-26T00:02:02.535350+0000","last_peered":"2024-08-26T00:02:02.535350+0000","last_clean":"2024-08-26T00:02:02.535350+0000","last_became_active":"2024-08-26T00:00:29.366737+0000","last_became_peered":"2024-08-26T00:00:29.366737+0000","last_unstale":"2024-08-26T00:02:02.535350+0000","last_undegraded":"2024-08-26T00:02:02.535350+0000","last_fullsized":"2024-08-26T00:02:02.535350+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T06:00:54.461716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.593279+0000","last_change":"2024-08-26T00:00:27.078078+0000","last_active":"2024-08-26T00:01:33.593279+0000","last_peered":"2024-08-26T00:01:33.593279+0000","last_clean":"2024-08-26T00:01:33.593279+0000","last_became_active":"2024-08-26T00:00:27.077036+0000","last_became_peered":"2024-08-26T00:00:27.077036+0000","last_unstale":"2024-08-26T00:01:33.593279+0000","last_undegraded":"2024-08-26T00:01:33.593279+0000","last_fullsized":"2024-08-26T00:01:33.593279+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T09:47:44.674548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"80'5","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:02:02.525643+0000","last_change":"2024-08-26T00:00:29.363867+0000","last_active":"2024-08-26T00:02:02.525643+0000","last_peered":"2024-08-26T00:02:02.525643+0000","last_clean":"2024-08-26T00:02:02.525643+0000","last_became_active":"2024-08-26T00:00:29.363556+0000","last_became_peered":"2024-08-26T00:00:29.363556+0000","last_unstale":"2024-08-26T00:02:02.525643+0000","last_undegraded":"2024-08-26T00:02:02.525643+0000","last_fullsized":"2024-08-26T00:02:02.525643+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:28.323626+0000","last_clean_scrub_stamp":"2024-08-26T00:00:28.323626+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T00:50:04.009177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-26T00:01:33.600056+0000","last_change":"2024-08-26T00:00:26.990557+0000","last_active":"2024-08-26T00:01:33.600056+0000","last_peered":"2024-08-26T00:01:33.600056+0000","last_clean":"2024-08-26T00:01:33.600056+0000","last_became_active":"2024-08-26T00:00:26.989945+0000","last_became_peered":"2024-08-26T00:00:26.989945+0000","last_unstale":"2024-08-26T00:01:33.600056+0000","last_undegraded":"2024-08-26T00:01:33.600056+0000","last_fullsized":"2024-08-26T00:01:33.600056+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-26T00:00:25.969912+0000","last_clean_scrub_stamp":"2024-08-26T00:00:25.969912+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-27T03:26:54.388359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69940,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":695,"num_read_kb":423,"num_write":180,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":60637,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":209820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645350,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":426443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874282,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41048,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704104,"statfs":{"total":95995035648,"available":95953002496,"internally_reserved":0,"allocated":1581056,"data_stored":1084232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037808,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":426657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266742,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":426555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495674,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40960,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704192,"statfs":{"total":95995035648,"available":95953092608,"internally_reserved":0,"allocated":1490944,"data_stored":1018957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626495,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":884736,"data_stored":426046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855428,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28492,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716660,"statfs":{"total":95995035648,"available":95965859840,"internally_reserved":0,"allocated":1503232,"data_stored":1017800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018952,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":492813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247886,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":426357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444116,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":427189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40432,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704720,"statfs":{"total":95995035648,"available":95953633280,"internally_reserved":0,"allocated":950272,"data_stored":491328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":427317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-26T00:02:33.040 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:02:33.124 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:32 smithi042 ceph-mon[17225]: from='client.25082 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-26T00:02:33.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:32 smithi043 ceph-mon[22091]: from='client.25082 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-26T00:02:33.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:32 smithi181 ceph-mon[22102]: from='client.25082 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-26T00:02:33.451 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:02:34.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.144+0000 7fe6c2800640 1 -- 172.21.15.42:0/3224600639 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6bc0764c0 msgr2=0x7fe6bc0768a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:34.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.144+0000 7fe6c2800640 1 --2- 172.21.15.42:0/3224600639 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6bc0764c0 0x7fe6bc0768a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac009900 tx=0x7fe6ac02a3f0 comp rx=0 tx=0).stop 2024-08-26T00:02:34.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.144+0000 7fe6c2800640 1 -- 172.21.15.42:0/3224600639 shutdown_connections 2024-08-26T00:02:34.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.144+0000 7fe6c2800640 1 --2- 172.21.15.42:0/3224600639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6bc1127d0 0x7fe6bc114bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:34.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.144+0000 7fe6c2800640 1 --2- 172.21.15.42:0/3224600639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6bc076de0 0x7fe6bc112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:34.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.144+0000 7fe6c2800640 1 --2- 172.21.15.42:0/3224600639 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6bc0764c0 0x7fe6bc0768a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:34.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.144+0000 7fe6c2800640 1 -- 172.21.15.42:0/3224600639 >> 172.21.15.42:0/3224600639 conn(0x7fe6bc0ff830 msgr2=0x7fe6bc101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:34.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.144+0000 7fe6c2800640 1 -- 172.21.15.42:0/3224600639 shutdown_connections 2024-08-26T00:02:34.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.144+0000 7fe6c2800640 1 -- 172.21.15.42:0/3224600639 wait complete. 2024-08-26T00:02:34.147 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:33 smithi042 ceph-mon[17225]: pgmap v340: 97 pgs: 97 active+clean; 645 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 938 B/s wr, 8 op/s 2024-08-26T00:02:34.147 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:33 smithi042 ceph-mon[17225]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-26T00:02:34.147 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:33 smithi042 ceph-mon[17225]: from='client.25094 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-26T00:02:34.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.146+0000 7fe6c2800640 1 Processor -- start 2024-08-26T00:02:34.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.146+0000 7fe6c2800640 1 -- start start 2024-08-26T00:02:34.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.146+0000 7fe6c2800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6bc0764c0 0x7fe6bc1a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:34.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.146+0000 7fe6c2800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6bc076de0 0x7fe6bc1a4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:34.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.146+0000 7fe6c2800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6bc1127d0 0x7fe6bc19e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:34.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.146+0000 7fe6c2800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc1183b0 con 0x7fe6bc076de0 2024-08-26T00:02:34.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.146+0000 7fe6c2800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc118230 con 0x7fe6bc1127d0 2024-08-26T00:02:34.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.146+0000 7fe6c2800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc118530 con 0x7fe6bc0764c0 2024-08-26T00:02:34.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.146+0000 7fe6bb400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6bc0764c0 0x7fe6bc1a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:34.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.146+0000 7fe6bb400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6bc0764c0 0x7fe6bc1a4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:58060/0 (socket says 172.21.15.42:58060) 2024-08-26T00:02:34.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.147+0000 7fe6bb400640 1 -- 172.21.15.42:0/1630978910 learned_addr learned my addr 172.21.15.42:0/1630978910 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:34.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.146+0000 7fe6baa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6bc076de0 0x7fe6bc1a4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:34.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.147+0000 7fe6bbe00640 1 --2- 172.21.15.42:0/1630978910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6bc1127d0 0x7fe6bc19e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:34.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.147+0000 7fe6bbe00640 1 -- 172.21.15.42:0/1630978910 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6bc0764c0 msgr2=0x7fe6bc1a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:34.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.147+0000 7fe6bbe00640 1 --2- 172.21.15.42:0/1630978910 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6bc0764c0 0x7fe6bc1a4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:34.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.147+0000 7fe6bbe00640 1 -- 172.21.15.42:0/1630978910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6bc076de0 msgr2=0x7fe6bc1a4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:34.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.147+0000 7fe6bbe00640 1 --2- 172.21.15.42:0/1630978910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6bc076de0 0x7fe6bc1a4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:34.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.147+0000 7fe6bbe00640 1 -- 172.21.15.42:0/1630978910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6bc19ed40 con 0x7fe6bc1127d0 2024-08-26T00:02:34.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.147+0000 7fe6bbe00640 1 --2- 172.21.15.42:0/1630978910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6bc1127d0 0x7fe6bc19e610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc07a7b0 tx=0x7fe6b400edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:34.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.148+0000 7fe6b3e00640 1 -- 172.21.15.42:0/1630978910 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4004d20 con 0x7fe6bc1127d0 2024-08-26T00:02:34.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.148+0000 7fe6b3e00640 1 -- 172.21.15.42:0/1630978910 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6b4005020 con 0x7fe6bc1127d0 2024-08-26T00:02:34.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.148+0000 7fe6b3e00640 1 -- 172.21.15.42:0/1630978910 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b40116d0 con 0x7fe6bc1127d0 2024-08-26T00:02:34.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.148+0000 7fe6c2800640 1 -- 172.21.15.42:0/1630978910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6bc19f030 con 0x7fe6bc1127d0 2024-08-26T00:02:34.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.148+0000 7fe6c2800640 1 -- 172.21.15.42:0/1630978910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6bc1ab320 con 0x7fe6bc1127d0 2024-08-26T00:02:34.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.149+0000 7fe6c2800640 1 -- 172.21.15.42:0/1630978910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6bc0768a0 con 0x7fe6bc1127d0 2024-08-26T00:02:34.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.151+0000 7fe6b3e00640 1 -- 172.21.15.42:0/1630978910 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe6b4005540 con 0x7fe6bc1127d0 2024-08-26T00:02:34.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.152+0000 7fe6b3e00640 1 --2- 172.21.15.42:0/1630978910 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe6a00a2b80 0x7fe6a00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:34.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.153+0000 7fe6b3e00640 1 -- 172.21.15.42:0/1630978910 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fe6b40cf070 con 0x7fe6bc1127d0 2024-08-26T00:02:34.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.153+0000 7fe6bb400640 1 --2- 172.21.15.42:0/1630978910 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe6a00a2b80 0x7fe6a00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:34.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.153+0000 7fe6bb400640 1 --2- 172.21.15.42:0/1630978910 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe6a00a2b80 0x7fe6a00a5040 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac0096c0 tx=0x7fe6ac0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:34.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.157+0000 7fe6b3e00640 1 -- 172.21.15.42:0/1630978910 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe6b4016030 con 0x7fe6bc1127d0 2024-08-26T00:02:34.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:33 smithi043 ceph-mon[22091]: pgmap v340: 97 pgs: 97 active+clean; 645 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 938 B/s wr, 8 op/s 2024-08-26T00:02:34.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:33 smithi043 ceph-mon[22091]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-26T00:02:34.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:33 smithi043 ceph-mon[22091]: from='client.25094 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-26T00:02:34.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:33 smithi181 ceph-mon[22102]: pgmap v340: 97 pgs: 97 active+clean; 645 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 938 B/s wr, 8 op/s 2024-08-26T00:02:34.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:33 smithi181 ceph-mon[22102]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-26T00:02:34.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:33 smithi181 ceph-mon[22102]: from='client.25094 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-26T00:02:34.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.382+0000 7fe6c2800640 1 -- 172.21.15.42:0/1630978910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6bc19fb40 con 0x7fe6bc1127d0 2024-08-26T00:02:34.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.383+0000 7fe6b3e00640 1 -- 172.21.15.42:0/1630978910 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11909 (secure 0 0 0) 0x7fe6bc19fb40 con 0x7fe6bc1127d0 2024-08-26T00:02:34.385 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:02:34.385 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":24,"btime":"2024-08-26T00:02:28:193800+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3168581452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3168581452},{"type":"v1","addr":"172.21.15.42:6839","nonce":3168581452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/3533492491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":3533492491},{"type":"v1","addr":"172.21.15.42:6841","nonce":3533492491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-26T00:00:30.169633+0000","modified":"2024-08-26T00:02:27.753317+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24532,"mds_1":24527,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6839/2653014277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2653014277},{"type":"v1","addr":"172.21.15.43:6839","nonce":2653014277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24532,"qdb_cluster":[24532,24527,24514]},"id":1}]} 2024-08-26T00:02:34.385 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 24 2024-08-26T00:02:34.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.386+0000 7fe6c2800640 1 -- 172.21.15.42:0/1630978910 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe6a00a2b80 msgr2=0x7fe6a00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:34.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.386+0000 7fe6c2800640 1 --2- 172.21.15.42:0/1630978910 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe6a00a2b80 0x7fe6a00a5040 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac0096c0 tx=0x7fe6ac0046c0 comp rx=0 tx=0).stop 2024-08-26T00:02:34.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.386+0000 7fe6c2800640 1 -- 172.21.15.42:0/1630978910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6bc1127d0 msgr2=0x7fe6bc19e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:34.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.386+0000 7fe6c2800640 1 --2- 172.21.15.42:0/1630978910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6bc1127d0 0x7fe6bc19e610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc07a7b0 tx=0x7fe6b400edd0 comp rx=0 tx=0).stop 2024-08-26T00:02:34.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.386+0000 7fe6c2800640 1 -- 172.21.15.42:0/1630978910 shutdown_connections 2024-08-26T00:02:34.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.386+0000 7fe6c2800640 1 --2- 172.21.15.42:0/1630978910 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe6a00a2b80 0x7fe6a00a5040 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:34.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.386+0000 7fe6c2800640 1 --2- 172.21.15.42:0/1630978910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6bc1127d0 0x7fe6bc19e610 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:34.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.386+0000 7fe6c2800640 1 --2- 172.21.15.42:0/1630978910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6bc076de0 0x7fe6bc1a4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:34.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.386+0000 7fe6c2800640 1 --2- 172.21.15.42:0/1630978910 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6bc0764c0 0x7fe6bc1a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:34.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.386+0000 7fe6c2800640 1 -- 172.21.15.42:0/1630978910 >> 172.21.15.42:0/1630978910 conn(0x7fe6bc0ff830 msgr2=0x7fe6bc101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:34.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.386+0000 7fe6c2800640 1 -- 172.21.15.42:0/1630978910 shutdown_connections 2024-08-26T00:02:34.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:34.386+0000 7fe6c2800640 1 -- 172.21.15.42:0/1630978910 wait complete. 2024-08-26T00:02:35.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:34 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1630978910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:02:35.075 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd dump --format=json 2024-08-26T00:02:35.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:34 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1630978910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:02:35.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:34 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1630978910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:02:35.466 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:02:36.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.114+0000 7f9afb000640 1 -- 172.21.15.42:0/3612232229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9af4103b50 msgr2=0x7f9af4103fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:36.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.114+0000 7f9afb000640 1 --2- 172.21.15.42:0/3612232229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9af4103b50 0x7f9af4103fb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9adc009900 tx=0x7f9adc02a3f0 comp rx=0 tx=0).stop 2024-08-26T00:02:36.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.114+0000 7f9afb000640 1 -- 172.21.15.42:0/3612232229 shutdown_connections 2024-08-26T00:02:36.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.114+0000 7f9afb000640 1 --2- 172.21.15.42:0/3612232229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9af41044f0 0x7f9af41109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:36.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.114+0000 7f9afb000640 1 --2- 172.21.15.42:0/3612232229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9af4103b50 0x7f9af4103fb0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:36.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.114+0000 7f9afb000640 1 --2- 172.21.15.42:0/3612232229 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9af4109c00 0x7f9af4109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:36.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.114+0000 7f9afb000640 1 -- 172.21.15.42:0/3612232229 >> 172.21.15.42:0/3612232229 conn(0x7f9af40ff830 msgr2=0x7f9af4101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:36.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.114+0000 7f9afb000640 1 -- 172.21.15.42:0/3612232229 shutdown_connections 2024-08-26T00:02:36.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.114+0000 7f9afb000640 1 -- 172.21.15.42:0/3612232229 wait complete. 2024-08-26T00:02:36.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.115+0000 7f9afb000640 1 Processor -- start 2024-08-26T00:02:36.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.115+0000 7f9afb000640 1 -- start start 2024-08-26T00:02:36.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.115+0000 7f9afb000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9af4103b50 0x7f9af419a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:36.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.115+0000 7f9afb000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9af41044f0 0x7f9af419a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:36.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.115+0000 7f9afb000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9af4109c00 0x7f9af419ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:36.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.116+0000 7f9afb000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9af4113f60 con 0x7f9af41044f0 2024-08-26T00:02:36.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.116+0000 7f9afb000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9af4113de0 con 0x7f9af4103b50 2024-08-26T00:02:36.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.116+0000 7f9afb000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9af41140e0 con 0x7f9af4109c00 2024-08-26T00:02:36.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.116+0000 7f9aebe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9af41044f0 0x7f9af419a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:36.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.116+0000 7f9aebe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9af41044f0 0x7f9af419a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50566/0 (socket says 172.21.15.42:50566) 2024-08-26T00:02:36.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.116+0000 7f9aebe00640 1 -- 172.21.15.42:0/4086120690 learned_addr learned my addr 172.21.15.42:0/4086120690 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:36.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.116+0000 7f9af3e00640 1 --2- 172.21.15.42:0/4086120690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9af4103b50 0x7f9af419a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:36.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.116+0000 7f9af9000640 1 --2- 172.21.15.42:0/4086120690 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9af4109c00 0x7f9af419ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:36.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.116+0000 7f9af3e00640 1 -- 172.21.15.42:0/4086120690 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9af4109c00 msgr2=0x7f9af419ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:36.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.116+0000 7f9af3e00640 1 --2- 172.21.15.42:0/4086120690 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9af4109c00 0x7f9af419ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:36.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.116+0000 7f9af3e00640 1 -- 172.21.15.42:0/4086120690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9af41044f0 msgr2=0x7f9af419a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:36.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.116+0000 7f9af3e00640 1 --2- 172.21.15.42:0/4086120690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9af41044f0 0x7f9af419a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:36.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.116+0000 7f9af3e00640 1 -- 172.21.15.42:0/4086120690 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af419f2b0 con 0x7f9af4103b50 2024-08-26T00:02:36.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.116+0000 7f9aebe00640 1 --2- 172.21.15.42:0/4086120690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9af41044f0 0x7f9af419a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:36.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.117+0000 7f9af3e00640 1 --2- 172.21.15.42:0/4086120690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9af4103b50 0x7f9af419a300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400e9f0 tx=0x7f9ae400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:36.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.117+0000 7f9af1600640 1 -- 172.21.15.42:0/4086120690 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae400ccc0 con 0x7f9af4103b50 2024-08-26T00:02:36.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.117+0000 7f9af1600640 1 -- 172.21.15.42:0/4086120690 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ae4005020 con 0x7f9af4103b50 2024-08-26T00:02:36.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.117+0000 7f9af1600640 1 -- 172.21.15.42:0/4086120690 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae40049e0 con 0x7f9af4103b50 2024-08-26T00:02:36.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.117+0000 7f9afb000640 1 -- 172.21.15.42:0/4086120690 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af419f5a0 con 0x7f9af4103b50 2024-08-26T00:02:36.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.117+0000 7f9afb000640 1 -- 172.21.15.42:0/4086120690 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af41a6e80 con 0x7f9af4103b50 2024-08-26T00:02:36.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.118+0000 7f9afb000640 1 -- 172.21.15.42:0/4086120690 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af4103fb0 con 0x7f9af4103b50 2024-08-26T00:02:36.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.120+0000 7f9af1600640 1 -- 172.21.15.42:0/4086120690 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9ae4005560 con 0x7f9af4103b50 2024-08-26T00:02:36.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.121+0000 7f9af1600640 1 --2- 172.21.15.42:0/4086120690 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9ad80a2b80 0x7f9ad80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:36.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.121+0000 7f9af1600640 1 -- 172.21.15.42:0/4086120690 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f9ae40cefe0 con 0x7f9af4103b50 2024-08-26T00:02:36.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.121+0000 7f9aebe00640 1 --2- 172.21.15.42:0/4086120690 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9ad80a2b80 0x7f9ad80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:36.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.122+0000 7f9aebe00640 1 --2- 172.21.15.42:0/4086120690 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9ad80a2b80 0x7f9ad80a5040 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9adc005770 tx=0x7f9adc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:36.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.125+0000 7f9af1600640 1 -- 172.21.15.42:0/4086120690 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f9ae40051d0 con 0x7f9af4103b50 2024-08-26T00:02:36.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:35 smithi043 ceph-mon[22091]: pgmap v341: 97 pgs: 97 active+clean; 645 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 938 B/s wr, 6 op/s 2024-08-26T00:02:36.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:35 smithi042 ceph-mon[17225]: pgmap v341: 97 pgs: 97 active+clean; 645 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 938 B/s wr, 6 op/s 2024-08-26T00:02:36.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:35 smithi181 ceph-mon[22102]: pgmap v341: 97 pgs: 97 active+clean; 645 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 938 B/s wr, 6 op/s 2024-08-26T00:02:36.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.312+0000 7f9afb000640 1 -- 172.21.15.42:0/4086120690 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9af41a7080 con 0x7f9af4103b50 2024-08-26T00:02:36.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.314+0000 7f9af1600640 1 -- 172.21.15.42:0/4086120690 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22625 (secure 0 0 0) 0x7f9ae409bf20 con 0x7f9af4103b50 2024-08-26T00:02:36.316 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:02:36.316 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":80,"fsid":"f89d317a-633c-11ef-bcd2-c7b262605968","created":"2024-08-25T23:52:39.598509+0000","modified":"2024-08-26T00:01:33.588911+0000","last_up_change":"2024-08-25T23:59:35.047575+0000","last_in_change":"2024-08-25T23:59:12.796940+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-25T23:55:51.022219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-26T00:00:25.606536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-26T00:00:28.322822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"980d8635-bca1-4c5a-b78e-4b44f9315d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6803","nonce":2657450248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6805","nonce":2657450248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6809","nonce":2657450248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6807","nonce":2657450248}]},"public_addr":"172.21.15.42:6803/2657450248","cluster_addr":"172.21.15.42:6805/2657450248","heartbeat_back_addr":"172.21.15.42:6809/2657450248","heartbeat_front_addr":"172.21.15.42:6807/2657450248","state":["exists","up"]},{"osd":1,"uuid":"e5f8dc3b-876a-4bdd-b6b0-b0d99d098d95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6801","nonce":2396081001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6803","nonce":2396081001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6807","nonce":2396081001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6805","nonce":2396081001}]},"public_addr":"172.21.15.43:6801/2396081001","cluster_addr":"172.21.15.43:6803/2396081001","heartbeat_back_addr":"172.21.15.43:6807/2396081001","heartbeat_front_addr":"172.21.15.43:6805/2396081001","state":["exists","up"]},{"osd":2,"uuid":"06eb25af-8e3d-4f90-bc24-28a9bc224c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6801","nonce":189987070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6803","nonce":189987070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6807","nonce":189987070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6805","nonce":189987070}]},"public_addr":"172.21.15.181:6801/189987070","cluster_addr":"172.21.15.181:6803/189987070","heartbeat_back_addr":"172.21.15.181:6807/189987070","heartbeat_front_addr":"172.21.15.181:6805/189987070","state":["exists","up"]},{"osd":3,"uuid":"c78dbc49-b5c7-4f82-be36-c76a89496520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6811","nonce":251017896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6813","nonce":251017896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6817","nonce":251017896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6815","nonce":251017896}]},"public_addr":"172.21.15.42:6811/251017896","cluster_addr":"172.21.15.42:6813/251017896","heartbeat_back_addr":"172.21.15.42:6817/251017896","heartbeat_front_addr":"172.21.15.42:6815/251017896","state":["exists","up"]},{"osd":4,"uuid":"ba633f66-25af-492f-bbf2-76032a4cd3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6809","nonce":1315420796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6811","nonce":1315420796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6815","nonce":1315420796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6813","nonce":1315420796}]},"public_addr":"172.21.15.43:6809/1315420796","cluster_addr":"172.21.15.43:6811/1315420796","heartbeat_back_addr":"172.21.15.43:6815/1315420796","heartbeat_front_addr":"172.21.15.43:6813/1315420796","state":["exists","up"]},{"osd":5,"uuid":"04e47ad9-21ba-43da-9793-d5cf83150dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6809","nonce":246971403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6811","nonce":246971403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6815","nonce":246971403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6813","nonce":246971403}]},"public_addr":"172.21.15.181:6809/246971403","cluster_addr":"172.21.15.181:6811/246971403","heartbeat_back_addr":"172.21.15.181:6815/246971403","heartbeat_front_addr":"172.21.15.181:6813/246971403","state":["exists","up"]},{"osd":6,"uuid":"f48161cd-bc44-4d99-8248-1bb845111129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6819","nonce":2910656480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6821","nonce":2910656480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6825","nonce":2910656480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6823","nonce":2910656480}]},"public_addr":"172.21.15.42:6819/2910656480","cluster_addr":"172.21.15.42:6821/2910656480","heartbeat_back_addr":"172.21.15.42:6825/2910656480","heartbeat_front_addr":"172.21.15.42:6823/2910656480","state":["exists","up"]},{"osd":7,"uuid":"65470b06-b14d-4d8e-9bcb-e6927c37fda5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6817","nonce":624542778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6819","nonce":624542778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6823","nonce":624542778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6821","nonce":624542778}]},"public_addr":"172.21.15.43:6817/624542778","cluster_addr":"172.21.15.43:6819/624542778","heartbeat_back_addr":"172.21.15.43:6823/624542778","heartbeat_front_addr":"172.21.15.43:6821/624542778","state":["exists","up"]},{"osd":8,"uuid":"1f4c9152-4b7c-415f-9cb9-d1e926fad5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6817","nonce":728226568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6819","nonce":728226568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6823","nonce":728226568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6821","nonce":728226568}]},"public_addr":"172.21.15.181:6817/728226568","cluster_addr":"172.21.15.181:6819/728226568","heartbeat_back_addr":"172.21.15.181:6823/728226568","heartbeat_front_addr":"172.21.15.181:6821/728226568","state":["exists","up"]},{"osd":9,"uuid":"fb387fbe-19b4-4a3e-8e40-81bd1363b55c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6827","nonce":1052069444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6829","nonce":1052069444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6833","nonce":1052069444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6831","nonce":1052069444}]},"public_addr":"172.21.15.42:6827/1052069444","cluster_addr":"172.21.15.42:6829/1052069444","heartbeat_back_addr":"172.21.15.42:6833/1052069444","heartbeat_front_addr":"172.21.15.42:6831/1052069444","state":["exists","up"]},{"osd":10,"uuid":"fe5bbeec-2341-4ea9-97ab-cc45d738d741","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6825","nonce":3417487386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6827","nonce":3417487386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6831","nonce":3417487386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6829","nonce":3417487386}]},"public_addr":"172.21.15.43:6825/3417487386","cluster_addr":"172.21.15.43:6827/3417487386","heartbeat_back_addr":"172.21.15.43:6831/3417487386","heartbeat_front_addr":"172.21.15.43:6829/3417487386","state":["exists","up"]},{"osd":11,"uuid":"cee07741-3ab7-481e-8477-54319f4f178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6825","nonce":3817502913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6827","nonce":3817502913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6831","nonce":3817502913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6829","nonce":3817502913}]},"public_addr":"172.21.15.181:6825/3817502913","cluster_addr":"172.21.15.181:6827/3817502913","heartbeat_back_addr":"172.21.15.181:6831/3817502913","heartbeat_front_addr":"172.21.15.181:6829/3817502913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:00.603592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:24.637326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:47.587859+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:14.978783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:39.025819+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:01.965471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:29.753475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:54.162377+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:17.970871+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:46.175576+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:10.590220+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:33.216701+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/3711239085":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6801/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2983166615":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/2974122891":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2980210051":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/4227793902":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6801/1517739376":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6800/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/1775009918":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6800/1517739376":"2024-08-26T23:53:05.122858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-26T00:02:36.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.316+0000 7f9afb000640 1 -- 172.21.15.42:0/4086120690 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9ad80a2b80 msgr2=0x7f9ad80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:36.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.316+0000 7f9afb000640 1 --2- 172.21.15.42:0/4086120690 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9ad80a2b80 0x7f9ad80a5040 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9adc005770 tx=0x7f9adc005a20 comp rx=0 tx=0).stop 2024-08-26T00:02:36.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.316+0000 7f9afb000640 1 -- 172.21.15.42:0/4086120690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9af4103b50 msgr2=0x7f9af419a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:36.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.316+0000 7f9afb000640 1 --2- 172.21.15.42:0/4086120690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9af4103b50 0x7f9af419a300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400e9f0 tx=0x7f9ae400eeb0 comp rx=0 tx=0).stop 2024-08-26T00:02:36.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.316+0000 7f9afb000640 1 -- 172.21.15.42:0/4086120690 shutdown_connections 2024-08-26T00:02:36.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.316+0000 7f9afb000640 1 --2- 172.21.15.42:0/4086120690 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9ad80a2b80 0x7f9ad80a5040 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:36.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.316+0000 7f9afb000640 1 --2- 172.21.15.42:0/4086120690 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9af4109c00 0x7f9af419ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:36.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.316+0000 7f9afb000640 1 --2- 172.21.15.42:0/4086120690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9af41044f0 0x7f9af419a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:36.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.316+0000 7f9afb000640 1 --2- 172.21.15.42:0/4086120690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9af4103b50 0x7f9af419a300 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:36.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.316+0000 7f9afb000640 1 -- 172.21.15.42:0/4086120690 >> 172.21.15.42:0/4086120690 conn(0x7f9af40ff830 msgr2=0x7f9af4100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:36.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.317+0000 7f9afb000640 1 -- 172.21.15.42:0/4086120690 shutdown_connections 2024-08-26T00:02:36.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:36.317+0000 7f9afb000640 1 -- 172.21.15.42:0/4086120690 wait complete. 2024-08-26T00:02:36.988 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:36 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/4086120690' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:02:37.024 DEBUG:tasks.fwd_scrub:Yielding 2024-08-26T00:02:37.025 INFO:teuthology.run_tasks:Running task workunit... 2024-08-26T00:02:37.038 INFO:tasks.workunit:Pulling workunits from ref f273685f88d22802ccbd8a96b393734630028a13 2024-08-26T00:02:37.038 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-26T00:02:37.038 INFO:tasks.workunit:timeout=3h 2024-08-26T00:02:37.038 INFO:tasks.workunit:cleanup=True 2024-08-26T00:02:37.038 DEBUG:teuthology.orchestra.run.smithi042:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-26T00:02:37.039 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-08-26T00:02:37.039 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-26T00:02:37.039 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-26T00:02:37.075 INFO:teuthology.orchestra.run.smithi042.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-08-26T00:02:37.075 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-08-26T00:02:37.075 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-08-26T00:02:37.075 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-26T00:02:37.075 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-08-26T00:02:37.075 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-08-26 00:00:50.203433016 +0000 2024-08-26T00:02:37.075 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-08-26 00:00:50.203433016 +0000 2024-08-26T00:02:37.075 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-08-26 00:02:26.873930915 +0000 2024-08-26T00:02:37.076 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-08-26 00:00:50.203433016 +0000 2024-08-26T00:02:37.076 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-08-26T00:02:37.076 DEBUG:teuthology.orchestra.run.smithi042:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-08-26T00:02:37.185 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f273685f88d22802ccbd8a96b393734630028a13 2024-08-26T00:02:37.224 INFO:tasks.workunit.client.0.smithi042.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-26T00:02:37.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:36 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/4086120690' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:02:37.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:36 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/4086120690' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:02:37.440 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:02:38.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.034+0000 7fdb73c00640 1 -- 172.21.15.42:0/2706050386 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb6c1022d0 msgr2=0x7fdb6c10e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:38.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.034+0000 7fdb73c00640 1 --2- 172.21.15.42:0/2706050386 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb6c1022d0 0x7fdb6c10e800 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdb64009cd0 tx=0x7fdb6402a8f0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.034+0000 7fdb73c00640 1 -- 172.21.15.42:0/2706050386 shutdown_connections 2024-08-26T00:02:38.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.034+0000 7fdb73c00640 1 --2- 172.21.15.42:0/2706050386 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb6c1022d0 0x7fdb6c10e800 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.034+0000 7fdb73c00640 1 --2- 172.21.15.42:0/2706050386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb6c101930 0x7fdb6c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.034+0000 7fdb73c00640 1 --2- 172.21.15.42:0/2706050386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb6c107930 0x7fdb6c107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.034+0000 7fdb73c00640 1 -- 172.21.15.42:0/2706050386 >> 172.21.15.42:0/2706050386 conn(0x7fdb6c0fd650 msgr2=0x7fdb6c0ffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:38.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.034+0000 7fdb73c00640 1 -- 172.21.15.42:0/2706050386 shutdown_connections 2024-08-26T00:02:38.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.034+0000 7fdb73c00640 1 -- 172.21.15.42:0/2706050386 wait complete. 2024-08-26T00:02:38.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.035+0000 7fdb73c00640 1 Processor -- start 2024-08-26T00:02:38.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.035+0000 7fdb73c00640 1 -- start start 2024-08-26T00:02:38.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.036+0000 7fdb73c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb6c101930 0x7fdb6c19a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:38.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.036+0000 7fdb73c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb6c1022d0 0x7fdb6c19a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:38.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.036+0000 7fdb73c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb6c107930 0x7fdb6c19ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:38.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.036+0000 7fdb73c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c111d80 con 0x7fdb6c101930 2024-08-26T00:02:38.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.036+0000 7fdb73c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c111c00 con 0x7fdb6c1022d0 2024-08-26T00:02:38.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.036+0000 7fdb73c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c111f00 con 0x7fdb6c107930 2024-08-26T00:02:38.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.036+0000 7fdb71200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb6c101930 0x7fdb6c19a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:38.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.036+0000 7fdb71200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb6c101930 0x7fdb6c19a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50574/0 (socket says 172.21.15.42:50574) 2024-08-26T00:02:38.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.036+0000 7fdb71200640 1 -- 172.21.15.42:0/1122507029 learned_addr learned my addr 172.21.15.42:0/1122507029 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:38.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.036+0000 7fdb6be00640 1 --2- 172.21.15.42:0/1122507029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb6c1022d0 0x7fdb6c19a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:38.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.036+0000 7fdb71c00640 1 --2- 172.21.15.42:0/1122507029 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb6c107930 0x7fdb6c19ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:38.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.036+0000 7fdb71200640 1 -- 172.21.15.42:0/1122507029 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb6c107930 msgr2=0x7fdb6c19ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:38.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.036+0000 7fdb71200640 1 --2- 172.21.15.42:0/1122507029 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb6c107930 0x7fdb6c19ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.036+0000 7fdb71200640 1 -- 172.21.15.42:0/1122507029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb6c1022d0 msgr2=0x7fdb6c19a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:38.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.036+0000 7fdb71200640 1 --2- 172.21.15.42:0/1122507029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb6c1022d0 0x7fdb6c19a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.037+0000 7fdb71200640 1 -- 172.21.15.42:0/1122507029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb6c19f310 con 0x7fdb6c101930 2024-08-26T00:02:38.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.037+0000 7fdb71200640 1 --2- 172.21.15.42:0/1122507029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb6c101930 0x7fdb6c19a360 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000e9f0 tx=0x7fdb6000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:38.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.037+0000 7fdb69600640 1 -- 172.21.15.42:0/1122507029 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6000cd80 con 0x7fdb6c101930 2024-08-26T00:02:38.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.037+0000 7fdb69600640 1 -- 172.21.15.42:0/1122507029 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb60010910 con 0x7fdb6c101930 2024-08-26T00:02:38.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.037+0000 7fdb73c00640 1 -- 172.21.15.42:0/1122507029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb6c19f600 con 0x7fdb6c101930 2024-08-26T00:02:38.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.037+0000 7fdb69600640 1 -- 172.21.15.42:0/1122507029 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb60018990 con 0x7fdb6c101930 2024-08-26T00:02:38.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.037+0000 7fdb73c00640 1 -- 172.21.15.42:0/1122507029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb6c1a6ee0 con 0x7fdb6c101930 2024-08-26T00:02:38.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.041+0000 7fdb7683b740 1 Processor -- start 2024-08-26T00:02:38.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.042+0000 7fdb7683b740 1 -- start start 2024-08-26T00:02:38.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.042+0000 7fdb69600640 1 -- 172.21.15.42:0/1122507029 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdb60010ac0 con 0x7fdb6c101930 2024-08-26T00:02:38.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.042+0000 7fdb7683b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16ee2d30 0x55ba16ee3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:38.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.042+0000 7fdb7683b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba16ee3650 0x55ba16eed9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:38.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.042+0000 7fdb7683b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16eedf10 0x55ba16ef0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:38.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.042+0000 7fdb7683b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ba16e49e30 con 0x55ba16eedf10 2024-08-26T00:02:38.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.042+0000 7fdb7683b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ba16de13c0 con 0x55ba16ee3650 2024-08-26T00:02:38.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.042+0000 7fdb7683b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ba16e45df0 con 0x55ba16ee2d30 2024-08-26T00:02:38.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.042+0000 7fdb71c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16ee2d30 0x55ba16ee3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:38.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.042+0000 7fdb71200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba16ee3650 0x55ba16eed9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:38.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.042+0000 7fdb71c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16ee2d30 0x55ba16ee3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:56350/0 (socket says 172.21.15.42:56350) 2024-08-26T00:02:38.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.042+0000 7fdb71c00640 1 -- 172.21.15.42:0/3086270740 learned_addr learned my addr 172.21.15.42:0/3086270740 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:38.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.043+0000 7fdb6be00640 1 --2- 172.21.15.42:0/3086270740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16eedf10 0x55ba16ef0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:38.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.043+0000 7fdb71c00640 1 -- 172.21.15.42:0/3086270740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba16ee3650 msgr2=0x55ba16eed9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:38.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.043+0000 7fdb71c00640 1 --2- 172.21.15.42:0/3086270740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba16ee3650 0x55ba16eed9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.043+0000 7fdb71c00640 1 -- 172.21.15.42:0/3086270740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16eedf10 msgr2=0x55ba16ef0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:38.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.043+0000 7fdb71c00640 1 --2- 172.21.15.42:0/3086270740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16eedf10 0x55ba16ef0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.043+0000 7fdb71c00640 1 -- 172.21.15.42:0/3086270740 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba16bbb6a0 con 0x55ba16ee2d30 2024-08-26T00:02:38.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.043+0000 7fdb6be00640 1 --2- 172.21.15.42:0/3086270740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16eedf10 0x55ba16ef0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:02:38.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.043+0000 7fdb71200640 1 --2- 172.21.15.42:0/3086270740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba16ee3650 0x55ba16eed9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:38.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.044+0000 7fdb71c00640 1 --2- 172.21.15.42:0/3086270740 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16ee2d30 0x55ba16ee3110 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdb64035000 tx=0x7fdb640303a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b3e87f3bfa74142 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:38.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.044+0000 7fdb69600640 1 --2- 172.21.15.42:0/1122507029 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fdb540a2c00 0x7fdb540a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:38.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.044+0000 7fdb5e000640 1 -- 172.21.15.42:0/3086270740 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb64030740 con 0x55ba16ee2d30 2024-08-26T00:02:38.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.044+0000 7fdb5e000640 1 -- 172.21.15.42:0/3086270740 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb64036040 con 0x55ba16ee2d30 2024-08-26T00:02:38.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.044+0000 7fdb5e000640 1 -- 172.21.15.42:0/3086270740 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb640043a0 con 0x55ba16ee2d30 2024-08-26T00:02:38.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.044+0000 7fdb69600640 1 -- 172.21.15.42:0/1122507029 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fdb600cf2c0 con 0x7fdb6c101930 2024-08-26T00:02:38.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.044+0000 7fdb71200640 1 --2- 172.21.15.42:0/1122507029 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fdb540a2c00 0x7fdb540a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:38.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.045+0000 7fdb7683b740 1 -- 172.21.15.42:0/3086270740 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16ee2d30 msgr2=0x55ba16ee3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:38.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.045+0000 7fdb7683b740 1 --2- 172.21.15.42:0/3086270740 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16ee2d30 0x55ba16ee3110 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdb64035000 tx=0x7fdb640303a0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.045+0000 7fdb7683b740 1 -- 172.21.15.42:0/3086270740 shutdown_connections 2024-08-26T00:02:38.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.045+0000 7fdb7683b740 1 --2- 172.21.15.42:0/3086270740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16eedf10 0x55ba16ef0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.045+0000 7fdb7683b740 1 --2- 172.21.15.42:0/3086270740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba16ee3650 0x55ba16eed9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.045+0000 7fdb7683b740 1 --2- 172.21.15.42:0/3086270740 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16ee2d30 0x55ba16ee3110 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.045+0000 7fdb7683b740 1 -- 172.21.15.42:0/3086270740 >> 172.21.15.42:0/3086270740 conn(0x55ba16edf2c0 msgr2=0x55ba16edf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:38.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.045+0000 7fdb71200640 1 --2- 172.21.15.42:0/1122507029 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fdb540a2c00 0x7fdb540a50c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdb6009b820 tx=0x7fdb600d2d40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:38.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.045+0000 7fdb7683b740 1 -- 172.21.15.42:0/3086270740 shutdown_connections 2024-08-26T00:02:38.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.045+0000 7fdb7683b740 1 -- 172.21.15.42:0/3086270740 wait complete. 2024-08-26T00:02:38.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.046+0000 7fdb7683b740 1 -- start start 2024-08-26T00:02:38.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.046+0000 7fdb7683b740 1 Processor -- start 2024-08-26T00:02:38.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.047+0000 7fdb7683b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16ee2d30 0x55ba16eeae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:38.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.047+0000 7fdb7683b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba16ee3650 0x55ba16eeb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:38.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.047+0000 7fdb7683b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16eedf10 0x55ba16eeb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:38.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.047+0000 7fdb7683b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ba16ef0ae0 con 0x55ba16ee2d30 2024-08-26T00:02:38.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.047+0000 7fdb7683b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ba16e04c30 con 0x55ba16ee3650 2024-08-26T00:02:38.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.047+0000 7fdb7683b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ba16ef0c60 con 0x55ba16eedf10 2024-08-26T00:02:38.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.047+0000 7fdb7683b740 10 client.0 _ll_register_callbacks cb 0x55ba16b58ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:02:38.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.047+0000 7fdb71c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16ee2d30 0x55ba16eeae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:38.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.047+0000 7fdb6be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba16ee3650 0x55ba16eeb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:38.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.047+0000 7fdb71c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16ee2d30 0x55ba16eeae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50602/0 (socket says 172.21.15.42:50602) 2024-08-26T00:02:38.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.047+0000 7fdb71c00640 1 -- 172.21.15.42:0/693101221 learned_addr learned my addr 172.21.15.42:0/693101221 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:38.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.047+0000 7fdb71c00640 1 --2- 172.21.15.42:0/693101221 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16eedf10 0x55ba16eeb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:38.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.047+0000 7fdb6be00640 1 -- 172.21.15.42:0/693101221 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16eedf10 msgr2=0x55ba16eeb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:38.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.047+0000 7fdb6be00640 1 --2- 172.21.15.42:0/693101221 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16eedf10 0x55ba16eeb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.047+0000 7fdb6be00640 1 -- 172.21.15.42:0/693101221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16ee2d30 msgr2=0x55ba16eeae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:38.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.047+0000 7fdb6be00640 1 --2- 172.21.15.42:0/693101221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16ee2d30 0x55ba16eeae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.047+0000 7fdb6be00640 1 -- 172.21.15.42:0/693101221 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba16e10dd0 con 0x55ba16ee3650 2024-08-26T00:02:38.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.048+0000 7fdb6be00640 1 --2- 172.21.15.42:0/693101221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba16ee3650 0x55ba16eeb370 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c10ec20 tx=0x7fdb5800bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=631306ee600d78aa server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:38.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.048+0000 7fdb52a00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:02:38.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.048+0000 7fdb52a00640 1 -- 172.21.15.42:0/693101221 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5801b640 con 0x55ba16ee3650 2024-08-26T00:02:38.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.048+0000 7fdb52a00640 1 -- 172.21.15.42:0/693101221 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fdb58011440 con 0x55ba16ee3650 2024-08-26T00:02:38.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.048+0000 7fdb7683b740 1 -- 172.21.15.42:0/693101221 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb64036040 con 0x55ba16ee3650 2024-08-26T00:02:38.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.048+0000 7fdb52a00640 1 -- 172.21.15.42:0/693101221 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdb5801b7e0 con 0x55ba16ee3650 2024-08-26T00:02:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.048+0000 7fdb7683b740 10 client.25118 fetch_fsmap learned FSMap version 24 2024-08-26T00:02:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.048+0000 7fdb7683b740 1 -- 172.21.15.42:0/693101221 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ba16efc7d0 con 0x55ba16ee3650 2024-08-26T00:02:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.049+0000 7fdb52a00640 1 -- 172.21.15.42:0/693101221 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb64036040 con 0x55ba16ee3650 2024-08-26T00:02:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.049+0000 7fdb52a00640 1 -- 172.21.15.42:0/693101221 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdb58019020 con 0x55ba16ee3650 2024-08-26T00:02:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.049+0000 7fdb7683b740 10 client.25118 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:02:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.049+0000 7fdb7683b740 10 client.25118 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:02:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.049+0000 7fdb7683b740 20 client.25118 populate_metadata read hostname 'smithi042' 2024-08-26T00:02:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.049+0000 7fdb7683b740 1 --2- 172.21.15.42:0/693101221 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55ba16efdc90 0x55ba16f00080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.049+0000 7fdb7683b740 4 client.25118 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:02:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.049+0000 7fdb7683b740 1 -- 172.21.15.42:0/693101221 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba16e573a0 con 0x55ba16efdc90 2024-08-26T00:02:38.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.049+0000 7fdb71c00640 1 --2- 172.21.15.42:0/693101221 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55ba16efdc90 0x55ba16f00080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.050+0000 7fdb71c00640 1 --2- 172.21.15.42:0/693101221 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55ba16efdc90 0x55ba16f00080 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ae9b1a1dd74a2ae server_cookie=59e635d1ca176784 in_seq=0 out_seq=0 2024-08-26T00:02:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.050+0000 7fdb52a00640 10 client.25118 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:02:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.051+0000 7fdb52a00640 1 -- 172.21.15.42:0/693101221 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ba16e573a0 con 0x55ba16efdc90 2024-08-26T00:02:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.051+0000 7fdb52a00640 10 client.25118 handle_command_reply: tid=0 2024-08-26T00:02:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.051+0000 7fdb7683b740 1 client.25118 shutdown 2024-08-26T00:02:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.051+0000 7fdb7683b740 1 -- 172.21.15.42:0/693101221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba16ee3650 msgr2=0x55ba16eeb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.051+0000 7fdb7683b740 1 --2- 172.21.15.42:0/693101221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba16ee3650 0x55ba16eeb370 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c10ec20 tx=0x7fdb5800bf00 comp rx=0 tx=0).stop 2024-08-26T00:02:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.051+0000 7fdb7683b740 1 -- 172.21.15.42:0/693101221 shutdown_connections 2024-08-26T00:02:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.051+0000 7fdb7683b740 1 --2- 172.21.15.42:0/693101221 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16eedf10 0x55ba16eeb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.051+0000 7fdb7683b740 1 --2- 172.21.15.42:0/693101221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba16ee3650 0x55ba16eeb370 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.051+0000 7fdb7683b740 1 --2- 172.21.15.42:0/693101221 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55ba16efdc90 0x55ba16f00080 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.051+0000 7fdb7683b740 1 --2- 172.21.15.42:0/693101221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16ee2d30 0x55ba16eeae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.051+0000 7fdb7683b740 1 -- 172.21.15.42:0/693101221 >> 172.21.15.42:0/693101221 conn(0x55ba16edf2c0 msgr2=0x55ba16ee4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:38.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.051+0000 7fdb52a00640 0 client.25118 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:02:38.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.051+0000 7fdb7683b740 1 -- 172.21.15.42:0/693101221 shutdown_connections 2024-08-26T00:02:38.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.051+0000 7fdb7683b740 1 -- 172.21.15.42:0/693101221 wait complete. 2024-08-26T00:02:38.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.051+0000 7fdb7683b740 20 client.25118 trim_cache size 0 max 16384 2024-08-26T00:02:38.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.070+0000 7fdb7683b740 1 Processor -- start 2024-08-26T00:02:38.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.070+0000 7fdb7683b740 1 -- start start 2024-08-26T00:02:38.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.070+0000 7fdb7683b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16ee2d30 0x55ba16f05990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:38.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.070+0000 7fdb7683b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba16ee3650 0x55ba16f05ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:38.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.070+0000 7fdb7683b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16eedf10 0x55ba16ee80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.070+0000 7fdb7683b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c1b1e60 con 0x55ba16ee2d30 2024-08-26T00:02:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.070+0000 7fdb7683b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c1af730 con 0x55ba16ee3650 2024-08-26T00:02:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.070+0000 7fdb7683b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c1ad560 con 0x55ba16eedf10 2024-08-26T00:02:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.070+0000 7fdb71c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16ee2d30 0x55ba16f05990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.070+0000 7fdb71c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16ee2d30 0x55ba16f05990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50610/0 (socket says 172.21.15.42:50610) 2024-08-26T00:02:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.070+0000 7fdb71c00640 1 -- 172.21.15.42:0/1780267005 learned_addr learned my addr 172.21.15.42:0/1780267005 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.071+0000 7fdb6be00640 1 --2- 172.21.15.42:0/1780267005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba16ee3650 0x55ba16f05ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.071+0000 7fdb71c00640 1 --2- 172.21.15.42:0/1780267005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16eedf10 0x55ba16ee80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.071+0000 7fdb6be00640 1 -- 172.21.15.42:0/1780267005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16eedf10 msgr2=0x55ba16ee80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.071+0000 7fdb6be00640 1 --2- 172.21.15.42:0/1780267005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16eedf10 0x55ba16ee80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.071+0000 7fdb6be00640 1 -- 172.21.15.42:0/1780267005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16ee2d30 msgr2=0x55ba16f05990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.071+0000 7fdb6be00640 1 --2- 172.21.15.42:0/1780267005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16ee2d30 0x55ba16f05990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.071+0000 7fdb6be00640 1 -- 172.21.15.42:0/1780267005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba16ee9de0 con 0x55ba16ee3650 2024-08-26T00:02:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.071+0000 7fdb71c00640 1 --2- 172.21.15.42:0/1780267005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16eedf10 0x55ba16ee80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:02:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.071+0000 7fdb6be00640 1 --2- 172.21.15.42:0/1780267005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba16ee3650 0x55ba16f05ed0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdb58000c00 tx=0x7fdb58003ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73017c7c81236fb3 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.071+0000 7fdb5d600640 1 -- 172.21.15.42:0/1780267005 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb580039c0 con 0x55ba16ee3650 2024-08-26T00:02:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.071+0000 7fdb5d600640 1 -- 172.21.15.42:0/1780267005 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb5802a070 con 0x55ba16ee3650 2024-08-26T00:02:38.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.071+0000 7fdb5d600640 1 -- 172.21.15.42:0/1780267005 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb580118b0 con 0x55ba16ee3650 2024-08-26T00:02:38.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.072+0000 7fdb7683b740 1 -- 172.21.15.42:0/1780267005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba16ee3650 msgr2=0x55ba16f05ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:38.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.072+0000 7fdb7683b740 1 --2- 172.21.15.42:0/1780267005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba16ee3650 0x55ba16f05ed0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdb58000c00 tx=0x7fdb58003ea0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.072+0000 7fdb7683b740 1 -- 172.21.15.42:0/1780267005 shutdown_connections 2024-08-26T00:02:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.072+0000 7fdb7683b740 1 --2- 172.21.15.42:0/1780267005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16eedf10 0x55ba16ee80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.072+0000 7fdb7683b740 1 --2- 172.21.15.42:0/1780267005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba16ee3650 0x55ba16f05ed0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.072+0000 7fdb7683b740 1 --2- 172.21.15.42:0/1780267005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16ee2d30 0x55ba16f05990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.072+0000 7fdb7683b740 1 -- 172.21.15.42:0/1780267005 >> 172.21.15.42:0/1780267005 conn(0x55ba16edf2c0 msgr2=0x55ba16eecda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.072+0000 7fdb7683b740 1 -- 172.21.15.42:0/1780267005 shutdown_connections 2024-08-26T00:02:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.072+0000 7fdb7683b740 1 -- 172.21.15.42:0/1780267005 wait complete. 2024-08-26T00:02:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.073+0000 7fdb7683b740 1 -- start start 2024-08-26T00:02:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.073+0000 7fdb7683b740 1 Processor -- start 2024-08-26T00:02:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.073+0000 7fdb7683b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16ee2d30 0x55ba16ef6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.073+0000 7fdb7683b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16ee3650 0x55ba16ef65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.074+0000 7fdb7683b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba16eedf10 0x55ba16ef2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.074+0000 7fdb7683b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c1adbf0 con 0x55ba16ee3650 2024-08-26T00:02:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.074+0000 7fdb7683b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c1af060 con 0x55ba16eedf10 2024-08-26T00:02:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.074+0000 7fdb7683b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c1ae2c0 con 0x55ba16ee2d30 2024-08-26T00:02:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.074+0000 7fdb7683b740 10 client.0 _ll_register_callbacks cb 0x7fdb58004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:02:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.074+0000 7fdb6be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16ee3650 0x55ba16ef65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.074+0000 7fdb6be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16ee3650 0x55ba16ef65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50622/0 (socket says 172.21.15.42:50622) 2024-08-26T00:02:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.074+0000 7fdb6be00640 1 -- 172.21.15.42:0/703810542 learned_addr learned my addr 172.21.15.42:0/703810542 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:38.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.074+0000 7fdb71c00640 1 --2- 172.21.15.42:0/703810542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba16eedf10 0x55ba16ef2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:38.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.074+0000 7fdb71c00640 1 --2- 172.21.15.42:0/703810542 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16ee2d30 0x55ba16ef6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:38.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.074+0000 7fdb6be00640 1 -- 172.21.15.42:0/703810542 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16ee2d30 msgr2=0x55ba16ef6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:38.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.074+0000 7fdb6be00640 1 --2- 172.21.15.42:0/703810542 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16ee2d30 0x55ba16ef6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.074+0000 7fdb6be00640 1 -- 172.21.15.42:0/703810542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba16eedf10 msgr2=0x55ba16ef2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:38.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.074+0000 7fdb6be00640 1 --2- 172.21.15.42:0/703810542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba16eedf10 0x55ba16ef2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.074+0000 7fdb6be00640 1 -- 172.21.15.42:0/703810542 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba16ee5ce0 con 0x55ba16ee3650 2024-08-26T00:02:38.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.074+0000 7fdb71c00640 1 --2- 172.21.15.42:0/703810542 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16ee2d30 0x55ba16ef6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:02:38.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.075+0000 7fdb6be00640 1 --2- 172.21.15.42:0/703810542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16ee3650 0x55ba16ef65d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdb5800bf40 tx=0x7fdb5801bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555e5177f0f866b server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:38.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.075+0000 7fdb52a00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:02:38.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.075+0000 7fdb52a00640 1 -- 172.21.15.42:0/703810542 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb58011440 con 0x55ba16ee3650 2024-08-26T00:02:38.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.075+0000 7fdb7683b740 1 -- 172.21.15.42:0/703810542 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb5802a070 con 0x55ba16ee3650 2024-08-26T00:02:38.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.075+0000 7fdb52a00640 1 -- 172.21.15.42:0/703810542 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fdb580115e0 con 0x55ba16ee3650 2024-08-26T00:02:38.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.075+0000 7fdb52a00640 1 -- 172.21.15.42:0/703810542 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdb580117e0 con 0x55ba16ee3650 2024-08-26T00:02:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.075+0000 7fdb7683b740 10 client.15117 fetch_fsmap learned FSMap version 24 2024-08-26T00:02:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.075+0000 7fdb7683b740 1 -- 172.21.15.42:0/703810542 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ba16f691f0 con 0x55ba16ee3650 2024-08-26T00:02:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.076+0000 7fdb52a00640 1 -- 172.21.15.42:0/703810542 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb5802a070 con 0x55ba16ee3650 2024-08-26T00:02:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.076+0000 7fdb52a00640 1 -- 172.21.15.42:0/703810542 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdb58019040 con 0x55ba16ee3650 2024-08-26T00:02:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.076+0000 7fdb7683b740 10 client.15117 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:02:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.076+0000 7fdb7683b740 10 client.15117 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:02:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.076+0000 7fdb7683b740 20 client.15117 populate_metadata read hostname 'smithi042' 2024-08-26T00:02:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.076+0000 7fdb7683b740 1 --2- 172.21.15.42:0/703810542 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55ba16f698c0 0x55ba16f6bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.076+0000 7fdb7683b740 4 client.15117 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-26T00:02:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.076+0000 7fdb7683b740 1 -- 172.21.15.42:0/703810542 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ba16e518b0 con 0x55ba16f698c0 2024-08-26T00:02:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.076+0000 7fdb71c00640 1 --2- 172.21.15.42:0/703810542 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55ba16f698c0 0x55ba16f6bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.077+0000 7fdb71c00640 1 --2- 172.21.15.42:0/703810542 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55ba16f698c0 0x55ba16f6bce0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87305be8d304e0eb server_cookie=5ec7b99719b5941d in_seq=0 out_seq=0 2024-08-26T00:02:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.077+0000 7fdb52a00640 10 client.15117 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:02:38.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.078+0000 7fdb52a00640 1 -- 172.21.15.42:0/703810542 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ba16e518b0 con 0x55ba16f698c0 2024-08-26T00:02:38.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.078+0000 7fdb52a00640 10 client.15117 handle_command_reply: tid=0 2024-08-26T00:02:38.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.078+0000 7fdb7683b740 1 client.15117 shutdown 2024-08-26T00:02:38.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.078+0000 7fdb7683b740 1 -- 172.21.15.42:0/703810542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16ee3650 msgr2=0x55ba16ef65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:38.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.078+0000 7fdb7683b740 1 --2- 172.21.15.42:0/703810542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16ee3650 0x55ba16ef65d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdb5800bf40 tx=0x7fdb5801bbb0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.078+0000 7fdb7683b740 1 -- 172.21.15.42:0/703810542 shutdown_connections 2024-08-26T00:02:38.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.078+0000 7fdb7683b740 1 --2- 172.21.15.42:0/703810542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ba16eedf10 0x55ba16ef2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.078+0000 7fdb7683b740 1 --2- 172.21.15.42:0/703810542 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55ba16f698c0 0x55ba16f6bce0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.078+0000 7fdb7683b740 1 --2- 172.21.15.42:0/703810542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ba16ee3650 0x55ba16ef65d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.078+0000 7fdb7683b740 1 --2- 172.21.15.42:0/703810542 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba16ee2d30 0x55ba16ef6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.078+0000 7fdb7683b740 1 -- 172.21.15.42:0/703810542 >> 172.21.15.42:0/703810542 conn(0x55ba16edf2c0 msgr2=0x55ba16eec3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:38.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.078+0000 7fdb52a00640 0 client.15117 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:02:38.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.078+0000 7fdb7683b740 1 -- 172.21.15.42:0/703810542 shutdown_connections 2024-08-26T00:02:38.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.078+0000 7fdb7683b740 1 -- 172.21.15.42:0/703810542 wait complete. 2024-08-26T00:02:38.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.079+0000 7fdb7683b740 20 client.15117 trim_cache size 0 max 16384 2024-08-26T00:02:38.084 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:02:38.084 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-08-26T00:02:38.084 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "db59e01b-3d7c-4c0c-9945-b97c874347e7", 2024-08-26T00:02:38.084 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-08-26T00:02:38.084 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:02:38.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.079+0000 7fdb73c00640 1 -- 172.21.15.42:0/1122507029 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fdb540a2c00 msgr2=0x7fdb540a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:38.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.079+0000 7fdb73c00640 1 --2- 172.21.15.42:0/1122507029 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fdb540a2c00 0x7fdb540a50c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdb6009b820 tx=0x7fdb600d2d40 comp rx=0 tx=0).stop 2024-08-26T00:02:38.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.079+0000 7fdb73c00640 1 -- 172.21.15.42:0/1122507029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb6c101930 msgr2=0x7fdb6c19a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:38.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.079+0000 7fdb73c00640 1 --2- 172.21.15.42:0/1122507029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb6c101930 0x7fdb6c19a360 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000e9f0 tx=0x7fdb6000eeb0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.079+0000 7fdb73c00640 1 -- 172.21.15.42:0/1122507029 shutdown_connections 2024-08-26T00:02:38.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.079+0000 7fdb73c00640 1 --2- 172.21.15.42:0/1122507029 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fdb540a2c00 0x7fdb540a50c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.079+0000 7fdb73c00640 1 --2- 172.21.15.42:0/1122507029 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb6c107930 0x7fdb6c19ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.079+0000 7fdb73c00640 1 --2- 172.21.15.42:0/1122507029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb6c1022d0 0x7fdb6c19a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.079+0000 7fdb73c00640 1 --2- 172.21.15.42:0/1122507029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb6c101930 0x7fdb6c19a360 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:38.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.079+0000 7fdb73c00640 1 -- 172.21.15.42:0/1122507029 >> 172.21.15.42:0/1122507029 conn(0x7fdb6c0fd650 msgr2=0x7fdb6c0fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:38.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.080+0000 7fdb73c00640 1 -- 172.21.15.42:0/1122507029 shutdown_connections 2024-08-26T00:02:38.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:38.080+0000 7fdb73c00640 1 -- 172.21.15.42:0/1122507029 wait complete. 2024-08-26T00:02:38.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:37 smithi043 ceph-mon[22091]: pgmap v342: 97 pgs: 97 active+clean; 645 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 938 B/s wr, 6 op/s 2024-08-26T00:02:38.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:37 smithi042 ceph-mon[17225]: pgmap v342: 97 pgs: 97 active+clean; 645 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 938 B/s wr, 6 op/s 2024-08-26T00:02:38.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:37 smithi181 ceph-mon[22102]: pgmap v342: 97 pgs: 97 active+clean; 645 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 938 B/s wr, 6 op/s 2024-08-26T00:02:38.743 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-26T00:02:39.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:38 smithi042 ceph-mon[17225]: scrub queued for path: / 2024-08-26T00:02:39.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:38 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:02:39.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:38 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:02:39.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:38 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:02:39.163 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:02:39.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:38 smithi043 ceph-mon[22091]: scrub queued for path: / 2024-08-26T00:02:39.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:38 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:02:39.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:38 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:02:39.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:38 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:02:39.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:38 smithi181 ceph-mon[22102]: scrub queued for path: / 2024-08-26T00:02:39.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:38 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:02:39.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:38 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:02:39.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:38 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:02:39.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.858+0000 7fcad1e00640 1 -- 172.21.15.42:0/196861207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcacc1044f0 msgr2=0x7fcacc1109d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:39.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.858+0000 7fcad1e00640 1 --2- 172.21.15.42:0/196861207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcacc1044f0 0x7fcacc1109d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009ca0 tx=0x7fcac402a8c0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.858+0000 7fcad1e00640 1 -- 172.21.15.42:0/196861207 shutdown_connections 2024-08-26T00:02:39.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.858+0000 7fcad1e00640 1 --2- 172.21.15.42:0/196861207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcacc1044f0 0x7fcacc1109d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.858+0000 7fcad1e00640 1 --2- 172.21.15.42:0/196861207 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcacc103b50 0x7fcacc103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.858+0000 7fcad1e00640 1 --2- 172.21.15.42:0/196861207 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcacc109c00 0x7fcacc109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.858+0000 7fcad1e00640 1 -- 172.21.15.42:0/196861207 >> 172.21.15.42:0/196861207 conn(0x7fcacc0ff830 msgr2=0x7fcacc101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:39.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.858+0000 7fcad1e00640 1 -- 172.21.15.42:0/196861207 shutdown_connections 2024-08-26T00:02:39.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.858+0000 7fcad1e00640 1 -- 172.21.15.42:0/196861207 wait complete. 2024-08-26T00:02:39.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.859+0000 7fcad1e00640 1 Processor -- start 2024-08-26T00:02:39.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.860+0000 7fcad1e00640 1 -- start start 2024-08-26T00:02:39.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.860+0000 7fcad1e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcacc103b50 0x7fcacc19a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:39.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.860+0000 7fcad1e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcacc1044f0 0x7fcacc19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:39.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.860+0000 7fcad1e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcacc109c00 0x7fcacc19eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:39.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.860+0000 7fcad1e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc113fb0 con 0x7fcacc1044f0 2024-08-26T00:02:39.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.860+0000 7fcad1e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc113e30 con 0x7fcacc109c00 2024-08-26T00:02:39.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.860+0000 7fcad1e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc114130 con 0x7fcacc103b50 2024-08-26T00:02:39.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.860+0000 7fcacaa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcacc103b50 0x7fcacc19a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:39.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.860+0000 7fcaca000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcacc1044f0 0x7fcacc19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:39.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.860+0000 7fcacaa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcacc103b50 0x7fcacc19a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:56388/0 (socket says 172.21.15.42:56388) 2024-08-26T00:02:39.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.860+0000 7fcacaa00640 1 -- 172.21.15.42:0/451855827 learned_addr learned my addr 172.21.15.42:0/451855827 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:39.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.860+0000 7fcacb400640 1 --2- 172.21.15.42:0/451855827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcacc109c00 0x7fcacc19eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:39.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.861+0000 7fcacaa00640 1 -- 172.21.15.42:0/451855827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcacc109c00 msgr2=0x7fcacc19eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:39.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.861+0000 7fcacaa00640 1 --2- 172.21.15.42:0/451855827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcacc109c00 0x7fcacc19eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.861+0000 7fcacaa00640 1 -- 172.21.15.42:0/451855827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcacc1044f0 msgr2=0x7fcacc19a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:39.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.861+0000 7fcacaa00640 1 --2- 172.21.15.42:0/451855827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcacc1044f0 0x7fcacc19a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.861+0000 7fcacaa00640 1 -- 172.21.15.42:0/451855827 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcacc19f260 con 0x7fcacc103b50 2024-08-26T00:02:39.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.861+0000 7fcaca000640 1 --2- 172.21.15.42:0/451855827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcacc1044f0 0x7fcacc19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:39.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.861+0000 7fcacaa00640 1 --2- 172.21.15.42:0/451855827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcacc103b50 0x7fcacc19a2b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00e9f0 tx=0x7fcabc00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:39.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.861+0000 7fcad0a00640 1 -- 172.21.15.42:0/451855827 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcabc00cd80 con 0x7fcacc103b50 2024-08-26T00:02:39.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.861+0000 7fcad1e00640 1 -- 172.21.15.42:0/451855827 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcacc19f550 con 0x7fcacc103b50 2024-08-26T00:02:39.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.861+0000 7fcad0a00640 1 -- 172.21.15.42:0/451855827 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcabc005500 con 0x7fcacc103b50 2024-08-26T00:02:39.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.861+0000 7fcad0a00640 1 -- 172.21.15.42:0/451855827 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcabc010690 con 0x7fcacc103b50 2024-08-26T00:02:39.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.862+0000 7fcad1e00640 1 -- 172.21.15.42:0/451855827 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcacc1a6e30 con 0x7fcacc103b50 2024-08-26T00:02:39.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.865+0000 7fcad48aa740 1 Processor -- start 2024-08-26T00:02:39.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.865+0000 7fcad0a00640 1 -- 172.21.15.42:0/451855827 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcabc0046c0 con 0x7fcacc103b50 2024-08-26T00:02:39.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.865+0000 7fcad48aa740 1 -- start start 2024-08-26T00:02:39.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.865+0000 7fcad48aa740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e322350940 0x55e322350d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:39.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.865+0000 7fcad48aa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e322351260 0x55e32235b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:39.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.865+0000 7fcad48aa740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e32235bb20 0x55e32235df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:39.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.865+0000 7fcad48aa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e3222b6fc0 con 0x55e322351260 2024-08-26T00:02:39.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.865+0000 7fcad48aa740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e32224e680 con 0x55e32235bb20 2024-08-26T00:02:39.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.865+0000 7fcad48aa740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55e3222b2f80 con 0x55e322350940 2024-08-26T00:02:39.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.866+0000 7fcacb400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e322350940 0x55e322350d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:39.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.866+0000 7fcacb400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e322350940 0x55e322350d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:56390/0 (socket says 172.21.15.42:56390) 2024-08-26T00:02:39.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.866+0000 7fcacb400640 1 -- 172.21.15.42:0/620238078 learned_addr learned my addr 172.21.15.42:0/620238078 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:39.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.866+0000 7fcacaa00640 1 --2- 172.21.15.42:0/620238078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e322351260 0x55e32235b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:39.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.866+0000 7fcaca000640 1 --2- 172.21.15.42:0/620238078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e32235bb20 0x55e32235df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:39.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.866+0000 7fcacb400640 1 -- 172.21.15.42:0/620238078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e32235bb20 msgr2=0x55e32235df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:39.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.866+0000 7fcacb400640 1 --2- 172.21.15.42:0/620238078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e32235bb20 0x55e32235df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.866+0000 7fcacb400640 1 -- 172.21.15.42:0/620238078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e322351260 msgr2=0x55e32235b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:39.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.866+0000 7fcacb400640 1 --2- 172.21.15.42:0/620238078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e322351260 0x55e32235b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.866+0000 7fcacb400640 1 -- 172.21.15.42:0/620238078 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e32226a2c0 con 0x55e322350940 2024-08-26T00:02:39.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.866+0000 7fcacb400640 1 --2- 172.21.15.42:0/620238078 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e322350940 0x55e322350d20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009ca0 tx=0x7fcac40093e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ae45c28612c1cea server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:39.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.867+0000 7fcab7e00640 1 -- 172.21.15.42:0/620238078 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac4031da0 con 0x55e322350940 2024-08-26T00:02:39.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.867+0000 7fcab7e00640 1 -- 172.21.15.42:0/620238078 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcac4036030 con 0x55e322350940 2024-08-26T00:02:39.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.867+0000 7fcab7e00640 1 -- 172.21.15.42:0/620238078 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac4004310 con 0x55e322350940 2024-08-26T00:02:39.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.867+0000 7fcad0a00640 1 --2- 172.21.15.42:0/451855827 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcab00a2b80 0x7fcab00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:39.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.867+0000 7fcad0a00640 1 -- 172.21.15.42:0/451855827 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fcabc0cf460 con 0x7fcacc103b50 2024-08-26T00:02:39.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.867+0000 7fcacaa00640 1 --2- 172.21.15.42:0/451855827 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcab00a2b80 0x7fcab00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:39.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.868+0000 7fcad48aa740 1 -- 172.21.15.42:0/620238078 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e322350940 msgr2=0x55e322350d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:39.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.868+0000 7fcad48aa740 1 --2- 172.21.15.42:0/620238078 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e322350940 0x55e322350d20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009ca0 tx=0x7fcac40093e0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.868+0000 7fcad48aa740 1 -- 172.21.15.42:0/620238078 shutdown_connections 2024-08-26T00:02:39.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.868+0000 7fcad48aa740 1 --2- 172.21.15.42:0/620238078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e32235bb20 0x55e32235df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.868+0000 7fcad48aa740 1 --2- 172.21.15.42:0/620238078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e322351260 0x55e32235b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.868+0000 7fcad48aa740 1 --2- 172.21.15.42:0/620238078 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e322350940 0x55e322350d20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.868+0000 7fcad48aa740 1 -- 172.21.15.42:0/620238078 >> 172.21.15.42:0/620238078 conn(0x55e32234ced0 msgr2=0x55e32234d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:39.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.868+0000 7fcad48aa740 1 -- 172.21.15.42:0/620238078 shutdown_connections 2024-08-26T00:02:39.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.868+0000 7fcad48aa740 1 -- 172.21.15.42:0/620238078 wait complete. 2024-08-26T00:02:39.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.868+0000 7fcacaa00640 1 --2- 172.21.15.42:0/451855827 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcab00a2b80 0x7fcab00a5040 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcabc098650 tx=0x7fcabc0d2ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:39.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.868+0000 7fcad48aa740 1 -- start start 2024-08-26T00:02:39.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.869+0000 7fcad48aa740 1 Processor -- start 2024-08-26T00:02:39.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.869+0000 7fcad48aa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e322350940 0x55e322358a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:39.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.869+0000 7fcad48aa740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e322351260 0x55e322358f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:39.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.869+0000 7fcad48aa740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e32235bb20 0x55e322359480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:39.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.869+0000 7fcad48aa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e32235e570 con 0x55e322350940 2024-08-26T00:02:39.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.869+0000 7fcad48aa740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e322271e50 con 0x55e322351260 2024-08-26T00:02:39.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.869+0000 7fcad48aa740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55e32235e6f0 con 0x55e32235bb20 2024-08-26T00:02:39.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.869+0000 7fcad48aa740 10 client.0 _ll_register_callbacks cb 0x55e32225cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:02:39.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.869+0000 7fcacb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e322350940 0x55e322358a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:39.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.869+0000 7fcaca000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e322351260 0x55e322358f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:39.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.869+0000 7fcacb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e322350940 0x55e322358a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50660/0 (socket says 172.21.15.42:50660) 2024-08-26T00:02:39.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.870+0000 7fcacb400640 1 -- 172.21.15.42:0/400169919 learned_addr learned my addr 172.21.15.42:0/400169919 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:39.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.870+0000 7fcacb400640 1 --2- 172.21.15.42:0/400169919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e32235bb20 0x55e322359480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:39.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.870+0000 7fcaca000640 1 -- 172.21.15.42:0/400169919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e32235bb20 msgr2=0x55e322359480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:39.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.870+0000 7fcaca000640 1 --2- 172.21.15.42:0/400169919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e32235bb20 0x55e322359480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.870+0000 7fcaca000640 1 -- 172.21.15.42:0/400169919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e322350940 msgr2=0x55e322358a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:39.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.870+0000 7fcaca000640 1 --2- 172.21.15.42:0/400169919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e322350940 0x55e322358a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.870+0000 7fcaca000640 1 -- 172.21.15.42:0/400169919 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3220283c0 con 0x55e322351260 2024-08-26T00:02:39.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.870+0000 7fcacb400640 1 --2- 172.21.15.42:0/400169919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e322350940 0x55e322358a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:39.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.870+0000 7fcaca000640 1 --2- 172.21.15.42:0/400169919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e322351260 0x55e322358f40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcacc1090f0 tx=0x7fcab800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5bddc72b0b359db server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:39.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.870+0000 7fcab4c00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:02:39.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.871+0000 7fcab4c00640 1 -- 172.21.15.42:0/400169919 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8012110 con 0x55e322351260 2024-08-26T00:02:39.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.871+0000 7fcad48aa740 1 -- 172.21.15.42:0/400169919 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcac4036030 con 0x55e322351260 2024-08-26T00:02:39.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.871+0000 7fcab4c00640 1 -- 172.21.15.42:0/400169919 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fcab8004050 con 0x55e322351260 2024-08-26T00:02:39.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.871+0000 7fcab4c00640 1 -- 172.21.15.42:0/400169919 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcab80122b0 con 0x55e322351260 2024-08-26T00:02:39.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.871+0000 7fcad48aa740 10 client.25136 fetch_fsmap learned FSMap version 24 2024-08-26T00:02:39.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.871+0000 7fcad48aa740 1 -- 172.21.15.42:0/400169919 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e32236a2d0 con 0x55e322351260 2024-08-26T00:02:39.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.871+0000 7fcab4c00640 1 -- 172.21.15.42:0/400169919 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcac4036030 con 0x55e322351260 2024-08-26T00:02:39.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.871+0000 7fcab4c00640 1 -- 172.21.15.42:0/400169919 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcab8010430 con 0x55e322351260 2024-08-26T00:02:39.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.871+0000 7fcad48aa740 10 client.25136 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:02:39.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.871+0000 7fcad48aa740 10 client.25136 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:02:39.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.871+0000 7fcad48aa740 20 client.25136 populate_metadata read hostname 'smithi042' 2024-08-26T00:02:39.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.872+0000 7fcad48aa740 1 --2- 172.21.15.42:0/400169919 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55e32236b6e0 0x55e32236dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:39.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.872+0000 7fcad48aa740 4 client.25136 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:02:39.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.872+0000 7fcad48aa740 1 -- 172.21.15.42:0/400169919 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3222c4530 con 0x55e32236b6e0 2024-08-26T00:02:39.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.872+0000 7fcacb400640 1 --2- 172.21.15.42:0/400169919 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55e32236b6e0 0x55e32236dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:39.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.872+0000 7fcacb400640 1 --2- 172.21.15.42:0/400169919 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55e32236b6e0 0x55e32236dad0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8c172eae5bd4a3a server_cookie=c57c1d8f990620a in_seq=0 out_seq=0 2024-08-26T00:02:39.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.872+0000 7fcab4c00640 10 client.25136 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:02:39.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.873+0000 7fcab4c00640 1 -- 172.21.15.42:0/400169919 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e3222c4530 con 0x55e32236b6e0 2024-08-26T00:02:39.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.873+0000 7fcab4c00640 10 client.25136 handle_command_reply: tid=0 2024-08-26T00:02:39.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.873+0000 7fcad48aa740 1 client.25136 shutdown 2024-08-26T00:02:39.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.873+0000 7fcad48aa740 1 -- 172.21.15.42:0/400169919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e322351260 msgr2=0x55e322358f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:39.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.873+0000 7fcad48aa740 1 --2- 172.21.15.42:0/400169919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e322351260 0x55e322358f40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcacc1090f0 tx=0x7fcab800f790 comp rx=0 tx=0).stop 2024-08-26T00:02:39.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.874+0000 7fcad48aa740 1 -- 172.21.15.42:0/400169919 shutdown_connections 2024-08-26T00:02:39.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.874+0000 7fcad48aa740 1 --2- 172.21.15.42:0/400169919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e32235bb20 0x55e322359480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.874+0000 7fcad48aa740 1 --2- 172.21.15.42:0/400169919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e322351260 0x55e322358f40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.874+0000 7fcad48aa740 1 --2- 172.21.15.42:0/400169919 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55e32236b6e0 0x55e32236dad0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.874+0000 7fcad48aa740 1 --2- 172.21.15.42:0/400169919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e322350940 0x55e322358a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.874+0000 7fcab4c00640 0 client.25136 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:02:39.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.874+0000 7fcad48aa740 1 -- 172.21.15.42:0/400169919 >> 172.21.15.42:0/400169919 conn(0x55e32234ced0 msgr2=0x55e32234c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:39.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.874+0000 7fcad48aa740 1 -- 172.21.15.42:0/400169919 shutdown_connections 2024-08-26T00:02:39.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.874+0000 7fcad48aa740 1 -- 172.21.15.42:0/400169919 wait complete. 2024-08-26T00:02:39.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.874+0000 7fcad48aa740 20 client.25136 trim_cache size 0 max 16384 2024-08-26T00:02:39.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.892+0000 7fcad48aa740 1 Processor -- start 2024-08-26T00:02:39.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.892+0000 7fcad48aa740 1 -- start start 2024-08-26T00:02:39.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.892+0000 7fcad48aa740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e322350940 0x55e3223533a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:39.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.892+0000 7fcad48aa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e322351260 0x55e32235a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:39.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.892+0000 7fcad48aa740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e32235bb20 0x55e3223733e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:39.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.892+0000 7fcad48aa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc1b1ca0 con 0x55e322351260 2024-08-26T00:02:39.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.892+0000 7fcad48aa740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc1af570 con 0x55e32235bb20 2024-08-26T00:02:39.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.892+0000 7fcad48aa740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc1ad3a0 con 0x55e322350940 2024-08-26T00:02:39.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.893+0000 7fcaca000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e322351260 0x55e32235a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:39.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.893+0000 7fcacb400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e322350940 0x55e3223533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:39.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.893+0000 7fcaca000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e322351260 0x55e32235a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50676/0 (socket says 172.21.15.42:50676) 2024-08-26T00:02:39.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.893+0000 7fcaca000640 1 -- 172.21.15.42:0/1521093356 learned_addr learned my addr 172.21.15.42:0/1521093356 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:39.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.893+0000 7fcacb400640 1 --2- 172.21.15.42:0/1521093356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e32235bb20 0x55e3223733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:39.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.893+0000 7fcaca000640 1 -- 172.21.15.42:0/1521093356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e322350940 msgr2=0x55e3223533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:39.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.893+0000 7fcaca000640 1 --2- 172.21.15.42:0/1521093356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e322350940 0x55e3223533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.893+0000 7fcaca000640 1 -- 172.21.15.42:0/1521093356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e32235bb20 msgr2=0x55e3223733e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:39.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.893+0000 7fcaca000640 1 --2- 172.21.15.42:0/1521093356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e32235bb20 0x55e3223733e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.893+0000 7fcaca000640 1 -- 172.21.15.42:0/1521093356 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e322348610 con 0x55e322351260 2024-08-26T00:02:39.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.893+0000 7fcaca000640 1 --2- 172.21.15.42:0/1521093356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e322351260 0x55e32235a970 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcab8010a40 tx=0x7fcab800fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a6d6b5901c4711 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:39.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.897+0000 7fcab7400640 1 -- 172.21.15.42:0/1521093356 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8010c00 con 0x55e322351260 2024-08-26T00:02:39.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.897+0000 7fcab7400640 1 -- 172.21.15.42:0/1521093356 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcab8005590 con 0x55e322351260 2024-08-26T00:02:39.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.897+0000 7fcab7400640 1 -- 172.21.15.42:0/1521093356 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8003b50 con 0x55e322351260 2024-08-26T00:02:39.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.898+0000 7fcad48aa740 1 -- 172.21.15.42:0/1521093356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e322351260 msgr2=0x55e32235a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:39.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.898+0000 7fcad48aa740 1 --2- 172.21.15.42:0/1521093356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e322351260 0x55e32235a970 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcab8010a40 tx=0x7fcab800fd10 comp rx=0 tx=0).stop 2024-08-26T00:02:39.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.898+0000 7fcad48aa740 1 -- 172.21.15.42:0/1521093356 shutdown_connections 2024-08-26T00:02:39.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.898+0000 7fcad48aa740 1 --2- 172.21.15.42:0/1521093356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e32235bb20 0x55e3223733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.898+0000 7fcad48aa740 1 --2- 172.21.15.42:0/1521093356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e322351260 0x55e32235a970 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.898+0000 7fcad48aa740 1 --2- 172.21.15.42:0/1521093356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e322350940 0x55e3223533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.898+0000 7fcad48aa740 1 -- 172.21.15.42:0/1521093356 >> 172.21.15.42:0/1521093356 conn(0x55e32234ced0 msgr2=0x55e32235a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:39.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.898+0000 7fcad48aa740 1 -- 172.21.15.42:0/1521093356 shutdown_connections 2024-08-26T00:02:39.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.898+0000 7fcad48aa740 1 -- 172.21.15.42:0/1521093356 wait complete. 2024-08-26T00:02:39.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.898+0000 7fcad48aa740 1 -- start start 2024-08-26T00:02:39.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.899+0000 7fcad48aa740 1 Processor -- start 2024-08-26T00:02:39.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.899+0000 7fcad48aa740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e322350940 0x55e322363c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:39.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.899+0000 7fcad48aa740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e322351260 0x55e322364180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:39.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.899+0000 7fcad48aa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e32235bb20 0x55e32235f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:39.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.899+0000 7fcad48aa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc1ada30 con 0x55e32235bb20 2024-08-26T00:02:39.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.899+0000 7fcad48aa740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc1aeea0 con 0x55e322350940 2024-08-26T00:02:39.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.899+0000 7fcad48aa740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc1ae100 con 0x55e322351260 2024-08-26T00:02:39.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.899+0000 7fcad48aa740 10 client.0 _ll_register_callbacks cb 0x7fcab8009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:02:39.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.899+0000 7fcacb400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e322350940 0x55e322363c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:39.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.899+0000 7fcaca000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e322351260 0x55e322364180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:39.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.899+0000 7fcacb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e32235bb20 0x55e32235f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:39.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.899+0000 7fcaca000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e322351260 0x55e322364180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:56436/0 (socket says 172.21.15.42:56436) 2024-08-26T00:02:39.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.899+0000 7fcaca000640 1 -- 172.21.15.42:0/176713027 learned_addr learned my addr 172.21.15.42:0/176713027 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:02:39.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.899+0000 7fcacb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e32235bb20 0x55e32235f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50684/0 (socket says 172.21.15.42:50684) 2024-08-26T00:02:39.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.900+0000 7fcacb400640 1 -- 172.21.15.42:0/176713027 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e322351260 msgr2=0x55e322364180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:39.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.900+0000 7fcacb400640 1 --2- 172.21.15.42:0/176713027 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e322351260 0x55e322364180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.900+0000 7fcacb400640 1 -- 172.21.15.42:0/176713027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e322350940 msgr2=0x55e322363c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:02:39.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.900+0000 7fcacb400640 1 --2- 172.21.15.42:0/176713027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e322350940 0x55e322363c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.900+0000 7fcacb400640 1 -- 172.21.15.42:0/176713027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e322351e50 con 0x55e32235bb20 2024-08-26T00:02:39.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.900+0000 7fcaca000640 1 --2- 172.21.15.42:0/176713027 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e322351260 0x55e322364180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:02:39.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.900+0000 7fcacb400640 1 --2- 172.21.15.42:0/176713027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e32235bb20 0x55e32235f090 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55e32236e380 tx=0x7fcac4031980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5760a400b5dd4b84 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:02:39.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.900+0000 7fcab4c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:02:39.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.900+0000 7fcab4c00640 1 -- 172.21.15.42:0/176713027 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac404a040 con 0x55e32235bb20 2024-08-26T00:02:39.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.901+0000 7fcad48aa740 1 -- 172.21.15.42:0/176713027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcab8005590 con 0x55e32235bb20 2024-08-26T00:02:39.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.901+0000 7fcab4c00640 1 -- 172.21.15.42:0/176713027 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fcac402f810 con 0x55e32235bb20 2024-08-26T00:02:39.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.901+0000 7fcab4c00640 1 -- 172.21.15.42:0/176713027 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcac4031520 con 0x55e32235bb20 2024-08-26T00:02:39.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.901+0000 7fcad48aa740 10 client.15135 fetch_fsmap learned FSMap version 24 2024-08-26T00:02:39.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.901+0000 7fcad48aa740 1 -- 172.21.15.42:0/176713027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e322351090 con 0x55e32235bb20 2024-08-26T00:02:39.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.901+0000 7fcab4c00640 1 -- 172.21.15.42:0/176713027 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcab8005590 con 0x55e32235bb20 2024-08-26T00:02:39.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.901+0000 7fcab4c00640 1 -- 172.21.15.42:0/176713027 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcac4050040 con 0x55e32235bb20 2024-08-26T00:02:39.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.901+0000 7fcad48aa740 10 client.15135 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:02:39.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.901+0000 7fcad48aa740 10 client.15135 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:02:39.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.901+0000 7fcad48aa740 20 client.15135 populate_metadata read hostname 'smithi042' 2024-08-26T00:02:39.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.901+0000 7fcad48aa740 1 --2- 172.21.15.42:0/176713027 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55e3223d5f30 0x55e3223d8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:02:39.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.901+0000 7fcad48aa740 4 client.15135 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-26T00:02:39.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.901+0000 7fcad48aa740 1 -- 172.21.15.42:0/176713027 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e3222bea40 con 0x55e3223d5f30 2024-08-26T00:02:39.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.902+0000 7fcaca000640 1 --2- 172.21.15.42:0/176713027 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55e3223d5f30 0x55e3223d8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:02:39.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.902+0000 7fcaca000640 1 --2- 172.21.15.42:0/176713027 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55e3223d5f30 0x55e3223d8320 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adc062c32c2914c8 server_cookie=986f7ade1c1b8613 in_seq=0 out_seq=0 2024-08-26T00:02:39.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.902+0000 7fcab4c00640 10 client.15135 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:02:39.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.903+0000 7fcab4c00640 1 -- 172.21.15.42:0/176713027 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e3222bea40 con 0x55e3223d5f30 2024-08-26T00:02:39.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.903+0000 7fcab4c00640 10 client.15135 handle_command_reply: tid=0 2024-08-26T00:02:39.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.903+0000 7fcad48aa740 1 client.15135 shutdown 2024-08-26T00:02:39.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.903+0000 7fcad48aa740 1 -- 172.21.15.42:0/176713027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e32235bb20 msgr2=0x55e32235f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:39.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.903+0000 7fcad48aa740 1 --2- 172.21.15.42:0/176713027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e32235bb20 0x55e32235f090 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55e32236e380 tx=0x7fcac4031980 comp rx=0 tx=0).stop 2024-08-26T00:02:39.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.903+0000 7fcad48aa740 1 -- 172.21.15.42:0/176713027 shutdown_connections 2024-08-26T00:02:39.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.903+0000 7fcad48aa740 1 --2- 172.21.15.42:0/176713027 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55e3223d5f30 0x55e3223d8320 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.903+0000 7fcad48aa740 1 --2- 172.21.15.42:0/176713027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e32235bb20 0x55e32235f090 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.903+0000 7fcad48aa740 1 --2- 172.21.15.42:0/176713027 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e322351260 0x55e322364180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.903+0000 7fcad48aa740 1 --2- 172.21.15.42:0/176713027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e322350940 0x55e322363c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.903+0000 7fcad48aa740 1 -- 172.21.15.42:0/176713027 >> 172.21.15.42:0/176713027 conn(0x55e32234ced0 msgr2=0x55e32234c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:39.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.903+0000 7fcab4c00640 0 client.15135 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:02:39.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.903+0000 7fcad48aa740 1 -- 172.21.15.42:0/176713027 shutdown_connections 2024-08-26T00:02:39.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.903+0000 7fcad48aa740 1 -- 172.21.15.42:0/176713027 wait complete. 2024-08-26T00:02:39.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.903+0000 7fcad48aa740 20 client.15135 trim_cache size 0 max 16384 2024-08-26T00:02:39.909 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:02:39.909 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-26T00:02:39.909 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-08-26T00:02:39.909 INFO:teuthology.orchestra.run.smithi042.stdout: "db59e01b-3d7c-4c0c-9945-b97c874347e7": { 2024-08-26T00:02:39.909 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-08-26T00:02:39.909 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "db59e01b-3d7c-4c0c-9945-b97c874347e7", 2024-08-26T00:02:39.909 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,force" 2024-08-26T00:02:39.910 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:02:39.910 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:02:39.910 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:02:39.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.904+0000 7fcad1e00640 1 -- 172.21.15.42:0/451855827 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcab00a2b80 msgr2=0x7fcab00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:39.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.904+0000 7fcad1e00640 1 --2- 172.21.15.42:0/451855827 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcab00a2b80 0x7fcab00a5040 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcabc098650 tx=0x7fcabc0d2ea0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.904+0000 7fcad1e00640 1 -- 172.21.15.42:0/451855827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcacc103b50 msgr2=0x7fcacc19a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:02:39.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.904+0000 7fcad1e00640 1 --2- 172.21.15.42:0/451855827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcacc103b50 0x7fcacc19a2b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00e9f0 tx=0x7fcabc00edf0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.904+0000 7fcad1e00640 1 -- 172.21.15.42:0/451855827 shutdown_connections 2024-08-26T00:02:39.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.904+0000 7fcad1e00640 1 --2- 172.21.15.42:0/451855827 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcab00a2b80 0x7fcab00a5040 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.904+0000 7fcad1e00640 1 --2- 172.21.15.42:0/451855827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcacc109c00 0x7fcacc19eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.904+0000 7fcad1e00640 1 --2- 172.21.15.42:0/451855827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcacc1044f0 0x7fcacc19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.904+0000 7fcad1e00640 1 --2- 172.21.15.42:0/451855827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcacc103b50 0x7fcacc19a2b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:02:39.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.904+0000 7fcad1e00640 1 -- 172.21.15.42:0/451855827 >> 172.21.15.42:0/451855827 conn(0x7fcacc0ff830 msgr2=0x7fcacc100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:02:39.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.904+0000 7fcad1e00640 1 -- 172.21.15.42:0/451855827 shutdown_connections 2024-08-26T00:02:39.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:02:39.904+0000 7fcad1e00640 1 -- 172.21.15.42:0/451855827 wait complete. 2024-08-26T00:02:40.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:39 smithi042 ceph-mon[17225]: pgmap v343: 97 pgs: 97 active+clean; 651 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-08-26T00:02:40.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:39 smithi043 ceph-mon[22091]: pgmap v343: 97 pgs: 97 active+clean; 651 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-08-26T00:02:40.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:39 smithi181 ceph-mon[22102]: pgmap v343: 97 pgs: 97 active+clean; 651 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-08-26T00:02:40.721 INFO:tasks.cephfs.filesystem:scrub status for tag:db59e01b-3d7c-4c0c-9945-b97c874347e7 - {'path': '/', 'tag': 'db59e01b-3d7c-4c0c-9945-b97c874347e7', 'options': 'recursive,force'} 2024-08-26T00:02:42.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:41 smithi043 ceph-mon[22091]: pgmap v344: 97 pgs: 97 active+clean; 651 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-08-26T00:02:42.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:41 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:02:42.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:41 smithi181 ceph-mon[22102]: pgmap v344: 97 pgs: 97 active+clean; 651 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-08-26T00:02:42.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:41 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:02:42.166 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:41 smithi042 ceph-mon[17225]: pgmap v344: 97 pgs: 97 active+clean; 651 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-08-26T00:02:42.166 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:41 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:02:44.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:43 smithi043 ceph-mon[22091]: pgmap v345: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-08-26T00:02:44.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:43 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:02:44.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:43 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:02:44.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:43 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:02:44.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:43 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:02:44.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:43 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:02:44.011 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:43 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:02:44.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:43 smithi042 ceph-mon[17225]: pgmap v345: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-08-26T00:02:44.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:43 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:02:44.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:43 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:02:44.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:43 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:02:44.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:43 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:02:44.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:43 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:02:44.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:43 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:02:44.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:43 smithi181 ceph-mon[22102]: pgmap v345: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-08-26T00:02:44.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:43 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:02:44.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:43 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:02:44.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:43 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:02:44.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:43 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:02:44.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:43 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:02:44.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:43 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:02:45.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:44 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:02:45.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:44 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:02:45.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:44 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:02:45.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:44 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:02:45.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:44 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:02:45.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:44 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:02:45.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:44 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:02:45.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:44 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:02:45.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:44 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:02:46.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:45 smithi042 ceph-mon[17225]: pgmap v346: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 6 op/s 2024-08-26T00:02:46.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:45 smithi043 ceph-mon[22091]: pgmap v346: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 6 op/s 2024-08-26T00:02:46.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:45 smithi181 ceph-mon[22102]: pgmap v346: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 6 op/s 2024-08-26T00:02:48.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:47 smithi043 ceph-mon[22091]: pgmap v347: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 6 op/s 2024-08-26T00:02:48.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:47 smithi042 ceph-mon[17225]: pgmap v347: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 6 op/s 2024-08-26T00:02:48.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:47 smithi181 ceph-mon[22102]: pgmap v347: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 6 op/s 2024-08-26T00:02:49.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:48 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:02:49.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:48 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:02:49.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:48 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:02:50.253 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:49 smithi181 ceph-mon[22102]: pgmap v348: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 8 op/s 2024-08-26T00:02:50.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:49 smithi043 ceph-mon[22091]: pgmap v348: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 8 op/s 2024-08-26T00:02:50.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:49 smithi042 ceph-mon[17225]: pgmap v348: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 8 op/s 2024-08-26T00:02:52.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:51 smithi043 ceph-mon[22091]: pgmap v349: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-26T00:02:52.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:51 smithi042 ceph-mon[17225]: pgmap v349: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-26T00:02:52.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:51 smithi181 ceph-mon[22102]: pgmap v349: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-26T00:02:54.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:53 smithi043 ceph-mon[22091]: pgmap v350: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-26T00:02:54.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:53 smithi042 ceph-mon[17225]: pgmap v350: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-26T00:02:54.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:53 smithi181 ceph-mon[22102]: pgmap v350: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-26T00:02:56.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:55 smithi043 ceph-mon[22091]: pgmap v351: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:02:56.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:55 smithi042 ceph-mon[17225]: pgmap v351: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:02:56.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:55 smithi181 ceph-mon[22102]: pgmap v351: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:02:58.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:57 smithi043 ceph-mon[22091]: pgmap v352: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:02:58.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:57 smithi042 ceph-mon[17225]: pgmap v352: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:02:58.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:57 smithi181 ceph-mon[22102]: pgmap v352: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:03:00.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:02:59 smithi043 ceph-mon[22091]: pgmap v353: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:03:00.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:02:59 smithi042 ceph-mon[17225]: pgmap v353: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:03:00.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:02:59 smithi181 ceph-mon[22102]: pgmap v353: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:03:02.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:01 smithi043 ceph-mon[22091]: pgmap v354: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-26T00:03:02.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:01 smithi042 ceph-mon[17225]: pgmap v354: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-26T00:03:02.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:01 smithi181 ceph-mon[22102]: pgmap v354: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-26T00:03:04.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:03 smithi043 ceph-mon[22091]: pgmap v355: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:03:04.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:03 smithi042 ceph-mon[17225]: pgmap v355: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:03:04.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:03 smithi181 ceph-mon[22102]: pgmap v355: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:03:05.997 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:05 smithi042 ceph-mon[17225]: pgmap v356: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:03:06.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:05 smithi043 ceph-mon[22091]: pgmap v356: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:03:06.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:05 smithi181 ceph-mon[22102]: pgmap v356: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:03:08.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:07 smithi043 ceph-mon[22091]: pgmap v357: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:03:08.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:07 smithi042 ceph-mon[17225]: pgmap v357: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:03:08.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:07 smithi181 ceph-mon[22102]: pgmap v357: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:03:10.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:10 smithi043 ceph-mon[22091]: pgmap v358: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:03:10.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:10 smithi042 ceph-mon[17225]: pgmap v358: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:03:10.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:10 smithi181 ceph-mon[22102]: pgmap v358: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-26T00:03:10.722 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-26T00:03:11.187 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:03:11.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.732+0000 7fd0e3400640 1 -- 172.21.15.42:0/4153646602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0dc108ee0 msgr2=0x7fd0dc110a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:11.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.732+0000 7fd0e3400640 1 --2- 172.21.15.42:0/4153646602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0dc108ee0 0x7fd0dc110a60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009be0 tx=0x7fd0d402a6c0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.732+0000 7fd0e3400640 1 -- 172.21.15.42:0/4153646602 shutdown_connections 2024-08-26T00:03:11.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.732+0000 7fd0e3400640 1 --2- 172.21.15.42:0/4153646602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0dc108ee0 0x7fd0dc110a60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.732+0000 7fd0e3400640 1 --2- 172.21.15.42:0/4153646602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0dc104760 0x7fd0dc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.732+0000 7fd0e3400640 1 --2- 172.21.15.42:0/4153646602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd0dc103db0 0x7fd0dc104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.732+0000 7fd0e3400640 1 -- 172.21.15.42:0/4153646602 >> 172.21.15.42:0/4153646602 conn(0x7fd0dc0ff7f0 msgr2=0x7fd0dc101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:11.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.733+0000 7fd0e3400640 1 -- 172.21.15.42:0/4153646602 shutdown_connections 2024-08-26T00:03:11.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.733+0000 7fd0e3400640 1 -- 172.21.15.42:0/4153646602 wait complete. 2024-08-26T00:03:11.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.734+0000 7fd0e3400640 1 Processor -- start 2024-08-26T00:03:11.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.734+0000 7fd0e3400640 1 -- start start 2024-08-26T00:03:11.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.734+0000 7fd0e3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0dc103db0 0x7fd0dc19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:11.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.735+0000 7fd0e3400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd0dc104760 0x7fd0dc19a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:11.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.735+0000 7fd0e3400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0dc108ee0 0x7fd0dc19ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:11.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.735+0000 7fd0e3400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc113ef0 con 0x7fd0dc103db0 2024-08-26T00:03:11.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.735+0000 7fd0e3400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc113d70 con 0x7fd0dc108ee0 2024-08-26T00:03:11.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.735+0000 7fd0e3400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc114070 con 0x7fd0dc104760 2024-08-26T00:03:11.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.735+0000 7fd0e0a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0dc103db0 0x7fd0dc19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:11.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.735+0000 7fd0e0a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0dc103db0 0x7fd0dc19a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35202/0 (socket says 172.21.15.42:35202) 2024-08-26T00:03:11.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.735+0000 7fd0e0a00640 1 -- 172.21.15.42:0/3687570900 learned_addr learned my addr 172.21.15.42:0/3687570900 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:11.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.735+0000 7fd0e1400640 1 --2- 172.21.15.42:0/3687570900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0dc108ee0 0x7fd0dc19ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:11.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.735+0000 7fd0e0a00640 1 -- 172.21.15.42:0/3687570900 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd0dc104760 msgr2=0x7fd0dc19a950 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-26T00:03:11.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.735+0000 7fd0e0a00640 1 --2- 172.21.15.42:0/3687570900 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd0dc104760 0x7fd0dc19a950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.736+0000 7fd0e0a00640 1 -- 172.21.15.42:0/3687570900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0dc108ee0 msgr2=0x7fd0dc19ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:11.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.736+0000 7fd0e0a00640 1 --2- 172.21.15.42:0/3687570900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0dc108ee0 0x7fd0dc19ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.736+0000 7fd0e0a00640 1 -- 172.21.15.42:0/3687570900 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0dc19f3c0 con 0x7fd0dc103db0 2024-08-26T00:03:11.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.736+0000 7fd0e0a00640 1 --2- 172.21.15.42:0/3687570900 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0dc103db0 0x7fd0dc19a410 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd0d000e9f0 tx=0x7fd0d000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:11.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.737+0000 7fd0d9600640 1 -- 172.21.15.42:0/3687570900 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d000ccc0 con 0x7fd0dc103db0 2024-08-26T00:03:11.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.737+0000 7fd0d9600640 1 -- 172.21.15.42:0/3687570900 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0d0005500 con 0x7fd0dc103db0 2024-08-26T00:03:11.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.737+0000 7fd0d9600640 1 -- 172.21.15.42:0/3687570900 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0010690 con 0x7fd0dc103db0 2024-08-26T00:03:11.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.737+0000 7fd0e3400640 1 -- 172.21.15.42:0/3687570900 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0dc19f6b0 con 0x7fd0dc103db0 2024-08-26T00:03:11.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.737+0000 7fd0e3400640 1 -- 172.21.15.42:0/3687570900 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0dc1a6f90 con 0x7fd0dc103db0 2024-08-26T00:03:11.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.741+0000 7fd0e5dd7740 1 Processor -- start 2024-08-26T00:03:11.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.741+0000 7fd0e5dd7740 1 -- start start 2024-08-26T00:03:11.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.741+0000 7fd0e5dd7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ab940 0x55c75e9abd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:11.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.741+0000 7fd0e5dd7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9ac260 0x55c75e9b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:11.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.741+0000 7fd0e5dd7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c75e9b6b20 0x55c75e9b8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:11.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.742+0000 7fd0e5dd7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c75e911fc0 con 0x55c75e9ac260 2024-08-26T00:03:11.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.742+0000 7fd0e5dd7740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c75e8a9680 con 0x55c75e9ab940 2024-08-26T00:03:11.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.742+0000 7fd0e5dd7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c75e90df80 con 0x55c75e9b6b20 2024-08-26T00:03:11.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.742+0000 7fd0e1400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ab940 0x55c75e9abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:11.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.742+0000 7fd0dbe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c75e9b6b20 0x55c75e9b8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:11.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.742+0000 7fd0e1400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ab940 0x55c75e9abd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:57352/0 (socket says 172.21.15.42:57352) 2024-08-26T00:03:11.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.742+0000 7fd0e1400640 1 -- 172.21.15.42:0/751064391 learned_addr learned my addr 172.21.15.42:0/751064391 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:11.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.742+0000 7fd0d9600640 1 -- 172.21.15.42:0/3687570900 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd0d00046c0 con 0x7fd0dc103db0 2024-08-26T00:03:11.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.743+0000 7fd0e1400640 1 -- 172.21.15.42:0/751064391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c75e9b6b20 msgr2=0x55c75e9b8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:11.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.743+0000 7fd0e1400640 1 --2- 172.21.15.42:0/751064391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c75e9b6b20 0x55c75e9b8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.743+0000 7fd0e1400640 1 -- 172.21.15.42:0/751064391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9ac260 msgr2=0x55c75e9b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:11.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.743+0000 7fd0e0a00640 1 --2- 172.21.15.42:0/751064391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9ac260 0x55c75e9b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:11.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.743+0000 7fd0e1400640 1 --2- 172.21.15.42:0/751064391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9ac260 0x55c75e9b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.743+0000 7fd0e1400640 1 -- 172.21.15.42:0/751064391 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c75e8c52c0 con 0x55c75e9ab940 2024-08-26T00:03:11.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.743+0000 7fd0e0a00640 1 --2- 172.21.15.42:0/751064391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9ac260 0x55c75e9b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:03:11.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.743+0000 7fd0e1400640 1 --2- 172.21.15.42:0/751064391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ab940 0x55c75e9abd20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009be0 tx=0x7fd0d4005c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d30ca46879d3d88 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:11.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.744+0000 7fd0cdc00640 1 -- 172.21.15.42:0/751064391 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4042030 con 0x55c75e9ab940 2024-08-26T00:03:11.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.744+0000 7fd0cdc00640 1 -- 172.21.15.42:0/751064391 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0d4037040 con 0x55c75e9ab940 2024-08-26T00:03:11.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.744+0000 7fd0cdc00640 1 -- 172.21.15.42:0/751064391 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4036070 con 0x55c75e9ab940 2024-08-26T00:03:11.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.744+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/751064391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ab940 msgr2=0x55c75e9abd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:11.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.744+0000 7fd0e5dd7740 1 --2- 172.21.15.42:0/751064391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ab940 0x55c75e9abd20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009be0 tx=0x7fd0d4005c60 comp rx=0 tx=0).stop 2024-08-26T00:03:11.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.745+0000 7fd0d9600640 1 --2- 172.21.15.42:0/3687570900 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd0c40a2c80 0x7fd0c40a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:11.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.745+0000 7fd0d9600640 1 -- 172.21.15.42:0/3687570900 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fd0d00cf370 con 0x7fd0dc103db0 2024-08-26T00:03:11.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.745+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/751064391 shutdown_connections 2024-08-26T00:03:11.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.745+0000 7fd0e5dd7740 1 --2- 172.21.15.42:0/751064391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c75e9b6b20 0x55c75e9b8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.745+0000 7fd0e5dd7740 1 --2- 172.21.15.42:0/751064391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9ac260 0x55c75e9b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.745+0000 7fd0e5dd7740 1 --2- 172.21.15.42:0/751064391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ab940 0x55c75e9abd20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.745+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/751064391 >> 172.21.15.42:0/751064391 conn(0x55c75e9a7ed0 msgr2=0x55c75e9a82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:11.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.746+0000 7fd0e1400640 1 --2- 172.21.15.42:0/3687570900 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd0c40a2c80 0x7fd0c40a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:11.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.746+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/751064391 shutdown_connections 2024-08-26T00:03:11.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.746+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/751064391 wait complete. 2024-08-26T00:03:11.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.747+0000 7fd0e5dd7740 1 -- start start 2024-08-26T00:03:11.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.747+0000 7fd0e5dd7740 1 Processor -- start 2024-08-26T00:03:11.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.747+0000 7fd0e1400640 1 --2- 172.21.15.42:0/3687570900 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd0c40a2c80 0x7fd0c40a5140 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4003c80 tx=0x7fd0d402a6c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:11.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.747+0000 7fd0e5dd7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c75e9ab940 0x55c75e9b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:11.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.747+0000 7fd0e5dd7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ac260 0x55c75e9b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:11.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.747+0000 7fd0e5dd7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9b6b20 0x55c75e9b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:11.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.747+0000 7fd0e5dd7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c75e9b96f0 con 0x55c75e9b6b20 2024-08-26T00:03:11.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.747+0000 7fd0e5dd7740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c75e8cce50 con 0x55c75e9ac260 2024-08-26T00:03:11.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.747+0000 7fd0e5dd7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c75e9b9870 con 0x55c75e9ab940 2024-08-26T00:03:11.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.748+0000 7fd0e5dd7740 10 client.0 _ll_register_callbacks cb 0x55c75e8b7f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:03:11.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.748+0000 7fd0dbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ac260 0x55c75e9b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:11.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.748+0000 7fd0e0a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c75e9ab940 0x55c75e9b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:11.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.748+0000 7fd0e0a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c75e9ab940 0x55c75e9b3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:60002/0 (socket says 172.21.15.42:60002) 2024-08-26T00:03:11.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.748+0000 7fd0e0a00640 1 -- 172.21.15.42:0/3253695141 learned_addr learned my addr 172.21.15.42:0/3253695141 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:11.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.748+0000 7fd0e1400640 1 --2- 172.21.15.42:0/3253695141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9b6b20 0x55c75e9b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:11.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.749+0000 7fd0dbe00640 1 -- 172.21.15.42:0/3253695141 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c75e9ab940 msgr2=0x55c75e9b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:11.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.749+0000 7fd0dbe00640 1 --2- 172.21.15.42:0/3253695141 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c75e9ab940 0x55c75e9b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.749+0000 7fd0dbe00640 1 -- 172.21.15.42:0/3253695141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9b6b20 msgr2=0x55c75e9b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:11.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.749+0000 7fd0dbe00640 1 --2- 172.21.15.42:0/3253695141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9b6b20 0x55c75e9b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.749+0000 7fd0dbe00640 1 -- 172.21.15.42:0/3253695141 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c75e6833c0 con 0x55c75e9ac260 2024-08-26T00:03:11.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.749+0000 7fd0e1400640 1 --2- 172.21.15.42:0/3253695141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9b6b20 0x55c75e9b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:03:11.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.749+0000 7fd0dbe00640 1 --2- 172.21.15.42:0/3253695141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ac260 0x55c75e9b3f60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8011440 tx=0x7fd0c8011840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=670a6e8d9f980f57 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:11.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.749+0000 7fd0c2000640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:03:11.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.750+0000 7fd0c2000640 1 -- 172.21.15.42:0/3253695141 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c801e060 con 0x55c75e9ac260 2024-08-26T00:03:11.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.750+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/3253695141 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0d4037040 con 0x55c75e9ac260 2024-08-26T00:03:11.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.750+0000 7fd0c2000640 1 -- 172.21.15.42:0/3253695141 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fd0c80035f0 con 0x55c75e9ac260 2024-08-26T00:03:11.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.750+0000 7fd0c2000640 1 -- 172.21.15.42:0/3253695141 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd0c80037f0 con 0x55c75e9ac260 2024-08-26T00:03:11.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.750+0000 7fd0e5dd7740 10 client.25154 fetch_fsmap learned FSMap version 24 2024-08-26T00:03:11.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.750+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/3253695141 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c75e9c53d0 con 0x55c75e9ac260 2024-08-26T00:03:11.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.750+0000 7fd0c2000640 1 -- 172.21.15.42:0/3253695141 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0d4037040 con 0x55c75e9ac260 2024-08-26T00:03:11.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.751+0000 7fd0c2000640 1 -- 172.21.15.42:0/3253695141 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd0c8023070 con 0x55c75e9ac260 2024-08-26T00:03:11.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.751+0000 7fd0e5dd7740 10 client.25154 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:03:11.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.751+0000 7fd0e5dd7740 10 client.25154 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:03:11.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.751+0000 7fd0e5dd7740 20 client.25154 populate_metadata read hostname 'smithi042' 2024-08-26T00:03:11.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.751+0000 7fd0e5dd7740 1 --2- 172.21.15.42:0/3253695141 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c75e9c6830 0x55c75e9c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:11.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.751+0000 7fd0e5dd7740 4 client.25154 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:03:11.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.751+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/3253695141 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c75e91f530 con 0x55c75e9c6830 2024-08-26T00:03:11.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.751+0000 7fd0e0a00640 1 --2- 172.21.15.42:0/3253695141 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c75e9c6830 0x55c75e9c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:11.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.752+0000 7fd0e0a00640 1 --2- 172.21.15.42:0/3253695141 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c75e9c6830 0x55c75e9c8c60 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5f276fe0afd16d5 server_cookie=f76f8482170ea385 in_seq=0 out_seq=0 2024-08-26T00:03:11.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.752+0000 7fd0c2000640 10 client.25154 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:11.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.753+0000 7fd0c2000640 1 -- 172.21.15.42:0/3253695141 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c75e91f530 con 0x55c75e9c6830 2024-08-26T00:03:11.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.753+0000 7fd0c2000640 10 client.25154 handle_command_reply: tid=0 2024-08-26T00:03:11.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.753+0000 7fd0e5dd7740 1 client.25154 shutdown 2024-08-26T00:03:11.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.753+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/3253695141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ac260 msgr2=0x55c75e9b3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:11.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.753+0000 7fd0e5dd7740 1 --2- 172.21.15.42:0/3253695141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ac260 0x55c75e9b3f60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8011440 tx=0x7fd0c8011840 comp rx=0 tx=0).stop 2024-08-26T00:03:11.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.753+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/3253695141 shutdown_connections 2024-08-26T00:03:11.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.753+0000 7fd0e5dd7740 1 --2- 172.21.15.42:0/3253695141 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c75e9c6830 0x55c75e9c8c60 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.753+0000 7fd0e5dd7740 1 --2- 172.21.15.42:0/3253695141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9b6b20 0x55c75e9b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.753+0000 7fd0e5dd7740 1 --2- 172.21.15.42:0/3253695141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ac260 0x55c75e9b3f60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.753+0000 7fd0e5dd7740 1 --2- 172.21.15.42:0/3253695141 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c75e9ab940 0x55c75e9b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.753+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/3253695141 >> 172.21.15.42:0/3253695141 conn(0x55c75e9a7ed0 msgr2=0x55c75e9a7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:11.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.753+0000 7fd0c2000640 0 client.25154 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:11.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.754+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/3253695141 shutdown_connections 2024-08-26T00:03:11.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.754+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/3253695141 wait complete. 2024-08-26T00:03:11.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.754+0000 7fd0e5dd7740 20 client.25154 trim_cache size 0 max 16384 2024-08-26T00:03:11.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.772+0000 7fd0e5dd7740 1 Processor -- start 2024-08-26T00:03:11.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.773+0000 7fd0e5dd7740 1 -- start start 2024-08-26T00:03:11.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.773+0000 7fd0e5dd7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9ab940 0x55c75e9a82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:11.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.773+0000 7fd0e5dd7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ac260 0x55c75e9adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:11.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.773+0000 7fd0e5dd7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c75e9b6b20 0x55c75e9ce530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:11.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.773+0000 7fd0e5dd7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc1b1d80 con 0x55c75e9ab940 2024-08-26T00:03:11.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.773+0000 7fd0e5dd7740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc1af650 con 0x55c75e9ac260 2024-08-26T00:03:11.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.773+0000 7fd0e5dd7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc1ad480 con 0x55c75e9b6b20 2024-08-26T00:03:11.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.773+0000 7fd0e0a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9ab940 0x55c75e9a82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:11.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.773+0000 7fd0dbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ac260 0x55c75e9adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:11.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.774+0000 7fd0dbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ac260 0x55c75e9adaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:57366/0 (socket says 172.21.15.42:57366) 2024-08-26T00:03:11.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.774+0000 7fd0dbe00640 1 -- 172.21.15.42:0/156558226 learned_addr learned my addr 172.21.15.42:0/156558226 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:11.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.774+0000 7fd0e1400640 1 --2- 172.21.15.42:0/156558226 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c75e9b6b20 0x55c75e9ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:11.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.774+0000 7fd0dbe00640 1 -- 172.21.15.42:0/156558226 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c75e9b6b20 msgr2=0x55c75e9ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:11.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.774+0000 7fd0dbe00640 1 --2- 172.21.15.42:0/156558226 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c75e9b6b20 0x55c75e9ce530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.774+0000 7fd0dbe00640 1 -- 172.21.15.42:0/156558226 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9ab940 msgr2=0x55c75e9a82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:11.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.774+0000 7fd0dbe00640 1 --2- 172.21.15.42:0/156558226 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9ab940 0x55c75e9a82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.774+0000 7fd0dbe00640 1 -- 172.21.15.42:0/156558226 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c75e9b6390 con 0x55c75e9ac260 2024-08-26T00:03:11.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.774+0000 7fd0dbe00640 1 --2- 172.21.15.42:0/156558226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ac260 0x55c75e9adaf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8019d30 tx=0x7fd0c8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d03ccd44cea10b09 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:11.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.775+0000 7fd0cd200640 1 -- 172.21.15.42:0/156558226 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8029070 con 0x55c75e9ac260 2024-08-26T00:03:11.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.775+0000 7fd0cd200640 1 -- 172.21.15.42:0/156558226 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0c8003e70 con 0x55c75e9ac260 2024-08-26T00:03:11.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.775+0000 7fd0cd200640 1 -- 172.21.15.42:0/156558226 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8019960 con 0x55c75e9ac260 2024-08-26T00:03:11.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.776+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/156558226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ac260 msgr2=0x55c75e9adaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:11.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.776+0000 7fd0e5dd7740 1 --2- 172.21.15.42:0/156558226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ac260 0x55c75e9adaf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8019d30 tx=0x7fd0c8009c30 comp rx=0 tx=0).stop 2024-08-26T00:03:11.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.776+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/156558226 shutdown_connections 2024-08-26T00:03:11.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.776+0000 7fd0e5dd7740 1 --2- 172.21.15.42:0/156558226 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c75e9b6b20 0x55c75e9ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.776+0000 7fd0e5dd7740 1 --2- 172.21.15.42:0/156558226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ac260 0x55c75e9adaf0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.776+0000 7fd0e5dd7740 1 --2- 172.21.15.42:0/156558226 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9ab940 0x55c75e9a82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.776+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/156558226 >> 172.21.15.42:0/156558226 conn(0x55c75e9a7ed0 msgr2=0x55c75e9ad3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:11.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.776+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/156558226 shutdown_connections 2024-08-26T00:03:11.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.776+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/156558226 wait complete. 2024-08-26T00:03:11.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.776+0000 7fd0e5dd7740 1 -- start start 2024-08-26T00:03:11.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.777+0000 7fd0e5dd7740 1 Processor -- start 2024-08-26T00:03:11.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.777+0000 7fd0e5dd7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9ab940 0x55c75e9bf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:11.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.777+0000 7fd0e5dd7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ac260 0x55c75e9ba640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:11.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.777+0000 7fd0e5dd7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c75e9b6b20 0x55c75e9bac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:11.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.777+0000 7fd0e5dd7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc1adb10 con 0x55c75e9ab940 2024-08-26T00:03:11.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.777+0000 7fd0e5dd7740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc1aef80 con 0x55c75e9ac260 2024-08-26T00:03:11.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.777+0000 7fd0e5dd7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc1ae1e0 con 0x55c75e9b6b20 2024-08-26T00:03:11.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.778+0000 7fd0e0a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9ab940 0x55c75e9bf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:11.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.778+0000 7fd0e5dd7740 10 client.0 _ll_register_callbacks cb 0x7fd0c80096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:03:11.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.778+0000 7fd0e0a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9ab940 0x55c75e9bf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35226/0 (socket says 172.21.15.42:35226) 2024-08-26T00:03:11.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.778+0000 7fd0e0a00640 1 -- 172.21.15.42:0/4243736158 learned_addr learned my addr 172.21.15.42:0/4243736158 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:11.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.778+0000 7fd0dbe00640 1 --2- 172.21.15.42:0/4243736158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ac260 0x55c75e9ba640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:11.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.778+0000 7fd0e1400640 1 --2- 172.21.15.42:0/4243736158 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c75e9b6b20 0x55c75e9bac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:11.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.778+0000 7fd0e0a00640 1 -- 172.21.15.42:0/4243736158 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c75e9b6b20 msgr2=0x55c75e9bac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:11.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.778+0000 7fd0e0a00640 1 --2- 172.21.15.42:0/4243736158 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c75e9b6b20 0x55c75e9bac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.778+0000 7fd0e0a00640 1 -- 172.21.15.42:0/4243736158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ac260 msgr2=0x55c75e9ba640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.778+0000 7fd0e0a00640 1 --2- 172.21.15.42:0/4243736158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ac260 0x55c75e9ba640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.778+0000 7fd0e0a00640 1 -- 172.21.15.42:0/4243736158 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c75e9bb440 con 0x55c75e9ab940 2024-08-26T00:03:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.778+0000 7fd0dbe00640 1 --2- 172.21.15.42:0/4243736158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ac260 0x55c75e9ba640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:03:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.779+0000 7fd0e0a00640 1 --2- 172.21.15.42:0/4243736158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9ab940 0x55c75e9bf310 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd0d009bad0 tx=0x7fd0d00cce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe32fea793116b72 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.779+0000 7fd0c2000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:03:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.779+0000 7fd0c2000640 1 -- 172.21.15.42:0/4243736158 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d009ff40 con 0x55c75e9ab940 2024-08-26T00:03:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.779+0000 7fd0c2000640 1 -- 172.21.15.42:0/4243736158 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fd0d0098200 con 0x55c75e9ab940 2024-08-26T00:03:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.779+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/4243736158 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0c8003e70 con 0x55c75e9ab940 2024-08-26T00:03:11.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.779+0000 7fd0c2000640 1 -- 172.21.15.42:0/4243736158 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd0d00a4800 con 0x55c75e9ab940 2024-08-26T00:03:11.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.779+0000 7fd0e5dd7740 10 client.15147 fetch_fsmap learned FSMap version 24 2024-08-26T00:03:11.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.779+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/4243736158 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c75ea31670 con 0x55c75e9ab940 2024-08-26T00:03:11.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.780+0000 7fd0c2000640 1 -- 172.21.15.42:0/4243736158 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0c8003e70 con 0x55c75e9ab940 2024-08-26T00:03:11.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.780+0000 7fd0c2000640 1 -- 172.21.15.42:0/4243736158 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd0d00ce040 con 0x55c75e9ab940 2024-08-26T00:03:11.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.780+0000 7fd0e5dd7740 10 client.15147 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:03:11.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.780+0000 7fd0e5dd7740 10 client.15147 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:03:11.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.780+0000 7fd0e5dd7740 20 client.15147 populate_metadata read hostname 'smithi042' 2024-08-26T00:03:11.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.780+0000 7fd0e5dd7740 1 --2- 172.21.15.42:0/4243736158 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c75ea31c80 0x55c75ea340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:11.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.780+0000 7fd0e5dd7740 4 client.15147 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-26T00:03:11.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.780+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/4243736158 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c75e919a40 con 0x55c75ea31c80 2024-08-26T00:03:11.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.780+0000 7fd0dbe00640 1 --2- 172.21.15.42:0/4243736158 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c75ea31c80 0x55c75ea340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:11.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.781+0000 7fd0dbe00640 1 --2- 172.21.15.42:0/4243736158 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c75ea31c80 0x55c75ea340a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ba5d97cbc3ce7ae server_cookie=726593d00c01e7b6 in_seq=0 out_seq=0 2024-08-26T00:03:11.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.781+0000 7fd0c2000640 10 client.15147 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:11.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.781+0000 7fd0c2000640 1 -- 172.21.15.42:0/4243736158 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c75e919a40 con 0x55c75ea31c80 2024-08-26T00:03:11.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.781+0000 7fd0c2000640 10 client.15147 handle_command_reply: tid=0 2024-08-26T00:03:11.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.781+0000 7fd0e5dd7740 1 client.15147 shutdown 2024-08-26T00:03:11.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.782+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/4243736158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9ab940 msgr2=0x55c75e9bf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:11.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.782+0000 7fd0e5dd7740 1 --2- 172.21.15.42:0/4243736158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9ab940 0x55c75e9bf310 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd0d009bad0 tx=0x7fd0d00cce30 comp rx=0 tx=0).stop 2024-08-26T00:03:11.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.782+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/4243736158 shutdown_connections 2024-08-26T00:03:11.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.782+0000 7fd0e5dd7740 1 --2- 172.21.15.42:0/4243736158 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c75e9b6b20 0x55c75e9bac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.782+0000 7fd0e5dd7740 1 --2- 172.21.15.42:0/4243736158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c75e9ac260 0x55c75e9ba640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.782+0000 7fd0e5dd7740 1 --2- 172.21.15.42:0/4243736158 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c75ea31c80 0x55c75ea340a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.782+0000 7fd0e5dd7740 1 --2- 172.21.15.42:0/4243736158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c75e9ab940 0x55c75e9bf310 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.782+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/4243736158 >> 172.21.15.42:0/4243736158 conn(0x55c75e9a7ed0 msgr2=0x55c75e9b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:11.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.782+0000 7fd0c2000640 0 client.15147 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:11.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.782+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/4243736158 shutdown_connections 2024-08-26T00:03:11.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.782+0000 7fd0e5dd7740 1 -- 172.21.15.42:0/4243736158 wait complete. 2024-08-26T00:03:11.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.783+0000 7fd0e5dd7740 20 client.15147 trim_cache size 0 max 16384 2024-08-26T00:03:11.789 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:03:11.789 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-08-26T00:03:11.789 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {} 2024-08-26T00:03:11.790 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:03:11.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.783+0000 7fd0e3400640 1 -- 172.21.15.42:0/3687570900 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd0c40a2c80 msgr2=0x7fd0c40a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:11.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.783+0000 7fd0e3400640 1 --2- 172.21.15.42:0/3687570900 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd0c40a2c80 0x7fd0c40a5140 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4003c80 tx=0x7fd0d402a6c0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.783+0000 7fd0e3400640 1 -- 172.21.15.42:0/3687570900 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0dc103db0 msgr2=0x7fd0dc19a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.783+0000 7fd0e3400640 1 --2- 172.21.15.42:0/3687570900 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0dc103db0 0x7fd0dc19a410 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd0d000e9f0 tx=0x7fd0d000eeb0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.784+0000 7fd0e3400640 1 -- 172.21.15.42:0/3687570900 shutdown_connections 2024-08-26T00:03:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.784+0000 7fd0e3400640 1 --2- 172.21.15.42:0/3687570900 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd0c40a2c80 0x7fd0c40a5140 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.784+0000 7fd0e3400640 1 --2- 172.21.15.42:0/3687570900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0dc108ee0 0x7fd0dc19ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.784+0000 7fd0e3400640 1 --2- 172.21.15.42:0/3687570900 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd0dc104760 0x7fd0dc19a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.784+0000 7fd0e3400640 1 --2- 172.21.15.42:0/3687570900 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0dc103db0 0x7fd0dc19a410 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.784+0000 7fd0e3400640 1 -- 172.21.15.42:0/3687570900 >> 172.21.15.42:0/3687570900 conn(0x7fd0dc0ff7f0 msgr2=0x7fd0dc100b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.784+0000 7fd0e3400640 1 -- 172.21.15.42:0/3687570900 shutdown_connections 2024-08-26T00:03:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:11.784+0000 7fd0e3400640 1 -- 172.21.15.42:0/3687570900 wait complete. 2024-08-26T00:03:12.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:12 smithi043 ceph-mon[22091]: pgmap v359: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-26T00:03:12.290 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:12 smithi181 ceph-mon[22102]: pgmap v359: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-26T00:03:12.290 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:12 smithi042 ceph-mon[17225]: pgmap v359: 97 pgs: 97 active+clean; 652 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-26T00:03:12.525 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-26T00:03:12.525 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:03:12.946 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:03:13.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.571+0000 7fb721200640 1 -- 172.21.15.42:0/140753549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb71c103950 msgr2=0x7fb71c103db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:13.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.571+0000 7fb721200640 1 --2- 172.21.15.42:0/140753549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb71c103950 0x7fb71c103db0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb708009930 tx=0x7fb70802a420 comp rx=0 tx=0).stop 2024-08-26T00:03:13.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.571+0000 7fb721200640 1 -- 172.21.15.42:0/140753549 shutdown_connections 2024-08-26T00:03:13.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.571+0000 7fb721200640 1 --2- 172.21.15.42:0/140753549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb71c1042f0 0x7fb71c110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:13.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.571+0000 7fb721200640 1 --2- 172.21.15.42:0/140753549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb71c103950 0x7fb71c103db0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:13.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.571+0000 7fb721200640 1 --2- 172.21.15.42:0/140753549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb71c109950 0x7fb71c109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:13.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.571+0000 7fb721200640 1 -- 172.21.15.42:0/140753549 >> 172.21.15.42:0/140753549 conn(0x7fb71c0ff610 msgr2=0x7fb71c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:13.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.571+0000 7fb721200640 1 -- 172.21.15.42:0/140753549 shutdown_connections 2024-08-26T00:03:13.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.572+0000 7fb721200640 1 -- 172.21.15.42:0/140753549 wait complete. 2024-08-26T00:03:13.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.572+0000 7fb721200640 1 Processor -- start 2024-08-26T00:03:13.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.573+0000 7fb721200640 1 -- start start 2024-08-26T00:03:13.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.573+0000 7fb721200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb71c1042f0 0x7fb71c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:13.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.573+0000 7fb721200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb71c109950 0x7fb71c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:13.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.573+0000 7fb721200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb71c19ed80 0x7fb71c19f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:13.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.573+0000 7fb721200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb71c113d50 con 0x7fb71c109950 2024-08-26T00:03:13.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.573+0000 7fb721200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb71c113bd0 con 0x7fb71c1042f0 2024-08-26T00:03:13.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.573+0000 7fb721200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb71c113ed0 con 0x7fb71c19ed80 2024-08-26T00:03:13.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.574+0000 7fb71be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb71c19ed80 0x7fb71c19f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:13.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.574+0000 7fb71be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb71c19ed80 0x7fb71c19f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:60066/0 (socket says 172.21.15.42:60066) 2024-08-26T00:03:13.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.574+0000 7fb71be00640 1 -- 172.21.15.42:0/496130469 learned_addr learned my addr 172.21.15.42:0/496130469 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:13.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.574+0000 7fb71b400640 1 --2- 172.21.15.42:0/496130469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb71c1042f0 0x7fb71c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:13.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.574+0000 7fb71aa00640 1 --2- 172.21.15.42:0/496130469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb71c109950 0x7fb71c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:13.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.574+0000 7fb71b400640 1 -- 172.21.15.42:0/496130469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb71c19ed80 msgr2=0x7fb71c19f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:13.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.574+0000 7fb71b400640 1 --2- 172.21.15.42:0/496130469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb71c19ed80 0x7fb71c19f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:13.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.574+0000 7fb71b400640 1 -- 172.21.15.42:0/496130469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb71c109950 msgr2=0x7fb71c19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:13.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.574+0000 7fb71b400640 1 --2- 172.21.15.42:0/496130469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb71c109950 0x7fb71c19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:13.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.574+0000 7fb71b400640 1 -- 172.21.15.42:0/496130469 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb71c19f840 con 0x7fb71c1042f0 2024-08-26T00:03:13.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.575+0000 7fb71aa00640 1 --2- 172.21.15.42:0/496130469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb71c109950 0x7fb71c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:03:13.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.575+0000 7fb71b400640 1 --2- 172.21.15.42:0/496130469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb71c1042f0 0x7fb71c19a4b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00e9f0 tx=0x7fb70c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:13.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.575+0000 7fb713e00640 1 -- 172.21.15.42:0/496130469 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c00ccc0 con 0x7fb71c1042f0 2024-08-26T00:03:13.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.575+0000 7fb721200640 1 -- 172.21.15.42:0/496130469 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb71c19fb30 con 0x7fb71c1042f0 2024-08-26T00:03:13.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.576+0000 7fb713e00640 1 -- 172.21.15.42:0/496130469 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb70c005020 con 0x7fb71c1042f0 2024-08-26T00:03:13.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.576+0000 7fb713e00640 1 -- 172.21.15.42:0/496130469 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c0049e0 con 0x7fb71c1042f0 2024-08-26T00:03:13.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.576+0000 7fb721200640 1 -- 172.21.15.42:0/496130469 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb71c1a7310 con 0x7fb71c1042f0 2024-08-26T00:03:13.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.577+0000 7fb721200640 1 -- 172.21.15.42:0/496130469 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6fc005290 con 0x7fb71c1042f0 2024-08-26T00:03:13.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.580+0000 7fb713e00640 1 -- 172.21.15.42:0/496130469 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb70c004ca0 con 0x7fb71c1042f0 2024-08-26T00:03:13.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.582+0000 7fb713e00640 1 --2- 172.21.15.42:0/496130469 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb7000a2c00 0x7fb7000a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:13.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.583+0000 7fb713e00640 1 -- 172.21.15.42:0/496130469 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb70c0ceea0 con 0x7fb71c1042f0 2024-08-26T00:03:13.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.583+0000 7fb71aa00640 1 --2- 172.21.15.42:0/496130469 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb7000a2c00 0x7fb7000a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:13.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.584+0000 7fb71aa00640 1 --2- 172.21.15.42:0/496130469 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb7000a2c00 0x7fb7000a50c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb708009230 tx=0x7fb708005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:13.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.585+0000 7fb713e00640 1 -- 172.21.15.42:0/496130469 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb70c09bdc0 con 0x7fb71c1042f0 2024-08-26T00:03:13.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.927+0000 7fb721200640 1 -- 172.21.15.42:0/496130469 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6fc005580 con 0x7fb71c1042f0 2024-08-26T00:03:13.930 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:03:13.930 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":24,"btime":"2024-08-26T00:02:28:193800+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3168581452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3168581452},{"type":"v1","addr":"172.21.15.42:6839","nonce":3168581452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/3533492491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":3533492491},{"type":"v1","addr":"172.21.15.42:6841","nonce":3533492491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-26T00:00:30.169633+0000","modified":"2024-08-26T00:02:27.753317+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24532,"mds_1":24527,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6839/2653014277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2653014277},{"type":"v1","addr":"172.21.15.43:6839","nonce":2653014277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24532,"qdb_cluster":[24532,24527,24514]},"id":1}]} 2024-08-26T00:03:13.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.929+0000 7fb713e00640 1 -- 172.21.15.42:0/496130469 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11909 (secure 0 0 0) 0x7fb70c09b6c0 con 0x7fb71c1042f0 2024-08-26T00:03:13.931 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 24 2024-08-26T00:03:13.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.932+0000 7fb721200640 1 -- 172.21.15.42:0/496130469 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb7000a2c00 msgr2=0x7fb7000a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:13.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.932+0000 7fb721200640 1 --2- 172.21.15.42:0/496130469 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb7000a2c00 0x7fb7000a50c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb708009230 tx=0x7fb708005a20 comp rx=0 tx=0).stop 2024-08-26T00:03:13.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.932+0000 7fb721200640 1 -- 172.21.15.42:0/496130469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb71c1042f0 msgr2=0x7fb71c19a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:13.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.932+0000 7fb721200640 1 --2- 172.21.15.42:0/496130469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb71c1042f0 0x7fb71c19a4b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00e9f0 tx=0x7fb70c00eeb0 comp rx=0 tx=0).stop 2024-08-26T00:03:13.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.932+0000 7fb721200640 1 -- 172.21.15.42:0/496130469 shutdown_connections 2024-08-26T00:03:13.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.932+0000 7fb721200640 1 --2- 172.21.15.42:0/496130469 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb7000a2c00 0x7fb7000a50c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:13.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.932+0000 7fb721200640 1 --2- 172.21.15.42:0/496130469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb71c19ed80 0x7fb71c19f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:13.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.932+0000 7fb721200640 1 --2- 172.21.15.42:0/496130469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb71c109950 0x7fb71c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:13.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.932+0000 7fb721200640 1 --2- 172.21.15.42:0/496130469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb71c1042f0 0x7fb71c19a4b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:13.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.932+0000 7fb721200640 1 -- 172.21.15.42:0/496130469 >> 172.21.15.42:0/496130469 conn(0x7fb71c0ff610 msgr2=0x7fb71c1000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:13.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.932+0000 7fb721200640 1 -- 172.21.15.42:0/496130469 shutdown_connections 2024-08-26T00:03:13.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:13.933+0000 7fb721200640 1 -- 172.21.15.42:0/496130469 wait complete. 2024-08-26T00:03:14.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:14 smithi043 ceph-mon[22091]: pgmap v360: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-08-26T00:03:14.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:14 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/496130469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:03:14.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:14 smithi042 ceph-mon[17225]: pgmap v360: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-08-26T00:03:14.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:14 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/496130469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:03:14.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:14 smithi181 ceph-mon[22102]: pgmap v360: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-08-26T00:03:14.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:14 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/496130469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:03:14.716 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-26T00:03:15.219 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:03:15.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.822+0000 7fcd19200640 1 -- 172.21.15.42:0/4184759939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd14074c80 msgr2=0x7fcd1410dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:15.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.822+0000 7fcd19200640 1 --2- 172.21.15.42:0/4184759939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd14074c80 0x7fcd1410dac0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcd00009900 tx=0x7fcd0002a480 comp rx=0 tx=0).stop 2024-08-26T00:03:15.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.822+0000 7fcd19200640 1 -- 172.21.15.42:0/4184759939 shutdown_connections 2024-08-26T00:03:15.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.822+0000 7fcd19200640 1 --2- 172.21.15.42:0/4184759939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd1410e000 0x7fcd141103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.822+0000 7fcd19200640 1 --2- 172.21.15.42:0/4184759939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd14074c80 0x7fcd1410dac0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.822+0000 7fcd19200640 1 --2- 172.21.15.42:0/4184759939 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd14074360 0x7fcd14074740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.822+0000 7fcd19200640 1 -- 172.21.15.42:0/4184759939 >> 172.21.15.42:0/4184759939 conn(0x7fcd140fd4e0 msgr2=0x7fcd140ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:15.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.822+0000 7fcd19200640 1 -- 172.21.15.42:0/4184759939 shutdown_connections 2024-08-26T00:03:15.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.822+0000 7fcd19200640 1 -- 172.21.15.42:0/4184759939 wait complete. 2024-08-26T00:03:15.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.823+0000 7fcd19200640 1 Processor -- start 2024-08-26T00:03:15.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.824+0000 7fcd19200640 1 -- start start 2024-08-26T00:03:15.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.824+0000 7fcd19200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd14074360 0x7fcd1419a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:15.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.824+0000 7fcd19200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd14074c80 0x7fcd1419a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:15.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.824+0000 7fcd19200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd1410e000 0x7fcd1419eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:15.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.824+0000 7fcd19200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcd14113da0 con 0x7fcd14074c80 2024-08-26T00:03:15.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.824+0000 7fcd19200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcd14113c20 con 0x7fcd1410e000 2024-08-26T00:03:15.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.824+0000 7fcd19200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcd14113f20 con 0x7fcd14074360 2024-08-26T00:03:15.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.825+0000 7fcd12a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd14074c80 0x7fcd1419a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:15.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.825+0000 7fcd13e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd1410e000 0x7fcd1419eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:15.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.825+0000 7fcd12a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd14074c80 0x7fcd1419a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43666/0 (socket says 172.21.15.42:43666) 2024-08-26T00:03:15.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.825+0000 7fcd12a00640 1 -- 172.21.15.42:0/2039462493 learned_addr learned my addr 172.21.15.42:0/2039462493 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:15.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.825+0000 7fcd13400640 1 --2- 172.21.15.42:0/2039462493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd14074360 0x7fcd1419a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.825+0000 7fcd13e00640 1 -- 172.21.15.42:0/2039462493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd14074360 msgr2=0x7fcd1419a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.825+0000 7fcd13e00640 1 --2- 172.21.15.42:0/2039462493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd14074360 0x7fcd1419a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.825+0000 7fcd13e00640 1 -- 172.21.15.42:0/2039462493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd14074c80 msgr2=0x7fcd1419a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.825+0000 7fcd13e00640 1 --2- 172.21.15.42:0/2039462493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd14074c80 0x7fcd1419a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.826+0000 7fcd13e00640 1 -- 172.21.15.42:0/2039462493 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd1419f250 con 0x7fcd1410e000 2024-08-26T00:03:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.826+0000 7fcd13e00640 1 --2- 172.21.15.42:0/2039462493 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd1410e000 0x7fcd1419eb70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c005fd0 tx=0x7fcd0c00dea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.826+0000 7fcd0be00640 1 -- 172.21.15.42:0/2039462493 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c00bd40 con 0x7fcd1410e000 2024-08-26T00:03:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.826+0000 7fcd0be00640 1 -- 172.21.15.42:0/2039462493 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd0c003e50 con 0x7fcd1410e000 2024-08-26T00:03:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.826+0000 7fcd19200640 1 -- 172.21.15.42:0/2039462493 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd1419f540 con 0x7fcd1410e000 2024-08-26T00:03:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.827+0000 7fcd0be00640 1 -- 172.21.15.42:0/2039462493 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c0106a0 con 0x7fcd1410e000 2024-08-26T00:03:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.827+0000 7fcd19200640 1 -- 172.21.15.42:0/2039462493 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd141a6e20 con 0x7fcd1410e000 2024-08-26T00:03:15.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.831+0000 7fcd1d3fe740 1 Processor -- start 2024-08-26T00:03:15.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.832+0000 7fcd0be00640 1 -- 172.21.15.42:0/2039462493 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcd0c003970 con 0x7fcd1410e000 2024-08-26T00:03:15.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.832+0000 7fcd1d3fe740 1 -- start start 2024-08-26T00:03:15.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.833+0000 7fcd1d3fe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618bba56a30 0x5618bba56e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:15.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.833+0000 7fcd1d3fe740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba57350 0x5618bba616d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:15.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.833+0000 7fcd1d3fe740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5618bba61c10 0x5618bba64000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:15.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.833+0000 7fcd1d3fe740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5618bb9bcf30 con 0x5618bba61c10 2024-08-26T00:03:15.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.833+0000 7fcd1d3fe740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5618bb9545a0 con 0x5618bba57350 2024-08-26T00:03:15.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.833+0000 7fcd1d3fe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5618bb9b8ef0 con 0x5618bba56a30 2024-08-26T00:03:15.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.833+0000 7fcd13400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba57350 0x5618bba616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:15.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.833+0000 7fcd13400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba57350 0x5618bba616d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:47320/0 (socket says 172.21.15.42:47320) 2024-08-26T00:03:15.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.833+0000 7fcd13400640 1 -- 172.21.15.42:0/443135293 learned_addr learned my addr 172.21.15.42:0/443135293 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:15.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.834+0000 7fcd13400640 1 -- 172.21.15.42:0/443135293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618bba56a30 msgr2=0x5618bba56e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:03:15.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.834+0000 7fcd13400640 1 --2- 172.21.15.42:0/443135293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618bba56a30 0x5618bba56e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.834+0000 7fcd13400640 1 -- 172.21.15.42:0/443135293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5618bba61c10 msgr2=0x5618bba64000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:03:15.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.834+0000 7fcd13400640 1 --2- 172.21.15.42:0/443135293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5618bba61c10 0x5618bba64000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.834+0000 7fcd13400640 1 -- 172.21.15.42:0/443135293 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618bb72e3c0 con 0x5618bba57350 2024-08-26T00:03:15.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.834+0000 7fcd0be00640 1 --2- 172.21.15.42:0/2039462493 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fccf80a2c00 0x7fccf80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:15.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.834+0000 7fcd13400640 1 --2- 172.21.15.42:0/443135293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba57350 0x5618bba616d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009d20 tx=0x7fcd04011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b310dba8e349beb8 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:15.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.834+0000 7fcd0be00640 1 -- 172.21.15.42:0/2039462493 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fcd0c0cf1b0 con 0x7fcd1410e000 2024-08-26T00:03:15.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.835+0000 7fcd12a00640 1 --2- 172.21.15.42:0/2039462493 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fccf80a2c00 0x7fccf80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:15.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.835+0000 7fcd08c00640 1 -- 172.21.15.42:0/443135293 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0401e070 con 0x5618bba57350 2024-08-26T00:03:15.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.835+0000 7fcd08c00640 1 -- 172.21.15.42:0/443135293 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd04019b10 con 0x5618bba57350 2024-08-26T00:03:15.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.835+0000 7fcd08c00640 1 -- 172.21.15.42:0/443135293 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0400eb40 con 0x5618bba57350 2024-08-26T00:03:15.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.836+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/443135293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba57350 msgr2=0x5618bba616d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:15.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.836+0000 7fcd1d3fe740 1 --2- 172.21.15.42:0/443135293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba57350 0x5618bba616d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009d20 tx=0x7fcd04011810 comp rx=0 tx=0).stop 2024-08-26T00:03:15.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.836+0000 7fcd12a00640 1 --2- 172.21.15.42:0/2039462493 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fccf80a2c00 0x7fccf80a50c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x5618bba54340 tx=0x7fcd000046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:15.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.836+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/443135293 shutdown_connections 2024-08-26T00:03:15.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.836+0000 7fcd1d3fe740 1 --2- 172.21.15.42:0/443135293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5618bba61c10 0x5618bba64000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.836+0000 7fcd1d3fe740 1 --2- 172.21.15.42:0/443135293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba57350 0x5618bba616d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.836+0000 7fcd1d3fe740 1 --2- 172.21.15.42:0/443135293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618bba56a30 0x5618bba56e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.836+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/443135293 >> 172.21.15.42:0/443135293 conn(0x5618bba52fc0 msgr2=0x5618bba533a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:15.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.836+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/443135293 shutdown_connections 2024-08-26T00:03:15.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.837+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/443135293 wait complete. 2024-08-26T00:03:15.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.837+0000 7fcd1d3fe740 1 -- start start 2024-08-26T00:03:15.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.837+0000 7fcd1d3fe740 1 Processor -- start 2024-08-26T00:03:15.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.838+0000 7fcd1d3fe740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba56a30 0x5618bba5eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:15.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.838+0000 7fcd1d3fe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618bba57350 0x5618bba5f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:15.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.838+0000 7fcd1d3fe740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5618bba61c10 0x5618bba5f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:15.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.838+0000 7fcd1d3fe740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5618bba6cf00 con 0x5618bba61c10 2024-08-26T00:03:15.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.838+0000 7fcd1d3fe740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5618bb977de0 con 0x5618bba56a30 2024-08-26T00:03:15.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.838+0000 7fcd1d3fe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5618bba6d080 con 0x5618bba57350 2024-08-26T00:03:15.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.838+0000 7fcd1d3fe740 10 client.0 _ll_register_callbacks cb 0x5618bb9667b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:03:15.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.839+0000 7fcd13400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba56a30 0x5618bba5eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:15.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.839+0000 7fcd12a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618bba57350 0x5618bba5f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:15.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.839+0000 7fcd13e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5618bba61c10 0x5618bba5f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:15.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.839+0000 7fcd12a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618bba57350 0x5618bba5f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:33438/0 (socket says 172.21.15.42:33438) 2024-08-26T00:03:15.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.839+0000 7fcd13e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5618bba61c10 0x5618bba5f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43680/0 (socket says 172.21.15.42:43680) 2024-08-26T00:03:15.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.839+0000 7fcd12a00640 1 -- 172.21.15.42:0/1406255502 learned_addr learned my addr 172.21.15.42:0/1406255502 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:15.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.840+0000 7fcd12a00640 1 -- 172.21.15.42:0/1406255502 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba56a30 msgr2=0x5618bba5eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:15.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.840+0000 7fcd12a00640 1 --2- 172.21.15.42:0/1406255502 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba56a30 0x5618bba5eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.840+0000 7fcd12a00640 1 -- 172.21.15.42:0/1406255502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5618bba61c10 msgr2=0x5618bba5f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:15.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.840+0000 7fcd12a00640 1 --2- 172.21.15.42:0/1406255502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5618bba61c10 0x5618bba5f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.840+0000 7fcd12a00640 1 -- 172.21.15.42:0/1406255502 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618bba764f0 con 0x5618bba57350 2024-08-26T00:03:15.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.840+0000 7fcd13e00640 1 --2- 172.21.15.42:0/1406255502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5618bba61c10 0x5618bba5f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:03:15.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.840+0000 7fcd12a00640 1 --2- 172.21.15.42:0/1406255502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618bba57350 0x5618bba5f060 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcd0002aa70 tx=0x7fcd00009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a58d0d9908d0ea4 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:15.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.840+0000 7fccfd600640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:03:15.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.840+0000 7fccfd600640 1 -- 172.21.15.42:0/1406255502 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0004d020 con 0x5618bba57350 2024-08-26T00:03:15.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.841+0000 7fccfd600640 1 -- 172.21.15.42:0/1406255502 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fcd00031c40 con 0x5618bba57350 2024-08-26T00:03:15.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.841+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/1406255502 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd04019b10 con 0x5618bba57350 2024-08-26T00:03:15.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.841+0000 7fccfd600640 1 -- 172.21.15.42:0/1406255502 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcd00035040 con 0x5618bba57350 2024-08-26T00:03:15.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.841+0000 7fcd1d3fe740 10 client.25189 fetch_fsmap learned FSMap version 24 2024-08-26T00:03:15.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.841+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/1406255502 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5618bba78eb0 con 0x5618bba57350 2024-08-26T00:03:15.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.842+0000 7fccfd600640 1 -- 172.21.15.42:0/1406255502 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd00031e40 con 0x5618bba57350 2024-08-26T00:03:15.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.842+0000 7fccfd600640 1 -- 172.21.15.42:0/1406255502 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcd00049830 con 0x5618bba57350 2024-08-26T00:03:15.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.842+0000 7fcd1d3fe740 10 client.25189 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:03:15.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.842+0000 7fcd1d3fe740 10 client.25189 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-26T00:03:15.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.842+0000 7fcd1d3fe740 20 client.25189 populate_metadata read hostname 'smithi042' 2024-08-26T00:03:15.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.842+0000 7fcd1d3fe740 1 --2- 172.21.15.42:0/1406255502 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x5618bba7a3f0 0x5618bba7c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:15.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.842+0000 7fcd1d3fe740 4 client.25189 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:03:15.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.842+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/1406255502 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fcd04019b10 con 0x5618bba7a3f0 2024-08-26T00:03:15.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.843+0000 7fcd13400640 1 --2- 172.21.15.42:0/1406255502 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x5618bba7a3f0 0x5618bba7c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:15.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.843+0000 7fcd13400640 1 --2- 172.21.15.42:0/1406255502 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x5618bba7a3f0 0x5618bba7c7e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b980380b3bc0e14b server_cookie=b048f2a149418933 in_seq=0 out_seq=0 2024-08-26T00:03:15.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.843+0000 7fccfd600640 10 client.25189 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:03:15.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.844+0000 7fccfd600640 1 -- 172.21.15.42:0/1406255502 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fcd04019b10 con 0x5618bba7a3f0 2024-08-26T00:03:15.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.844+0000 7fccfd600640 10 client.25189 handle_command_reply: tid=0 2024-08-26T00:03:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.844+0000 7fcd1d3fe740 1 client.25189 shutdown 2024-08-26T00:03:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.845+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/1406255502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618bba57350 msgr2=0x5618bba5f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.845+0000 7fcd1d3fe740 1 --2- 172.21.15.42:0/1406255502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618bba57350 0x5618bba5f060 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcd0002aa70 tx=0x7fcd00009260 comp rx=0 tx=0).stop 2024-08-26T00:03:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.845+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/1406255502 shutdown_connections 2024-08-26T00:03:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.845+0000 7fcd1d3fe740 1 --2- 172.21.15.42:0/1406255502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5618bba61c10 0x5618bba5f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.845+0000 7fcd1d3fe740 1 --2- 172.21.15.42:0/1406255502 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x5618bba7a3f0 0x5618bba7c7e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.845+0000 7fcd1d3fe740 1 --2- 172.21.15.42:0/1406255502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618bba57350 0x5618bba5f060 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.845+0000 7fcd1d3fe740 1 --2- 172.21.15.42:0/1406255502 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba56a30 0x5618bba5eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.845+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/1406255502 >> 172.21.15.42:0/1406255502 conn(0x5618bba52fc0 msgr2=0x5618bba58ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.845+0000 7fccfd600640 0 client.25189 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:03:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.846+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/1406255502 shutdown_connections 2024-08-26T00:03:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.846+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/1406255502 wait complete. 2024-08-26T00:03:15.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.846+0000 7fcd1d3fe740 20 client.25189 trim_cache size 0 max 16384 2024-08-26T00:03:15.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.873+0000 7fcd1d3fe740 1 Processor -- start 2024-08-26T00:03:15.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.873+0000 7fcd1d3fe740 1 -- start start 2024-08-26T00:03:15.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.873+0000 7fcd1d3fe740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba56a30 0x5618bba5e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:15.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.873+0000 7fcd1d3fe740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5618bba57350 0x5618bba60980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:15.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.873+0000 7fcd1d3fe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618bba61c10 0x5618bba820f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:15.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.873+0000 7fcd1d3fe740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fccf4010d60 con 0x5618bba57350 2024-08-26T00:03:15.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.873+0000 7fcd1d3fe740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fccf400e630 con 0x5618bba56a30 2024-08-26T00:03:15.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.873+0000 7fcd1d3fe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fccf400c460 con 0x5618bba61c10 2024-08-26T00:03:15.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.874+0000 7fcd13400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba56a30 0x5618bba5e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:15.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.874+0000 7fcd13400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba56a30 0x5618bba5e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:47332/0 (socket says 172.21.15.42:47332) 2024-08-26T00:03:15.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.874+0000 7fcd13400640 1 -- 172.21.15.42:0/2455897232 learned_addr learned my addr 172.21.15.42:0/2455897232 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:15.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.874+0000 7fcd13e00640 1 --2- 172.21.15.42:0/2455897232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618bba61c10 0x5618bba820f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:15.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.874+0000 7fcd12a00640 1 --2- 172.21.15.42:0/2455897232 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5618bba57350 0x5618bba60980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:15.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.875+0000 7fcd13400640 1 -- 172.21.15.42:0/2455897232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618bba61c10 msgr2=0x5618bba820f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:15.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.875+0000 7fcd13400640 1 --2- 172.21.15.42:0/2455897232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618bba61c10 0x5618bba820f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.875+0000 7fcd13400640 1 -- 172.21.15.42:0/2455897232 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5618bba57350 msgr2=0x5618bba60980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:15.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.875+0000 7fcd13400640 1 --2- 172.21.15.42:0/2455897232 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5618bba57350 0x5618bba60980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.875+0000 7fcd13400640 1 -- 172.21.15.42:0/2455897232 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618bba5dad0 con 0x5618bba56a30 2024-08-26T00:03:15.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.875+0000 7fcd12a00640 1 --2- 172.21.15.42:0/2455897232 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5618bba57350 0x5618bba60980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:03:15.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.875+0000 7fcd13400640 1 --2- 172.21.15.42:0/2455897232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba56a30 0x5618bba5e3e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400a010 tx=0x7fcd0400e640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46e3fa70270f03b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:15.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.876+0000 7fccffe00640 1 -- 172.21.15.42:0/2455897232 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0401e040 con 0x5618bba56a30 2024-08-26T00:03:15.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.876+0000 7fccffe00640 1 -- 172.21.15.42:0/2455897232 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd04019430 con 0x5618bba56a30 2024-08-26T00:03:15.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.876+0000 7fccffe00640 1 -- 172.21.15.42:0/2455897232 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0400e9b0 con 0x5618bba56a30 2024-08-26T00:03:15.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.877+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/2455897232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba56a30 msgr2=0x5618bba5e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:15.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.877+0000 7fcd1d3fe740 1 --2- 172.21.15.42:0/2455897232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba56a30 0x5618bba5e3e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400a010 tx=0x7fcd0400e640 comp rx=0 tx=0).stop 2024-08-26T00:03:15.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.877+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/2455897232 shutdown_connections 2024-08-26T00:03:15.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.877+0000 7fcd1d3fe740 1 --2- 172.21.15.42:0/2455897232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618bba61c10 0x5618bba820f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.877+0000 7fcd1d3fe740 1 --2- 172.21.15.42:0/2455897232 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5618bba57350 0x5618bba60980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.877+0000 7fcd1d3fe740 1 --2- 172.21.15.42:0/2455897232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba56a30 0x5618bba5e3e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.877+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/2455897232 >> 172.21.15.42:0/2455897232 conn(0x5618bba52fc0 msgr2=0x5618bba60270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:15.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.877+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/2455897232 shutdown_connections 2024-08-26T00:03:15.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.878+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/2455897232 wait complete. 2024-08-26T00:03:15.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.878+0000 7fcd1d3fe740 1 -- start start 2024-08-26T00:03:15.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.878+0000 7fcd1d3fe740 1 Processor -- start 2024-08-26T00:03:15.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.879+0000 7fcd1d3fe740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5618bba56a30 0x5618bba6e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:15.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.879+0000 7fcd1d3fe740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba57350 0x5618bba6e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:15.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.879+0000 7fcd1d3fe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618bba61c10 0x5618bba6ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:15.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.879+0000 7fcd1d3fe740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fccf400caf0 con 0x5618bba56a30 2024-08-26T00:03:15.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.879+0000 7fcd1d3fe740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fccf400df60 con 0x5618bba57350 2024-08-26T00:03:15.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.879+0000 7fcd1d3fe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fccf400d1c0 con 0x5618bba61c10 2024-08-26T00:03:15.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.879+0000 7fcd1d3fe740 10 client.0 _ll_register_callbacks cb 0x7fcd00040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:03:15.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.879+0000 7fcd12a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba57350 0x5618bba6e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:15.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.880+0000 7fcd12a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba57350 0x5618bba6e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:47342/0 (socket says 172.21.15.42:47342) 2024-08-26T00:03:15.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.880+0000 7fcd12a00640 1 -- 172.21.15.42:0/2440738504 learned_addr learned my addr 172.21.15.42:0/2440738504 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:15.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.880+0000 7fcd13e00640 1 --2- 172.21.15.42:0/2440738504 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618bba61c10 0x5618bba6ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:15.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.880+0000 7fcd13400640 1 --2- 172.21.15.42:0/2440738504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5618bba56a30 0x5618bba6e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:15.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.880+0000 7fcd12a00640 1 -- 172.21.15.42:0/2440738504 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618bba61c10 msgr2=0x5618bba6ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:15.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.880+0000 7fcd12a00640 1 --2- 172.21.15.42:0/2440738504 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618bba61c10 0x5618bba6ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.880+0000 7fcd12a00640 1 -- 172.21.15.42:0/2440738504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5618bba56a30 msgr2=0x5618bba6e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:15.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.880+0000 7fcd12a00640 1 --2- 172.21.15.42:0/2440738504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5618bba56a30 0x5618bba6e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.880+0000 7fcd12a00640 1 -- 172.21.15.42:0/2440738504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618bba7cb50 con 0x5618bba57350 2024-08-26T00:03:15.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.880+0000 7fcd13400640 1 --2- 172.21.15.42:0/2440738504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5618bba56a30 0x5618bba6e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:03:15.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.880+0000 7fcd13e00640 1 --2- 172.21.15.42:0/2440738504 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618bba61c10 0x5618bba6ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:03:15.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.881+0000 7fcd12a00640 1 --2- 172.21.15.42:0/2440738504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba57350 0x5618bba6e7a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcd00049e90 tx=0x7fcd000315b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e50c83bb9d20d19 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:15.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.881+0000 7fccfd600640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:03:15.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.881+0000 7fccfd600640 1 -- 172.21.15.42:0/2440738504 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd00062070 con 0x5618bba57350 2024-08-26T00:03:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.881+0000 7fccfd600640 1 -- 172.21.15.42:0/2440738504 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fcd00049950 con 0x5618bba57350 2024-08-26T00:03:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.881+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/2440738504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd04019430 con 0x5618bba57350 2024-08-26T00:03:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.882+0000 7fccfd600640 1 -- 172.21.15.42:0/2440738504 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcd0006e050 con 0x5618bba57350 2024-08-26T00:03:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.882+0000 7fcd1d3fe740 10 client.25184 fetch_fsmap learned FSMap version 24 2024-08-26T00:03:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.882+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/2440738504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5618bbae5250 con 0x5618bba57350 2024-08-26T00:03:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.882+0000 7fccfd600640 1 -- 172.21.15.42:0/2440738504 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd04019430 con 0x5618bba57350 2024-08-26T00:03:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.883+0000 7fccfd600640 1 -- 172.21.15.42:0/2440738504 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcd00003890 con 0x5618bba57350 2024-08-26T00:03:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.883+0000 7fcd1d3fe740 10 client.25184 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:03:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.883+0000 7fcd1d3fe740 10 client.25184 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-26T00:03:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.883+0000 7fcd1d3fe740 20 client.25184 populate_metadata read hostname 'smithi042' 2024-08-26T00:03:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.883+0000 7fcd1d3fe740 1 --2- 172.21.15.42:0/2440738504 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x5618bbae5960 0x5618bbae7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.883+0000 7fcd1d3fe740 4 client.25184 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:03:15.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.883+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/2440738504 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5618bb9ca4a0 con 0x5618bbae5960 2024-08-26T00:03:15.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.883+0000 7fcd13400640 1 --2- 172.21.15.42:0/2440738504 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x5618bbae5960 0x5618bbae7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:15.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.884+0000 7fcd13400640 1 --2- 172.21.15.42:0/2440738504 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x5618bbae5960 0x5618bbae7d80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c092981c2e39a21d server_cookie=3a5f0c9d02eebb8e in_seq=0 out_seq=0 2024-08-26T00:03:15.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.884+0000 7fccfd600640 10 client.25184 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:03:15.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.884+0000 7fccfd600640 1 -- 172.21.15.42:0/2440738504 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5618bb9ca4a0 con 0x5618bbae5960 2024-08-26T00:03:15.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.884+0000 7fccfd600640 10 client.25184 handle_command_reply: tid=0 2024-08-26T00:03:15.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.884+0000 7fcd1d3fe740 1 client.25184 shutdown 2024-08-26T00:03:15.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.885+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/2440738504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba57350 msgr2=0x5618bba6e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:15.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.885+0000 7fcd1d3fe740 1 --2- 172.21.15.42:0/2440738504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba57350 0x5618bba6e7a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcd00049e90 tx=0x7fcd000315b0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.885+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/2440738504 shutdown_connections 2024-08-26T00:03:15.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.885+0000 7fcd1d3fe740 1 --2- 172.21.15.42:0/2440738504 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x5618bbae5960 0x5618bbae7d80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.885+0000 7fcd1d3fe740 1 --2- 172.21.15.42:0/2440738504 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618bba61c10 0x5618bba6ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.885+0000 7fcd1d3fe740 1 --2- 172.21.15.42:0/2440738504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5618bba57350 0x5618bba6e7a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.885+0000 7fcd1d3fe740 1 --2- 172.21.15.42:0/2440738504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5618bba56a30 0x5618bba6e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.885+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/2440738504 >> 172.21.15.42:0/2440738504 conn(0x5618bba52fc0 msgr2=0x5618bba52120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:15.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.885+0000 7fccfd600640 0 client.25184 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:03:15.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.885+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/2440738504 shutdown_connections 2024-08-26T00:03:15.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.885+0000 7fcd1d3fe740 1 -- 172.21.15.42:0/2440738504 wait complete. 2024-08-26T00:03:15.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.886+0000 7fcd1d3fe740 20 client.25184 trim_cache size 0 max 16384 2024-08-26T00:03:15.888 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:03:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.887+0000 7fcd19200640 1 -- 172.21.15.42:0/2039462493 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fccf80a2c00 msgr2=0x7fccf80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.887+0000 7fcd19200640 1 --2- 172.21.15.42:0/2039462493 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fccf80a2c00 0x7fccf80a50c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x5618bba54340 tx=0x7fcd000046c0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.887+0000 7fcd19200640 1 -- 172.21.15.42:0/2039462493 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd1410e000 msgr2=0x7fcd1419eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.887+0000 7fcd19200640 1 --2- 172.21.15.42:0/2039462493 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd1410e000 0x7fcd1419eb70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c005fd0 tx=0x7fcd0c00dea0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.887+0000 7fcd19200640 1 -- 172.21.15.42:0/2039462493 shutdown_connections 2024-08-26T00:03:15.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.887+0000 7fcd19200640 1 --2- 172.21.15.42:0/2039462493 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fccf80a2c00 0x7fccf80a50c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.887+0000 7fcd19200640 1 --2- 172.21.15.42:0/2039462493 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd1410e000 0x7fcd1419eb70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.887+0000 7fcd19200640 1 --2- 172.21.15.42:0/2039462493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd14074c80 0x7fcd1419a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.887+0000 7fcd19200640 1 --2- 172.21.15.42:0/2039462493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd14074360 0x7fcd1419a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:15.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.887+0000 7fcd19200640 1 -- 172.21.15.42:0/2039462493 >> 172.21.15.42:0/2039462493 conn(0x7fcd140fd4e0 msgr2=0x7fcd140fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:15.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.887+0000 7fcd19200640 1 -- 172.21.15.42:0/2039462493 shutdown_connections 2024-08-26T00:03:15.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:15.888+0000 7fcd19200640 1 -- 172.21.15.42:0/2039462493 wait complete. 2024-08-26T00:03:16.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:16 smithi042 ceph-mon[17225]: pgmap v361: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-08-26T00:03:16.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:16 smithi181 ceph-mon[22102]: pgmap v361: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-08-26T00:03:16.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:16 smithi043 ceph-mon[22091]: pgmap v361: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-08-26T00:03:16.902 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-26T00:03:17.342 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:03:18.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.029+0000 7f3f1a200640 1 -- 172.21.15.42:0/4096757428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f140742b0 msgr2=0x7f3f14074690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:18.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.029+0000 7f3f1a200640 1 --2- 172.21.15.42:0/4096757428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f140742b0 0x7f3f14074690 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3f08009860 tx=0x7f3f0802a3d0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.029+0000 7f3f1a200640 1 -- 172.21.15.42:0/4096757428 shutdown_connections 2024-08-26T00:03:18.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.029+0000 7f3f1a200640 1 --2- 172.21.15.42:0/4096757428 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f1410e020 0x7f3f14110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.029+0000 7f3f1a200640 1 --2- 172.21.15.42:0/4096757428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f14074bd0 0x7f3f1410dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.029+0000 7f3f1a200640 1 --2- 172.21.15.42:0/4096757428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f140742b0 0x7f3f14074690 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.029+0000 7f3f1a200640 1 -- 172.21.15.42:0/4096757428 >> 172.21.15.42:0/4096757428 conn(0x7f3f140fd4e0 msgr2=0x7f3f140ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:18.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.029+0000 7f3f1a200640 1 -- 172.21.15.42:0/4096757428 shutdown_connections 2024-08-26T00:03:18.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.029+0000 7f3f1a200640 1 -- 172.21.15.42:0/4096757428 wait complete. 2024-08-26T00:03:18.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.031+0000 7f3f1a200640 1 Processor -- start 2024-08-26T00:03:18.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.031+0000 7f3f1a200640 1 -- start start 2024-08-26T00:03:18.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.032+0000 7f3f1a200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f140742b0 0x7f3f1419a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:18.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.032+0000 7f3f1a200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f14074bd0 0x7f3f1419a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:18.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.032+0000 7f3f1a200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f1410e020 0x7f3f1419eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:18.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.032+0000 7f3f1a200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3f14113d70 con 0x7f3f14074bd0 2024-08-26T00:03:18.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.032+0000 7f3f1a200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3f14113bf0 con 0x7f3f140742b0 2024-08-26T00:03:18.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.032+0000 7f3f1a200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3f14113ef0 con 0x7f3f1410e020 2024-08-26T00:03:18.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.032+0000 7f3f18e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f140742b0 0x7f3f1419a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:18.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.032+0000 7f3f18e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f140742b0 0x7f3f1419a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:47356/0 (socket says 172.21.15.42:47356) 2024-08-26T00:03:18.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.032+0000 7f3f18e00640 1 -- 172.21.15.42:0/2826978300 learned_addr learned my addr 172.21.15.42:0/2826978300 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:18.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.032+0000 7f3f19800640 1 --2- 172.21.15.42:0/2826978300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f1410e020 0x7f3f1419eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:18.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.033+0000 7f3f19800640 1 -- 172.21.15.42:0/2826978300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f140742b0 msgr2=0x7f3f1419a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:18.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.033+0000 7f3f19800640 1 --2- 172.21.15.42:0/2826978300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f140742b0 0x7f3f1419a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.033+0000 7f3f19800640 1 -- 172.21.15.42:0/2826978300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f14074bd0 msgr2=0x7f3f1419a770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-26T00:03:18.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.033+0000 7f3f13e00640 1 --2- 172.21.15.42:0/2826978300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f14074bd0 0x7f3f1419a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:18.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.033+0000 7f3f19800640 1 --2- 172.21.15.42:0/2826978300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f14074bd0 0x7f3f1419a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.033+0000 7f3f19800640 1 -- 172.21.15.42:0/2826978300 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1419f1e0 con 0x7f3f1410e020 2024-08-26T00:03:18.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.033+0000 7f3f13e00640 1 --2- 172.21.15.42:0/2826978300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f14074bd0 0x7f3f1419a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:03:18.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.034+0000 7f3f19800640 1 --2- 172.21.15.42:0/2826978300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f1410e020 0x7f3f1419eb00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c005fd0 tx=0x7f3f0c00c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:18.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.034+0000 7f3f11600640 1 -- 172.21.15.42:0/2826978300 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c004b20 con 0x7f3f1410e020 2024-08-26T00:03:18.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.034+0000 7f3f11600640 1 -- 172.21.15.42:0/2826978300 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f0c003e50 con 0x7f3f1410e020 2024-08-26T00:03:18.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.034+0000 7f3f1a200640 1 -- 172.21.15.42:0/2826978300 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f1419f4d0 con 0x7f3f1410e020 2024-08-26T00:03:18.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.034+0000 7f3f11600640 1 -- 172.21.15.42:0/2826978300 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c00b570 con 0x7f3f1410e020 2024-08-26T00:03:18.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.034+0000 7f3f1a200640 1 -- 172.21.15.42:0/2826978300 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f141a6db0 con 0x7f3f1410e020 2024-08-26T00:03:18.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.039+0000 7f3f1e465740 1 Processor -- start 2024-08-26T00:03:18.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.039+0000 7f3f11600640 1 -- 172.21.15.42:0/2826978300 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3f0c01d020 con 0x7f3f1410e020 2024-08-26T00:03:18.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.039+0000 7f3f1e465740 1 -- start start 2024-08-26T00:03:18.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.040+0000 7f3f1e465740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a057413a30 0x55a057413e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:18.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.040+0000 7f3f1e465740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a057414350 0x55a05741e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:18.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.040+0000 7f3f1e465740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a05741ec10 0x55a057421000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:18.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.040+0000 7f3f1e465740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a057379f30 con 0x55a057413a30 2024-08-26T00:03:18.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.040+0000 7f3f1e465740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a0573115a0 con 0x55a05741ec10 2024-08-26T00:03:18.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.040+0000 7f3f1e465740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a057375ef0 con 0x55a057414350 2024-08-26T00:03:18.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.041+0000 7f3f18e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a057414350 0x55a05741e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:18.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.041+0000 7f3f18e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a057414350 0x55a05741e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:33490/0 (socket says 172.21.15.42:33490) 2024-08-26T00:03:18.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.041+0000 7f3f18e00640 1 -- 172.21.15.42:0/2207950778 learned_addr learned my addr 172.21.15.42:0/2207950778 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:18.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.041+0000 7f3f13e00640 1 --2- 172.21.15.42:0/2207950778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a05741ec10 0x55a057421000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:18.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.041+0000 7f3f13e00640 1 --2- 172.21.15.42:0/2207950778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a057413a30 0x55a057413e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:18.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.042+0000 7f3f13e00640 1 -- 172.21.15.42:0/2207950778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a057414350 msgr2=0x55a05741e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:18.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.042+0000 7f3f13e00640 1 --2- 172.21.15.42:0/2207950778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a057414350 0x55a05741e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.042+0000 7f3f13e00640 1 -- 172.21.15.42:0/2207950778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a057413a30 msgr2=0x55a057413e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:18.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.042+0000 7f3f13e00640 1 --2- 172.21.15.42:0/2207950778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a057413a30 0x55a057413e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.042+0000 7f3f13e00640 1 -- 172.21.15.42:0/2207950778 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0570eb3c0 con 0x55a05741ec10 2024-08-26T00:03:18.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.042+0000 7f3f11600640 1 --2- 172.21.15.42:0/2826978300 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3efc0ab410 0x7f3efc0ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:18.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.042+0000 7f3f11600640 1 -- 172.21.15.42:0/2826978300 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f3f0c0cee90 con 0x7f3f1410e020 2024-08-26T00:03:18.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.043+0000 7f3f13e00640 1 --2- 172.21.15.42:0/2207950778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a05741ec10 0x55a057421000 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3f00005d00 tx=0x7f3f00005c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a973db75c4cd4b78 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:18.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.043+0000 7f3f18e00640 1 --2- 172.21.15.42:0/2826978300 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3efc0ab410 0x7f3efc0ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:18.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.043+0000 7f3f06000640 1 -- 172.21.15.42:0/2207950778 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f00004020 con 0x55a05741ec10 2024-08-26T00:03:18.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.043+0000 7f3f06000640 1 -- 172.21.15.42:0/2207950778 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f000041c0 con 0x55a05741ec10 2024-08-26T00:03:18.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.043+0000 7f3f06000640 1 -- 172.21.15.42:0/2207950778 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f00003830 con 0x55a05741ec10 2024-08-26T00:03:18.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.044+0000 7f3f1e465740 1 -- 172.21.15.42:0/2207950778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a05741ec10 msgr2=0x55a057421000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:18.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.044+0000 7f3f1e465740 1 --2- 172.21.15.42:0/2207950778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a05741ec10 0x55a057421000 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3f00005d00 tx=0x7f3f00005c50 comp rx=0 tx=0).stop 2024-08-26T00:03:18.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.044+0000 7f3f18e00640 1 --2- 172.21.15.42:0/2826978300 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3efc0ab410 0x7f3efc0ad8d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3f080095f0 tx=0x7f3f08005cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:18.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.045+0000 7f3f1e465740 1 -- 172.21.15.42:0/2207950778 shutdown_connections 2024-08-26T00:03:18.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.045+0000 7f3f1e465740 1 --2- 172.21.15.42:0/2207950778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a05741ec10 0x55a057421000 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.045+0000 7f3f1e465740 1 --2- 172.21.15.42:0/2207950778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a057414350 0x55a05741e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.045+0000 7f3f1e465740 1 --2- 172.21.15.42:0/2207950778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a057413a30 0x55a057413e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.045+0000 7f3f1e465740 1 -- 172.21.15.42:0/2207950778 >> 172.21.15.42:0/2207950778 conn(0x55a05740ffc0 msgr2=0x55a0574103a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:18.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.045+0000 7f3f1e465740 1 -- 172.21.15.42:0/2207950778 shutdown_connections 2024-08-26T00:03:18.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.045+0000 7f3f1e465740 1 -- 172.21.15.42:0/2207950778 wait complete. 2024-08-26T00:03:18.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.045+0000 7f3f1e465740 1 -- start start 2024-08-26T00:03:18.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.046+0000 7f3f1e465740 1 Processor -- start 2024-08-26T00:03:18.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.047+0000 7f3f1e465740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a057413a30 0x55a05741bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:18.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.047+0000 7f3f1e465740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a057414350 0x55a05741c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:18.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.047+0000 7f3f1e465740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a05741ec10 0x55a05741c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:18.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.047+0000 7f3f1e465740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a0574217e0 con 0x55a057414350 2024-08-26T00:03:18.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.047+0000 7f3f1e465740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a057334de0 con 0x55a057413a30 2024-08-26T00:03:18.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.047+0000 7f3f1e465740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a057421960 con 0x55a05741ec10 2024-08-26T00:03:18.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.047+0000 7f3f1e465740 10 client.0 _ll_register_callbacks cb 0x55a0573237b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:03:18.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.047+0000 7f3f13e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a057414350 0x55a05741c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:18.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.047+0000 7f3f13e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a057414350 0x55a05741c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43710/0 (socket says 172.21.15.42:43710) 2024-08-26T00:03:18.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.047+0000 7f3f13e00640 1 -- 172.21.15.42:0/3152145972 learned_addr learned my addr 172.21.15.42:0/3152145972 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:18.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.047+0000 7f3f18e00640 1 --2- 172.21.15.42:0/3152145972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a057413a30 0x55a05741bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:18.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.048+0000 7f3f19800640 1 --2- 172.21.15.42:0/3152145972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a05741ec10 0x55a05741c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:18.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.048+0000 7f3f13e00640 1 -- 172.21.15.42:0/3152145972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a05741ec10 msgr2=0x55a05741c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:18.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.048+0000 7f3f13e00640 1 --2- 172.21.15.42:0/3152145972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a05741ec10 0x55a05741c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.048+0000 7f3f13e00640 1 -- 172.21.15.42:0/3152145972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a057413a30 msgr2=0x55a05741bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:18.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.048+0000 7f3f13e00640 1 --2- 172.21.15.42:0/3152145972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a057413a30 0x55a05741bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.048+0000 7f3f13e00640 1 -- 172.21.15.42:0/3152145972 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a05742ac50 con 0x55a057414350 2024-08-26T00:03:18.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.048+0000 7f3f19800640 1 --2- 172.21.15.42:0/3152145972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a05741ec10 0x55a05741c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:03:18.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.049+0000 7f3f13e00640 1 --2- 172.21.15.42:0/3152145972 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a057414350 0x55a05741c050 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3f00014440 tx=0x7f3f00005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5c58fe523c56e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:18.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.049+0000 7f3efaa00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:03:18.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.049+0000 7f3efaa00640 1 -- 172.21.15.42:0/3152145972 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f00024030 con 0x55a057414350 2024-08-26T00:03:18.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.049+0000 7f3efaa00640 1 -- 172.21.15.42:0/3152145972 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f3f00004370 con 0x55a057414350 2024-08-26T00:03:18.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.049+0000 7f3f1e465740 1 -- 172.21.15.42:0/3152145972 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f000041c0 con 0x55a057414350 2024-08-26T00:03:18.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.050+0000 7f3efaa00640 1 -- 172.21.15.42:0/3152145972 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3f00014510 con 0x55a057414350 2024-08-26T00:03:18.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.050+0000 7f3f1e465740 10 client.15177 fetch_fsmap learned FSMap version 24 2024-08-26T00:03:18.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.050+0000 7f3f1e465740 1 -- 172.21.15.42:0/3152145972 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a05742d5e0 con 0x55a057414350 2024-08-26T00:03:18.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.050+0000 7f3efaa00640 1 -- 172.21.15.42:0/3152145972 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f000041c0 con 0x55a057414350 2024-08-26T00:03:18.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.051+0000 7f3efaa00640 1 -- 172.21.15.42:0/3152145972 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3f00020970 con 0x55a057414350 2024-08-26T00:03:18.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.051+0000 7f3f1e465740 10 client.15177 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:03:18.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.051+0000 7f3f1e465740 10 client.15177 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-26T00:03:18.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.051+0000 7f3f1e465740 20 client.15177 populate_metadata read hostname 'smithi042' 2024-08-26T00:03:18.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.051+0000 7f3f1e465740 1 --2- 172.21.15.42:0/3152145972 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55a05742e990 0x55a057430d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:18.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.051+0000 7f3f1e465740 4 client.15177 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:03:18.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.051+0000 7f3f1e465740 1 -- 172.21.15.42:0/3152145972 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0573874a0 con 0x55a05742e990 2024-08-26T00:03:18.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.052+0000 7f3f18e00640 1 --2- 172.21.15.42:0/3152145972 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55a05742e990 0x55a057430d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:18.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.053+0000 7f3f18e00640 1 --2- 172.21.15.42:0/3152145972 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55a05742e990 0x55a057430d80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=472e23592f70a2e server_cookie=eb6e8c771fd94307 in_seq=0 out_seq=0 2024-08-26T00:03:18.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.053+0000 7f3efaa00640 10 client.15177 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:03:18.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.053+0000 7f3efaa00640 1 -- 172.21.15.42:0/3152145972 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a0573874a0 con 0x55a05742e990 2024-08-26T00:03:18.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.053+0000 7f3efaa00640 10 client.15177 handle_command_reply: tid=0 2024-08-26T00:03:18.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.053+0000 7f3f1e465740 1 client.15177 shutdown 2024-08-26T00:03:18.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.054+0000 7f3f1e465740 1 -- 172.21.15.42:0/3152145972 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a057414350 msgr2=0x55a05741c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:18.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.054+0000 7f3f1e465740 1 --2- 172.21.15.42:0/3152145972 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a057414350 0x55a05741c050 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3f00014440 tx=0x7f3f00005870 comp rx=0 tx=0).stop 2024-08-26T00:03:18.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.054+0000 7f3f1e465740 1 -- 172.21.15.42:0/3152145972 shutdown_connections 2024-08-26T00:03:18.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.054+0000 7f3f1e465740 1 --2- 172.21.15.42:0/3152145972 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55a05742e990 0x55a057430d80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.054+0000 7f3f1e465740 1 --2- 172.21.15.42:0/3152145972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a05741ec10 0x55a05741c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.054+0000 7f3f1e465740 1 --2- 172.21.15.42:0/3152145972 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a057414350 0x55a05741c050 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.054+0000 7f3efaa00640 0 client.15177 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:03:18.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.054+0000 7f3f1e465740 1 --2- 172.21.15.42:0/3152145972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a057413a30 0x55a05741bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.054+0000 7f3f1e465740 1 -- 172.21.15.42:0/3152145972 >> 172.21.15.42:0/3152145972 conn(0x55a05740ffc0 msgr2=0x55a057415cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:18.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.055+0000 7f3f1e465740 1 -- 172.21.15.42:0/3152145972 shutdown_connections 2024-08-26T00:03:18.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.055+0000 7f3f1e465740 1 -- 172.21.15.42:0/3152145972 wait complete. 2024-08-26T00:03:18.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.055+0000 7f3f1e465740 20 client.15177 trim_cache size 0 max 16384 2024-08-26T00:03:18.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.082+0000 7f3f1e465740 1 Processor -- start 2024-08-26T00:03:18.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.083+0000 7f3f1e465740 1 -- start start 2024-08-26T00:03:18.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.083+0000 7f3f1e465740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a057413a30 0x55a05741d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:18.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.083+0000 7f3f1e465740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a057414350 0x55a0574365e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:18.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.083+0000 7f3f1e465740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a05741ec10 0x55a057436b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:18.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.083+0000 7f3f1e465740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3f141ad8c0 con 0x55a057414350 2024-08-26T00:03:18.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.083+0000 7f3f1e465740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3f141ab190 con 0x55a057413a30 2024-08-26T00:03:18.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.083+0000 7f3f1e465740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3f141a8fc0 con 0x55a05741ec10 2024-08-26T00:03:18.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.084+0000 7f3f18e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a057413a30 0x55a05741d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:18.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.084+0000 7f3f18e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a057413a30 0x55a05741d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:47404/0 (socket says 172.21.15.42:47404) 2024-08-26T00:03:18.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.084+0000 7f3f18e00640 1 -- 172.21.15.42:0/3198889350 learned_addr learned my addr 172.21.15.42:0/3198889350 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:18.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.084+0000 7f3f13e00640 1 --2- 172.21.15.42:0/3198889350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a057414350 0x55a0574365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:18.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.084+0000 7f3f18e00640 1 -- 172.21.15.42:0/3198889350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a05741ec10 msgr2=0x55a057436b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:03:18.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.084+0000 7f3f18e00640 1 --2- 172.21.15.42:0/3198889350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a05741ec10 0x55a057436b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.084+0000 7f3f18e00640 1 -- 172.21.15.42:0/3198889350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a057414350 msgr2=0x55a0574365e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:18.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.084+0000 7f3f18e00640 1 --2- 172.21.15.42:0/3198889350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a057414350 0x55a0574365e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.084+0000 7f3f18e00640 1 -- 172.21.15.42:0/3198889350 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0574310f0 con 0x55a057413a30 2024-08-26T00:03:18.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.084+0000 7f3f13e00640 1 --2- 172.21.15.42:0/3198889350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a057414350 0x55a0574365e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:03:18.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.085+0000 7f3f18e00640 1 --2- 172.21.15.42:0/3198889350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a057413a30 0x55a05741d970 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3f08009980 tx=0x7f3f08045000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a014a8c0d8789a server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:18.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.085+0000 7f3f05600640 1 -- 172.21.15.42:0/3198889350 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0805a070 con 0x55a057413a30 2024-08-26T00:03:18.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.085+0000 7f3f05600640 1 -- 172.21.15.42:0/3198889350 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f080035f0 con 0x55a057413a30 2024-08-26T00:03:18.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.085+0000 7f3f05600640 1 -- 172.21.15.42:0/3198889350 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f080545a0 con 0x55a057413a30 2024-08-26T00:03:18.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.086+0000 7f3f1e465740 1 -- 172.21.15.42:0/3198889350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a057413a30 msgr2=0x55a05741d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:18.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.086+0000 7f3f1e465740 1 --2- 172.21.15.42:0/3198889350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a057413a30 0x55a05741d970 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3f08009980 tx=0x7f3f08045000 comp rx=0 tx=0).stop 2024-08-26T00:03:18.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.087+0000 7f3f1e465740 1 -- 172.21.15.42:0/3198889350 shutdown_connections 2024-08-26T00:03:18.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.087+0000 7f3f1e465740 1 --2- 172.21.15.42:0/3198889350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a05741ec10 0x55a057436b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.087+0000 7f3f1e465740 1 --2- 172.21.15.42:0/3198889350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a057414350 0x55a0574365e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.087+0000 7f3f1e465740 1 --2- 172.21.15.42:0/3198889350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a057413a30 0x55a05741d970 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.087+0000 7f3f1e465740 1 -- 172.21.15.42:0/3198889350 >> 172.21.15.42:0/3198889350 conn(0x55a05740ffc0 msgr2=0x55a05741d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:18.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.087+0000 7f3f1e465740 1 -- 172.21.15.42:0/3198889350 shutdown_connections 2024-08-26T00:03:18.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.087+0000 7f3f1e465740 1 -- 172.21.15.42:0/3198889350 wait complete. 2024-08-26T00:03:18.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.088+0000 7f3f1e465740 1 -- start start 2024-08-26T00:03:18.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.088+0000 7f3f1e465740 1 Processor -- start 2024-08-26T00:03:18.091 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:18 smithi042 ceph-mon[17225]: pgmap v362: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-08-26T00:03:18.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.089+0000 7f3f1e465740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a057413a30 0x55a057422110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:18.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.089+0000 7f3f1e465740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a057414350 0x55a057422650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:18.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.089+0000 7f3f1e465740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a05741ec10 0x55a0574975a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:18.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.089+0000 7f3f1e465740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3f141a9650 con 0x55a05741ec10 2024-08-26T00:03:18.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.089+0000 7f3f1e465740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3f141aaac0 con 0x55a057413a30 2024-08-26T00:03:18.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.089+0000 7f3f1e465740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3f141a9d20 con 0x55a057414350 2024-08-26T00:03:18.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.089+0000 7f3f1e465740 10 client.0 _ll_register_callbacks cb 0x7f3f00009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:03:18.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.091+0000 7f3f18e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a057413a30 0x55a057422110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:18.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.091+0000 7f3f18e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a057413a30 0x55a057422110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:47410/0 (socket says 172.21.15.42:47410) 2024-08-26T00:03:18.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.091+0000 7f3f18e00640 1 -- 172.21.15.42:0/1468391678 learned_addr learned my addr 172.21.15.42:0/1468391678 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:18.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.091+0000 7f3f13e00640 1 --2- 172.21.15.42:0/1468391678 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a057414350 0x55a057422650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:18.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.091+0000 7f3f19800640 1 --2- 172.21.15.42:0/1468391678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a05741ec10 0x55a0574975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:18.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.091+0000 7f3f18e00640 1 -- 172.21.15.42:0/1468391678 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a057414350 msgr2=0x55a057422650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:18.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.091+0000 7f3f18e00640 1 --2- 172.21.15.42:0/1468391678 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a057414350 0x55a057422650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.091+0000 7f3f18e00640 1 -- 172.21.15.42:0/1468391678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a05741ec10 msgr2=0x55a0574975a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:18.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.092+0000 7f3f18e00640 1 --2- 172.21.15.42:0/1468391678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a05741ec10 0x55a0574975a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.092+0000 7f3f18e00640 1 -- 172.21.15.42:0/1468391678 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a057497ae0 con 0x55a057413a30 2024-08-26T00:03:18.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.092+0000 7f3f19800640 1 --2- 172.21.15.42:0/1468391678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a05741ec10 0x55a0574975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:03:18.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.092+0000 7f3f18e00640 1 --2- 172.21.15.42:0/1468391678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a057413a30 0x55a057422110 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3f08009780 tx=0x7f3f080305a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bdf454d8f027835 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:18.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.092+0000 7f3efaa00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:03:18.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.093+0000 7f3efaa00640 1 -- 172.21.15.42:0/1468391678 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0805a040 con 0x55a057413a30 2024-08-26T00:03:18.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.093+0000 7f3efaa00640 1 -- 172.21.15.42:0/1468391678 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f3f080037a0 con 0x55a057413a30 2024-08-26T00:03:18.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.093+0000 7f3f1e465740 1 -- 172.21.15.42:0/1468391678 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f080035f0 con 0x55a057413a30 2024-08-26T00:03:18.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.094+0000 7f3efaa00640 1 -- 172.21.15.42:0/1468391678 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3f080039a0 con 0x55a057413a30 2024-08-26T00:03:18.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.094+0000 7f3f1e465740 10 client.25202 fetch_fsmap learned FSMap version 24 2024-08-26T00:03:18.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.094+0000 7f3f1e465740 1 -- 172.21.15.42:0/1468391678 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a057498de0 con 0x55a057413a30 2024-08-26T00:03:18.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.094+0000 7f3efaa00640 1 -- 172.21.15.42:0/1468391678 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f080035f0 con 0x55a057413a30 2024-08-26T00:03:18.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.094+0000 7f3efaa00640 1 -- 172.21.15.42:0/1468391678 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3f08066030 con 0x55a057413a30 2024-08-26T00:03:18.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.095+0000 7f3f1e465740 10 client.25202 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:03:18.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.095+0000 7f3f1e465740 10 client.25202 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-26T00:03:18.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.095+0000 7f3f1e465740 20 client.25202 populate_metadata read hostname 'smithi042' 2024-08-26T00:03:18.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.095+0000 7f3f1e465740 1 --2- 172.21.15.42:0/1468391678 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55a0574994d0 0x55a05749b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:18.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.095+0000 7f3f1e465740 4 client.25202 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:03:18.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.095+0000 7f3f1e465740 1 -- 172.21.15.42:0/1468391678 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a0573819b0 con 0x55a0574994d0 2024-08-26T00:03:18.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.095+0000 7f3f13e00640 1 --2- 172.21.15.42:0/1468391678 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55a0574994d0 0x55a05749b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:18.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.096+0000 7f3f13e00640 1 --2- 172.21.15.42:0/1468391678 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55a0574994d0 0x55a05749b8f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=370e074597c7665c server_cookie=25fcfade6f810a15 in_seq=0 out_seq=0 2024-08-26T00:03:18.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.096+0000 7f3efaa00640 10 client.25202 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:03:18.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.096+0000 7f3efaa00640 1 -- 172.21.15.42:0/1468391678 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a0573819b0 con 0x55a0574994d0 2024-08-26T00:03:18.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.096+0000 7f3efaa00640 10 client.25202 handle_command_reply: tid=0 2024-08-26T00:03:18.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.096+0000 7f3f1e465740 1 client.25202 shutdown 2024-08-26T00:03:18.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.097+0000 7f3f1e465740 1 -- 172.21.15.42:0/1468391678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a057413a30 msgr2=0x55a057422110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:18.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.097+0000 7f3f1e465740 1 --2- 172.21.15.42:0/1468391678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a057413a30 0x55a057422110 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3f08009780 tx=0x7f3f080305a0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.098+0000 7f3f1e465740 1 -- 172.21.15.42:0/1468391678 shutdown_connections 2024-08-26T00:03:18.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.098+0000 7f3f1e465740 1 --2- 172.21.15.42:0/1468391678 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55a0574994d0 0x55a05749b8f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.098+0000 7f3f1e465740 1 --2- 172.21.15.42:0/1468391678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a05741ec10 0x55a0574975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.098+0000 7f3f1e465740 1 --2- 172.21.15.42:0/1468391678 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a057414350 0x55a057422650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.098+0000 7f3f1e465740 1 --2- 172.21.15.42:0/1468391678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a057413a30 0x55a057422110 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.098+0000 7f3f1e465740 1 -- 172.21.15.42:0/1468391678 >> 172.21.15.42:0/1468391678 conn(0x55a05740ffc0 msgr2=0x55a05741c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:18.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.098+0000 7f3efaa00640 0 client.25202 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:03:18.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.098+0000 7f3f1e465740 1 -- 172.21.15.42:0/1468391678 shutdown_connections 2024-08-26T00:03:18.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.098+0000 7f3f1e465740 1 -- 172.21.15.42:0/1468391678 wait complete. 2024-08-26T00:03:18.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.099+0000 7f3f1e465740 20 client.25202 trim_cache size 0 max 16384 2024-08-26T00:03:18.102 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:03:18.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.100+0000 7f3f1a200640 1 -- 172.21.15.42:0/2826978300 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3efc0ab410 msgr2=0x7f3efc0ad8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:18.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.100+0000 7f3f1a200640 1 --2- 172.21.15.42:0/2826978300 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3efc0ab410 0x7f3efc0ad8d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3f080095f0 tx=0x7f3f08005cb0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.100+0000 7f3f1a200640 1 -- 172.21.15.42:0/2826978300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f1410e020 msgr2=0x7f3f1419eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:18.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.100+0000 7f3f1a200640 1 --2- 172.21.15.42:0/2826978300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f1410e020 0x7f3f1419eb00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c005fd0 tx=0x7f3f0c00c740 comp rx=0 tx=0).stop 2024-08-26T00:03:18.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.100+0000 7f3f1a200640 1 -- 172.21.15.42:0/2826978300 shutdown_connections 2024-08-26T00:03:18.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.100+0000 7f3f1a200640 1 --2- 172.21.15.42:0/2826978300 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3efc0ab410 0x7f3efc0ad8d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.100+0000 7f3f1a200640 1 --2- 172.21.15.42:0/2826978300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f1410e020 0x7f3f1419eb00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.100+0000 7f3f1a200640 1 --2- 172.21.15.42:0/2826978300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f14074bd0 0x7f3f1419a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.100+0000 7f3f1a200640 1 --2- 172.21.15.42:0/2826978300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f140742b0 0x7f3f1419a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:18.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.100+0000 7f3f1a200640 1 -- 172.21.15.42:0/2826978300 >> 172.21.15.42:0/2826978300 conn(0x7f3f140fd4e0 msgr2=0x7f3f140fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:18.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.100+0000 7f3f1a200640 1 -- 172.21.15.42:0/2826978300 shutdown_connections 2024-08-26T00:03:18.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:18.101+0000 7f3f1a200640 1 -- 172.21.15.42:0/2826978300 wait complete. 2024-08-26T00:03:18.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:18 smithi181 ceph-mon[22102]: pgmap v362: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-08-26T00:03:18.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:18 smithi043 ceph-mon[22091]: pgmap v362: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-08-26T00:03:18.942 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-26T00:03:19.381 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:03:19.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.980+0000 7f31cce00640 1 -- 172.21.15.42:0/2311620287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31c8102900 msgr2=0x7f31c8102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:19.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.980+0000 7f31cce00640 1 --2- 172.21.15.42:0/2311620287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31c8102900 0x7f31c8102ce0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009900 tx=0x7f31b802a480 comp rx=0 tx=0).stop 2024-08-26T00:03:19.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.980+0000 7f31cce00640 1 -- 172.21.15.42:0/2311620287 shutdown_connections 2024-08-26T00:03:19.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.980+0000 7f31cce00640 1 --2- 172.21.15.42:0/2311620287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31c810bd30 0x7f31c810e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:19.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.980+0000 7f31cce00640 1 --2- 172.21.15.42:0/2311620287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31c8103220 0x7f31c810b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:19.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.980+0000 7f31cce00640 1 --2- 172.21.15.42:0/2311620287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31c8102900 0x7f31c8102ce0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:19.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.980+0000 7f31cce00640 1 -- 172.21.15.42:0/2311620287 >> 172.21.15.42:0/2311620287 conn(0x7f31c80fc360 msgr2=0x7f31c80fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:19.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.980+0000 7f31cce00640 1 -- 172.21.15.42:0/2311620287 shutdown_connections 2024-08-26T00:03:19.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.981+0000 7f31cce00640 1 -- 172.21.15.42:0/2311620287 wait complete. 2024-08-26T00:03:19.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.982+0000 7f31cce00640 1 Processor -- start 2024-08-26T00:03:19.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.982+0000 7f31cce00640 1 -- start start 2024-08-26T00:03:19.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.983+0000 7f31cce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31c8102900 0x7f31c819a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:19.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.983+0000 7f31cce00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31c8103220 0x7f31c819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:19.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.983+0000 7f31cce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31c810bd30 0x7f31c819eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:19.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.983+0000 7f31cce00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f31c8111b80 con 0x7f31c8102900 2024-08-26T00:03:19.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.983+0000 7f31cce00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f31c8111a00 con 0x7f31c810bd30 2024-08-26T00:03:19.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.983+0000 7f31cce00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f31c8111d00 con 0x7f31c8103220 2024-08-26T00:03:19.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.983+0000 7f31c7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31c810bd30 0x7f31c819eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:19.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.983+0000 7f31c7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31c810bd30 0x7f31c819eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:47434/0 (socket says 172.21.15.42:47434) 2024-08-26T00:03:19.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.983+0000 7f31c7e00640 1 -- 172.21.15.42:0/3091413609 learned_addr learned my addr 172.21.15.42:0/3091413609 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:19.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.983+0000 7f31c7400640 1 --2- 172.21.15.42:0/3091413609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31c8102900 0x7f31c819a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:19.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.983+0000 7f31c6a00640 1 --2- 172.21.15.42:0/3091413609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31c8103220 0x7f31c819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:19.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.984+0000 7f31c7e00640 1 -- 172.21.15.42:0/3091413609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31c8103220 msgr2=0x7f31c819a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:19.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.984+0000 7f31c7e00640 1 --2- 172.21.15.42:0/3091413609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31c8103220 0x7f31c819a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:19.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.984+0000 7f31c7e00640 1 -- 172.21.15.42:0/3091413609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31c8102900 msgr2=0x7f31c819a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:19.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.984+0000 7f31c7e00640 1 --2- 172.21.15.42:0/3091413609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31c8102900 0x7f31c819a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:19.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.984+0000 7f31c7e00640 1 -- 172.21.15.42:0/3091413609 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c819f180 con 0x7f31c810bd30 2024-08-26T00:03:19.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.984+0000 7f31c7400640 1 --2- 172.21.15.42:0/3091413609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31c8102900 0x7f31c819a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:03:19.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.985+0000 7f31c7e00640 1 --2- 172.21.15.42:0/3091413609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31c810bd30 0x7f31c819eaa0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f31c000eb10 tx=0x7f31c000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:19.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.985+0000 7f31bfe00640 1 -- 172.21.15.42:0/3091413609 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c0004b20 con 0x7f31c810bd30 2024-08-26T00:03:19.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.985+0000 7f31bfe00640 1 -- 172.21.15.42:0/3091413609 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31c0004cc0 con 0x7f31c810bd30 2024-08-26T00:03:19.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.985+0000 7f31cce00640 1 -- 172.21.15.42:0/3091413609 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c819f470 con 0x7f31c810bd30 2024-08-26T00:03:19.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.985+0000 7f31bfe00640 1 -- 172.21.15.42:0/3091413609 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c0010760 con 0x7f31c810bd30 2024-08-26T00:03:19.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.985+0000 7f31cce00640 1 -- 172.21.15.42:0/3091413609 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c81a6d50 con 0x7f31c810bd30 2024-08-26T00:03:19.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.990+0000 7f31d0e07740 1 Processor -- start 2024-08-26T00:03:19.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.991+0000 7f31bfe00640 1 -- 172.21.15.42:0/3091413609 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f31c0005020 con 0x7f31c810bd30 2024-08-26T00:03:19.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.991+0000 7f31d0e07740 1 -- start start 2024-08-26T00:03:19.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.991+0000 7f31d0e07740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acccd90a30 0x55acccd90e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:19.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.991+0000 7f31d0e07740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55acccd91350 0x55acccd9b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:19.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.991+0000 7f31d0e07740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd9bc10 0x55acccd9e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:19.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.991+0000 7f31d0e07740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55accccf6f30 con 0x55acccd90a30 2024-08-26T00:03:19.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.991+0000 7f31d0e07740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55acccc8e5a0 con 0x55acccd9bc10 2024-08-26T00:03:19.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.991+0000 7f31d0e07740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55accccf2ef0 con 0x55acccd91350 2024-08-26T00:03:19.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.992+0000 7f31c6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acccd90a30 0x55acccd90e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:19.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.992+0000 7f31c7400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55acccd91350 0x55acccd9b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:19.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.992+0000 7f31c7400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55acccd91350 0x55acccd9b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:33552/0 (socket says 172.21.15.42:33552) 2024-08-26T00:03:19.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.992+0000 7f31c7400640 1 -- 172.21.15.42:0/4290809863 learned_addr learned my addr 172.21.15.42:0/4290809863 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:19.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.992+0000 7f31c6a00640 1 --2- 172.21.15.42:0/4290809863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd9bc10 0x55acccd9e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:19.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.993+0000 7f31c7400640 1 -- 172.21.15.42:0/4290809863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd9bc10 msgr2=0x55acccd9e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:19.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.993+0000 7f31c7400640 1 --2- 172.21.15.42:0/4290809863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd9bc10 0x55acccd9e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:19.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.993+0000 7f31c7400640 1 -- 172.21.15.42:0/4290809863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acccd90a30 msgr2=0x55acccd90e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:19.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.993+0000 7f31c7400640 1 --2- 172.21.15.42:0/4290809863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acccd90a30 0x55acccd90e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:19.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.993+0000 7f31c7400640 1 -- 172.21.15.42:0/4290809863 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55accca683c0 con 0x55acccd91350 2024-08-26T00:03:19.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.993+0000 7f31bfe00640 1 --2- 172.21.15.42:0/3091413609 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f31ac0a2c00 0x7f31ac0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:19.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.993+0000 7f31c7400640 1 --2- 172.21.15.42:0/4290809863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55acccd91350 0x55acccd9b6d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009900 tx=0x7f31b80044a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d966faa68a2e390 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:19.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.994+0000 7f31bfe00640 1 -- 172.21.15.42:0/3091413609 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f31c00cf630 con 0x7f31c810bd30 2024-08-26T00:03:19.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.994+0000 7f31bcc00640 1 -- 172.21.15.42:0/4290809863 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8035040 con 0x55acccd91350 2024-08-26T00:03:19.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.994+0000 7f31bcc00640 1 -- 172.21.15.42:0/4290809863 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31b8004760 con 0x55acccd91350 2024-08-26T00:03:19.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.994+0000 7f31bcc00640 1 -- 172.21.15.42:0/4290809863 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8003a90 con 0x55acccd91350 2024-08-26T00:03:19.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.995+0000 7f31c6a00640 1 --2- 172.21.15.42:0/3091413609 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f31ac0a2c00 0x7f31ac0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:19.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.995+0000 7f31d0e07740 1 -- 172.21.15.42:0/4290809863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55acccd91350 msgr2=0x55acccd9b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:19.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.995+0000 7f31d0e07740 1 --2- 172.21.15.42:0/4290809863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55acccd91350 0x55acccd9b6d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009900 tx=0x7f31b80044a0 comp rx=0 tx=0).stop 2024-08-26T00:03:19.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.995+0000 7f31d0e07740 1 -- 172.21.15.42:0/4290809863 shutdown_connections 2024-08-26T00:03:19.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.996+0000 7f31d0e07740 1 --2- 172.21.15.42:0/4290809863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd9bc10 0x55acccd9e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:19.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.996+0000 7f31d0e07740 1 --2- 172.21.15.42:0/4290809863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55acccd91350 0x55acccd9b6d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:19.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.996+0000 7f31d0e07740 1 --2- 172.21.15.42:0/4290809863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acccd90a30 0x55acccd90e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:19.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.996+0000 7f31d0e07740 1 -- 172.21.15.42:0/4290809863 >> 172.21.15.42:0/4290809863 conn(0x55acccd8cfc0 msgr2=0x55acccd8d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:19.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.996+0000 7f31d0e07740 1 -- 172.21.15.42:0/4290809863 shutdown_connections 2024-08-26T00:03:19.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.996+0000 7f31d0e07740 1 -- 172.21.15.42:0/4290809863 wait complete. 2024-08-26T00:03:19.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.997+0000 7f31c6a00640 1 --2- 172.21.15.42:0/3091413609 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f31ac0a2c00 0x7f31ac0a50c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55acccd8e340 tx=0x7f31b400a6b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.997+0000 7f31d0e07740 1 -- start start 2024-08-26T00:03:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.997+0000 7f31d0e07740 1 Processor -- start 2024-08-26T00:03:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.998+0000 7f31d0e07740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd90a30 0x55acccd98a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.998+0000 7f31d0e07740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55acccd91350 0x55acccd98f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.998+0000 7f31d0e07740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acccd9bc10 0x55acccd994d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:20.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.998+0000 7f31d0e07740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55acccd9e7e0 con 0x55acccd9bc10 2024-08-26T00:03:20.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.998+0000 7f31d0e07740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55accccb1de0 con 0x55acccd90a30 2024-08-26T00:03:20.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.998+0000 7f31d0e07740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55acccd9e960 con 0x55acccd91350 2024-08-26T00:03:20.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.998+0000 7f31d0e07740 10 client.0 _ll_register_callbacks cb 0x55acccca07b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:03:20.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.999+0000 7f31c7400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd90a30 0x55acccd98a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:20.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.999+0000 7f31c6a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55acccd91350 0x55acccd98f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:20.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.999+0000 7f31c7400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd90a30 0x55acccd98a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:47460/0 (socket says 172.21.15.42:47460) 2024-08-26T00:03:20.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.999+0000 7f31c7400640 1 -- 172.21.15.42:0/4267737402 learned_addr learned my addr 172.21.15.42:0/4267737402 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:20.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.999+0000 7f31c7e00640 1 --2- 172.21.15.42:0/4267737402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acccd9bc10 0x55acccd994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:20.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.999+0000 7f31c7400640 1 -- 172.21.15.42:0/4267737402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55acccd91350 msgr2=0x55acccd98f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:20.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.999+0000 7f31c7400640 1 --2- 172.21.15.42:0/4267737402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55acccd91350 0x55acccd98f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.999+0000 7f31c7400640 1 -- 172.21.15.42:0/4267737402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acccd9bc10 msgr2=0x55acccd994d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:20.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.999+0000 7f31c7400640 1 --2- 172.21.15.42:0/4267737402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acccd9bc10 0x55acccd994d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.999+0000 7f31c7400640 1 -- 172.21.15.42:0/4267737402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acccdb04c0 con 0x55acccd90a30 2024-08-26T00:03:20.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:19.999+0000 7f31c6a00640 1 --2- 172.21.15.42:0/4267737402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55acccd91350 0x55acccd98f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:03:20.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.000+0000 7f31c7400640 1 --2- 172.21.15.42:0/4267737402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd90a30 0x55acccd98a50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f31b802aa70 tx=0x7f31b80035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7db5e9696d083e30 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:20.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.000+0000 7f31b1600640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:03:20.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.000+0000 7f31b1600640 1 -- 172.21.15.42:0/4267737402 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8035070 con 0x55acccd90a30 2024-08-26T00:03:20.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.000+0000 7f31b1600640 1 -- 172.21.15.42:0/4267737402 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f31b80052d0 con 0x55acccd90a30 2024-08-26T00:03:20.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.001+0000 7f31d0e07740 1 -- 172.21.15.42:0/4267737402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31b8004760 con 0x55acccd90a30 2024-08-26T00:03:20.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.001+0000 7f31b1600640 1 -- 172.21.15.42:0/4267737402 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f31b80054d0 con 0x55acccd90a30 2024-08-26T00:03:20.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.001+0000 7f31d0e07740 10 client.25211 fetch_fsmap learned FSMap version 24 2024-08-26T00:03:20.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.001+0000 7f31d0e07740 1 -- 172.21.15.42:0/4267737402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55acccdb2d90 con 0x55acccd90a30 2024-08-26T00:03:20.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.001+0000 7f31b1600640 1 -- 172.21.15.42:0/4267737402 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31b8004760 con 0x55acccd90a30 2024-08-26T00:03:20.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.002+0000 7f31b1600640 1 -- 172.21.15.42:0/4267737402 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f31b8031880 con 0x55acccd90a30 2024-08-26T00:03:20.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.002+0000 7f31d0e07740 10 client.25211 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:03:20.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.002+0000 7f31d0e07740 10 client.25211 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:03:20.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.002+0000 7f31d0e07740 20 client.25211 populate_metadata read hostname 'smithi042' 2024-08-26T00:03:20.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.002+0000 7f31d0e07740 1 --2- 172.21.15.42:0/4267737402 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55acccdb40e0 0x55acccdb64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:20.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.002+0000 7f31d0e07740 4 client.25211 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:03:20.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.002+0000 7f31d0e07740 1 -- 172.21.15.42:0/4267737402 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55acccd044a0 con 0x55acccdb40e0 2024-08-26T00:03:20.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.003+0000 7f31c6a00640 1 --2- 172.21.15.42:0/4267737402 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55acccdb40e0 0x55acccdb64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:20.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.004+0000 7f31c6a00640 1 --2- 172.21.15.42:0/4267737402 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55acccdb40e0 0x55acccdb64d0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2a9818ac24d0c2b server_cookie=e67d6fca507a6cf3 in_seq=0 out_seq=0 2024-08-26T00:03:20.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.004+0000 7f31b1600640 10 client.25211 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:20.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.004+0000 7f31b1600640 1 -- 172.21.15.42:0/4267737402 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55acccd044a0 con 0x55acccdb40e0 2024-08-26T00:03:20.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.004+0000 7f31b1600640 10 client.25211 handle_command_reply: tid=0 2024-08-26T00:03:20.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.004+0000 7f31d0e07740 1 client.25211 shutdown 2024-08-26T00:03:20.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.005+0000 7f31d0e07740 1 -- 172.21.15.42:0/4267737402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd90a30 msgr2=0x55acccd98a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:20.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.005+0000 7f31d0e07740 1 --2- 172.21.15.42:0/4267737402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd90a30 0x55acccd98a50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f31b802aa70 tx=0x7f31b80035f0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.005+0000 7f31d0e07740 1 -- 172.21.15.42:0/4267737402 shutdown_connections 2024-08-26T00:03:20.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.005+0000 7f31d0e07740 1 --2- 172.21.15.42:0/4267737402 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55acccdb40e0 0x55acccdb64d0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.005+0000 7f31d0e07740 1 --2- 172.21.15.42:0/4267737402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acccd9bc10 0x55acccd994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.005+0000 7f31d0e07740 1 --2- 172.21.15.42:0/4267737402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55acccd91350 0x55acccd98f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.005+0000 7f31d0e07740 1 --2- 172.21.15.42:0/4267737402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd90a30 0x55acccd98a50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.005+0000 7f31d0e07740 1 -- 172.21.15.42:0/4267737402 >> 172.21.15.42:0/4267737402 conn(0x55acccd8cfc0 msgr2=0x55acccd92cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:20.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.005+0000 7f31b1600640 0 client.25211 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:20.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.005+0000 7f31d0e07740 1 -- 172.21.15.42:0/4267737402 shutdown_connections 2024-08-26T00:03:20.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.006+0000 7f31d0e07740 1 -- 172.21.15.42:0/4267737402 wait complete. 2024-08-26T00:03:20.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.006+0000 7f31d0e07740 20 client.25211 trim_cache size 0 max 16384 2024-08-26T00:03:20.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.031+0000 7f31d0e07740 1 Processor -- start 2024-08-26T00:03:20.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.031+0000 7f31d0e07740 1 -- start start 2024-08-26T00:03:20.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.031+0000 7f31d0e07740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd90a30 0x55acccd93490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:20.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.031+0000 7f31d0e07740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55acccd91350 0x55acccd99320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:20.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.031+0000 7f31d0e07740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acccd9bc10 0x55acccd9a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:20.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.031+0000 7f31d0e07740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81ad830 con 0x55acccd9bc10 2024-08-26T00:03:20.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.031+0000 7f31d0e07740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81ab100 con 0x55acccd90a30 2024-08-26T00:03:20.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.031+0000 7f31d0e07740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81a8fb0 con 0x55acccd91350 2024-08-26T00:03:20.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.032+0000 7f31c7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acccd9bc10 0x55acccd9a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:20.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.032+0000 7f31c7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acccd9bc10 0x55acccd9a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43756/0 (socket says 172.21.15.42:43756) 2024-08-26T00:03:20.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.032+0000 7f31c7e00640 1 -- 172.21.15.42:0/3039093264 learned_addr learned my addr 172.21.15.42:0/3039093264 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:20.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.032+0000 7f31c7400640 1 --2- 172.21.15.42:0/3039093264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd90a30 0x55acccd93490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:20.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.032+0000 7f31c6a00640 1 --2- 172.21.15.42:0/3039093264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55acccd91350 0x55acccd99320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:20.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.033+0000 7f31c7400640 1 -- 172.21.15.42:0/3039093264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55acccd91350 msgr2=0x55acccd99320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:20.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.033+0000 7f31c7400640 1 --2- 172.21.15.42:0/3039093264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55acccd91350 0x55acccd99320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.033+0000 7f31c7400640 1 -- 172.21.15.42:0/3039093264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acccd9bc10 msgr2=0x55acccd9a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:20.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.033+0000 7f31c7400640 1 --2- 172.21.15.42:0/3039093264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acccd9bc10 0x55acccd9a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.033+0000 7f31c7400640 1 -- 172.21.15.42:0/3039093264 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acccd91180 con 0x55acccd90a30 2024-08-26T00:03:20.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.033+0000 7f31c7e00640 1 --2- 172.21.15.42:0/3039093264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acccd9bc10 0x55acccd9a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:03:20.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.033+0000 7f31c7400640 1 --2- 172.21.15.42:0/3039093264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd90a30 0x55acccd93490 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f31b80092a0 tx=0x7f31b802a480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4aa58f3ecc29b6bb server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:20.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.033+0000 7f31b3e00640 1 -- 172.21.15.42:0/3039093264 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8035040 con 0x55acccd90a30 2024-08-26T00:03:20.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.034+0000 7f31b3e00640 1 -- 172.21.15.42:0/3039093264 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31b8004e80 con 0x55acccd90a30 2024-08-26T00:03:20.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.034+0000 7f31b3e00640 1 -- 172.21.15.42:0/3039093264 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8003c30 con 0x55acccd90a30 2024-08-26T00:03:20.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.035+0000 7f31d0e07740 1 -- 172.21.15.42:0/3039093264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd90a30 msgr2=0x55acccd93490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:20.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.035+0000 7f31d0e07740 1 --2- 172.21.15.42:0/3039093264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd90a30 0x55acccd93490 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f31b80092a0 tx=0x7f31b802a480 comp rx=0 tx=0).stop 2024-08-26T00:03:20.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.035+0000 7f31d0e07740 1 -- 172.21.15.42:0/3039093264 shutdown_connections 2024-08-26T00:03:20.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.035+0000 7f31d0e07740 1 --2- 172.21.15.42:0/3039093264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acccd9bc10 0x55acccd9a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.035+0000 7f31d0e07740 1 --2- 172.21.15.42:0/3039093264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55acccd91350 0x55acccd99320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.035+0000 7f31d0e07740 1 --2- 172.21.15.42:0/3039093264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd90a30 0x55acccd93490 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.035+0000 7f31d0e07740 1 -- 172.21.15.42:0/3039093264 >> 172.21.15.42:0/3039093264 conn(0x55acccd8cfc0 msgr2=0x55acccd9a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:20.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.035+0000 7f31d0e07740 1 -- 172.21.15.42:0/3039093264 shutdown_connections 2024-08-26T00:03:20.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.035+0000 7f31d0e07740 1 -- 172.21.15.42:0/3039093264 wait complete. 2024-08-26T00:03:20.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.036+0000 7f31d0e07740 1 -- start start 2024-08-26T00:03:20.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.037+0000 7f31d0e07740 1 Processor -- start 2024-08-26T00:03:20.038 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:20 smithi042 ceph-mon[17225]: pgmap v363: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-08-26T00:03:20.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.037+0000 7f31d0e07740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acccd90a30 0x55acccdac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:20.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.037+0000 7f31d0e07740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd91350 0x55acccdac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:20.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.037+0000 7f31d0e07740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55acccd9bc10 0x55acccd94ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:20.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.037+0000 7f31d0e07740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81a9600 con 0x55acccd90a30 2024-08-26T00:03:20.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.037+0000 7f31d0e07740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81aaa30 con 0x55acccd91350 2024-08-26T00:03:20.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.037+0000 7f31d0e07740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81a9c90 con 0x55acccd9bc10 2024-08-26T00:03:20.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.037+0000 7f31d0e07740 10 client.0 _ll_register_callbacks cb 0x7f31b80043f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:03:20.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.038+0000 7f31c6a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd91350 0x55acccdac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:20.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.038+0000 7f31c6a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd91350 0x55acccdac9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:47484/0 (socket says 172.21.15.42:47484) 2024-08-26T00:03:20.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.038+0000 7f31c6a00640 1 -- 172.21.15.42:0/2892661901 learned_addr learned my addr 172.21.15.42:0/2892661901 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:20.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.038+0000 7f31c7e00640 1 --2- 172.21.15.42:0/2892661901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55acccd9bc10 0x55acccd94ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:20.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.038+0000 7f31c7400640 1 --2- 172.21.15.42:0/2892661901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acccd90a30 0x55acccdac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:20.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.039+0000 7f31c6a00640 1 -- 172.21.15.42:0/2892661901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55acccd9bc10 msgr2=0x55acccd94ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:20.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.039+0000 7f31c6a00640 1 --2- 172.21.15.42:0/2892661901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55acccd9bc10 0x55acccd94ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.039+0000 7f31c6a00640 1 -- 172.21.15.42:0/2892661901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acccd90a30 msgr2=0x55acccdac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:20.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.039+0000 7f31c6a00640 1 --2- 172.21.15.42:0/2892661901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acccd90a30 0x55acccdac4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.039+0000 7f31c6a00640 1 -- 172.21.15.42:0/2892661901 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acccd95400 con 0x55acccd91350 2024-08-26T00:03:20.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.039+0000 7f31c7400640 1 --2- 172.21.15.42:0/2892661901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acccd90a30 0x55acccdac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:03:20.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.040+0000 7f31c6a00640 1 --2- 172.21.15.42:0/2892661901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd91350 0x55acccdac9e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55acccd982e0 tx=0x7f31b4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d782a09e2409af4 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:20.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.040+0000 7f31b1600640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:03:20.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.040+0000 7f31b1600640 1 -- 172.21.15.42:0/2892661901 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b401a070 con 0x55acccd91350 2024-08-26T00:03:20.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.040+0000 7f31b1600640 1 -- 172.21.15.42:0/2892661901 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f31b401f410 con 0x55acccd91350 2024-08-26T00:03:20.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.041+0000 7f31d0e07740 1 -- 172.21.15.42:0/2892661901 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55accccfe9b0 con 0x55acccd91350 2024-08-26T00:03:20.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.041+0000 7f31b1600640 1 -- 172.21.15.42:0/2892661901 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f31b4031670 con 0x55acccd91350 2024-08-26T00:03:20.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.041+0000 7f31d0e07740 10 client.25217 fetch_fsmap learned FSMap version 24 2024-08-26T00:03:20.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.041+0000 7f31d0e07740 1 -- 172.21.15.42:0/2892661901 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55accce1e1f0 con 0x55acccd91350 2024-08-26T00:03:20.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.042+0000 7f31b1600640 1 -- 172.21.15.42:0/2892661901 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55accccfe9b0 con 0x55acccd91350 2024-08-26T00:03:20.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.042+0000 7f31b1600640 1 -- 172.21.15.42:0/2892661901 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f31b400f420 con 0x55acccd91350 2024-08-26T00:03:20.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.042+0000 7f31d0e07740 10 client.25217 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:03:20.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.042+0000 7f31d0e07740 10 client.25217 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:03:20.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.042+0000 7f31d0e07740 20 client.25217 populate_metadata read hostname 'smithi042' 2024-08-26T00:03:20.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.042+0000 7f31d0e07740 1 --2- 172.21.15.42:0/2892661901 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55accce1e990 0x55accce20db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:20.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.042+0000 7f31d0e07740 4 client.25217 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:03:20.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.042+0000 7f31d0e07740 1 -- 172.21.15.42:0/2892661901 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55acccc7b010 con 0x55accce1e990 2024-08-26T00:03:20.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.043+0000 7f31c7400640 1 --2- 172.21.15.42:0/2892661901 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55accce1e990 0x55accce20db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:20.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.043+0000 7f31b1600640 10 client.25217 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:20.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.044+0000 7f31c7400640 1 --2- 172.21.15.42:0/2892661901 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55accce1e990 0x55accce20db0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4acb4bf7a6cf3f6 server_cookie=f623c5b4f48693ef in_seq=0 out_seq=0 2024-08-26T00:03:20.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.045+0000 7f31b1600640 1 -- 172.21.15.42:0/2892661901 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55acccc7b010 con 0x55accce1e990 2024-08-26T00:03:20.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.045+0000 7f31b1600640 10 client.25217 handle_command_reply: tid=0 2024-08-26T00:03:20.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.045+0000 7f31d0e07740 1 client.25217 shutdown 2024-08-26T00:03:20.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.045+0000 7f31d0e07740 1 -- 172.21.15.42:0/2892661901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd91350 msgr2=0x55acccdac9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:20.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.045+0000 7f31d0e07740 1 --2- 172.21.15.42:0/2892661901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd91350 0x55acccdac9e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55acccd982e0 tx=0x7f31b4004730 comp rx=0 tx=0).stop 2024-08-26T00:03:20.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.046+0000 7f31d0e07740 1 -- 172.21.15.42:0/2892661901 shutdown_connections 2024-08-26T00:03:20.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.046+0000 7f31d0e07740 1 --2- 172.21.15.42:0/2892661901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55acccd9bc10 0x55acccd94ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.046+0000 7f31d0e07740 1 --2- 172.21.15.42:0/2892661901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55acccd91350 0x55acccdac9e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.046+0000 7f31d0e07740 1 --2- 172.21.15.42:0/2892661901 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55accce1e990 0x55accce20db0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.046+0000 7f31d0e07740 1 --2- 172.21.15.42:0/2892661901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acccd90a30 0x55acccdac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.046+0000 7f31d0e07740 1 -- 172.21.15.42:0/2892661901 >> 172.21.15.42:0/2892661901 conn(0x55acccd8cfc0 msgr2=0x55acccd9a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:20.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.046+0000 7f31b1600640 0 client.25217 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:20.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.047+0000 7f31d0e07740 1 -- 172.21.15.42:0/2892661901 shutdown_connections 2024-08-26T00:03:20.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.047+0000 7f31d0e07740 1 -- 172.21.15.42:0/2892661901 wait complete. 2024-08-26T00:03:20.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.047+0000 7f31d0e07740 20 client.25217 trim_cache size 0 max 16384 2024-08-26T00:03:20.049 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:03:20.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.048+0000 7f31cce00640 1 -- 172.21.15.42:0/3091413609 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f31ac0a2c00 msgr2=0x7f31ac0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:20.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.048+0000 7f31cce00640 1 --2- 172.21.15.42:0/3091413609 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f31ac0a2c00 0x7f31ac0a50c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55acccd8e340 tx=0x7f31b400a6b0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.048+0000 7f31cce00640 1 -- 172.21.15.42:0/3091413609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31c810bd30 msgr2=0x7f31c819eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:20.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.048+0000 7f31cce00640 1 --2- 172.21.15.42:0/3091413609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31c810bd30 0x7f31c819eaa0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f31c000eb10 tx=0x7f31c000c2d0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.048+0000 7f31cce00640 1 -- 172.21.15.42:0/3091413609 shutdown_connections 2024-08-26T00:03:20.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.048+0000 7f31cce00640 1 --2- 172.21.15.42:0/3091413609 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f31ac0a2c00 0x7f31ac0a50c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.048+0000 7f31cce00640 1 --2- 172.21.15.42:0/3091413609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31c810bd30 0x7f31c819eaa0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.048+0000 7f31cce00640 1 --2- 172.21.15.42:0/3091413609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31c8103220 0x7f31c819a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.048+0000 7f31cce00640 1 --2- 172.21.15.42:0/3091413609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31c8102900 0x7f31c819a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:20.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.048+0000 7f31cce00640 1 -- 172.21.15.42:0/3091413609 >> 172.21.15.42:0/3091413609 conn(0x7f31c80fc360 msgr2=0x7f31c80fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:20.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.049+0000 7f31cce00640 1 -- 172.21.15.42:0/3091413609 shutdown_connections 2024-08-26T00:03:20.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:20.049+0000 7f31cce00640 1 -- 172.21.15.42:0/3091413609 wait complete. 2024-08-26T00:03:20.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:20 smithi181 ceph-mon[22102]: pgmap v363: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-08-26T00:03:20.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:20 smithi043 ceph-mon[22091]: pgmap v363: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-08-26T00:03:21.906 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-26T00:03:21.907 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-26T00:03:22.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:22 smithi042 ceph-mon[17225]: pgmap v364: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-08-26T00:03:22.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:22 smithi181 ceph-mon[22102]: pgmap v364: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-08-26T00:03:22.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:22 smithi043 ceph-mon[22091]: pgmap v364: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-08-26T00:03:22.542 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:03:23.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.154+0000 7fa57b200640 1 -- 172.21.15.42:0/1511273589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa57c074bd0 msgr2=0x7fa57c10dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:23.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.154+0000 7fa57b200640 1 --2- 172.21.15.42:0/1511273589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa57c074bd0 0x7fa57c10dae0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa568009900 tx=0x7fa56802a480 comp rx=0 tx=0).stop 2024-08-26T00:03:23.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.154+0000 7fa57b200640 1 -- 172.21.15.42:0/1511273589 shutdown_connections 2024-08-26T00:03:23.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.154+0000 7fa57b200640 1 --2- 172.21.15.42:0/1511273589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa57c10e020 0x7fa57c110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.154+0000 7fa57b200640 1 --2- 172.21.15.42:0/1511273589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa57c074bd0 0x7fa57c10dae0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.154+0000 7fa57b200640 1 --2- 172.21.15.42:0/1511273589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa57c0742b0 0x7fa57c074690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.154+0000 7fa57b200640 1 -- 172.21.15.42:0/1511273589 >> 172.21.15.42:0/1511273589 conn(0x7fa57c0fd4e0 msgr2=0x7fa57c0ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:23.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.154+0000 7fa57b200640 1 -- 172.21.15.42:0/1511273589 shutdown_connections 2024-08-26T00:03:23.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.154+0000 7fa57b200640 1 -- 172.21.15.42:0/1511273589 wait complete. 2024-08-26T00:03:23.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.155+0000 7fa57b200640 1 Processor -- start 2024-08-26T00:03:23.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.156+0000 7fa57b200640 1 -- start start 2024-08-26T00:03:23.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.156+0000 7fa57b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa57c0742b0 0x7fa57c19a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:23.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.156+0000 7fa57b200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa57c074bd0 0x7fa57c19a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:23.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.156+0000 7fa57b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa57c10e020 0x7fa57c19eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:23.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.156+0000 7fa57b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa57c113da0 con 0x7fa57c10e020 2024-08-26T00:03:23.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.156+0000 7fa57b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa57c113c20 con 0x7fa57c0742b0 2024-08-26T00:03:23.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.156+0000 7fa57b200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa57c113f20 con 0x7fa57c074bd0 2024-08-26T00:03:23.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.157+0000 7fa579e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa57c0742b0 0x7fa57c19a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:23.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.157+0000 7fa579e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa57c0742b0 0x7fa57c19a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:47494/0 (socket says 172.21.15.42:47494) 2024-08-26T00:03:23.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.157+0000 7fa579e00640 1 -- 172.21.15.42:0/3977036581 learned_addr learned my addr 172.21.15.42:0/3977036581 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:23.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.157+0000 7fa579400640 1 --2- 172.21.15.42:0/3977036581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa57c074bd0 0x7fa57c19a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:23.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.157+0000 7fa57a800640 1 --2- 172.21.15.42:0/3977036581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa57c10e020 0x7fa57c19eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:23.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.157+0000 7fa579e00640 1 -- 172.21.15.42:0/3977036581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa57c074bd0 msgr2=0x7fa57c19a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:23.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.157+0000 7fa579e00640 1 --2- 172.21.15.42:0/3977036581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa57c074bd0 0x7fa57c19a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.157+0000 7fa579e00640 1 -- 172.21.15.42:0/3977036581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa57c10e020 msgr2=0x7fa57c19eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:23.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.157+0000 7fa579e00640 1 --2- 172.21.15.42:0/3977036581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa57c10e020 0x7fa57c19eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.157+0000 7fa579e00640 1 -- 172.21.15.42:0/3977036581 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa57c19f200 con 0x7fa57c0742b0 2024-08-26T00:03:23.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.157+0000 7fa57a800640 1 --2- 172.21.15.42:0/3977036581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa57c10e020 0x7fa57c19eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:03:23.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.158+0000 7fa579e00640 1 --2- 172.21.15.42:0/3977036581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa57c0742b0 0x7fa57c19a250 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00e9f0 tx=0x7fa56c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:23.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.158+0000 7fa572a00640 1 -- 172.21.15.42:0/3977036581 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56c00cd80 con 0x7fa57c0742b0 2024-08-26T00:03:23.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.158+0000 7fa572a00640 1 -- 172.21.15.42:0/3977036581 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa56c005500 con 0x7fa57c0742b0 2024-08-26T00:03:23.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.158+0000 7fa57b200640 1 -- 172.21.15.42:0/3977036581 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa57c19f4f0 con 0x7fa57c0742b0 2024-08-26T00:03:23.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.158+0000 7fa572a00640 1 -- 172.21.15.42:0/3977036581 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56c010690 con 0x7fa57c0742b0 2024-08-26T00:03:23.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.158+0000 7fa57b200640 1 -- 172.21.15.42:0/3977036581 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa57c1a6dd0 con 0x7fa57c0742b0 2024-08-26T00:03:23.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.162+0000 7fa58380b740 1 Processor -- start 2024-08-26T00:03:23.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.163+0000 7fa58380b740 1 -- start start 2024-08-26T00:03:23.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.164+0000 7fa572a00640 1 -- 172.21.15.42:0/3977036581 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa56c0046c0 con 0x7fa57c0742b0 2024-08-26T00:03:23.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.164+0000 7fa58380b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556399c3f60 0x5556399c4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:23.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.164+0000 7fa58380b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c4880 0x5556399cec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:23.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.164+0000 7fa58380b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556399cf140 0x5556399d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:23.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.164+0000 7fa58380b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55563992ae30 con 0x5556399c4880 2024-08-26T00:03:23.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.164+0000 7fa58380b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5556398c23c0 con 0x5556399cf140 2024-08-26T00:03:23.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.164+0000 7fa58380b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x555639926df0 con 0x5556399c3f60 2024-08-26T00:03:23.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.165+0000 7fa579e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c4880 0x5556399cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:23.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.165+0000 7fa579400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556399cf140 0x5556399d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:23.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.165+0000 7fa579400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556399cf140 0x5556399d1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:47506/0 (socket says 172.21.15.42:47506) 2024-08-26T00:03:23.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.165+0000 7fa579400640 1 -- 172.21.15.42:0/2990531844 learned_addr learned my addr 172.21.15.42:0/2990531844 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:23.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.164+0000 7fa57a800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556399c3f60 0x5556399c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:23.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.165+0000 7fa579400640 1 -- 172.21.15.42:0/2990531844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556399c3f60 msgr2=0x5556399c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:23.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.165+0000 7fa579400640 1 --2- 172.21.15.42:0/2990531844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556399c3f60 0x5556399c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.165+0000 7fa579400640 1 -- 172.21.15.42:0/2990531844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c4880 msgr2=0x5556399cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:23.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.166+0000 7fa579400640 1 --2- 172.21.15.42:0/2990531844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c4880 0x5556399cec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.166+0000 7fa579400640 1 -- 172.21.15.42:0/2990531844 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55563969c6a0 con 0x5556399cf140 2024-08-26T00:03:23.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.166+0000 7fa579e00640 1 --2- 172.21.15.42:0/2990531844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c4880 0x5556399cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:03:23.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.166+0000 7fa572a00640 1 --2- 172.21.15.42:0/3977036581 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa5600a2c00 0x7fa5600a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:23.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.166+0000 7fa572a00640 1 -- 172.21.15.42:0/3977036581 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fa56c0cf490 con 0x7fa57c0742b0 2024-08-26T00:03:23.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.166+0000 7fa579400640 1 --2- 172.21.15.42:0/2990531844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556399cf140 0x5556399d1530 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa568009900 tx=0x7fa568005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=feabdf891115d19d server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:23.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.167+0000 7fa567000640 1 -- 172.21.15.42:0/2990531844 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa568035040 con 0x5556399cf140 2024-08-26T00:03:23.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.167+0000 7fa57a800640 1 --2- 172.21.15.42:0/3977036581 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa5600a2c00 0x7fa5600a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:23.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.167+0000 7fa567000640 1 -- 172.21.15.42:0/2990531844 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa568004400 con 0x5556399cf140 2024-08-26T00:03:23.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.167+0000 7fa567000640 1 -- 172.21.15.42:0/2990531844 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5680035f0 con 0x5556399cf140 2024-08-26T00:03:23.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.168+0000 7fa58380b740 1 -- 172.21.15.42:0/2990531844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556399cf140 msgr2=0x5556399d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:23.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.168+0000 7fa58380b740 1 --2- 172.21.15.42:0/2990531844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556399cf140 0x5556399d1530 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa568009900 tx=0x7fa568005de0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.168+0000 7fa58380b740 1 -- 172.21.15.42:0/2990531844 shutdown_connections 2024-08-26T00:03:23.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.168+0000 7fa58380b740 1 --2- 172.21.15.42:0/2990531844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556399cf140 0x5556399d1530 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.168+0000 7fa58380b740 1 --2- 172.21.15.42:0/2990531844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c4880 0x5556399cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.168+0000 7fa58380b740 1 --2- 172.21.15.42:0/2990531844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556399c3f60 0x5556399c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.168+0000 7fa58380b740 1 -- 172.21.15.42:0/2990531844 >> 172.21.15.42:0/2990531844 conn(0x5556399c04f0 msgr2=0x5556399c08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:23.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.169+0000 7fa57a800640 1 --2- 172.21.15.42:0/3977036581 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa5600a2c00 0x7fa5600a50c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa57c075290 tx=0x7fa574009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:23.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.169+0000 7fa58380b740 1 -- 172.21.15.42:0/2990531844 shutdown_connections 2024-08-26T00:03:23.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.169+0000 7fa58380b740 1 -- 172.21.15.42:0/2990531844 wait complete. 2024-08-26T00:03:23.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.170+0000 7fa58380b740 1 -- start start 2024-08-26T00:03:23.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.170+0000 7fa58380b740 1 Processor -- start 2024-08-26T00:03:23.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.171+0000 7fa58380b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556399c3f60 0x5556399cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:23.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.171+0000 7fa58380b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c4880 0x5556399cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:23.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.171+0000 7fa58380b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556399cf140 0x5556399ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:23.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.171+0000 7fa58380b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5556399d1d10 con 0x5556399c4880 2024-08-26T00:03:23.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.171+0000 7fa58380b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5556398e5c30 con 0x5556399cf140 2024-08-26T00:03:23.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.171+0000 7fa58380b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5556399d1e90 con 0x5556399c3f60 2024-08-26T00:03:23.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.171+0000 7fa58380b740 10 client.0 _ll_register_callbacks cb 0x555639639ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:03:23.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.171+0000 7fa57a800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556399cf140 0x5556399ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:23.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.171+0000 7fa579400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c4880 0x5556399cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:23.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.172+0000 7fa57a800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556399cf140 0x5556399ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:47512/0 (socket says 172.21.15.42:47512) 2024-08-26T00:03:23.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.172+0000 7fa57a800640 1 -- 172.21.15.42:0/2595165919 learned_addr learned my addr 172.21.15.42:0/2595165919 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:23.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.172+0000 7fa579e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556399c3f60 0x5556399cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:23.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.172+0000 7fa57a800640 1 -- 172.21.15.42:0/2595165919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556399c3f60 msgr2=0x5556399cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:23.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.172+0000 7fa57a800640 1 --2- 172.21.15.42:0/2595165919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556399c3f60 0x5556399cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.172+0000 7fa57a800640 1 -- 172.21.15.42:0/2595165919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c4880 msgr2=0x5556399cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:23.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.172+0000 7fa57a800640 1 --2- 172.21.15.42:0/2595165919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c4880 0x5556399cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.172+0000 7fa57a800640 1 -- 172.21.15.42:0/2595165919 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556398f1dd0 con 0x5556399cf140 2024-08-26T00:03:23.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.173+0000 7fa57a800640 1 --2- 172.21.15.42:0/2595165919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556399cf140 0x5556399ccaa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa574010b10 tx=0x7fa574004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37540739fdfd80d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:23.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.173+0000 7fa55b400640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:03:23.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.173+0000 7fa55b400640 1 -- 172.21.15.42:0/2595165919 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa574029480 con 0x5556399cf140 2024-08-26T00:03:23.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.173+0000 7fa55b400640 1 -- 172.21.15.42:0/2595165919 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fa574029620 con 0x5556399cf140 2024-08-26T00:03:23.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.173+0000 7fa58380b740 1 -- 172.21.15.42:0/2595165919 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa568004400 con 0x5556399cf140 2024-08-26T00:03:23.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.174+0000 7fa55b400640 1 -- 172.21.15.42:0/2595165919 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa574004b20 con 0x5556399cf140 2024-08-26T00:03:23.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.174+0000 7fa58380b740 10 client.25229 fetch_fsmap learned FSMap version 24 2024-08-26T00:03:23.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.174+0000 7fa58380b740 1 -- 172.21.15.42:0/2595165919 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5556399dd8e0 con 0x5556399cf140 2024-08-26T00:03:23.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.174+0000 7fa55b400640 1 -- 172.21.15.42:0/2595165919 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa568004400 con 0x5556399cf140 2024-08-26T00:03:23.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.175+0000 7fa55b400640 1 -- 172.21.15.42:0/2595165919 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa57401e420 con 0x5556399cf140 2024-08-26T00:03:23.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.175+0000 7fa58380b740 10 client.25229 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:03:23.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.175+0000 7fa58380b740 10 client.25229 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:03:23.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.175+0000 7fa58380b740 20 client.25229 populate_metadata read hostname 'smithi042' 2024-08-26T00:03:23.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.175+0000 7fa58380b740 1 --2- 172.21.15.42:0/2595165919 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5556399deda0 0x5556399e1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:23.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.175+0000 7fa58380b740 4 client.25229 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:03:23.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.175+0000 7fa58380b740 1 -- 172.21.15.42:0/2595165919 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556399383a0 con 0x5556399deda0 2024-08-26T00:03:23.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.176+0000 7fa579e00640 1 --2- 172.21.15.42:0/2595165919 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5556399deda0 0x5556399e1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:23.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.177+0000 7fa579e00640 1 --2- 172.21.15.42:0/2595165919 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5556399deda0 0x5556399e1190 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e6cca8df71ba518 server_cookie=af7970e45de250bc in_seq=0 out_seq=0 2024-08-26T00:03:23.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.177+0000 7fa55b400640 10 client.25229 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:23.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.177+0000 7fa55b400640 1 -- 172.21.15.42:0/2595165919 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5556399383a0 con 0x5556399deda0 2024-08-26T00:03:23.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.177+0000 7fa55b400640 10 client.25229 handle_command_reply: tid=0 2024-08-26T00:03:23.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.178+0000 7fa58380b740 1 client.25229 shutdown 2024-08-26T00:03:23.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.178+0000 7fa58380b740 1 -- 172.21.15.42:0/2595165919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556399cf140 msgr2=0x5556399ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:23.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.178+0000 7fa58380b740 1 --2- 172.21.15.42:0/2595165919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556399cf140 0x5556399ccaa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa574010b10 tx=0x7fa574004a40 comp rx=0 tx=0).stop 2024-08-26T00:03:23.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.178+0000 7fa58380b740 1 -- 172.21.15.42:0/2595165919 shutdown_connections 2024-08-26T00:03:23.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.178+0000 7fa58380b740 1 --2- 172.21.15.42:0/2595165919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556399cf140 0x5556399ccaa0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.178+0000 7fa58380b740 1 --2- 172.21.15.42:0/2595165919 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5556399deda0 0x5556399e1190 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.178+0000 7fa58380b740 1 --2- 172.21.15.42:0/2595165919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c4880 0x5556399cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.178+0000 7fa58380b740 1 --2- 172.21.15.42:0/2595165919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556399c3f60 0x5556399cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.178+0000 7fa58380b740 1 -- 172.21.15.42:0/2595165919 >> 172.21.15.42:0/2595165919 conn(0x5556399c04f0 msgr2=0x5556399c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:23.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.178+0000 7fa55b400640 0 client.25229 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:23.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.179+0000 7fa58380b740 1 -- 172.21.15.42:0/2595165919 shutdown_connections 2024-08-26T00:03:23.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.179+0000 7fa58380b740 1 -- 172.21.15.42:0/2595165919 wait complete. 2024-08-26T00:03:23.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.180+0000 7fa58380b740 20 client.25229 trim_cache size 0 max 16384 2024-08-26T00:03:23.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.216+0000 7fa58380b740 1 Processor -- start 2024-08-26T00:03:23.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.216+0000 7fa58380b740 1 -- start start 2024-08-26T00:03:23.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.216+0000 7fa58380b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556399c3f60 0x5556399c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:23.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.216+0000 7fa58380b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c4880 0x5556399cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:23.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.216+0000 7fa58380b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556399cf140 0x5556399e6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:23.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.216+0000 7fa58380b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa57c1b6100 con 0x5556399c4880 2024-08-26T00:03:23.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.216+0000 7fa58380b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa57c1b39d0 con 0x5556399cf140 2024-08-26T00:03:23.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.216+0000 7fa58380b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa57c1b1800 con 0x5556399c3f60 2024-08-26T00:03:23.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.217+0000 7fa579e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556399c3f60 0x5556399c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:23.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.217+0000 7fa579e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556399c3f60 0x5556399c6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:33612/0 (socket says 172.21.15.42:33612) 2024-08-26T00:03:23.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.217+0000 7fa579e00640 1 -- 172.21.15.42:0/1808036438 learned_addr learned my addr 172.21.15.42:0/1808036438 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.217+0000 7fa579400640 1 --2- 172.21.15.42:0/1808036438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c4880 0x5556399cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.217+0000 7fa579e00640 1 -- 172.21.15.42:0/1808036438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556399cf140 msgr2=0x5556399e6a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-26T00:03:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.217+0000 7fa579e00640 1 --2- 172.21.15.42:0/1808036438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556399cf140 0x5556399e6a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.217+0000 7fa579e00640 1 -- 172.21.15.42:0/1808036438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c4880 msgr2=0x5556399cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.217+0000 7fa579e00640 1 --2- 172.21.15.42:0/1808036438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c4880 0x5556399cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.217+0000 7fa579e00640 1 -- 172.21.15.42:0/1808036438 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556399ce8f0 con 0x5556399c3f60 2024-08-26T00:03:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.217+0000 7fa579400640 1 --2- 172.21.15.42:0/1808036438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c4880 0x5556399cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:03:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.218+0000 7fa579e00640 1 --2- 172.21.15.42:0/1808036438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556399c3f60 0x5556399c6a10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa56c098680 tx=0x7fa56c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3c42cf179b7eb9b server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.218+0000 7fa566600640 1 -- 172.21.15.42:0/1808036438 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56c0a0060 con 0x5556399c3f60 2024-08-26T00:03:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.218+0000 7fa566600640 1 -- 172.21.15.42:0/1808036438 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa56c0a4920 con 0x5556399c3f60 2024-08-26T00:03:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.218+0000 7fa566600640 1 -- 172.21.15.42:0/1808036438 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56c0cf0b0 con 0x5556399c3f60 2024-08-26T00:03:23.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.219+0000 7fa58380b740 1 -- 172.21.15.42:0/1808036438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556399c3f60 msgr2=0x5556399c6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:23.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.219+0000 7fa58380b740 1 --2- 172.21.15.42:0/1808036438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556399c3f60 0x5556399c6a10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa56c098680 tx=0x7fa56c004a40 comp rx=0 tx=0).stop 2024-08-26T00:03:23.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.219+0000 7fa58380b740 1 -- 172.21.15.42:0/1808036438 shutdown_connections 2024-08-26T00:03:23.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.219+0000 7fa58380b740 1 --2- 172.21.15.42:0/1808036438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556399cf140 0x5556399e6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.219+0000 7fa58380b740 1 --2- 172.21.15.42:0/1808036438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c4880 0x5556399cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.219+0000 7fa58380b740 1 --2- 172.21.15.42:0/1808036438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556399c3f60 0x5556399c6a10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.219+0000 7fa58380b740 1 -- 172.21.15.42:0/1808036438 >> 172.21.15.42:0/1808036438 conn(0x5556399c04f0 msgr2=0x5556399cd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:23.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.220+0000 7fa58380b740 1 -- 172.21.15.42:0/1808036438 shutdown_connections 2024-08-26T00:03:23.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.220+0000 7fa58380b740 1 -- 172.21.15.42:0/1808036438 wait complete. 2024-08-26T00:03:23.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.220+0000 7fa58380b740 1 -- start start 2024-08-26T00:03:23.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.221+0000 7fa58380b740 1 Processor -- start 2024-08-26T00:03:23.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.221+0000 7fa58380b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c3f60 0x5556399d3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:23.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.221+0000 7fa58380b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556399c4880 0x5556399d3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:23.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.221+0000 7fa58380b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556399cf140 0x5556399d3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:23.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.221+0000 7fa58380b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa57c1b1e90 con 0x5556399c3f60 2024-08-26T00:03:23.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.221+0000 7fa58380b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa57c1b3300 con 0x5556399c4880 2024-08-26T00:03:23.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.221+0000 7fa58380b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa57c1b2560 con 0x5556399cf140 2024-08-26T00:03:23.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.221+0000 7fa58380b740 10 client.0 _ll_register_callbacks cb 0x7fa574009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:03:23.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.222+0000 7fa579e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c3f60 0x5556399d3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:23.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.222+0000 7fa579e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c3f60 0x5556399d3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43836/0 (socket says 172.21.15.42:43836) 2024-08-26T00:03:23.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.222+0000 7fa579e00640 1 -- 172.21.15.42:0/3644012846 learned_addr learned my addr 172.21.15.42:0/3644012846 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:23.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.222+0000 7fa57a800640 1 --2- 172.21.15.42:0/3644012846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556399cf140 0x5556399d3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:23.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.222+0000 7fa579400640 1 --2- 172.21.15.42:0/3644012846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556399c4880 0x5556399d3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:23.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.222+0000 7fa57a800640 1 -- 172.21.15.42:0/3644012846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556399c4880 msgr2=0x5556399d3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:23.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.222+0000 7fa57a800640 1 --2- 172.21.15.42:0/3644012846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556399c4880 0x5556399d3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.222+0000 7fa57a800640 1 -- 172.21.15.42:0/3644012846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c3f60 msgr2=0x5556399d3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:23.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.222+0000 7fa57a800640 1 --2- 172.21.15.42:0/3644012846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c3f60 0x5556399d3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.222+0000 7fa57a800640 1 -- 172.21.15.42:0/3644012846 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555639a48c80 con 0x5556399cf140 2024-08-26T00:03:23.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.222+0000 7fa579e00640 1 --2- 172.21.15.42:0/3644012846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c3f60 0x5556399d3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:03:23.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.223+0000 7fa57a800640 1 --2- 172.21.15.42:0/3644012846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556399cf140 0x5556399d3b80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa574012d70 tx=0x7fa574012e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=734d3c2b5a1f6597 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:23.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.223+0000 7fa55b400640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:03:23.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.223+0000 7fa55b400640 1 -- 172.21.15.42:0/3644012846 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57403b020 con 0x5556399cf140 2024-08-26T00:03:23.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.223+0000 7fa55b400640 1 -- 172.21.15.42:0/3644012846 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fa574029480 con 0x5556399cf140 2024-08-26T00:03:23.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.223+0000 7fa58380b740 1 -- 172.21.15.42:0/3644012846 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa56c0a4920 con 0x5556399cf140 2024-08-26T00:03:23.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.224+0000 7fa55b400640 1 -- 172.21.15.42:0/3644012846 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa5740108d0 con 0x5556399cf140 2024-08-26T00:03:23.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.224+0000 7fa58380b740 10 client.25237 fetch_fsmap learned FSMap version 24 2024-08-26T00:03:23.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.224+0000 7fa58380b740 1 -- 172.21.15.42:0/3644012846 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555639a49fc0 con 0x5556399cf140 2024-08-26T00:03:23.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.225+0000 7fa55b400640 1 -- 172.21.15.42:0/3644012846 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa56c0a4920 con 0x5556399cf140 2024-08-26T00:03:23.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.225+0000 7fa55b400640 1 -- 172.21.15.42:0/3644012846 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa574034470 con 0x5556399cf140 2024-08-26T00:03:23.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.225+0000 7fa58380b740 10 client.25237 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:03:23.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.225+0000 7fa58380b740 10 client.25237 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:03:23.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.225+0000 7fa58380b740 20 client.25237 populate_metadata read hostname 'smithi042' 2024-08-26T00:03:23.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.225+0000 7fa58380b740 1 --2- 172.21.15.42:0/3644012846 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x555639a4a720 0x555639a4cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:23.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.225+0000 7fa58380b740 4 client.25237 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-26T00:03:23.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.225+0000 7fa58380b740 1 -- 172.21.15.42:0/3644012846 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5556399328b0 con 0x555639a4a720 2024-08-26T00:03:23.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.226+0000 7fa579e00640 1 --2- 172.21.15.42:0/3644012846 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x555639a4a720 0x555639a4cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:23.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.227+0000 7fa579e00640 1 --2- 172.21.15.42:0/3644012846 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x555639a4a720 0x555639a4cb40 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae316f332633fd9c server_cookie=675eb599584f7b80 in_seq=0 out_seq=0 2024-08-26T00:03:23.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.227+0000 7fa55b400640 10 client.25237 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:23.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.228+0000 7fa55b400640 1 -- 172.21.15.42:0/3644012846 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5556399328b0 con 0x555639a4a720 2024-08-26T00:03:23.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.228+0000 7fa55b400640 10 client.25237 handle_command_reply: tid=0 2024-08-26T00:03:23.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.228+0000 7fa58380b740 1 client.25237 shutdown 2024-08-26T00:03:23.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.228+0000 7fa58380b740 1 -- 172.21.15.42:0/3644012846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556399cf140 msgr2=0x5556399d3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:23.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.228+0000 7fa58380b740 1 --2- 172.21.15.42:0/3644012846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556399cf140 0x5556399d3b80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa574012d70 tx=0x7fa574012e40 comp rx=0 tx=0).stop 2024-08-26T00:03:23.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.228+0000 7fa58380b740 1 -- 172.21.15.42:0/3644012846 shutdown_connections 2024-08-26T00:03:23.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.228+0000 7fa58380b740 1 --2- 172.21.15.42:0/3644012846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556399cf140 0x5556399d3b80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.228+0000 7fa58380b740 1 --2- 172.21.15.42:0/3644012846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556399c4880 0x5556399d3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.228+0000 7fa58380b740 1 --2- 172.21.15.42:0/3644012846 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x555639a4a720 0x555639a4cb40 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.228+0000 7fa58380b740 1 --2- 172.21.15.42:0/3644012846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5556399c3f60 0x5556399d3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.228+0000 7fa58380b740 1 -- 172.21.15.42:0/3644012846 >> 172.21.15.42:0/3644012846 conn(0x5556399c04f0 msgr2=0x5556399bf520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:23.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.228+0000 7fa55b400640 0 client.25237 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:23.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.229+0000 7fa58380b740 1 -- 172.21.15.42:0/3644012846 shutdown_connections 2024-08-26T00:03:23.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.229+0000 7fa58380b740 1 -- 172.21.15.42:0/3644012846 wait complete. 2024-08-26T00:03:23.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.229+0000 7fa58380b740 20 client.25237 trim_cache size 0 max 16384 2024-08-26T00:03:23.231 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:03:23.231 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-08-26T00:03:23.231 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "5f1dca08-7c45-4f86-8d3a-64e1958cee04", 2024-08-26T00:03:23.231 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-08-26T00:03:23.231 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:03:23.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.230+0000 7fa57b200640 1 -- 172.21.15.42:0/3977036581 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa5600a2c00 msgr2=0x7fa5600a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:23.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.230+0000 7fa57b200640 1 --2- 172.21.15.42:0/3977036581 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa5600a2c00 0x7fa5600a50c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa57c075290 tx=0x7fa574009500 comp rx=0 tx=0).stop 2024-08-26T00:03:23.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.230+0000 7fa57b200640 1 -- 172.21.15.42:0/3977036581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa57c0742b0 msgr2=0x7fa57c19a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:23.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.230+0000 7fa57b200640 1 --2- 172.21.15.42:0/3977036581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa57c0742b0 0x7fa57c19a250 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00e9f0 tx=0x7fa56c00edf0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.230+0000 7fa57b200640 1 -- 172.21.15.42:0/3977036581 shutdown_connections 2024-08-26T00:03:23.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.230+0000 7fa57b200640 1 --2- 172.21.15.42:0/3977036581 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fa5600a2c00 0x7fa5600a50c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.230+0000 7fa57b200640 1 --2- 172.21.15.42:0/3977036581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa57c10e020 0x7fa57c19eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.230+0000 7fa57b200640 1 --2- 172.21.15.42:0/3977036581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa57c074bd0 0x7fa57c19a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.230+0000 7fa57b200640 1 --2- 172.21.15.42:0/3977036581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa57c0742b0 0x7fa57c19a250 secure :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00e9f0 tx=0x7fa56c00edf0 comp rx=0 tx=0).stop 2024-08-26T00:03:23.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.230+0000 7fa57b200640 1 -- 172.21.15.42:0/3977036581 >> 172.21.15.42:0/3977036581 conn(0x7fa57c0fd4e0 msgr2=0x7fa57c0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:23.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.231+0000 7fa57b200640 1 -- 172.21.15.42:0/3977036581 shutdown_connections 2024-08-26T00:03:23.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:23.231+0000 7fa57b200640 1 -- 172.21.15.42:0/3977036581 wait complete. 2024-08-26T00:03:23.988 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-26T00:03:24.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:24 smithi181 ceph-mon[22102]: pgmap v365: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-08-26T00:03:24.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:24 smithi181 ceph-mon[22102]: scrub queued for path: / 2024-08-26T00:03:24.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:24 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:03:24.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:24 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:03:24.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:24 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:03:24.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:24 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:03:24.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:24 smithi042 ceph-mon[17225]: pgmap v365: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-08-26T00:03:24.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:24 smithi042 ceph-mon[17225]: scrub queued for path: / 2024-08-26T00:03:24.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:24 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:03:24.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:24 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:03:24.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:24 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:03:24.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:24 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:03:24.457 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:03:24.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:24 smithi043 ceph-mon[22091]: pgmap v365: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-08-26T00:03:24.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:24 smithi043 ceph-mon[22091]: scrub queued for path: / 2024-08-26T00:03:24.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:24 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:03:24.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:24 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:03:24.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:24 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:03:24.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:24 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:03:25.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.054+0000 7f858a600640 1 -- 172.21.15.42:0/2526956798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8584103db0 msgr2=0x7f8584104190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:25.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.054+0000 7f858a600640 1 --2- 172.21.15.42:0/2526956798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8584103db0 0x7f8584104190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8574009860 tx=0x7f857402a340 comp rx=0 tx=0).stop 2024-08-26T00:03:25.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.054+0000 7f858a600640 1 -- 172.21.15.42:0/2526956798 shutdown_connections 2024-08-26T00:03:25.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.054+0000 7f858a600640 1 --2- 172.21.15.42:0/2526956798 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8584108ee0 0x7f8584110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.054+0000 7f858a600640 1 --2- 172.21.15.42:0/2526956798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8584104760 0x7f85841087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.054+0000 7f858a600640 1 --2- 172.21.15.42:0/2526956798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8584103db0 0x7f8584104190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.054+0000 7f858a600640 1 -- 172.21.15.42:0/2526956798 >> 172.21.15.42:0/2526956798 conn(0x7f85840ff7f0 msgr2=0x7f8584101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:25.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.055+0000 7f858a600640 1 -- 172.21.15.42:0/2526956798 shutdown_connections 2024-08-26T00:03:25.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.055+0000 7f858a600640 1 -- 172.21.15.42:0/2526956798 wait complete. 2024-08-26T00:03:25.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.057+0000 7f858a600640 1 Processor -- start 2024-08-26T00:03:25.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.057+0000 7f858a600640 1 -- start start 2024-08-26T00:03:25.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.058+0000 7f858a600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8584103db0 0x7f858419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:25.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.058+0000 7f858a600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8584104760 0x7f858419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:25.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.058+0000 7f858a600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8584108ee0 0x7f858419eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:25.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.058+0000 7f858a600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8584113f40 con 0x7f8584103db0 2024-08-26T00:03:25.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.058+0000 7f858a600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8584113dc0 con 0x7f8584104760 2024-08-26T00:03:25.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.058+0000 7f858a600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f85841140c0 con 0x7f8584108ee0 2024-08-26T00:03:25.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.058+0000 7f8583400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8584103db0 0x7f858419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:25.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.058+0000 7f8583400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8584103db0 0x7f858419a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49924/0 (socket says 172.21.15.42:49924) 2024-08-26T00:03:25.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.058+0000 7f8583400640 1 -- 172.21.15.42:0/2034193129 learned_addr learned my addr 172.21.15.42:0/2034193129 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:25.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.058+0000 7f8583e00640 1 --2- 172.21.15.42:0/2034193129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8584108ee0 0x7f858419eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:25.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.059+0000 7f8582a00640 1 --2- 172.21.15.42:0/2034193129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8584104760 0x7f858419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:25.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.059+0000 7f8583e00640 1 -- 172.21.15.42:0/2034193129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8584104760 msgr2=0x7f858419a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:25.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.059+0000 7f8583e00640 1 --2- 172.21.15.42:0/2034193129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8584104760 0x7f858419a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.059+0000 7f8583e00640 1 -- 172.21.15.42:0/2034193129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8584103db0 msgr2=0x7f858419a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:25.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.059+0000 7f8583e00640 1 --2- 172.21.15.42:0/2034193129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8584103db0 0x7f858419a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.059+0000 7f8583e00640 1 -- 172.21.15.42:0/2034193129 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858419f380 con 0x7f8584108ee0 2024-08-26T00:03:25.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.059+0000 7f8583400640 1 --2- 172.21.15.42:0/2034193129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8584103db0 0x7f858419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:03:25.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.060+0000 7f8583e00640 1 --2- 172.21.15.42:0/2034193129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8584108ee0 0x7f858419eca0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f857c00ef00 tx=0x7f857c00c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:25.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.060+0000 7f857be00640 1 -- 172.21.15.42:0/2034193129 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c004b20 con 0x7f8584108ee0 2024-08-26T00:03:25.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.060+0000 7f858a600640 1 -- 172.21.15.42:0/2034193129 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f858419f670 con 0x7f8584108ee0 2024-08-26T00:03:25.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.061+0000 7f857be00640 1 -- 172.21.15.42:0/2034193129 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f857c003e50 con 0x7f8584108ee0 2024-08-26T00:03:25.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.061+0000 7f858a600640 1 -- 172.21.15.42:0/2034193129 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85841a6f50 con 0x7f8584108ee0 2024-08-26T00:03:25.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.061+0000 7f857be00640 1 -- 172.21.15.42:0/2034193129 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c00b570 con 0x7f8584108ee0 2024-08-26T00:03:25.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.065+0000 7f857be00640 1 -- 172.21.15.42:0/2034193129 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f857c01d020 con 0x7f8584108ee0 2024-08-26T00:03:25.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.065+0000 7f858d217740 1 Processor -- start 2024-08-26T00:03:25.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.066+0000 7f858d217740 1 -- start start 2024-08-26T00:03:25.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.066+0000 7f858d217740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea14150 0x5576bea14530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:25.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.066+0000 7f858d217740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576bea14a70 0x5576bea1edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:25.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.066+0000 7f858d217740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576bea1f330 0x5576bea21720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:25.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.066+0000 7f858d217740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5576be971fc0 con 0x5576bea14150 2024-08-26T00:03:25.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.066+0000 7f858d217740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5576be909680 con 0x5576bea1f330 2024-08-26T00:03:25.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.066+0000 7f858d217740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5576be96df80 con 0x5576bea14a70 2024-08-26T00:03:25.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.066+0000 7f857be00640 1 --2- 172.21.15.42:0/2034193129 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f85680a2c80 0x7f85680a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:25.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.066+0000 7f857be00640 1 -- 172.21.15.42:0/2034193129 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f857c0cec20 con 0x7f8584108ee0 2024-08-26T00:03:25.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.067+0000 7f8583400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576bea14a70 0x5576bea1edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:25.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.067+0000 7f8582a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea14150 0x5576bea14530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:25.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.067+0000 7f8582a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea14150 0x5576bea14530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49926/0 (socket says 172.21.15.42:49926) 2024-08-26T00:03:25.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.067+0000 7f8582a00640 1 -- 172.21.15.42:0/2199101664 learned_addr learned my addr 172.21.15.42:0/2199101664 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:25.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.067+0000 7f8583e00640 1 --2- 172.21.15.42:0/2034193129 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f85680a2c80 0x7f85680a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:25.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.068+0000 7f8582a00640 1 --2- 172.21.15.42:0/2199101664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576bea1f330 0x5576bea21720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:25.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.068+0000 7f8583400640 1 -- 172.21.15.42:0/2199101664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576bea1f330 msgr2=0x5576bea21720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:25.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.068+0000 7f8583400640 1 --2- 172.21.15.42:0/2199101664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576bea1f330 0x5576bea21720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.068+0000 7f8583400640 1 -- 172.21.15.42:0/2199101664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea14150 msgr2=0x5576bea14530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:25.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.069+0000 7f8583400640 1 --2- 172.21.15.42:0/2199101664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea14150 0x5576bea14530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.069+0000 7f8583400640 1 -- 172.21.15.42:0/2199101664 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576be9252c0 con 0x5576bea14a70 2024-08-26T00:03:25.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.069+0000 7f8582a00640 1 --2- 172.21.15.42:0/2199101664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea14150 0x5576bea14530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:03:25.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.069+0000 7f8583e00640 1 --2- 172.21.15.42:0/2034193129 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f85680a2c80 0x7f85680a5140 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f857c005fd0 tx=0x7f857c00cf70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:25.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.069+0000 7f8583400640 1 --2- 172.21.15.42:0/2199101664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576bea14a70 0x5576bea1edf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8574000c00 tx=0x7f85740095a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9aa527b7374698c server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:25.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.070+0000 7f8578c00640 1 -- 172.21.15.42:0/2199101664 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8574041020 con 0x5576bea14a70 2024-08-26T00:03:25.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.070+0000 7f8578c00640 1 -- 172.21.15.42:0/2199101664 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8574004240 con 0x5576bea14a70 2024-08-26T00:03:25.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.070+0000 7f8578c00640 1 -- 172.21.15.42:0/2199101664 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8574037040 con 0x5576bea14a70 2024-08-26T00:03:25.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.071+0000 7f858d217740 1 -- 172.21.15.42:0/2199101664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576bea14a70 msgr2=0x5576bea1edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:25.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.071+0000 7f858d217740 1 --2- 172.21.15.42:0/2199101664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576bea14a70 0x5576bea1edf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8574000c00 tx=0x7f85740095a0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.071+0000 7f858d217740 1 -- 172.21.15.42:0/2199101664 shutdown_connections 2024-08-26T00:03:25.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.071+0000 7f858d217740 1 --2- 172.21.15.42:0/2199101664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576bea1f330 0x5576bea21720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.071+0000 7f858d217740 1 --2- 172.21.15.42:0/2199101664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576bea14a70 0x5576bea1edf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.071+0000 7f858d217740 1 --2- 172.21.15.42:0/2199101664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea14150 0x5576bea14530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.071+0000 7f858d217740 1 -- 172.21.15.42:0/2199101664 >> 172.21.15.42:0/2199101664 conn(0x5576bea106e0 msgr2=0x5576bea10ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:25.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.072+0000 7f858d217740 1 -- 172.21.15.42:0/2199101664 shutdown_connections 2024-08-26T00:03:25.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.072+0000 7f858d217740 1 -- 172.21.15.42:0/2199101664 wait complete. 2024-08-26T00:03:25.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.072+0000 7f858d217740 1 -- start start 2024-08-26T00:03:25.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.073+0000 7f858d217740 1 Processor -- start 2024-08-26T00:03:25.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.073+0000 7f858d217740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea14150 0x5576bea1c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:25.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.073+0000 7f858d217740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576bea14a70 0x5576bea1c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:25.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.073+0000 7f858d217740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576bea1f330 0x5576bea1cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:25.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.073+0000 7f858d217740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5576bea32f10 con 0x5576bea14150 2024-08-26T00:03:25.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.073+0000 7f858d217740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5576be92ce50 con 0x5576bea14a70 2024-08-26T00:03:25.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.073+0000 7f858d217740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5576bea33090 con 0x5576bea1f330 2024-08-26T00:03:25.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.073+0000 7f858d217740 10 client.0 _ll_register_callbacks cb 0x5576be917f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:03:25.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.074+0000 7f8582a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea14150 0x5576bea1c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:25.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.074+0000 7f8582a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea14150 0x5576bea1c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49932/0 (socket says 172.21.15.42:49932) 2024-08-26T00:03:25.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.074+0000 7f8582a00640 1 -- 172.21.15.42:0/2361239314 learned_addr learned my addr 172.21.15.42:0/2361239314 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:25.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.074+0000 7f8582a00640 1 --2- 172.21.15.42:0/2361239314 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576bea1f330 0x5576bea1cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:25.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.074+0000 7f8583400640 1 --2- 172.21.15.42:0/2361239314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576bea14a70 0x5576bea1c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.074+0000 7f8582a00640 1 -- 172.21.15.42:0/2361239314 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576bea1f330 msgr2=0x5576bea1cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.074+0000 7f8582a00640 1 --2- 172.21.15.42:0/2361239314 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576bea1f330 0x5576bea1cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.074+0000 7f8582a00640 1 -- 172.21.15.42:0/2361239314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576bea14a70 msgr2=0x5576bea1c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.074+0000 7f8582a00640 1 --2- 172.21.15.42:0/2361239314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576bea14a70 0x5576bea1c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.074+0000 7f8582a00640 1 -- 172.21.15.42:0/2361239314 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576be6e33c0 con 0x5576bea14150 2024-08-26T00:03:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.075+0000 7f8582a00640 1 --2- 172.21.15.42:0/2361239314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea14150 0x5576bea1c100 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f857000f3c0 tx=0x7f8570015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4923d02b77e1c0b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.075+0000 7f856d600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:03:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.075+0000 7f856d600640 1 -- 172.21.15.42:0/2361239314 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8570004030 con 0x5576bea14150 2024-08-26T00:03:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.075+0000 7f858d217740 1 -- 172.21.15.42:0/2361239314 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8574004240 con 0x5576bea14150 2024-08-26T00:03:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.076+0000 7f856d600640 1 -- 172.21.15.42:0/2361239314 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f857001c040 con 0x5576bea14150 2024-08-26T00:03:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.076+0000 7f856d600640 1 -- 172.21.15.42:0/2361239314 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8570026050 con 0x5576bea14150 2024-08-26T00:03:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.076+0000 7f858d217740 10 client.15228 fetch_fsmap learned FSMap version 24 2024-08-26T00:03:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.076+0000 7f858d217740 1 -- 172.21.15.42:0/2361239314 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5576bea3ebe0 con 0x5576bea14150 2024-08-26T00:03:25.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.077+0000 7f856d600640 1 -- 172.21.15.42:0/2361239314 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8574004240 con 0x5576bea14150 2024-08-26T00:03:25.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.077+0000 7f856d600640 1 -- 172.21.15.42:0/2361239314 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8570029020 con 0x5576bea14150 2024-08-26T00:03:25.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.077+0000 7f858d217740 10 client.15228 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:03:25.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.077+0000 7f858d217740 10 client.15228 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:03:25.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.077+0000 7f858d217740 20 client.15228 populate_metadata read hostname 'smithi042' 2024-08-26T00:03:25.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.077+0000 7f858d217740 1 --2- 172.21.15.42:0/2361239314 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5576bea400a0 0x5576bea424f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:25.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.077+0000 7f858d217740 4 client.15228 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:03:25.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.077+0000 7f858d217740 1 -- 172.21.15.42:0/2361239314 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576be97f530 con 0x5576bea400a0 2024-08-26T00:03:25.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.078+0000 7f8583400640 1 --2- 172.21.15.42:0/2361239314 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5576bea400a0 0x5576bea424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:25.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.079+0000 7f8583400640 1 --2- 172.21.15.42:0/2361239314 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5576bea400a0 0x5576bea424f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=230ae4a1b425626d server_cookie=b19047fda88e4b1a in_seq=0 out_seq=0 2024-08-26T00:03:25.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.079+0000 7f856d600640 10 client.15228 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:25.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.080+0000 7f856d600640 1 -- 172.21.15.42:0/2361239314 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5576be97f530 con 0x5576bea400a0 2024-08-26T00:03:25.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.080+0000 7f856d600640 10 client.15228 handle_command_reply: tid=0 2024-08-26T00:03:25.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.080+0000 7f858d217740 1 client.15228 shutdown 2024-08-26T00:03:25.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.081+0000 7f858d217740 1 -- 172.21.15.42:0/2361239314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea14150 msgr2=0x5576bea1c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:25.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.081+0000 7f858d217740 1 --2- 172.21.15.42:0/2361239314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea14150 0x5576bea1c100 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f857000f3c0 tx=0x7f8570015040 comp rx=0 tx=0).stop 2024-08-26T00:03:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.081+0000 7f858d217740 1 -- 172.21.15.42:0/2361239314 shutdown_connections 2024-08-26T00:03:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.081+0000 7f858d217740 1 --2- 172.21.15.42:0/2361239314 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576bea1f330 0x5576bea1cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.081+0000 7f858d217740 1 --2- 172.21.15.42:0/2361239314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576bea14a70 0x5576bea1c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.081+0000 7f858d217740 1 --2- 172.21.15.42:0/2361239314 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5576bea400a0 0x5576bea424f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.081+0000 7f858d217740 1 --2- 172.21.15.42:0/2361239314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea14150 0x5576bea1c100 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.081+0000 7f858d217740 1 -- 172.21.15.42:0/2361239314 >> 172.21.15.42:0/2361239314 conn(0x5576bea106e0 msgr2=0x5576bea07050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.081+0000 7f856d600640 0 client.15228 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.081+0000 7f858d217740 1 -- 172.21.15.42:0/2361239314 shutdown_connections 2024-08-26T00:03:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.081+0000 7f858d217740 1 -- 172.21.15.42:0/2361239314 wait complete. 2024-08-26T00:03:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.081+0000 7f858d217740 20 client.15228 trim_cache size 0 max 16384 2024-08-26T00:03:25.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.118+0000 7f858d217740 1 Processor -- start 2024-08-26T00:03:25.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.118+0000 7f858d217740 1 -- start start 2024-08-26T00:03:25.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.118+0000 7f858d217740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576bea14a70 0x5576bea1c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:25.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.118+0000 7f858d217740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea1f330 0x5576bea47dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:25.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.118+0000 7f858d217740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576bea16bb0 0x5576bea48300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:25.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.118+0000 7f858d217740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8564010e40 con 0x5576bea1f330 2024-08-26T00:03:25.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.118+0000 7f858d217740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f856400e710 con 0x5576bea14a70 2024-08-26T00:03:25.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.118+0000 7f858d217740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f856400c500 con 0x5576bea16bb0 2024-08-26T00:03:25.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.119+0000 7f8582a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576bea16bb0 0x5576bea48300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:25.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.119+0000 7f8583400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea1f330 0x5576bea47dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:25.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.119+0000 7f8582a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576bea16bb0 0x5576bea48300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:38152/0 (socket says 172.21.15.42:38152) 2024-08-26T00:03:25.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.119+0000 7f8582a00640 1 -- 172.21.15.42:0/2889035476 learned_addr learned my addr 172.21.15.42:0/2889035476 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:25.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.119+0000 7f8582a00640 1 --2- 172.21.15.42:0/2889035476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576bea14a70 0x5576bea1c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:25.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.119+0000 7f8582a00640 1 -- 172.21.15.42:0/2889035476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576bea14a70 msgr2=0x5576bea1c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:25.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.119+0000 7f8582a00640 1 --2- 172.21.15.42:0/2889035476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576bea14a70 0x5576bea1c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.119+0000 7f8582a00640 1 -- 172.21.15.42:0/2889035476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea1f330 msgr2=0x5576bea47dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:25.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.119+0000 7f8582a00640 1 --2- 172.21.15.42:0/2889035476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea1f330 0x5576bea47dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.119+0000 7f8582a00640 1 -- 172.21.15.42:0/2889035476 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576bea10510 con 0x5576bea16bb0 2024-08-26T00:03:25.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.120+0000 7f8583400640 1 --2- 172.21.15.42:0/2889035476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea1f330 0x5576bea47dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:03:25.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.120+0000 7f8582a00640 1 --2- 172.21.15.42:0/2889035476 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576bea16bb0 0x5576bea48300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f85700096c0 tx=0x7f8570015040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d775b457835420e server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:25.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.120+0000 7f856fe00640 1 -- 172.21.15.42:0/2889035476 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8570010b70 con 0x5576bea16bb0 2024-08-26T00:03:25.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.120+0000 7f856fe00640 1 -- 172.21.15.42:0/2889035476 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85700044a0 con 0x5576bea16bb0 2024-08-26T00:03:25.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.121+0000 7f856fe00640 1 -- 172.21.15.42:0/2889035476 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8570020520 con 0x5576bea16bb0 2024-08-26T00:03:25.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.121+0000 7f858d217740 1 -- 172.21.15.42:0/2889035476 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576bea16bb0 msgr2=0x5576bea48300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:25.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.121+0000 7f858d217740 1 --2- 172.21.15.42:0/2889035476 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576bea16bb0 0x5576bea48300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f85700096c0 tx=0x7f8570015040 comp rx=0 tx=0).stop 2024-08-26T00:03:25.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.122+0000 7f858d217740 1 -- 172.21.15.42:0/2889035476 shutdown_connections 2024-08-26T00:03:25.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.122+0000 7f858d217740 1 --2- 172.21.15.42:0/2889035476 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576bea16bb0 0x5576bea48300 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.122+0000 7f858d217740 1 --2- 172.21.15.42:0/2889035476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea1f330 0x5576bea47dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.122+0000 7f858d217740 1 --2- 172.21.15.42:0/2889035476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576bea14a70 0x5576bea1c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.122+0000 7f858d217740 1 -- 172.21.15.42:0/2889035476 >> 172.21.15.42:0/2889035476 conn(0x5576bea106e0 msgr2=0x5576bea1b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:25.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.122+0000 7f858d217740 1 -- 172.21.15.42:0/2889035476 shutdown_connections 2024-08-26T00:03:25.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.122+0000 7f858d217740 1 -- 172.21.15.42:0/2889035476 wait complete. 2024-08-26T00:03:25.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.123+0000 7f858d217740 1 -- start start 2024-08-26T00:03:25.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.123+0000 7f858d217740 1 Processor -- start 2024-08-26T00:03:25.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.124+0000 7f858d217740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576bea14a70 0x5576bea38be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:25.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.124+0000 7f858d217740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea16bb0 0x5576bea1bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:25.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.124+0000 7f858d217740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576bea1f330 0x5576bea1c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:25.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.124+0000 7f858d217740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f856400cbd0 con 0x5576bea16bb0 2024-08-26T00:03:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.124+0000 7f858d217740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f856400e040 con 0x5576bea14a70 2024-08-26T00:03:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.124+0000 7f858d217740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f856400d2a0 con 0x5576bea1f330 2024-08-26T00:03:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.124+0000 7f858d217740 10 client.0 _ll_register_callbacks cb 0x7f8570009d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:03:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.124+0000 7f8582a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576bea14a70 0x5576bea38be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.124+0000 7f8582a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576bea14a70 0x5576bea38be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:49992/0 (socket says 172.21.15.42:49992) 2024-08-26T00:03:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.124+0000 7f8582a00640 1 -- 172.21.15.42:0/3446497906 learned_addr learned my addr 172.21.15.42:0/3446497906 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.124+0000 7f8582a00640 1 --2- 172.21.15.42:0/3446497906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576bea1f330 0x5576bea1c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.124+0000 7f8583400640 1 --2- 172.21.15.42:0/3446497906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea16bb0 0x5576bea1bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:25.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.125+0000 7f8582a00640 1 -- 172.21.15.42:0/3446497906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576bea1f330 msgr2=0x5576bea1c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:25.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.125+0000 7f8582a00640 1 --2- 172.21.15.42:0/3446497906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576bea1f330 0x5576bea1c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.125+0000 7f8582a00640 1 -- 172.21.15.42:0/3446497906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea16bb0 msgr2=0x5576bea1bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:25.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.125+0000 7f8582a00640 1 --2- 172.21.15.42:0/3446497906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea16bb0 0x5576bea1bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.125+0000 7f8582a00640 1 -- 172.21.15.42:0/3446497906 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576bea1ccd0 con 0x5576bea14a70 2024-08-26T00:03:25.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.125+0000 7f8583400640 1 --2- 172.21.15.42:0/3446497906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea16bb0 0x5576bea1bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:03:25.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.125+0000 7f8582a00640 1 --2- 172.21.15.42:0/3446497906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576bea14a70 0x5576bea38be0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8570009fd0 tx=0x7f8570005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20968434712977c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:25.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.125+0000 7f856d600640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:03:25.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.125+0000 7f856d600640 1 -- 172.21.15.42:0/3446497906 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8570003800 con 0x5576bea14a70 2024-08-26T00:03:25.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.126+0000 7f856d600640 1 -- 172.21.15.42:0/3446497906 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f85700039a0 con 0x5576bea14a70 2024-08-26T00:03:25.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.126+0000 7f858d217740 1 -- 172.21.15.42:0/3446497906 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85700044a0 con 0x5576bea14a70 2024-08-26T00:03:25.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.126+0000 7f856d600640 1 -- 172.21.15.42:0/3446497906 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8570040070 con 0x5576bea14a70 2024-08-26T00:03:25.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.126+0000 7f858d217740 10 client.25247 fetch_fsmap learned FSMap version 24 2024-08-26T00:03:25.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.126+0000 7f858d217740 1 -- 172.21.15.42:0/3446497906 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5576beaaaed0 con 0x5576bea14a70 2024-08-26T00:03:25.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.126+0000 7f856d600640 1 -- 172.21.15.42:0/3446497906 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85700044a0 con 0x5576bea14a70 2024-08-26T00:03:25.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.127+0000 7f856d600640 1 -- 172.21.15.42:0/3446497906 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8570036040 con 0x5576bea14a70 2024-08-26T00:03:25.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.127+0000 7f858d217740 10 client.25247 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:03:25.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.127+0000 7f858d217740 10 client.25247 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:03:25.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.127+0000 7f858d217740 20 client.25247 populate_metadata read hostname 'smithi042' 2024-08-26T00:03:25.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.127+0000 7f858d217740 1 --2- 172.21.15.42:0/3446497906 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5576beaab420 0x5576beaad810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:25.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.127+0000 7f858d217740 4 client.25247 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-26T00:03:25.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.127+0000 7f858d217740 1 -- 172.21.15.42:0/3446497906 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5576be979a40 con 0x5576beaab420 2024-08-26T00:03:25.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.127+0000 7f8583400640 1 --2- 172.21.15.42:0/3446497906 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5576beaab420 0x5576beaad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:25.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.128+0000 7f8583400640 1 --2- 172.21.15.42:0/3446497906 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5576beaab420 0x5576beaad810 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0e1113e2ce46822 server_cookie=530f8f6bf8e51504 in_seq=0 out_seq=0 2024-08-26T00:03:25.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.128+0000 7f856d600640 10 client.25247 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:25.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.128+0000 7f856d600640 1 -- 172.21.15.42:0/3446497906 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5576be979a40 con 0x5576beaab420 2024-08-26T00:03:25.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.128+0000 7f856d600640 10 client.25247 handle_command_reply: tid=0 2024-08-26T00:03:25.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.128+0000 7f858d217740 1 client.25247 shutdown 2024-08-26T00:03:25.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.129+0000 7f858d217740 1 -- 172.21.15.42:0/3446497906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576bea14a70 msgr2=0x5576bea38be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:25.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.129+0000 7f858d217740 1 --2- 172.21.15.42:0/3446497906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576bea14a70 0x5576bea38be0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8570009fd0 tx=0x7f8570005850 comp rx=0 tx=0).stop 2024-08-26T00:03:25.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.129+0000 7f858d217740 1 -- 172.21.15.42:0/3446497906 shutdown_connections 2024-08-26T00:03:25.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.129+0000 7f858d217740 1 --2- 172.21.15.42:0/3446497906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5576bea1f330 0x5576bea1c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.129+0000 7f858d217740 1 --2- 172.21.15.42:0/3446497906 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5576beaab420 0x5576beaad810 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.129+0000 7f858d217740 1 --2- 172.21.15.42:0/3446497906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576bea16bb0 0x5576bea1bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.129+0000 7f858d217740 1 --2- 172.21.15.42:0/3446497906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5576bea14a70 0x5576bea38be0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.129+0000 7f858d217740 1 -- 172.21.15.42:0/3446497906 >> 172.21.15.42:0/3446497906 conn(0x5576bea106e0 msgr2=0x5576bea06830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:25.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.129+0000 7f856d600640 0 client.25247 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:25.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.129+0000 7f858d217740 1 -- 172.21.15.42:0/3446497906 shutdown_connections 2024-08-26T00:03:25.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.129+0000 7f858d217740 1 -- 172.21.15.42:0/3446497906 wait complete. 2024-08-26T00:03:25.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.129+0000 7f858d217740 20 client.25247 trim_cache size 0 max 16384 2024-08-26T00:03:25.133 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:03:25.133 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-08-26T00:03:25.133 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {} 2024-08-26T00:03:25.133 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:03:25.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.130+0000 7f858a600640 1 -- 172.21.15.42:0/2034193129 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f85680a2c80 msgr2=0x7f85680a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:25.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.130+0000 7f858a600640 1 --2- 172.21.15.42:0/2034193129 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f85680a2c80 0x7f85680a5140 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f857c005fd0 tx=0x7f857c00cf70 comp rx=0 tx=0).stop 2024-08-26T00:03:25.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.130+0000 7f858a600640 1 -- 172.21.15.42:0/2034193129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8584108ee0 msgr2=0x7f858419eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:25.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.130+0000 7f858a600640 1 --2- 172.21.15.42:0/2034193129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8584108ee0 0x7f858419eca0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f857c00ef00 tx=0x7f857c00c740 comp rx=0 tx=0).stop 2024-08-26T00:03:25.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.131+0000 7f858a600640 1 -- 172.21.15.42:0/2034193129 shutdown_connections 2024-08-26T00:03:25.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.131+0000 7f858a600640 1 --2- 172.21.15.42:0/2034193129 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f85680a2c80 0x7f85680a5140 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.131+0000 7f858a600640 1 --2- 172.21.15.42:0/2034193129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8584108ee0 0x7f858419eca0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.131+0000 7f858a600640 1 --2- 172.21.15.42:0/2034193129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8584104760 0x7f858419a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.131+0000 7f858a600640 1 --2- 172.21.15.42:0/2034193129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8584103db0 0x7f858419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:25.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.131+0000 7f858a600640 1 -- 172.21.15.42:0/2034193129 >> 172.21.15.42:0/2034193129 conn(0x7f85840ff7f0 msgr2=0x7f8584100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:25.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.131+0000 7f858a600640 1 -- 172.21.15.42:0/2034193129 shutdown_connections 2024-08-26T00:03:25.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:25.131+0000 7f858a600640 1 -- 172.21.15.42:0/2034193129 wait complete. 2024-08-26T00:03:25.918 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-26T00:03:25.918 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:03:26.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:26 smithi042 ceph-mon[17225]: pgmap v366: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:03:26.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:26 smithi181 ceph-mon[22102]: pgmap v366: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:03:26.351 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:03:26.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:26 smithi043 ceph-mon[22091]: pgmap v366: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:03:27.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.008+0000 7fd9e2000640 1 -- 172.21.15.42:0/661429366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9dc109970 msgr2=0x7fd9dc109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:27.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.008+0000 7fd9e2000640 1 --2- 172.21.15.42:0/661429366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9dc109970 0x7fd9dc109d50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0009860 tx=0x7fd9d002a340 comp rx=0 tx=0).stop 2024-08-26T00:03:27.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.009+0000 7fd9e2000640 1 -- 172.21.15.42:0/661429366 shutdown_connections 2024-08-26T00:03:27.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.009+0000 7fd9e2000640 1 --2- 172.21.15.42:0/661429366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9dc104310 0x7fd9dc110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:27.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.009+0000 7fd9e2000640 1 --2- 172.21.15.42:0/661429366 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9dc103970 0x7fd9dc103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:27.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.009+0000 7fd9e2000640 1 --2- 172.21.15.42:0/661429366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9dc109970 0x7fd9dc109d50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:27.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.009+0000 7fd9e2000640 1 -- 172.21.15.42:0/661429366 >> 172.21.15.42:0/661429366 conn(0x7fd9dc0ff6b0 msgr2=0x7fd9dc101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:27.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.009+0000 7fd9e2000640 1 -- 172.21.15.42:0/661429366 shutdown_connections 2024-08-26T00:03:27.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.010+0000 7fd9e2000640 1 -- 172.21.15.42:0/661429366 wait complete. 2024-08-26T00:03:27.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.011+0000 7fd9e2000640 1 Processor -- start 2024-08-26T00:03:27.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.011+0000 7fd9e2000640 1 -- start start 2024-08-26T00:03:27.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.011+0000 7fd9e2000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9dc103970 0x7fd9dc19a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:27.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.011+0000 7fd9e2000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9dc104310 0x7fd9dc19a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:27.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.011+0000 7fd9e2000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9dc109970 0x7fd9dc19eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:27.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.011+0000 7fd9e2000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd9dc113d70 con 0x7fd9dc104310 2024-08-26T00:03:27.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.011+0000 7fd9e2000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd9dc113bf0 con 0x7fd9dc103970 2024-08-26T00:03:27.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.011+0000 7fd9e2000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd9dc113ef0 con 0x7fd9dc109970 2024-08-26T00:03:27.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.012+0000 7fd9e0c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9dc103970 0x7fd9dc19a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:27.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.012+0000 7fd9e0c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9dc103970 0x7fd9dc19a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:50010/0 (socket says 172.21.15.42:50010) 2024-08-26T00:03:27.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.012+0000 7fd9e0c00640 1 -- 172.21.15.42:0/3590709962 learned_addr learned my addr 172.21.15.42:0/3590709962 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:27.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.012+0000 7fd9dbe00640 1 --2- 172.21.15.42:0/3590709962 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9dc104310 0x7fd9dc19a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:27.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.012+0000 7fd9e1600640 1 --2- 172.21.15.42:0/3590709962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9dc109970 0x7fd9dc19eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:27.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.012+0000 7fd9e0c00640 1 -- 172.21.15.42:0/3590709962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9dc109970 msgr2=0x7fd9dc19eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:27.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.012+0000 7fd9e0c00640 1 --2- 172.21.15.42:0/3590709962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9dc109970 0x7fd9dc19eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:27.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.012+0000 7fd9e0c00640 1 -- 172.21.15.42:0/3590709962 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9dc104310 msgr2=0x7fd9dc19a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:27.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.012+0000 7fd9e0c00640 1 --2- 172.21.15.42:0/3590709962 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9dc104310 0x7fd9dc19a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:27.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.012+0000 7fd9e0c00640 1 -- 172.21.15.42:0/3590709962 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9dc19f1e0 con 0x7fd9dc103970 2024-08-26T00:03:27.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.013+0000 7fd9e0c00640 1 --2- 172.21.15.42:0/3590709962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9dc103970 0x7fd9dc19a230 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0035040 tx=0x7fd9d0033b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:27.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.013+0000 7fd9d9600640 1 -- 172.21.15.42:0/3590709962 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0030990 con 0x7fd9dc103970 2024-08-26T00:03:27.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.013+0000 7fd9e2000640 1 -- 172.21.15.42:0/3590709962 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9dc19f470 con 0x7fd9dc103970 2024-08-26T00:03:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.013+0000 7fd9e2000640 1 -- 172.21.15.42:0/3590709962 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9dc0763d0 con 0x7fd9dc103970 2024-08-26T00:03:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.013+0000 7fd9d9600640 1 -- 172.21.15.42:0/3590709962 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9d0033e10 con 0x7fd9dc103970 2024-08-26T00:03:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.013+0000 7fd9d9600640 1 -- 172.21.15.42:0/3590709962 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0003830 con 0x7fd9dc103970 2024-08-26T00:03:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.015+0000 7fd9e2000640 1 -- 172.21.15.42:0/3590709962 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9bc005290 con 0x7fd9dc103970 2024-08-26T00:03:27.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.018+0000 7fd9d9600640 1 -- 172.21.15.42:0/3590709962 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd9d003e980 con 0x7fd9dc103970 2024-08-26T00:03:27.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.020+0000 7fd9d9600640 1 --2- 172.21.15.42:0/3590709962 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd9c40a2c00 0x7fd9c40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:27.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.020+0000 7fd9d9600640 1 -- 172.21.15.42:0/3590709962 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fd9d00f78b0 con 0x7fd9dc103970 2024-08-26T00:03:27.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.021+0000 7fd9dbe00640 1 --2- 172.21.15.42:0/3590709962 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd9c40a2c00 0x7fd9c40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:27.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.022+0000 7fd9dbe00640 1 --2- 172.21.15.42:0/3590709962 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd9c40a2c00 0x7fd9c40a50c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc101ce0 tx=0x7fd9c8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:27.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.024+0000 7fd9d9600640 1 -- 172.21.15.42:0/3590709962 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd9d00c47d0 con 0x7fd9dc103970 2024-08-26T00:03:27.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.267+0000 7fd9e2000640 1 -- 172.21.15.42:0/3590709962 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9bc005580 con 0x7fd9dc103970 2024-08-26T00:03:27.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.268+0000 7fd9d9600640 1 -- 172.21.15.42:0/3590709962 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11909 (secure 0 0 0) 0x7fd9d00c40d0 con 0x7fd9dc103970 2024-08-26T00:03:27.272 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:03:27.272 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":24,"btime":"2024-08-26T00:02:28:193800+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3168581452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3168581452},{"type":"v1","addr":"172.21.15.42:6839","nonce":3168581452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/3533492491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":3533492491},{"type":"v1","addr":"172.21.15.42:6841","nonce":3533492491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-26T00:00:30.169633+0000","modified":"2024-08-26T00:02:27.753317+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24532,"mds_1":24527,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6839/2653014277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2653014277},{"type":"v1","addr":"172.21.15.43:6839","nonce":2653014277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24532,"qdb_cluster":[24532,24527,24514]},"id":1}]} 2024-08-26T00:03:27.272 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 24 2024-08-26T00:03:27.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.271+0000 7fd9e2000640 1 -- 172.21.15.42:0/3590709962 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd9c40a2c00 msgr2=0x7fd9c40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:27.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.271+0000 7fd9e2000640 1 --2- 172.21.15.42:0/3590709962 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd9c40a2c00 0x7fd9c40a50c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc101ce0 tx=0x7fd9c8009260 comp rx=0 tx=0).stop 2024-08-26T00:03:27.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.271+0000 7fd9e2000640 1 -- 172.21.15.42:0/3590709962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9dc103970 msgr2=0x7fd9dc19a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:27.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.271+0000 7fd9e2000640 1 --2- 172.21.15.42:0/3590709962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9dc103970 0x7fd9dc19a230 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0035040 tx=0x7fd9d0033b60 comp rx=0 tx=0).stop 2024-08-26T00:03:27.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.272+0000 7fd9e2000640 1 -- 172.21.15.42:0/3590709962 shutdown_connections 2024-08-26T00:03:27.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.272+0000 7fd9e2000640 1 --2- 172.21.15.42:0/3590709962 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd9c40a2c00 0x7fd9c40a50c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:27.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.272+0000 7fd9e2000640 1 --2- 172.21.15.42:0/3590709962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9dc109970 0x7fd9dc19eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:27.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.272+0000 7fd9e2000640 1 --2- 172.21.15.42:0/3590709962 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9dc104310 0x7fd9dc19a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:27.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.272+0000 7fd9e2000640 1 --2- 172.21.15.42:0/3590709962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9dc103970 0x7fd9dc19a230 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:27.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.272+0000 7fd9e2000640 1 -- 172.21.15.42:0/3590709962 >> 172.21.15.42:0/3590709962 conn(0x7fd9dc0ff6b0 msgr2=0x7fd9dc0fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:27.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.272+0000 7fd9e2000640 1 -- 172.21.15.42:0/3590709962 shutdown_connections 2024-08-26T00:03:27.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:27.272+0000 7fd9e2000640 1 -- 172.21.15.42:0/3590709962 wait complete. 2024-08-26T00:03:28.058 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-26T00:03:28.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:28 smithi042 ceph-mon[17225]: pgmap v367: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:03:28.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:28 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/3590709962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:03:28.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:28 smithi043 ceph-mon[22091]: pgmap v367: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:03:28.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:28 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/3590709962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:03:28.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:28 smithi181 ceph-mon[22102]: pgmap v367: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-26T00:03:28.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:28 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/3590709962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:03:28.616 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:03:29.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.274+0000 7f9e7d600640 1 -- 172.21.15.42:0/162861834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e78104310 msgr2=0x7f9e78110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:29.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.274+0000 7f9e7d600640 1 --2- 172.21.15.42:0/162861834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e78104310 0x7f9e78110840 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009cd0 tx=0x7f9e7002a8e0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.275+0000 7f9e7d600640 1 -- 172.21.15.42:0/162861834 shutdown_connections 2024-08-26T00:03:29.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.275+0000 7f9e7d600640 1 --2- 172.21.15.42:0/162861834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e78104310 0x7f9e78110840 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.275+0000 7f9e7d600640 1 --2- 172.21.15.42:0/162861834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9e78103970 0x7f9e78103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.275+0000 7f9e7d600640 1 --2- 172.21.15.42:0/162861834 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e78109970 0x7f9e78109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.275+0000 7f9e7d600640 1 -- 172.21.15.42:0/162861834 >> 172.21.15.42:0/162861834 conn(0x7f9e780ff6b0 msgr2=0x7f9e78101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:29.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.275+0000 7f9e7d600640 1 -- 172.21.15.42:0/162861834 shutdown_connections 2024-08-26T00:03:29.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.276+0000 7f9e7d600640 1 -- 172.21.15.42:0/162861834 wait complete. 2024-08-26T00:03:29.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.277+0000 7f9e7d600640 1 Processor -- start 2024-08-26T00:03:29.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.277+0000 7f9e7d600640 1 -- start start 2024-08-26T00:03:29.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.278+0000 7f9e7d600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e78103970 0x7f9e7819a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:29.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.278+0000 7f9e7d600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9e78104310 0x7f9e7819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:29.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.278+0000 7f9e7d600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e78109970 0x7f9e7819ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:29.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.278+0000 7f9e7d600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9e78113dc0 con 0x7f9e78103970 2024-08-26T00:03:29.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.278+0000 7f9e7d600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9e78113c40 con 0x7f9e78109970 2024-08-26T00:03:29.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.278+0000 7f9e7d600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9e78113f40 con 0x7f9e78104310 2024-08-26T00:03:29.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.278+0000 7f9e7cc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e78109970 0x7f9e7819ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:29.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.279+0000 7f9e77400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9e78104310 0x7f9e7819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:29.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.279+0000 7f9e7cc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e78109970 0x7f9e7819ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:50030/0 (socket says 172.21.15.42:50030) 2024-08-26T00:03:29.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.279+0000 7f9e7cc00640 1 -- 172.21.15.42:0/821258133 learned_addr learned my addr 172.21.15.42:0/821258133 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:29.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.279+0000 7f9e7cc00640 1 -- 172.21.15.42:0/821258133 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9e78104310 msgr2=0x7f9e7819a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:29.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.279+0000 7f9e7cc00640 1 --2- 172.21.15.42:0/821258133 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9e78104310 0x7f9e7819a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.279+0000 7f9e77e00640 1 --2- 172.21.15.42:0/821258133 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e78103970 0x7f9e7819a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:29.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.279+0000 7f9e7cc00640 1 -- 172.21.15.42:0/821258133 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e78103970 msgr2=0x7f9e7819a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:29.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.279+0000 7f9e7cc00640 1 --2- 172.21.15.42:0/821258133 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e78103970 0x7f9e7819a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.279+0000 7f9e7cc00640 1 -- 172.21.15.42:0/821258133 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e7819f170 con 0x7f9e78109970 2024-08-26T00:03:29.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.279+0000 7f9e77e00640 1 --2- 172.21.15.42:0/821258133 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e78103970 0x7f9e7819a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:03:29.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.280+0000 7f9e7cc00640 1 --2- 172.21.15.42:0/821258133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e78109970 0x7f9e7819ea90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9e70033040 tx=0x7f9e70031e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:29.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.280+0000 7f9e74c00640 1 -- 172.21.15.42:0/821258133 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70004040 con 0x7f9e78109970 2024-08-26T00:03:29.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.280+0000 7f9e74c00640 1 -- 172.21.15.42:0/821258133 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e700046c0 con 0x7f9e78109970 2024-08-26T00:03:29.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.280+0000 7f9e74c00640 1 -- 172.21.15.42:0/821258133 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70030e80 con 0x7f9e78109970 2024-08-26T00:03:29.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.280+0000 7f9e7d600640 1 -- 172.21.15.42:0/821258133 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e7819f400 con 0x7f9e78109970 2024-08-26T00:03:29.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.280+0000 7f9e7d600640 1 -- 172.21.15.42:0/821258133 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e781a6d40 con 0x7f9e78109970 2024-08-26T00:03:29.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.285+0000 7f9e81821740 1 Processor -- start 2024-08-26T00:03:29.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.286+0000 7f9e74c00640 1 -- 172.21.15.42:0/821258133 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9e700305a0 con 0x7f9e78109970 2024-08-26T00:03:29.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.286+0000 7f9e81821740 1 -- start start 2024-08-26T00:03:29.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.286+0000 7f9e81821740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb9e45950 0x558eb9e45d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:29.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.286+0000 7f9e81821740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e46270 0x558eb9e58ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:29.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.286+0000 7f9e81821740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb9e59420 0x558eb9e5b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:29.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.286+0000 7f9e81821740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558eb9dabf30 con 0x558eb9e45950 2024-08-26T00:03:29.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.286+0000 7f9e81821740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558eb9d435a0 con 0x558eb9e46270 2024-08-26T00:03:29.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.286+0000 7f9e81821740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558eb9da7ef0 con 0x558eb9e59420 2024-08-26T00:03:29.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.287+0000 7f9e77e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e46270 0x558eb9e58ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:29.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.287+0000 7f9e77e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e46270 0x558eb9e58ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:50032/0 (socket says 172.21.15.42:50032) 2024-08-26T00:03:29.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.287+0000 7f9e77e00640 1 -- 172.21.15.42:0/1605440716 learned_addr learned my addr 172.21.15.42:0/1605440716 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:29.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.287+0000 7f9e77400640 1 --2- 172.21.15.42:0/1605440716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb9e45950 0x558eb9e45d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:29.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.288+0000 7f9e77400640 1 --2- 172.21.15.42:0/1605440716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb9e59420 0x558eb9e5b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:29.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.288+0000 7f9e77400640 1 -- 172.21.15.42:0/1605440716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb9e59420 msgr2=0x558eb9e5b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:29.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.288+0000 7f9e77400640 1 --2- 172.21.15.42:0/1605440716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb9e59420 0x558eb9e5b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.288+0000 7f9e77400640 1 -- 172.21.15.42:0/1605440716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e46270 msgr2=0x558eb9e58ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:29.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.288+0000 7f9e77400640 1 --2- 172.21.15.42:0/1605440716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e46270 0x558eb9e58ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.288+0000 7f9e77400640 1 -- 172.21.15.42:0/1605440716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eb9b1d3c0 con 0x558eb9e45950 2024-08-26T00:03:29.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.289+0000 7f9e77e00640 1 --2- 172.21.15.42:0/1605440716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e46270 0x558eb9e58ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:03:29.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.289+0000 7f9e74c00640 1 --2- 172.21.15.42:0/821258133 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9e5c0a2c00 0x7f9e5c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:29.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.289+0000 7f9e77400640 1 --2- 172.21.15.42:0/1605440716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb9e45950 0x558eb9e45d30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009f80 tx=0x7f9e64004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90041448b79155b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:29.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.289+0000 7f9e6d200640 1 -- 172.21.15.42:0/1605440716 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e64004220 con 0x558eb9e45950 2024-08-26T00:03:29.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.289+0000 7f9e6d200640 1 -- 172.21.15.42:0/1605440716 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e640043c0 con 0x558eb9e45950 2024-08-26T00:03:29.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.289+0000 7f9e6d200640 1 -- 172.21.15.42:0/1605440716 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e640035f0 con 0x558eb9e45950 2024-08-26T00:03:29.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.289+0000 7f9e77e00640 1 --2- 172.21.15.42:0/821258133 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9e5c0a2c00 0x7f9e5c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:29.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.290+0000 7f9e74c00640 1 -- 172.21.15.42:0/821258133 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f9e7002e030 con 0x7f9e78109970 2024-08-26T00:03:29.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.291+0000 7f9e81821740 1 -- 172.21.15.42:0/1605440716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb9e45950 msgr2=0x558eb9e45d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:29.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.291+0000 7f9e81821740 1 --2- 172.21.15.42:0/1605440716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb9e45950 0x558eb9e45d30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009f80 tx=0x7f9e64004730 comp rx=0 tx=0).stop 2024-08-26T00:03:29.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.291+0000 7f9e77e00640 1 --2- 172.21.15.42:0/821258133 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9e5c0a2c00 0x7f9e5c0a50c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9e68009eb0 tx=0x7f9e68005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:29.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.291+0000 7f9e81821740 1 -- 172.21.15.42:0/1605440716 shutdown_connections 2024-08-26T00:03:29.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.291+0000 7f9e81821740 1 --2- 172.21.15.42:0/1605440716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb9e59420 0x558eb9e5b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.291+0000 7f9e81821740 1 --2- 172.21.15.42:0/1605440716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e46270 0x558eb9e58ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.291+0000 7f9e81821740 1 --2- 172.21.15.42:0/1605440716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb9e45950 0x558eb9e45d30 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.291+0000 7f9e81821740 1 -- 172.21.15.42:0/1605440716 >> 172.21.15.42:0/1605440716 conn(0x558eb9e41fc0 msgr2=0x558eb9e423a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:29.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.291+0000 7f9e81821740 1 -- 172.21.15.42:0/1605440716 shutdown_connections 2024-08-26T00:03:29.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.292+0000 7f9e81821740 1 -- 172.21.15.42:0/1605440716 wait complete. 2024-08-26T00:03:29.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.293+0000 7f9e81821740 1 -- start start 2024-08-26T00:03:29.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.293+0000 7f9e81821740 1 Processor -- start 2024-08-26T00:03:29.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.294+0000 7f9e81821740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e45950 0x558eb9e563c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:29.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.294+0000 7f9e81821740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb9e46270 0x558eb9e56900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:29.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.294+0000 7f9e81821740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb9e59420 0x558eb9e56e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:29.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.294+0000 7f9e81821740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558eb9e5bf90 con 0x558eb9e46270 2024-08-26T00:03:29.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.294+0000 7f9e81821740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558eb9d66de0 con 0x558eb9e45950 2024-08-26T00:03:29.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.294+0000 7f9e81821740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558eb9e5c110 con 0x558eb9e59420 2024-08-26T00:03:29.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.294+0000 7f9e81821740 10 client.0 _ll_register_callbacks cb 0x558eb9d557b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:03:29.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.294+0000 7f9e77e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e45950 0x558eb9e563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:29.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.294+0000 7f9e77e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e45950 0x558eb9e563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:50042/0 (socket says 172.21.15.42:50042) 2024-08-26T00:03:29.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.294+0000 7f9e77e00640 1 -- 172.21.15.42:0/357655440 learned_addr learned my addr 172.21.15.42:0/357655440 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:29.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.294+0000 7f9e77400640 1 --2- 172.21.15.42:0/357655440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb9e46270 0x558eb9e56900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:29.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.294+0000 7f9e7cc00640 1 --2- 172.21.15.42:0/357655440 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb9e59420 0x558eb9e56e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:29.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.295+0000 7f9e77e00640 1 -- 172.21.15.42:0/357655440 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb9e59420 msgr2=0x558eb9e56e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:29.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.295+0000 7f9e77e00640 1 --2- 172.21.15.42:0/357655440 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb9e59420 0x558eb9e56e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.295+0000 7f9e77e00640 1 -- 172.21.15.42:0/357655440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb9e46270 msgr2=0x558eb9e56900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:29.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.295+0000 7f9e77e00640 1 --2- 172.21.15.42:0/357655440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb9e46270 0x558eb9e56900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.295+0000 7f9e77e00640 1 -- 172.21.15.42:0/357655440 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eb9e65570 con 0x558eb9e45950 2024-08-26T00:03:29.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.295+0000 7f9e77400640 1 --2- 172.21.15.42:0/357655440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb9e46270 0x558eb9e56900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:03:29.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.295+0000 7f9e77e00640 1 --2- 172.21.15.42:0/357655440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e45950 0x558eb9e563c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9e680043b0 tx=0x7f9e680046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14f47c67aa554390 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:29.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.295+0000 7f9e61600640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:03:29.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.296+0000 7f9e61600640 1 -- 172.21.15.42:0/357655440 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e68020800 con 0x558eb9e45950 2024-08-26T00:03:29.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.296+0000 7f9e61600640 1 -- 172.21.15.42:0/357655440 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f9e680209a0 con 0x558eb9e45950 2024-08-26T00:03:29.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.296+0000 7f9e81821740 1 -- 172.21.15.42:0/357655440 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e640043c0 con 0x558eb9e45950 2024-08-26T00:03:29.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.296+0000 7f9e61600640 1 -- 172.21.15.42:0/357655440 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9e680044a0 con 0x558eb9e45950 2024-08-26T00:03:29.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.296+0000 7f9e81821740 10 client.25265 fetch_fsmap learned FSMap version 24 2024-08-26T00:03:29.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.297+0000 7f9e81821740 1 -- 172.21.15.42:0/357655440 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558eb9e67f40 con 0x558eb9e45950 2024-08-26T00:03:29.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.297+0000 7f9e61600640 1 -- 172.21.15.42:0/357655440 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e640043c0 con 0x558eb9e45950 2024-08-26T00:03:29.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.298+0000 7f9e61600640 1 -- 172.21.15.42:0/357655440 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9e6800f040 con 0x558eb9e45950 2024-08-26T00:03:29.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.298+0000 7f9e81821740 10 client.25265 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:03:29.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.298+0000 7f9e81821740 10 client.25265 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-26T00:03:29.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.298+0000 7f9e81821740 20 client.25265 populate_metadata read hostname 'smithi042' 2024-08-26T00:03:29.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.298+0000 7f9e81821740 1 --2- 172.21.15.42:0/357655440 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x558eb9e69400 0x558eb9e6b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:29.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.298+0000 7f9e81821740 4 client.25265 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:03:29.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.298+0000 7f9e81821740 1 -- 172.21.15.42:0/357655440 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558eb9db94a0 con 0x558eb9e69400 2024-08-26T00:03:29.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.298+0000 7f9e77400640 1 --2- 172.21.15.42:0/357655440 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x558eb9e69400 0x558eb9e6b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:29.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.299+0000 7f9e77400640 1 --2- 172.21.15.42:0/357655440 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x558eb9e69400 0x558eb9e6b810 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3dfbf449d8f26e server_cookie=c818e61514f29ecf in_seq=0 out_seq=0 2024-08-26T00:03:29.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.299+0000 7f9e61600640 10 client.25265 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:03:29.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.300+0000 7f9e61600640 1 -- 172.21.15.42:0/357655440 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558eb9db94a0 con 0x558eb9e69400 2024-08-26T00:03:29.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.300+0000 7f9e61600640 10 client.25265 handle_command_reply: tid=0 2024-08-26T00:03:29.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.300+0000 7f9e81821740 1 client.25265 shutdown 2024-08-26T00:03:29.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.300+0000 7f9e81821740 1 -- 172.21.15.42:0/357655440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e45950 msgr2=0x558eb9e563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:29.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.300+0000 7f9e81821740 1 --2- 172.21.15.42:0/357655440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e45950 0x558eb9e563c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9e680043b0 tx=0x7f9e680046c0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.301+0000 7f9e81821740 1 -- 172.21.15.42:0/357655440 shutdown_connections 2024-08-26T00:03:29.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.301+0000 7f9e81821740 1 --2- 172.21.15.42:0/357655440 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x558eb9e69400 0x558eb9e6b810 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.301+0000 7f9e61600640 0 client.25265 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:03:29.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.301+0000 7f9e81821740 1 --2- 172.21.15.42:0/357655440 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb9e59420 0x558eb9e56e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.301+0000 7f9e81821740 1 --2- 172.21.15.42:0/357655440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb9e46270 0x558eb9e56900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.301+0000 7f9e81821740 1 --2- 172.21.15.42:0/357655440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e45950 0x558eb9e563c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.301+0000 7f9e81821740 1 -- 172.21.15.42:0/357655440 >> 172.21.15.42:0/357655440 conn(0x558eb9e41fc0 msgr2=0x558eb9e41120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:29.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.301+0000 7f9e81821740 1 -- 172.21.15.42:0/357655440 shutdown_connections 2024-08-26T00:03:29.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.301+0000 7f9e81821740 1 -- 172.21.15.42:0/357655440 wait complete. 2024-08-26T00:03:29.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.301+0000 7f9e81821740 20 client.25265 trim_cache size 0 max 16384 2024-08-26T00:03:29.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.328+0000 7f9e81821740 1 Processor -- start 2024-08-26T00:03:29.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.329+0000 7f9e81821740 1 -- start start 2024-08-26T00:03:29.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.329+0000 7f9e81821740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb9e45950 0x558eb9e710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:29.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.329+0000 7f9e81821740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb9e46270 0x558eb9e71620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:29.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.329+0000 7f9e81821740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e59420 0x558eb9e40900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:29.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.329+0000 7f9e81821740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9e781ad890 con 0x558eb9e45950 2024-08-26T00:03:29.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.329+0000 7f9e81821740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9e781ab160 con 0x558eb9e59420 2024-08-26T00:03:29.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.329+0000 7f9e81821740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9e781a8fb0 con 0x558eb9e46270 2024-08-26T00:03:29.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.330+0000 7f9e77e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb9e45950 0x558eb9e710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:29.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.330+0000 7f9e77400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb9e46270 0x558eb9e71620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:29.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.331+0000 7f9e77400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb9e46270 0x558eb9e71620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:38240/0 (socket says 172.21.15.42:38240) 2024-08-26T00:03:29.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.331+0000 7f9e77400640 1 -- 172.21.15.42:0/3145624884 learned_addr learned my addr 172.21.15.42:0/3145624884 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:29.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.330+0000 7f9e77e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb9e45950 0x558eb9e710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50002/0 (socket says 172.21.15.42:50002) 2024-08-26T00:03:29.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.330+0000 7f9e7cc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e59420 0x558eb9e40900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:29.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.331+0000 7f9e7cc00640 1 -- 172.21.15.42:0/3145624884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb9e46270 msgr2=0x558eb9e71620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:29.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.331+0000 7f9e7cc00640 1 --2- 172.21.15.42:0/3145624884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb9e46270 0x558eb9e71620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.331+0000 7f9e7cc00640 1 -- 172.21.15.42:0/3145624884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb9e45950 msgr2=0x558eb9e710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:29.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.331+0000 7f9e7cc00640 1 --2- 172.21.15.42:0/3145624884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb9e45950 0x558eb9e710e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.331+0000 7f9e7cc00640 1 -- 172.21.15.42:0/3145624884 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eb9e6be90 con 0x558eb9e59420 2024-08-26T00:03:29.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.332+0000 7f9e7cc00640 1 --2- 172.21.15.42:0/3145624884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e59420 0x558eb9e40900 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9e70005e30 tx=0x7f9e700048f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3f06305a62bc990 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:29.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.332+0000 7f9e63e00640 1 -- 172.21.15.42:0/3145624884 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e700da070 con 0x558eb9e59420 2024-08-26T00:03:29.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.332+0000 7f9e63e00640 1 -- 172.21.15.42:0/3145624884 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e70036070 con 0x558eb9e59420 2024-08-26T00:03:29.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.332+0000 7f9e63e00640 1 -- 172.21.15.42:0/3145624884 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e700c3040 con 0x558eb9e59420 2024-08-26T00:03:29.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.333+0000 7f9e81821740 1 -- 172.21.15.42:0/3145624884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e59420 msgr2=0x558eb9e40900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:29.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.333+0000 7f9e81821740 1 --2- 172.21.15.42:0/3145624884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e59420 0x558eb9e40900 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9e70005e30 tx=0x7f9e700048f0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.334+0000 7f9e81821740 1 -- 172.21.15.42:0/3145624884 shutdown_connections 2024-08-26T00:03:29.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.334+0000 7f9e81821740 1 --2- 172.21.15.42:0/3145624884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e59420 0x558eb9e40900 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.334+0000 7f9e81821740 1 --2- 172.21.15.42:0/3145624884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb9e46270 0x558eb9e71620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.334+0000 7f9e81821740 1 --2- 172.21.15.42:0/3145624884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb9e45950 0x558eb9e710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.334+0000 7f9e81821740 1 -- 172.21.15.42:0/3145624884 >> 172.21.15.42:0/3145624884 conn(0x558eb9e41fc0 msgr2=0x558eb9e554b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:29.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.334+0000 7f9e81821740 1 -- 172.21.15.42:0/3145624884 shutdown_connections 2024-08-26T00:03:29.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.334+0000 7f9e81821740 1 -- 172.21.15.42:0/3145624884 wait complete. 2024-08-26T00:03:29.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.335+0000 7f9e81821740 1 -- start start 2024-08-26T00:03:29.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.335+0000 7f9e81821740 1 Processor -- start 2024-08-26T00:03:29.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.336+0000 7f9e81821740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb9e45950 0x558eb9e61910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:29.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.336+0000 7f9e81821740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e46270 0x558eb9e5cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:29.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.336+0000 7f9e81821740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb9e59420 0x558eb9e5d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:29.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.336+0000 7f9e81821740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9e781a9620 con 0x558eb9e59420 2024-08-26T00:03:29.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.336+0000 7f9e81821740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9e781aaa90 con 0x558eb9e46270 2024-08-26T00:03:29.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.336+0000 7f9e81821740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9e781a9cf0 con 0x558eb9e45950 2024-08-26T00:03:29.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.336+0000 7f9e81821740 10 client.0 _ll_register_callbacks cb 0x7f9e68004030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:03:29.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.337+0000 7f9e77400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e46270 0x558eb9e5cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:29.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.337+0000 7f9e77e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb9e45950 0x558eb9e61910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:29.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.337+0000 7f9e77400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e46270 0x558eb9e5cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:50052/0 (socket says 172.21.15.42:50052) 2024-08-26T00:03:29.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.337+0000 7f9e77400640 1 -- 172.21.15.42:0/3629884677 learned_addr learned my addr 172.21.15.42:0/3629884677 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:29.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.337+0000 7f9e7cc00640 1 --2- 172.21.15.42:0/3629884677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb9e59420 0x558eb9e5d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:29.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.338+0000 7f9e77400640 1 -- 172.21.15.42:0/3629884677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb9e45950 msgr2=0x558eb9e61910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:29.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.338+0000 7f9e77400640 1 --2- 172.21.15.42:0/3629884677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb9e45950 0x558eb9e61910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.338+0000 7f9e77400640 1 -- 172.21.15.42:0/3629884677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb9e59420 msgr2=0x558eb9e5d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:29.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.338+0000 7f9e77400640 1 --2- 172.21.15.42:0/3629884677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb9e59420 0x558eb9e5d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.338+0000 7f9e77400640 1 -- 172.21.15.42:0/3629884677 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eb9e5d740 con 0x558eb9e46270 2024-08-26T00:03:29.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.339+0000 7f9e77400640 1 --2- 172.21.15.42:0/3629884677 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e46270 0x558eb9e5cc40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009390 tx=0x7f9e640094a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdba6f813ef75655 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:29.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.339+0000 7f9e61600640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:03:29.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.339+0000 7f9e61600640 1 -- 172.21.15.42:0/3629884677 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6402f030 con 0x558eb9e46270 2024-08-26T00:03:29.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.339+0000 7f9e61600640 1 -- 172.21.15.42:0/3629884677 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f9e640043d0 con 0x558eb9e46270 2024-08-26T00:03:29.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.340+0000 7f9e81821740 1 -- 172.21.15.42:0/3629884677 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e70036070 con 0x558eb9e46270 2024-08-26T00:03:29.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.340+0000 7f9e61600640 1 -- 172.21.15.42:0/3629884677 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9e6403a050 con 0x558eb9e46270 2024-08-26T00:03:29.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.340+0000 7f9e81821740 10 client.25271 fetch_fsmap learned FSMap version 24 2024-08-26T00:03:29.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.340+0000 7f9e81821740 1 -- 172.21.15.42:0/3629884677 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558eb9ed3e40 con 0x558eb9e46270 2024-08-26T00:03:29.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.341+0000 7f9e61600640 1 -- 172.21.15.42:0/3629884677 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e70036070 con 0x558eb9e46270 2024-08-26T00:03:29.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.342+0000 7f9e61600640 1 -- 172.21.15.42:0/3629884677 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9e6401c030 con 0x558eb9e46270 2024-08-26T00:03:29.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.342+0000 7f9e81821740 10 client.25271 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:03:29.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.342+0000 7f9e81821740 10 client.25271 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-26T00:03:29.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.342+0000 7f9e81821740 20 client.25271 populate_metadata read hostname 'smithi042' 2024-08-26T00:03:29.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.342+0000 7f9e81821740 1 --2- 172.21.15.42:0/3629884677 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x558eb9ed4310 0x558eb9ed6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:29.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.342+0000 7f9e81821740 4 client.25271 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:03:29.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.342+0000 7f9e81821740 1 -- 172.21.15.42:0/3629884677 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558eb9db39b0 con 0x558eb9ed4310 2024-08-26T00:03:29.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.343+0000 7f9e77e00640 1 --2- 172.21.15.42:0/3629884677 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x558eb9ed4310 0x558eb9ed6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:29.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.343+0000 7f9e61600640 10 client.25271 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:03:29.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.343+0000 7f9e77e00640 1 --2- 172.21.15.42:0/3629884677 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x558eb9ed4310 0x558eb9ed6730 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8500c347d6285d23 server_cookie=6b7c5269301d43d9 in_seq=0 out_seq=0 2024-08-26T00:03:29.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.344+0000 7f9e61600640 1 -- 172.21.15.42:0/3629884677 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558eb9db39b0 con 0x558eb9ed4310 2024-08-26T00:03:29.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.344+0000 7f9e61600640 10 client.25271 handle_command_reply: tid=0 2024-08-26T00:03:29.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.344+0000 7f9e81821740 1 client.25271 shutdown 2024-08-26T00:03:29.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.344+0000 7f9e81821740 1 -- 172.21.15.42:0/3629884677 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e46270 msgr2=0x558eb9e5cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:29.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.344+0000 7f9e81821740 1 --2- 172.21.15.42:0/3629884677 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e46270 0x558eb9e5cc40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009390 tx=0x7f9e640094a0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.344+0000 7f9e81821740 1 -- 172.21.15.42:0/3629884677 shutdown_connections 2024-08-26T00:03:29.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.344+0000 7f9e81821740 1 --2- 172.21.15.42:0/3629884677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb9e59420 0x558eb9e5d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.344+0000 7f9e81821740 1 --2- 172.21.15.42:0/3629884677 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb9e46270 0x558eb9e5cc40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.344+0000 7f9e81821740 1 --2- 172.21.15.42:0/3629884677 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x558eb9ed4310 0x558eb9ed6730 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.344+0000 7f9e81821740 1 --2- 172.21.15.42:0/3629884677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb9e45950 0x558eb9e61910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.344+0000 7f9e81821740 1 -- 172.21.15.42:0/3629884677 >> 172.21.15.42:0/3629884677 conn(0x558eb9e41fc0 msgr2=0x558eb9e473f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:29.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.345+0000 7f9e61600640 0 client.25271 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:03:29.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.345+0000 7f9e81821740 1 -- 172.21.15.42:0/3629884677 shutdown_connections 2024-08-26T00:03:29.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.345+0000 7f9e81821740 1 -- 172.21.15.42:0/3629884677 wait complete. 2024-08-26T00:03:29.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.345+0000 7f9e81821740 20 client.25271 trim_cache size 0 max 16384 2024-08-26T00:03:29.348 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:03:29.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.346+0000 7f9e7d600640 1 -- 172.21.15.42:0/821258133 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9e5c0a2c00 msgr2=0x7f9e5c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:29.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.346+0000 7f9e7d600640 1 --2- 172.21.15.42:0/821258133 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9e5c0a2c00 0x7f9e5c0a50c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9e68009eb0 tx=0x7f9e68005f90 comp rx=0 tx=0).stop 2024-08-26T00:03:29.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.346+0000 7f9e7d600640 1 -- 172.21.15.42:0/821258133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e78109970 msgr2=0x7f9e7819ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:29.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.346+0000 7f9e7d600640 1 --2- 172.21.15.42:0/821258133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e78109970 0x7f9e7819ea90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9e70033040 tx=0x7f9e70031e60 comp rx=0 tx=0).stop 2024-08-26T00:03:29.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.346+0000 7f9e7d600640 1 -- 172.21.15.42:0/821258133 shutdown_connections 2024-08-26T00:03:29.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.346+0000 7f9e7d600640 1 --2- 172.21.15.42:0/821258133 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9e5c0a2c00 0x7f9e5c0a50c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.346+0000 7f9e7d600640 1 --2- 172.21.15.42:0/821258133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e78109970 0x7f9e7819ea90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.346+0000 7f9e7d600640 1 --2- 172.21.15.42:0/821258133 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9e78104310 0x7f9e7819a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.346+0000 7f9e7d600640 1 --2- 172.21.15.42:0/821258133 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e78103970 0x7f9e7819a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:29.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.346+0000 7f9e7d600640 1 -- 172.21.15.42:0/821258133 >> 172.21.15.42:0/821258133 conn(0x7f9e780ff6b0 msgr2=0x7f9e78100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:29.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.347+0000 7f9e7d600640 1 -- 172.21.15.42:0/821258133 shutdown_connections 2024-08-26T00:03:29.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:29.347+0000 7f9e7d600640 1 -- 172.21.15.42:0/821258133 wait complete. 2024-08-26T00:03:30.252 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-26T00:03:30.304 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:30 smithi042 ceph-mon[17225]: pgmap v368: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-08-26T00:03:30.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:30 smithi043 ceph-mon[22091]: pgmap v368: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-08-26T00:03:30.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:30 smithi181 ceph-mon[22102]: pgmap v368: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-08-26T00:03:30.676 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:03:31.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.361+0000 7f49dd600640 1 -- 172.21.15.42:0/3157404352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49d8103db0 msgr2=0x7f49d8104190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:31.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.361+0000 7f49dd600640 1 --2- 172.21.15.42:0/3157404352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49d8103db0 0x7f49d8104190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f49c8009900 tx=0x7f49c802a3f0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.361+0000 7f49dd600640 1 -- 172.21.15.42:0/3157404352 shutdown_connections 2024-08-26T00:03:31.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.361+0000 7f49dd600640 1 --2- 172.21.15.42:0/3157404352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49d8108ee0 0x7f49d8110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.361+0000 7f49dd600640 1 --2- 172.21.15.42:0/3157404352 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49d8104760 0x7f49d81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.361+0000 7f49dd600640 1 --2- 172.21.15.42:0/3157404352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49d8103db0 0x7f49d8104190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.361+0000 7f49dd600640 1 -- 172.21.15.42:0/3157404352 >> 172.21.15.42:0/3157404352 conn(0x7f49d80ff7f0 msgr2=0x7f49d8101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:31.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.361+0000 7f49dd600640 1 -- 172.21.15.42:0/3157404352 shutdown_connections 2024-08-26T00:03:31.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.361+0000 7f49dd600640 1 -- 172.21.15.42:0/3157404352 wait complete. 2024-08-26T00:03:31.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.362+0000 7f49dd600640 1 Processor -- start 2024-08-26T00:03:31.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.363+0000 7f49dd600640 1 -- start start 2024-08-26T00:03:31.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.363+0000 7f49dd600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49d8103db0 0x7f49d80764a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:31.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.363+0000 7f49dd600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49d8104760 0x7f49d80769e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:31.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.363+0000 7f49dd600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49d8108ee0 0x7f49d8076f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:31.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.363+0000 7f49dd600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f49d8113f40 con 0x7f49d8103db0 2024-08-26T00:03:31.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.363+0000 7f49dd600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f49d8113dc0 con 0x7f49d8104760 2024-08-26T00:03:31.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.363+0000 7f49dd600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f49d81140c0 con 0x7f49d8108ee0 2024-08-26T00:03:31.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.364+0000 7f49d6000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49d8104760 0x7f49d80769e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:31.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.364+0000 7f49d6000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49d8104760 0x7f49d80769e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:50072/0 (socket says 172.21.15.42:50072) 2024-08-26T00:03:31.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.364+0000 7f49d6000640 1 -- 172.21.15.42:0/3027734203 learned_addr learned my addr 172.21.15.42:0/3027734203 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:31.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.364+0000 7f49d7400640 1 --2- 172.21.15.42:0/3027734203 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49d8108ee0 0x7f49d8076f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:31.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.364+0000 7f49d6a00640 1 --2- 172.21.15.42:0/3027734203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49d8103db0 0x7f49d80764a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:31.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.364+0000 7f49d6000640 1 -- 172.21.15.42:0/3027734203 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49d8108ee0 msgr2=0x7f49d8076f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:31.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.364+0000 7f49d6000640 1 --2- 172.21.15.42:0/3027734203 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49d8108ee0 0x7f49d8076f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.364+0000 7f49d6000640 1 -- 172.21.15.42:0/3027734203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49d8103db0 msgr2=0x7f49d80764a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:31.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.364+0000 7f49d6000640 1 --2- 172.21.15.42:0/3027734203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49d8103db0 0x7f49d80764a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.364+0000 7f49d6000640 1 -- 172.21.15.42:0/3027734203 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d81aaa70 con 0x7f49d8104760 2024-08-26T00:03:31.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.365+0000 7f49d6000640 1 --2- 172.21.15.42:0/3027734203 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49d8104760 0x7f49d80769e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f49c400d9b0 tx=0x7f49c400de70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:31.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.365+0000 7f49cf400640 1 -- 172.21.15.42:0/3027734203 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c4017030 con 0x7f49d8104760 2024-08-26T00:03:31.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.365+0000 7f49dd600640 1 -- 172.21.15.42:0/3027734203 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d81aad60 con 0x7f49d8104760 2024-08-26T00:03:31.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.365+0000 7f49cf400640 1 -- 172.21.15.42:0/3027734203 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49c40099d0 con 0x7f49d8104760 2024-08-26T00:03:31.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.365+0000 7f49dd600640 1 -- 172.21.15.42:0/3027734203 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d81ab260 con 0x7f49d8104760 2024-08-26T00:03:31.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.365+0000 7f49cf400640 1 -- 172.21.15.42:0/3027734203 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c4003d30 con 0x7f49d8104760 2024-08-26T00:03:31.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.370+0000 7f49e001c740 1 Processor -- start 2024-08-26T00:03:31.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.370+0000 7f49e001c740 1 -- start start 2024-08-26T00:03:31.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.370+0000 7f49e001c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bc2fd87820 0x55bc2fd87c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:31.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.371+0000 7f49e001c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc2fd88140 0x55bc2fd924c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:31.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.371+0000 7f49e001c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd92a00 0x55bc2fd94df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:31.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.371+0000 7f49e001c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55bc2fcedf30 con 0x55bc2fd87820 2024-08-26T00:03:31.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.371+0000 7f49e001c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bc2fc855a0 con 0x55bc2fd92a00 2024-08-26T00:03:31.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.371+0000 7f49e001c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55bc2fce9ef0 con 0x55bc2fd88140 2024-08-26T00:03:31.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.371+0000 7f49cf400640 1 -- 172.21.15.42:0/3027734203 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f49c401a070 con 0x7f49d8104760 2024-08-26T00:03:31.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.371+0000 7f49d7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bc2fd87820 0x55bc2fd87c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:31.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.371+0000 7f49d7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bc2fd87820 0x55bc2fd87c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50034/0 (socket says 172.21.15.42:50034) 2024-08-26T00:03:31.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.371+0000 7f49d7400640 1 -- 172.21.15.42:0/539986460 learned_addr learned my addr 172.21.15.42:0/539986460 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:31.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.371+0000 7f49d6a00640 1 --2- 172.21.15.42:0/539986460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc2fd88140 0x55bc2fd924c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:31.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.372+0000 7f49d6a00640 1 -- 172.21.15.42:0/539986460 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd92a00 msgr2=0x55bc2fd94df0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-26T00:03:31.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.372+0000 7f49d6a00640 1 --2- 172.21.15.42:0/539986460 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd92a00 0x55bc2fd94df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.372+0000 7f49d6a00640 1 -- 172.21.15.42:0/539986460 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bc2fd87820 msgr2=0x55bc2fd87c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:31.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.372+0000 7f49d6a00640 1 --2- 172.21.15.42:0/539986460 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bc2fd87820 0x55bc2fd87c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.372+0000 7f49d6a00640 1 -- 172.21.15.42:0/539986460 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc2fa5f3c0 con 0x55bc2fd88140 2024-08-26T00:03:31.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.372+0000 7f49d6a00640 1 --2- 172.21.15.42:0/539986460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc2fd88140 0x55bc2fd924c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f49c8009230 tx=0x7f49c8005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee03e288ca0f5ce2 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:31.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.372+0000 7f49c3400640 1 -- 172.21.15.42:0/539986460 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c803f070 con 0x55bc2fd88140 2024-08-26T00:03:31.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.372+0000 7f49c3400640 1 -- 172.21.15.42:0/539986460 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49c8004030 con 0x55bc2fd88140 2024-08-26T00:03:31.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.372+0000 7f49c3400640 1 -- 172.21.15.42:0/539986460 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c8035070 con 0x55bc2fd88140 2024-08-26T00:03:31.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.373+0000 7f49cf400640 1 --2- 172.21.15.42:0/3027734203 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f49bc0a2c00 0x7f49bc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:31.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.373+0000 7f49e001c740 1 -- 172.21.15.42:0/539986460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc2fd88140 msgr2=0x55bc2fd924c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:31.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.373+0000 7f49e001c740 1 --2- 172.21.15.42:0/539986460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc2fd88140 0x55bc2fd924c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f49c8009230 tx=0x7f49c8005e80 comp rx=0 tx=0).stop 2024-08-26T00:03:31.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.374+0000 7f49cf400640 1 -- 172.21.15.42:0/3027734203 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f49c40ce640 con 0x7f49d8104760 2024-08-26T00:03:31.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.374+0000 7f49d7400640 1 --2- 172.21.15.42:0/3027734203 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f49bc0a2c00 0x7f49bc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:31.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.374+0000 7f49e001c740 1 -- 172.21.15.42:0/539986460 shutdown_connections 2024-08-26T00:03:31.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.374+0000 7f49e001c740 1 --2- 172.21.15.42:0/539986460 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd92a00 0x55bc2fd94df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.374+0000 7f49e001c740 1 --2- 172.21.15.42:0/539986460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc2fd88140 0x55bc2fd924c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.374+0000 7f49e001c740 1 --2- 172.21.15.42:0/539986460 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bc2fd87820 0x55bc2fd87c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.374+0000 7f49e001c740 1 -- 172.21.15.42:0/539986460 >> 172.21.15.42:0/539986460 conn(0x55bc2fd83db0 msgr2=0x55bc2fd84190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:31.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.375+0000 7f49e001c740 1 -- 172.21.15.42:0/539986460 shutdown_connections 2024-08-26T00:03:31.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.375+0000 7f49e001c740 1 -- 172.21.15.42:0/539986460 wait complete. 2024-08-26T00:03:31.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.375+0000 7f49e001c740 1 -- start start 2024-08-26T00:03:31.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.375+0000 7f49d7400640 1 --2- 172.21.15.42:0/3027734203 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f49bc0a2c00 0x7f49bc0a50c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f49d0005f40 tx=0x7f49d0009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:31.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.376+0000 7f49e001c740 1 Processor -- start 2024-08-26T00:03:31.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.376+0000 7f49e001c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd87820 0x55bc2fd8f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:31.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.376+0000 7f49e001c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bc2fd88140 0x55bc2fd8fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:31.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.376+0000 7f49e001c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc2fd92a00 0x55bc2fd90360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:31.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.376+0000 7f49e001c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55bc2fd955d0 con 0x55bc2fd88140 2024-08-26T00:03:31.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.376+0000 7f49e001c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bc2fca8de0 con 0x55bc2fd87820 2024-08-26T00:03:31.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.376+0000 7f49e001c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55bc2fd95750 con 0x55bc2fd92a00 2024-08-26T00:03:31.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.376+0000 7f49e001c740 10 client.0 _ll_register_callbacks cb 0x55bc2fc977b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:03:31.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.377+0000 7f49d6a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd87820 0x55bc2fd8f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:31.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.377+0000 7f49d6a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd87820 0x55bc2fd8f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:50094/0 (socket says 172.21.15.42:50094) 2024-08-26T00:03:31.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.377+0000 7f49d6a00640 1 -- 172.21.15.42:0/1718025941 learned_addr learned my addr 172.21.15.42:0/1718025941 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:31.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.377+0000 7f49d7400640 1 --2- 172.21.15.42:0/1718025941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc2fd92a00 0x55bc2fd90360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:31.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.377+0000 7f49d6000640 1 --2- 172.21.15.42:0/1718025941 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bc2fd88140 0x55bc2fd8fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:31.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.377+0000 7f49d6a00640 1 -- 172.21.15.42:0/1718025941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc2fd92a00 msgr2=0x55bc2fd90360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:31.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.377+0000 7f49d6a00640 1 --2- 172.21.15.42:0/1718025941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc2fd92a00 0x55bc2fd90360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.377+0000 7f49d6a00640 1 -- 172.21.15.42:0/1718025941 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bc2fd88140 msgr2=0x55bc2fd8fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:31.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.378+0000 7f49d6a00640 1 --2- 172.21.15.42:0/1718025941 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bc2fd88140 0x55bc2fd8fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.378+0000 7f49d6a00640 1 -- 172.21.15.42:0/1718025941 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc2fd9eaa0 con 0x55bc2fd87820 2024-08-26T00:03:31.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.378+0000 7f49d6000640 1 --2- 172.21.15.42:0/1718025941 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bc2fd88140 0x55bc2fd8fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:03:31.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.378+0000 7f49d6a00640 1 --2- 172.21.15.42:0/1718025941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd87820 0x55bc2fd8f8e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f49c8004410 tx=0x7f49c802a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b6af0dfa62eabb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:31.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.378+0000 7f49b7e00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:03:31.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.379+0000 7f49b7e00640 1 -- 172.21.15.42:0/1718025941 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c8035070 con 0x55bc2fd87820 2024-08-26T00:03:31.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.379+0000 7f49b7e00640 1 -- 172.21.15.42:0/1718025941 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f49c80319c0 con 0x55bc2fd87820 2024-08-26T00:03:31.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.379+0000 7f49e001c740 1 -- 172.21.15.42:0/1718025941 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49c8004030 con 0x55bc2fd87820 2024-08-26T00:03:31.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.380+0000 7f49b7e00640 1 -- 172.21.15.42:0/1718025941 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f49c803f040 con 0x55bc2fd87820 2024-08-26T00:03:31.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.380+0000 7f49e001c740 10 client.25280 fetch_fsmap learned FSMap version 24 2024-08-26T00:03:31.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.380+0000 7f49e001c740 1 -- 172.21.15.42:0/1718025941 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bc2fda1400 con 0x55bc2fd87820 2024-08-26T00:03:31.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.381+0000 7f49b7e00640 1 -- 172.21.15.42:0/1718025941 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49c8004030 con 0x55bc2fd87820 2024-08-26T00:03:31.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.381+0000 7f49b7e00640 1 -- 172.21.15.42:0/1718025941 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f49c803b7c0 con 0x55bc2fd87820 2024-08-26T00:03:31.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.381+0000 7f49e001c740 10 client.25280 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:03:31.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.381+0000 7f49e001c740 10 client.25280 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-26T00:03:31.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.382+0000 7f49e001c740 20 client.25280 populate_metadata read hostname 'smithi042' 2024-08-26T00:03:31.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.382+0000 7f49e001c740 1 --2- 172.21.15.42:0/1718025941 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55bc2fda2750 0x55bc2fda4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:31.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.382+0000 7f49e001c740 4 client.25280 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:03:31.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.382+0000 7f49e001c740 1 -- 172.21.15.42:0/1718025941 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc2fcfb4a0 con 0x55bc2fda2750 2024-08-26T00:03:31.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.382+0000 7f49d6000640 1 --2- 172.21.15.42:0/1718025941 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55bc2fda2750 0x55bc2fda4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:31.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.383+0000 7f49d6000640 1 --2- 172.21.15.42:0/1718025941 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55bc2fda2750 0x55bc2fda4b40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d28853a49e38c37e server_cookie=2e7790951d8cbd08 in_seq=0 out_seq=0 2024-08-26T00:03:31.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.383+0000 7f49b7e00640 10 client.25280 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:03:31.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.384+0000 7f49b7e00640 1 -- 172.21.15.42:0/1718025941 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bc2fcfb4a0 con 0x55bc2fda2750 2024-08-26T00:03:31.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.384+0000 7f49b7e00640 10 client.25280 handle_command_reply: tid=0 2024-08-26T00:03:31.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.384+0000 7f49e001c740 1 client.25280 shutdown 2024-08-26T00:03:31.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.384+0000 7f49e001c740 1 -- 172.21.15.42:0/1718025941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd87820 msgr2=0x55bc2fd8f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:31.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.384+0000 7f49e001c740 1 --2- 172.21.15.42:0/1718025941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd87820 0x55bc2fd8f8e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f49c8004410 tx=0x7f49c802a3f0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.385+0000 7f49e001c740 1 -- 172.21.15.42:0/1718025941 shutdown_connections 2024-08-26T00:03:31.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.385+0000 7f49e001c740 1 --2- 172.21.15.42:0/1718025941 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55bc2fda2750 0x55bc2fda4b40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.385+0000 7f49e001c740 1 --2- 172.21.15.42:0/1718025941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc2fd92a00 0x55bc2fd90360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.385+0000 7f49e001c740 1 --2- 172.21.15.42:0/1718025941 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bc2fd88140 0x55bc2fd8fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.385+0000 7f49e001c740 1 --2- 172.21.15.42:0/1718025941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd87820 0x55bc2fd8f8e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.385+0000 7f49e001c740 1 -- 172.21.15.42:0/1718025941 >> 172.21.15.42:0/1718025941 conn(0x55bc2fd83db0 msgr2=0x55bc2fd89ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:31.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.385+0000 7f49b7e00640 0 client.25280 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:03:31.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.385+0000 7f49e001c740 1 -- 172.21.15.42:0/1718025941 shutdown_connections 2024-08-26T00:03:31.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.385+0000 7f49e001c740 1 -- 172.21.15.42:0/1718025941 wait complete. 2024-08-26T00:03:31.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.386+0000 7f49e001c740 20 client.25280 trim_cache size 0 max 16384 2024-08-26T00:03:31.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.413+0000 7f49e001c740 1 Processor -- start 2024-08-26T00:03:31.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.413+0000 7f49e001c740 1 -- start start 2024-08-26T00:03:31.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.414+0000 7f49e001c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc2fd87820 0x55bc2fd9e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:31.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.414+0000 7f49e001c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bc2fd88140 0x55bc2fd8cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:31.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.414+0000 7f49e001c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd92a00 0x55bc2fd8d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:31.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.414+0000 7f49e001c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f49b8010d60 con 0x55bc2fd88140 2024-08-26T00:03:31.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.414+0000 7f49e001c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f49b800e630 con 0x55bc2fd92a00 2024-08-26T00:03:31.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.414+0000 7f49e001c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f49b800c460 con 0x55bc2fd87820 2024-08-26T00:03:31.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.414+0000 7f49d7400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd92a00 0x55bc2fd8d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:31.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.414+0000 7f49d7400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd92a00 0x55bc2fd8d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:50098/0 (socket says 172.21.15.42:50098) 2024-08-26T00:03:31.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.414+0000 7f49d7400640 1 -- 172.21.15.42:0/809755109 learned_addr learned my addr 172.21.15.42:0/809755109 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:31.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.414+0000 7f49d6000640 1 --2- 172.21.15.42:0/809755109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bc2fd88140 0x55bc2fd8cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:31.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.415+0000 7f49d6a00640 1 --2- 172.21.15.42:0/809755109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc2fd87820 0x55bc2fd9e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:31.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.415+0000 7f49d7400640 1 -- 172.21.15.42:0/809755109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc2fd87820 msgr2=0x55bc2fd9e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:31.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.415+0000 7f49d7400640 1 --2- 172.21.15.42:0/809755109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc2fd87820 0x55bc2fd9e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.415+0000 7f49d7400640 1 -- 172.21.15.42:0/809755109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bc2fd88140 msgr2=0x55bc2fd8cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:31.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.415+0000 7f49d7400640 1 --2- 172.21.15.42:0/809755109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bc2fd88140 0x55bc2fd8cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.415+0000 7f49d7400640 1 -- 172.21.15.42:0/809755109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc2fd92390 con 0x55bc2fd92a00 2024-08-26T00:03:31.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.415+0000 7f49d6000640 1 --2- 172.21.15.42:0/809755109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bc2fd88140 0x55bc2fd8cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:03:31.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.416+0000 7f49d7400640 1 --2- 172.21.15.42:0/809755109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd92a00 0x55bc2fd8d080 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f49d0003ae0 tx=0x7f49d0016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2308d114a38a94a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:31.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.416+0000 7f49c2a00640 1 -- 172.21.15.42:0/809755109 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d00043f0 con 0x55bc2fd92a00 2024-08-26T00:03:31.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.416+0000 7f49c2a00640 1 -- 172.21.15.42:0/809755109 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49d0026030 con 0x55bc2fd92a00 2024-08-26T00:03:31.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.416+0000 7f49c2a00640 1 -- 172.21.15.42:0/809755109 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d0022670 con 0x55bc2fd92a00 2024-08-26T00:03:31.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.417+0000 7f49e001c740 1 -- 172.21.15.42:0/809755109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd92a00 msgr2=0x55bc2fd8d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:31.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.417+0000 7f49e001c740 1 --2- 172.21.15.42:0/809755109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd92a00 0x55bc2fd8d080 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f49d0003ae0 tx=0x7f49d0016000 comp rx=0 tx=0).stop 2024-08-26T00:03:31.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.417+0000 7f49e001c740 1 -- 172.21.15.42:0/809755109 shutdown_connections 2024-08-26T00:03:31.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.417+0000 7f49e001c740 1 --2- 172.21.15.42:0/809755109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd92a00 0x55bc2fd8d080 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.417+0000 7f49e001c740 1 --2- 172.21.15.42:0/809755109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bc2fd88140 0x55bc2fd8cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.417+0000 7f49e001c740 1 --2- 172.21.15.42:0/809755109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc2fd87820 0x55bc2fd9e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.417+0000 7f49e001c740 1 -- 172.21.15.42:0/809755109 >> 172.21.15.42:0/809755109 conn(0x55bc2fd83db0 msgr2=0x55bc2fd9da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:31.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.418+0000 7f49e001c740 1 -- 172.21.15.42:0/809755109 shutdown_connections 2024-08-26T00:03:31.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.418+0000 7f49e001c740 1 -- 172.21.15.42:0/809755109 wait complete. 2024-08-26T00:03:31.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.418+0000 7f49e001c740 1 -- start start 2024-08-26T00:03:31.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.419+0000 7f49e001c740 1 Processor -- start 2024-08-26T00:03:31.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.419+0000 7f49e001c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc2fd87820 0x55bc2fda4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:31.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.419+0000 7f49e001c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd88140 0x55bc2fda51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:31.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.419+0000 7f49e001c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bc2fd92a00 0x55bc2fe0b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:31.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.419+0000 7f49e001c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f49b800caf0 con 0x55bc2fd92a00 2024-08-26T00:03:31.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.419+0000 7f49e001c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f49b800df60 con 0x55bc2fd88140 2024-08-26T00:03:31.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.419+0000 7f49e001c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f49b800d1c0 con 0x55bc2fd87820 2024-08-26T00:03:31.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.419+0000 7f49e001c740 10 client.0 _ll_register_callbacks cb 0x7f49d0009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:03:31.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.420+0000 7f49d6000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd88140 0x55bc2fda51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:31.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.420+0000 7f49d6000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd88140 0x55bc2fda51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:50112/0 (socket says 172.21.15.42:50112) 2024-08-26T00:03:31.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.420+0000 7f49d6000640 1 -- 172.21.15.42:0/3700888945 learned_addr learned my addr 172.21.15.42:0/3700888945 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:31.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.420+0000 7f49d6a00640 1 --2- 172.21.15.42:0/3700888945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc2fd87820 0x55bc2fda4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:31.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.420+0000 7f49d7400640 1 --2- 172.21.15.42:0/3700888945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bc2fd92a00 0x55bc2fe0b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:31.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.420+0000 7f49d6000640 1 -- 172.21.15.42:0/3700888945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc2fd87820 msgr2=0x55bc2fda4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:31.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.420+0000 7f49d6000640 1 --2- 172.21.15.42:0/3700888945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc2fd87820 0x55bc2fda4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.420+0000 7f49d6000640 1 -- 172.21.15.42:0/3700888945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bc2fd92a00 msgr2=0x55bc2fe0b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:31.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.420+0000 7f49d6000640 1 --2- 172.21.15.42:0/3700888945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bc2fd92a00 0x55bc2fe0b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.420+0000 7f49d6000640 1 -- 172.21.15.42:0/3700888945 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc2fe0b5c0 con 0x55bc2fd88140 2024-08-26T00:03:31.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.421+0000 7f49d6000640 1 --2- 172.21.15.42:0/3700888945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd88140 0x55bc2fda51b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f49c4097300 tx=0x7f49c4005810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a56cab106cf59b25 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:31.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.421+0000 7f49b7e00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:03:31.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.421+0000 7f49b7e00640 1 -- 172.21.15.42:0/3700888945 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c40cc250 con 0x55bc2fd88140 2024-08-26T00:03:31.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.421+0000 7f49b7e00640 1 -- 172.21.15.42:0/3700888945 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f49c40035f0 con 0x55bc2fd88140 2024-08-26T00:03:31.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.422+0000 7f49e001c740 1 -- 172.21.15.42:0/3700888945 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49d0026030 con 0x55bc2fd88140 2024-08-26T00:03:31.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.422+0000 7f49b7e00640 1 -- 172.21.15.42:0/3700888945 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f49c4097510 con 0x55bc2fd88140 2024-08-26T00:03:31.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.422+0000 7f49e001c740 10 client.25286 fetch_fsmap learned FSMap version 24 2024-08-26T00:03:31.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.422+0000 7f49e001c740 1 -- 172.21.15.42:0/3700888945 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bc2fe0c8f0 con 0x55bc2fd88140 2024-08-26T00:03:31.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.423+0000 7f49b7e00640 1 -- 172.21.15.42:0/3700888945 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49d0026030 con 0x55bc2fd88140 2024-08-26T00:03:31.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.423+0000 7f49b7e00640 1 -- 172.21.15.42:0/3700888945 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f49c409a2f0 con 0x55bc2fd88140 2024-08-26T00:03:31.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.423+0000 7f49e001c740 10 client.25286 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:03:31.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.423+0000 7f49e001c740 10 client.25286 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-26T00:03:31.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.423+0000 7f49e001c740 20 client.25286 populate_metadata read hostname 'smithi042' 2024-08-26T00:03:31.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.423+0000 7f49e001c740 1 --2- 172.21.15.42:0/3700888945 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55bc2fe0d000 0x55bc2fe0f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:31.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.423+0000 7f49e001c740 4 client.25286 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:03:31.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.423+0000 7f49e001c740 1 -- 172.21.15.42:0/3700888945 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bc2fcf59b0 con 0x55bc2fe0d000 2024-08-26T00:03:31.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.423+0000 7f49d6a00640 1 --2- 172.21.15.42:0/3700888945 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55bc2fe0d000 0x55bc2fe0f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:31.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.424+0000 7f49d6a00640 1 --2- 172.21.15.42:0/3700888945 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55bc2fe0d000 0x55bc2fe0f420 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8967486f91f0e7c server_cookie=76d4b14330328a26 in_seq=0 out_seq=0 2024-08-26T00:03:31.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.424+0000 7f49b7e00640 10 client.25286 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:03:31.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.424+0000 7f49b7e00640 1 -- 172.21.15.42:0/3700888945 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bc2fcf59b0 con 0x55bc2fe0d000 2024-08-26T00:03:31.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.424+0000 7f49b7e00640 10 client.25286 handle_command_reply: tid=0 2024-08-26T00:03:31.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.424+0000 7f49e001c740 1 client.25286 shutdown 2024-08-26T00:03:31.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.425+0000 7f49e001c740 1 -- 172.21.15.42:0/3700888945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd88140 msgr2=0x55bc2fda51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:31.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.425+0000 7f49e001c740 1 --2- 172.21.15.42:0/3700888945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd88140 0x55bc2fda51b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f49c4097300 tx=0x7f49c4005810 comp rx=0 tx=0).stop 2024-08-26T00:03:31.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.425+0000 7f49e001c740 1 -- 172.21.15.42:0/3700888945 shutdown_connections 2024-08-26T00:03:31.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.425+0000 7f49e001c740 1 --2- 172.21.15.42:0/3700888945 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55bc2fe0d000 0x55bc2fe0f420 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.425+0000 7f49e001c740 1 --2- 172.21.15.42:0/3700888945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bc2fd92a00 0x55bc2fe0b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.425+0000 7f49e001c740 1 --2- 172.21.15.42:0/3700888945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bc2fd88140 0x55bc2fda51b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.425+0000 7f49b7e00640 0 client.25286 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:03:31.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.425+0000 7f49e001c740 1 --2- 172.21.15.42:0/3700888945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc2fd87820 0x55bc2fda4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.425+0000 7f49e001c740 1 -- 172.21.15.42:0/3700888945 >> 172.21.15.42:0/3700888945 conn(0x55bc2fd83db0 msgr2=0x55bc2fd900c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:31.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.425+0000 7f49e001c740 1 -- 172.21.15.42:0/3700888945 shutdown_connections 2024-08-26T00:03:31.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.426+0000 7f49e001c740 1 -- 172.21.15.42:0/3700888945 wait complete. 2024-08-26T00:03:31.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.426+0000 7f49e001c740 20 client.25286 trim_cache size 0 max 16384 2024-08-26T00:03:31.431 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:03:31.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.427+0000 7f49dd600640 1 -- 172.21.15.42:0/3027734203 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f49bc0a2c00 msgr2=0x7f49bc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:31.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.427+0000 7f49dd600640 1 --2- 172.21.15.42:0/3027734203 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f49bc0a2c00 0x7f49bc0a50c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f49d0005f40 tx=0x7f49d0009600 comp rx=0 tx=0).stop 2024-08-26T00:03:31.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.427+0000 7f49dd600640 1 -- 172.21.15.42:0/3027734203 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49d8104760 msgr2=0x7f49d80769e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:31.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.427+0000 7f49dd600640 1 --2- 172.21.15.42:0/3027734203 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49d8104760 0x7f49d80769e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f49c400d9b0 tx=0x7f49c400de70 comp rx=0 tx=0).stop 2024-08-26T00:03:31.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.427+0000 7f49dd600640 1 -- 172.21.15.42:0/3027734203 shutdown_connections 2024-08-26T00:03:31.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.427+0000 7f49dd600640 1 --2- 172.21.15.42:0/3027734203 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f49bc0a2c00 0x7f49bc0a50c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.427+0000 7f49dd600640 1 --2- 172.21.15.42:0/3027734203 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49d8108ee0 0x7f49d8076f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.427+0000 7f49dd600640 1 --2- 172.21.15.42:0/3027734203 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49d8104760 0x7f49d80769e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.427+0000 7f49dd600640 1 --2- 172.21.15.42:0/3027734203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49d8103db0 0x7f49d80764a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:31.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.427+0000 7f49dd600640 1 -- 172.21.15.42:0/3027734203 >> 172.21.15.42:0/3027734203 conn(0x7f49d80ff7f0 msgr2=0x7f49d8100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:31.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.428+0000 7f49dd600640 1 -- 172.21.15.42:0/3027734203 shutdown_connections 2024-08-26T00:03:31.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:31.428+0000 7f49dd600640 1 -- 172.21.15.42:0/3027734203 wait complete. 2024-08-26T00:03:32.222 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-26T00:03:32.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:32 smithi043 ceph-mon[22091]: pgmap v369: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-26T00:03:32.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:32 smithi042 ceph-mon[17225]: pgmap v369: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-26T00:03:32.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:32 smithi181 ceph-mon[22102]: pgmap v369: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-26T00:03:32.647 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:03:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.252+0000 7f40c6600640 1 -- 172.21.15.42:0/79300579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40c0102100 msgr2=0x7f40c010e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.252+0000 7f40c6600640 1 --2- 172.21.15.42:0/79300579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40c0102100 0x7f40c010e630 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f40b8009cd0 tx=0x7f40b802a8f0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.252+0000 7f40c6600640 1 -- 172.21.15.42:0/79300579 shutdown_connections 2024-08-26T00:03:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.252+0000 7f40c6600640 1 --2- 172.21.15.42:0/79300579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40c0102100 0x7f40c010e630 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.252+0000 7f40c6600640 1 --2- 172.21.15.42:0/79300579 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40c0101760 0x7f40c0101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.252+0000 7f40c6600640 1 --2- 172.21.15.42:0/79300579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40c0107760 0x7f40c0107b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.252+0000 7f40c6600640 1 -- 172.21.15.42:0/79300579 >> 172.21.15.42:0/79300579 conn(0x7f40c00fd4e0 msgr2=0x7f40c00ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:33.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.253+0000 7f40c6600640 1 -- 172.21.15.42:0/79300579 shutdown_connections 2024-08-26T00:03:33.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.253+0000 7f40c6600640 1 -- 172.21.15.42:0/79300579 wait complete. 2024-08-26T00:03:33.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.254+0000 7f40c6600640 1 Processor -- start 2024-08-26T00:03:33.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.254+0000 7f40c6600640 1 -- start start 2024-08-26T00:03:33.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.255+0000 7f40c6600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40c0101760 0x7f40c0074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:33.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.255+0000 7f40c6600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40c0102100 0x7f40c00747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:33.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.255+0000 7f40c6600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40c0107760 0x7f40c0074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:33.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.255+0000 7f40c6600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f40c0111b60 con 0x7f40c0101760 2024-08-26T00:03:33.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.255+0000 7f40c6600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f40c01119e0 con 0x7f40c0107760 2024-08-26T00:03:33.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.255+0000 7f40c6600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f40c0111ce0 con 0x7f40c0102100 2024-08-26T00:03:33.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.255+0000 7f40c5200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40c0101760 0x7f40c0074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:33.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.255+0000 7f40c5c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40c0107760 0x7f40c0074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:33.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.255+0000 7f40c5200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40c0101760 0x7f40c0074290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50090/0 (socket says 172.21.15.42:50090) 2024-08-26T00:03:33.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.255+0000 7f40c5200640 1 -- 172.21.15.42:0/434676586 learned_addr learned my addr 172.21.15.42:0/434676586 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:33.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.255+0000 7f40bfe00640 1 --2- 172.21.15.42:0/434676586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40c0102100 0x7f40c00747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:33.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.256+0000 7f40c5200640 1 -- 172.21.15.42:0/434676586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40c0102100 msgr2=0x7f40c00747d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:33.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.256+0000 7f40c5200640 1 --2- 172.21.15.42:0/434676586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40c0102100 0x7f40c00747d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.256+0000 7f40c5200640 1 -- 172.21.15.42:0/434676586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40c0107760 msgr2=0x7f40c0074d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:33.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.256+0000 7f40c5200640 1 --2- 172.21.15.42:0/434676586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40c0107760 0x7f40c0074d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.256+0000 7f40c5200640 1 -- 172.21.15.42:0/434676586 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c01a6540 con 0x7f40c0101760 2024-08-26T00:03:33.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.256+0000 7f40c5200640 1 --2- 172.21.15.42:0/434676586 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40c0101760 0x7f40c0074290 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f40b400d950 tx=0x7f40b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.257+0000 7f40bd600640 1 -- 172.21.15.42:0/434676586 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b4017070 con 0x7f40c0101760 2024-08-26T00:03:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.257+0000 7f40bd600640 1 -- 172.21.15.42:0/434676586 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40b4009c30 con 0x7f40c0101760 2024-08-26T00:03:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.257+0000 7f40bd600640 1 -- 172.21.15.42:0/434676586 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b400f6b0 con 0x7f40c0101760 2024-08-26T00:03:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.258+0000 7f40c6600640 1 -- 172.21.15.42:0/434676586 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40c01a6830 con 0x7f40c0101760 2024-08-26T00:03:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.258+0000 7f40c6600640 1 -- 172.21.15.42:0/434676586 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40c01a6d20 con 0x7f40c0101760 2024-08-26T00:03:33.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.262+0000 7f40ca5cb740 1 Processor -- start 2024-08-26T00:03:33.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.262+0000 7f40bd600640 1 -- 172.21.15.42:0/434676586 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f40b40109d0 con 0x7f40c0101760 2024-08-26T00:03:33.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.262+0000 7f40ca5cb740 1 -- start start 2024-08-26T00:03:33.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.263+0000 7f40ca5cb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c22a30 0x558eb0c22e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:33.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.263+0000 7f40ca5cb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c23350 0x558eb0c2d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:33.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.263+0000 7f40ca5cb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb0c2dc10 0x558eb0c30000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:33.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.263+0000 7f40ca5cb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558eb0b88f30 con 0x558eb0c22a30 2024-08-26T00:03:33.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.263+0000 7f40ca5cb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558eb0b205a0 con 0x558eb0c23350 2024-08-26T00:03:33.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.263+0000 7f40ca5cb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558eb0b84ef0 con 0x558eb0c2dc10 2024-08-26T00:03:33.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.263+0000 7f40c5200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c23350 0x558eb0c2d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:33.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.263+0000 7f40c5200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c23350 0x558eb0c2d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:50138/0 (socket says 172.21.15.42:50138) 2024-08-26T00:03:33.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.263+0000 7f40c5200640 1 -- 172.21.15.42:0/4211094331 learned_addr learned my addr 172.21.15.42:0/4211094331 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:33.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.263+0000 7f40c5c00640 1 --2- 172.21.15.42:0/4211094331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c22a30 0x558eb0c22e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:33.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.263+0000 7f40bfe00640 1 --2- 172.21.15.42:0/4211094331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb0c2dc10 0x558eb0c30000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:33.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.264+0000 7f40c5200640 1 -- 172.21.15.42:0/4211094331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb0c2dc10 msgr2=0x558eb0c30000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:33.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.264+0000 7f40c5200640 1 --2- 172.21.15.42:0/4211094331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb0c2dc10 0x558eb0c30000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.264+0000 7f40c5200640 1 -- 172.21.15.42:0/4211094331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c22a30 msgr2=0x558eb0c22e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:33.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.264+0000 7f40c5200640 1 --2- 172.21.15.42:0/4211094331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c22a30 0x558eb0c22e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.264+0000 7f40c5200640 1 -- 172.21.15.42:0/4211094331 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eb08fa3c0 con 0x558eb0c23350 2024-08-26T00:03:33.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.264+0000 7f40c5c00640 1 --2- 172.21.15.42:0/4211094331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c22a30 0x558eb0c22e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:03:33.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.264+0000 7f40bfe00640 1 --2- 172.21.15.42:0/4211094331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb0c2dc10 0x558eb0c30000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:03:33.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.265+0000 7f40bd600640 1 --2- 172.21.15.42:0/434676586 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f40a80a2c00 0x7f40a80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:33.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.265+0000 7f40bd600640 1 -- 172.21.15.42:0/434676586 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f40b40ce800 con 0x7f40c0101760 2024-08-26T00:03:33.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.265+0000 7f40c5c00640 1 --2- 172.21.15.42:0/434676586 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f40a80a2c00 0x7f40a80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:33.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.266+0000 7f40c5200640 1 --2- 172.21.15.42:0/4211094331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c23350 0x558eb0c2d6d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f40b40d4c20 tx=0x7f40b40d6670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9df3e4497655914 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:33.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.266+0000 7f40b2000640 1 -- 172.21.15.42:0/4211094331 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b4020020 con 0x558eb0c23350 2024-08-26T00:03:33.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.266+0000 7f40b2000640 1 -- 172.21.15.42:0/4211094331 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40b4009de0 con 0x558eb0c23350 2024-08-26T00:03:33.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.266+0000 7f40b2000640 1 -- 172.21.15.42:0/4211094331 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b409ac10 con 0x558eb0c23350 2024-08-26T00:03:33.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.267+0000 7f40ca5cb740 1 -- 172.21.15.42:0/4211094331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c23350 msgr2=0x558eb0c2d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:33.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.267+0000 7f40ca5cb740 1 --2- 172.21.15.42:0/4211094331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c23350 0x558eb0c2d6d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f40b40d4c20 tx=0x7f40b40d6670 comp rx=0 tx=0).stop 2024-08-26T00:03:33.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.267+0000 7f40c5c00640 1 --2- 172.21.15.42:0/434676586 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f40a80a2c00 0x7f40a80a50c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f40b8004af0 tx=0x7f40b8004a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:33.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.267+0000 7f40ca5cb740 1 -- 172.21.15.42:0/4211094331 shutdown_connections 2024-08-26T00:03:33.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.267+0000 7f40ca5cb740 1 --2- 172.21.15.42:0/4211094331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb0c2dc10 0x558eb0c30000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.267+0000 7f40ca5cb740 1 --2- 172.21.15.42:0/4211094331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c23350 0x558eb0c2d6d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.267+0000 7f40ca5cb740 1 --2- 172.21.15.42:0/4211094331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c22a30 0x558eb0c22e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.267+0000 7f40ca5cb740 1 -- 172.21.15.42:0/4211094331 >> 172.21.15.42:0/4211094331 conn(0x558eb0c1efc0 msgr2=0x558eb0c1f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:33.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.268+0000 7f40ca5cb740 1 -- 172.21.15.42:0/4211094331 shutdown_connections 2024-08-26T00:03:33.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.268+0000 7f40ca5cb740 1 -- 172.21.15.42:0/4211094331 wait complete. 2024-08-26T00:03:33.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.268+0000 7f40ca5cb740 1 -- start start 2024-08-26T00:03:33.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.269+0000 7f40ca5cb740 1 Processor -- start 2024-08-26T00:03:33.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.269+0000 7f40ca5cb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c22a30 0x558eb0c2aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:33.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.269+0000 7f40ca5cb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb0c23350 0x558eb0c2afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:33.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.269+0000 7f40ca5cb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c2dc10 0x558eb0c2b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:33.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.270+0000 7f40ca5cb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558eb0c307e0 con 0x558eb0c2dc10 2024-08-26T00:03:33.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.270+0000 7f40ca5cb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558eb0b43de0 con 0x558eb0c22a30 2024-08-26T00:03:33.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.270+0000 7f40ca5cb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558eb0c30960 con 0x558eb0c23350 2024-08-26T00:03:33.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.270+0000 7f40ca5cb740 10 client.0 _ll_register_callbacks cb 0x558eb0b327b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:03:33.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.270+0000 7f40c5200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c22a30 0x558eb0c2aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:33.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.270+0000 7f40bfe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb0c23350 0x558eb0c2afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:33.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.270+0000 7f40c5200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c22a30 0x558eb0c2aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:50148/0 (socket says 172.21.15.42:50148) 2024-08-26T00:03:33.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.270+0000 7f40c5200640 1 -- 172.21.15.42:0/3702455787 learned_addr learned my addr 172.21.15.42:0/3702455787 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:33.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.270+0000 7f40c5c00640 1 --2- 172.21.15.42:0/3702455787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c2dc10 0x558eb0c2b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:33.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.271+0000 7f40c5200640 1 -- 172.21.15.42:0/3702455787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb0c23350 msgr2=0x558eb0c2afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:33.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.271+0000 7f40c5200640 1 --2- 172.21.15.42:0/3702455787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb0c23350 0x558eb0c2afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.271+0000 7f40c5200640 1 -- 172.21.15.42:0/3702455787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c2dc10 msgr2=0x558eb0c2b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:33.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.271+0000 7f40c5200640 1 --2- 172.21.15.42:0/3702455787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c2dc10 0x558eb0c2b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.271+0000 7f40c5200640 1 -- 172.21.15.42:0/3702455787 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eb0c39c50 con 0x558eb0c22a30 2024-08-26T00:03:33.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.271+0000 7f40bfe00640 1 --2- 172.21.15.42:0/3702455787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb0c23350 0x558eb0c2afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:03:33.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.271+0000 7f40c5c00640 1 --2- 172.21.15.42:0/3702455787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c2dc10 0x558eb0c2b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:03:33.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.271+0000 7f40c5200640 1 --2- 172.21.15.42:0/3702455787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c22a30 0x558eb0c2aa90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f40b40058c0 tx=0x7f40b4005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b58d00fca24645e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:33.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.271+0000 7f40a6a00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:03:33.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.272+0000 7f40a6a00640 1 -- 172.21.15.42:0/3702455787 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b4020040 con 0x558eb0c22a30 2024-08-26T00:03:33.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.272+0000 7f40a6a00640 1 -- 172.21.15.42:0/3702455787 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f40b40cc340 con 0x558eb0c22a30 2024-08-26T00:03:33.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.272+0000 7f40ca5cb740 1 -- 172.21.15.42:0/3702455787 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40b4009de0 con 0x558eb0c22a30 2024-08-26T00:03:33.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.272+0000 7f40a6a00640 1 -- 172.21.15.42:0/3702455787 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f40b409aa30 con 0x558eb0c22a30 2024-08-26T00:03:33.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.272+0000 7f40ca5cb740 10 client.25298 fetch_fsmap learned FSMap version 24 2024-08-26T00:03:33.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.272+0000 7f40ca5cb740 1 -- 172.21.15.42:0/3702455787 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558eb0c3c560 con 0x558eb0c22a30 2024-08-26T00:03:33.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.273+0000 7f40a6a00640 1 -- 172.21.15.42:0/3702455787 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40b4009de0 con 0x558eb0c22a30 2024-08-26T00:03:33.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.273+0000 7f40a6a00640 1 -- 172.21.15.42:0/3702455787 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f40b40d4d10 con 0x558eb0c22a30 2024-08-26T00:03:33.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.273+0000 7f40ca5cb740 10 client.25298 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:03:33.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.274+0000 7f40ca5cb740 10 client.25298 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:03:33.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.274+0000 7f40ca5cb740 20 client.25298 populate_metadata read hostname 'smithi042' 2024-08-26T00:03:33.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.274+0000 7f40ca5cb740 1 --2- 172.21.15.42:0/3702455787 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x558eb0c3d8b0 0x558eb0c3fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:33.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.274+0000 7f40ca5cb740 4 client.25298 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:03:33.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.274+0000 7f40ca5cb740 1 -- 172.21.15.42:0/3702455787 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558eb0b964a0 con 0x558eb0c3d8b0 2024-08-26T00:03:33.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.274+0000 7f40bfe00640 1 --2- 172.21.15.42:0/3702455787 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x558eb0c3d8b0 0x558eb0c3fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:33.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.275+0000 7f40bfe00640 1 --2- 172.21.15.42:0/3702455787 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x558eb0c3d8b0 0x558eb0c3fca0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fdfc673193d8ec5 server_cookie=22f35838a07d10fb in_seq=0 out_seq=0 2024-08-26T00:03:33.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.275+0000 7f40a6a00640 10 client.25298 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:33.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.276+0000 7f40a6a00640 1 -- 172.21.15.42:0/3702455787 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558eb0b964a0 con 0x558eb0c3d8b0 2024-08-26T00:03:33.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.276+0000 7f40a6a00640 10 client.25298 handle_command_reply: tid=0 2024-08-26T00:03:33.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.276+0000 7f40ca5cb740 1 client.25298 shutdown 2024-08-26T00:03:33.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.276+0000 7f40ca5cb740 1 -- 172.21.15.42:0/3702455787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c22a30 msgr2=0x558eb0c2aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:33.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.276+0000 7f40ca5cb740 1 --2- 172.21.15.42:0/3702455787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c22a30 0x558eb0c2aa90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f40b40058c0 tx=0x7f40b4005bd0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.277+0000 7f40ca5cb740 1 -- 172.21.15.42:0/3702455787 shutdown_connections 2024-08-26T00:03:33.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.277+0000 7f40ca5cb740 1 --2- 172.21.15.42:0/3702455787 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x558eb0c3d8b0 0x558eb0c3fca0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.277+0000 7f40a6a00640 0 client.25298 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.277+0000 7f40ca5cb740 1 --2- 172.21.15.42:0/3702455787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c2dc10 0x558eb0c2b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.277+0000 7f40ca5cb740 1 --2- 172.21.15.42:0/3702455787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb0c23350 0x558eb0c2afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.277+0000 7f40ca5cb740 1 --2- 172.21.15.42:0/3702455787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c22a30 0x558eb0c2aa90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.277+0000 7f40ca5cb740 1 -- 172.21.15.42:0/3702455787 >> 172.21.15.42:0/3702455787 conn(0x558eb0c1efc0 msgr2=0x558eb0c24cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.277+0000 7f40ca5cb740 1 -- 172.21.15.42:0/3702455787 shutdown_connections 2024-08-26T00:03:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.277+0000 7f40ca5cb740 1 -- 172.21.15.42:0/3702455787 wait complete. 2024-08-26T00:03:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.277+0000 7f40ca5cb740 20 client.25298 trim_cache size 0 max 16384 2024-08-26T00:03:33.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.299+0000 7f40ca5cb740 1 Processor -- start 2024-08-26T00:03:33.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.299+0000 7f40ca5cb740 1 -- start start 2024-08-26T00:03:33.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.299+0000 7f40ca5cb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c22a30 0x558eb0c25490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:33.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.299+0000 7f40ca5cb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c23350 0x558eb0c27d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:33.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.299+0000 7f40ca5cb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb0c2dc10 0x558eb0c28290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:33.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.299+0000 7f40ca5cb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f40c01b1cc0 con 0x558eb0c22a30 2024-08-26T00:03:33.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.299+0000 7f40ca5cb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f40c01af590 con 0x558eb0c23350 2024-08-26T00:03:33.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.299+0000 7f40ca5cb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f40c01ad3c0 con 0x558eb0c2dc10 2024-08-26T00:03:33.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.300+0000 7f40bfe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c23350 0x558eb0c27d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:33.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.300+0000 7f40bfe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c23350 0x558eb0c27d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:50160/0 (socket says 172.21.15.42:50160) 2024-08-26T00:03:33.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.300+0000 7f40bfe00640 1 -- 172.21.15.42:0/3253266968 learned_addr learned my addr 172.21.15.42:0/3253266968 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:33.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.300+0000 7f40c5c00640 1 --2- 172.21.15.42:0/3253266968 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb0c2dc10 0x558eb0c28290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:33.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.300+0000 7f40c5200640 1 --2- 172.21.15.42:0/3253266968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c22a30 0x558eb0c25490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:33.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.300+0000 7f40bfe00640 1 -- 172.21.15.42:0/3253266968 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb0c2dc10 msgr2=0x558eb0c28290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:33.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.300+0000 7f40bfe00640 1 --2- 172.21.15.42:0/3253266968 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb0c2dc10 0x558eb0c28290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.300+0000 7f40bfe00640 1 -- 172.21.15.42:0/3253266968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c22a30 msgr2=0x558eb0c25490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:33.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.300+0000 7f40bfe00640 1 --2- 172.21.15.42:0/3253266968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c22a30 0x558eb0c25490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.300+0000 7f40bfe00640 1 -- 172.21.15.42:0/3253266968 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eb0c2d540 con 0x558eb0c23350 2024-08-26T00:03:33.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.301+0000 7f40bfe00640 1 --2- 172.21.15.42:0/3253266968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c23350 0x558eb0c27d50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x558eb0c2a320 tx=0x7f40ac005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a0de7d365a6fc7c server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:33.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.301+0000 7f40b1600640 1 -- 172.21.15.42:0/3253266968 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ac004310 con 0x558eb0c23350 2024-08-26T00:03:33.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.301+0000 7f40b1600640 1 -- 172.21.15.42:0/3253266968 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40ac0044b0 con 0x558eb0c23350 2024-08-26T00:03:33.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.301+0000 7f40b1600640 1 -- 172.21.15.42:0/3253266968 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ac003850 con 0x558eb0c23350 2024-08-26T00:03:33.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.302+0000 7f40ca5cb740 1 -- 172.21.15.42:0/3253266968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c23350 msgr2=0x558eb0c27d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:33.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.302+0000 7f40ca5cb740 1 --2- 172.21.15.42:0/3253266968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c23350 0x558eb0c27d50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x558eb0c2a320 tx=0x7f40ac005f90 comp rx=0 tx=0).stop 2024-08-26T00:03:33.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.303+0000 7f40ca5cb740 1 -- 172.21.15.42:0/3253266968 shutdown_connections 2024-08-26T00:03:33.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.303+0000 7f40ca5cb740 1 --2- 172.21.15.42:0/3253266968 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb0c2dc10 0x558eb0c28290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.303+0000 7f40ca5cb740 1 --2- 172.21.15.42:0/3253266968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c23350 0x558eb0c27d50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.303+0000 7f40ca5cb740 1 --2- 172.21.15.42:0/3253266968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c22a30 0x558eb0c25490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.303+0000 7f40ca5cb740 1 -- 172.21.15.42:0/3253266968 >> 172.21.15.42:0/3253266968 conn(0x558eb0c1efc0 msgr2=0x558eb0c29bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:33.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.303+0000 7f40ca5cb740 1 -- 172.21.15.42:0/3253266968 shutdown_connections 2024-08-26T00:03:33.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.303+0000 7f40ca5cb740 1 -- 172.21.15.42:0/3253266968 wait complete. 2024-08-26T00:03:33.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.303+0000 7f40ca5cb740 1 -- start start 2024-08-26T00:03:33.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.304+0000 7f40ca5cb740 1 Processor -- start 2024-08-26T00:03:33.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.304+0000 7f40ca5cb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c22a30 0x558eb0c43280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:33.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.304+0000 7f40ca5cb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb0c2dc10 0x558eb0c40580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:33.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.304+0000 7f40ca5cb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c3d8b0 0x558eb0c40ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:33.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.304+0000 7f40ca5cb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f40c01ada50 con 0x558eb0c22a30 2024-08-26T00:03:33.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.304+0000 7f40ca5cb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f40c01aeec0 con 0x558eb0c3d8b0 2024-08-26T00:03:33.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.304+0000 7f40ca5cb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f40c01ae120 con 0x558eb0c2dc10 2024-08-26T00:03:33.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.305+0000 7f40ca5cb740 10 client.0 _ll_register_callbacks cb 0x7f40b8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:03:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.305+0000 7f40c5200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c22a30 0x558eb0c43280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.305+0000 7f40c5c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c3d8b0 0x558eb0c40ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.305+0000 7f40c5c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c3d8b0 0x558eb0c40ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:50170/0 (socket says 172.21.15.42:50170) 2024-08-26T00:03:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.305+0000 7f40c5c00640 1 -- 172.21.15.42:0/2955481387 learned_addr learned my addr 172.21.15.42:0/2955481387 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.305+0000 7f40bfe00640 1 --2- 172.21.15.42:0/2955481387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb0c2dc10 0x558eb0c40580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.305+0000 7f40c5200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c22a30 0x558eb0c43280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50128/0 (socket says 172.21.15.42:50128) 2024-08-26T00:03:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.306+0000 7f40c5c00640 1 -- 172.21.15.42:0/2955481387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb0c2dc10 msgr2=0x558eb0c40580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.306+0000 7f40c5c00640 1 --2- 172.21.15.42:0/2955481387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb0c2dc10 0x558eb0c40580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.306+0000 7f40c5c00640 1 -- 172.21.15.42:0/2955481387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c22a30 msgr2=0x558eb0c43280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:33.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.306+0000 7f40c5c00640 1 --2- 172.21.15.42:0/2955481387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c22a30 0x558eb0c43280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.306+0000 7f40c5c00640 1 -- 172.21.15.42:0/2955481387 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eb0c41130 con 0x558eb0c3d8b0 2024-08-26T00:03:33.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.306+0000 7f40c5200640 1 --2- 172.21.15.42:0/2955481387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c22a30 0x558eb0c43280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:03:33.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.307+0000 7f40c5c00640 1 --2- 172.21.15.42:0/2955481387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c3d8b0 0x558eb0c40ac0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f40b8009cd0 tx=0x7f40b80095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c52016f8e70b2805 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:33.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.307+0000 7f40a6a00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:03:33.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.307+0000 7f40a6a00640 1 -- 172.21.15.42:0/2955481387 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b8003b80 con 0x558eb0c3d8b0 2024-08-26T00:03:33.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.307+0000 7f40a6a00640 1 -- 172.21.15.42:0/2955481387 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f40b8003d20 con 0x558eb0c3d8b0 2024-08-26T00:03:33.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.307+0000 7f40ca5cb740 1 -- 172.21.15.42:0/2955481387 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40ac0044b0 con 0x558eb0c3d8b0 2024-08-26T00:03:33.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.307+0000 7f40a6a00640 1 -- 172.21.15.42:0/2955481387 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f40b8004050 con 0x558eb0c3d8b0 2024-08-26T00:03:33.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.308+0000 7f40ca5cb740 10 client.25304 fetch_fsmap learned FSMap version 24 2024-08-26T00:03:33.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.308+0000 7f40ca5cb740 1 -- 172.21.15.42:0/2955481387 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558eb0cb0870 con 0x558eb0c3d8b0 2024-08-26T00:03:33.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.308+0000 7f40a6a00640 1 -- 172.21.15.42:0/2955481387 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40ac0044b0 con 0x558eb0c3d8b0 2024-08-26T00:03:33.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.308+0000 7f40a6a00640 1 -- 172.21.15.42:0/2955481387 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f40b805d020 con 0x558eb0c3d8b0 2024-08-26T00:03:33.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.308+0000 7f40ca5cb740 10 client.25304 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:03:33.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.308+0000 7f40ca5cb740 10 client.25304 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:03:33.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.308+0000 7f40ca5cb740 20 client.25304 populate_metadata read hostname 'smithi042' 2024-08-26T00:03:33.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.308+0000 7f40ca5cb740 1 --2- 172.21.15.42:0/2955481387 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x558eb0cb0f80 0x558eb0cb33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:33.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.308+0000 7f40ca5cb740 4 client.25304 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:03:33.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.308+0000 7f40ca5cb740 1 -- 172.21.15.42:0/2955481387 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558eb0b909b0 con 0x558eb0cb0f80 2024-08-26T00:03:33.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.309+0000 7f40c5200640 1 --2- 172.21.15.42:0/2955481387 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x558eb0cb0f80 0x558eb0cb33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:33.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.309+0000 7f40c5200640 1 --2- 172.21.15.42:0/2955481387 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x558eb0cb0f80 0x558eb0cb33a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4c6c681590d2117 server_cookie=9b0f93fe4b3e6daa in_seq=0 out_seq=0 2024-08-26T00:03:33.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.309+0000 7f40a6a00640 10 client.25304 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:33.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.310+0000 7f40a6a00640 1 -- 172.21.15.42:0/2955481387 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558eb0b909b0 con 0x558eb0cb0f80 2024-08-26T00:03:33.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.310+0000 7f40a6a00640 10 client.25304 handle_command_reply: tid=0 2024-08-26T00:03:33.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.310+0000 7f40ca5cb740 1 client.25304 shutdown 2024-08-26T00:03:33.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.310+0000 7f40ca5cb740 1 -- 172.21.15.42:0/2955481387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c3d8b0 msgr2=0x558eb0c40ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:33.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.310+0000 7f40ca5cb740 1 --2- 172.21.15.42:0/2955481387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c3d8b0 0x558eb0c40ac0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f40b8009cd0 tx=0x7f40b80095c0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.310+0000 7f40ca5cb740 1 -- 172.21.15.42:0/2955481387 shutdown_connections 2024-08-26T00:03:33.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.310+0000 7f40ca5cb740 1 --2- 172.21.15.42:0/2955481387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558eb0c3d8b0 0x558eb0c40ac0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.310+0000 7f40ca5cb740 1 --2- 172.21.15.42:0/2955481387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558eb0c2dc10 0x558eb0c40580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.310+0000 7f40ca5cb740 1 --2- 172.21.15.42:0/2955481387 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x558eb0cb0f80 0x558eb0cb33a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.310+0000 7f40ca5cb740 1 --2- 172.21.15.42:0/2955481387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558eb0c22a30 0x558eb0c43280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.310+0000 7f40ca5cb740 1 -- 172.21.15.42:0/2955481387 >> 172.21.15.42:0/2955481387 conn(0x558eb0c1efc0 msgr2=0x558eb0c38bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:33.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.310+0000 7f40a6a00640 0 client.25304 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:33.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.311+0000 7f40ca5cb740 1 -- 172.21.15.42:0/2955481387 shutdown_connections 2024-08-26T00:03:33.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.311+0000 7f40ca5cb740 1 -- 172.21.15.42:0/2955481387 wait complete. 2024-08-26T00:03:33.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.311+0000 7f40ca5cb740 20 client.25304 trim_cache size 0 max 16384 2024-08-26T00:03:33.314 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:03:33.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.312+0000 7f40c6600640 1 -- 172.21.15.42:0/434676586 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f40a80a2c00 msgr2=0x7f40a80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:33.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.312+0000 7f40c6600640 1 --2- 172.21.15.42:0/434676586 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f40a80a2c00 0x7f40a80a50c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f40b8004af0 tx=0x7f40b8004a80 comp rx=0 tx=0).stop 2024-08-26T00:03:33.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.312+0000 7f40c6600640 1 -- 172.21.15.42:0/434676586 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40c0101760 msgr2=0x7f40c0074290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:33.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.312+0000 7f40c6600640 1 --2- 172.21.15.42:0/434676586 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40c0101760 0x7f40c0074290 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f40b400d950 tx=0x7f40b400de10 comp rx=0 tx=0).stop 2024-08-26T00:03:33.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.312+0000 7f40c6600640 1 -- 172.21.15.42:0/434676586 shutdown_connections 2024-08-26T00:03:33.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.312+0000 7f40c6600640 1 --2- 172.21.15.42:0/434676586 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f40a80a2c00 0x7f40a80a50c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.312+0000 7f40c6600640 1 --2- 172.21.15.42:0/434676586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40c0107760 0x7f40c0074d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.312+0000 7f40c6600640 1 --2- 172.21.15.42:0/434676586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40c0102100 0x7f40c00747d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.312+0000 7f40c6600640 1 --2- 172.21.15.42:0/434676586 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40c0101760 0x7f40c0074290 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:33.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.312+0000 7f40c6600640 1 -- 172.21.15.42:0/434676586 >> 172.21.15.42:0/434676586 conn(0x7f40c00fd4e0 msgr2=0x7f40c00fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:33.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.313+0000 7f40c6600640 1 -- 172.21.15.42:0/434676586 shutdown_connections 2024-08-26T00:03:33.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:33.313+0000 7f40c6600640 1 -- 172.21.15.42:0/434676586 wait complete. 2024-08-26T00:03:34.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:34 smithi043 ceph-mon[22091]: pgmap v370: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-08-26T00:03:34.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:34 smithi042 ceph-mon[17225]: pgmap v370: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-08-26T00:03:34.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:34 smithi181 ceph-mon[22102]: pgmap v370: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-08-26T00:03:35.135 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-26T00:03:35.135 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-26T00:03:35.584 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:03:36.172 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:36 smithi042 ceph-mon[17225]: pgmap v371: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-26T00:03:36.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.234+0000 7fb74f200640 1 -- 172.21.15.42:0/2805766724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb750102100 msgr2=0x7fb75010e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:36.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.234+0000 7fb74f200640 1 --2- 172.21.15.42:0/2805766724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb750102100 0x7fb75010e630 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb748009ca0 tx=0x7fb74802a8c0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.234+0000 7fb74f200640 1 -- 172.21.15.42:0/2805766724 shutdown_connections 2024-08-26T00:03:36.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.234+0000 7fb74f200640 1 --2- 172.21.15.42:0/2805766724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb750102100 0x7fb75010e630 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.234+0000 7fb74f200640 1 --2- 172.21.15.42:0/2805766724 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb750101760 0x7fb750101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.234+0000 7fb74f200640 1 --2- 172.21.15.42:0/2805766724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb750107760 0x7fb750107b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.234+0000 7fb74f200640 1 -- 172.21.15.42:0/2805766724 >> 172.21.15.42:0/2805766724 conn(0x7fb7500fd4e0 msgr2=0x7fb7500ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:36.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.234+0000 7fb74f200640 1 -- 172.21.15.42:0/2805766724 shutdown_connections 2024-08-26T00:03:36.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.234+0000 7fb74f200640 1 -- 172.21.15.42:0/2805766724 wait complete. 2024-08-26T00:03:36.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.235+0000 7fb74f200640 1 Processor -- start 2024-08-26T00:03:36.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.236+0000 7fb74f200640 1 -- start start 2024-08-26T00:03:36.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.236+0000 7fb74f200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb750101760 0x7fb7500713a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:36.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.236+0000 7fb74f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb750102100 0x7fb7500718e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:36.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.236+0000 7fb74f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb750107760 0x7fb75006c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:36.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.236+0000 7fb74f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb750111bb0 con 0x7fb750107760 2024-08-26T00:03:36.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.236+0000 7fb74f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb750111a30 con 0x7fb750102100 2024-08-26T00:03:36.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.236+0000 7fb74f200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb750111d30 con 0x7fb750101760 2024-08-26T00:03:36.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.237+0000 7fb74de00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb750101760 0x7fb7500713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:36.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.237+0000 7fb74d400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb750102100 0x7fb7500718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:36.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.237+0000 7fb74e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb750107760 0x7fb75006c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:36.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.237+0000 7fb74d400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb750102100 0x7fb7500718e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45132/0 (socket says 172.21.15.42:45132) 2024-08-26T00:03:36.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.237+0000 7fb74de00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb750101760 0x7fb7500713a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:52202/0 (socket says 172.21.15.42:52202) 2024-08-26T00:03:36.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.237+0000 7fb74e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb750107760 0x7fb75006c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54686/0 (socket says 172.21.15.42:54686) 2024-08-26T00:03:36.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.237+0000 7fb74e800640 1 -- 172.21.15.42:0/2798037619 learned_addr learned my addr 172.21.15.42:0/2798037619 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:36.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.238+0000 7fb74d400640 1 -- 172.21.15.42:0/2798037619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb750101760 msgr2=0x7fb7500713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:36.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.238+0000 7fb74d400640 1 --2- 172.21.15.42:0/2798037619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb750101760 0x7fb7500713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.238+0000 7fb74d400640 1 -- 172.21.15.42:0/2798037619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb750107760 msgr2=0x7fb75006c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:36.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.238+0000 7fb74d400640 1 --2- 172.21.15.42:0/2798037619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb750107760 0x7fb75006c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.238+0000 7fb74d400640 1 -- 172.21.15.42:0/2798037619 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb75006cd80 con 0x7fb750102100 2024-08-26T00:03:36.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.238+0000 7fb74e800640 1 --2- 172.21.15.42:0/2798037619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb750107760 0x7fb75006c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:03:36.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.239+0000 7fb74d400640 1 --2- 172.21.15.42:0/2798037619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb750102100 0x7fb7500718e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00c970 tx=0x7fb73c00ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:36.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.239+0000 7fb746a00640 1 -- 172.21.15.42:0/2798037619 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73c007bb0 con 0x7fb750102100 2024-08-26T00:03:36.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.239+0000 7fb74f200640 1 -- 172.21.15.42:0/2798037619 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb75006d070 con 0x7fb750102100 2024-08-26T00:03:36.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.239+0000 7fb74f200640 1 -- 172.21.15.42:0/2798037619 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb750075280 con 0x7fb750102100 2024-08-26T00:03:36.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.241+0000 7fb746a00640 1 -- 172.21.15.42:0/2798037619 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb73c007d50 con 0x7fb750102100 2024-08-26T00:03:36.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.241+0000 7fb746a00640 1 -- 172.21.15.42:0/2798037619 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73c018820 con 0x7fb750102100 2024-08-26T00:03:36.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.243+0000 7fb746a00640 1 -- 172.21.15.42:0/2798037619 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb73c018a60 con 0x7fb750102100 2024-08-26T00:03:36.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.245+0000 7fb746a00640 1 --2- 172.21.15.42:0/2798037619 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb7340a2c00 0x7fb7340a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:36.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.245+0000 7fb746a00640 1 -- 172.21.15.42:0/2798037619 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb73c0cef10 con 0x7fb750102100 2024-08-26T00:03:36.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.245+0000 7fb757607740 1 Processor -- start 2024-08-26T00:03:36.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.245+0000 7fb757607740 1 -- start start 2024-08-26T00:03:36.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.245+0000 7fb74de00640 1 --2- 172.21.15.42:0/2798037619 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb7340a2c00 0x7fb7340a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:36.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.246+0000 7fb757607740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e31f60 0x559904e32340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:36.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.246+0000 7fb757607740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559904e32880 0x559904e3cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:36.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.246+0000 7fb757607740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e3d140 0x559904e3f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:36.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.246+0000 7fb757607740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559904d98e30 con 0x559904e32880 2024-08-26T00:03:36.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.246+0000 7fb757607740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559904d303c0 con 0x559904e3d140 2024-08-26T00:03:36.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.246+0000 7fb757607740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559904d94df0 con 0x559904e31f60 2024-08-26T00:03:36.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.246+0000 7fb74de00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e31f60 0x559904e32340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:36.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.246+0000 7fb74e800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e3d140 0x559904e3f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:36.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.246+0000 7fb74de00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e31f60 0x559904e32340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:52216/0 (socket says 172.21.15.42:52216) 2024-08-26T00:03:36.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.246+0000 7fb74de00640 1 -- 172.21.15.42:0/587024623 learned_addr learned my addr 172.21.15.42:0/587024623 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:36.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.247+0000 7fb74de00640 1 --2- 172.21.15.42:0/2798037619 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb7340a2c00 0x7fb7340a50c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb740009ba0 tx=0x7fb740005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:36.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.247+0000 7fb74d400640 1 --2- 172.21.15.42:0/587024623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559904e32880 0x559904e3cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:36.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.247+0000 7fb74de00640 1 -- 172.21.15.42:0/587024623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e3d140 msgr2=0x559904e3f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:36.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.247+0000 7fb74de00640 1 --2- 172.21.15.42:0/587024623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e3d140 0x559904e3f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.247+0000 7fb74de00640 1 -- 172.21.15.42:0/587024623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559904e32880 msgr2=0x559904e3cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:36.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.247+0000 7fb74de00640 1 --2- 172.21.15.42:0/587024623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559904e32880 0x559904e3cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.247+0000 7fb74de00640 1 -- 172.21.15.42:0/587024623 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559904b0a6a0 con 0x559904e31f60 2024-08-26T00:03:36.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.247+0000 7fb74d400640 1 --2- 172.21.15.42:0/587024623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559904e32880 0x559904e3cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:03:36.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.248+0000 7fb74de00640 1 --2- 172.21.15.42:0/587024623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e31f60 0x559904e32340 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb740012e80 tx=0x7fb740019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9faff931358d50a server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:36.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.248+0000 7fb73b000640 1 -- 172.21.15.42:0/587024623 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb740005220 con 0x559904e31f60 2024-08-26T00:03:36.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.248+0000 7fb73b000640 1 -- 172.21.15.42:0/587024623 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb74001ce50 con 0x559904e31f60 2024-08-26T00:03:36.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.248+0000 7fb73b000640 1 -- 172.21.15.42:0/587024623 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74001b890 con 0x559904e31f60 2024-08-26T00:03:36.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.249+0000 7fb757607740 1 -- 172.21.15.42:0/587024623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e31f60 msgr2=0x559904e32340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:36.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.249+0000 7fb757607740 1 --2- 172.21.15.42:0/587024623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e31f60 0x559904e32340 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb740012e80 tx=0x7fb740019000 comp rx=0 tx=0).stop 2024-08-26T00:03:36.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.249+0000 7fb757607740 1 -- 172.21.15.42:0/587024623 shutdown_connections 2024-08-26T00:03:36.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.249+0000 7fb757607740 1 --2- 172.21.15.42:0/587024623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e3d140 0x559904e3f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.249+0000 7fb757607740 1 --2- 172.21.15.42:0/587024623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559904e32880 0x559904e3cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.249+0000 7fb757607740 1 --2- 172.21.15.42:0/587024623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e31f60 0x559904e32340 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.249+0000 7fb757607740 1 -- 172.21.15.42:0/587024623 >> 172.21.15.42:0/587024623 conn(0x559904e2e4f0 msgr2=0x559904e2e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:36.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.249+0000 7fb757607740 1 -- 172.21.15.42:0/587024623 shutdown_connections 2024-08-26T00:03:36.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.250+0000 7fb757607740 1 -- 172.21.15.42:0/587024623 wait complete. 2024-08-26T00:03:36.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.250+0000 7fb757607740 1 -- start start 2024-08-26T00:03:36.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.251+0000 7fb757607740 1 Processor -- start 2024-08-26T00:03:36.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.251+0000 7fb757607740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e31f60 0x559904e3cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:36.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.251+0000 7fb757607740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e32880 0x559904e39f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:36.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.251+0000 7fb757607740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559904e3d140 0x559904e3a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:36.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.251+0000 7fb757607740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559904e3fd60 con 0x559904e3d140 2024-08-26T00:03:36.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.251+0000 7fb757607740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559904d53c30 con 0x559904e32880 2024-08-26T00:03:36.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.251+0000 7fb757607740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559904e3fee0 con 0x559904e31f60 2024-08-26T00:03:36.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.251+0000 7fb757607740 10 client.0 _ll_register_callbacks cb 0x559904aa7ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:03:36.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.252+0000 7fb74d400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e32880 0x559904e39f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:36.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.252+0000 7fb74d400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e32880 0x559904e39f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45156/0 (socket says 172.21.15.42:45156) 2024-08-26T00:03:36.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.252+0000 7fb74d400640 1 -- 172.21.15.42:0/4004414864 learned_addr learned my addr 172.21.15.42:0/4004414864 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:36.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.252+0000 7fb74de00640 1 --2- 172.21.15.42:0/4004414864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e31f60 0x559904e3cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:36.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.252+0000 7fb74e800640 1 --2- 172.21.15.42:0/4004414864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559904e3d140 0x559904e3a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:36.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.253+0000 7fb74d400640 1 -- 172.21.15.42:0/4004414864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e31f60 msgr2=0x559904e3cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:36.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.253+0000 7fb74d400640 1 --2- 172.21.15.42:0/4004414864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e31f60 0x559904e3cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.253+0000 7fb74d400640 1 -- 172.21.15.42:0/4004414864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559904e3d140 msgr2=0x559904e3a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:36.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.253+0000 7fb74d400640 1 --2- 172.21.15.42:0/4004414864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559904e3d140 0x559904e3a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.253+0000 7fb74d400640 1 -- 172.21.15.42:0/4004414864 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559904d5fdd0 con 0x559904e32880 2024-08-26T00:03:36.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.253+0000 7fb74d400640 1 --2- 172.21.15.42:0/4004414864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e32880 0x559904e39f30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00ff30 tx=0x7fb73c09c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c40b8d6714b5ee5b server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:36.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.253+0000 7fb72f400640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:03:36.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.254+0000 7fb72f400640 1 -- 172.21.15.42:0/4004414864 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73c0b3020 con 0x559904e32880 2024-08-26T00:03:36.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.254+0000 7fb72f400640 1 -- 172.21.15.42:0/4004414864 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb73c087070 con 0x559904e32880 2024-08-26T00:03:36.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.254+0000 7fb757607740 1 -- 172.21.15.42:0/4004414864 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb74001ce50 con 0x559904e32880 2024-08-26T00:03:36.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.255+0000 7fb72f400640 1 -- 172.21.15.42:0/4004414864 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb73c087270 con 0x559904e32880 2024-08-26T00:03:36.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.255+0000 7fb757607740 10 client.25316 fetch_fsmap learned FSMap version 24 2024-08-26T00:03:36.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.255+0000 7fb757607740 1 -- 172.21.15.42:0/4004414864 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559904e4b930 con 0x559904e32880 2024-08-26T00:03:36.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.255+0000 7fb72f400640 1 -- 172.21.15.42:0/4004414864 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb74001ce50 con 0x559904e32880 2024-08-26T00:03:36.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.256+0000 7fb72f400640 1 -- 172.21.15.42:0/4004414864 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb73c0b8070 con 0x559904e32880 2024-08-26T00:03:36.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.256+0000 7fb757607740 10 client.25316 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:03:36.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.256+0000 7fb757607740 10 client.25316 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:03:36.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.256+0000 7fb757607740 20 client.25316 populate_metadata read hostname 'smithi042' 2024-08-26T00:03:36.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.256+0000 7fb757607740 1 --2- 172.21.15.42:0/4004414864 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x559904e4cdf0 0x559904e4f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:36.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.256+0000 7fb757607740 4 client.25316 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:03:36.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.256+0000 7fb757607740 1 -- 172.21.15.42:0/4004414864 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559904da63a0 con 0x559904e4cdf0 2024-08-26T00:03:36.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.257+0000 7fb74de00640 1 --2- 172.21.15.42:0/4004414864 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x559904e4cdf0 0x559904e4f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:36.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.258+0000 7fb74de00640 1 --2- 172.21.15.42:0/4004414864 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x559904e4cdf0 0x559904e4f1e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b080462928fe0516 server_cookie=ea3dfe566f158aea in_seq=0 out_seq=0 2024-08-26T00:03:36.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.258+0000 7fb72f400640 10 client.25316 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:36.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.259+0000 7fb72f400640 1 -- 172.21.15.42:0/4004414864 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559904da63a0 con 0x559904e4cdf0 2024-08-26T00:03:36.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.259+0000 7fb72f400640 10 client.25316 handle_command_reply: tid=0 2024-08-26T00:03:36.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.259+0000 7fb757607740 1 client.25316 shutdown 2024-08-26T00:03:36.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.259+0000 7fb757607740 1 -- 172.21.15.42:0/4004414864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e32880 msgr2=0x559904e39f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:36.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.259+0000 7fb757607740 1 --2- 172.21.15.42:0/4004414864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e32880 0x559904e39f30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00ff30 tx=0x7fb73c09c860 comp rx=0 tx=0).stop 2024-08-26T00:03:36.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.259+0000 7fb757607740 1 -- 172.21.15.42:0/4004414864 shutdown_connections 2024-08-26T00:03:36.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.259+0000 7fb757607740 1 --2- 172.21.15.42:0/4004414864 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x559904e4cdf0 0x559904e4f1e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.260+0000 7fb757607740 1 --2- 172.21.15.42:0/4004414864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559904e3d140 0x559904e3a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.260+0000 7fb757607740 1 --2- 172.21.15.42:0/4004414864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e32880 0x559904e39f30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.260+0000 7fb757607740 1 --2- 172.21.15.42:0/4004414864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e31f60 0x559904e3cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.260+0000 7fb72f400640 0 client.25316 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:36.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.260+0000 7fb757607740 1 -- 172.21.15.42:0/4004414864 >> 172.21.15.42:0/4004414864 conn(0x559904e2e4f0 msgr2=0x559904e34220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:36.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.260+0000 7fb757607740 1 -- 172.21.15.42:0/4004414864 shutdown_connections 2024-08-26T00:03:36.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.261+0000 7fb757607740 1 -- 172.21.15.42:0/4004414864 wait complete. 2024-08-26T00:03:36.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.261+0000 7fb757607740 20 client.25316 trim_cache size 0 max 16384 2024-08-26T00:03:36.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.280+0000 7fb757607740 1 Processor -- start 2024-08-26T00:03:36.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.280+0000 7fb757607740 1 -- start start 2024-08-26T00:03:36.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.280+0000 7fb757607740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e31f60 0x559904e38f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:36.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.280+0000 7fb757607740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e32880 0x559904e54aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:36.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.280+0000 7fb757607740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559904e3d140 0x559904e54fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:36.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.280+0000 7fb757607740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb730010e20 con 0x559904e3d140 2024-08-26T00:03:36.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.280+0000 7fb757607740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb73000e6f0 con 0x559904e31f60 2024-08-26T00:03:36.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.280+0000 7fb757607740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb73000c520 con 0x559904e32880 2024-08-26T00:03:36.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.281+0000 7fb74de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e31f60 0x559904e38f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:36.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.281+0000 7fb74de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e31f60 0x559904e38f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45170/0 (socket says 172.21.15.42:45170) 2024-08-26T00:03:36.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.281+0000 7fb74de00640 1 -- 172.21.15.42:0/1058449333 learned_addr learned my addr 172.21.15.42:0/1058449333 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:36.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.281+0000 7fb74e800640 1 --2- 172.21.15.42:0/1058449333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559904e3d140 0x559904e54fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:36.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.281+0000 7fb74d400640 1 --2- 172.21.15.42:0/1058449333 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e32880 0x559904e54aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:36.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.282+0000 7fb74e800640 1 -- 172.21.15.42:0/1058449333 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e32880 msgr2=0x559904e54aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:36.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.282+0000 7fb74e800640 1 --2- 172.21.15.42:0/1058449333 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e32880 0x559904e54aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.282+0000 7fb74e800640 1 -- 172.21.15.42:0/1058449333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e31f60 msgr2=0x559904e38f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:36.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.282+0000 7fb74e800640 1 --2- 172.21.15.42:0/1058449333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e31f60 0x559904e38f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.282+0000 7fb74e800640 1 -- 172.21.15.42:0/1058449333 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559904e3cf50 con 0x559904e3d140 2024-08-26T00:03:36.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.283+0000 7fb74e800640 1 --2- 172.21.15.42:0/1058449333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559904e3d140 0x559904e54fe0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x559904e2f870 tx=0x7fb748001160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fdb1743f23d3a0b server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:36.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.283+0000 7fb73a600640 1 -- 172.21.15.42:0/1058449333 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb748003b70 con 0x559904e3d140 2024-08-26T00:03:36.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.283+0000 7fb73a600640 1 -- 172.21.15.42:0/1058449333 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb74804c070 con 0x559904e3d140 2024-08-26T00:03:36.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.283+0000 7fb73a600640 1 -- 172.21.15.42:0/1058449333 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb748004810 con 0x559904e3d140 2024-08-26T00:03:36.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.284+0000 7fb757607740 1 -- 172.21.15.42:0/1058449333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559904e3d140 msgr2=0x559904e54fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:36.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.284+0000 7fb757607740 1 --2- 172.21.15.42:0/1058449333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559904e3d140 0x559904e54fe0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x559904e2f870 tx=0x7fb748001160 comp rx=0 tx=0).stop 2024-08-26T00:03:36.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.284+0000 7fb757607740 1 -- 172.21.15.42:0/1058449333 shutdown_connections 2024-08-26T00:03:36.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.285+0000 7fb757607740 1 --2- 172.21.15.42:0/1058449333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559904e3d140 0x559904e54fe0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.285+0000 7fb757607740 1 --2- 172.21.15.42:0/1058449333 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e32880 0x559904e54aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.285+0000 7fb757607740 1 --2- 172.21.15.42:0/1058449333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e31f60 0x559904e38f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.285+0000 7fb757607740 1 -- 172.21.15.42:0/1058449333 >> 172.21.15.42:0/1058449333 conn(0x559904e2e4f0 msgr2=0x559904e38800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:36.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.285+0000 7fb757607740 1 -- 172.21.15.42:0/1058449333 shutdown_connections 2024-08-26T00:03:36.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.285+0000 7fb757607740 1 -- 172.21.15.42:0/1058449333 wait complete. 2024-08-26T00:03:36.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.285+0000 7fb757607740 1 -- start start 2024-08-26T00:03:36.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.286+0000 7fb757607740 1 Processor -- start 2024-08-26T00:03:36.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.286+0000 7fb757607740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559904e31f60 0x559904e45940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:36.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.286+0000 7fb757607740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e32880 0x559904e36cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:36.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.286+0000 7fb757607740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e3d140 0x559904e371f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:36.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.287+0000 7fb757607740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb73000cbb0 con 0x559904e31f60 2024-08-26T00:03:36.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.287+0000 7fb757607740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb73000e020 con 0x559904e3d140 2024-08-26T00:03:36.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.287+0000 7fb757607740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb73000d280 con 0x559904e32880 2024-08-26T00:03:36.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.287+0000 7fb757607740 10 client.0 _ll_register_callbacks cb 0x7fb73c09c720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:03:36.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.287+0000 7fb74d400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e32880 0x559904e36cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:36.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.287+0000 7fb74d400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e32880 0x559904e36cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:52246/0 (socket says 172.21.15.42:52246) 2024-08-26T00:03:36.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.287+0000 7fb74d400640 1 -- 172.21.15.42:0/1000112829 learned_addr learned my addr 172.21.15.42:0/1000112829 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:36.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.287+0000 7fb74de00640 1 --2- 172.21.15.42:0/1000112829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559904e31f60 0x559904e45940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:36.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.288+0000 7fb74d400640 1 -- 172.21.15.42:0/1000112829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e3d140 msgr2=0x559904e371f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:36.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.287+0000 7fb74e800640 1 --2- 172.21.15.42:0/1000112829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e3d140 0x559904e371f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:36.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.289+0000 7fb74d400640 1 --2- 172.21.15.42:0/1000112829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e3d140 0x559904e371f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.289+0000 7fb74d400640 1 -- 172.21.15.42:0/1000112829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559904e31f60 msgr2=0x559904e45940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:36.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.289+0000 7fb74d400640 1 --2- 172.21.15.42:0/1000112829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559904e31f60 0x559904e45940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.289+0000 7fb74d400640 1 -- 172.21.15.42:0/1000112829 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559904e37a20 con 0x559904e32880 2024-08-26T00:03:36.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.289+0000 7fb74de00640 1 --2- 172.21.15.42:0/1000112829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559904e31f60 0x559904e45940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:03:36.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.289+0000 7fb74e800640 1 --2- 172.21.15.42:0/1000112829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e3d140 0x559904e371f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:03:36.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.290+0000 7fb74d400640 1 --2- 172.21.15.42:0/1000112829 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e32880 0x559904e36cb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb73c000c00 tx=0x7fb73c0189c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa21ac1f08d370ab server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:36.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.290+0000 7fb72f400640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:03:36.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.290+0000 7fb72f400640 1 -- 172.21.15.42:0/1000112829 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73c07f070 con 0x559904e32880 2024-08-26T00:03:36.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.290+0000 7fb72f400640 1 -- 172.21.15.42:0/1000112829 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb73c09bcb0 con 0x559904e32880 2024-08-26T00:03:36.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.290+0000 7fb757607740 1 -- 172.21.15.42:0/1000112829 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb74804c070 con 0x559904e32880 2024-08-26T00:03:36.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.291+0000 7fb72f400640 1 -- 172.21.15.42:0/1000112829 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb73c0b3070 con 0x559904e32880 2024-08-26T00:03:36.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.291+0000 7fb757607740 10 client.25324 fetch_fsmap learned FSMap version 24 2024-08-26T00:03:36.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.291+0000 7fb757607740 1 -- 172.21.15.42:0/1000112829 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559904eb7b10 con 0x559904e32880 2024-08-26T00:03:36.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.291+0000 7fb72f400640 1 -- 172.21.15.42:0/1000112829 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb74804c070 con 0x559904e32880 2024-08-26T00:03:36.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.291+0000 7fb72f400640 1 -- 172.21.15.42:0/1000112829 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb73c0b8050 con 0x559904e32880 2024-08-26T00:03:36.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.292+0000 7fb757607740 10 client.25324 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:03:36.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.292+0000 7fb757607740 10 client.25324 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:03:36.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.292+0000 7fb757607740 20 client.25324 populate_metadata read hostname 'smithi042' 2024-08-26T00:03:36.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.292+0000 7fb757607740 1 --2- 172.21.15.42:0/1000112829 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x559904eb8180 0x559904eba5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:36.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.292+0000 7fb757607740 4 client.25324 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-26T00:03:36.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.292+0000 7fb757607740 1 -- 172.21.15.42:0/1000112829 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559904da08b0 con 0x559904eb8180 2024-08-26T00:03:36.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.292+0000 7fb74de00640 1 --2- 172.21.15.42:0/1000112829 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x559904eb8180 0x559904eba5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:36.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.293+0000 7fb74de00640 1 --2- 172.21.15.42:0/1000112829 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x559904eb8180 0x559904eba5a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57aca830b1fb11b2 server_cookie=7a350bb0f852b9c3 in_seq=0 out_seq=0 2024-08-26T00:03:36.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.293+0000 7fb72f400640 10 client.25324 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:36.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.294+0000 7fb72f400640 1 -- 172.21.15.42:0/1000112829 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559904da08b0 con 0x559904eb8180 2024-08-26T00:03:36.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.294+0000 7fb72f400640 10 client.25324 handle_command_reply: tid=0 2024-08-26T00:03:36.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.294+0000 7fb757607740 1 client.25324 shutdown 2024-08-26T00:03:36.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.295+0000 7fb757607740 1 -- 172.21.15.42:0/1000112829 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e32880 msgr2=0x559904e36cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:36.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.295+0000 7fb757607740 1 --2- 172.21.15.42:0/1000112829 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e32880 0x559904e36cb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb73c000c00 tx=0x7fb73c0189c0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.295+0000 7fb757607740 1 -- 172.21.15.42:0/1000112829 shutdown_connections 2024-08-26T00:03:36.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.295+0000 7fb757607740 1 --2- 172.21.15.42:0/1000112829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559904e3d140 0x559904e371f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.295+0000 7fb757607740 1 --2- 172.21.15.42:0/1000112829 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559904e32880 0x559904e36cb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.295+0000 7fb757607740 1 --2- 172.21.15.42:0/1000112829 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x559904eb8180 0x559904eba5a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.295+0000 7fb757607740 1 --2- 172.21.15.42:0/1000112829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559904e31f60 0x559904e45940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.295+0000 7fb757607740 1 -- 172.21.15.42:0/1000112829 >> 172.21.15.42:0/1000112829 conn(0x559904e2e4f0 msgr2=0x559904e39020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:36.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.295+0000 7fb72f400640 0 client.25324 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:36.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.296+0000 7fb757607740 1 -- 172.21.15.42:0/1000112829 shutdown_connections 2024-08-26T00:03:36.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.296+0000 7fb757607740 1 -- 172.21.15.42:0/1000112829 wait complete. 2024-08-26T00:03:36.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.296+0000 7fb757607740 20 client.25324 trim_cache size 0 max 16384 2024-08-26T00:03:36.298 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:03:36.298 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-08-26T00:03:36.298 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "23542b18-9e56-4347-9d61-a90bed4a6579", 2024-08-26T00:03:36.299 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-08-26T00:03:36.299 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:03:36.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.297+0000 7fb74f200640 1 -- 172.21.15.42:0/2798037619 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb7340a2c00 msgr2=0x7fb7340a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:36.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.297+0000 7fb74f200640 1 --2- 172.21.15.42:0/2798037619 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb7340a2c00 0x7fb7340a50c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb740009ba0 tx=0x7fb740005f90 comp rx=0 tx=0).stop 2024-08-26T00:03:36.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.297+0000 7fb74f200640 1 -- 172.21.15.42:0/2798037619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb750102100 msgr2=0x7fb7500718e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:36.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.297+0000 7fb74f200640 1 --2- 172.21.15.42:0/2798037619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb750102100 0x7fb7500718e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00c970 tx=0x7fb73c00ce30 comp rx=0 tx=0).stop 2024-08-26T00:03:36.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.298+0000 7fb74f200640 1 -- 172.21.15.42:0/2798037619 shutdown_connections 2024-08-26T00:03:36.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.298+0000 7fb74f200640 1 --2- 172.21.15.42:0/2798037619 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb7340a2c00 0x7fb7340a50c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.298+0000 7fb74f200640 1 --2- 172.21.15.42:0/2798037619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb750107760 0x7fb75006c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.298+0000 7fb74f200640 1 --2- 172.21.15.42:0/2798037619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb750102100 0x7fb7500718e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.298+0000 7fb74f200640 1 --2- 172.21.15.42:0/2798037619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb750101760 0x7fb7500713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:36.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.298+0000 7fb74f200640 1 -- 172.21.15.42:0/2798037619 >> 172.21.15.42:0/2798037619 conn(0x7fb7500fd4e0 msgr2=0x7fb7500fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:36.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.298+0000 7fb74f200640 1 -- 172.21.15.42:0/2798037619 shutdown_connections 2024-08-26T00:03:36.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:36.299+0000 7fb74f200640 1 -- 172.21.15.42:0/2798037619 wait complete. 2024-08-26T00:03:36.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:36 smithi043 ceph-mon[22091]: pgmap v371: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-26T00:03:36.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:36 smithi181 ceph-mon[22102]: pgmap v371: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-26T00:03:37.202 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-26T00:03:37.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:37 smithi043 ceph-mon[22091]: scrub queued for path: / 2024-08-26T00:03:37.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:37 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:03:37.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:37 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:03:37.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:37 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:03:37.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:37 smithi181 ceph-mon[22102]: scrub queued for path: / 2024-08-26T00:03:37.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:37 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:03:37.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:37 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:03:37.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:37 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:03:37.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:37 smithi042 ceph-mon[17225]: scrub queued for path: / 2024-08-26T00:03:37.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:37 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:03:37.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:37 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:03:37.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:37 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:03:37.631 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:03:38.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.176+0000 7f1e21c00640 1 -- 172.21.15.42:0/3808052277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e1c101770 msgr2=0x7f1e1c101bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:38.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.176+0000 7f1e21c00640 1 --2- 172.21.15.42:0/3808052277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e1c101770 0x7f1e1c101bd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1e04009930 tx=0x7f1e0402a420 comp rx=0 tx=0).stop 2024-08-26T00:03:38.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.176+0000 7f1e21c00640 1 -- 172.21.15.42:0/3808052277 shutdown_connections 2024-08-26T00:03:38.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.176+0000 7f1e21c00640 1 --2- 172.21.15.42:0/3808052277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e1c102110 0x7f1e1c10e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.176+0000 7f1e21c00640 1 --2- 172.21.15.42:0/3808052277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e1c101770 0x7f1e1c101bd0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.176+0000 7f1e21c00640 1 --2- 172.21.15.42:0/3808052277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e1c107770 0x7f1e1c107b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.176+0000 7f1e21c00640 1 -- 172.21.15.42:0/3808052277 >> 172.21.15.42:0/3808052277 conn(0x7f1e1c0fd4b0 msgr2=0x7f1e1c0ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:38.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.176+0000 7f1e21c00640 1 -- 172.21.15.42:0/3808052277 shutdown_connections 2024-08-26T00:03:38.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.176+0000 7f1e21c00640 1 -- 172.21.15.42:0/3808052277 wait complete. 2024-08-26T00:03:38.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.178+0000 7f1e21c00640 1 Processor -- start 2024-08-26T00:03:38.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.178+0000 7f1e21c00640 1 -- start start 2024-08-26T00:03:38.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.178+0000 7f1e21c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e1c101770 0x7f1e1c074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:38.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.178+0000 7f1e21c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e1c102110 0x7f1e1c0747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:38.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.178+0000 7f1e21c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e1c107770 0x7f1e1c074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:38.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.178+0000 7f1e21c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1c111b70 con 0x7f1e1c107770 2024-08-26T00:03:38.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.178+0000 7f1e21c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1c1119f0 con 0x7f1e1c101770 2024-08-26T00:03:38.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.178+0000 7f1e21c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1c111cf0 con 0x7f1e1c102110 2024-08-26T00:03:38.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.179+0000 7f1e21200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e1c107770 0x7f1e1c074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:38.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.179+0000 7f1e1be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e1c101770 0x7f1e1c074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:38.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.179+0000 7f1e13e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e1c102110 0x7f1e1c0747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:38.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.179+0000 7f1e13e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e1c102110 0x7f1e1c0747d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:52256/0 (socket says 172.21.15.42:52256) 2024-08-26T00:03:38.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.179+0000 7f1e1be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e1c101770 0x7f1e1c074290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45202/0 (socket says 172.21.15.42:45202) 2024-08-26T00:03:38.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.179+0000 7f1e13e00640 1 -- 172.21.15.42:0/4222248922 learned_addr learned my addr 172.21.15.42:0/4222248922 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:38.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.179+0000 7f1e13e00640 1 -- 172.21.15.42:0/4222248922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e1c101770 msgr2=0x7f1e1c074290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:38.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.179+0000 7f1e13e00640 1 --2- 172.21.15.42:0/4222248922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e1c101770 0x7f1e1c074290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.179+0000 7f1e13e00640 1 -- 172.21.15.42:0/4222248922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e1c107770 msgr2=0x7f1e1c074d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:38.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.179+0000 7f1e13e00640 1 --2- 172.21.15.42:0/4222248922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e1c107770 0x7f1e1c074d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.179+0000 7f1e13e00640 1 -- 172.21.15.42:0/4222248922 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e1c1a6590 con 0x7f1e1c102110 2024-08-26T00:03:38.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.180+0000 7f1e13e00640 1 --2- 172.21.15.42:0/4222248922 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e1c102110 0x7f1e1c0747d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1e04009230 tx=0x7f1e04004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:38.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.180+0000 7f1e19600640 1 -- 172.21.15.42:0/4222248922 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0403f030 con 0x7f1e1c102110 2024-08-26T00:03:38.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.180+0000 7f1e19600640 1 -- 172.21.15.42:0/4222248922 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e04004440 con 0x7f1e1c102110 2024-08-26T00:03:38.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.180+0000 7f1e21c00640 1 -- 172.21.15.42:0/4222248922 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e1c1a6820 con 0x7f1e1c102110 2024-08-26T00:03:38.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.180+0000 7f1e21c00640 1 -- 172.21.15.42:0/4222248922 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e1c1a6d50 con 0x7f1e1c102110 2024-08-26T00:03:38.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.180+0000 7f1e19600640 1 -- 172.21.15.42:0/4222248922 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e04035070 con 0x7f1e1c102110 2024-08-26T00:03:38.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.183+0000 7f1e19600640 1 -- 172.21.15.42:0/4222248922 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1e04042030 con 0x7f1e1c102110 2024-08-26T00:03:38.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.183+0000 7f1e25dd1740 1 Processor -- start 2024-08-26T00:03:38.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.184+0000 7f1e25dd1740 1 -- start start 2024-08-26T00:03:38.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.184+0000 7f1e25dd1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5586b5ba2b40 0x5586b5ba2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:38.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.184+0000 7f1e25dd1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586b5ba3460 0x5586b5bad7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:38.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.184+0000 7f1e25dd1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5badd20 0x5586b5bb0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:38.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.184+0000 7f1e25dd1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5586b5b08fc0 con 0x5586b5badd20 2024-08-26T00:03:38.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.184+0000 7f1e25dd1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5586b5aa0680 con 0x5586b5ba3460 2024-08-26T00:03:38.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.184+0000 7f1e25dd1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5586b5b04f80 con 0x5586b5ba2b40 2024-08-26T00:03:38.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.184+0000 7f1e1be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586b5ba3460 0x5586b5bad7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:38.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.184+0000 7f1e21200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5586b5ba2b40 0x5586b5ba2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:38.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.184+0000 7f1e1be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586b5ba3460 0x5586b5bad7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45208/0 (socket says 172.21.15.42:45208) 2024-08-26T00:03:38.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.184+0000 7f1e13e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5badd20 0x5586b5bb0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:38.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.184+0000 7f1e1be00640 1 -- 172.21.15.42:0/2572882037 learned_addr learned my addr 172.21.15.42:0/2572882037 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:38.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.185+0000 7f1e1be00640 1 -- 172.21.15.42:0/2572882037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5586b5ba2b40 msgr2=0x5586b5ba2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:38.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.185+0000 7f1e1be00640 1 --2- 172.21.15.42:0/2572882037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5586b5ba2b40 0x5586b5ba2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.185+0000 7f1e1be00640 1 -- 172.21.15.42:0/2572882037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5badd20 msgr2=0x5586b5bb0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:38.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.185+0000 7f1e1be00640 1 --2- 172.21.15.42:0/2572882037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5badd20 0x5586b5bb0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.185+0000 7f1e1be00640 1 -- 172.21.15.42:0/2572882037 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586b5abc2c0 con 0x5586b5ba3460 2024-08-26T00:03:38.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.185+0000 7f1e13e00640 1 --2- 172.21.15.42:0/2572882037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5badd20 0x5586b5bb0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:03:38.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.185+0000 7f1e1be00640 1 --2- 172.21.15.42:0/2572882037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586b5ba3460 0x5586b5bad7e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c009ca0 tx=0x7f1e0c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4247128b870a0968 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:38.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.185+0000 7f1e19600640 1 --2- 172.21.15.42:0/4222248922 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1e000a2c00 0x7f1e000a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:38.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.185+0000 7f1e11600640 1 -- 172.21.15.42:0/2572882037 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c01e070 con 0x5586b5ba3460 2024-08-26T00:03:38.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.185+0000 7f1e11600640 1 -- 172.21.15.42:0/2572882037 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e0c019b10 con 0x5586b5ba3460 2024-08-26T00:03:38.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.185+0000 7f1e19600640 1 -- 172.21.15.42:0/4222248922 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f1e040ef2d0 con 0x7f1e1c102110 2024-08-26T00:03:38.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.185+0000 7f1e11600640 1 -- 172.21.15.42:0/2572882037 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c00eae0 con 0x5586b5ba3460 2024-08-26T00:03:38.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.186+0000 7f1e21200640 1 --2- 172.21.15.42:0/4222248922 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1e000a2c00 0x7f1e000a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:38.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.186+0000 7f1e25dd1740 1 -- 172.21.15.42:0/2572882037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586b5ba3460 msgr2=0x5586b5bad7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:38.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.186+0000 7f1e25dd1740 1 --2- 172.21.15.42:0/2572882037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586b5ba3460 0x5586b5bad7e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c009ca0 tx=0x7f1e0c011810 comp rx=0 tx=0).stop 2024-08-26T00:03:38.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.186+0000 7f1e21200640 1 --2- 172.21.15.42:0/4222248922 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1e000a2c00 0x7f1e000a50c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1e14005fd0 tx=0x7f1e14009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:38.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.186+0000 7f1e25dd1740 1 -- 172.21.15.42:0/2572882037 shutdown_connections 2024-08-26T00:03:38.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.187+0000 7f1e25dd1740 1 --2- 172.21.15.42:0/2572882037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5badd20 0x5586b5bb0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.187+0000 7f1e25dd1740 1 --2- 172.21.15.42:0/2572882037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586b5ba3460 0x5586b5bad7e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.187+0000 7f1e25dd1740 1 --2- 172.21.15.42:0/2572882037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5586b5ba2b40 0x5586b5ba2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.187+0000 7f1e25dd1740 1 -- 172.21.15.42:0/2572882037 >> 172.21.15.42:0/2572882037 conn(0x5586b5b9f080 msgr2=0x5586b5b9f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:38.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.187+0000 7f1e25dd1740 1 -- 172.21.15.42:0/2572882037 shutdown_connections 2024-08-26T00:03:38.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.187+0000 7f1e25dd1740 1 -- 172.21.15.42:0/2572882037 wait complete. 2024-08-26T00:03:38.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.187+0000 7f1e25dd1740 1 -- start start 2024-08-26T00:03:38.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.187+0000 7f1e25dd1740 1 Processor -- start 2024-08-26T00:03:38.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.188+0000 7f1e25dd1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5ba2b40 0x5586b5baac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:38.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.188+0000 7f1e25dd1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5586b5ba3460 0x5586b5bab160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:38.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.188+0000 7f1e25dd1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586b5badd20 0x5586b5bab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:38.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.188+0000 7f1e25dd1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5586b5bb08f0 con 0x5586b5ba2b40 2024-08-26T00:03:38.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.188+0000 7f1e25dd1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5586b5ac3e50 con 0x5586b5badd20 2024-08-26T00:03:38.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.188+0000 7f1e25dd1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5586b5bb0a70 con 0x5586b5ba3460 2024-08-26T00:03:38.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.188+0000 7f1e25dd1740 10 client.0 _ll_register_callbacks cb 0x5586b5aaef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:03:38.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.188+0000 7f1e1be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5ba2b40 0x5586b5baac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:38.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.188+0000 7f1e1be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5ba2b40 0x5586b5baac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54756/0 (socket says 172.21.15.42:54756) 2024-08-26T00:03:38.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.188+0000 7f1e21200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586b5badd20 0x5586b5bab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:38.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.188+0000 7f1e1be00640 1 -- 172.21.15.42:0/2106993229 learned_addr learned my addr 172.21.15.42:0/2106993229 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:38.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.188+0000 7f1e13e00640 1 --2- 172.21.15.42:0/2106993229 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5586b5ba3460 0x5586b5bab160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:38.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.189+0000 7f1e1be00640 1 -- 172.21.15.42:0/2106993229 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5586b5ba3460 msgr2=0x5586b5bab160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:38.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.189+0000 7f1e1be00640 1 --2- 172.21.15.42:0/2106993229 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5586b5ba3460 0x5586b5bab160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.189+0000 7f1e1be00640 1 -- 172.21.15.42:0/2106993229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586b5badd20 msgr2=0x5586b5bab6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:38.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.189+0000 7f1e1be00640 1 --2- 172.21.15.42:0/2106993229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586b5badd20 0x5586b5bab6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.189+0000 7f1e1be00640 1 -- 172.21.15.42:0/2106993229 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586b587a3c0 con 0x5586b5ba2b40 2024-08-26T00:03:38.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.189+0000 7f1e1be00640 1 --2- 172.21.15.42:0/2106993229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5ba2b40 0x5586b5baac20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c009c70 tx=0x7f1e0c019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10bd3aafabbb180d server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:38.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.189+0000 7f1e0a000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:03:38.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.189+0000 7f1e0a000640 1 -- 172.21.15.42:0/2106993229 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c01e070 con 0x5586b5ba2b40 2024-08-26T00:03:38.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.189+0000 7f1e0a000640 1 -- 172.21.15.42:0/2106993229 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f1e0c004020 con 0x5586b5ba2b40 2024-08-26T00:03:38.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.189+0000 7f1e25dd1740 1 -- 172.21.15.42:0/2106993229 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e0c019b10 con 0x5586b5ba2b40 2024-08-26T00:03:38.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.190+0000 7f1e0a000640 1 -- 172.21.15.42:0/2106993229 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1e0c00e3b0 con 0x5586b5ba2b40 2024-08-26T00:03:38.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.190+0000 7f1e25dd1740 10 client.15318 fetch_fsmap learned FSMap version 24 2024-08-26T00:03:38.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.190+0000 7f1e25dd1740 1 -- 172.21.15.42:0/2106993229 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5586b5bbc5b0 con 0x5586b5ba2b40 2024-08-26T00:03:38.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.190+0000 7f1e0a000640 1 -- 172.21.15.42:0/2106993229 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e0c019b10 con 0x5586b5ba2b40 2024-08-26T00:03:38.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.190+0000 7f1e0a000640 1 -- 172.21.15.42:0/2106993229 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1e0c02c020 con 0x5586b5ba2b40 2024-08-26T00:03:38.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.190+0000 7f1e25dd1740 10 client.15318 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:03:38.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.190+0000 7f1e25dd1740 10 client.15318 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:03:38.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.190+0000 7f1e25dd1740 20 client.15318 populate_metadata read hostname 'smithi042' 2024-08-26T00:03:38.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.190+0000 7f1e25dd1740 1 --2- 172.21.15.42:0/2106993229 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5586b5bbda10 0x5586b5bbfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:38.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.191+0000 7f1e25dd1740 4 client.15318 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:03:38.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.191+0000 7f1e25dd1740 1 -- 172.21.15.42:0/2106993229 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586b5b16530 con 0x5586b5bbda10 2024-08-26T00:03:38.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.191+0000 7f1e13e00640 1 --2- 172.21.15.42:0/2106993229 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5586b5bbda10 0x5586b5bbfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:38.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.191+0000 7f1e13e00640 1 --2- 172.21.15.42:0/2106993229 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5586b5bbda10 0x5586b5bbfe00 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0e0a866572087e0 server_cookie=847b2ac7d280c79a in_seq=0 out_seq=0 2024-08-26T00:03:38.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.191+0000 7f1e0a000640 10 client.15318 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:38.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.192+0000 7f1e0a000640 1 -- 172.21.15.42:0/2106993229 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5586b5b16530 con 0x5586b5bbda10 2024-08-26T00:03:38.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.192+0000 7f1e0a000640 10 client.15318 handle_command_reply: tid=0 2024-08-26T00:03:38.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.192+0000 7f1e25dd1740 1 client.15318 shutdown 2024-08-26T00:03:38.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.193+0000 7f1e25dd1740 1 -- 172.21.15.42:0/2106993229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5ba2b40 msgr2=0x5586b5baac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:38.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.193+0000 7f1e25dd1740 1 --2- 172.21.15.42:0/2106993229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5ba2b40 0x5586b5baac20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c009c70 tx=0x7f1e0c019660 comp rx=0 tx=0).stop 2024-08-26T00:03:38.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.193+0000 7f1e25dd1740 1 -- 172.21.15.42:0/2106993229 shutdown_connections 2024-08-26T00:03:38.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.193+0000 7f1e25dd1740 1 --2- 172.21.15.42:0/2106993229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586b5badd20 0x5586b5bab6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.193+0000 7f1e25dd1740 1 --2- 172.21.15.42:0/2106993229 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5586b5ba3460 0x5586b5bab160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.193+0000 7f1e25dd1740 1 --2- 172.21.15.42:0/2106993229 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5586b5bbda10 0x5586b5bbfe00 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.193+0000 7f1e25dd1740 1 --2- 172.21.15.42:0/2106993229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5ba2b40 0x5586b5baac20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.193+0000 7f1e25dd1740 1 -- 172.21.15.42:0/2106993229 >> 172.21.15.42:0/2106993229 conn(0x5586b5b9f080 msgr2=0x5586b5b9e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:38.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.193+0000 7f1e0a000640 0 client.15318 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:38.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.193+0000 7f1e25dd1740 1 -- 172.21.15.42:0/2106993229 shutdown_connections 2024-08-26T00:03:38.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.193+0000 7f1e25dd1740 1 -- 172.21.15.42:0/2106993229 wait complete. 2024-08-26T00:03:38.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.193+0000 7f1e25dd1740 20 client.15318 trim_cache size 0 max 16384 2024-08-26T00:03:38.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.227+0000 7f1e25dd1740 1 Processor -- start 2024-08-26T00:03:38.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.227+0000 7f1e25dd1740 1 -- start start 2024-08-26T00:03:38.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.227+0000 7f1e25dd1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586b5ba2b40 0x5586b5ba55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:38.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.227+0000 7f1e25dd1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5586b5ba3460 0x5586b5bc5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:38.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.227+0000 7f1e25dd1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5badd20 0x5586b5bc5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:38.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.227+0000 7f1e25dd1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1c1b1ca0 con 0x5586b5badd20 2024-08-26T00:03:38.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.227+0000 7f1e25dd1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1c1af570 con 0x5586b5ba2b40 2024-08-26T00:03:38.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.227+0000 7f1e25dd1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1c1ad3a0 con 0x5586b5ba3460 2024-08-26T00:03:38.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.228+0000 7f1e13e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5586b5ba3460 0x5586b5bc5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:38.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.228+0000 7f1e13e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5586b5ba3460 0x5586b5bc5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:52272/0 (socket says 172.21.15.42:52272) 2024-08-26T00:03:38.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.228+0000 7f1e13e00640 1 -- 172.21.15.42:0/322311069 learned_addr learned my addr 172.21.15.42:0/322311069 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:38.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.228+0000 7f1e21200640 1 --2- 172.21.15.42:0/322311069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5badd20 0x5586b5bc5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:38.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.228+0000 7f1e1be00640 1 --2- 172.21.15.42:0/322311069 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586b5ba2b40 0x5586b5ba55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:38.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.228+0000 7f1e1be00640 1 -- 172.21.15.42:0/322311069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5586b5ba3460 msgr2=0x5586b5bc5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:38.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.228+0000 7f1e1be00640 1 --2- 172.21.15.42:0/322311069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5586b5ba3460 0x5586b5bc5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.228+0000 7f1e1be00640 1 -- 172.21.15.42:0/322311069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5badd20 msgr2=0x5586b5bc5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:38.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.228+0000 7f1e1be00640 1 --2- 172.21.15.42:0/322311069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5badd20 0x5586b5bc5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.228+0000 7f1e1be00640 1 -- 172.21.15.42:0/322311069 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586b5ba0260 con 0x5586b5ba2b40 2024-08-26T00:03:38.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.228+0000 7f1e13e00640 1 --2- 172.21.15.42:0/322311069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5586b5ba3460 0x5586b5bc5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:03:38.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.228+0000 7f1e1be00640 1 --2- 172.21.15.42:0/322311069 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586b5ba2b40 0x5586b5ba55a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00e570 tx=0x7f1e0c009990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b9a03d0ca796b61 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:38.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.229+0000 7f1e10c00640 1 -- 172.21.15.42:0/322311069 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c01e070 con 0x5586b5ba2b40 2024-08-26T00:03:38.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.229+0000 7f1e10c00640 1 -- 172.21.15.42:0/322311069 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e0c01f040 con 0x5586b5ba2b40 2024-08-26T00:03:38.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.229+0000 7f1e10c00640 1 -- 172.21.15.42:0/322311069 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c0053e0 con 0x5586b5ba2b40 2024-08-26T00:03:38.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.230+0000 7f1e25dd1740 1 -- 172.21.15.42:0/322311069 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586b5ba2b40 msgr2=0x5586b5ba55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:38.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.230+0000 7f1e25dd1740 1 --2- 172.21.15.42:0/322311069 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586b5ba2b40 0x5586b5ba55a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00e570 tx=0x7f1e0c009990 comp rx=0 tx=0).stop 2024-08-26T00:03:38.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.230+0000 7f1e25dd1740 1 -- 172.21.15.42:0/322311069 shutdown_connections 2024-08-26T00:03:38.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.230+0000 7f1e25dd1740 1 --2- 172.21.15.42:0/322311069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5badd20 0x5586b5bc5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.230+0000 7f1e25dd1740 1 --2- 172.21.15.42:0/322311069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5586b5ba3460 0x5586b5bc5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.230+0000 7f1e25dd1740 1 --2- 172.21.15.42:0/322311069 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586b5ba2b40 0x5586b5ba55a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.230+0000 7f1e25dd1740 1 -- 172.21.15.42:0/322311069 >> 172.21.15.42:0/322311069 conn(0x5586b5b9f080 msgr2=0x5586b5ba9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:38.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.230+0000 7f1e25dd1740 1 -- 172.21.15.42:0/322311069 shutdown_connections 2024-08-26T00:03:38.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.230+0000 7f1e25dd1740 1 -- 172.21.15.42:0/322311069 wait complete. 2024-08-26T00:03:38.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.230+0000 7f1e25dd1740 1 -- start start 2024-08-26T00:03:38.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.230+0000 7f1e25dd1740 1 Processor -- start 2024-08-26T00:03:38.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.231+0000 7f1e25dd1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5ba2b40 0x5586b5bb1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:38.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.231+0000 7f1e25dd1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5586b5ba3460 0x5586b5bb17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.231+0000 7f1e25dd1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586b5badd20 0x5586b5c26530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.231+0000 7f1e25dd1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1c1ada30 con 0x5586b5ba2b40 2024-08-26T00:03:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.231+0000 7f1e25dd1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1c1aeea0 con 0x5586b5badd20 2024-08-26T00:03:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.231+0000 7f1e25dd1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1c1ae100 con 0x5586b5ba3460 2024-08-26T00:03:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.231+0000 7f1e25dd1740 10 client.0 _ll_register_callbacks cb 0x7f1e0c01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:03:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.231+0000 7f1e1be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5ba2b40 0x5586b5bb1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.231+0000 7f1e1be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5ba2b40 0x5586b5bb1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54780/0 (socket says 172.21.15.42:54780) 2024-08-26T00:03:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.231+0000 7f1e13e00640 1 --2- 172.21.15.42:0/1054029399 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5586b5ba3460 0x5586b5bb17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.231+0000 7f1e1be00640 1 -- 172.21.15.42:0/1054029399 learned_addr learned my addr 172.21.15.42:0/1054029399 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:03:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.231+0000 7f1e21200640 1 --2- 172.21.15.42:0/1054029399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586b5badd20 0x5586b5c26530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:38.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.232+0000 7f1e13e00640 1 -- 172.21.15.42:0/1054029399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586b5badd20 msgr2=0x5586b5c26530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.232+0000 7f1e13e00640 1 --2- 172.21.15.42:0/1054029399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586b5badd20 0x5586b5c26530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.232+0000 7f1e13e00640 1 -- 172.21.15.42:0/1054029399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5ba2b40 msgr2=0x5586b5bb1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:03:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.232+0000 7f1e13e00640 1 --2- 172.21.15.42:0/1054029399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5ba2b40 0x5586b5bb1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.232+0000 7f1e13e00640 1 -- 172.21.15.42:0/1054029399 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586b5c26a70 con 0x5586b5ba3460 2024-08-26T00:03:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.232+0000 7f1e1be00640 1 --2- 172.21.15.42:0/1054029399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5ba2b40 0x5586b5bb1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:03:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.232+0000 7f1e13e00640 1 --2- 172.21.15.42:0/1054029399 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5586b5ba3460 0x5586b5bb17b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1e040b84c0 tx=0x7f1e0403b460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b02057fd7677af3 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:03:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.232+0000 7f1e0a000640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:03:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.232+0000 7f1e0a000640 1 -- 172.21.15.42:0/1054029399 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e04049040 con 0x5586b5ba3460 2024-08-26T00:03:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.233+0000 7f1e0a000640 1 -- 172.21.15.42:0/1054029399 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f1e040b8160 con 0x5586b5ba3460 2024-08-26T00:03:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.233+0000 7f1e25dd1740 1 -- 172.21.15.42:0/1054029399 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e0c01f040 con 0x5586b5ba3460 2024-08-26T00:03:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.233+0000 7f1e0a000640 1 -- 172.21.15.42:0/1054029399 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1e040d9050 con 0x5586b5ba3460 2024-08-26T00:03:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.233+0000 7f1e25dd1740 10 client.25342 fetch_fsmap learned FSMap version 24 2024-08-26T00:03:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.233+0000 7f1e25dd1740 1 -- 172.21.15.42:0/1054029399 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5586b5c27d80 con 0x5586b5ba3460 2024-08-26T00:03:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.233+0000 7f1e0a000640 1 -- 172.21.15.42:0/1054029399 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e0c01f040 con 0x5586b5ba3460 2024-08-26T00:03:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.233+0000 7f1e0a000640 1 -- 172.21.15.42:0/1054029399 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1e040c42d0 con 0x5586b5ba3460 2024-08-26T00:03:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.233+0000 7f1e25dd1740 10 client.25342 fetch_fsmap finished waiting for FSMap version 24 2024-08-26T00:03:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.233+0000 7f1e25dd1740 10 client.25342 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:03:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.233+0000 7f1e25dd1740 20 client.25342 populate_metadata read hostname 'smithi042' 2024-08-26T00:03:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.233+0000 7f1e25dd1740 1 --2- 172.21.15.42:0/1054029399 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5586b5c28510 0x5586b5c2a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:03:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.234+0000 7f1e25dd1740 4 client.25342 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-26T00:03:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.234+0000 7f1e25dd1740 1 -- 172.21.15.42:0/1054029399 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5586b5b10a40 con 0x5586b5c28510 2024-08-26T00:03:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.234+0000 7f1e1be00640 1 --2- 172.21.15.42:0/1054029399 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5586b5c28510 0x5586b5c2a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:03:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.234+0000 7f1e1be00640 1 --2- 172.21.15.42:0/1054029399 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5586b5c28510 0x5586b5c2a930 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e878de5f0cc79ec server_cookie=e85f25225b84e251 in_seq=0 out_seq=0 2024-08-26T00:03:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.234+0000 7f1e0a000640 10 client.25342 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.235+0000 7f1e0a000640 1 -- 172.21.15.42:0/1054029399 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5586b5b10a40 con 0x5586b5c28510 2024-08-26T00:03:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.235+0000 7f1e0a000640 10 client.25342 handle_command_reply: tid=0 2024-08-26T00:03:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.235+0000 7f1e25dd1740 1 client.25342 shutdown 2024-08-26T00:03:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.235+0000 7f1e25dd1740 1 -- 172.21.15.42:0/1054029399 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5586b5ba3460 msgr2=0x5586b5bb17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.235+0000 7f1e25dd1740 1 --2- 172.21.15.42:0/1054029399 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5586b5ba3460 0x5586b5bb17b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1e040b84c0 tx=0x7f1e0403b460 comp rx=0 tx=0).stop 2024-08-26T00:03:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.235+0000 7f1e25dd1740 1 -- 172.21.15.42:0/1054029399 shutdown_connections 2024-08-26T00:03:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.235+0000 7f1e25dd1740 1 --2- 172.21.15.42:0/1054029399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5586b5badd20 0x5586b5c26530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.235+0000 7f1e25dd1740 1 --2- 172.21.15.42:0/1054029399 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5586b5ba3460 0x5586b5bb17b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.235+0000 7f1e25dd1740 1 --2- 172.21.15.42:0/1054029399 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5586b5c28510 0x5586b5c2a930 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.235+0000 7f1e25dd1740 1 --2- 172.21.15.42:0/1054029399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5586b5ba2b40 0x5586b5bb1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.235+0000 7f1e0a000640 0 client.25342 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:03:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.235+0000 7f1e25dd1740 1 -- 172.21.15.42:0/1054029399 >> 172.21.15.42:0/1054029399 conn(0x5586b5b9f080 msgr2=0x5586b5b9da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.235+0000 7f1e25dd1740 1 -- 172.21.15.42:0/1054029399 shutdown_connections 2024-08-26T00:03:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.235+0000 7f1e25dd1740 1 -- 172.21.15.42:0/1054029399 wait complete. 2024-08-26T00:03:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.236+0000 7f1e25dd1740 20 client.25342 trim_cache size 0 max 16384 2024-08-26T00:03:38.259 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:03:38.259 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-26T00:03:38.259 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-08-26T00:03:38.259 INFO:teuthology.orchestra.run.smithi042.stdout: "23542b18-9e56-4347-9d61-a90bed4a6579": { 2024-08-26T00:03:38.259 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-08-26T00:03:38.259 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "23542b18-9e56-4347-9d61-a90bed4a6579", 2024-08-26T00:03:38.259 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,force" 2024-08-26T00:03:38.259 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:03:38.259 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:03:38.260 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:03:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.236+0000 7f1e21c00640 1 -- 172.21.15.42:0/4222248922 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1e000a2c00 msgr2=0x7f1e000a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.236+0000 7f1e21c00640 1 --2- 172.21.15.42:0/4222248922 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1e000a2c00 0x7f1e000a50c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1e14005fd0 tx=0x7f1e14009500 comp rx=0 tx=0).stop 2024-08-26T00:03:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.236+0000 7f1e21c00640 1 -- 172.21.15.42:0/4222248922 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e1c102110 msgr2=0x7f1e1c0747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:03:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.236+0000 7f1e21c00640 1 --2- 172.21.15.42:0/4222248922 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e1c102110 0x7f1e1c0747d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1e04009230 tx=0x7f1e04004040 comp rx=0 tx=0).stop 2024-08-26T00:03:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.236+0000 7f1e21c00640 1 -- 172.21.15.42:0/4222248922 shutdown_connections 2024-08-26T00:03:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.236+0000 7f1e21c00640 1 --2- 172.21.15.42:0/4222248922 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1e000a2c00 0x7f1e000a50c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.236+0000 7f1e21c00640 1 --2- 172.21.15.42:0/4222248922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e1c107770 0x7f1e1c074d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.236+0000 7f1e21c00640 1 --2- 172.21.15.42:0/4222248922 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e1c102110 0x7f1e1c0747d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.236+0000 7f1e21c00640 1 --2- 172.21.15.42:0/4222248922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e1c101770 0x7f1e1c074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:03:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.236+0000 7f1e21c00640 1 -- 172.21.15.42:0/4222248922 >> 172.21.15.42:0/4222248922 conn(0x7f1e1c0fd4b0 msgr2=0x7f1e1c0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:03:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.237+0000 7f1e21c00640 1 -- 172.21.15.42:0/4222248922 shutdown_connections 2024-08-26T00:03:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:03:38.237+0000 7f1e21c00640 1 -- 172.21.15.42:0/4222248922 wait complete. 2024-08-26T00:03:38.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:38 smithi043 ceph-mon[22091]: pgmap v372: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-26T00:03:38.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:38 smithi042 ceph-mon[17225]: pgmap v372: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-26T00:03:38.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:38 smithi181 ceph-mon[22102]: pgmap v372: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-26T00:03:39.343 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:39 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:03:39.345 INFO:tasks.cephfs.filesystem:scrub status for tag:23542b18-9e56-4347-9d61-a90bed4a6579 - {'path': '/', 'tag': '23542b18-9e56-4347-9d61-a90bed4a6579', 'options': 'recursive,force'} 2024-08-26T00:03:39.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:39 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:03:39.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:39 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:03:40.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:40 smithi043 ceph-mon[22091]: pgmap v373: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-08-26T00:03:40.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:40 smithi042 ceph-mon[17225]: pgmap v373: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-08-26T00:03:40.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:40 smithi181 ceph-mon[22102]: pgmap v373: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-08-26T00:03:42.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:42 smithi043 ceph-mon[22091]: pgmap v374: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-26T00:03:42.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:42 smithi042 ceph-mon[17225]: pgmap v374: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-26T00:03:42.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:42 smithi181 ceph-mon[22102]: pgmap v374: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-26T00:03:44.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:44 smithi043 ceph-mon[22091]: pgmap v375: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-08-26T00:03:44.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:44 smithi042 ceph-mon[17225]: pgmap v375: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-08-26T00:03:44.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:44 smithi181 ceph-mon[22102]: pgmap v375: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-08-26T00:03:45.415 INFO:tasks.workunit.client.0.smithi042.stderr:Updating files: 62% (8089/12879) Updating files: 63% (8114/12879) Updating files: 64% (8243/12879) Updating files: 65% (8372/12879) Updating files: 66% (8501/12879) Updating files: 67% (8629/12879) Updating files: 68% (8758/12879) Updating files: 69% (8887/12879) Updating files: 70% (9016/12879) Updating files: 71% (9145/12879) Updating files: 72% (9273/12879) Updating files: 73% (9402/12879) Updating files: 74% (9531/12879) Updating files: 75% (9660/12879) Updating files: 76% (9789/12879) Updating files: 77% (9917/12879) Updating files: 78% (10046/12879) Updating files: 79% (10175/12879) Updating files: 80% (10304/12879) Updating files: 81% (10432/12879) Updating files: 82% (10561/12879) Updating files: 83% (10690/12879) Updating files: 84% (10819/12879) Updating files: 85% (10948/12879) Updating files: 86% (11076/12879) Updating files: 87% (11205/12879) Updating files: 88% (11334/12879) Updating files: 89% (11463/12879) Updating files: 90% (11592/12879) Updating files: 91% (11720/12879) Updating files: 92% (11849/12879) Updating files: 93% (11978/12879) Updating files: 94% (12107/12879) Updating files: 95% (12236/12879) Updating files: 96% (12364/12879) Updating files: 97% (12493/12879) Updating files: 97% (12600/12879) Updating files: 98% (12622/12879) Updating files: 99% (12751/12879) Updating files: 100% (12879/12879) Updating files: 100% (12879/12879), done. 2024-08-26T00:03:45.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:45 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:03:45.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:45 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:03:45.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:45 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:03:45.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:45 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:03:45.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:45 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:03:45.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:45 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:03:45.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:45 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:03:45.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:45 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:03:45.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:45 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:03:46.324 INFO:tasks.workunit.client.0.smithi042.stderr:Note: switching to 'f273685f88d22802ccbd8a96b393734630028a13'. 2024-08-26T00:03:46.325 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-08-26T00:03:46.325 INFO:tasks.workunit.client.0.smithi042.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-26T00:03:46.325 INFO:tasks.workunit.client.0.smithi042.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-26T00:03:46.325 INFO:tasks.workunit.client.0.smithi042.stderr:state without impacting any branches by switching back to a branch. 2024-08-26T00:03:46.325 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-08-26T00:03:46.325 INFO:tasks.workunit.client.0.smithi042.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-26T00:03:46.325 INFO:tasks.workunit.client.0.smithi042.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-26T00:03:46.325 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-08-26T00:03:46.325 INFO:tasks.workunit.client.0.smithi042.stderr: git switch -c 2024-08-26T00:03:46.325 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-08-26T00:03:46.325 INFO:tasks.workunit.client.0.smithi042.stderr:Or undo this operation with: 2024-08-26T00:03:46.325 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-08-26T00:03:46.326 INFO:tasks.workunit.client.0.smithi042.stderr: git switch - 2024-08-26T00:03:46.326 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-08-26T00:03:46.326 INFO:tasks.workunit.client.0.smithi042.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-26T00:03:46.326 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-08-26T00:03:46.326 INFO:tasks.workunit.client.0.smithi042.stderr:HEAD is now at f273685f88d Merge pull request #59106 from aclamk/wip-67454-squid 2024-08-26T00:03:46.341 DEBUG:teuthology.orchestra.run.smithi042:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-26T00:03:46.386 INFO:tasks.workunit.client.0.smithi042.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-26T00:03:46.391 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-26T00:03:46.391 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-26T00:03:46.411 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:46 smithi043 ceph-mon[22091]: pgmap v376: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-26T00:03:46.412 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:46 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:03:46.412 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:46 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:03:46.412 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:46 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:03:46.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:46 smithi042 ceph-mon[17225]: pgmap v376: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-26T00:03:46.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:46 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:03:46.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:46 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:03:46.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:46 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:03:46.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:46 smithi181 ceph-mon[22102]: pgmap v376: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-26T00:03:46.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:46 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:03:46.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:46 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:03:46.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:46 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:03:47.069 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-26T00:03:47.162 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-26T00:03:47.228 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-26T00:03:47.232 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-26T00:03:47.232 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-26T00:03:47.297 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-26T00:03:47.304 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-26T00:03:47.304 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-26T00:03:47.381 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2024-08-26T00:03:47.382 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2024-08-26T00:03:47.382 DEBUG:teuthology.orchestra.run.smithi042:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f273685f88d22802ccbd8a96b393734630028a13 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-08-26T00:03:47.470 INFO:tasks.workunit.client.0.smithi042.stdout:getting blogbench 2024-08-26T00:03:47.470 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'getting blogbench' 2024-08-26T00:03:47.470 INFO:tasks.workunit.client.0.smithi042.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-08-26T00:03:47.508 INFO:tasks.workunit.client.0.smithi042.stderr:--2024-08-26 00:03:47-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-08-26T00:03:47.509 INFO:tasks.workunit.client.0.smithi042.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-08-26T00:03:47.572 INFO:tasks.workunit.client.0.smithi042.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-08-26T00:03:47.610 INFO:tasks.workunit.client.0.smithi042.stderr:HTTP request sent, awaiting response... 200 OK 2024-08-26T00:03:47.610 INFO:tasks.workunit.client.0.smithi042.stderr:Length: 103355 (101K) [application/octet-stream] 2024-08-26T00:03:47.611 INFO:tasks.workunit.client.0.smithi042.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2024-08-26T00:03:47.615 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-08-26T00:03:47.675 INFO:tasks.workunit.client.0.smithi042.stderr: 0K .......... .......... .......... .......... .......... 49% 787K 0s 2024-08-26T00:03:47.716 INFO:tasks.workunit.client.0.smithi042.stderr: 50K .......... .......... .......... .......... .......... 99% 1.20M 0s 2024-08-26T00:03:47.716 INFO:tasks.workunit.client.0.smithi042.stderr: 100K 100% 1.74T=0.1s 2024-08-26T00:03:47.716 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-08-26T00:03:47.717 INFO:tasks.workunit.client.0.smithi042.stderr:2024-08-26 00:03:47 (968 KB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2024-08-26T00:03:47.717 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-08-26T00:03:47.717 INFO:tasks.workunit.client.0.smithi042.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2024-08-26T00:03:47.761 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/ 2024-08-26T00:03:47.761 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/m4/ 2024-08-26T00:03:47.762 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/m4/acx_pthread.m4 2024-08-26T00:03:47.764 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/man/ 2024-08-26T00:03:47.765 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/man/blogbench.8 2024-08-26T00:03:47.766 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/man/Makefile.am 2024-08-26T00:03:47.767 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/man/Makefile.in 2024-08-26T00:03:47.768 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/src/ 2024-08-26T00:03:47.770 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/src/mysnprintf.c 2024-08-26T00:03:47.771 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/src/mysnprintf.h 2024-08-26T00:03:47.772 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/src/blogbench.c 2024-08-26T00:03:47.773 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/src/blogbench.h 2024-08-26T00:03:47.774 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/src/fakesnprintf.c 2024-08-26T00:03:47.776 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/src/fakesnprintf.h 2024-08-26T00:03:47.777 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/src/blogbench_p.h 2024-08-26T00:03:47.778 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/src/bsd-getopt_long.c 2024-08-26T00:03:47.779 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/src/bsd-getopt_long.h 2024-08-26T00:03:47.780 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/src/Makefile.am 2024-08-26T00:03:47.782 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/src/Makefile.in 2024-08-26T00:03:47.783 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/src/process.c 2024-08-26T00:03:47.784 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/src/globals.h 2024-08-26T00:03:47.785 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/src/commenter.c 2024-08-26T00:03:47.786 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/src/rewriter.c 2024-08-26T00:03:47.788 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/src/reader.c 2024-08-26T00:03:47.789 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/src/writer.c 2024-08-26T00:03:47.790 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/src/helpers.c 2024-08-26T00:03:47.791 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/NEWS 2024-08-26T00:03:47.792 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/compile 2024-08-26T00:03:47.793 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/depcomp 2024-08-26T00:03:47.794 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/aclocal.m4 2024-08-26T00:03:47.796 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/README 2024-08-26T00:03:47.797 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/configure 2024-08-26T00:03:47.801 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/configure.ac 2024-08-26T00:03:47.802 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/config.guess 2024-08-26T00:03:47.803 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/install-sh 2024-08-26T00:03:47.804 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/config.sub 2024-08-26T00:03:47.805 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/missing 2024-08-26T00:03:47.807 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/mkinstalldirs 2024-08-26T00:03:47.811 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/Makefile.am 2024-08-26T00:03:47.811 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/Makefile.in 2024-08-26T00:03:47.811 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/config.h.in 2024-08-26T00:03:47.811 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/AUTHORS 2024-08-26T00:03:47.812 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/INSTALL 2024-08-26T00:03:47.813 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/ChangeLog 2024-08-26T00:03:47.814 INFO:tasks.workunit.client.0.smithi042.stdout:blogbench-1.0/COPYING 2024-08-26T00:03:47.816 INFO:tasks.workunit.client.0.smithi042.stderr:+ cd blogbench-1.0/ 2024-08-26T00:03:47.816 INFO:tasks.workunit.client.0.smithi042.stdout:making blogbench 2024-08-26T00:03:47.816 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'making blogbench' 2024-08-26T00:03:47.816 INFO:tasks.workunit.client.0.smithi042.stderr:+ ./configure 2024-08-26T00:03:48.029 INFO:tasks.workunit.client.0.smithi042.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-08-26T00:03:48.335 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:48 smithi181 ceph-mon[22102]: pgmap v377: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-26T00:03:48.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:48 smithi043 ceph-mon[22091]: pgmap v377: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-26T00:03:48.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:48 smithi042 ceph-mon[17225]: pgmap v377: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-26T00:03:49.042 INFO:tasks.workunit.client.0.smithi042.stdout:checking whether build environment is sane... yes 2024-08-26T00:03:49.060 INFO:tasks.workunit.client.0.smithi042.stdout:checking for gawk... gawk 2024-08-26T00:03:49.085 INFO:tasks.workunit.client.0.smithi042.stdout:checking whether make sets $(MAKE)... yes 2024-08-26T00:03:49.114 INFO:tasks.workunit.client.0.smithi042.stdout:checking for gcc... gcc 2024-08-26T00:03:49.207 INFO:tasks.workunit.client.0.smithi042.stdout:checking for C compiler default output file name... a.out 2024-08-26T00:03:49.211 INFO:tasks.workunit.client.0.smithi042.stdout:checking whether the C compiler works... yes 2024-08-26T00:03:49.215 INFO:tasks.workunit.client.0.smithi042.stdout:checking whether we are cross compiling... no 2024-08-26T00:03:49.276 INFO:tasks.workunit.client.0.smithi042.stdout:checking for suffix of executables... 2024-08-26T00:03:49.339 INFO:tasks.workunit.client.0.smithi042.stdout:checking for suffix of object files... o 2024-08-26T00:03:49.405 INFO:tasks.workunit.client.0.smithi042.stdout:checking whether we are using the GNU C compiler... yes 2024-08-26T00:03:49.470 INFO:tasks.workunit.client.0.smithi042.stdout:checking whether gcc accepts -g... yes 2024-08-26T00:03:49.565 INFO:tasks.workunit.client.0.smithi042.stdout:checking for gcc option to accept ANSI C... none needed 2024-08-26T00:03:49.634 INFO:tasks.workunit.client.0.smithi042.stdout:checking for style of include used by make... GNU 2024-08-26T00:03:49.763 INFO:tasks.workunit.client.0.smithi042.stdout:checking dependency style of gcc... gcc3 2024-08-26T00:03:49.764 INFO:tasks.workunit.client.0.smithi042.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-08-26T00:03:49.854 INFO:tasks.workunit.client.0.smithi042.stdout:checking how to run the C preprocessor... gcc -E 2024-08-26T00:03:49.931 INFO:tasks.workunit.client.0.smithi042.stdout:checking for egrep... grep -E 2024-08-26T00:03:49.951 INFO:tasks.workunit.client.0.smithi042.stdout:checking for AIX... no 2024-08-26T00:03:50.051 INFO:tasks.workunit.client.0.smithi042.stdout:checking for library containing strerror... none required 2024-08-26T00:03:50.281 INFO:tasks.workunit.client.0.smithi042.stdout:checking for ANSI C header files... yes 2024-08-26T00:03:50.357 INFO:tasks.workunit.client.0.smithi042.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-08-26T00:03:50.439 INFO:tasks.workunit.client.0.smithi042.stdout:checking for sys/types.h... yes 2024-08-26T00:03:50.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:50 smithi043 ceph-mon[22091]: pgmap v378: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-08-26T00:03:50.528 INFO:tasks.workunit.client.0.smithi042.stdout:checking for sys/stat.h... yes 2024-08-26T00:03:50.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:50 smithi042 ceph-mon[17225]: pgmap v378: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-08-26T00:03:50.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:50 smithi181 ceph-mon[22102]: pgmap v378: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-08-26T00:03:50.615 INFO:tasks.workunit.client.0.smithi042.stdout:checking for stdlib.h... yes 2024-08-26T00:03:50.703 INFO:tasks.workunit.client.0.smithi042.stdout:checking for string.h... yes 2024-08-26T00:03:50.790 INFO:tasks.workunit.client.0.smithi042.stdout:checking for memory.h... yes 2024-08-26T00:03:50.876 INFO:tasks.workunit.client.0.smithi042.stdout:checking for strings.h... yes 2024-08-26T00:03:50.967 INFO:tasks.workunit.client.0.smithi042.stdout:checking for inttypes.h... yes 2024-08-26T00:03:51.057 INFO:tasks.workunit.client.0.smithi042.stdout:checking for stdint.h... yes 2024-08-26T00:03:51.154 INFO:tasks.workunit.client.0.smithi042.stdout:checking for unistd.h... yes 2024-08-26T00:03:51.177 INFO:tasks.workunit.client.0.smithi042.stdout:checking for memory.h... (cached) yes 2024-08-26T00:03:51.191 INFO:tasks.workunit.client.0.smithi042.stdout:checking for strings.h... (cached) yes 2024-08-26T00:03:51.204 INFO:tasks.workunit.client.0.smithi042.stdout:checking for unistd.h... (cached) yes 2024-08-26T00:03:51.302 INFO:tasks.workunit.client.0.smithi042.stdout:checking locale.h usability... yes 2024-08-26T00:03:51.341 INFO:tasks.workunit.client.0.smithi042.stdout:checking locale.h presence... yes 2024-08-26T00:03:51.343 INFO:tasks.workunit.client.0.smithi042.stdout:checking for locale.h... yes 2024-08-26T00:03:51.367 INFO:tasks.workunit.client.0.smithi042.stdout:checking for stdlib.h... (cached) yes 2024-08-26T00:03:51.381 INFO:tasks.workunit.client.0.smithi042.stdout:checking for string.h... (cached) yes 2024-08-26T00:03:51.472 INFO:tasks.workunit.client.0.smithi042.stdout:checking sys/socket.h usability... yes 2024-08-26T00:03:51.512 INFO:tasks.workunit.client.0.smithi042.stdout:checking sys/socket.h presence... yes 2024-08-26T00:03:51.514 INFO:tasks.workunit.client.0.smithi042.stdout:checking for sys/socket.h... yes 2024-08-26T00:03:51.604 INFO:tasks.workunit.client.0.smithi042.stdout:checking sys/time.h usability... yes 2024-08-26T00:03:51.642 INFO:tasks.workunit.client.0.smithi042.stdout:checking sys/time.h presence... yes 2024-08-26T00:03:51.644 INFO:tasks.workunit.client.0.smithi042.stdout:checking for sys/time.h... yes 2024-08-26T00:03:51.735 INFO:tasks.workunit.client.0.smithi042.stdout:checking fcntl.h usability... yes 2024-08-26T00:03:51.772 INFO:tasks.workunit.client.0.smithi042.stdout:checking fcntl.h presence... yes 2024-08-26T00:03:51.774 INFO:tasks.workunit.client.0.smithi042.stdout:checking for fcntl.h... yes 2024-08-26T00:03:51.876 INFO:tasks.workunit.client.0.smithi042.stdout:checking sys/fcntl.h usability... yes 2024-08-26T00:03:51.913 INFO:tasks.workunit.client.0.smithi042.stdout:checking sys/fcntl.h presence... yes 2024-08-26T00:03:51.914 INFO:tasks.workunit.client.0.smithi042.stdout:checking for sys/fcntl.h... yes 2024-08-26T00:03:52.044 INFO:tasks.workunit.client.0.smithi042.stdout:checking sys/param.h usability... yes 2024-08-26T00:03:52.085 INFO:tasks.workunit.client.0.smithi042.stdout:checking sys/param.h presence... yes 2024-08-26T00:03:52.088 INFO:tasks.workunit.client.0.smithi042.stdout:checking for sys/param.h... yes 2024-08-26T00:03:52.166 INFO:tasks.workunit.client.0.smithi042.stdout:checking ioctl.h usability... no 2024-08-26T00:03:52.203 INFO:tasks.workunit.client.0.smithi042.stdout:checking ioctl.h presence... no 2024-08-26T00:03:52.205 INFO:tasks.workunit.client.0.smithi042.stdout:checking for ioctl.h... no 2024-08-26T00:03:52.291 INFO:tasks.workunit.client.0.smithi042.stdout:checking sys/ioctl.h usability... yes 2024-08-26T00:03:52.327 INFO:tasks.workunit.client.0.smithi042.stdout:checking sys/ioctl.h presence... yes 2024-08-26T00:03:52.329 INFO:tasks.workunit.client.0.smithi042.stdout:checking for sys/ioctl.h... yes 2024-08-26T00:03:52.414 INFO:tasks.workunit.client.0.smithi042.stdout:checking return type of signal handlers... void 2024-08-26T00:03:52.494 INFO:tasks.workunit.client.0.smithi042.stdout:checking for size_t... yes 2024-08-26T00:03:52.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:52 smithi043 ceph-mon[22091]: pgmap v379: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-26T00:03:52.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:52 smithi042 ceph-mon[17225]: pgmap v379: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-26T00:03:52.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:52 smithi181 ceph-mon[22102]: pgmap v379: 97 pgs: 97 active+clean; 657 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-26T00:03:52.563 INFO:tasks.workunit.client.0.smithi042.stdout:checking for dev_t... yes 2024-08-26T00:03:52.639 INFO:tasks.workunit.client.0.smithi042.stdout:checking for short... yes 2024-08-26T00:03:52.754 INFO:tasks.workunit.client.0.smithi042.stdout:checking size of short... 2 2024-08-26T00:03:52.835 INFO:tasks.workunit.client.0.smithi042.stdout:checking for int... yes 2024-08-26T00:03:52.938 INFO:tasks.workunit.client.0.smithi042.stdout:checking size of int... 4 2024-08-26T00:03:53.016 INFO:tasks.workunit.client.0.smithi042.stdout:checking for long... yes 2024-08-26T00:03:53.160 INFO:tasks.workunit.client.0.smithi042.stdout:checking size of long... 8 2024-08-26T00:03:53.238 INFO:tasks.workunit.client.0.smithi042.stdout:checking for long long... yes 2024-08-26T00:03:53.344 INFO:tasks.workunit.client.0.smithi042.stdout:checking size of long long... 8 2024-08-26T00:03:53.419 INFO:tasks.workunit.client.0.smithi042.stdout:checking for ssize_t... yes 2024-08-26T00:03:53.508 INFO:tasks.workunit.client.0.smithi042.stdout:checking for sig_atomic_t... yes 2024-08-26T00:03:53.587 INFO:tasks.workunit.client.0.smithi042.stdout:checking whether gcc needs -traditional... no 2024-08-26T00:03:53.651 INFO:tasks.workunit.client.0.smithi042.stdout:checking for an ANSI C-conforming const... yes 2024-08-26T00:03:53.700 INFO:tasks.workunit.client.0.smithi042.stdout:checking for inline... inline 2024-08-26T00:03:53.795 INFO:tasks.workunit.client.0.smithi042.stdout:checking for working alloca.h... yes 2024-08-26T00:03:53.887 INFO:tasks.workunit.client.0.smithi042.stdout:checking for alloca... yes 2024-08-26T00:03:53.986 INFO:tasks.workunit.client.0.smithi042.stdout:checking for working memcmp... yes 2024-08-26T00:03:54.081 INFO:tasks.workunit.client.0.smithi042.stdout:checking for strftime... yes 2024-08-26T00:03:54.201 INFO:tasks.workunit.client.0.smithi042.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2024-08-26T00:03:54.299 INFO:tasks.workunit.client.0.smithi042.stdout:checking whether stat accepts an empty string... no 2024-08-26T00:03:54.394 INFO:tasks.workunit.client.0.smithi042.stdout:checking for vprintf... yes 2024-08-26T00:03:54.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:54 smithi042 ceph-mon[17225]: pgmap v380: 97 pgs: 97 active+clean; 1.8 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 100 KiB/s wr, 11 op/s 2024-08-26T00:03:54.491 INFO:tasks.workunit.client.0.smithi042.stdout:checking for _doprnt... no 2024-08-26T00:03:54.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:54 smithi043 ceph-mon[22091]: pgmap v380: 97 pgs: 97 active+clean; 1.8 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 100 KiB/s wr, 11 op/s 2024-08-26T00:03:54.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:54 smithi181 ceph-mon[22102]: pgmap v380: 97 pgs: 97 active+clean; 1.8 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 100 KiB/s wr, 11 op/s 2024-08-26T00:03:54.542 INFO:tasks.workunit.client.0.smithi042.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-08-26T00:03:54.572 INFO:tasks.workunit.client.0.smithi042.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-08-26T00:03:54.663 INFO:tasks.workunit.client.0.smithi042.stdout:checking for the pthreads library -lpthreads... no 2024-08-26T00:03:54.755 INFO:tasks.workunit.client.0.smithi042.stdout:checking whether pthreads work without any flags... yes 2024-08-26T00:03:54.839 INFO:tasks.workunit.client.0.smithi042.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2024-08-26T00:03:54.840 INFO:tasks.workunit.client.0.smithi042.stdout:checking if more special flags are required for pthreads... no 2024-08-26T00:03:54.840 INFO:tasks.workunit.client.0.smithi042.stdout:checking for cc_r... gcc 2024-08-26T00:03:54.957 INFO:tasks.workunit.client.0.smithi042.stdout:checking for setrlimit... yes 2024-08-26T00:03:55.073 INFO:tasks.workunit.client.0.smithi042.stdout:checking for setproctitle... no 2024-08-26T00:03:55.174 INFO:tasks.workunit.client.0.smithi042.stdout:checking for getopt_long... yes 2024-08-26T00:03:55.281 INFO:tasks.workunit.client.0.smithi042.stdout:checking for strtoull... yes 2024-08-26T00:03:55.392 INFO:tasks.workunit.client.0.smithi042.stdout:checking for strtoq... yes 2024-08-26T00:03:55.501 INFO:tasks.workunit.client.0.smithi042.stdout:checking for snprintf... yes 2024-08-26T00:03:55.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:55 smithi043 ceph-mon[22091]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:03:55.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:55 smithi042 ceph-mon[17225]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:03:55.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:55 smithi181 ceph-mon[22102]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:03:55.608 INFO:tasks.workunit.client.0.smithi042.stdout:checking for vsnprintf... yes 2024-08-26T00:03:55.715 INFO:tasks.workunit.client.0.smithi042.stdout:checking for vfprintf... yes 2024-08-26T00:03:55.822 INFO:tasks.workunit.client.0.smithi042.stdout:checking for gethostname... yes 2024-08-26T00:03:55.927 INFO:tasks.workunit.client.0.smithi042.stdout:checking for setlocale... yes 2024-08-26T00:03:56.038 INFO:tasks.workunit.client.0.smithi042.stdout:checking for sync... yes 2024-08-26T00:03:56.148 INFO:tasks.workunit.client.0.smithi042.stdout:checking whether snprintf is C99 conformant... done 2024-08-26T00:03:56.169 INFO:tasks.workunit.client.0.smithi042.stdout:configure: creating ./config.status 2024-08-26T00:03:56.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:56 smithi042 ceph-mon[17225]: pgmap v381: 97 pgs: 97 active+clean; 1.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 113 KiB/s wr, 10 op/s 2024-08-26T00:03:56.460 INFO:tasks.workunit.client.0.smithi042.stdout:config.status: creating Makefile 2024-08-26T00:03:56.502 INFO:tasks.workunit.client.0.smithi042.stdout:config.status: creating src/Makefile 2024-08-26T00:03:56.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:56 smithi043 ceph-mon[22091]: pgmap v381: 97 pgs: 97 active+clean; 1.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 113 KiB/s wr, 10 op/s 2024-08-26T00:03:56.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:56 smithi181 ceph-mon[22102]: pgmap v381: 97 pgs: 97 active+clean; 1.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 113 KiB/s wr, 10 op/s 2024-08-26T00:03:58.227 INFO:tasks.workunit.client.0.smithi042.stdout:config.status: creating man/Makefile 2024-08-26T00:03:58.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:03:58 smithi043 ceph-mon[22091]: pgmap v382: 97 pgs: 97 active+clean; 2.0 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 131 KiB/s wr, 19 op/s 2024-08-26T00:03:58.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:03:58 smithi042 ceph-mon[17225]: pgmap v382: 97 pgs: 97 active+clean; 2.0 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 131 KiB/s wr, 19 op/s 2024-08-26T00:03:58.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:03:58 smithi181 ceph-mon[22102]: pgmap v382: 97 pgs: 97 active+clean; 2.0 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 131 KiB/s wr, 19 op/s 2024-08-26T00:04:00.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:00 smithi043 ceph-mon[22091]: pgmap v383: 97 pgs: 97 active+clean; 3.9 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 320 KiB/s wr, 42 op/s 2024-08-26T00:04:00.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:00 smithi042 ceph-mon[17225]: pgmap v383: 97 pgs: 97 active+clean; 3.9 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 320 KiB/s wr, 42 op/s 2024-08-26T00:04:00.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:00 smithi181 ceph-mon[22102]: pgmap v383: 97 pgs: 97 active+clean; 3.9 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 320 KiB/s wr, 42 op/s 2024-08-26T00:04:02.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:02 smithi043 ceph-mon[22091]: pgmap v384: 97 pgs: 97 active+clean; 4.0 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 339 KiB/s wr, 45 op/s 2024-08-26T00:04:02.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:02 smithi042 ceph-mon[17225]: pgmap v384: 97 pgs: 97 active+clean; 4.0 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 339 KiB/s wr, 45 op/s 2024-08-26T00:04:02.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:02 smithi181 ceph-mon[22102]: pgmap v384: 97 pgs: 97 active+clean; 4.0 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 339 KiB/s wr, 45 op/s 2024-08-26T00:04:03.092 INFO:tasks.workunit.client.0.smithi042.stdout:config.status: creating config.h 2024-08-26T00:04:04.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:04 smithi043 ceph-mon[22091]: pgmap v385: 97 pgs: 97 active+clean; 4.2 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 383 KiB/s wr, 58 op/s 2024-08-26T00:04:04.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:04 smithi042 ceph-mon[17225]: pgmap v385: 97 pgs: 97 active+clean; 4.2 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 383 KiB/s wr, 58 op/s 2024-08-26T00:04:04.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:04 smithi181 ceph-mon[22102]: pgmap v385: 97 pgs: 97 active+clean; 4.2 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 383 KiB/s wr, 58 op/s 2024-08-26T00:04:06.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:06 smithi043 ceph-mon[22091]: pgmap v386: 97 pgs: 97 active+clean; 4.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 285 KiB/s wr, 54 op/s 2024-08-26T00:04:06.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:06 smithi042 ceph-mon[17225]: pgmap v386: 97 pgs: 97 active+clean; 4.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 285 KiB/s wr, 54 op/s 2024-08-26T00:04:06.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:06 smithi181 ceph-mon[22102]: pgmap v386: 97 pgs: 97 active+clean; 4.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 285 KiB/s wr, 54 op/s 2024-08-26T00:04:08.113 INFO:tasks.workunit.client.0.smithi042.stdout:config.status: executing depfiles commands 2024-08-26T00:04:08.415 INFO:tasks.workunit.client.0.smithi042.stderr:+ make 2024-08-26T00:04:08.427 INFO:tasks.workunit.client.0.smithi042.stdout:make all-recursive 2024-08-26T00:04:08.431 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-08-26T00:04:08.437 INFO:tasks.workunit.client.0.smithi042.stdout:Making all in src 2024-08-26T00:04:08.447 INFO:tasks.workunit.client.0.smithi042.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-08-26T00:04:08.447 INFO:tasks.workunit.client.0.smithi042.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2024-08-26T00:04:08.447 INFO:tasks.workunit.client.0.smithi042.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2024-08-26T00:04:08.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:08 smithi043 ceph-mon[22091]: pgmap v387: 97 pgs: 97 active+clean; 4.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 274 KiB/s wr, 54 op/s 2024-08-26T00:04:08.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:08 smithi042 ceph-mon[17225]: pgmap v387: 97 pgs: 97 active+clean; 4.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 274 KiB/s wr, 54 op/s 2024-08-26T00:04:08.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:08 smithi181 ceph-mon[22102]: pgmap v387: 97 pgs: 97 active+clean; 4.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 274 KiB/s wr, 54 op/s 2024-08-26T00:04:08.599 INFO:tasks.workunit.client.0.smithi042.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2024-08-26T00:04:08.599 INFO:tasks.workunit.client.0.smithi042.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2024-08-26T00:04:08.733 INFO:tasks.workunit.client.0.smithi042.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2024-08-26T00:04:08.733 INFO:tasks.workunit.client.0.smithi042.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2024-08-26T00:04:08.852 INFO:tasks.workunit.client.0.smithi042.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2024-08-26T00:04:08.852 INFO:tasks.workunit.client.0.smithi042.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2024-08-26T00:04:08.967 INFO:tasks.workunit.client.0.smithi042.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2024-08-26T00:04:08.967 INFO:tasks.workunit.client.0.smithi042.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2024-08-26T00:04:09.083 INFO:tasks.workunit.client.0.smithi042.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2024-08-26T00:04:09.084 INFO:tasks.workunit.client.0.smithi042.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2024-08-26T00:04:09.195 INFO:tasks.workunit.client.0.smithi042.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2024-08-26T00:04:09.195 INFO:tasks.workunit.client.0.smithi042.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2024-08-26T00:04:09.346 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-26T00:04:09.347 INFO:tasks.workunit.client.0.smithi042.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2024-08-26T00:04:09.347 INFO:tasks.workunit.client.0.smithi042.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2024-08-26T00:04:09.441 INFO:tasks.workunit.client.0.smithi042.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2024-08-26T00:04:09.442 INFO:tasks.workunit.client.0.smithi042.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2024-08-26T00:04:09.531 INFO:tasks.workunit.client.0.smithi042.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2024-08-26T00:04:09.532 INFO:tasks.workunit.client.0.smithi042.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2024-08-26T00:04:09.616 INFO:tasks.workunit.client.0.smithi042.stdout:gcc -g -O2 -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2024-08-26T00:04:09.648 INFO:tasks.workunit.client.0.smithi042.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-08-26T00:04:09.648 INFO:tasks.workunit.client.0.smithi042.stdout:Making all in man 2024-08-26T00:04:09.653 INFO:tasks.workunit.client.0.smithi042.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-08-26T00:04:09.653 INFO:tasks.workunit.client.0.smithi042.stdout:make[2]: Nothing to be done for 'all'. 2024-08-26T00:04:09.653 INFO:tasks.workunit.client.0.smithi042.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-08-26T00:04:09.657 INFO:tasks.workunit.client.0.smithi042.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-08-26T00:04:09.659 INFO:tasks.workunit.client.0.smithi042.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-08-26T00:04:09.660 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-08-26T00:04:09.660 INFO:tasks.workunit.client.0.smithi042.stderr:+ cd src 2024-08-26T00:04:09.666 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir blogtest_in 2024-08-26T00:04:09.671 INFO:tasks.workunit.client.0.smithi042.stdout:running blogbench 2024-08-26T00:04:09.671 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'running blogbench' 2024-08-26T00:04:09.672 INFO:tasks.workunit.client.0.smithi042.stderr:+ ./blogbench -d blogtest_in 2024-08-26T00:04:09.673 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-08-26T00:04:09.673 INFO:tasks.workunit.client.0.smithi042.stdout:Frequency = 10 secs 2024-08-26T00:04:09.673 INFO:tasks.workunit.client.0.smithi042.stdout:Scratch dir = [blogtest_in] 2024-08-26T00:04:09.753 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:04:10.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:10 smithi042 ceph-mon[17225]: pgmap v388: 97 pgs: 97 active+clean; 4.2 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 261 KiB/s wr, 48 op/s 2024-08-26T00:04:10.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:10 smithi043 ceph-mon[22091]: pgmap v388: 97 pgs: 97 active+clean; 4.2 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 261 KiB/s wr, 48 op/s 2024-08-26T00:04:10.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:10 smithi181 ceph-mon[22102]: pgmap v388: 97 pgs: 97 active+clean; 4.2 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 261 KiB/s wr, 48 op/s 2024-08-26T00:04:11.612 INFO:tasks.workunit.client.0.smithi042.stdout:Spawning 3 writers... 2024-08-26T00:04:11.612 INFO:tasks.workunit.client.0.smithi042.stdout:Spawning 1 rewriters... 2024-08-26T00:04:11.612 INFO:tasks.workunit.client.0.smithi042.stdout:Spawning 5 commenters... 2024-08-26T00:04:11.613 INFO:tasks.workunit.client.0.smithi042.stdout:Spawning 100 readers... 2024-08-26T00:04:11.621 INFO:tasks.workunit.client.0.smithi042.stdout:Benchmarking for 30 iterations. 2024-08-26T00:04:11.621 INFO:tasks.workunit.client.0.smithi042.stdout:The test will run during 5 minutes. 2024-08-26T00:04:11.621 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-08-26T00:04:11.621 INFO:tasks.workunit.client.0.smithi042.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2024-08-26T00:04:12.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.066+0000 7fecf1c00640 1 -- 172.21.15.42:0/2674527108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecec109970 msgr2=0x7fecec109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:12.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.066+0000 7fecf1c00640 1 --2- 172.21.15.42:0/2674527108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecec109970 0x7fecec109d50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009900 tx=0x7fecdc02a3f0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.066+0000 7fecf1c00640 1 -- 172.21.15.42:0/2674527108 shutdown_connections 2024-08-26T00:04:12.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.066+0000 7fecf1c00640 1 --2- 172.21.15.42:0/2674527108 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecec104310 0x7fecec110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.066+0000 7fecf1c00640 1 --2- 172.21.15.42:0/2674527108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecec103970 0x7fecec103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.066+0000 7fecf1c00640 1 --2- 172.21.15.42:0/2674527108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecec109970 0x7fecec109d50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.066+0000 7fecf1c00640 1 -- 172.21.15.42:0/2674527108 >> 172.21.15.42:0/2674527108 conn(0x7fecec0ff6b0 msgr2=0x7fecec101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:12.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.066+0000 7fecf1c00640 1 -- 172.21.15.42:0/2674527108 shutdown_connections 2024-08-26T00:04:12.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.066+0000 7fecf1c00640 1 -- 172.21.15.42:0/2674527108 wait complete. 2024-08-26T00:04:12.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.067+0000 7fecf1c00640 1 Processor -- start 2024-08-26T00:04:12.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.067+0000 7fecf1c00640 1 -- start start 2024-08-26T00:04:12.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.067+0000 7fecf1c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecec103970 0x7fecec19a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:12.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.068+0000 7fecf1c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecec104310 0x7fecec19a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:12.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.068+0000 7fecf1c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecec109970 0x7fecec19eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:12.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.068+0000 7fecf1c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fecec113d70 con 0x7fecec103970 2024-08-26T00:04:12.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.068+0000 7fecf1c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fecec113bf0 con 0x7fecec109970 2024-08-26T00:04:12.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.068+0000 7fecf1c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fecec113ef0 con 0x7fecec104310 2024-08-26T00:04:12.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.068+0000 7fecebe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecec103970 0x7fecec19a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:12.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.068+0000 7fecebe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecec103970 0x7fecec19a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55188/0 (socket says 172.21.15.42:55188) 2024-08-26T00:04:12.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.068+0000 7fecebe00640 1 -- 172.21.15.42:0/4016767611 learned_addr learned my addr 172.21.15.42:0/4016767611 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:12.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.068+0000 7fecf1200640 1 --2- 172.21.15.42:0/4016767611 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecec109970 0x7fecec19eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:12.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.068+0000 7feceb400640 1 --2- 172.21.15.42:0/4016767611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecec104310 0x7fecec19a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:12.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.068+0000 7fecebe00640 1 -- 172.21.15.42:0/4016767611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecec104310 msgr2=0x7fecec19a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:12.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.068+0000 7fecebe00640 1 --2- 172.21.15.42:0/4016767611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecec104310 0x7fecec19a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.068+0000 7fecebe00640 1 -- 172.21.15.42:0/4016767611 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecec109970 msgr2=0x7fecec19eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:12.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.068+0000 7fecebe00640 1 --2- 172.21.15.42:0/4016767611 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecec109970 0x7fecec19eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.068+0000 7fecebe00640 1 -- 172.21.15.42:0/4016767611 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecec19f1e0 con 0x7fecec103970 2024-08-26T00:04:12.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.069+0000 7fecf1200640 1 --2- 172.21.15.42:0/4016767611 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecec109970 0x7fecec19eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:04:12.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.069+0000 7fecebe00640 1 --2- 172.21.15.42:0/4016767611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecec103970 0x7fecec19a230 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fecdc006010 tx=0x7fecdc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:12.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.069+0000 7fece8c00640 1 -- 172.21.15.42:0/4016767611 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc03f070 con 0x7fecec103970 2024-08-26T00:04:12.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.069+0000 7fece8c00640 1 -- 172.21.15.42:0/4016767611 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecdc031c30 con 0x7fecec103970 2024-08-26T00:04:12.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.069+0000 7fece8c00640 1 -- 172.21.15.42:0/4016767611 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc035030 con 0x7fecec103970 2024-08-26T00:04:12.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.069+0000 7fecf1c00640 1 -- 172.21.15.42:0/4016767611 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecec19f470 con 0x7fecec103970 2024-08-26T00:04:12.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.070+0000 7fecf1c00640 1 -- 172.21.15.42:0/4016767611 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecec19f900 con 0x7fecec103970 2024-08-26T00:04:12.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.072+0000 7fece8c00640 1 -- 172.21.15.42:0/4016767611 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fecdc042070 con 0x7fecec103970 2024-08-26T00:04:12.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.073+0000 7fecf5e64740 1 Processor -- start 2024-08-26T00:04:12.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.073+0000 7fecf5e64740 1 -- start start 2024-08-26T00:04:12.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.073+0000 7fecf5e64740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56169d315b40 0x56169d315f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:12.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.073+0000 7fecf5e64740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56169d316460 0x56169d3207e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:12.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.073+0000 7fecf5e64740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d320d20 0x56169d323110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:12.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.073+0000 7fecf5e64740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56169d27bfc0 con 0x56169d316460 2024-08-26T00:04:12.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.073+0000 7fecf5e64740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56169d213680 con 0x56169d320d20 2024-08-26T00:04:12.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.073+0000 7fecf5e64740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56169d277f80 con 0x56169d315b40 2024-08-26T00:04:12.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.074+0000 7fecebe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56169d316460 0x56169d3207e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:12.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.074+0000 7feceb400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d320d20 0x56169d323110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:12.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.074+0000 7fecf1200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56169d315b40 0x56169d315f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:12.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.074+0000 7feceb400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d320d20 0x56169d323110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:34324/0 (socket says 172.21.15.42:34324) 2024-08-26T00:04:12.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.074+0000 7feceb400640 1 -- 172.21.15.42:0/218462322 learned_addr learned my addr 172.21.15.42:0/218462322 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:12.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.074+0000 7feceb400640 1 -- 172.21.15.42:0/218462322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56169d315b40 msgr2=0x56169d315f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:12.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.074+0000 7feceb400640 1 --2- 172.21.15.42:0/218462322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56169d315b40 0x56169d315f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.074+0000 7feceb400640 1 -- 172.21.15.42:0/218462322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56169d316460 msgr2=0x56169d3207e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:12.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.074+0000 7feceb400640 1 --2- 172.21.15.42:0/218462322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56169d316460 0x56169d3207e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.074+0000 7feceb400640 1 -- 172.21.15.42:0/218462322 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56169d22f2c0 con 0x56169d320d20 2024-08-26T00:04:12.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.074+0000 7fecf1200640 1 --2- 172.21.15.42:0/218462322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56169d315b40 0x56169d315f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:04:12.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.074+0000 7fece8c00640 1 --2- 172.21.15.42:0/4016767611 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fecd00a2c00 0x7fecd00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:12.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.074+0000 7feceb400640 1 --2- 172.21.15.42:0/218462322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d320d20 0x56169d323110 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fecd8009c90 tx=0x7fecd8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96152dd8b897b138 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:12.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.074+0000 7fece8c00640 1 -- 172.21.15.42:0/4016767611 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fecdc0ef630 con 0x7fecec103970 2024-08-26T00:04:12.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.075+0000 7fecf1200640 1 --2- 172.21.15.42:0/4016767611 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fecd00a2c00 0x7fecd00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:12.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.075+0000 7fece1600640 1 -- 172.21.15.42:0/218462322 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd801e070 con 0x56169d320d20 2024-08-26T00:04:12.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.075+0000 7fece1600640 1 -- 172.21.15.42:0/218462322 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecd8009e40 con 0x56169d320d20 2024-08-26T00:04:12.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.075+0000 7fece1600640 1 -- 172.21.15.42:0/218462322 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd800ea90 con 0x56169d320d20 2024-08-26T00:04:12.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.076+0000 7fecf5e64740 1 -- 172.21.15.42:0/218462322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d320d20 msgr2=0x56169d323110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:12.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.076+0000 7fecf1200640 1 --2- 172.21.15.42:0/4016767611 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fecd00a2c00 0x7fecd00a50c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fece4009fd0 tx=0x7fece4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:12.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.076+0000 7fecf5e64740 1 --2- 172.21.15.42:0/218462322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d320d20 0x56169d323110 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fecd8009c90 tx=0x7fecd8011810 comp rx=0 tx=0).stop 2024-08-26T00:04:12.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.076+0000 7fecf5e64740 1 -- 172.21.15.42:0/218462322 shutdown_connections 2024-08-26T00:04:12.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.076+0000 7fecf5e64740 1 --2- 172.21.15.42:0/218462322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d320d20 0x56169d323110 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.076+0000 7fecf5e64740 1 --2- 172.21.15.42:0/218462322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56169d316460 0x56169d3207e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.076+0000 7fecf5e64740 1 --2- 172.21.15.42:0/218462322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56169d315b40 0x56169d315f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.076+0000 7fecf5e64740 1 -- 172.21.15.42:0/218462322 >> 172.21.15.42:0/218462322 conn(0x56169d312080 msgr2=0x56169d312460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:12.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.076+0000 7fecf5e64740 1 -- 172.21.15.42:0/218462322 shutdown_connections 2024-08-26T00:04:12.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.076+0000 7fecf5e64740 1 -- 172.21.15.42:0/218462322 wait complete. 2024-08-26T00:04:12.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.077+0000 7fecf5e64740 1 -- start start 2024-08-26T00:04:12.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.077+0000 7fecf5e64740 1 Processor -- start 2024-08-26T00:04:12.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.078+0000 7fecf5e64740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d315b40 0x56169d31dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:12.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.078+0000 7fecf5e64740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56169d316460 0x56169d31e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:12.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.078+0000 7fecf5e64740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56169d320d20 0x56169d31e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:12.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.078+0000 7fecf5e64740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56169d3238f0 con 0x56169d320d20 2024-08-26T00:04:12.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.078+0000 7fecf5e64740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56169d236e50 con 0x56169d315b40 2024-08-26T00:04:12.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.078+0000 7fecf5e64740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56169d323a70 con 0x56169d316460 2024-08-26T00:04:12.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.078+0000 7fecf5e64740 10 client.0 _ll_register_callbacks cb 0x56169d221f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:04:12.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.078+0000 7fecebe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d315b40 0x56169d31dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:12.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.078+0000 7fecebe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d315b40 0x56169d31dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:34332/0 (socket says 172.21.15.42:34332) 2024-08-26T00:04:12.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.078+0000 7fecebe00640 1 -- 172.21.15.42:0/3106721172 learned_addr learned my addr 172.21.15.42:0/3106721172 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:12.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.078+0000 7fecf1200640 1 --2- 172.21.15.42:0/3106721172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56169d320d20 0x56169d31e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:12.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.078+0000 7feceb400640 1 --2- 172.21.15.42:0/3106721172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56169d316460 0x56169d31e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:12.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.078+0000 7fecebe00640 1 -- 172.21.15.42:0/3106721172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56169d316460 msgr2=0x56169d31e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:12.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.078+0000 7fecebe00640 1 --2- 172.21.15.42:0/3106721172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56169d316460 0x56169d31e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.078+0000 7fecebe00640 1 -- 172.21.15.42:0/3106721172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56169d320d20 msgr2=0x56169d31e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:12.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.078+0000 7fecebe00640 1 --2- 172.21.15.42:0/3106721172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56169d320d20 0x56169d31e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.078+0000 7fecebe00640 1 -- 172.21.15.42:0/3106721172 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56169cfed3c0 con 0x56169d315b40 2024-08-26T00:04:12.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.078+0000 7feceb400640 1 --2- 172.21.15.42:0/3106721172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56169d316460 0x56169d31e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:04:12.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.078+0000 7fecebe00640 1 --2- 172.21.15.42:0/3106721172 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d315b40 0x56169d31dbd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fecdc0b88d0 tx=0x7fecdc005dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef69063ff2925636 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:12.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.078+0000 7fecd6000640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:04:12.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.079+0000 7fecd6000640 1 -- 172.21.15.42:0/3106721172 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc049070 con 0x56169d315b40 2024-08-26T00:04:12.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.079+0000 7fecd6000640 1 -- 172.21.15.42:0/3106721172 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fecdc0b8570 con 0x56169d315b40 2024-08-26T00:04:12.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.079+0000 7fecf5e64740 1 -- 172.21.15.42:0/3106721172 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56169d289530 con 0x56169d315b40 2024-08-26T00:04:12.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.079+0000 7fecd6000640 1 -- 172.21.15.42:0/3106721172 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fecdc0bba40 con 0x56169d315b40 2024-08-26T00:04:12.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.079+0000 7fecf5e64740 10 client.25349 fetch_fsmap learned FSMap version 25 2024-08-26T00:04:12.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.079+0000 7fecf5e64740 1 -- 172.21.15.42:0/3106721172 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56169d32f570 con 0x56169d315b40 2024-08-26T00:04:12.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.079+0000 7fecd6000640 1 -- 172.21.15.42:0/3106721172 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56169d289530 con 0x56169d315b40 2024-08-26T00:04:12.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.079+0000 7fecd6000640 1 -- 172.21.15.42:0/3106721172 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fecdc0c4630 con 0x56169d315b40 2024-08-26T00:04:12.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.080+0000 7fecf5e64740 10 client.25349 fetch_fsmap finished waiting for FSMap version 25 2024-08-26T00:04:12.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.080+0000 7fecf5e64740 10 client.25349 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:04:12.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.080+0000 7fecf5e64740 20 client.25349 populate_metadata read hostname 'smithi042' 2024-08-26T00:04:12.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.080+0000 7fecf5e64740 1 --2- 172.21.15.42:0/3106721172 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x56169d330a70 0x56169d332f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:12.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.080+0000 7fecf5e64740 4 client.25349 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:04:12.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.080+0000 7fecf5e64740 1 -- 172.21.15.42:0/3106721172 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56169d283a40 con 0x56169d330a70 2024-08-26T00:04:12.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.080+0000 7feceb400640 1 --2- 172.21.15.42:0/3106721172 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x56169d330a70 0x56169d332f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:12.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.081+0000 7feceb400640 1 --2- 172.21.15.42:0/3106721172 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x56169d330a70 0x56169d332f30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ccac540158d6555 server_cookie=3010e13a08227d5e in_seq=0 out_seq=0 2024-08-26T00:04:12.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.081+0000 7fecd6000640 10 client.25349 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:04:12.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.081+0000 7fecd6000640 1 -- 172.21.15.42:0/3106721172 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56169d283a40 con 0x56169d330a70 2024-08-26T00:04:12.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.081+0000 7fecd6000640 10 client.25349 handle_command_reply: tid=0 2024-08-26T00:04:12.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.081+0000 7fecf5e64740 1 client.25349 shutdown 2024-08-26T00:04:12.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.082+0000 7fecf5e64740 1 -- 172.21.15.42:0/3106721172 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d315b40 msgr2=0x56169d31dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:12.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.082+0000 7fecf5e64740 1 --2- 172.21.15.42:0/3106721172 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d315b40 0x56169d31dbd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fecdc0b88d0 tx=0x7fecdc005dd0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.082+0000 7fecf5e64740 1 -- 172.21.15.42:0/3106721172 shutdown_connections 2024-08-26T00:04:12.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.082+0000 7fecf5e64740 1 --2- 172.21.15.42:0/3106721172 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x56169d330a70 0x56169d332f30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.082+0000 7fecf5e64740 1 --2- 172.21.15.42:0/3106721172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56169d320d20 0x56169d31e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.082+0000 7fecf5e64740 1 --2- 172.21.15.42:0/3106721172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56169d316460 0x56169d31e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.082+0000 7fecf5e64740 1 --2- 172.21.15.42:0/3106721172 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d315b40 0x56169d31dbd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.082+0000 7fecd6000640 0 client.25349 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:04:12.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.082+0000 7fecf5e64740 1 -- 172.21.15.42:0/3106721172 >> 172.21.15.42:0/3106721172 conn(0x56169d312080 msgr2=0x56169d317e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:12.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.082+0000 7fecf5e64740 1 -- 172.21.15.42:0/3106721172 shutdown_connections 2024-08-26T00:04:12.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.082+0000 7fecf5e64740 1 -- 172.21.15.42:0/3106721172 wait complete. 2024-08-26T00:04:12.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.082+0000 7fecf5e64740 20 client.25349 trim_cache size 0 max 16384 2024-08-26T00:04:12.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.103+0000 7fecf5e64740 1 Processor -- start 2024-08-26T00:04:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.103+0000 7fecf5e64740 1 -- start start 2024-08-26T00:04:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.104+0000 7fecf5e64740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d315b40 0x56169d317cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.104+0000 7fecf5e64740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56169d316460 0x56169d338840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.104+0000 7fecf5e64740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56169d320d20 0x56169d338d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.104+0000 7fecf5e64740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fecec1b1cd0 con 0x56169d316460 2024-08-26T00:04:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.104+0000 7fecf5e64740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fecec1af5a0 con 0x56169d315b40 2024-08-26T00:04:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.104+0000 7fecf5e64740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fecec1ad3d0 con 0x56169d320d20 2024-08-26T00:04:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.104+0000 7fecebe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d315b40 0x56169d317cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.104+0000 7feceb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56169d316460 0x56169d338840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.104+0000 7fecebe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d315b40 0x56169d317cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:34344/0 (socket says 172.21.15.42:34344) 2024-08-26T00:04:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.104+0000 7fecebe00640 1 -- 172.21.15.42:0/106313522 learned_addr learned my addr 172.21.15.42:0/106313522 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.104+0000 7fecf1200640 1 --2- 172.21.15.42:0/106313522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56169d320d20 0x56169d338d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:12.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.104+0000 7fecebe00640 1 -- 172.21.15.42:0/106313522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56169d320d20 msgr2=0x56169d338d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:12.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.104+0000 7fecebe00640 1 --2- 172.21.15.42:0/106313522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56169d320d20 0x56169d338d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.104+0000 7fecebe00640 1 -- 172.21.15.42:0/106313522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56169d316460 msgr2=0x56169d338840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:12.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.104+0000 7fecebe00640 1 --2- 172.21.15.42:0/106313522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56169d316460 0x56169d338840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.104+0000 7fecebe00640 1 -- 172.21.15.42:0/106313522 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56169d311eb0 con 0x56169d315b40 2024-08-26T00:04:12.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.105+0000 7fecebe00640 1 --2- 172.21.15.42:0/106313522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d315b40 0x56169d317cf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fecdc005ab0 tx=0x7fecdc0c49f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d70e0c965a9cf40 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:12.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.105+0000 7fece0c00640 1 -- 172.21.15.42:0/106313522 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc049070 con 0x56169d315b40 2024-08-26T00:04:12.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.105+0000 7fece0c00640 1 -- 172.21.15.42:0/106313522 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecdc0be020 con 0x56169d315b40 2024-08-26T00:04:12.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.105+0000 7fece0c00640 1 -- 172.21.15.42:0/106313522 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc0bb860 con 0x56169d315b40 2024-08-26T00:04:12.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.106+0000 7fecf5e64740 1 -- 172.21.15.42:0/106313522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d315b40 msgr2=0x56169d317cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:12.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.106+0000 7fecf5e64740 1 --2- 172.21.15.42:0/106313522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d315b40 0x56169d317cf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fecdc005ab0 tx=0x7fecdc0c49f0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.106+0000 7fecf5e64740 1 -- 172.21.15.42:0/106313522 shutdown_connections 2024-08-26T00:04:12.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.106+0000 7fecf5e64740 1 --2- 172.21.15.42:0/106313522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56169d320d20 0x56169d338d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.106+0000 7fecf5e64740 1 --2- 172.21.15.42:0/106313522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56169d316460 0x56169d338840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.106+0000 7fecf5e64740 1 --2- 172.21.15.42:0/106313522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d315b40 0x56169d317cf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.106+0000 7fecf5e64740 1 -- 172.21.15.42:0/106313522 >> 172.21.15.42:0/106313522 conn(0x56169d312080 msgr2=0x56169d3175e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:12.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.106+0000 7fecf5e64740 1 -- 172.21.15.42:0/106313522 shutdown_connections 2024-08-26T00:04:12.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.106+0000 7fecf5e64740 1 -- 172.21.15.42:0/106313522 wait complete. 2024-08-26T00:04:12.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.106+0000 7fecf5e64740 1 -- start start 2024-08-26T00:04:12.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.107+0000 7fecf5e64740 1 Processor -- start 2024-08-26T00:04:12.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.107+0000 7fecf5e64740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d315b40 0x56169d3290f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:12.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.107+0000 7fecf5e64740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56169d316460 0x56169d324420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:12.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.107+0000 7fecf5e64740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56169d320d20 0x56169d324960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:12.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.107+0000 7fecf5e64740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fecec1ada60 con 0x56169d316460 2024-08-26T00:04:12.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.107+0000 7fecf5e64740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fecec1aeed0 con 0x56169d315b40 2024-08-26T00:04:12.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.107+0000 7fecf5e64740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fecec1ae130 con 0x56169d320d20 2024-08-26T00:04:12.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.107+0000 7fecf5e64740 10 client.0 _ll_register_callbacks cb 0x7fecdc005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:04:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.107+0000 7fecebe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d315b40 0x56169d3290f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.107+0000 7fecebe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d315b40 0x56169d3290f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:34348/0 (socket says 172.21.15.42:34348) 2024-08-26T00:04:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.107+0000 7fecebe00640 1 -- 172.21.15.42:0/1000779450 learned_addr learned my addr 172.21.15.42:0/1000779450 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.107+0000 7fecf1200640 1 --2- 172.21.15.42:0/1000779450 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56169d320d20 0x56169d324960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.108+0000 7fecebe00640 1 -- 172.21.15.42:0/1000779450 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56169d320d20 msgr2=0x56169d324960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.108+0000 7fecebe00640 1 --2- 172.21.15.42:0/1000779450 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56169d320d20 0x56169d324960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.108+0000 7fecebe00640 1 -- 172.21.15.42:0/1000779450 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56169d316460 msgr2=0x56169d324420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.108+0000 7feceb400640 1 --2- 172.21.15.42:0/1000779450 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56169d316460 0x56169d324420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.108+0000 7fecebe00640 1 --2- 172.21.15.42:0/1000779450 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56169d316460 0x56169d324420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.108+0000 7fecebe00640 1 -- 172.21.15.42:0/1000779450 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56169d324ea0 con 0x56169d315b40 2024-08-26T00:04:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.108+0000 7feceb400640 1 --2- 172.21.15.42:0/1000779450 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56169d316460 0x56169d324420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:04:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.108+0000 7fecebe00640 1 --2- 172.21.15.42:0/1000779450 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d315b40 0x56169d3290f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fecdc0bbe90 tx=0x7fecdc0c48e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6ade1e948e09292 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.108+0000 7fecd6000640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:04:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.108+0000 7fecd6000640 1 -- 172.21.15.42:0/1000779450 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc049070 con 0x56169d315b40 2024-08-26T00:04:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.108+0000 7fecd6000640 1 -- 172.21.15.42:0/1000779450 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fecdc031750 con 0x56169d315b40 2024-08-26T00:04:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.108+0000 7fecf5e64740 1 -- 172.21.15.42:0/1000779450 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecdc0be020 con 0x56169d315b40 2024-08-26T00:04:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.108+0000 7fecd6000640 1 -- 172.21.15.42:0/1000779450 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fecdc0bb860 con 0x56169d315b40 2024-08-26T00:04:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.108+0000 7fecf5e64740 10 client.25355 fetch_fsmap learned FSMap version 25 2024-08-26T00:04:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.108+0000 7fecf5e64740 1 -- 172.21.15.42:0/1000779450 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56169d324ea0 con 0x56169d315b40 2024-08-26T00:04:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.109+0000 7fecd6000640 1 -- 172.21.15.42:0/1000779450 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecdc0be020 con 0x56169d315b40 2024-08-26T00:04:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.109+0000 7fecd6000640 1 -- 172.21.15.42:0/1000779450 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fecdc0ef1f0 con 0x56169d315b40 2024-08-26T00:04:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.109+0000 7fecf5e64740 10 client.25355 fetch_fsmap finished waiting for FSMap version 25 2024-08-26T00:04:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.109+0000 7fecf5e64740 10 client.25355 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:04:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.109+0000 7fecf5e64740 20 client.25355 populate_metadata read hostname 'smithi042' 2024-08-26T00:04:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.109+0000 7fecf5e64740 1 --2- 172.21.15.42:0/1000779450 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x56169d39b780 0x56169d39dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.109+0000 7fecf5e64740 4 client.25355 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-26T00:04:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.109+0000 7fecf5e64740 1 -- 172.21.15.42:0/1000779450 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56169d2000c0 con 0x56169d39b780 2024-08-26T00:04:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.109+0000 7feceb400640 1 --2- 172.21.15.42:0/1000779450 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x56169d39b780 0x56169d39dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.110+0000 7feceb400640 1 --2- 172.21.15.42:0/1000779450 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x56169d39b780 0x56169d39dba0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec375a9e9b6311c0 server_cookie=5b2130f6d3a7f079 in_seq=0 out_seq=0 2024-08-26T00:04:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.110+0000 7fecd6000640 10 client.25355 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:04:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.110+0000 7fecd6000640 1 -- 172.21.15.42:0/1000779450 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56169d2000c0 con 0x56169d39b780 2024-08-26T00:04:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.110+0000 7fecd6000640 10 client.25355 handle_command_reply: tid=0 2024-08-26T00:04:12.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.110+0000 7fecf5e64740 1 client.25355 shutdown 2024-08-26T00:04:12.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.110+0000 7fecf5e64740 1 -- 172.21.15.42:0/1000779450 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d315b40 msgr2=0x56169d3290f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:12.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.110+0000 7fecf5e64740 1 --2- 172.21.15.42:0/1000779450 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d315b40 0x56169d3290f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fecdc0bbe90 tx=0x7fecdc0c48e0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.110+0000 7fecf5e64740 1 -- 172.21.15.42:0/1000779450 shutdown_connections 2024-08-26T00:04:12.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.110+0000 7fecf5e64740 1 --2- 172.21.15.42:0/1000779450 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56169d320d20 0x56169d324960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.110+0000 7fecf5e64740 1 --2- 172.21.15.42:0/1000779450 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x56169d39b780 0x56169d39dba0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.110+0000 7fecf5e64740 1 --2- 172.21.15.42:0/1000779450 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56169d316460 0x56169d324420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.110+0000 7fecf5e64740 1 --2- 172.21.15.42:0/1000779450 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56169d315b40 0x56169d3290f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.110+0000 7fecd6000640 0 client.25355 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:04:12.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.110+0000 7fecf5e64740 1 -- 172.21.15.42:0/1000779450 >> 172.21.15.42:0/1000779450 conn(0x56169d312080 msgr2=0x56169d311240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:12.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.111+0000 7fecf5e64740 1 -- 172.21.15.42:0/1000779450 shutdown_connections 2024-08-26T00:04:12.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.111+0000 7fecf5e64740 1 -- 172.21.15.42:0/1000779450 wait complete. 2024-08-26T00:04:12.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.111+0000 7fecf5e64740 20 client.25355 trim_cache size 0 max 16384 2024-08-26T00:04:12.115 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:04:12.115 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-08-26T00:04:12.115 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {} 2024-08-26T00:04:12.115 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:04:12.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.112+0000 7fecf1c00640 1 -- 172.21.15.42:0/4016767611 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fecd00a2c00 msgr2=0x7fecd00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:12.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.112+0000 7fecf1c00640 1 --2- 172.21.15.42:0/4016767611 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fecd00a2c00 0x7fecd00a50c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fece4009fd0 tx=0x7fece4009500 comp rx=0 tx=0).stop 2024-08-26T00:04:12.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.112+0000 7fecf1c00640 1 -- 172.21.15.42:0/4016767611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecec103970 msgr2=0x7fecec19a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:12.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.112+0000 7fecf1c00640 1 --2- 172.21.15.42:0/4016767611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecec103970 0x7fecec19a230 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fecdc006010 tx=0x7fecdc003c10 comp rx=0 tx=0).stop 2024-08-26T00:04:12.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.112+0000 7fecf1c00640 1 -- 172.21.15.42:0/4016767611 shutdown_connections 2024-08-26T00:04:12.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.112+0000 7fecf1c00640 1 --2- 172.21.15.42:0/4016767611 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fecd00a2c00 0x7fecd00a50c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.112+0000 7fecf1c00640 1 --2- 172.21.15.42:0/4016767611 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecec109970 0x7fecec19eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.112+0000 7fecf1c00640 1 --2- 172.21.15.42:0/4016767611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecec104310 0x7fecec19a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.112+0000 7fecf1c00640 1 --2- 172.21.15.42:0/4016767611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecec103970 0x7fecec19a230 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:12.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.112+0000 7fecf1c00640 1 -- 172.21.15.42:0/4016767611 >> 172.21.15.42:0/4016767611 conn(0x7fecec0ff6b0 msgr2=0x7fecec0fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:12.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.112+0000 7fecf1c00640 1 -- 172.21.15.42:0/4016767611 shutdown_connections 2024-08-26T00:04:12.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:12.112+0000 7fecf1c00640 1 -- 172.21.15.42:0/4016767611 wait complete. 2024-08-26T00:04:12.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:12 smithi042 ceph-mon[17225]: pgmap v389: 97 pgs: 97 active+clean; 4.3 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 79 KiB/s wr, 26 op/s 2024-08-26T00:04:12.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:12 smithi043 ceph-mon[22091]: pgmap v389: 97 pgs: 97 active+clean; 4.3 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 79 KiB/s wr, 26 op/s 2024-08-26T00:04:12.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:12 smithi181 ceph-mon[22102]: pgmap v389: 97 pgs: 97 active+clean; 4.3 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 79 KiB/s wr, 26 op/s 2024-08-26T00:04:12.941 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-26T00:04:12.942 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:04:13.355 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:04:13.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.904+0000 7f1802a00640 1 -- 172.21.15.42:0/839661698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17fc103db0 msgr2=0x7f17fc104190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:13.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.904+0000 7f1802a00640 1 --2- 172.21.15.42:0/839661698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17fc103db0 0x7f17fc104190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009900 tx=0x7f17ec02a3f0 comp rx=0 tx=0).stop 2024-08-26T00:04:13.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.905+0000 7f1802a00640 1 -- 172.21.15.42:0/839661698 shutdown_connections 2024-08-26T00:04:13.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.905+0000 7f1802a00640 1 --2- 172.21.15.42:0/839661698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17fc108ee0 0x7f17fc110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:13.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.905+0000 7f1802a00640 1 --2- 172.21.15.42:0/839661698 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17fc104760 0x7f17fc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:13.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.905+0000 7f1802a00640 1 --2- 172.21.15.42:0/839661698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17fc103db0 0x7f17fc104190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:13.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.905+0000 7f1802a00640 1 -- 172.21.15.42:0/839661698 >> 172.21.15.42:0/839661698 conn(0x7f17fc0ff7f0 msgr2=0x7f17fc101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:13.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.905+0000 7f1802a00640 1 -- 172.21.15.42:0/839661698 shutdown_connections 2024-08-26T00:04:13.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.905+0000 7f1802a00640 1 -- 172.21.15.42:0/839661698 wait complete. 2024-08-26T00:04:13.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.906+0000 7f1802a00640 1 Processor -- start 2024-08-26T00:04:13.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.906+0000 7f1802a00640 1 -- start start 2024-08-26T00:04:13.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.907+0000 7f1802a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17fc103db0 0x7f17fc19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:13.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.907+0000 7f1802a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17fc104760 0x7f17fc19a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:13.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.907+0000 7f1802a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17fc108ee0 0x7f17fc19ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:13.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.907+0000 7f1802a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f17fc113f90 con 0x7f17fc103db0 2024-08-26T00:04:13.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.907+0000 7f1802a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f17fc113e10 con 0x7f17fc104760 2024-08-26T00:04:13.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.907+0000 7f1802a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f17fc114110 con 0x7f17fc108ee0 2024-08-26T00:04:13.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.907+0000 7f17f3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17fc104760 0x7f17fc19a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:13.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.907+0000 7f17fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17fc103db0 0x7f17fc19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:13.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.907+0000 7f17f3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17fc104760 0x7f17fc19a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:34362/0 (socket says 172.21.15.42:34362) 2024-08-26T00:04:13.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.907+0000 7f17f3e00640 1 -- 172.21.15.42:0/2163949933 learned_addr learned my addr 172.21.15.42:0/2163949933 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:13.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.907+0000 7f1800a00640 1 --2- 172.21.15.42:0/2163949933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17fc108ee0 0x7f17fc19ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:13.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.907+0000 7f17f3e00640 1 -- 172.21.15.42:0/2163949933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17fc108ee0 msgr2=0x7f17fc19ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:13.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.907+0000 7f17f3e00640 1 --2- 172.21.15.42:0/2163949933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17fc108ee0 0x7f17fc19ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:13.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.907+0000 7f17f3e00640 1 -- 172.21.15.42:0/2163949933 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17fc103db0 msgr2=0x7f17fc19a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:13.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.907+0000 7f17f3e00640 1 --2- 172.21.15.42:0/2163949933 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17fc103db0 0x7f17fc19a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:13.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.907+0000 7f17f3e00640 1 -- 172.21.15.42:0/2163949933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17fc19f3d0 con 0x7f17fc104760 2024-08-26T00:04:13.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.908+0000 7f17f3e00640 1 --2- 172.21.15.42:0/2163949933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17fc104760 0x7f17fc19a960 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f17e400e9f0 tx=0x7f17e400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:13.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.908+0000 7f17f9600640 1 -- 172.21.15.42:0/2163949933 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e400cd80 con 0x7f17fc104760 2024-08-26T00:04:13.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.908+0000 7f17f9600640 1 -- 172.21.15.42:0/2163949933 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17e4005500 con 0x7f17fc104760 2024-08-26T00:04:13.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.908+0000 7f1802a00640 1 -- 172.21.15.42:0/2163949933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17fc19f6c0 con 0x7f17fc104760 2024-08-26T00:04:13.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.908+0000 7f17f9600640 1 -- 172.21.15.42:0/2163949933 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e4010690 con 0x7f17fc104760 2024-08-26T00:04:13.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.908+0000 7f1802a00640 1 -- 172.21.15.42:0/2163949933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17fc1a6fa0 con 0x7f17fc104760 2024-08-26T00:04:13.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.909+0000 7f1802a00640 1 -- 172.21.15.42:0/2163949933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17fc104190 con 0x7f17fc104760 2024-08-26T00:04:13.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.911+0000 7f17f9600640 1 -- 172.21.15.42:0/2163949933 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f17e40046c0 con 0x7f17fc104760 2024-08-26T00:04:13.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.913+0000 7f17f9600640 1 --2- 172.21.15.42:0/2163949933 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f17e00a2b80 0x7f17e00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:13.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.913+0000 7f17f9600640 1 -- 172.21.15.42:0/2163949933 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f17e40cf460 con 0x7f17fc104760 2024-08-26T00:04:13.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.913+0000 7f17fbe00640 1 --2- 172.21.15.42:0/2163949933 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f17e00a2b80 0x7f17e00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:13.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.914+0000 7f17fbe00640 1 --2- 172.21.15.42:0/2163949933 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f17e00a2b80 0x7f17e00a5040 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f17ec000c00 tx=0x7f17ec005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:13.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:13.916+0000 7f17f9600640 1 -- 172.21.15.42:0/2163949933 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f17e409c380 con 0x7f17fc104760 2024-08-26T00:04:14.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:14.166+0000 7f1802a00640 1 -- 172.21.15.42:0/2163949933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17fc02d6a0 con 0x7f17fc104760 2024-08-26T00:04:14.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:14.167+0000 7f17f9600640 1 -- 172.21.15.42:0/2163949933 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11913 (secure 0 0 0) 0x7f17e409bc80 con 0x7f17fc104760 2024-08-26T00:04:14.167 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:04:14.167 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":26,"btime":"2024-08-26T00:04:13:129913+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3168581452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3168581452},{"type":"v1","addr":"172.21.15.42:6839","nonce":3168581452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/3533492491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":3533492491},{"type":"v1","addr":"172.21.15.42:6841","nonce":3533492491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-26T00:00:30.169633+0000","modified":"2024-08-26T00:04:13.087250+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24532,"mds_1":24527,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6839/2653014277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2653014277},{"type":"v1","addr":"172.21.15.43:6839","nonce":2653014277}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24532,"qdb_cluster":[24532,24527,24514]},"id":1}]} 2024-08-26T00:04:14.168 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 26 2024-08-26T00:04:14.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:14.169+0000 7f1802a00640 1 -- 172.21.15.42:0/2163949933 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f17e00a2b80 msgr2=0x7f17e00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:14.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:14.169+0000 7f1802a00640 1 --2- 172.21.15.42:0/2163949933 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f17e00a2b80 0x7f17e00a5040 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f17ec000c00 tx=0x7f17ec005b50 comp rx=0 tx=0).stop 2024-08-26T00:04:14.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:14.169+0000 7f1802a00640 1 -- 172.21.15.42:0/2163949933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17fc104760 msgr2=0x7f17fc19a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:14.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:14.169+0000 7f1802a00640 1 --2- 172.21.15.42:0/2163949933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17fc104760 0x7f17fc19a960 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f17e400e9f0 tx=0x7f17e400edf0 comp rx=0 tx=0).stop 2024-08-26T00:04:14.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:14.169+0000 7f1802a00640 1 -- 172.21.15.42:0/2163949933 shutdown_connections 2024-08-26T00:04:14.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:14.169+0000 7f1802a00640 1 --2- 172.21.15.42:0/2163949933 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f17e00a2b80 0x7f17e00a5040 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:14.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:14.169+0000 7f1802a00640 1 --2- 172.21.15.42:0/2163949933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f17fc108ee0 0x7f17fc19ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:14.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:14.169+0000 7f1802a00640 1 --2- 172.21.15.42:0/2163949933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17fc104760 0x7f17fc19a960 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:14.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:14.169+0000 7f1802a00640 1 --2- 172.21.15.42:0/2163949933 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17fc103db0 0x7f17fc19a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:14.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:14.169+0000 7f1802a00640 1 -- 172.21.15.42:0/2163949933 >> 172.21.15.42:0/2163949933 conn(0x7f17fc0ff7f0 msgr2=0x7f17fc100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:14.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:14.169+0000 7f1802a00640 1 -- 172.21.15.42:0/2163949933 shutdown_connections 2024-08-26T00:04:14.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:14.169+0000 7f1802a00640 1 -- 172.21.15.42:0/2163949933 wait complete. 2024-08-26T00:04:14.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:14 smithi043 ceph-mon[22091]: pgmap v390: 97 pgs: 97 active+clean; 4.5 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 85 KiB/s wr, 30 op/s 2024-08-26T00:04:14.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:14 smithi043 ceph-mon[22091]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:04:14.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:14 smithi042 ceph-mon[17225]: pgmap v390: 97 pgs: 97 active+clean; 4.5 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 85 KiB/s wr, 30 op/s 2024-08-26T00:04:14.535 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:14 smithi042 ceph-mon[17225]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:04:14.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:14 smithi181 ceph-mon[22102]: pgmap v390: 97 pgs: 97 active+clean; 4.5 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 85 KiB/s wr, 30 op/s 2024-08-26T00:04:14.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:14 smithi181 ceph-mon[22102]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:04:15.051 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-26T00:04:15.168 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:15 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2163949933' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:04:15.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:15 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/2163949933' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:04:15.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:15 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/2163949933' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:04:15.670 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:04:16.168 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:16 smithi042 ceph-mon[17225]: pgmap v391: 97 pgs: 97 active+clean; 8.3 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 366 KiB/s wr, 20 op/s 2024-08-26T00:04:16.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.400+0000 7f1263c00640 1 -- 172.21.15.42:0/2022388614 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f125c076de0 msgr2=0x7f125c112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:16.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.401+0000 7f1263c00640 1 --2- 172.21.15.42:0/2022388614 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f125c076de0 0x7f125c112290 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1250009900 tx=0x7f125002a410 comp rx=0 tx=0).stop 2024-08-26T00:04:16.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.401+0000 7f1263c00640 1 -- 172.21.15.42:0/2022388614 shutdown_connections 2024-08-26T00:04:16.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.402+0000 7f1263c00640 1 --2- 172.21.15.42:0/2022388614 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f125c1127d0 0x7f125c114bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.402+0000 7f1263c00640 1 --2- 172.21.15.42:0/2022388614 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f125c076de0 0x7f125c112290 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.402+0000 7f1263c00640 1 --2- 172.21.15.42:0/2022388614 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f125c0764c0 0x7f125c0768a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.402+0000 7f1263c00640 1 -- 172.21.15.42:0/2022388614 >> 172.21.15.42:0/2022388614 conn(0x7f125c0ff830 msgr2=0x7f125c101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:16.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.402+0000 7f1263c00640 1 -- 172.21.15.42:0/2022388614 shutdown_connections 2024-08-26T00:04:16.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.402+0000 7f1263c00640 1 -- 172.21.15.42:0/2022388614 wait complete. 2024-08-26T00:04:16.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.409+0000 7f1263c00640 1 Processor -- start 2024-08-26T00:04:16.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.410+0000 7f1263c00640 1 -- start start 2024-08-26T00:04:16.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.411+0000 7f1263c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f125c0764c0 0x7f125c19e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:16.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.412+0000 7f1263c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f125c076de0 0x7f125c19ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:16.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.412+0000 7f1261200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f125c0764c0 0x7f125c19e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:16.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.412+0000 7f1261200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f125c0764c0 0x7f125c19e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:54366/0 (socket says 172.21.15.42:54366) 2024-08-26T00:04:16.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.414+0000 7f125be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f125c076de0 0x7f125c19ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:16.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.414+0000 7f125be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f125c076de0 0x7f125c19ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40974/0 (socket says 172.21.15.42:40974) 2024-08-26T00:04:16.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.415+0000 7f1261200640 1 -- 172.21.15.42:0/4189647950 learned_addr learned my addr 172.21.15.42:0/4189647950 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:16.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.415+0000 7f1263c00640 1 --2- 172.21.15.42:0/4189647950 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f125c1127d0 0x7f125c1a2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:16.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.415+0000 7f1263c00640 1 -- 172.21.15.42:0/4189647950 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f125c118390 con 0x7f125c076de0 2024-08-26T00:04:16.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.415+0000 7f1263c00640 1 -- 172.21.15.42:0/4189647950 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f125c118210 con 0x7f125c0764c0 2024-08-26T00:04:16.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.415+0000 7f1263c00640 1 -- 172.21.15.42:0/4189647950 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f125c118510 con 0x7f125c1127d0 2024-08-26T00:04:16.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.415+0000 7f1261c00640 1 --2- 172.21.15.42:0/4189647950 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f125c1127d0 0x7f125c1a2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:16.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.416+0000 7f1261c00640 1 -- 172.21.15.42:0/4189647950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f125c0764c0 msgr2=0x7f125c19e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:16.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.416+0000 7f1261c00640 1 --2- 172.21.15.42:0/4189647950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f125c0764c0 0x7f125c19e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.416+0000 7f1261c00640 1 -- 172.21.15.42:0/4189647950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f125c076de0 msgr2=0x7f125c19ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:16.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.416+0000 7f1261c00640 1 --2- 172.21.15.42:0/4189647950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f125c076de0 0x7f125c19ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.416+0000 7f1261c00640 1 -- 172.21.15.42:0/4189647950 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f125c1a2740 con 0x7f125c1127d0 2024-08-26T00:04:16.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.417+0000 7f1261200640 1 --2- 172.21.15.42:0/4189647950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f125c0764c0 0x7f125c19e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:04:16.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.417+0000 7f125be00640 1 --2- 172.21.15.42:0/4189647950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f125c076de0 0x7f125c19ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:04:16.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.419+0000 7f1261c00640 1 --2- 172.21.15.42:0/4189647950 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f125c1127d0 0x7f125c1a2010 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f125c07a7b0 tx=0x7f125400edd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:16.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.419+0000 7f1259600640 1 -- 172.21.15.42:0/4189647950 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1254004d20 con 0x7f125c1127d0 2024-08-26T00:04:16.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.420+0000 7f1259600640 1 -- 172.21.15.42:0/4189647950 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1254005020 con 0x7f125c1127d0 2024-08-26T00:04:16.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.420+0000 7f1259600640 1 -- 172.21.15.42:0/4189647950 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12540116d0 con 0x7f125c1127d0 2024-08-26T00:04:16.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.420+0000 7f1263c00640 1 -- 172.21.15.42:0/4189647950 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f125c1a2a30 con 0x7f125c1127d0 2024-08-26T00:04:16.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.420+0000 7f1263c00640 1 -- 172.21.15.42:0/4189647950 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f125c1ab3a0 con 0x7f125c1127d0 2024-08-26T00:04:16.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.429+0000 7f1266322740 1 Processor -- start 2024-08-26T00:04:16.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.431+0000 7f1259600640 1 -- 172.21.15.42:0/4189647950 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1254005540 con 0x7f125c1127d0 2024-08-26T00:04:16.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.431+0000 7f1266322740 1 -- start start 2024-08-26T00:04:16.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.431+0000 7f1266322740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91956820 0x555c91956c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:16.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.431+0000 7f1266322740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555c91957140 0x555c919614c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:16.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.431+0000 7f1266322740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91961a00 0x555c91963df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:16.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.431+0000 7f1266322740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555c918bcf30 con 0x555c91956820 2024-08-26T00:04:16.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.431+0000 7f1266322740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555c918545a0 con 0x555c91961a00 2024-08-26T00:04:16.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.432+0000 7f1266322740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x555c918b8ef0 con 0x555c91957140 2024-08-26T00:04:16.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.432+0000 7f125be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91956820 0x555c91956c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:16.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.433+0000 7f125be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91956820 0x555c91956c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40976/0 (socket says 172.21.15.42:40976) 2024-08-26T00:04:16.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.433+0000 7f125be00640 1 -- 172.21.15.42:0/3658889440 learned_addr learned my addr 172.21.15.42:0/3658889440 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:16.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.433+0000 7f125be00640 1 --2- 172.21.15.42:0/3658889440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91961a00 0x555c91963df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:16.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.433+0000 7f1259600640 1 --2- 172.21.15.42:0/4189647950 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f12440a2c80 0x7f12440a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:16.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.433+0000 7f125be00640 1 -- 172.21.15.42:0/3658889440 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555c91957140 msgr2=0x555c919614c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:04:16.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.433+0000 7f125be00640 1 --2- 172.21.15.42:0/3658889440 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555c91957140 0x555c919614c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.433+0000 7f125be00640 1 -- 172.21.15.42:0/3658889440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91961a00 msgr2=0x555c91963df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:16.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.433+0000 7f125be00640 1 --2- 172.21.15.42:0/3658889440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91961a00 0x555c91963df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.433+0000 7f125be00640 1 -- 172.21.15.42:0/3658889440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c9162e3c0 con 0x555c91956820 2024-08-26T00:04:16.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.433+0000 7f1259600640 1 -- 172.21.15.42:0/4189647950 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f12540cf0f0 con 0x7f125c1127d0 2024-08-26T00:04:16.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.434+0000 7f125be00640 1 --2- 172.21.15.42:0/3658889440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91956820 0x555c91956c00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1250004650 tx=0x7f1250031420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf141b9b2624ed4 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:16.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.434+0000 7f1261c00640 1 --2- 172.21.15.42:0/4189647950 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f12440a2c80 0x7f12440a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:16.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.434+0000 7f124e000640 1 -- 172.21.15.42:0/3658889440 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1250035030 con 0x555c91956820 2024-08-26T00:04:16.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.435+0000 7f124e000640 1 -- 172.21.15.42:0/3658889440 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1250003d80 con 0x555c91956820 2024-08-26T00:04:16.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.435+0000 7f124e000640 1 -- 172.21.15.42:0/3658889440 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1250035030 con 0x555c91956820 2024-08-26T00:04:16.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.436+0000 7f1266322740 1 -- 172.21.15.42:0/3658889440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91956820 msgr2=0x555c91956c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:16.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.436+0000 7f1266322740 1 --2- 172.21.15.42:0/3658889440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91956820 0x555c91956c00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1250004650 tx=0x7f1250031420 comp rx=0 tx=0).stop 2024-08-26T00:04:16.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.436+0000 7f1261c00640 1 --2- 172.21.15.42:0/4189647950 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f12440a2c80 0x7f12440a5140 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f125409b610 tx=0x7f1254005830 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:16.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.438+0000 7f1266322740 1 -- 172.21.15.42:0/3658889440 shutdown_connections 2024-08-26T00:04:16.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.438+0000 7f1266322740 1 --2- 172.21.15.42:0/3658889440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91961a00 0x555c91963df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.438+0000 7f1266322740 1 --2- 172.21.15.42:0/3658889440 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555c91957140 0x555c919614c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.438+0000 7f1266322740 1 --2- 172.21.15.42:0/3658889440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91956820 0x555c91956c00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.438+0000 7f1266322740 1 -- 172.21.15.42:0/3658889440 >> 172.21.15.42:0/3658889440 conn(0x555c91952db0 msgr2=0x555c91953190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:16.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.438+0000 7f1266322740 1 -- 172.21.15.42:0/3658889440 shutdown_connections 2024-08-26T00:04:16.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.438+0000 7f1266322740 1 -- 172.21.15.42:0/3658889440 wait complete. 2024-08-26T00:04:16.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.439+0000 7f1266322740 1 -- start start 2024-08-26T00:04:16.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.439+0000 7f1266322740 1 Processor -- start 2024-08-26T00:04:16.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.440+0000 7f1266322740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555c91956820 0x555c9195e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:16.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.440+0000 7f1266322740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91957140 0x555c9195eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:16.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.440+0000 7f1266322740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91961a00 0x555c9195f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:16.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.440+0000 7f1266322740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555c919755e0 con 0x555c91961a00 2024-08-26T00:04:16.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.440+0000 7f1266322740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555c91877de0 con 0x555c91957140 2024-08-26T00:04:16.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.440+0000 7f1266322740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x555c91975760 con 0x555c91956820 2024-08-26T00:04:16.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.440+0000 7f1266322740 10 client.0 _ll_register_callbacks cb 0x555c918667b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:04:16.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.440+0000 7f1261200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91957140 0x555c9195eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:16.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.440+0000 7f1261200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91957140 0x555c9195eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:54378/0 (socket says 172.21.15.42:54378) 2024-08-26T00:04:16.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.440+0000 7f1261200640 1 -- 172.21.15.42:0/1403536833 learned_addr learned my addr 172.21.15.42:0/1403536833 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:16.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.441+0000 7f1261200640 1 -- 172.21.15.42:0/1403536833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555c91956820 msgr2=0x555c9195e970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-26T00:04:16.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.441+0000 7f1261200640 1 --2- 172.21.15.42:0/1403536833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555c91956820 0x555c9195e970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.441+0000 7f1261200640 1 -- 172.21.15.42:0/1403536833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91961a00 msgr2=0x555c9195f3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:04:16.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.442+0000 7f125be00640 1 --2- 172.21.15.42:0/1403536833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91961a00 0x555c9195f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:16.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.442+0000 7f1261200640 1 --2- 172.21.15.42:0/1403536833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91961a00 0x555c9195f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.442+0000 7f1261200640 1 -- 172.21.15.42:0/1403536833 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c9197ead0 con 0x555c91957140 2024-08-26T00:04:16.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.443+0000 7f125be00640 1 --2- 172.21.15.42:0/1403536833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91961a00 0x555c9195f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:04:16.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.447+0000 7f1261200640 1 --2- 172.21.15.42:0/1403536833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91957140 0x555c9195eeb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f124800d6e0 tx=0x7f124800dba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f68c65291c6e366 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:16.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.447+0000 7f1242a00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:04:16.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.447+0000 7f1242a00640 1 -- 172.21.15.42:0/1403536833 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1248008a70 con 0x555c91957140 2024-08-26T00:04:16.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.448+0000 7f1242a00640 1 -- 172.21.15.42:0/1403536833 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f1248008c10 con 0x555c91957140 2024-08-26T00:04:16.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.449+0000 7f1266322740 1 -- 172.21.15.42:0/1403536833 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1250003d80 con 0x555c91957140 2024-08-26T00:04:16.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.449+0000 7f1242a00640 1 -- 172.21.15.42:0/1403536833 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1248008e10 con 0x555c91957140 2024-08-26T00:04:16.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.452+0000 7f1266322740 10 client.25370 fetch_fsmap learned FSMap version 26 2024-08-26T00:04:16.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.452+0000 7f1266322740 1 -- 172.21.15.42:0/1403536833 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555c919814f0 con 0x555c91957140 2024-08-26T00:04:16.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.452+0000 7f1242a00640 1 -- 172.21.15.42:0/1403536833 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1250003d80 con 0x555c91957140 2024-08-26T00:04:16.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.453+0000 7f1242a00640 1 -- 172.21.15.42:0/1403536833 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f1248017470 con 0x555c91957140 2024-08-26T00:04:16.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.453+0000 7f1266322740 10 client.25370 fetch_fsmap finished waiting for FSMap version 26 2024-08-26T00:04:16.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.453+0000 7f1266322740 10 client.25370 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-26T00:04:16.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.454+0000 7f1266322740 20 client.25370 populate_metadata read hostname 'smithi042' 2024-08-26T00:04:16.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.454+0000 7f1266322740 1 --2- 172.21.15.42:0/1403536833 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x555c919829b0 0x555c91984da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:16.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.454+0000 7f1266322740 4 client.25370 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:04:16.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.454+0000 7f1266322740 1 -- 172.21.15.42:0/1403536833 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c918ca4a0 con 0x555c919829b0 2024-08-26T00:04:16.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.457+0000 7f125be00640 1 --2- 172.21.15.42:0/1403536833 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x555c919829b0 0x555c91984da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:16.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.458+0000 7f125be00640 1 --2- 172.21.15.42:0/1403536833 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x555c919829b0 0x555c91984da0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5ab53f7377ddd587 server_cookie=2fd211d251d892b3 in_seq=0 out_seq=0 2024-08-26T00:04:16.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.458+0000 7f1242a00640 10 client.25370 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:04:16.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.459+0000 7f1242a00640 1 -- 172.21.15.42:0/1403536833 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555c918ca4a0 con 0x555c919829b0 2024-08-26T00:04:16.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.459+0000 7f1242a00640 10 client.25370 handle_command_reply: tid=0 2024-08-26T00:04:16.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.459+0000 7f1266322740 1 client.25370 shutdown 2024-08-26T00:04:16.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.460+0000 7f1266322740 1 -- 172.21.15.42:0/1403536833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91957140 msgr2=0x555c9195eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:16.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.460+0000 7f1266322740 1 --2- 172.21.15.42:0/1403536833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91957140 0x555c9195eeb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f124800d6e0 tx=0x7f124800dba0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.460+0000 7f1266322740 1 -- 172.21.15.42:0/1403536833 shutdown_connections 2024-08-26T00:04:16.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.460+0000 7f1266322740 1 --2- 172.21.15.42:0/1403536833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91961a00 0x555c9195f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.460+0000 7f1266322740 1 --2- 172.21.15.42:0/1403536833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91957140 0x555c9195eeb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.460+0000 7f1266322740 1 --2- 172.21.15.42:0/1403536833 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x555c919829b0 0x555c91984da0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.460+0000 7f1266322740 1 --2- 172.21.15.42:0/1403536833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555c91956820 0x555c9195e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.460+0000 7f1266322740 1 -- 172.21.15.42:0/1403536833 >> 172.21.15.42:0/1403536833 conn(0x555c91952db0 msgr2=0x555c91951f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:16.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.460+0000 7f1242a00640 0 client.25370 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:04:16.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.460+0000 7f1266322740 1 -- 172.21.15.42:0/1403536833 shutdown_connections 2024-08-26T00:04:16.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.460+0000 7f1266322740 1 -- 172.21.15.42:0/1403536833 wait complete. 2024-08-26T00:04:16.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.461+0000 7f1266322740 20 client.25370 trim_cache size 0 max 16384 2024-08-26T00:04:16.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.489+0000 7f1266322740 1 Processor -- start 2024-08-26T00:04:16.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.489+0000 7f1266322740 1 -- start start 2024-08-26T00:04:16.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.490+0000 7f1266322740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91956820 0x555c91959280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:16.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.490+0000 7f1266322740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555c91957140 0x555c9195f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:16.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.490+0000 7f1266322740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91961a00 0x555c919607d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:16.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.490+0000 7f1266322740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f125c1ad9c0 con 0x555c91961a00 2024-08-26T00:04:16.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.490+0000 7f1266322740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f125c10d0b0 con 0x555c91956820 2024-08-26T00:04:16.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.490+0000 7f1266322740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f125c0768a0 con 0x555c91957140 2024-08-26T00:04:16.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.490+0000 7f125be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91956820 0x555c91959280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:16.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.490+0000 7f125be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91956820 0x555c91959280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:54384/0 (socket says 172.21.15.42:54384) 2024-08-26T00:04:16.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.490+0000 7f125be00640 1 -- 172.21.15.42:0/715298970 learned_addr learned my addr 172.21.15.42:0/715298970 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:16.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.490+0000 7f125be00640 1 --2- 172.21.15.42:0/715298970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91961a00 0x555c919607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:16.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.491+0000 7f125be00640 1 -- 172.21.15.42:0/715298970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555c91957140 msgr2=0x555c9195f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:16.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.491+0000 7f1261200640 1 --2- 172.21.15.42:0/715298970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555c91957140 0x555c9195f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:16.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.491+0000 7f125be00640 1 --2- 172.21.15.42:0/715298970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555c91957140 0x555c9195f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.491+0000 7f125be00640 1 -- 172.21.15.42:0/715298970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91961a00 msgr2=0x555c919607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:16.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.491+0000 7f125be00640 1 --2- 172.21.15.42:0/715298970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91961a00 0x555c919607d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.491+0000 7f125be00640 1 -- 172.21.15.42:0/715298970 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c9195cee0 con 0x555c91956820 2024-08-26T00:04:16.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.491+0000 7f125be00640 1 --2- 172.21.15.42:0/715298970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91956820 0x555c91959280 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1250001eb0 tx=0x7f1250041040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0412430285cbe0a server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:16.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.492+0000 7f124d600640 1 -- 172.21.15.42:0/715298970 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1250035040 con 0x555c91956820 2024-08-26T00:04:16.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.492+0000 7f124d600640 1 -- 172.21.15.42:0/715298970 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1250005550 con 0x555c91956820 2024-08-26T00:04:16.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.492+0000 7f124d600640 1 -- 172.21.15.42:0/715298970 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1250004c80 con 0x555c91956820 2024-08-26T00:04:16.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.493+0000 7f1266322740 1 -- 172.21.15.42:0/715298970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91956820 msgr2=0x555c91959280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:16.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.493+0000 7f1266322740 1 --2- 172.21.15.42:0/715298970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91956820 0x555c91959280 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1250001eb0 tx=0x7f1250041040 comp rx=0 tx=0).stop 2024-08-26T00:04:16.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.493+0000 7f1266322740 1 -- 172.21.15.42:0/715298970 shutdown_connections 2024-08-26T00:04:16.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.493+0000 7f1266322740 1 --2- 172.21.15.42:0/715298970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91961a00 0x555c919607d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.493+0000 7f1266322740 1 --2- 172.21.15.42:0/715298970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555c91957140 0x555c9195f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.493+0000 7f1266322740 1 --2- 172.21.15.42:0/715298970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91956820 0x555c91959280 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.493+0000 7f1266322740 1 -- 172.21.15.42:0/715298970 >> 172.21.15.42:0/715298970 conn(0x555c91952db0 msgr2=0x555c919600c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:16.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.493+0000 7f1266322740 1 -- 172.21.15.42:0/715298970 shutdown_connections 2024-08-26T00:04:16.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.493+0000 7f1266322740 1 -- 172.21.15.42:0/715298970 wait complete. 2024-08-26T00:04:16.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.493+0000 7f1266322740 1 -- start start 2024-08-26T00:04:16.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.494+0000 7f1266322740 1 Processor -- start 2024-08-26T00:04:16.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.495+0000 7f1266322740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91956820 0x555c9197af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:16.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.495+0000 7f1266322740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555c91957140 0x555c9195b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:16.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.495+0000 7f1266322740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91961a00 0x555c9195ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:16.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.495+0000 7f1266322740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f125c10b570 con 0x555c91956820 2024-08-26T00:04:16.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.495+0000 7f1266322740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f125c10c9e0 con 0x555c91961a00 2024-08-26T00:04:16.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.495+0000 7f1266322740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f125c10bc40 con 0x555c91957140 2024-08-26T00:04:16.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.495+0000 7f1266322740 10 client.0 _ll_register_callbacks cb 0x7f124800b380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:04:16.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.495+0000 7f1261200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555c91957140 0x555c9195b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:16.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.495+0000 7f1261200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555c91957140 0x555c9195b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:52482/0 (socket says 172.21.15.42:52482) 2024-08-26T00:04:16.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.495+0000 7f1261200640 1 -- 172.21.15.42:0/4103169563 learned_addr learned my addr 172.21.15.42:0/4103169563 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:16.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.495+0000 7f125be00640 1 --2- 172.21.15.42:0/4103169563 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91956820 0x555c9197af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:16.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.495+0000 7f125be00640 1 --2- 172.21.15.42:0/4103169563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91961a00 0x555c9195ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:16.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.496+0000 7f1261200640 1 -- 172.21.15.42:0/4103169563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91961a00 msgr2=0x555c9195ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:16.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.496+0000 7f1261200640 1 --2- 172.21.15.42:0/4103169563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91961a00 0x555c9195ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.496+0000 7f1261200640 1 -- 172.21.15.42:0/4103169563 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91956820 msgr2=0x555c9197af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:16.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.496+0000 7f1261200640 1 --2- 172.21.15.42:0/4103169563 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91956820 0x555c9197af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.496+0000 7f1261200640 1 -- 172.21.15.42:0/4103169563 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c9195c170 con 0x555c91957140 2024-08-26T00:04:16.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.496+0000 7f125be00640 1 --2- 172.21.15.42:0/4103169563 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91956820 0x555c9197af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:04:16.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.497+0000 7f1261200640 1 --2- 172.21.15.42:0/4103169563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555c91957140 0x555c9195b540 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f12480178c0 tx=0x7f124800b5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=381d13091925d875 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:16.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.497+0000 7f1242a00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:04:16.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.497+0000 7f1242a00640 1 -- 172.21.15.42:0/4103169563 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1248026040 con 0x555c91957140 2024-08-26T00:04:16.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.498+0000 7f1242a00640 1 -- 172.21.15.42:0/4103169563 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f1248008870 con 0x555c91957140 2024-08-26T00:04:16.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.498+0000 7f1266322740 1 -- 172.21.15.42:0/4103169563 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1250005550 con 0x555c91957140 2024-08-26T00:04:16.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.498+0000 7f1242a00640 1 -- 172.21.15.42:0/4103169563 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1248008a70 con 0x555c91957140 2024-08-26T00:04:16.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.499+0000 7f1266322740 10 client.25372 fetch_fsmap learned FSMap version 26 2024-08-26T00:04:16.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.499+0000 7f1266322740 1 -- 172.21.15.42:0/4103169563 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555c919ed520 con 0x555c91957140 2024-08-26T00:04:16.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.499+0000 7f1242a00640 1 -- 172.21.15.42:0/4103169563 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1250005550 con 0x555c91957140 2024-08-26T00:04:16.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.499+0000 7f1242a00640 1 -- 172.21.15.42:0/4103169563 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f1248004900 con 0x555c91957140 2024-08-26T00:04:16.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.500+0000 7f1266322740 10 client.25372 fetch_fsmap finished waiting for FSMap version 26 2024-08-26T00:04:16.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.500+0000 7f1266322740 10 client.25372 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-26T00:04:16.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.500+0000 7f1266322740 20 client.25372 populate_metadata read hostname 'smithi042' 2024-08-26T00:04:16.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.500+0000 7f1266322740 1 --2- 172.21.15.42:0/4103169563 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x555c919edcb0 0x555c919f00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:16.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.500+0000 7f1266322740 4 client.25372 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:04:16.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.500+0000 7f1266322740 1 -- 172.21.15.42:0/4103169563 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555c918c49b0 con 0x555c919edcb0 2024-08-26T00:04:16.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.501+0000 7f125be00640 1 --2- 172.21.15.42:0/4103169563 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x555c919edcb0 0x555c919f00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:16.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.502+0000 7f125be00640 1 --2- 172.21.15.42:0/4103169563 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x555c919edcb0 0x555c919f00d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b73cca73132e2763 server_cookie=1f5de28e1c12ca85 in_seq=0 out_seq=0 2024-08-26T00:04:16.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.502+0000 7f1242a00640 10 client.25372 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:04:16.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.502+0000 7f1242a00640 1 -- 172.21.15.42:0/4103169563 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555c918c49b0 con 0x555c919edcb0 2024-08-26T00:04:16.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.502+0000 7f1242a00640 10 client.25372 handle_command_reply: tid=0 2024-08-26T00:04:16.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.502+0000 7f1266322740 1 client.25372 shutdown 2024-08-26T00:04:16.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.502+0000 7f1266322740 1 -- 172.21.15.42:0/4103169563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555c91957140 msgr2=0x555c9195b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:16.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.502+0000 7f1266322740 1 --2- 172.21.15.42:0/4103169563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555c91957140 0x555c9195b540 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f12480178c0 tx=0x7f124800b5d0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.503+0000 7f1266322740 1 -- 172.21.15.42:0/4103169563 shutdown_connections 2024-08-26T00:04:16.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.503+0000 7f1266322740 1 --2- 172.21.15.42:0/4103169563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c91961a00 0x555c9195ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.503+0000 7f1266322740 1 --2- 172.21.15.42:0/4103169563 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x555c919edcb0 0x555c919f00d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.503+0000 7f1266322740 1 --2- 172.21.15.42:0/4103169563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555c91957140 0x555c9195b540 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.503+0000 7f1266322740 1 --2- 172.21.15.42:0/4103169563 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c91956820 0x555c9197af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.503+0000 7f1242a00640 0 client.25372 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:04:16.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.503+0000 7f1266322740 1 -- 172.21.15.42:0/4103169563 >> 172.21.15.42:0/4103169563 conn(0x555c91952db0 msgr2=0x555c91960800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:16.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.503+0000 7f1266322740 1 -- 172.21.15.42:0/4103169563 shutdown_connections 2024-08-26T00:04:16.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.503+0000 7f1266322740 1 -- 172.21.15.42:0/4103169563 wait complete. 2024-08-26T00:04:16.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.504+0000 7f1266322740 20 client.25372 trim_cache size 0 max 16384 2024-08-26T00:04:16.505 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:04:16.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.505+0000 7f1263c00640 1 -- 172.21.15.42:0/4189647950 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f12440a2c80 msgr2=0x7f12440a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:16.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.505+0000 7f1263c00640 1 --2- 172.21.15.42:0/4189647950 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f12440a2c80 0x7f12440a5140 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f125409b610 tx=0x7f1254005830 comp rx=0 tx=0).stop 2024-08-26T00:04:16.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.505+0000 7f1263c00640 1 -- 172.21.15.42:0/4189647950 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f125c1127d0 msgr2=0x7f125c1a2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:16.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.505+0000 7f1263c00640 1 --2- 172.21.15.42:0/4189647950 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f125c1127d0 0x7f125c1a2010 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f125c07a7b0 tx=0x7f125400edd0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.505+0000 7f1263c00640 1 -- 172.21.15.42:0/4189647950 shutdown_connections 2024-08-26T00:04:16.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.505+0000 7f1263c00640 1 --2- 172.21.15.42:0/4189647950 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f12440a2c80 0x7f12440a5140 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.505+0000 7f1263c00640 1 --2- 172.21.15.42:0/4189647950 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f125c1127d0 0x7f125c1a2010 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.505+0000 7f1263c00640 1 --2- 172.21.15.42:0/4189647950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f125c076de0 0x7f125c19ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.505+0000 7f1263c00640 1 --2- 172.21.15.42:0/4189647950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f125c0764c0 0x7f125c19e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:16.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.505+0000 7f1263c00640 1 -- 172.21.15.42:0/4189647950 >> 172.21.15.42:0/4189647950 conn(0x7f125c0ff830 msgr2=0x7f125c101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:16.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.505+0000 7f1263c00640 1 -- 172.21.15.42:0/4189647950 shutdown_connections 2024-08-26T00:04:16.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:16.505+0000 7f1263c00640 1 -- 172.21.15.42:0/4189647950 wait complete. 2024-08-26T00:04:16.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:16 smithi043 ceph-mon[22091]: pgmap v391: 97 pgs: 97 active+clean; 8.3 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 366 KiB/s wr, 20 op/s 2024-08-26T00:04:16.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:16 smithi181 ceph-mon[22102]: pgmap v391: 97 pgs: 97 active+clean; 8.3 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 366 KiB/s wr, 20 op/s 2024-08-26T00:04:17.627 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-26T00:04:18.079 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:04:18.488 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:18 smithi042 ceph-mon[17225]: pgmap v392: 97 pgs: 97 active+clean; 8.3 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 395 KiB/s wr, 23 op/s 2024-08-26T00:04:18.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:18 smithi181 ceph-mon[22102]: pgmap v392: 97 pgs: 97 active+clean; 8.3 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 395 KiB/s wr, 23 op/s 2024-08-26T00:04:18.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:18 smithi043 ceph-mon[22091]: pgmap v392: 97 pgs: 97 active+clean; 8.3 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 395 KiB/s wr, 23 op/s 2024-08-26T00:04:18.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.887+0000 7ff1d2800640 1 -- 172.21.15.42:0/2766808489 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1cc074bd0 msgr2=0x7ff1cc10dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:18.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.887+0000 7ff1d2800640 1 --2- 172.21.15.42:0/2766808489 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1cc074bd0 0x7ff1cc10dae0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8009900 tx=0x7ff1b802a480 comp rx=0 tx=0).stop 2024-08-26T00:04:18.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.887+0000 7ff1d2800640 1 -- 172.21.15.42:0/2766808489 shutdown_connections 2024-08-26T00:04:18.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.887+0000 7ff1d2800640 1 --2- 172.21.15.42:0/2766808489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1cc10e020 0x7ff1cc110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.887+0000 7ff1d2800640 1 --2- 172.21.15.42:0/2766808489 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1cc074bd0 0x7ff1cc10dae0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.887+0000 7ff1d2800640 1 --2- 172.21.15.42:0/2766808489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1cc0742b0 0x7ff1cc074690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.887+0000 7ff1d2800640 1 -- 172.21.15.42:0/2766808489 >> 172.21.15.42:0/2766808489 conn(0x7ff1cc0fd4e0 msgr2=0x7ff1cc0ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:18.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.887+0000 7ff1d2800640 1 -- 172.21.15.42:0/2766808489 shutdown_connections 2024-08-26T00:04:18.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.887+0000 7ff1d2800640 1 -- 172.21.15.42:0/2766808489 wait complete. 2024-08-26T00:04:18.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.889+0000 7ff1d2800640 1 Processor -- start 2024-08-26T00:04:18.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.889+0000 7ff1d2800640 1 -- start start 2024-08-26T00:04:18.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.889+0000 7ff1d2800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1cc0742b0 0x7ff1cc19a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:18.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.889+0000 7ff1d2800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1cc074bd0 0x7ff1cc19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:18.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.889+0000 7ff1d2800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1cc10e020 0x7ff1cc19eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:18.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.889+0000 7ff1d2800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc113d70 con 0x7ff1cc074bd0 2024-08-26T00:04:18.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.889+0000 7ff1d2800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc113bf0 con 0x7ff1cc0742b0 2024-08-26T00:04:18.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.889+0000 7ff1d2800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc113ef0 con 0x7ff1cc10e020 2024-08-26T00:04:18.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.890+0000 7ff1d1400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1cc0742b0 0x7ff1cc19a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:18.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.890+0000 7ff1d1400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1cc0742b0 0x7ff1cc19a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:54404/0 (socket says 172.21.15.42:54404) 2024-08-26T00:04:18.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.890+0000 7ff1d1400640 1 -- 172.21.15.42:0/1729574350 learned_addr learned my addr 172.21.15.42:0/1729574350 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:18.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.890+0000 7ff1d0a00640 1 --2- 172.21.15.42:0/1729574350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1cc074bd0 0x7ff1cc19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:18.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.890+0000 7ff1d1e00640 1 --2- 172.21.15.42:0/1729574350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1cc10e020 0x7ff1cc19eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:18.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.890+0000 7ff1d1400640 1 -- 172.21.15.42:0/1729574350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1cc10e020 msgr2=0x7ff1cc19eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:18.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.890+0000 7ff1d1400640 1 --2- 172.21.15.42:0/1729574350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1cc10e020 0x7ff1cc19eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.890+0000 7ff1d1400640 1 -- 172.21.15.42:0/1729574350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1cc074bd0 msgr2=0x7ff1cc19a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:18.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.890+0000 7ff1d1400640 1 --2- 172.21.15.42:0/1729574350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1cc074bd0 0x7ff1cc19a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.890+0000 7ff1d1400640 1 -- 172.21.15.42:0/1729574350 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1cc19f260 con 0x7ff1cc0742b0 2024-08-26T00:04:18.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.890+0000 7ff1d0a00640 1 --2- 172.21.15.42:0/1729574350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1cc074bd0 0x7ff1cc19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:04:18.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.890+0000 7ff1d1400640 1 --2- 172.21.15.42:0/1729574350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1cc0742b0 0x7ff1cc19a2b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000ea60 tx=0x7ff1c000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:18.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.890+0000 7ff1ca000640 1 -- 172.21.15.42:0/1729574350 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000cde0 con 0x7ff1cc0742b0 2024-08-26T00:04:18.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.891+0000 7ff1ca000640 1 -- 172.21.15.42:0/1729574350 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1c00035f0 con 0x7ff1cc0742b0 2024-08-26T00:04:18.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.891+0000 7ff1d2800640 1 -- 172.21.15.42:0/1729574350 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1cc19f550 con 0x7ff1cc0742b0 2024-08-26T00:04:18.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.891+0000 7ff1ca000640 1 -- 172.21.15.42:0/1729574350 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0010670 con 0x7ff1cc0742b0 2024-08-26T00:04:18.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.891+0000 7ff1d2800640 1 -- 172.21.15.42:0/1729574350 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1cc1a6e30 con 0x7ff1cc0742b0 2024-08-26T00:04:18.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.894+0000 7ff1d6a13740 1 Processor -- start 2024-08-26T00:04:18.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.894+0000 7ff1ca000640 1 -- 172.21.15.42:0/1729574350 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff1c00037a0 con 0x7ff1cc0742b0 2024-08-26T00:04:18.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.894+0000 7ff1d6a13740 1 -- start start 2024-08-26T00:04:18.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.895+0000 7ff1d6a13740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654195b0a30 0x5654195b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:18.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.895+0000 7ff1d6a13740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654195b1350 0x5654195bb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:18.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.895+0000 7ff1d6a13740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195bbc10 0x5654195be000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:18.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.895+0000 7ff1d6a13740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x565419516f30 con 0x5654195b0a30 2024-08-26T00:04:18.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.895+0000 7ff1d6a13740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5654194ae5a0 con 0x5654195bbc10 2024-08-26T00:04:18.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.895+0000 7ff1d6a13740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x565419512ef0 con 0x5654195b1350 2024-08-26T00:04:18.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.895+0000 7ff1d0a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195bbc10 0x5654195be000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:18.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.895+0000 7ff1d1400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654195b1350 0x5654195bb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:18.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.895+0000 7ff1d1e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654195b0a30 0x5654195b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:18.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.895+0000 7ff1d0a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195bbc10 0x5654195be000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:54410/0 (socket says 172.21.15.42:54410) 2024-08-26T00:04:18.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.895+0000 7ff1d0a00640 1 -- 172.21.15.42:0/2574616097 learned_addr learned my addr 172.21.15.42:0/2574616097 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:18.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.895+0000 7ff1d0a00640 1 -- 172.21.15.42:0/2574616097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654195b1350 msgr2=0x5654195bb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:18.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.895+0000 7ff1d0a00640 1 --2- 172.21.15.42:0/2574616097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654195b1350 0x5654195bb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.895+0000 7ff1d0a00640 1 -- 172.21.15.42:0/2574616097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654195b0a30 msgr2=0x5654195b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:18.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.895+0000 7ff1d0a00640 1 --2- 172.21.15.42:0/2574616097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654195b0a30 0x5654195b0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.895+0000 7ff1d0a00640 1 -- 172.21.15.42:0/2574616097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654192883c0 con 0x5654195bbc10 2024-08-26T00:04:18.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.896+0000 7ff1d0a00640 1 --2- 172.21.15.42:0/2574616097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195bbc10 0x5654195be000 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8009230 tx=0x7ff1b80040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce0637aebc4dc7c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:18.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.896+0000 7ff1be600640 1 -- 172.21.15.42:0/2574616097 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8035030 con 0x5654195bbc10 2024-08-26T00:04:18.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.896+0000 7ff1be600640 1 -- 172.21.15.42:0/2574616097 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1b8005520 con 0x5654195bbc10 2024-08-26T00:04:18.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.896+0000 7ff1be600640 1 -- 172.21.15.42:0/2574616097 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b80035f0 con 0x5654195bbc10 2024-08-26T00:04:18.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.897+0000 7ff1ca000640 1 --2- 172.21.15.42:0/1729574350 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff1b40a2b80 0x7ff1b40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:18.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.897+0000 7ff1ca000640 1 -- 172.21.15.42:0/1729574350 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7ff1c00cf4c0 con 0x7ff1cc0742b0 2024-08-26T00:04:18.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.897+0000 7ff1d6a13740 1 -- 172.21.15.42:0/2574616097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195bbc10 msgr2=0x5654195be000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:18.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.897+0000 7ff1d6a13740 1 --2- 172.21.15.42:0/2574616097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195bbc10 0x5654195be000 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8009230 tx=0x7ff1b80040c0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.897+0000 7ff1d1e00640 1 --2- 172.21.15.42:0/1729574350 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff1b40a2b80 0x7ff1b40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:18.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.897+0000 7ff1d6a13740 1 -- 172.21.15.42:0/2574616097 shutdown_connections 2024-08-26T00:04:18.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.897+0000 7ff1d6a13740 1 --2- 172.21.15.42:0/2574616097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195bbc10 0x5654195be000 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.897+0000 7ff1d6a13740 1 --2- 172.21.15.42:0/2574616097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654195b1350 0x5654195bb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.897+0000 7ff1d6a13740 1 --2- 172.21.15.42:0/2574616097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654195b0a30 0x5654195b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.897+0000 7ff1d6a13740 1 -- 172.21.15.42:0/2574616097 >> 172.21.15.42:0/2574616097 conn(0x5654195acfc0 msgr2=0x5654195ad3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:18.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.897+0000 7ff1d6a13740 1 -- 172.21.15.42:0/2574616097 shutdown_connections 2024-08-26T00:04:18.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.897+0000 7ff1d6a13740 1 -- 172.21.15.42:0/2574616097 wait complete. 2024-08-26T00:04:18.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.898+0000 7ff1d1e00640 1 --2- 172.21.15.42:0/1729574350 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff1b40a2b80 0x7ff1b40a5040 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40092f0 tx=0x7ff1c4009280 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:18.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.898+0000 7ff1d6a13740 1 -- start start 2024-08-26T00:04:18.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.898+0000 7ff1d6a13740 1 Processor -- start 2024-08-26T00:04:18.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.898+0000 7ff1d6a13740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654195b0a30 0x5654195b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:18.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.898+0000 7ff1d6a13740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195b1350 0x5654195b8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:18.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.898+0000 7ff1d6a13740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654195bbc10 0x5654195b94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:18.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.898+0000 7ff1d6a13740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5654195be7e0 con 0x5654195b0a30 2024-08-26T00:04:18.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.898+0000 7ff1d6a13740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5654194d1de0 con 0x5654195b1350 2024-08-26T00:04:18.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.898+0000 7ff1d6a13740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5654195be960 con 0x5654195bbc10 2024-08-26T00:04:18.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.899+0000 7ff1d6a13740 10 client.0 _ll_register_callbacks cb 0x5654194c07b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:04:18.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.899+0000 7ff1d0a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195b1350 0x5654195b8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:18.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.899+0000 7ff1d0a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195b1350 0x5654195b8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:54426/0 (socket says 172.21.15.42:54426) 2024-08-26T00:04:18.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.899+0000 7ff1d0a00640 1 -- 172.21.15.42:0/2128141864 learned_addr learned my addr 172.21.15.42:0/2128141864 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:18.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.899+0000 7ff1d1400640 1 --2- 172.21.15.42:0/2128141864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654195b0a30 0x5654195b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:18.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.899+0000 7ff1d1e00640 1 --2- 172.21.15.42:0/2128141864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654195bbc10 0x5654195b94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:18.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.899+0000 7ff1d0a00640 1 -- 172.21.15.42:0/2128141864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654195bbc10 msgr2=0x5654195b94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:18.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.899+0000 7ff1d0a00640 1 --2- 172.21.15.42:0/2128141864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654195bbc10 0x5654195b94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.899+0000 7ff1d0a00640 1 -- 172.21.15.42:0/2128141864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654195b0a30 msgr2=0x5654195b8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:18.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.899+0000 7ff1d0a00640 1 --2- 172.21.15.42:0/2128141864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654195b0a30 0x5654195b8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.899+0000 7ff1d0a00640 1 -- 172.21.15.42:0/2128141864 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654195c7cb0 con 0x5654195b1350 2024-08-26T00:04:18.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.899+0000 7ff1d0a00640 1 --2- 172.21.15.42:0/2128141864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195b1350 0x5654195b8fa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff1b802a9a0 tx=0x7ff1b802a480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e8ee836d625a2ac server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:18.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.899+0000 7ff1b2a00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:04:18.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.900+0000 7ff1b2a00640 1 -- 172.21.15.42:0/2128141864 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8051060 con 0x5654195b1350 2024-08-26T00:04:18.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.900+0000 7ff1b2a00640 1 -- 172.21.15.42:0/2128141864 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7ff1b8004fb0 con 0x5654195b1350 2024-08-26T00:04:18.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.900+0000 7ff1d6a13740 1 -- 172.21.15.42:0/2128141864 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1b8005520 con 0x5654195b1350 2024-08-26T00:04:18.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.900+0000 7ff1b2a00640 1 -- 172.21.15.42:0/2128141864 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff1b8035050 con 0x5654195b1350 2024-08-26T00:04:18.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.900+0000 7ff1d6a13740 10 client.25388 fetch_fsmap learned FSMap version 26 2024-08-26T00:04:18.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.900+0000 7ff1d6a13740 1 -- 172.21.15.42:0/2128141864 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5654195ca5a0 con 0x5654195b1350 2024-08-26T00:04:18.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.901+0000 7ff1b2a00640 1 -- 172.21.15.42:0/2128141864 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1b8005520 con 0x5654195b1350 2024-08-26T00:04:18.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.901+0000 7ff1b2a00640 1 -- 172.21.15.42:0/2128141864 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7ff1b8056070 con 0x5654195b1350 2024-08-26T00:04:18.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.901+0000 7ff1d6a13740 10 client.25388 fetch_fsmap finished waiting for FSMap version 26 2024-08-26T00:04:18.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.901+0000 7ff1d6a13740 10 client.25388 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-26T00:04:18.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.901+0000 7ff1d6a13740 20 client.25388 populate_metadata read hostname 'smithi042' 2024-08-26T00:04:18.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.901+0000 7ff1d6a13740 1 --2- 172.21.15.42:0/2128141864 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x5654195cb8f0 0x5654195cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:18.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.901+0000 7ff1d6a13740 4 client.25388 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:04:18.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.901+0000 7ff1d6a13740 1 -- 172.21.15.42:0/2128141864 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654195244a0 con 0x5654195cb8f0 2024-08-26T00:04:18.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.901+0000 7ff1d1400640 1 --2- 172.21.15.42:0/2128141864 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x5654195cb8f0 0x5654195cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:18.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.902+0000 7ff1d1400640 1 --2- 172.21.15.42:0/2128141864 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x5654195cb8f0 0x5654195cdce0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1640083db2ba7466 server_cookie=f43955d06f804c6b in_seq=0 out_seq=0 2024-08-26T00:04:18.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.902+0000 7ff1b2a00640 10 client.25388 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:04:18.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.905+0000 7ff1b2a00640 1 -- 172.21.15.42:0/2128141864 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5654195244a0 con 0x5654195cb8f0 2024-08-26T00:04:18.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.905+0000 7ff1b2a00640 10 client.25388 handle_command_reply: tid=0 2024-08-26T00:04:18.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.905+0000 7ff1d6a13740 1 client.25388 shutdown 2024-08-26T00:04:18.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.905+0000 7ff1d6a13740 1 -- 172.21.15.42:0/2128141864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195b1350 msgr2=0x5654195b8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:18.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.905+0000 7ff1d6a13740 1 --2- 172.21.15.42:0/2128141864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195b1350 0x5654195b8fa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff1b802a9a0 tx=0x7ff1b802a480 comp rx=0 tx=0).stop 2024-08-26T00:04:18.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.905+0000 7ff1d6a13740 1 -- 172.21.15.42:0/2128141864 shutdown_connections 2024-08-26T00:04:18.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.905+0000 7ff1d6a13740 1 --2- 172.21.15.42:0/2128141864 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x5654195cb8f0 0x5654195cdce0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.905+0000 7ff1d6a13740 1 --2- 172.21.15.42:0/2128141864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654195bbc10 0x5654195b94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.905+0000 7ff1d6a13740 1 --2- 172.21.15.42:0/2128141864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195b1350 0x5654195b8fa0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.905+0000 7ff1d6a13740 1 --2- 172.21.15.42:0/2128141864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654195b0a30 0x5654195b8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.905+0000 7ff1d6a13740 1 -- 172.21.15.42:0/2128141864 >> 172.21.15.42:0/2128141864 conn(0x5654195acfc0 msgr2=0x5654195b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:18.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.905+0000 7ff1b2a00640 0 client.25388 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:04:18.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.906+0000 7ff1d6a13740 1 -- 172.21.15.42:0/2128141864 shutdown_connections 2024-08-26T00:04:18.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.906+0000 7ff1d6a13740 1 -- 172.21.15.42:0/2128141864 wait complete. 2024-08-26T00:04:18.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.906+0000 7ff1d6a13740 20 client.25388 trim_cache size 0 max 16384 2024-08-26T00:04:18.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.920+0000 7ff1d6a13740 1 Processor -- start 2024-08-26T00:04:18.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.920+0000 7ff1d6a13740 1 -- start start 2024-08-26T00:04:18.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.920+0000 7ff1d6a13740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195b0a30 0x5654195d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:18.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.920+0000 7ff1d6a13740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654195b1350 0x5654195d37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:18.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.920+0000 7ff1d6a13740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654195bbc10 0x5654195b2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:18.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.920+0000 7ff1d6a13740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc1b1ca0 con 0x5654195bbc10 2024-08-26T00:04:18.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.920+0000 7ff1d6a13740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc1af540 con 0x5654195b0a30 2024-08-26T00:04:18.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.920+0000 7ff1d6a13740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc1ad370 con 0x5654195b1350 2024-08-26T00:04:18.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.921+0000 7ff1d1400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195b0a30 0x5654195d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:18.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.921+0000 7ff1d1400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195b0a30 0x5654195d3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:54442/0 (socket says 172.21.15.42:54442) 2024-08-26T00:04:18.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.921+0000 7ff1d1400640 1 -- 172.21.15.42:0/576396134 learned_addr learned my addr 172.21.15.42:0/576396134 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:18.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.921+0000 7ff1d1e00640 1 --2- 172.21.15.42:0/576396134 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654195bbc10 0x5654195b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:18.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.921+0000 7ff1d0a00640 1 --2- 172.21.15.42:0/576396134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654195b1350 0x5654195d37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:18.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.921+0000 7ff1d1400640 1 -- 172.21.15.42:0/576396134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654195b1350 msgr2=0x5654195d37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:18.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.921+0000 7ff1d1400640 1 --2- 172.21.15.42:0/576396134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654195b1350 0x5654195d37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.921+0000 7ff1d1400640 1 -- 172.21.15.42:0/576396134 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654195bbc10 msgr2=0x5654195b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:18.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.921+0000 7ff1d1400640 1 --2- 172.21.15.42:0/576396134 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654195bbc10 0x5654195b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.921+0000 7ff1d1400640 1 -- 172.21.15.42:0/576396134 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654195acdf0 con 0x5654195b0a30 2024-08-26T00:04:18.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.921+0000 7ff1d1e00640 1 --2- 172.21.15.42:0/576396134 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654195bbc10 0x5654195b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:04:18.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.921+0000 7ff1d1400640 1 --2- 172.21.15.42:0/576396134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195b0a30 0x5654195d3280 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000c760 tx=0x7ff1c00cce50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3561dca88234bc43 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:18.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.922+0000 7ff1bdc00640 1 -- 172.21.15.42:0/576396134 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c009b640 con 0x5654195b0a30 2024-08-26T00:04:18.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.922+0000 7ff1bdc00640 1 -- 172.21.15.42:0/576396134 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1c009c3e0 con 0x5654195b0a30 2024-08-26T00:04:18.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.922+0000 7ff1bdc00640 1 -- 172.21.15.42:0/576396134 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c001fdd0 con 0x5654195b0a30 2024-08-26T00:04:18.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.922+0000 7ff1d6a13740 1 -- 172.21.15.42:0/576396134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195b0a30 msgr2=0x5654195d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:18.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.922+0000 7ff1d6a13740 1 --2- 172.21.15.42:0/576396134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195b0a30 0x5654195d3280 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000c760 tx=0x7ff1c00cce50 comp rx=0 tx=0).stop 2024-08-26T00:04:18.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.922+0000 7ff1d6a13740 1 -- 172.21.15.42:0/576396134 shutdown_connections 2024-08-26T00:04:18.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.922+0000 7ff1d6a13740 1 --2- 172.21.15.42:0/576396134 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654195bbc10 0x5654195b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.922+0000 7ff1d6a13740 1 --2- 172.21.15.42:0/576396134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654195b1350 0x5654195d37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.922+0000 7ff1d6a13740 1 --2- 172.21.15.42:0/576396134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195b0a30 0x5654195d3280 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.922+0000 7ff1d6a13740 1 -- 172.21.15.42:0/576396134 >> 172.21.15.42:0/576396134 conn(0x5654195acfc0 msgr2=0x5654195b7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:18.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.922+0000 7ff1d6a13740 1 -- 172.21.15.42:0/576396134 shutdown_connections 2024-08-26T00:04:18.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.922+0000 7ff1d6a13740 1 -- 172.21.15.42:0/576396134 wait complete. 2024-08-26T00:04:18.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.923+0000 7ff1d6a13740 1 -- start start 2024-08-26T00:04:18.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.923+0000 7ff1d6a13740 1 Processor -- start 2024-08-26T00:04:18.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.923+0000 7ff1d6a13740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654195b0a30 0x5654195b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:18.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.923+0000 7ff1d6a13740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195b1350 0x5654195b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:18.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.923+0000 7ff1d6a13740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654195bbc10 0x5654195b6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:18.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.923+0000 7ff1d6a13740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc1ada00 con 0x5654195bbc10 2024-08-26T00:04:18.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.923+0000 7ff1d6a13740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc1aee70 con 0x5654195b1350 2024-08-26T00:04:18.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.923+0000 7ff1d6a13740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc1ae0d0 con 0x5654195b0a30 2024-08-26T00:04:18.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.924+0000 7ff1d6a13740 10 client.0 _ll_register_callbacks cb 0x7ff1c00d2dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:04:18.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.924+0000 7ff1d1e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654195bbc10 0x5654195b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:18.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.924+0000 7ff1d0a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195b1350 0x5654195b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:18.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.924+0000 7ff1d0a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195b1350 0x5654195b6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:54452/0 (socket says 172.21.15.42:54452) 2024-08-26T00:04:18.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.924+0000 7ff1d0a00640 1 -- 172.21.15.42:0/1594707717 learned_addr learned my addr 172.21.15.42:0/1594707717 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:18.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.924+0000 7ff1d1400640 1 --2- 172.21.15.42:0/1594707717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654195b0a30 0x5654195b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:18.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.924+0000 7ff1d0a00640 1 -- 172.21.15.42:0/1594707717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654195b0a30 msgr2=0x5654195b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:18.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.924+0000 7ff1d0a00640 1 --2- 172.21.15.42:0/1594707717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654195b0a30 0x5654195b5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.924+0000 7ff1d0a00640 1 -- 172.21.15.42:0/1594707717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654195bbc10 msgr2=0x5654195b6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:18.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.924+0000 7ff1d0a00640 1 --2- 172.21.15.42:0/1594707717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654195bbc10 0x5654195b6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.925+0000 7ff1d0a00640 1 -- 172.21.15.42:0/1594707717 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654195b38a0 con 0x5654195b1350 2024-08-26T00:04:18.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.925+0000 7ff1d1e00640 1 --2- 172.21.15.42:0/1594707717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654195bbc10 0x5654195b6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:04:18.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.925+0000 7ff1d0a00640 1 --2- 172.21.15.42:0/1594707717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195b1350 0x5654195b6030 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8006010 tx=0x7ff1b8005630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cef7e22eac7c50b server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:18.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.925+0000 7ff1b2a00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:04:18.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.925+0000 7ff1b2a00640 1 -- 172.21.15.42:0/1594707717 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8051040 con 0x5654195b1350 2024-08-26T00:04:18.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.925+0000 7ff1b2a00640 1 -- 172.21.15.42:0/1594707717 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7ff1b80035f0 con 0x5654195b1350 2024-08-26T00:04:18.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.925+0000 7ff1d6a13740 1 -- 172.21.15.42:0/1594707717 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1c009c3e0 con 0x5654195b1350 2024-08-26T00:04:18.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.926+0000 7ff1b2a00640 1 -- 172.21.15.42:0/1594707717 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff1b805c030 con 0x5654195b1350 2024-08-26T00:04:18.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.926+0000 7ff1d6a13740 10 client.25394 fetch_fsmap learned FSMap version 26 2024-08-26T00:04:18.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.926+0000 7ff1d6a13740 1 -- 172.21.15.42:0/1594707717 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56541963ec00 con 0x5654195b1350 2024-08-26T00:04:18.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.926+0000 7ff1b2a00640 1 -- 172.21.15.42:0/1594707717 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1c009c3e0 con 0x5654195b1350 2024-08-26T00:04:18.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.926+0000 7ff1b2a00640 1 -- 172.21.15.42:0/1594707717 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7ff1b8056040 con 0x5654195b1350 2024-08-26T00:04:18.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.927+0000 7ff1d6a13740 10 client.25394 fetch_fsmap finished waiting for FSMap version 26 2024-08-26T00:04:18.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.927+0000 7ff1d6a13740 10 client.25394 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-26T00:04:18.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.927+0000 7ff1d6a13740 20 client.25394 populate_metadata read hostname 'smithi042' 2024-08-26T00:04:18.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.927+0000 7ff1d6a13740 1 --2- 172.21.15.42:0/1594707717 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x56541963f340 0x565419641760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:18.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.927+0000 7ff1d6a13740 4 client.25394 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:04:18.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.927+0000 7ff1d6a13740 1 -- 172.21.15.42:0/1594707717 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56541951e9b0 con 0x56541963f340 2024-08-26T00:04:18.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.927+0000 7ff1d1400640 1 --2- 172.21.15.42:0/1594707717 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x56541963f340 0x565419641760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:18.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.927+0000 7ff1d1400640 1 --2- 172.21.15.42:0/1594707717 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x56541963f340 0x565419641760 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cc05ff7f0b7d397a server_cookie=dec8fe84c05b1675 in_seq=0 out_seq=0 2024-08-26T00:04:18.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.927+0000 7ff1b2a00640 10 client.25394 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:04:18.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.933+0000 7ff1b2a00640 1 -- 172.21.15.42:0/1594707717 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56541951e9b0 con 0x56541963f340 2024-08-26T00:04:18.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.933+0000 7ff1b2a00640 10 client.25394 handle_command_reply: tid=0 2024-08-26T00:04:18.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.933+0000 7ff1d6a13740 1 client.25394 shutdown 2024-08-26T00:04:18.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.933+0000 7ff1d6a13740 1 -- 172.21.15.42:0/1594707717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195b1350 msgr2=0x5654195b6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:18.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.933+0000 7ff1d6a13740 1 --2- 172.21.15.42:0/1594707717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195b1350 0x5654195b6030 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8006010 tx=0x7ff1b8005630 comp rx=0 tx=0).stop 2024-08-26T00:04:18.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.933+0000 7ff1d6a13740 1 -- 172.21.15.42:0/1594707717 shutdown_connections 2024-08-26T00:04:18.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.933+0000 7ff1d6a13740 1 --2- 172.21.15.42:0/1594707717 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x56541963f340 0x565419641760 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.933+0000 7ff1d6a13740 1 --2- 172.21.15.42:0/1594707717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654195bbc10 0x5654195b6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.933+0000 7ff1d6a13740 1 --2- 172.21.15.42:0/1594707717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654195b1350 0x5654195b6030 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.933+0000 7ff1b2a00640 0 client.25394 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:04:18.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.933+0000 7ff1d6a13740 1 --2- 172.21.15.42:0/1594707717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654195b0a30 0x5654195b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.933+0000 7ff1d6a13740 1 -- 172.21.15.42:0/1594707717 >> 172.21.15.42:0/1594707717 conn(0x5654195acfc0 msgr2=0x5654195ab900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:18.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.934+0000 7ff1d6a13740 1 -- 172.21.15.42:0/1594707717 shutdown_connections 2024-08-26T00:04:18.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.934+0000 7ff1d6a13740 1 -- 172.21.15.42:0/1594707717 wait complete. 2024-08-26T00:04:18.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.934+0000 7ff1d6a13740 20 client.25394 trim_cache size 0 max 16384 2024-08-26T00:04:18.936 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:04:18.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.934+0000 7ff1d2800640 1 -- 172.21.15.42:0/1729574350 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff1b40a2b80 msgr2=0x7ff1b40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:18.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.934+0000 7ff1d2800640 1 --2- 172.21.15.42:0/1729574350 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff1b40a2b80 0x7ff1b40a5040 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40092f0 tx=0x7ff1c4009280 comp rx=0 tx=0).stop 2024-08-26T00:04:18.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.934+0000 7ff1d2800640 1 -- 172.21.15.42:0/1729574350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1cc0742b0 msgr2=0x7ff1cc19a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:18.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.934+0000 7ff1d2800640 1 --2- 172.21.15.42:0/1729574350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1cc0742b0 0x7ff1cc19a2b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000ea60 tx=0x7ff1c000ef20 comp rx=0 tx=0).stop 2024-08-26T00:04:18.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.935+0000 7ff1d2800640 1 -- 172.21.15.42:0/1729574350 shutdown_connections 2024-08-26T00:04:18.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.935+0000 7ff1d2800640 1 --2- 172.21.15.42:0/1729574350 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff1b40a2b80 0x7ff1b40a5040 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.935+0000 7ff1d2800640 1 --2- 172.21.15.42:0/1729574350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1cc10e020 0x7ff1cc19eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.935+0000 7ff1d2800640 1 --2- 172.21.15.42:0/1729574350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1cc074bd0 0x7ff1cc19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.935+0000 7ff1d2800640 1 --2- 172.21.15.42:0/1729574350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1cc0742b0 0x7ff1cc19a2b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:18.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.935+0000 7ff1d2800640 1 -- 172.21.15.42:0/1729574350 >> 172.21.15.42:0/1729574350 conn(0x7ff1cc0fd4e0 msgr2=0x7ff1cc0fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:18.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.935+0000 7ff1d2800640 1 -- 172.21.15.42:0/1729574350 shutdown_connections 2024-08-26T00:04:18.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:18.935+0000 7ff1d2800640 1 -- 172.21.15.42:0/1729574350 wait complete. 2024-08-26T00:04:20.021 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-26T00:04:20.375 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:20 smithi042 ceph-mon[17225]: pgmap v393: 97 pgs: 97 active+clean; 21 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 52 op/s 2024-08-26T00:04:20.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:20 smithi181 ceph-mon[22102]: pgmap v393: 97 pgs: 97 active+clean; 21 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 52 op/s 2024-08-26T00:04:20.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:20 smithi043 ceph-mon[22091]: pgmap v393: 97 pgs: 97 active+clean; 21 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 52 op/s 2024-08-26T00:04:20.773 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:04:21.632 INFO:tasks.workunit.client.0.smithi042.stdout: 18 294300 890 220243 1132 117491 1254 2024-08-26T00:04:21.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.825+0000 7fb02d400640 1 -- 172.21.15.42:0/1220234086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb028108720 msgr2=0x7fb028114c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:21.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.825+0000 7fb02d400640 1 --2- 172.21.15.42:0/1220234086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb028108720 0x7fb028114c40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb020009ca0 tx=0x7fb02002a8b0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.827+0000 7fb02d400640 1 -- 172.21.15.42:0/1220234086 shutdown_connections 2024-08-26T00:04:21.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.827+0000 7fb02d400640 1 --2- 172.21.15.42:0/1220234086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb028108720 0x7fb028114c40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.827+0000 7fb02d400640 1 --2- 172.21.15.42:0/1220234086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb028107dc0 0x7fb0281081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.827+0000 7fb02d400640 1 --2- 172.21.15.42:0/1220234086 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb02810de00 0x7fb02810e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.827+0000 7fb02d400640 1 -- 172.21.15.42:0/1220234086 >> 172.21.15.42:0/1220234086 conn(0x7fb028077720 msgr2=0x7fb028079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:21.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.827+0000 7fb02d400640 1 -- 172.21.15.42:0/1220234086 shutdown_connections 2024-08-26T00:04:21.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.827+0000 7fb02d400640 1 -- 172.21.15.42:0/1220234086 wait complete. 2024-08-26T00:04:21.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.828+0000 7fb02d400640 1 Processor -- start 2024-08-26T00:04:21.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.829+0000 7fb02d400640 1 -- start start 2024-08-26T00:04:21.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.829+0000 7fb02d400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb028107dc0 0x7fb02819e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:21.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.829+0000 7fb02d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb028108720 0x7fb02819eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:21.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.829+0000 7fb02d400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb02810de00 0x7fb0281a2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:21.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.829+0000 7fb02d400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb028118160 con 0x7fb028108720 2024-08-26T00:04:21.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.829+0000 7fb02d400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb028117fe0 con 0x7fb02810de00 2024-08-26T00:04:21.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.829+0000 7fb02d400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb0281182e0 con 0x7fb028107dc0 2024-08-26T00:04:21.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.830+0000 7fb02ca00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb02810de00 0x7fb0281a2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:21.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.830+0000 7fb02ca00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb02810de00 0x7fb0281a2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:54468/0 (socket says 172.21.15.42:54468) 2024-08-26T00:04:21.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.830+0000 7fb02ca00640 1 -- 172.21.15.42:0/6173495 learned_addr learned my addr 172.21.15.42:0/6173495 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:21.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.830+0000 7fb027e00640 1 --2- 172.21.15.42:0/6173495 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb028107dc0 0x7fb02819e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:21.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.830+0000 7fb02ca00640 1 -- 172.21.15.42:0/6173495 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb028107dc0 msgr2=0x7fb02819e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:21.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.830+0000 7fb02ca00640 1 --2- 172.21.15.42:0/6173495 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb028107dc0 0x7fb02819e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.830+0000 7fb02ca00640 1 -- 172.21.15.42:0/6173495 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb028108720 msgr2=0x7fb02819eb00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-26T00:04:21.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.830+0000 7fb02ca00640 1 --2- 172.21.15.42:0/6173495 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb028108720 0x7fb02819eb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.830+0000 7fb02ca00640 1 -- 172.21.15.42:0/6173495 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0281a3570 con 0x7fb02810de00 2024-08-26T00:04:21.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.832+0000 7fb02ca00640 1 --2- 172.21.15.42:0/6173495 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb02810de00 0x7fb0281a2e90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb0200308b0 tx=0x7fb020003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:21.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.832+0000 7fb024c00640 1 -- 172.21.15.42:0/6173495 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020030e70 con 0x7fb02810de00 2024-08-26T00:04:21.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.832+0000 7fb024c00640 1 -- 172.21.15.42:0/6173495 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb020051070 con 0x7fb02810de00 2024-08-26T00:04:21.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.832+0000 7fb024c00640 1 -- 172.21.15.42:0/6173495 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020056b40 con 0x7fb02810de00 2024-08-26T00:04:21.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.832+0000 7fb02d400640 1 -- 172.21.15.42:0/6173495 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0281a3800 con 0x7fb02810de00 2024-08-26T00:04:21.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.833+0000 7fb02d400640 1 -- 172.21.15.42:0/6173495 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb02806b9b0 con 0x7fb02810de00 2024-08-26T00:04:21.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.838+0000 7fb0313ba740 1 Processor -- start 2024-08-26T00:04:21.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.846+0000 7fb024c00640 1 -- 172.21.15.42:0/6173495 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb020004040 con 0x7fb02810de00 2024-08-26T00:04:21.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.848+0000 7fb024c00640 1 --2- 172.21.15.42:0/6173495 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb00c0a2c00 0x7fb00c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:21.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.849+0000 7fb027400640 1 --2- 172.21.15.42:0/6173495 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb00c0a2c00 0x7fb00c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:21.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.849+0000 7fb0313ba740 1 -- start start 2024-08-26T00:04:21.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.850+0000 7fb0313ba740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629e76f1a30 0x5629e76f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:21.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.850+0000 7fb0313ba740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e76f2350 0x5629e76fc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:21.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.850+0000 7fb0313ba740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76fcc10 0x5629e76ff000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:21.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.850+0000 7fb0313ba740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5629e7657f30 con 0x5629e76f1a30 2024-08-26T00:04:21.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.850+0000 7fb0313ba740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5629e75ef5a0 con 0x5629e76f2350 2024-08-26T00:04:21.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.850+0000 7fb0313ba740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5629e7653ef0 con 0x5629e76fcc10 2024-08-26T00:04:21.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.850+0000 7fb024c00640 1 -- 172.21.15.42:0/6173495 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb0200cba70 con 0x7fb02810de00 2024-08-26T00:04:21.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.850+0000 7fb02ca00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76fcc10 0x5629e76ff000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:21.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.850+0000 7fb02ca00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76fcc10 0x5629e76ff000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:52558/0 (socket says 172.21.15.42:52558) 2024-08-26T00:04:21.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.850+0000 7fb02ca00640 1 -- 172.21.15.42:0/3536191758 learned_addr learned my addr 172.21.15.42:0/3536191758 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:21.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.851+0000 7fb027400640 1 --2- 172.21.15.42:0/6173495 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb00c0a2c00 0x7fb00c0a50c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb02810d480 tx=0x7fb01400b370 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:21.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.851+0000 7fb02ca00640 1 -- 172.21.15.42:0/3536191758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e76f2350 msgr2=0x5629e76fc6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:04:21.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.852+0000 7fb02ca00640 1 --2- 172.21.15.42:0/3536191758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e76f2350 0x5629e76fc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.852+0000 7fb02ca00640 1 -- 172.21.15.42:0/3536191758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629e76f1a30 msgr2=0x5629e76f1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:21.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.853+0000 7fb027e00640 1 --2- 172.21.15.42:0/3536191758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629e76f1a30 0x5629e76f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:21.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.853+0000 7fb02ca00640 1 --2- 172.21.15.42:0/3536191758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629e76f1a30 0x5629e76f1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.853+0000 7fb02ca00640 1 -- 172.21.15.42:0/3536191758 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629e73c93c0 con 0x5629e76fcc10 2024-08-26T00:04:21.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.853+0000 7fb027e00640 1 --2- 172.21.15.42:0/3536191758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629e76f1a30 0x5629e76f1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:04:21.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.854+0000 7fb02ca00640 1 --2- 172.21.15.42:0/3536191758 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76fcc10 0x5629e76ff000 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb0200cd960 tx=0x7fb0200d5090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e67933a7247b21d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:21.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.858+0000 7fb01d200640 1 -- 172.21.15.42:0/3536191758 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0200ca400 con 0x5629e76fcc10 2024-08-26T00:04:21.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.861+0000 7fb01d200640 1 -- 172.21.15.42:0/3536191758 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb020050ec0 con 0x5629e76fcc10 2024-08-26T00:04:21.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.868+0000 7fb01d200640 1 -- 172.21.15.42:0/3536191758 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0200ca5a0 con 0x5629e76fcc10 2024-08-26T00:04:21.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.871+0000 7fb0313ba740 1 -- 172.21.15.42:0/3536191758 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76fcc10 msgr2=0x5629e76ff000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:21.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.871+0000 7fb0313ba740 1 --2- 172.21.15.42:0/3536191758 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76fcc10 0x5629e76ff000 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb0200cd960 tx=0x7fb0200d5090 comp rx=0 tx=0).stop 2024-08-26T00:04:21.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.873+0000 7fb0313ba740 1 -- 172.21.15.42:0/3536191758 shutdown_connections 2024-08-26T00:04:21.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.873+0000 7fb0313ba740 1 --2- 172.21.15.42:0/3536191758 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76fcc10 0x5629e76ff000 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.873+0000 7fb0313ba740 1 --2- 172.21.15.42:0/3536191758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e76f2350 0x5629e76fc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.873+0000 7fb0313ba740 1 --2- 172.21.15.42:0/3536191758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629e76f1a30 0x5629e76f1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.873+0000 7fb0313ba740 1 -- 172.21.15.42:0/3536191758 >> 172.21.15.42:0/3536191758 conn(0x5629e76edfc0 msgr2=0x5629e76ee3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:21.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.877+0000 7fb0313ba740 1 -- 172.21.15.42:0/3536191758 shutdown_connections 2024-08-26T00:04:21.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.877+0000 7fb0313ba740 1 -- 172.21.15.42:0/3536191758 wait complete. 2024-08-26T00:04:21.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.878+0000 7fb0313ba740 1 -- start start 2024-08-26T00:04:21.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.878+0000 7fb0313ba740 1 Processor -- start 2024-08-26T00:04:21.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.884+0000 7fb0313ba740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76f1a30 0x5629e76f9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:21.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.884+0000 7fb0313ba740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629e76f2350 0x5629e76fa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:21.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.884+0000 7fb0313ba740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e76fcc10 0x5629e76fa600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:21.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.885+0000 7fb0313ba740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5629e76ff5a0 con 0x5629e76f2350 2024-08-26T00:04:21.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.885+0000 7fb0313ba740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5629e7612de0 con 0x5629e76fcc10 2024-08-26T00:04:21.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.885+0000 7fb0313ba740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5629e76ff720 con 0x5629e76f1a30 2024-08-26T00:04:21.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.885+0000 7fb02ca00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e76fcc10 0x5629e76fa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:21.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.885+0000 7fb02ca00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e76fcc10 0x5629e76fa600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:54498/0 (socket says 172.21.15.42:54498) 2024-08-26T00:04:21.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.885+0000 7fb02ca00640 1 -- 172.21.15.42:0/3873647279 learned_addr learned my addr 172.21.15.42:0/3873647279 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:21.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.885+0000 7fb027e00640 1 --2- 172.21.15.42:0/3873647279 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76f1a30 0x5629e76f9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.886+0000 7fb0313ba740 10 client.0 _ll_register_callbacks cb 0x5629e76017b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:04:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.886+0000 7fb02ca00640 1 -- 172.21.15.42:0/3873647279 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76f1a30 msgr2=0x5629e76f9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.886+0000 7fb02ca00640 1 --2- 172.21.15.42:0/3873647279 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76f1a30 0x5629e76f9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.886+0000 7fb02ca00640 1 -- 172.21.15.42:0/3873647279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629e76f2350 msgr2=0x5629e76fa0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.886+0000 7fb02ca00640 1 --2- 172.21.15.42:0/3873647279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629e76f2350 0x5629e76fa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.886+0000 7fb02ca00640 1 -- 172.21.15.42:0/3873647279 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629e7708a10 con 0x5629e76fcc10 2024-08-26T00:04:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.886+0000 7fb027e00640 1 --2- 172.21.15.42:0/3873647279 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76f1a30 0x5629e76f9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:04:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.887+0000 7fb0313ba740 1 -- 172.21.15.42:0/3873647279 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb020050ec0 con 0x5629e76fcc10 2024-08-26T00:04:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.889+0000 7fb02ca00640 1 --2- 172.21.15.42:0/3873647279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e76fcc10 0x5629e76fa600 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb020003fd0 tx=0x7fb0200cbee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b331eaa657a771d server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.889+0000 7fb011600640 10 client.25403 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:04:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.889+0000 7fb011600640 1 -- 172.21.15.42:0/3873647279 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0200e5030 con 0x5629e76fcc10 2024-08-26T00:04:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.890+0000 7fb011600640 1 -- 172.21.15.42:0/3873647279 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb020004770 con 0x5629e76fcc10 2024-08-26T00:04:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.890+0000 7fb011600640 1 -- 172.21.15.42:0/3873647279 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb0200ca740 con 0x5629e76fcc10 2024-08-26T00:04:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.892+0000 7fb0313ba740 10 client.25403 fetch_fsmap learned FSMap version 26 2024-08-26T00:04:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.892+0000 7fb0313ba740 1 -- 172.21.15.42:0/3873647279 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5629e76ff5a0 con 0x5629e76fcc10 2024-08-26T00:04:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.892+0000 7fb011600640 1 -- 172.21.15.42:0/3873647279 <== mon.2 v2:172.21.15.43:3300/0 4 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7fb020056ce0 con 0x5629e76fcc10 2024-08-26T00:04:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.893+0000 7fb0313ba740 10 client.25403 fetch_fsmap finished waiting for FSMap version 26 2024-08-26T00:04:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.893+0000 7fb0313ba740 10 client.25403 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:04:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.893+0000 7fb0313ba740 20 client.25403 populate_metadata read hostname 'smithi042' 2024-08-26T00:04:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.893+0000 7fb0313ba740 1 --2- 172.21.15.42:0/3873647279 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5629e770c390 0x5629e770e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.893+0000 7fb0313ba740 4 client.25403 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:04:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.893+0000 7fb0313ba740 1 -- 172.21.15.42:0/3873647279 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629e76654a0 con 0x5629e770c390 2024-08-26T00:04:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.893+0000 7fb027e00640 1 --2- 172.21.15.42:0/3873647279 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5629e770c390 0x5629e770e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.897+0000 7fb027e00640 1 --2- 172.21.15.42:0/3873647279 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5629e770c390 0x5629e770e780 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfd456b33bc20e69 server_cookie=b2e4784a1f9b6814 in_seq=0 out_seq=0 2024-08-26T00:04:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.897+0000 7fb011600640 10 client.25403 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:04:21.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.898+0000 7fb011600640 1 -- 172.21.15.42:0/3873647279 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5629e76654a0 con 0x5629e770c390 2024-08-26T00:04:21.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.898+0000 7fb011600640 10 client.25403 handle_command_reply: tid=0 2024-08-26T00:04:21.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.899+0000 7fb0313ba740 1 client.25403 shutdown 2024-08-26T00:04:21.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.899+0000 7fb0313ba740 1 -- 172.21.15.42:0/3873647279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e76fcc10 msgr2=0x5629e76fa600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:21.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.899+0000 7fb0313ba740 1 --2- 172.21.15.42:0/3873647279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e76fcc10 0x5629e76fa600 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb020003fd0 tx=0x7fb0200cbee0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.899+0000 7fb0313ba740 1 -- 172.21.15.42:0/3873647279 shutdown_connections 2024-08-26T00:04:21.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.899+0000 7fb0313ba740 1 --2- 172.21.15.42:0/3873647279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e76fcc10 0x5629e76fa600 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.899+0000 7fb0313ba740 1 --2- 172.21.15.42:0/3873647279 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5629e770c390 0x5629e770e780 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.899+0000 7fb0313ba740 1 --2- 172.21.15.42:0/3873647279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629e76f2350 0x5629e76fa0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.899+0000 7fb0313ba740 1 --2- 172.21.15.42:0/3873647279 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76f1a30 0x5629e76f9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.899+0000 7fb0313ba740 1 -- 172.21.15.42:0/3873647279 >> 172.21.15.42:0/3873647279 conn(0x5629e76edfc0 msgr2=0x5629e76f3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:21.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.899+0000 7fb011600640 0 client.25403 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:04:21.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.900+0000 7fb0313ba740 1 -- 172.21.15.42:0/3873647279 shutdown_connections 2024-08-26T00:04:21.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.900+0000 7fb0313ba740 1 -- 172.21.15.42:0/3873647279 wait complete. 2024-08-26T00:04:21.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.901+0000 7fb0313ba740 20 client.25403 trim_cache size 0 max 16384 2024-08-26T00:04:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.937+0000 7fb0313ba740 1 Processor -- start 2024-08-26T00:04:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.938+0000 7fb0313ba740 1 -- start start 2024-08-26T00:04:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.938+0000 7fb0313ba740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e76f1a30 0x5629e76f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.938+0000 7fb0313ba740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76f2350 0x5629e7713ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.938+0000 7fb0313ba740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629e76fcc10 0x5629e7714430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.939+0000 7fb027e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e76f1a30 0x5629e76f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.940+0000 7fb027400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76f2350 0x5629e7713ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.940+0000 7fb027400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76f2350 0x5629e7713ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:52566/0 (socket says 172.21.15.42:52566) 2024-08-26T00:04:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.940+0000 7fb0313ba740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb0281ad7d0 con 0x5629e76fcc10 2024-08-26T00:04:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.940+0000 7fb0313ba740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb0281ab140 con 0x5629e76f1a30 2024-08-26T00:04:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.940+0000 7fb0313ba740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb028071f20 con 0x5629e76f2350 2024-08-26T00:04:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.940+0000 7fb027e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e76f1a30 0x5629e76f3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:54510/0 (socket says 172.21.15.42:54510) 2024-08-26T00:04:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.940+0000 7fb027e00640 1 -- 172.21.15.42:0/2639308125 learned_addr learned my addr 172.21.15.42:0/2639308125 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.940+0000 7fb02ca00640 1 --2- 172.21.15.42:0/2639308125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629e76fcc10 0x5629e7714430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.941+0000 7fb027e00640 1 -- 172.21.15.42:0/2639308125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76f2350 msgr2=0x5629e7713ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.941+0000 7fb027e00640 1 --2- 172.21.15.42:0/2639308125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76f2350 0x5629e7713ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.941+0000 7fb027e00640 1 -- 172.21.15.42:0/2639308125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629e76fcc10 msgr2=0x5629e7714430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.941+0000 7fb027e00640 1 --2- 172.21.15.42:0/2639308125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629e76fcc10 0x5629e7714430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.941+0000 7fb027e00640 1 -- 172.21.15.42:0/2639308125 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629e76f1860 con 0x5629e76f1a30 2024-08-26T00:04:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.942+0000 7fb027e00640 1 --2- 172.21.15.42:0/2639308125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e76f1a30 0x5629e76f3be0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x5629e770ee60 tx=0x7fb018010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db690eea2f03c0d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.943+0000 7fb013e00640 1 -- 172.21.15.42:0/2639308125 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb018022070 con 0x5629e76f1a30 2024-08-26T00:04:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.943+0000 7fb013e00640 1 -- 172.21.15.42:0/2639308125 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb018004230 con 0x5629e76f1a30 2024-08-26T00:04:21.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.943+0000 7fb013e00640 1 -- 172.21.15.42:0/2639308125 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01801c7e0 con 0x5629e76f1a30 2024-08-26T00:04:21.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.944+0000 7fb0313ba740 1 -- 172.21.15.42:0/2639308125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e76f1a30 msgr2=0x5629e76f3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:21.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.944+0000 7fb0313ba740 1 --2- 172.21.15.42:0/2639308125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e76f1a30 0x5629e76f3be0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x5629e770ee60 tx=0x7fb018010800 comp rx=0 tx=0).stop 2024-08-26T00:04:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.944+0000 7fb0313ba740 1 -- 172.21.15.42:0/2639308125 shutdown_connections 2024-08-26T00:04:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.944+0000 7fb0313ba740 1 --2- 172.21.15.42:0/2639308125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629e76fcc10 0x5629e7714430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.944+0000 7fb0313ba740 1 --2- 172.21.15.42:0/2639308125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76f2350 0x5629e7713ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.944+0000 7fb0313ba740 1 --2- 172.21.15.42:0/2639308125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e76f1a30 0x5629e76f3be0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.944+0000 7fb0313ba740 1 -- 172.21.15.42:0/2639308125 >> 172.21.15.42:0/2639308125 conn(0x5629e76edfc0 msgr2=0x5629e76f34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.948+0000 7fb0313ba740 1 -- 172.21.15.42:0/2639308125 shutdown_connections 2024-08-26T00:04:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.948+0000 7fb0313ba740 1 -- 172.21.15.42:0/2639308125 wait complete. 2024-08-26T00:04:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.949+0000 7fb0313ba740 1 -- start start 2024-08-26T00:04:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.950+0000 7fb0313ba740 1 Processor -- start 2024-08-26T00:04:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.951+0000 7fb0313ba740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76f2350 0x5629e7701000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.951+0000 7fb0313ba740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629e76fcc10 0x5629e7701540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.951+0000 7fb0313ba740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e7704710 0x5629e7704b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.951+0000 7fb0313ba740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb0280725b0 con 0x5629e76fcc10 2024-08-26T00:04:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.951+0000 7fb0313ba740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb028073a20 con 0x5629e7704710 2024-08-26T00:04:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.951+0000 7fb0313ba740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb028072c80 con 0x5629e76f2350 2024-08-26T00:04:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.951+0000 7fb0313ba740 10 client.0 _ll_register_callbacks cb 0x7fb020098c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:04:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.953+0000 7fb02ca00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e7704710 0x5629e7704b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.953+0000 7fb02ca00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e7704710 0x5629e7704b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:54512/0 (socket says 172.21.15.42:54512) 2024-08-26T00:04:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.953+0000 7fb02ca00640 1 -- 172.21.15.42:0/1779220702 learned_addr learned my addr 172.21.15.42:0/1779220702 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.953+0000 7fb027400640 1 --2- 172.21.15.42:0/1779220702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629e76fcc10 0x5629e7701540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.954+0000 7fb027e00640 1 --2- 172.21.15.42:0/1779220702 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76f2350 0x5629e7701000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.956+0000 7fb02ca00640 1 -- 172.21.15.42:0/1779220702 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76f2350 msgr2=0x5629e7701000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.956+0000 7fb02ca00640 1 --2- 172.21.15.42:0/1779220702 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76f2350 0x5629e7701000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.956+0000 7fb02ca00640 1 -- 172.21.15.42:0/1779220702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629e76fcc10 msgr2=0x5629e7701540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.956+0000 7fb02ca00640 1 --2- 172.21.15.42:0/1779220702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629e76fcc10 0x5629e7701540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.956+0000 7fb02ca00640 1 -- 172.21.15.42:0/1779220702 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629e77051d0 con 0x5629e7704710 2024-08-26T00:04:21.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.957+0000 7fb011600640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:04:21.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.958+0000 7fb02ca00640 1 --2- 172.21.15.42:0/1779220702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e7704710 0x5629e7704b90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb020009270 tx=0x7fb0200d2ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cf1fb92d1afa2e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:21.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.958+0000 7fb011600640 1 -- 172.21.15.42:0/1779220702 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0200e5070 con 0x5629e7704710 2024-08-26T00:04:21.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.958+0000 7fb011600640 1 -- 172.21.15.42:0/1779220702 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb0200c9aa0 con 0x5629e7704710 2024-08-26T00:04:21.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.959+0000 7fb0313ba740 1 -- 172.21.15.42:0/1779220702 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb018004230 con 0x5629e7704710 2024-08-26T00:04:21.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.959+0000 7fb011600640 1 -- 172.21.15.42:0/1779220702 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb0200ca910 con 0x5629e7704710 2024-08-26T00:04:21.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.960+0000 7fb0313ba740 10 client.25409 fetch_fsmap learned FSMap version 26 2024-08-26T00:04:21.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.960+0000 7fb0313ba740 1 -- 172.21.15.42:0/1779220702 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5629e77051d0 con 0x5629e7704710 2024-08-26T00:04:21.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.960+0000 7fb011600640 1 -- 172.21.15.42:0/1779220702 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb018004230 con 0x5629e7704710 2024-08-26T00:04:21.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.961+0000 7fb011600640 1 -- 172.21.15.42:0/1779220702 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7fb020056ce0 con 0x5629e7704710 2024-08-26T00:04:21.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.961+0000 7fb0313ba740 10 client.25409 fetch_fsmap finished waiting for FSMap version 26 2024-08-26T00:04:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.961+0000 7fb0313ba740 10 client.25409 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:04:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.961+0000 7fb0313ba740 20 client.25409 populate_metadata read hostname 'smithi042' 2024-08-26T00:04:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.961+0000 7fb0313ba740 1 --2- 172.21.15.42:0/1779220702 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5629e7778080 0x5629e777a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.961+0000 7fb0313ba740 4 client.25409 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:04:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.961+0000 7fb0313ba740 1 -- 172.21.15.42:0/1779220702 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5629e765f9b0 con 0x5629e7778080 2024-08-26T00:04:21.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.962+0000 7fb027e00640 1 --2- 172.21.15.42:0/1779220702 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5629e7778080 0x5629e777a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.967+0000 7fb011600640 10 client.25409 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:04:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.967+0000 7fb027e00640 1 --2- 172.21.15.42:0/1779220702 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5629e7778080 0x5629e777a470 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f514b6ad717b642e server_cookie=8841b57002d919af in_seq=0 out_seq=0 2024-08-26T00:04:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.967+0000 7fb011600640 1 -- 172.21.15.42:0/1779220702 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5629e765f9b0 con 0x5629e7778080 2024-08-26T00:04:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.967+0000 7fb011600640 10 client.25409 handle_command_reply: tid=0 2024-08-26T00:04:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.968+0000 7fb0313ba740 1 client.25409 shutdown 2024-08-26T00:04:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.968+0000 7fb0313ba740 1 -- 172.21.15.42:0/1779220702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e7704710 msgr2=0x5629e7704b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.968+0000 7fb0313ba740 1 --2- 172.21.15.42:0/1779220702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e7704710 0x5629e7704b90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb020009270 tx=0x7fb0200d2ea0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.972+0000 7fb0313ba740 1 -- 172.21.15.42:0/1779220702 shutdown_connections 2024-08-26T00:04:21.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.972+0000 7fb0313ba740 1 --2- 172.21.15.42:0/1779220702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5629e7704710 0x5629e7704b90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.972+0000 7fb0313ba740 1 --2- 172.21.15.42:0/1779220702 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5629e7778080 0x5629e777a470 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.972+0000 7fb0313ba740 1 --2- 172.21.15.42:0/1779220702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5629e76fcc10 0x5629e7701540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.972+0000 7fb0313ba740 1 --2- 172.21.15.42:0/1779220702 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5629e76f2350 0x5629e7701000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.972+0000 7fb011600640 0 client.25409 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:04:21.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.972+0000 7fb0313ba740 1 -- 172.21.15.42:0/1779220702 >> 172.21.15.42:0/1779220702 conn(0x5629e76edfc0 msgr2=0x5629e76ed120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:21.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.974+0000 7fb0313ba740 1 -- 172.21.15.42:0/1779220702 shutdown_connections 2024-08-26T00:04:21.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.974+0000 7fb0313ba740 1 -- 172.21.15.42:0/1779220702 wait complete. 2024-08-26T00:04:21.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.974+0000 7fb0313ba740 20 client.25409 trim_cache size 0 max 16384 2024-08-26T00:04:21.976 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:04:21.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.975+0000 7fb02d400640 1 -- 172.21.15.42:0/6173495 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb00c0a2c00 msgr2=0x7fb00c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:21.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.975+0000 7fb02d400640 1 --2- 172.21.15.42:0/6173495 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb00c0a2c00 0x7fb00c0a50c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb02810d480 tx=0x7fb01400b370 comp rx=0 tx=0).stop 2024-08-26T00:04:21.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.975+0000 7fb02d400640 1 -- 172.21.15.42:0/6173495 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb02810de00 msgr2=0x7fb0281a2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:21.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.975+0000 7fb02d400640 1 --2- 172.21.15.42:0/6173495 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb02810de00 0x7fb0281a2e90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb0200308b0 tx=0x7fb020003f10 comp rx=0 tx=0).stop 2024-08-26T00:04:21.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.975+0000 7fb02d400640 1 -- 172.21.15.42:0/6173495 shutdown_connections 2024-08-26T00:04:21.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.975+0000 7fb02d400640 1 --2- 172.21.15.42:0/6173495 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb00c0a2c00 0x7fb00c0a50c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.975+0000 7fb02d400640 1 --2- 172.21.15.42:0/6173495 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb02810de00 0x7fb0281a2e90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.975+0000 7fb02d400640 1 --2- 172.21.15.42:0/6173495 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb028108720 0x7fb02819eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.975+0000 7fb02d400640 1 --2- 172.21.15.42:0/6173495 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb028107dc0 0x7fb02819e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:21.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.976+0000 7fb02d400640 1 -- 172.21.15.42:0/6173495 >> 172.21.15.42:0/6173495 conn(0x7fb028077720 msgr2=0x7fb028078e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:21.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.977+0000 7fb02d400640 1 -- 172.21.15.42:0/6173495 shutdown_connections 2024-08-26T00:04:21.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:21.977+0000 7fb02d400640 1 -- 172.21.15.42:0/6173495 wait complete. 2024-08-26T00:04:22.734 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:22 smithi042 ceph-mon[17225]: pgmap v394: 97 pgs: 97 active+clean; 25 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 71 op/s 2024-08-26T00:04:22.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:22 smithi043 ceph-mon[22091]: pgmap v394: 97 pgs: 97 active+clean; 25 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 71 op/s 2024-08-26T00:04:22.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:22 smithi181 ceph-mon[22102]: pgmap v394: 97 pgs: 97 active+clean; 25 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 71 op/s 2024-08-26T00:04:24.181 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-26T00:04:24.181 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-26T00:04:24.556 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:24 smithi042 ceph-mon[17225]: pgmap v395: 97 pgs: 97 active+clean; 39 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 131 op/s 2024-08-26T00:04:24.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:24 smithi043 ceph-mon[22091]: pgmap v395: 97 pgs: 97 active+clean; 39 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 131 op/s 2024-08-26T00:04:24.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:24 smithi181 ceph-mon[22102]: pgmap v395: 97 pgs: 97 active+clean; 39 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 131 op/s 2024-08-26T00:04:24.806 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:04:25.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.747+0000 7f6291c00640 1 -- 172.21.15.42:0/1000641494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628c114850 msgr2=0x7f628c116c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:25.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.747+0000 7f6291c00640 1 --2- 172.21.15.42:0/1000641494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628c114850 0x7f628c116c40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6284009c10 tx=0x7f628402a700 comp rx=0 tx=0).stop 2024-08-26T00:04:25.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.747+0000 7f6291c00640 1 -- 172.21.15.42:0/1000641494 shutdown_connections 2024-08-26T00:04:25.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.747+0000 7f6291c00640 1 --2- 172.21.15.42:0/1000641494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628c114850 0x7f628c116c40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.747+0000 7f6291c00640 1 --2- 172.21.15.42:0/1000641494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f628c06ebb0 0x7f628c114310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.747+0000 7f6291c00640 1 --2- 172.21.15.42:0/1000641494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f628c06e290 0x7f628c06e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.747+0000 7f6291c00640 1 -- 172.21.15.42:0/1000641494 >> 172.21.15.42:0/1000641494 conn(0x7f628c072f20 msgr2=0x7f628c073330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:25.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.747+0000 7f6291c00640 1 -- 172.21.15.42:0/1000641494 shutdown_connections 2024-08-26T00:04:25.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.749+0000 7f6291c00640 1 -- 172.21.15.42:0/1000641494 wait complete. 2024-08-26T00:04:25.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.750+0000 7f6291c00640 1 Processor -- start 2024-08-26T00:04:25.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.751+0000 7f6291c00640 1 -- start start 2024-08-26T00:04:25.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.752+0000 7f6291c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f628c06e290 0x7f628c113c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:25.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.752+0000 7f6291c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628c06ebb0 0x7f628c1141d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:25.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.752+0000 7f6291c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f628c114850 0x7f628c10acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:25.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.752+0000 7f628be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f628c06e290 0x7f628c113c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:25.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.752+0000 7f6291c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f628c11a2f0 con 0x7f628c06e290 2024-08-26T00:04:25.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.752+0000 7f6291c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f628c11a170 con 0x7f628c06ebb0 2024-08-26T00:04:25.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.752+0000 7f6291c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f628c11a470 con 0x7f628c114850 2024-08-26T00:04:25.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.753+0000 7f628be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f628c06e290 0x7f628c113c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51948/0 (socket says 172.21.15.42:51948) 2024-08-26T00:04:25.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.753+0000 7f6291200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f628c114850 0x7f628c10acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:25.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.753+0000 7f6291200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f628c114850 0x7f628c10acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:51380/0 (socket says 172.21.15.42:51380) 2024-08-26T00:04:25.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.753+0000 7f6291200640 1 -- 172.21.15.42:0/4218471278 learned_addr learned my addr 172.21.15.42:0/4218471278 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:25.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.753+0000 7f628b400640 1 --2- 172.21.15.42:0/4218471278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628c06ebb0 0x7f628c1141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:25.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.753+0000 7f628b400640 1 -- 172.21.15.42:0/4218471278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f628c114850 msgr2=0x7f628c10acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:25.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.753+0000 7f628b400640 1 --2- 172.21.15.42:0/4218471278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f628c114850 0x7f628c10acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.753+0000 7f628b400640 1 -- 172.21.15.42:0/4218471278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f628c06e290 msgr2=0x7f628c113c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:25.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.753+0000 7f628b400640 1 --2- 172.21.15.42:0/4218471278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f628c06e290 0x7f628c113c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.753+0000 7f628b400640 1 -- 172.21.15.42:0/4218471278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628c10b590 con 0x7f628c06ebb0 2024-08-26T00:04:25.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.753+0000 7f6291200640 1 --2- 172.21.15.42:0/4218471278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f628c114850 0x7f628c10acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:04:25.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.754+0000 7f628b400640 1 --2- 172.21.15.42:0/4218471278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628c06ebb0 0x7f628c1141d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f627800e9f0 tx=0x7f627800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:25.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.755+0000 7f6288c00640 1 -- 172.21.15.42:0/4218471278 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627800ccc0 con 0x7f628c06ebb0 2024-08-26T00:04:25.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.755+0000 7f6288c00640 1 -- 172.21.15.42:0/4218471278 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6278010910 con 0x7f628c06ebb0 2024-08-26T00:04:25.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.755+0000 7f6291c00640 1 -- 172.21.15.42:0/4218471278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f628c10b880 con 0x7f628c06ebb0 2024-08-26T00:04:25.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.755+0000 7f6288c00640 1 -- 172.21.15.42:0/4218471278 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278018800 con 0x7f628c06ebb0 2024-08-26T00:04:25.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.756+0000 7f6291c00640 1 -- 172.21.15.42:0/4218471278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f628c10f8b0 con 0x7f628c06ebb0 2024-08-26T00:04:25.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.762+0000 7f6295c34740 1 Processor -- start 2024-08-26T00:04:25.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.766+0000 7f6288c00640 1 -- 172.21.15.42:0/4218471278 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6278010ac0 con 0x7f628c06ebb0 2024-08-26T00:04:25.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.766+0000 7f6295c34740 1 -- start start 2024-08-26T00:04:25.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.766+0000 7f6295c34740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56234299bf60 0x56234299c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:25.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.767+0000 7f6295c34740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56234299c880 0x5623429a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:25.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.767+0000 7f6291200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56234299bf60 0x56234299c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:25.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.767+0000 7f6291200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56234299bf60 0x56234299c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51962/0 (socket says 172.21.15.42:51962) 2024-08-26T00:04:25.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.768+0000 7f6295c34740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5623429a7140 0x5623429a9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:25.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.768+0000 7f6295c34740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562342902e30 con 0x56234299bf60 2024-08-26T00:04:25.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.768+0000 7f6295c34740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56234289a3c0 con 0x5623429a7140 2024-08-26T00:04:25.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.768+0000 7f6295c34740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5623428fedf0 con 0x56234299c880 2024-08-26T00:04:25.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.768+0000 7f6291200640 1 -- 172.21.15.42:0/2541507382 learned_addr learned my addr 172.21.15.42:0/2541507382 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:25.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.768+0000 7f628b400640 1 --2- 172.21.15.42:0/2541507382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5623429a7140 0x5623429a9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:25.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.768+0000 7f628be00640 1 --2- 172.21.15.42:0/2541507382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56234299c880 0x5623429a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:25.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.769+0000 7f6291200640 1 -- 172.21.15.42:0/2541507382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56234299c880 msgr2=0x5623429a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:25.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.769+0000 7f6291200640 1 --2- 172.21.15.42:0/2541507382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56234299c880 0x5623429a6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.769+0000 7f6291200640 1 -- 172.21.15.42:0/2541507382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5623429a7140 msgr2=0x5623429a9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:25.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.769+0000 7f6291200640 1 --2- 172.21.15.42:0/2541507382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5623429a7140 0x5623429a9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.769+0000 7f6291200640 1 -- 172.21.15.42:0/2541507382 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623426746a0 con 0x56234299bf60 2024-08-26T00:04:25.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.769+0000 7f6288c00640 1 --2- 172.21.15.42:0/4218471278 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f62700a2cd0 0x7f62700a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:25.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.770+0000 7f6288c00640 1 -- 172.21.15.42:0/4218471278 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f62780cf1a0 con 0x7f628c06ebb0 2024-08-26T00:04:25.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.770+0000 7f6291200640 1 --2- 172.21.15.42:0/2541507382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56234299bf60 0x56234299c340 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6284031020 tx=0x7f628402f300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84e717c8ac2e171 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:25.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.770+0000 7f628be00640 1 --2- 172.21.15.42:0/4218471278 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f62700a2cd0 0x7f62700a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:25.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.771+0000 7f6281600640 1 -- 172.21.15.42:0/2541507382 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284041030 con 0x56234299bf60 2024-08-26T00:04:25.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.771+0000 7f6281600640 1 -- 172.21.15.42:0/2541507382 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6284003e50 con 0x56234299bf60 2024-08-26T00:04:25.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.771+0000 7f6281600640 1 -- 172.21.15.42:0/2541507382 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284036040 con 0x56234299bf60 2024-08-26T00:04:25.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.772+0000 7f6295c34740 1 -- 172.21.15.42:0/2541507382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56234299bf60 msgr2=0x56234299c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:25.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.772+0000 7f6295c34740 1 --2- 172.21.15.42:0/2541507382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56234299bf60 0x56234299c340 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6284031020 tx=0x7f628402f300 comp rx=0 tx=0).stop 2024-08-26T00:04:25.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.772+0000 7f6295c34740 1 -- 172.21.15.42:0/2541507382 shutdown_connections 2024-08-26T00:04:25.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.772+0000 7f6295c34740 1 --2- 172.21.15.42:0/2541507382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5623429a7140 0x5623429a9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.772+0000 7f628be00640 1 --2- 172.21.15.42:0/4218471278 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f62700a2cd0 0x7f62700a5190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x562342999350 tx=0x7f627c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:25.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.772+0000 7f6295c34740 1 --2- 172.21.15.42:0/2541507382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56234299c880 0x5623429a6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.772+0000 7f6295c34740 1 --2- 172.21.15.42:0/2541507382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56234299bf60 0x56234299c340 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.772+0000 7f6295c34740 1 -- 172.21.15.42:0/2541507382 >> 172.21.15.42:0/2541507382 conn(0x5623429984f0 msgr2=0x5623429988d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:25.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.775+0000 7f6295c34740 1 -- 172.21.15.42:0/2541507382 shutdown_connections 2024-08-26T00:04:25.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.776+0000 7f6295c34740 1 -- 172.21.15.42:0/2541507382 wait complete. 2024-08-26T00:04:25.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.776+0000 7f6295c34740 1 -- start start 2024-08-26T00:04:25.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.776+0000 7f6295c34740 1 Processor -- start 2024-08-26T00:04:25.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.777+0000 7f6295c34740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56234299bf60 0x5623429a3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:25.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.777+0000 7f6295c34740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56234299c880 0x5623429a4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:25.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.777+0000 7f6295c34740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5623429a7140 0x5623429a4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:25.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.778+0000 7f628be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56234299bf60 0x5623429a3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:25.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.778+0000 7f628be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56234299bf60 0x5623429a3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:53364/0 (socket says 172.21.15.42:53364) 2024-08-26T00:04:25.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.779+0000 7f6291200640 1 --2- 172.21.15.42:0/3562011555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5623429a7140 0x5623429a4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:25.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.779+0000 7f628be00640 1 -- 172.21.15.42:0/3562011555 learned_addr learned my addr 172.21.15.42:0/3562011555 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:25.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.779+0000 7f628b400640 1 --2- 172.21.15.42:0/3562011555 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56234299c880 0x5623429a4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:25.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.779+0000 7f6295c34740 1 -- 172.21.15.42:0/3562011555 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5623429a9d10 con 0x56234299c880 2024-08-26T00:04:25.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.779+0000 7f6295c34740 1 -- 172.21.15.42:0/3562011555 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5623428bdc30 con 0x56234299bf60 2024-08-26T00:04:25.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.779+0000 7f6295c34740 1 -- 172.21.15.42:0/3562011555 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5623429a9e90 con 0x5623429a7140 2024-08-26T00:04:25.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.780+0000 7f6295c34740 10 client.0 _ll_register_callbacks cb 0x562342611ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:04:25.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.781+0000 7f6291200640 1 -- 172.21.15.42:0/3562011555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56234299bf60 msgr2=0x5623429a3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:25.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.781+0000 7f6291200640 1 --2- 172.21.15.42:0/3562011555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56234299bf60 0x5623429a3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.781+0000 7f6291200640 1 -- 172.21.15.42:0/3562011555 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56234299c880 msgr2=0x5623429a4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:25.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.781+0000 7f6291200640 1 --2- 172.21.15.42:0/3562011555 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56234299c880 0x5623429a4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.781+0000 7f6291200640 1 -- 172.21.15.42:0/3562011555 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623428c9dd0 con 0x5623429a7140 2024-08-26T00:04:25.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.781+0000 7f628be00640 1 --2- 172.21.15.42:0/3562011555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56234299bf60 0x5623429a3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:04:25.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.781+0000 7f6295c34740 1 -- 172.21.15.42:0/3562011555 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6284003e50 con 0x5623429a7140 2024-08-26T00:04:25.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.781+0000 7f628b400640 1 --2- 172.21.15.42:0/3562011555 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56234299c880 0x5623429a4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:04:25.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.782+0000 7f6276000640 10 client.25417 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:04:25.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.782+0000 7f6291200640 1 --2- 172.21.15.42:0/3562011555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5623429a7140 0x5623429a4a60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6284009b30 tx=0x7f6284004080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48d5d709fadb9833 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:25.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.782+0000 7f6276000640 1 -- 172.21.15.42:0/3562011555 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284036050 con 0x5623429a7140 2024-08-26T00:04:25.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.782+0000 7f6276000640 1 -- 172.21.15.42:0/3562011555 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f62840303a0 con 0x5623429a7140 2024-08-26T00:04:25.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.783+0000 7f6276000640 1 -- 172.21.15.42:0/3562011555 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6284036050 con 0x5623429a7140 2024-08-26T00:04:25.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.785+0000 7f6295c34740 10 client.25417 fetch_fsmap learned FSMap version 26 2024-08-26T00:04:25.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.785+0000 7f6295c34740 1 -- 172.21.15.42:0/3562011555 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5623429a9d10 con 0x5623429a7140 2024-08-26T00:04:25.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.785+0000 7f6276000640 1 -- 172.21.15.42:0/3562011555 <== mon.1 v2:172.21.15.181:3300/0 4 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f6284003970 con 0x5623429a7140 2024-08-26T00:04:25.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.786+0000 7f6295c34740 10 client.25417 fetch_fsmap finished waiting for FSMap version 26 2024-08-26T00:04:25.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.786+0000 7f6295c34740 10 client.25417 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:04:25.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.786+0000 7f6295c34740 20 client.25417 populate_metadata read hostname 'smithi042' 2024-08-26T00:04:25.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.786+0000 7f6295c34740 1 --2- 172.21.15.42:0/3562011555 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5623429b6980 0x5623429b8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:25.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.786+0000 7f6295c34740 4 client.25417 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:04:25.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.786+0000 7f6295c34740 1 -- 172.21.15.42:0/3562011555 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623429103a0 con 0x5623429b6980 2024-08-26T00:04:25.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.786+0000 7f628be00640 1 --2- 172.21.15.42:0/3562011555 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5623429b6980 0x5623429b8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:25.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.788+0000 7f628be00640 1 --2- 172.21.15.42:0/3562011555 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5623429b6980 0x5623429b8d70 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=230ead06a4c8fea3 server_cookie=9221b6eafe5b825e in_seq=0 out_seq=0 2024-08-26T00:04:25.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.790+0000 7f6276000640 10 client.25417 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:04:25.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.790+0000 7f6276000640 1 -- 172.21.15.42:0/3562011555 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5623429103a0 con 0x5623429b6980 2024-08-26T00:04:25.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.790+0000 7f6276000640 10 client.25417 handle_command_reply: tid=0 2024-08-26T00:04:25.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.790+0000 7f6295c34740 1 client.25417 shutdown 2024-08-26T00:04:25.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.791+0000 7f6295c34740 1 -- 172.21.15.42:0/3562011555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5623429a7140 msgr2=0x5623429a4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:25.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.791+0000 7f6295c34740 1 --2- 172.21.15.42:0/3562011555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5623429a7140 0x5623429a4a60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6284009b30 tx=0x7f6284004080 comp rx=0 tx=0).stop 2024-08-26T00:04:25.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.794+0000 7f6295c34740 1 -- 172.21.15.42:0/3562011555 shutdown_connections 2024-08-26T00:04:25.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.794+0000 7f6295c34740 1 --2- 172.21.15.42:0/3562011555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5623429a7140 0x5623429a4a60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.794+0000 7f6295c34740 1 --2- 172.21.15.42:0/3562011555 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5623429b6980 0x5623429b8d70 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.794+0000 7f6295c34740 1 --2- 172.21.15.42:0/3562011555 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56234299c880 0x5623429a4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.794+0000 7f6295c34740 1 --2- 172.21.15.42:0/3562011555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56234299bf60 0x5623429a3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.794+0000 7f6276000640 0 client.25417 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:04:25.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.794+0000 7f6295c34740 1 -- 172.21.15.42:0/3562011555 >> 172.21.15.42:0/3562011555 conn(0x5623429984f0 msgr2=0x56234299e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:25.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.796+0000 7f6295c34740 1 -- 172.21.15.42:0/3562011555 shutdown_connections 2024-08-26T00:04:25.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.796+0000 7f6295c34740 1 -- 172.21.15.42:0/3562011555 wait complete. 2024-08-26T00:04:25.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.796+0000 7f6295c34740 20 client.25417 trim_cache size 0 max 16384 2024-08-26T00:04:25.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.846+0000 7f6295c34740 1 Processor -- start 2024-08-26T00:04:25.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.846+0000 7f6295c34740 1 -- start start 2024-08-26T00:04:25.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.846+0000 7f6295c34740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56234299bf60 0x56234299e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:25.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.846+0000 7f6295c34740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56234299c880 0x5623429be310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:25.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.846+0000 7f6295c34740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5623429a7140 0x5623429be850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:25.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.846+0000 7f6295c34740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f628c1c7020 con 0x5623429a7140 2024-08-26T00:04:25.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.846+0000 7f6295c34740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f628c1c48c0 con 0x56234299bf60 2024-08-26T00:04:25.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.846+0000 7f6295c34740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f628c1c26b0 con 0x56234299c880 2024-08-26T00:04:25.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.848+0000 7f628be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56234299bf60 0x56234299e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:25.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.848+0000 7f628be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56234299bf60 0x56234299e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:53380/0 (socket says 172.21.15.42:53380) 2024-08-26T00:04:25.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.848+0000 7f628be00640 1 -- 172.21.15.42:0/2886489651 learned_addr learned my addr 172.21.15.42:0/2886489651 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:25.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.848+0000 7f628b400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56234299c880 0x5623429be310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:25.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.849+0000 7f6291200640 1 --2- 172.21.15.42:0/2886489651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5623429a7140 0x5623429be850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:25.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.851+0000 7f628be00640 1 -- 172.21.15.42:0/2886489651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56234299c880 msgr2=0x5623429be310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:25.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.851+0000 7f628be00640 1 --2- 172.21.15.42:0/2886489651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56234299c880 0x5623429be310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.851+0000 7f628be00640 1 -- 172.21.15.42:0/2886489651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5623429a7140 msgr2=0x5623429be850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:25.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.851+0000 7f628be00640 1 --2- 172.21.15.42:0/2886489651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5623429a7140 0x5623429be850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.851+0000 7f628be00640 1 -- 172.21.15.42:0/2886489651 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623429995a0 con 0x56234299bf60 2024-08-26T00:04:25.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.851+0000 7f628b400640 1 --2- 172.21.15.42:0/2886489651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56234299c880 0x5623429be310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:04:25.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.852+0000 7f628be00640 1 --2- 172.21.15.42:0/2886489651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56234299bf60 0x56234299e9c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f627c005fd0 tx=0x7f627c01b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3127082f2e79204d server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:25.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.853+0000 7f6280c00640 1 -- 172.21.15.42:0/2886489651 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627c039070 con 0x56234299bf60 2024-08-26T00:04:25.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.853+0000 7f6280c00640 1 -- 172.21.15.42:0/2886489651 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5623429103a0 con 0x56234299bf60 2024-08-26T00:04:25.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.853+0000 7f6280c00640 1 -- 172.21.15.42:0/2886489651 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627c02b9d0 con 0x56234299bf60 2024-08-26T00:04:25.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.854+0000 7f6295c34740 1 -- 172.21.15.42:0/2886489651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56234299bf60 msgr2=0x56234299e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:25.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.854+0000 7f6295c34740 1 --2- 172.21.15.42:0/2886489651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56234299bf60 0x56234299e9c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f627c005fd0 tx=0x7f627c01b000 comp rx=0 tx=0).stop 2024-08-26T00:04:25.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.854+0000 7f6295c34740 1 -- 172.21.15.42:0/2886489651 shutdown_connections 2024-08-26T00:04:25.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.854+0000 7f6295c34740 1 --2- 172.21.15.42:0/2886489651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5623429a7140 0x5623429be850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.854+0000 7f6295c34740 1 --2- 172.21.15.42:0/2886489651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56234299c880 0x5623429be310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.854+0000 7f6295c34740 1 --2- 172.21.15.42:0/2886489651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56234299bf60 0x56234299e9c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.854+0000 7f6295c34740 1 -- 172.21.15.42:0/2886489651 >> 172.21.15.42:0/2886489651 conn(0x5623429984f0 msgr2=0x5623429a5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:25.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.854+0000 7f6295c34740 1 -- 172.21.15.42:0/2886489651 shutdown_connections 2024-08-26T00:04:25.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.855+0000 7f6295c34740 1 -- 172.21.15.42:0/2886489651 wait complete. 2024-08-26T00:04:25.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.855+0000 7f6295c34740 1 -- start start 2024-08-26T00:04:25.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.855+0000 7f6295c34740 1 Processor -- start 2024-08-26T00:04:25.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.857+0000 7f6295c34740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56234299bf60 0x5623429ab520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:25.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.857+0000 7f6295c34740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56234299c880 0x5623429aba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:25.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.858+0000 7f6295c34740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5623429a7140 0x562342a202e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:25.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.858+0000 7f6295c34740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f628c1c2d80 con 0x56234299c880 2024-08-26T00:04:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.858+0000 7f6295c34740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f628c1c41f0 con 0x5623429a7140 2024-08-26T00:04:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.858+0000 7f6295c34740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f628c1c3450 con 0x56234299bf60 2024-08-26T00:04:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.858+0000 7f6295c34740 10 client.0 _ll_register_callbacks cb 0x7f6278005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:04:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.858+0000 7f6291200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5623429a7140 0x562342a202e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.858+0000 7f628be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56234299bf60 0x5623429ab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.858+0000 7f6291200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5623429a7140 0x562342a202e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:53392/0 (socket says 172.21.15.42:53392) 2024-08-26T00:04:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.858+0000 7f6291200640 1 -- 172.21.15.42:0/1051554130 learned_addr learned my addr 172.21.15.42:0/1051554130 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.858+0000 7f6291200640 1 -- 172.21.15.42:0/1051554130 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56234299bf60 msgr2=0x5623429ab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.858+0000 7f6291200640 1 --2- 172.21.15.42:0/1051554130 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56234299bf60 0x5623429ab520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.858+0000 7f6291200640 1 -- 172.21.15.42:0/1051554130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56234299c880 msgr2=0x5623429aba60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:04:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.859+0000 7f628b400640 1 --2- 172.21.15.42:0/1051554130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56234299c880 0x5623429aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.859+0000 7f6291200640 1 --2- 172.21.15.42:0/1051554130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56234299c880 0x5623429aba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.859+0000 7f6291200640 1 -- 172.21.15.42:0/1051554130 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562342a20820 con 0x5623429a7140 2024-08-26T00:04:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.859+0000 7f6295c34740 1 -- 172.21.15.42:0/1051554130 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5623429103a0 con 0x5623429a7140 2024-08-26T00:04:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.859+0000 7f628b400640 1 --2- 172.21.15.42:0/1051554130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56234299c880 0x5623429aba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:04:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.860+0000 7f6291200640 1 --2- 172.21.15.42:0/1051554130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5623429a7140 0x562342a202e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6284030a10 tx=0x7f6284030fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a6ae6eb7712f7fa server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.860+0000 7f6276000640 10 client.25427 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:04:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.861+0000 7f6276000640 1 -- 172.21.15.42:0/1051554130 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284068050 con 0x5623429a7140 2024-08-26T00:04:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.861+0000 7f6276000640 1 -- 172.21.15.42:0/1051554130 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f6284004290 con 0x5623429a7140 2024-08-26T00:04:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.861+0000 7f6276000640 1 -- 172.21.15.42:0/1051554130 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f628405e070 con 0x5623429a7140 2024-08-26T00:04:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.861+0000 7f6295c34740 10 client.25427 fetch_fsmap learned FSMap version 26 2024-08-26T00:04:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.861+0000 7f6295c34740 1 -- 172.21.15.42:0/1051554130 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({fsmap=26}) -- 0x562342a21a20 con 0x5623429a7140 2024-08-26T00:04:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.863+0000 7f6276000640 1 -- 172.21.15.42:0/1051554130 <== mon.2 v2:172.21.15.43:3300/0 4 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f62840044d0 con 0x5623429a7140 2024-08-26T00:04:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.863+0000 7f6295c34740 10 client.25427 fetch_fsmap finished waiting for FSMap version 26 2024-08-26T00:04:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.863+0000 7f6295c34740 10 client.25427 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:04:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.863+0000 7f6295c34740 20 client.25427 populate_metadata read hostname 'smithi042' 2024-08-26T00:04:25.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.863+0000 7f6295c34740 1 --2- 172.21.15.42:0/1051554130 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x562342a21f80 0x562342a24370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:25.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.863+0000 7f6295c34740 4 client.25427 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-26T00:04:25.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.863+0000 7f6295c34740 1 -- 172.21.15.42:0/1051554130 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56234290a8b0 con 0x562342a21f80 2024-08-26T00:04:25.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.865+0000 7f628be00640 1 --2- 172.21.15.42:0/1051554130 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x562342a21f80 0x562342a24370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:25.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.866+0000 7f628be00640 1 --2- 172.21.15.42:0/1051554130 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x562342a21f80 0x562342a24370 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=880c4c1e1e83b1c4 server_cookie=a864c8e1bff02f9a in_seq=0 out_seq=0 2024-08-26T00:04:25.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.866+0000 7f6276000640 10 client.25427 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:04:25.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.868+0000 7f6276000640 1 -- 172.21.15.42:0/1051554130 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56234290a8b0 con 0x562342a21f80 2024-08-26T00:04:25.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.868+0000 7f6276000640 10 client.25427 handle_command_reply: tid=0 2024-08-26T00:04:25.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.868+0000 7f6295c34740 1 client.25427 shutdown 2024-08-26T00:04:25.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.869+0000 7f6295c34740 1 -- 172.21.15.42:0/1051554130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5623429a7140 msgr2=0x562342a202e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:25.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.869+0000 7f6295c34740 1 --2- 172.21.15.42:0/1051554130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5623429a7140 0x562342a202e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6284030a10 tx=0x7f6284030fb0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.869+0000 7f6295c34740 1 -- 172.21.15.42:0/1051554130 shutdown_connections 2024-08-26T00:04:25.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.869+0000 7f6295c34740 1 --2- 172.21.15.42:0/1051554130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5623429a7140 0x562342a202e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.869+0000 7f6295c34740 1 --2- 172.21.15.42:0/1051554130 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x562342a21f80 0x562342a24370 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.869+0000 7f6295c34740 1 --2- 172.21.15.42:0/1051554130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56234299c880 0x5623429aba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.869+0000 7f6295c34740 1 --2- 172.21.15.42:0/1051554130 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56234299bf60 0x5623429ab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.869+0000 7f6276000640 0 client.25427 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:04:25.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.869+0000 7f6295c34740 1 -- 172.21.15.42:0/1051554130 >> 172.21.15.42:0/1051554130 conn(0x5623429984f0 msgr2=0x5623429b1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:25.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.870+0000 7f6295c34740 1 -- 172.21.15.42:0/1051554130 shutdown_connections 2024-08-26T00:04:25.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.870+0000 7f6295c34740 1 -- 172.21.15.42:0/1051554130 wait complete. 2024-08-26T00:04:25.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.870+0000 7f6295c34740 20 client.25427 trim_cache size 0 max 16384 2024-08-26T00:04:25.873 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:04:25.873 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-08-26T00:04:25.873 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "f22956bc-4be7-4574-8c1d-c23d41501ab7", 2024-08-26T00:04:25.873 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-08-26T00:04:25.873 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:04:25.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.872+0000 7f6291c00640 1 -- 172.21.15.42:0/4218471278 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f62700a2cd0 msgr2=0x7f62700a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:25.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.872+0000 7f6291c00640 1 --2- 172.21.15.42:0/4218471278 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f62700a2cd0 0x7f62700a5190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x562342999350 tx=0x7f627c009260 comp rx=0 tx=0).stop 2024-08-26T00:04:25.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.872+0000 7f6291c00640 1 -- 172.21.15.42:0/4218471278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628c06ebb0 msgr2=0x7f628c1141d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:25.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.872+0000 7f6291c00640 1 --2- 172.21.15.42:0/4218471278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628c06ebb0 0x7f628c1141d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f627800e9f0 tx=0x7f627800edf0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.875+0000 7f6291c00640 1 -- 172.21.15.42:0/4218471278 shutdown_connections 2024-08-26T00:04:25.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.875+0000 7f6291c00640 1 --2- 172.21.15.42:0/4218471278 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f62700a2cd0 0x7f62700a5190 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.875+0000 7f6291c00640 1 --2- 172.21.15.42:0/4218471278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f628c114850 0x7f628c10acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.875+0000 7f6291c00640 1 --2- 172.21.15.42:0/4218471278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f628c06ebb0 0x7f628c1141d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.875+0000 7f6291c00640 1 --2- 172.21.15.42:0/4218471278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f628c06e290 0x7f628c113c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:25.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.875+0000 7f6291c00640 1 -- 172.21.15.42:0/4218471278 >> 172.21.15.42:0/4218471278 conn(0x7f628c072f20 msgr2=0x7f628c06b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:25.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.875+0000 7f6291c00640 1 -- 172.21.15.42:0/4218471278 shutdown_connections 2024-08-26T00:04:25.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:25.875+0000 7f6291c00640 1 -- 172.21.15.42:0/4218471278 wait complete. 2024-08-26T00:04:26.504 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:26 smithi042 ceph-mon[17225]: pgmap v396: 97 pgs: 97 active+clean; 45 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 135 op/s 2024-08-26T00:04:26.504 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:26 smithi042 ceph-mon[17225]: scrub queued for path: / 2024-08-26T00:04:26.504 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:26 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:26.505 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:26 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:26.505 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:26 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:26.671 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-26T00:04:26.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:26 smithi043 ceph-mon[22091]: pgmap v396: 97 pgs: 97 active+clean; 45 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 135 op/s 2024-08-26T00:04:26.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:26 smithi043 ceph-mon[22091]: scrub queued for path: / 2024-08-26T00:04:26.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:26 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:26.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:26 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:26.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:26 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:26.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:26 smithi181 ceph-mon[22102]: pgmap v396: 97 pgs: 97 active+clean; 45 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 135 op/s 2024-08-26T00:04:26.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:26 smithi181 ceph-mon[22102]: scrub queued for path: / 2024-08-26T00:04:26.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:26 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:26.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:26 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:26.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:26 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:27.484 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:04:27.604 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:27 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:27.605 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:27 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:27.605 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:27 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:27.605 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:27 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:27.605 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:27 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:27.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:27 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:27.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:27 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:27.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:27 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:27.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:27 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:27.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:27 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:27.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:27 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:27.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:27 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:27.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:27 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:27.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:27 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:27.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:27 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:28.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:28 smithi042 ceph-mon[17225]: pgmap v397: 97 pgs: 97 active+clean; 54 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.2 MiB/s wr, 184 op/s 2024-08-26T00:04:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.650+0000 7fb3b4a00640 1 -- 172.21.15.42:0/1304183295 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3a80ab560 msgr2=0x7fb3a80ab940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.651+0000 7fb3b4a00640 1 --2- 172.21.15.42:0/1304183295 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3a80ab560 0x7fb3a80ab940 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb3a000bb90 tx=0x7fb3a00329b0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.651+0000 7fb3b4a00640 1 -- 172.21.15.42:0/1304183295 shutdown_connections 2024-08-26T00:04:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.652+0000 7fb3b4a00640 1 --2- 172.21.15.42:0/1304183295 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3a80a62e0 0x7fb3a80b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.652+0000 7fb3b4a00640 1 --2- 172.21.15.42:0/1304183295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3a80a5940 0x7fb3a80a5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.652+0000 7fb3b4a00640 1 --2- 172.21.15.42:0/1304183295 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3a80ab560 0x7fb3a80ab940 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.652+0000 7fb3b4a00640 1 -- 172.21.15.42:0/1304183295 >> 172.21.15.42:0/1304183295 conn(0x7fb3a800a1f0 msgr2=0x7fb3a800a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:28.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.652+0000 7fb3b4a00640 1 -- 172.21.15.42:0/1304183295 shutdown_connections 2024-08-26T00:04:28.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.652+0000 7fb3b4a00640 1 -- 172.21.15.42:0/1304183295 wait complete. 2024-08-26T00:04:28.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.654+0000 7fb3b4a00640 1 Processor -- start 2024-08-26T00:04:28.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.654+0000 7fb3b4a00640 1 -- start start 2024-08-26T00:04:28.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.655+0000 7fb3b4a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3a80a5940 0x7fb3a81518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:28.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.655+0000 7fb3b4a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3a80a62e0 0x7fb3a8151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:28.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.655+0000 7fb3b4a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3a80ab560 0x7fb3a814bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:28.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.656+0000 7fb3b4a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a80b4830 con 0x7fb3a80a5940 2024-08-26T00:04:28.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.656+0000 7fb3b4a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a80b46b0 con 0x7fb3a80a62e0 2024-08-26T00:04:28.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.656+0000 7fb3b4a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a80b49b0 con 0x7fb3a80ab560 2024-08-26T00:04:28.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.656+0000 7fb3af200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3a80ab560 0x7fb3a814bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:28.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.656+0000 7fb3af200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3a80ab560 0x7fb3a814bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:51426/0 (socket says 172.21.15.42:51426) 2024-08-26T00:04:28.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.656+0000 7fb3af200640 1 -- 172.21.15.42:0/4288494528 learned_addr learned my addr 172.21.15.42:0/4288494528 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:28.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.656+0000 7fb3ade00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3a80a62e0 0x7fb3a8151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:28.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.656+0000 7fb3af200640 1 -- 172.21.15.42:0/4288494528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3a80a62e0 msgr2=0x7fb3a8151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:28.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.656+0000 7fb3af200640 1 --2- 172.21.15.42:0/4288494528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3a80a62e0 0x7fb3a8151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.656+0000 7fb3af200640 1 -- 172.21.15.42:0/4288494528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3a80a5940 msgr2=0x7fb3a81518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:28.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.656+0000 7fb3ae800640 1 --2- 172.21.15.42:0/4288494528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3a80a5940 0x7fb3a81518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:28.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.657+0000 7fb3af200640 1 --2- 172.21.15.42:0/4288494528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3a80a5940 0x7fb3a81518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.657+0000 7fb3af200640 1 -- 172.21.15.42:0/4288494528 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a814c1e0 con 0x7fb3a80ab560 2024-08-26T00:04:28.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.657+0000 7fb3ae800640 1 --2- 172.21.15.42:0/4288494528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3a80a5940 0x7fb3a81518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:04:28.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.657+0000 7fb3af200640 1 --2- 172.21.15.42:0/4288494528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3a80ab560 0x7fb3a814bab0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0051650 tx=0x7fb3b0074f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:28.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.658+0000 7fb3a7400640 1 -- 172.21.15.42:0/4288494528 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0072e90 con 0x7fb3a80ab560 2024-08-26T00:04:28.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.658+0000 7fb3b4a00640 1 -- 172.21.15.42:0/4288494528 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a814c4d0 con 0x7fb3a80ab560 2024-08-26T00:04:28.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.658+0000 7fb3b4a00640 1 -- 172.21.15.42:0/4288494528 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a81587c0 con 0x7fb3a80ab560 2024-08-26T00:04:28.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.661+0000 7fb3a7400640 1 -- 172.21.15.42:0/4288494528 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3b0079030 con 0x7fb3a80ab560 2024-08-26T00:04:28.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.661+0000 7fb3a7400640 1 -- 172.21.15.42:0/4288494528 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b007d630 con 0x7fb3a80ab560 2024-08-26T00:04:28.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.667+0000 7fb3b7fd8740 1 Processor -- start 2024-08-26T00:04:28.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.668+0000 7fb3a7400640 1 -- 172.21.15.42:0/4288494528 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb3b007d7d0 con 0x7fb3a80ab560 2024-08-26T00:04:28.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.668+0000 7fb3b7fd8740 1 -- start start 2024-08-26T00:04:28.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.668+0000 7fb3b7fd8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a34b40 0x555cb9a34f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:28.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.668+0000 7fb3b7fd8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555cb9a35460 0x555cb9a3f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:28.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.668+0000 7fb3b7fd8740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a3fd20 0x555cb9a42110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:28.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.668+0000 7fb3b7fd8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555cb999afc0 con 0x555cb9a35460 2024-08-26T00:04:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.668+0000 7fb3b7fd8740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555cb9932680 con 0x555cb9a3fd20 2024-08-26T00:04:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.668+0000 7fb3b7fd8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x555cb9996f80 con 0x555cb9a34b40 2024-08-26T00:04:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.669+0000 7fb3ade00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a34b40 0x555cb9a34f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.669+0000 7fb3ade00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a34b40 0x555cb9a34f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:51434/0 (socket says 172.21.15.42:51434) 2024-08-26T00:04:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.669+0000 7fb3ade00640 1 -- 172.21.15.42:0/1032619660 learned_addr learned my addr 172.21.15.42:0/1032619660 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.669+0000 7fb3ae800640 1 --2- 172.21.15.42:0/1032619660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555cb9a35460 0x555cb9a3f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.669+0000 7fb3ade00640 1 --2- 172.21.15.42:0/1032619660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a3fd20 0x555cb9a42110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.670+0000 7fb3ade00640 1 -- 172.21.15.42:0/1032619660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a3fd20 msgr2=0x555cb9a42110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.670+0000 7fb3ade00640 1 --2- 172.21.15.42:0/1032619660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a3fd20 0x555cb9a42110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.670+0000 7fb3ade00640 1 -- 172.21.15.42:0/1032619660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555cb9a35460 msgr2=0x555cb9a3f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.670+0000 7fb3ade00640 1 --2- 172.21.15.42:0/1032619660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555cb9a35460 0x555cb9a3f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.670+0000 7fb3ade00640 1 -- 172.21.15.42:0/1032619660 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cb994e2c0 con 0x555cb9a34b40 2024-08-26T00:04:28.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.670+0000 7fb3ae800640 1 --2- 172.21.15.42:0/1032619660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555cb9a35460 0x555cb9a3f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:04:28.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.670+0000 7fb3ade00640 1 --2- 172.21.15.42:0/1032619660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a34b40 0x555cb9a34f20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00b8d0 tx=0x7fb39c00b1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6cd19a56b6c76c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:28.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.672+0000 7fb39b400640 1 -- 172.21.15.42:0/1032619660 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c012710 con 0x555cb9a34b40 2024-08-26T00:04:28.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.672+0000 7fb39b400640 1 -- 172.21.15.42:0/1032619660 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb39c010040 con 0x555cb9a34b40 2024-08-26T00:04:28.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.672+0000 7fb39b400640 1 -- 172.21.15.42:0/1032619660 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c03ab70 con 0x555cb9a34b40 2024-08-26T00:04:28.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.673+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/1032619660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a34b40 msgr2=0x555cb9a34f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:28.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.673+0000 7fb3b7fd8740 1 --2- 172.21.15.42:0/1032619660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a34b40 0x555cb9a34f20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00b8d0 tx=0x7fb39c00b1a0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.673+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/1032619660 shutdown_connections 2024-08-26T00:04:28.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.673+0000 7fb3b7fd8740 1 --2- 172.21.15.42:0/1032619660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a3fd20 0x555cb9a42110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.673+0000 7fb3b7fd8740 1 --2- 172.21.15.42:0/1032619660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555cb9a35460 0x555cb9a3f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.673+0000 7fb3b7fd8740 1 --2- 172.21.15.42:0/1032619660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a34b40 0x555cb9a34f20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.673+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/1032619660 >> 172.21.15.42:0/1032619660 conn(0x555cb9a31080 msgr2=0x555cb9a31460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:28.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.673+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/1032619660 shutdown_connections 2024-08-26T00:04:28.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.673+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/1032619660 wait complete. 2024-08-26T00:04:28.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.674+0000 7fb3b7fd8740 1 -- start start 2024-08-26T00:04:28.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.674+0000 7fb3a7400640 1 --2- 172.21.15.42:0/4288494528 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb3940a2db0 0x7fb3940a5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:28.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.675+0000 7fb3b7fd8740 1 Processor -- start 2024-08-26T00:04:28.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.675+0000 7fb3a7400640 1 -- 172.21.15.42:0/4288494528 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb3b0133300 con 0x7fb3a80ab560 2024-08-26T00:04:28.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.675+0000 7fb3ade00640 1 --2- 172.21.15.42:0/4288494528 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb3940a2db0 0x7fb3940a5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:28.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.676+0000 7fb3ade00640 1 --2- 172.21.15.42:0/4288494528 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb3940a2db0 0x7fb3940a5270 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb39c006e90 tx=0x7fb39c00b130 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:28.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.677+0000 7fb3b7fd8740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a34b40 0x555cb9a3cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:28.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.677+0000 7fb3b7fd8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a35460 0x555cb9a3d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:28.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.678+0000 7fb3b7fd8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555cb9a3fd20 0x555cb9a3d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:28.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.678+0000 7fb3ae800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a34b40 0x555cb9a3cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:28.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.678+0000 7fb3ae800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a34b40 0x555cb9a3cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:53442/0 (socket says 172.21.15.42:53442) 2024-08-26T00:04:28.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.678+0000 7fb3ade00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a35460 0x555cb9a3d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:28.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.678+0000 7fb3ade00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a35460 0x555cb9a3d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:51436/0 (socket says 172.21.15.42:51436) 2024-08-26T00:04:28.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.678+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/1774514699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555cb9a428f0 con 0x555cb9a3fd20 2024-08-26T00:04:28.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.678+0000 7fb3ae800640 1 -- 172.21.15.42:0/1774514699 learned_addr learned my addr 172.21.15.42:0/1774514699 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:28.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.678+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/1774514699 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555cb9955e50 con 0x555cb9a34b40 2024-08-26T00:04:28.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.678+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/1774514699 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x555cb9a42a70 con 0x555cb9a35460 2024-08-26T00:04:28.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.678+0000 7fb3af200640 1 --2- 172.21.15.42:0/1774514699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555cb9a3fd20 0x555cb9a3d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:28.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.678+0000 7fb3b7fd8740 10 client.0 _ll_register_callbacks cb 0x555cb9940f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:04:28.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.679+0000 7fb3ae800640 1 -- 172.21.15.42:0/1774514699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a35460 msgr2=0x555cb9a3d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:28.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.679+0000 7fb3ae800640 1 --2- 172.21.15.42:0/1774514699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a35460 0x555cb9a3d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.679+0000 7fb3ae800640 1 -- 172.21.15.42:0/1774514699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555cb9a3fd20 msgr2=0x555cb9a3d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:28.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.679+0000 7fb3ae800640 1 --2- 172.21.15.42:0/1774514699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555cb9a3fd20 0x555cb9a3d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.679+0000 7fb3ae800640 1 -- 172.21.15.42:0/1774514699 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cb970c3c0 con 0x555cb9a34b40 2024-08-26T00:04:28.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.679+0000 7fb3ade00640 1 --2- 172.21.15.42:0/1774514699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a35460 0x555cb9a3d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:04:28.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.679+0000 7fb3af200640 1 --2- 172.21.15.42:0/1774514699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555cb9a3fd20 0x555cb9a3d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:04:28.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.680+0000 7fb3ae800640 1 --2- 172.21.15.42:0/1774514699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a34b40 0x555cb9a3cb70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb3a003c000 tx=0x7fb3a0004550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d25843fa78503e29 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:28.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.680+0000 7fb38fe00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:04:28.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.682+0000 7fb38fe00640 1 -- 172.21.15.42:0/1774514699 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0043070 con 0x555cb9a34b40 2024-08-26T00:04:28.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.682+0000 7fb38fe00640 1 -- 172.21.15.42:0/1774514699 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb3a0004c10 con 0x555cb9a34b40 2024-08-26T00:04:28.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.682+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/1774514699 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb39c010040 con 0x555cb9a34b40 2024-08-26T00:04:28.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.682+0000 7fb38fe00640 1 -- 172.21.15.42:0/1774514699 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb3a004e050 con 0x555cb9a34b40 2024-08-26T00:04:28.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.683+0000 7fb3b7fd8740 10 client.25436 fetch_fsmap learned FSMap version 26 2024-08-26T00:04:28.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.683+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/1774514699 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555cb9a4e5a0 con 0x555cb9a34b40 2024-08-26T00:04:28.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.683+0000 7fb38fe00640 1 -- 172.21.15.42:0/1774514699 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb39c010040 con 0x555cb9a34b40 2024-08-26T00:04:28.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.684+0000 7fb38fe00640 1 -- 172.21.15.42:0/1774514699 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7fb3a00197e0 con 0x555cb9a34b40 2024-08-26T00:04:28.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.684+0000 7fb3b7fd8740 10 client.25436 fetch_fsmap finished waiting for FSMap version 26 2024-08-26T00:04:28.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.684+0000 7fb3b7fd8740 10 client.25436 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:04:28.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.684+0000 7fb3b7fd8740 20 client.25436 populate_metadata read hostname 'smithi042' 2024-08-26T00:04:28.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.684+0000 7fb3b7fd8740 1 --2- 172.21.15.42:0/1774514699 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x555cb9a4fac0 0x555cb9a51f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:28.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.684+0000 7fb3b7fd8740 4 client.25436 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:04:28.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.684+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/1774514699 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cb99a8530 con 0x555cb9a4fac0 2024-08-26T00:04:28.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.687+0000 7fb3ade00640 1 --2- 172.21.15.42:0/1774514699 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x555cb9a4fac0 0x555cb9a51f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:28.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.688+0000 7fb3ade00640 1 --2- 172.21.15.42:0/1774514699 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x555cb9a4fac0 0x555cb9a51f60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e39dc133857aef00 server_cookie=d26e85bee266ce8d in_seq=0 out_seq=0 2024-08-26T00:04:28.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.688+0000 7fb38fe00640 10 client.25436 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:04:28.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.688+0000 7fb38fe00640 1 -- 172.21.15.42:0/1774514699 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555cb99a8530 con 0x555cb9a4fac0 2024-08-26T00:04:28.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.688+0000 7fb38fe00640 10 client.25436 handle_command_reply: tid=0 2024-08-26T00:04:28.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.689+0000 7fb3b7fd8740 1 client.25436 shutdown 2024-08-26T00:04:28.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.689+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/1774514699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a34b40 msgr2=0x555cb9a3cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:28.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.689+0000 7fb3b7fd8740 1 --2- 172.21.15.42:0/1774514699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a34b40 0x555cb9a3cb70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb3a003c000 tx=0x7fb3a0004550 comp rx=0 tx=0).stop 2024-08-26T00:04:28.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.692+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/1774514699 shutdown_connections 2024-08-26T00:04:28.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.692+0000 7fb3b7fd8740 1 --2- 172.21.15.42:0/1774514699 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x555cb9a4fac0 0x555cb9a51f60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.692+0000 7fb3b7fd8740 1 --2- 172.21.15.42:0/1774514699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555cb9a3fd20 0x555cb9a3d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.692+0000 7fb3b7fd8740 1 --2- 172.21.15.42:0/1774514699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a35460 0x555cb9a3d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.692+0000 7fb38fe00640 0 client.25436 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:04:28.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.692+0000 7fb3b7fd8740 1 --2- 172.21.15.42:0/1774514699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a34b40 0x555cb9a3cb70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.692+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/1774514699 >> 172.21.15.42:0/1774514699 conn(0x555cb9a31080 msgr2=0x555cb9a30240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:28.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.692+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/1774514699 shutdown_connections 2024-08-26T00:04:28.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.692+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/1774514699 wait complete. 2024-08-26T00:04:28.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.692+0000 7fb3b7fd8740 20 client.25436 trim_cache size 0 max 16384 2024-08-26T00:04:28.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.746+0000 7fb3b7fd8740 1 Processor -- start 2024-08-26T00:04:28.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.746+0000 7fb3b7fd8740 1 -- start start 2024-08-26T00:04:28.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.747+0000 7fb3b7fd8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555cb9a34b40 0x555cb9a57870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:28.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.747+0000 7fb3b7fd8740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a35460 0x555cb9a57db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:28.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.747+0000 7fb3b7fd8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a3fd20 0x555cb9a2fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:28.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.747+0000 7fb3b7fd8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb390010d90 con 0x555cb9a34b40 2024-08-26T00:04:28.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.747+0000 7fb3b7fd8740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb39000e630 con 0x555cb9a35460 2024-08-26T00:04:28.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.747+0000 7fb3b7fd8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb39000c460 con 0x555cb9a3fd20 2024-08-26T00:04:28.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.748+0000 7fb3ade00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a35460 0x555cb9a57db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:28.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.748+0000 7fb3ade00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a35460 0x555cb9a57db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:53458/0 (socket says 172.21.15.42:53458) 2024-08-26T00:04:28.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.748+0000 7fb3ade00640 1 -- 172.21.15.42:0/2934550928 learned_addr learned my addr 172.21.15.42:0/2934550928 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:28.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.748+0000 7fb3af200640 1 --2- 172.21.15.42:0/2934550928 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a3fd20 0x555cb9a2fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:28.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.749+0000 7fb3ade00640 1 -- 172.21.15.42:0/2934550928 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a3fd20 msgr2=0x555cb9a2fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:28.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.749+0000 7fb3ade00640 1 --2- 172.21.15.42:0/2934550928 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a3fd20 0x555cb9a2fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.749+0000 7fb3ade00640 1 -- 172.21.15.42:0/2934550928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555cb9a34b40 msgr2=0x555cb9a57870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:28.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.749+0000 7fb3ade00640 1 --2- 172.21.15.42:0/2934550928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555cb9a34b40 0x555cb9a57870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.749+0000 7fb3ade00640 1 -- 172.21.15.42:0/2934550928 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cb9a30b20 con 0x555cb9a35460 2024-08-26T00:04:28.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.749+0000 7fb3ade00640 1 --2- 172.21.15.42:0/2934550928 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a35460 0x555cb9a57db0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb39c007fd0 tx=0x7fb39c00b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9bc5588b038f260 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:28.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.750+0000 7fb39aa00640 1 -- 172.21.15.42:0/2934550928 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c040040 con 0x555cb9a35460 2024-08-26T00:04:28.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.750+0000 7fb39aa00640 1 -- 172.21.15.42:0/2934550928 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb39c00b6b0 con 0x555cb9a35460 2024-08-26T00:04:28.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.750+0000 7fb39aa00640 1 -- 172.21.15.42:0/2934550928 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c003ab0 con 0x555cb9a35460 2024-08-26T00:04:28.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.751+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/2934550928 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a35460 msgr2=0x555cb9a57db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:28.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.751+0000 7fb3b7fd8740 1 --2- 172.21.15.42:0/2934550928 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a35460 0x555cb9a57db0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb39c007fd0 tx=0x7fb39c00b860 comp rx=0 tx=0).stop 2024-08-26T00:04:28.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.751+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/2934550928 shutdown_connections 2024-08-26T00:04:28.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.751+0000 7fb3b7fd8740 1 --2- 172.21.15.42:0/2934550928 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a3fd20 0x555cb9a2fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.751+0000 7fb3b7fd8740 1 --2- 172.21.15.42:0/2934550928 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a35460 0x555cb9a57db0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.751+0000 7fb3b7fd8740 1 --2- 172.21.15.42:0/2934550928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555cb9a34b40 0x555cb9a57870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.751+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/2934550928 >> 172.21.15.42:0/2934550928 conn(0x555cb9a31080 msgr2=0x555cb9a3bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:28.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.751+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/2934550928 shutdown_connections 2024-08-26T00:04:28.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.752+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/2934550928 wait complete. 2024-08-26T00:04:28.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.752+0000 7fb3b7fd8740 1 -- start start 2024-08-26T00:04:28.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.752+0000 7fb3b7fd8740 1 Processor -- start 2024-08-26T00:04:28.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.754+0000 7fb3b7fd8740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a34b40 0x555cb9a435d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:28.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.754+0000 7fb3b7fd8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555cb9a35460 0x555cb9a43b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:28.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.754+0000 7fb3b7fd8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a3fd20 0x555cb9a47b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:28.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.754+0000 7fb3b7fd8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb39000caf0 con 0x555cb9a35460 2024-08-26T00:04:28.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.754+0000 7fb3b7fd8740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb39000df60 con 0x555cb9a34b40 2024-08-26T00:04:28.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.754+0000 7fb3b7fd8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb39000d1c0 con 0x555cb9a3fd20 2024-08-26T00:04:28.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.754+0000 7fb3af200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a3fd20 0x555cb9a47b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:28.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.754+0000 7fb3af200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a3fd20 0x555cb9a47b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:51446/0 (socket says 172.21.15.42:51446) 2024-08-26T00:04:28.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.754+0000 7fb3af200640 1 -- 172.21.15.42:0/391610368 learned_addr learned my addr 172.21.15.42:0/391610368 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:04:28.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.755+0000 7fb3b7fd8740 10 client.0 _ll_register_callbacks cb 0x7fb3a000b9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:04:28.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.755+0000 7fb3af200640 1 -- 172.21.15.42:0/391610368 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a34b40 msgr2=0x555cb9a435d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-26T00:04:28.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.755+0000 7fb3ae800640 1 --2- 172.21.15.42:0/391610368 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a34b40 0x555cb9a435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:28.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.755+0000 7fb3af200640 1 --2- 172.21.15.42:0/391610368 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a34b40 0x555cb9a435d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.755+0000 7fb3af200640 1 -- 172.21.15.42:0/391610368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555cb9a35460 msgr2=0x555cb9a43b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:04:28.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:28 smithi043 ceph-mon[22091]: pgmap v397: 97 pgs: 97 active+clean; 54 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.2 MiB/s wr, 184 op/s 2024-08-26T00:04:28.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.755+0000 7fb3af200640 1 --2- 172.21.15.42:0/391610368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555cb9a35460 0x555cb9a43b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.755+0000 7fb3af200640 1 -- 172.21.15.42:0/391610368 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cb9a48180 con 0x555cb9a3fd20 2024-08-26T00:04:28.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.756+0000 7fb3ae800640 1 --2- 172.21.15.42:0/391610368 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a34b40 0x555cb9a435d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:04:28.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.756+0000 7fb38fe00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:04:28.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.756+0000 7fb3af200640 1 --2- 172.21.15.42:0/391610368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a3fd20 0x555cb9a47b40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb3b01006e0 tx=0x7fb3b00681b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6399446a3a36b server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:04:28.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.757+0000 7fb38fe00640 1 -- 172.21.15.42:0/391610368 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0119be0 con 0x555cb9a3fd20 2024-08-26T00:04:28.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.757+0000 7fb38fe00640 1 -- 172.21.15.42:0/391610368 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb3b00fece0 con 0x555cb9a3fd20 2024-08-26T00:04:28.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.757+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/391610368 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb39c00b6b0 con 0x555cb9a3fd20 2024-08-26T00:04:28.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.757+0000 7fb38fe00640 1 -- 172.21.15.42:0/391610368 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb3b0119be0 con 0x555cb9a3fd20 2024-08-26T00:04:28.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.757+0000 7fb3b7fd8740 10 client.25438 fetch_fsmap learned FSMap version 26 2024-08-26T00:04:28.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.757+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/391610368 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555cb9aba380 con 0x555cb9a3fd20 2024-08-26T00:04:28.765 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:04:28.765 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-26T00:04:28.765 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-08-26T00:04:28.765 INFO:teuthology.orchestra.run.smithi042.stdout: "f22956bc-4be7-4574-8c1d-c23d41501ab7": { 2024-08-26T00:04:28.765 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-08-26T00:04:28.766 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "f22956bc-4be7-4574-8c1d-c23d41501ab7", 2024-08-26T00:04:28.766 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,force" 2024-08-26T00:04:28.766 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:04:28.766 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:04:28.766 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:04:28.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.758+0000 7fb38fe00640 1 -- 172.21.15.42:0/391610368 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb39c00b6b0 con 0x555cb9a3fd20 2024-08-26T00:04:28.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.758+0000 7fb38fe00640 1 -- 172.21.15.42:0/391610368 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7fb3b00ffe30 con 0x555cb9a3fd20 2024-08-26T00:04:28.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.758+0000 7fb3b7fd8740 10 client.25438 fetch_fsmap finished waiting for FSMap version 26 2024-08-26T00:04:28.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.758+0000 7fb3b7fd8740 10 client.25438 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:04:28.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.758+0000 7fb3b7fd8740 20 client.25438 populate_metadata read hostname 'smithi042' 2024-08-26T00:04:28.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.758+0000 7fb3b7fd8740 1 --2- 172.21.15.42:0/391610368 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x555cb9a4fac0 0x555cb9abcb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:04:28.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.758+0000 7fb3b7fd8740 4 client.25438 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-26T00:04:28.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.758+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/391610368 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555cb99a2a40 con 0x555cb9a4fac0 2024-08-26T00:04:28.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.759+0000 7fb3ae800640 1 --2- 172.21.15.42:0/391610368 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x555cb9a4fac0 0x555cb9abcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:04:28.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.759+0000 7fb3ae800640 1 --2- 172.21.15.42:0/391610368 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x555cb9a4fac0 0x555cb9abcb90 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e515d6c9e53cefdd server_cookie=5fabeda1a24dff90 in_seq=0 out_seq=0 2024-08-26T00:04:28.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.759+0000 7fb38fe00640 10 client.25438 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:04:28.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.760+0000 7fb38fe00640 1 -- 172.21.15.42:0/391610368 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x555cb99a2a40 con 0x555cb9a4fac0 2024-08-26T00:04:28.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.760+0000 7fb38fe00640 10 client.25438 handle_command_reply: tid=0 2024-08-26T00:04:28.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.760+0000 7fb3b7fd8740 1 client.25438 shutdown 2024-08-26T00:04:28.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.760+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/391610368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a3fd20 msgr2=0x555cb9a47b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:28.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.760+0000 7fb3b7fd8740 1 --2- 172.21.15.42:0/391610368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a3fd20 0x555cb9a47b40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb3b01006e0 tx=0x7fb3b00681b0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.760+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/391610368 shutdown_connections 2024-08-26T00:04:28.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.760+0000 7fb3b7fd8740 1 --2- 172.21.15.42:0/391610368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb9a3fd20 0x555cb9a47b40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.760+0000 7fb3b7fd8740 1 --2- 172.21.15.42:0/391610368 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x555cb9a4fac0 0x555cb9abcb90 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.760+0000 7fb3b7fd8740 1 --2- 172.21.15.42:0/391610368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555cb9a35460 0x555cb9a43b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.760+0000 7fb3b7fd8740 1 --2- 172.21.15.42:0/391610368 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555cb9a34b40 0x555cb9a435d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.760+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/391610368 >> 172.21.15.42:0/391610368 conn(0x555cb9a31080 msgr2=0x555cb9a2fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:28.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.760+0000 7fb38fe00640 0 client.25438 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:04:28.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.761+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/391610368 shutdown_connections 2024-08-26T00:04:28.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.761+0000 7fb3b7fd8740 1 -- 172.21.15.42:0/391610368 wait complete. 2024-08-26T00:04:28.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.761+0000 7fb3b7fd8740 20 client.25438 trim_cache size 0 max 16384 2024-08-26T00:04:28.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.763+0000 7fb3b4a00640 1 -- 172.21.15.42:0/4288494528 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb3940a2db0 msgr2=0x7fb3940a5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:28.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.763+0000 7fb3b4a00640 1 --2- 172.21.15.42:0/4288494528 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb3940a2db0 0x7fb3940a5270 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb39c006e90 tx=0x7fb39c00b130 comp rx=0 tx=0).stop 2024-08-26T00:04:28.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.763+0000 7fb3b4a00640 1 -- 172.21.15.42:0/4288494528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3a80ab560 msgr2=0x7fb3a814bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:04:28.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.763+0000 7fb3b4a00640 1 --2- 172.21.15.42:0/4288494528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3a80ab560 0x7fb3a814bab0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0051650 tx=0x7fb3b0074f40 comp rx=0 tx=0).stop 2024-08-26T00:04:28.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.763+0000 7fb3b4a00640 1 -- 172.21.15.42:0/4288494528 shutdown_connections 2024-08-26T00:04:28.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.763+0000 7fb3b4a00640 1 --2- 172.21.15.42:0/4288494528 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb3940a2db0 0x7fb3940a5270 secure :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb39c006e90 tx=0x7fb39c00b130 comp rx=0 tx=0).stop 2024-08-26T00:04:28.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.763+0000 7fb3b4a00640 1 --2- 172.21.15.42:0/4288494528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3a80ab560 0x7fb3a814bab0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.763+0000 7fb3b4a00640 1 --2- 172.21.15.42:0/4288494528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3a80a62e0 0x7fb3a8151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.763+0000 7fb3b4a00640 1 --2- 172.21.15.42:0/4288494528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3a80a5940 0x7fb3a81518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:04:28.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.764+0000 7fb3b4a00640 1 -- 172.21.15.42:0/4288494528 >> 172.21.15.42:0/4288494528 conn(0x7fb3a800a1f0 msgr2=0x7fb3a80935f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:04:28.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.764+0000 7fb3b4a00640 1 -- 172.21.15.42:0/4288494528 shutdown_connections 2024-08-26T00:04:28.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:04:28.766+0000 7fb3b4a00640 1 -- 172.21.15.42:0/4288494528 wait complete. 2024-08-26T00:04:28.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:28 smithi181 ceph-mon[22102]: pgmap v397: 97 pgs: 97 active+clean; 54 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.2 MiB/s wr, 184 op/s 2024-08-26T00:04:29.548 INFO:tasks.cephfs.filesystem:scrub status for tag:f22956bc-4be7-4574-8c1d-c23d41501ab7 - {'path': '/', 'tag': 'f22956bc-4be7-4574-8c1d-c23d41501ab7', 'options': 'recursive,force'} 2024-08-26T00:04:30.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:30 smithi043 ceph-mon[22091]: pgmap v398: 97 pgs: 97 active+clean; 70 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.7 MiB/s wr, 255 op/s 2024-08-26T00:04:30.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:30 smithi042 ceph-mon[17225]: pgmap v398: 97 pgs: 97 active+clean; 70 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.7 MiB/s wr, 255 op/s 2024-08-26T00:04:30.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:30 smithi181 ceph-mon[22102]: pgmap v398: 97 pgs: 97 active+clean; 70 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.7 MiB/s wr, 255 op/s 2024-08-26T00:04:31.632 INFO:tasks.workunit.client.0.smithi042.stdout: 26 271206 487 208221 360 141456 1063 2024-08-26T00:04:31.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:31.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:31.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.804 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.804 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.804 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.804 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.804 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.804 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:31.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:31.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: pgmap v399: 97 pgs: 97 active+clean; 70 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.6 MiB/s wr, 231 op/s 2024-08-26T00:04:32.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.779 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.779 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.779 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.779 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.779 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.779 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.780 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.780 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.780 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.780 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.780 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.780 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.780 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.780 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.780 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.780 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.781 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.781 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.781 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.781 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.781 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.781 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.781 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.781 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.781 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.781 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.781 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.781 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.781 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.781 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.781 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.782 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.782 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.782 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.782 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.782 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.782 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.782 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.782 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.782 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.782 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.782 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:04:32.782 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.782 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: pgmap v399: 97 pgs: 97 active+clean; 70 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.6 MiB/s wr, 231 op/s 2024-08-26T00:04:32.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.805 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.805 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.805 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.805 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.805 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.805 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:04:32.805 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.805 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: pgmap v399: 97 pgs: 97 active+clean; 70 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.6 MiB/s wr, 231 op/s 2024-08-26T00:04:32.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:04:32.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:32.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:04:34.629 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:34 smithi042 ceph-mon[17225]: pgmap v400: 97 pgs: 97 active+clean; 80 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 248 op/s 2024-08-26T00:04:34.629 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:34 smithi042 ceph-mon[17225]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:04:34.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:34 smithi043 ceph-mon[22091]: pgmap v400: 97 pgs: 97 active+clean; 80 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 248 op/s 2024-08-26T00:04:34.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:34 smithi043 ceph-mon[22091]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:04:34.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:34 smithi181 ceph-mon[22102]: pgmap v400: 97 pgs: 97 active+clean; 80 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 248 op/s 2024-08-26T00:04:34.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:34 smithi181 ceph-mon[22102]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:04:36.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:36 smithi043 ceph-mon[22091]: pgmap v401: 97 pgs: 97 active+clean; 80 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 190 op/s 2024-08-26T00:04:36.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:36 smithi042 ceph-mon[17225]: pgmap v401: 97 pgs: 97 active+clean; 80 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 190 op/s 2024-08-26T00:04:36.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:36 smithi181 ceph-mon[22102]: pgmap v401: 97 pgs: 97 active+clean; 80 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 190 op/s 2024-08-26T00:04:38.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:38 smithi043 ceph-mon[22091]: pgmap v402: 97 pgs: 97 active+clean; 85 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 233 op/s 2024-08-26T00:04:38.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:38 smithi042 ceph-mon[17225]: pgmap v402: 97 pgs: 97 active+clean; 85 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 233 op/s 2024-08-26T00:04:38.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:38 smithi181 ceph-mon[22102]: pgmap v402: 97 pgs: 97 active+clean; 85 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 233 op/s 2024-08-26T00:04:40.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:40 smithi043 ceph-mon[22091]: pgmap v403: 97 pgs: 97 active+clean; 86 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 209 op/s 2024-08-26T00:04:40.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:40 smithi042 ceph-mon[17225]: pgmap v403: 97 pgs: 97 active+clean; 86 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 209 op/s 2024-08-26T00:04:40.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:40 smithi181 ceph-mon[22102]: pgmap v403: 97 pgs: 97 active+clean; 86 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 209 op/s 2024-08-26T00:04:41.634 INFO:tasks.workunit.client.0.smithi042.stdout: 48 354402 1100 245313 703 162417 988 2024-08-26T00:04:42.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:42 smithi043 ceph-mon[22091]: pgmap v404: 97 pgs: 97 active+clean; 86 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.5 MiB/s wr, 140 op/s 2024-08-26T00:04:42.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:42 smithi181 ceph-mon[22102]: pgmap v404: 97 pgs: 97 active+clean; 86 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.5 MiB/s wr, 140 op/s 2024-08-26T00:04:42.792 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:42 smithi042 ceph-mon[17225]: pgmap v404: 97 pgs: 97 active+clean; 86 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.5 MiB/s wr, 140 op/s 2024-08-26T00:04:43.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:43 smithi043 ceph-mon[22091]: pgmap v405: 97 pgs: 97 active+clean; 95 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.3 MiB/s wr, 168 op/s 2024-08-26T00:04:43.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:43 smithi181 ceph-mon[22102]: pgmap v405: 97 pgs: 97 active+clean; 95 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.3 MiB/s wr, 168 op/s 2024-08-26T00:04:43.795 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:43 smithi042 ceph-mon[17225]: pgmap v405: 97 pgs: 97 active+clean; 95 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.3 MiB/s wr, 168 op/s 2024-08-26T00:04:44.653 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:44 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:04:44.653 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:44 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:04:44.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:44 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:04:44.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:44 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:04:44.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:44 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:04:44.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:44 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:04:45.481 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:45 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:04:45.481 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:45 smithi042 ceph-mon[17225]: pgmap v406: 97 pgs: 97 active+clean; 96 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.6 MiB/s wr, 137 op/s 2024-08-26T00:04:45.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:45 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:04:45.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:45 smithi043 ceph-mon[22091]: pgmap v406: 97 pgs: 97 active+clean; 96 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.6 MiB/s wr, 137 op/s 2024-08-26T00:04:45.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:45 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:04:45.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:45 smithi181 ceph-mon[22102]: pgmap v406: 97 pgs: 97 active+clean; 96 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.6 MiB/s wr, 137 op/s 2024-08-26T00:04:46.660 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:46 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:04:46.660 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:46 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:04:46.660 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:46 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:04:46.661 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:46 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:04:46.661 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:46 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:04:46.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:46 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:04:46.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:46 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:04:46.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:46 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:04:46.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:46 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:04:46.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:46 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:04:46.797 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:46 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:04:46.797 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:46 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:04:46.797 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:46 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:04:46.797 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:46 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:04:46.797 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:46 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:04:47.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:47 smithi043 ceph-mon[22091]: pgmap v407: 97 pgs: 97 active+clean; 105 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 202 op/s 2024-08-26T00:04:47.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:47 smithi042 ceph-mon[17225]: pgmap v407: 97 pgs: 97 active+clean; 105 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 202 op/s 2024-08-26T00:04:47.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:47 smithi181 ceph-mon[22102]: pgmap v407: 97 pgs: 97 active+clean; 105 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 202 op/s 2024-08-26T00:04:48.685 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:48 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:04:48.685 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:48 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:04:48.685 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:48 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:04:48.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:48 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:04:48.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:48 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:04:48.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:48 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:04:48.793 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:48 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:04:48.793 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:48 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:04:48.793 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:48 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:04:49.627 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:49 smithi042 ceph-mon[17225]: pgmap v408: 97 pgs: 97 active+clean; 116 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 246 op/s 2024-08-26T00:04:49.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:49 smithi043 ceph-mon[22091]: pgmap v408: 97 pgs: 97 active+clean; 116 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 246 op/s 2024-08-26T00:04:49.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:49 smithi181 ceph-mon[22102]: pgmap v408: 97 pgs: 97 active+clean; 116 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 246 op/s 2024-08-26T00:04:51.635 INFO:tasks.workunit.client.0.smithi042.stdout: 60 374884 658 239776 495 135004 722 2024-08-26T00:04:51.641 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:51 smithi042 ceph-mon[17225]: pgmap v409: 97 pgs: 97 active+clean; 136 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.8 MiB/s wr, 335 op/s 2024-08-26T00:04:52.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:51 smithi043 ceph-mon[22091]: pgmap v409: 97 pgs: 97 active+clean; 136 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.8 MiB/s wr, 335 op/s 2024-08-26T00:04:52.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:51 smithi181 ceph-mon[22102]: pgmap v409: 97 pgs: 97 active+clean; 136 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.8 MiB/s wr, 335 op/s 2024-08-26T00:04:53.857 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:53 smithi042 ceph-mon[17225]: pgmap v410: 97 pgs: 97 active+clean; 207 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 680 op/s 2024-08-26T00:04:54.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:53 smithi043 ceph-mon[22091]: pgmap v410: 97 pgs: 97 active+clean; 207 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 680 op/s 2024-08-26T00:04:54.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:53 smithi181 ceph-mon[22102]: pgmap v410: 97 pgs: 97 active+clean; 207 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 680 op/s 2024-08-26T00:04:55.874 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:55 smithi042 ceph-mon[17225]: pgmap v411: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 11 MiB/s wr, 689 op/s 2024-08-26T00:04:56.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:55 smithi043 ceph-mon[22091]: pgmap v411: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 11 MiB/s wr, 689 op/s 2024-08-26T00:04:56.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:55 smithi181 ceph-mon[22102]: pgmap v411: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 11 MiB/s wr, 689 op/s 2024-08-26T00:04:58.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:57 smithi043 ceph-mon[22091]: pgmap v412: 97 pgs: 97 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 11 MiB/s wr, 725 op/s 2024-08-26T00:04:58.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:57 smithi042 ceph-mon[17225]: pgmap v412: 97 pgs: 97 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 11 MiB/s wr, 725 op/s 2024-08-26T00:04:58.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:57 smithi181 ceph-mon[22102]: pgmap v412: 97 pgs: 97 active+clean; 214 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 11 MiB/s wr, 725 op/s 2024-08-26T00:04:59.549 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-26T00:04:59.949 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:04:59 smithi042 ceph-mon[17225]: pgmap v413: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 10 MiB/s wr, 715 op/s 2024-08-26T00:05:00.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:04:59 smithi043 ceph-mon[22091]: pgmap v413: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 10 MiB/s wr, 715 op/s 2024-08-26T00:05:00.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:04:59 smithi181 ceph-mon[22102]: pgmap v413: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 10 MiB/s wr, 715 op/s 2024-08-26T00:05:01.634 INFO:tasks.workunit.client.0.smithi042.stdout: 73 243852 889 155224 748 92087 504 2024-08-26T00:05:02.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:01 smithi043 ceph-mon[22091]: pgmap v414: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 9.3 MiB/s wr, 629 op/s 2024-08-26T00:05:02.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:01 smithi181 ceph-mon[22102]: pgmap v414: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 9.3 MiB/s wr, 629 op/s 2024-08-26T00:05:02.054 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:01 smithi042 ceph-mon[17225]: pgmap v414: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 9.3 MiB/s wr, 629 op/s 2024-08-26T00:05:03.647 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:05:04.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:03 smithi043 ceph-mon[22091]: pgmap v415: 97 pgs: 97 active+clean; 223 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.3 MiB/s wr, 580 op/s 2024-08-26T00:05:04.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:03 smithi042 ceph-mon[17225]: pgmap v415: 97 pgs: 97 active+clean; 223 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.3 MiB/s wr, 580 op/s 2024-08-26T00:05:04.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:03 smithi181 ceph-mon[22102]: pgmap v415: 97 pgs: 97 active+clean; 223 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.3 MiB/s wr, 580 op/s 2024-08-26T00:05:05.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.396+0000 7f8663000640 1 -- 172.21.15.42:0/2202105890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f865c114850 msgr2=0x7f865c116c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:05.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.396+0000 7f8663000640 1 --2- 172.21.15.42:0/2202105890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f865c114850 0x7f865c116c40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8654009ca0 tx=0x7f865402a970 comp rx=0 tx=0).stop 2024-08-26T00:05:05.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.399+0000 7f8663000640 1 -- 172.21.15.42:0/2202105890 shutdown_connections 2024-08-26T00:05:05.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.399+0000 7f8663000640 1 --2- 172.21.15.42:0/2202105890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f865c114850 0x7f865c116c40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.399+0000 7f8663000640 1 --2- 172.21.15.42:0/2202105890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f865c1098b0 0x7f865c114310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.399+0000 7f8663000640 1 --2- 172.21.15.42:0/2202105890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f865c108f90 0x7f865c109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.399+0000 7f8663000640 1 -- 172.21.15.42:0/2202105890 >> 172.21.15.42:0/2202105890 conn(0x7f865c06dee0 msgr2=0x7f865c06e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:05.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.399+0000 7f8663000640 1 -- 172.21.15.42:0/2202105890 shutdown_connections 2024-08-26T00:05:05.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.399+0000 7f8663000640 1 -- 172.21.15.42:0/2202105890 wait complete. 2024-08-26T00:05:05.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.401+0000 7f8663000640 1 Processor -- start 2024-08-26T00:05:05.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.401+0000 7f8663000640 1 -- start start 2024-08-26T00:05:05.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.402+0000 7f8663000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f865c108f90 0x7f865c113c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:05.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.402+0000 7f8663000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f865c1098b0 0x7f865c114150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:05.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.402+0000 7f8663000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f865c114850 0x7f865c10abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:05.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.403+0000 7f8663000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f865c11a5f0 con 0x7f865c114850 2024-08-26T00:05:05.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.403+0000 7f8663000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f865c11a470 con 0x7f865c1098b0 2024-08-26T00:05:05.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.403+0000 7f8663000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f865c11a770 con 0x7f865c108f90 2024-08-26T00:05:05.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.403+0000 7f8661000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f865c114850 0x7f865c10abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:05.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.403+0000 7f8661000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f865c114850 0x7f865c10abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51158/0 (socket says 172.21.15.42:51158) 2024-08-26T00:05:05.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.403+0000 7f8661000640 1 -- 172.21.15.42:0/2072272717 learned_addr learned my addr 172.21.15.42:0/2072272717 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:05.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.404+0000 7f865b400640 1 --2- 172.21.15.42:0/2072272717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f865c1098b0 0x7f865c114150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:05.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.404+0000 7f8661000640 1 -- 172.21.15.42:0/2072272717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f865c108f90 msgr2=0x7f865c113c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:05.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.404+0000 7f865be00640 1 --2- 172.21.15.42:0/2072272717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f865c108f90 0x7f865c113c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:05.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.406+0000 7f8661000640 1 --2- 172.21.15.42:0/2072272717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f865c108f90 0x7f865c113c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.406+0000 7f8661000640 1 -- 172.21.15.42:0/2072272717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f865c1098b0 msgr2=0x7f865c114150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:05.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.406+0000 7f8661000640 1 --2- 172.21.15.42:0/2072272717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f865c1098b0 0x7f865c114150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.406+0000 7f8661000640 1 -- 172.21.15.42:0/2072272717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f865c10b4b0 con 0x7f865c114850 2024-08-26T00:05:05.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.409+0000 7f865b400640 1 --2- 172.21.15.42:0/2072272717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f865c1098b0 0x7f865c114150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:05:05.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.410+0000 7f865be00640 1 --2- 172.21.15.42:0/2072272717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f865c108f90 0x7f865c113c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:05:05.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.412+0000 7f8661000640 1 --2- 172.21.15.42:0/2072272717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f865c114850 0x7f865c10abf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f865402ae90 tx=0x7f86540308a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:05.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.415+0000 7f8658c00640 1 -- 172.21.15.42:0/2072272717 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8654034030 con 0x7f865c114850 2024-08-26T00:05:05.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.416+0000 7f8658c00640 1 -- 172.21.15.42:0/2072272717 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8654004040 con 0x7f865c114850 2024-08-26T00:05:05.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.416+0000 7f8663000640 1 -- 172.21.15.42:0/2072272717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f865c10b740 con 0x7f865c114850 2024-08-26T00:05:05.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.416+0000 7f8663000640 1 -- 172.21.15.42:0/2072272717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f865c10f830 con 0x7f865c114850 2024-08-26T00:05:05.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.417+0000 7f8658c00640 1 -- 172.21.15.42:0/2072272717 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8654039680 con 0x7f865c114850 2024-08-26T00:05:05.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.427+0000 7f8658c00640 1 -- 172.21.15.42:0/2072272717 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8654037020 con 0x7f865c114850 2024-08-26T00:05:05.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.429+0000 7f8665a20740 1 Processor -- start 2024-08-26T00:05:05.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.430+0000 7f8658c00640 1 --2- 172.21.15.42:0/2072272717 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f86400a2cd0 0x7f86400a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:05.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.431+0000 7f8665a20740 1 -- start start 2024-08-26T00:05:05.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.431+0000 7f8658c00640 1 -- 172.21.15.42:0/2072272717 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f86540f0130 con 0x7f865c114850 2024-08-26T00:05:05.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.431+0000 7f8665a20740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab054940 0x564fab054d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:05.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.431+0000 7f8665a20740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fab055260 0x564fab05f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:05.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.431+0000 7f8665a20740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab05fb20 0x564fab061f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:05.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.431+0000 7f8665a20740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564faafbafc0 con 0x564fab05fb20 2024-08-26T00:05:05.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.431+0000 7f8665a20740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564faaf52680 con 0x564fab055260 2024-08-26T00:05:05.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.431+0000 7f8665a20740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564faafb6f80 con 0x564fab054940 2024-08-26T00:05:05.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.431+0000 7f865b400640 1 --2- 172.21.15.42:0/2072272717 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f86400a2cd0 0x7f86400a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:05.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.432+0000 7f8661000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab05fb20 0x564fab061f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:05.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.433+0000 7f865be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab054940 0x564fab054d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:05.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.433+0000 7f865be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab054940 0x564fab054d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:35522/0 (socket says 172.21.15.42:35522) 2024-08-26T00:05:05.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.433+0000 7f865be00640 1 -- 172.21.15.42:0/2650210346 learned_addr learned my addr 172.21.15.42:0/2650210346 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:05.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.433+0000 7f865be00640 1 -- 172.21.15.42:0/2650210346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fab055260 msgr2=0x564fab05f5e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:05:05.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.433+0000 7f865be00640 1 --2- 172.21.15.42:0/2650210346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fab055260 0x564fab05f5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.433+0000 7f865be00640 1 -- 172.21.15.42:0/2650210346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab05fb20 msgr2=0x564fab061f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:05.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.434+0000 7f865be00640 1 --2- 172.21.15.42:0/2650210346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab05fb20 0x564fab061f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.434+0000 7f865be00640 1 -- 172.21.15.42:0/2650210346 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564faaf6e2c0 con 0x564fab054940 2024-08-26T00:05:05.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.434+0000 7f865b400640 1 --2- 172.21.15.42:0/2072272717 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f86400a2cd0 0x7f86400a5190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f865c10c390 tx=0x7f864c00a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:05.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.434+0000 7f8661000640 1 --2- 172.21.15.42:0/2650210346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab05fb20 0x564fab061f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:05:05.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.435+0000 7f865be00640 1 --2- 172.21.15.42:0/2650210346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab054940 0x564fab054d20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f864800a9c0 tx=0x7f864800ae80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa4c5f0bceb917b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:05.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.435+0000 7f8651600640 1 -- 172.21.15.42:0/2650210346 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8648015070 con 0x564fab054940 2024-08-26T00:05:05.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.435+0000 7f8651600640 1 -- 172.21.15.42:0/2650210346 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f864800cc60 con 0x564fab054940 2024-08-26T00:05:05.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.435+0000 7f8651600640 1 -- 172.21.15.42:0/2650210346 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86480186d0 con 0x564fab054940 2024-08-26T00:05:05.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.436+0000 7f8665a20740 1 -- 172.21.15.42:0/2650210346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab054940 msgr2=0x564fab054d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:05.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.436+0000 7f8665a20740 1 --2- 172.21.15.42:0/2650210346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab054940 0x564fab054d20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f864800a9c0 tx=0x7f864800ae80 comp rx=0 tx=0).stop 2024-08-26T00:05:05.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.437+0000 7f8665a20740 1 -- 172.21.15.42:0/2650210346 shutdown_connections 2024-08-26T00:05:05.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.437+0000 7f8665a20740 1 --2- 172.21.15.42:0/2650210346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab05fb20 0x564fab061f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.437+0000 7f8665a20740 1 --2- 172.21.15.42:0/2650210346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fab055260 0x564fab05f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.437+0000 7f8665a20740 1 --2- 172.21.15.42:0/2650210346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab054940 0x564fab054d20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.437+0000 7f8665a20740 1 -- 172.21.15.42:0/2650210346 >> 172.21.15.42:0/2650210346 conn(0x564fab050ed0 msgr2=0x564fab0512b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:05.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.438+0000 7f8665a20740 1 -- 172.21.15.42:0/2650210346 shutdown_connections 2024-08-26T00:05:05.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.438+0000 7f8665a20740 1 -- 172.21.15.42:0/2650210346 wait complete. 2024-08-26T00:05:05.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.439+0000 7f8665a20740 1 -- start start 2024-08-26T00:05:05.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.439+0000 7f8665a20740 1 Processor -- start 2024-08-26T00:05:05.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.440+0000 7f8665a20740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab054940 0x564fab05c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:05.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.440+0000 7f8665a20740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab055260 0x564fab05cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:05.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.440+0000 7f8665a20740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fab05fb20 0x564fab05d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:05.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.441+0000 7f8665a20740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564fab0626f0 con 0x564fab055260 2024-08-26T00:05:05.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.441+0000 7f8665a20740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564faaf75e50 con 0x564fab05fb20 2024-08-26T00:05:05.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.441+0000 7f8665a20740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564fab062870 con 0x564fab054940 2024-08-26T00:05:05.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.441+0000 7f8665a20740 10 client.0 _ll_register_callbacks cb 0x564faaf60f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:05:05.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.441+0000 7f865b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab055260 0x564fab05cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:05.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.441+0000 7f865b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab055260 0x564fab05cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51190/0 (socket says 172.21.15.42:51190) 2024-08-26T00:05:05.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.441+0000 7f865b400640 1 -- 172.21.15.42:0/1804548883 learned_addr learned my addr 172.21.15.42:0/1804548883 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:05.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.442+0000 7f865be00640 1 --2- 172.21.15.42:0/1804548883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab054940 0x564fab05c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:05.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.442+0000 7f8661000640 1 --2- 172.21.15.42:0/1804548883 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fab05fb20 0x564fab05d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:05.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.442+0000 7f865b400640 1 -- 172.21.15.42:0/1804548883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab054940 msgr2=0x564fab05c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:05.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.442+0000 7f865b400640 1 --2- 172.21.15.42:0/1804548883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab054940 0x564fab05c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.442+0000 7f865b400640 1 -- 172.21.15.42:0/1804548883 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fab05fb20 msgr2=0x564fab05d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:05.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.442+0000 7f865b400640 1 --2- 172.21.15.42:0/1804548883 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fab05fb20 0x564fab05d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.442+0000 7f865b400640 1 -- 172.21.15.42:0/1804548883 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564faad2c3c0 con 0x564fab055260 2024-08-26T00:05:05.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.442+0000 7f8661000640 1 --2- 172.21.15.42:0/1804548883 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fab05fb20 0x564fab05d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:05:05.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.442+0000 7f865be00640 1 --2- 172.21.15.42:0/1804548883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab054940 0x564fab05c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:05:05.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.442+0000 7f865b400640 1 --2- 172.21.15.42:0/1804548883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab055260 0x564fab05cf00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f864c010960 tx=0x7f864c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996e94c2f019324b server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:05.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.443+0000 7f8646000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:05:05.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.443+0000 7f8646000640 1 -- 172.21.15.42:0/1804548883 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864c021070 con 0x564fab055260 2024-08-26T00:05:05.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.443+0000 7f8665a20740 1 -- 172.21.15.42:0/1804548883 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f864800cc60 con 0x564fab055260 2024-08-26T00:05:05.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.443+0000 7f8646000640 1 -- 172.21.15.42:0/1804548883 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f864c00fcd0 con 0x564fab055260 2024-08-26T00:05:05.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.444+0000 7f8646000640 1 -- 172.21.15.42:0/1804548883 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f864c02b050 con 0x564fab055260 2024-08-26T00:05:05.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.444+0000 7f8665a20740 10 client.15414 fetch_fsmap learned FSMap version 27 2024-08-26T00:05:05.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.444+0000 7f8665a20740 1 -- 172.21.15.42:0/1804548883 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564fab06e430 con 0x564fab055260 2024-08-26T00:05:05.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.447+0000 7f8646000640 1 -- 172.21.15.42:0/1804548883 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f864800cc60 con 0x564fab055260 2024-08-26T00:05:05.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.447+0000 7f8646000640 1 -- 172.21.15.42:0/1804548883 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f864c026680 con 0x564fab055260 2024-08-26T00:05:05.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.447+0000 7f8665a20740 10 client.15414 fetch_fsmap finished waiting for FSMap version 27 2024-08-26T00:05:05.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.447+0000 7f8665a20740 10 client.15414 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:05:05.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.447+0000 7f8665a20740 20 client.15414 populate_metadata read hostname 'smithi042' 2024-08-26T00:05:05.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.447+0000 7f8665a20740 1 --2- 172.21.15.42:0/1804548883 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x564fab06f840 0x564fab071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:05.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.447+0000 7f8665a20740 4 client.15414 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:05:05.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.447+0000 7f8665a20740 1 -- 172.21.15.42:0/1804548883 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564faafc8530 con 0x564fab06f840 2024-08-26T00:05:05.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.451+0000 7f865be00640 1 --2- 172.21.15.42:0/1804548883 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x564fab06f840 0x564fab071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:05.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.453+0000 7f865be00640 1 --2- 172.21.15.42:0/1804548883 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x564fab06f840 0x564fab071d00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af5d2491daa60946 server_cookie=bb8b687c0cc67568 in_seq=0 out_seq=0 2024-08-26T00:05:05.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.454+0000 7f8646000640 10 client.15414 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:05:05.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.456+0000 7f8646000640 1 -- 172.21.15.42:0/1804548883 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564faafc8530 con 0x564fab06f840 2024-08-26T00:05:05.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.456+0000 7f8646000640 10 client.15414 handle_command_reply: tid=0 2024-08-26T00:05:05.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.456+0000 7f8665a20740 1 client.15414 shutdown 2024-08-26T00:05:05.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.457+0000 7f8665a20740 1 -- 172.21.15.42:0/1804548883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab055260 msgr2=0x564fab05cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:05.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.457+0000 7f8665a20740 1 --2- 172.21.15.42:0/1804548883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab055260 0x564fab05cf00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f864c010960 tx=0x7f864c0046c0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.457+0000 7f8665a20740 1 -- 172.21.15.42:0/1804548883 shutdown_connections 2024-08-26T00:05:05.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.457+0000 7f8665a20740 1 --2- 172.21.15.42:0/1804548883 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fab05fb20 0x564fab05d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.457+0000 7f8665a20740 1 --2- 172.21.15.42:0/1804548883 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x564fab06f840 0x564fab071d00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.457+0000 7f8665a20740 1 --2- 172.21.15.42:0/1804548883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab055260 0x564fab05cf00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.457+0000 7f8665a20740 1 --2- 172.21.15.42:0/1804548883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab054940 0x564fab05c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.457+0000 7f8665a20740 1 -- 172.21.15.42:0/1804548883 >> 172.21.15.42:0/1804548883 conn(0x564fab050ed0 msgr2=0x564fab050050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:05.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.458+0000 7f8646000640 0 client.15414 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:05:05.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.458+0000 7f8665a20740 1 -- 172.21.15.42:0/1804548883 shutdown_connections 2024-08-26T00:05:05.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.459+0000 7f8665a20740 1 -- 172.21.15.42:0/1804548883 wait complete. 2024-08-26T00:05:05.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.459+0000 7f8665a20740 20 client.15414 trim_cache size 0 max 16384 2024-08-26T00:05:05.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.493+0000 7f8665a20740 1 Processor -- start 2024-08-26T00:05:05.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.493+0000 7f8665a20740 1 -- start start 2024-08-26T00:05:05.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.493+0000 7f8665a20740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab054940 0x564fab0573a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:05.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.493+0000 7f8665a20740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab055260 0x564fab071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:05.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.493+0000 7f8665a20740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fab05fb20 0x564fab05e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:05.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.493+0000 7f8665a20740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f863c010e50 con 0x564fab054940 2024-08-26T00:05:05.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.493+0000 7f8665a20740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f863c00e6c0 con 0x564fab05fb20 2024-08-26T00:05:05.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.493+0000 7f8665a20740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f863c00c4b0 con 0x564fab055260 2024-08-26T00:05:05.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.494+0000 7f865b400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab055260 0x564fab071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:05.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.494+0000 7f865be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab054940 0x564fab0573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:05.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.494+0000 7f865be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab054940 0x564fab0573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51206/0 (socket says 172.21.15.42:51206) 2024-08-26T00:05:05.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.494+0000 7f865be00640 1 -- 172.21.15.42:0/3531948477 learned_addr learned my addr 172.21.15.42:0/3531948477 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:05.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.494+0000 7f8661000640 1 --2- 172.21.15.42:0/3531948477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fab05fb20 0x564fab05e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:05.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.495+0000 7f8661000640 1 -- 172.21.15.42:0/3531948477 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab055260 msgr2=0x564fab071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:05.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.495+0000 7f8661000640 1 --2- 172.21.15.42:0/3531948477 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab055260 0x564fab071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.495+0000 7f8661000640 1 -- 172.21.15.42:0/3531948477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab054940 msgr2=0x564fab0573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:05.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.495+0000 7f8661000640 1 --2- 172.21.15.42:0/3531948477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab054940 0x564fab0573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.495+0000 7f8661000640 1 -- 172.21.15.42:0/3531948477 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fab05b970 con 0x564fab05fb20 2024-08-26T00:05:05.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.495+0000 7f8661000640 1 --2- 172.21.15.42:0/3531948477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fab05fb20 0x564fab05e930 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x564fab052250 tx=0x7f86540bc5e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66570dd8a1417b4d server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:05.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.495+0000 7f8650c00640 1 -- 172.21.15.42:0/3531948477 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86540c0d40 con 0x564fab05fb20 2024-08-26T00:05:05.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.496+0000 7f8650c00640 1 -- 172.21.15.42:0/3531948477 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86540c5600 con 0x564fab05fb20 2024-08-26T00:05:05.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.496+0000 7f8650c00640 1 -- 172.21.15.42:0/3531948477 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86540c0d40 con 0x564fab05fb20 2024-08-26T00:05:05.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.497+0000 7f8665a20740 1 -- 172.21.15.42:0/3531948477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fab05fb20 msgr2=0x564fab05e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:05.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.497+0000 7f8665a20740 1 --2- 172.21.15.42:0/3531948477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fab05fb20 0x564fab05e930 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x564fab052250 tx=0x7f86540bc5e0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.497+0000 7f8665a20740 1 -- 172.21.15.42:0/3531948477 shutdown_connections 2024-08-26T00:05:05.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.497+0000 7f8665a20740 1 --2- 172.21.15.42:0/3531948477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fab05fb20 0x564fab05e930 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.497+0000 7f8665a20740 1 --2- 172.21.15.42:0/3531948477 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab055260 0x564fab071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.497+0000 7f8665a20740 1 --2- 172.21.15.42:0/3531948477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab054940 0x564fab0573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.497+0000 7f8665a20740 1 -- 172.21.15.42:0/3531948477 >> 172.21.15.42:0/3531948477 conn(0x564fab050ed0 msgr2=0x564fab05e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:05.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.497+0000 7f8665a20740 1 -- 172.21.15.42:0/3531948477 shutdown_connections 2024-08-26T00:05:05.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.498+0000 7f8665a20740 1 -- 172.21.15.42:0/3531948477 wait complete. 2024-08-26T00:05:05.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.498+0000 7f8665a20740 1 -- start start 2024-08-26T00:05:05.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.498+0000 7f8665a20740 1 Processor -- start 2024-08-26T00:05:05.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.499+0000 7f8665a20740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab054940 0x564fab067f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:05.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.500+0000 7f8665a20740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fab055260 0x564fab068460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:05.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.500+0000 7f8665a20740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab05fb20 0x564fab063480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:05.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.500+0000 7f8665a20740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f863c00cb80 con 0x564fab054940 2024-08-26T00:05:05.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.500+0000 7f8665a20740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f863c00dff0 con 0x564fab055260 2024-08-26T00:05:05.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.500+0000 7f8665a20740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f863c00d250 con 0x564fab05fb20 2024-08-26T00:05:05.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.500+0000 7f8665a20740 10 client.0 _ll_register_callbacks cb 0x7f864c014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:05:05.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.500+0000 7f8661000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab05fb20 0x564fab063480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:05.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.500+0000 7f865be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab054940 0x564fab067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:05.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.500+0000 7f865b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fab055260 0x564fab068460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:05.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.500+0000 7f865b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fab055260 0x564fab068460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:33210/0 (socket says 172.21.15.42:33210) 2024-08-26T00:05:05.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.500+0000 7f865b400640 1 -- 172.21.15.42:0/2523522620 learned_addr learned my addr 172.21.15.42:0/2523522620 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:05.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.500+0000 7f8661000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab05fb20 0x564fab063480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:35534/0 (socket says 172.21.15.42:35534) 2024-08-26T00:05:05.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.502+0000 7f865be00640 1 -- 172.21.15.42:0/2523522620 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab05fb20 msgr2=0x564fab063480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:05.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.502+0000 7f865be00640 1 --2- 172.21.15.42:0/2523522620 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab05fb20 0x564fab063480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.502+0000 7f865be00640 1 -- 172.21.15.42:0/2523522620 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fab055260 msgr2=0x564fab068460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:05.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.502+0000 7f865be00640 1 --2- 172.21.15.42:0/2523522620 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fab055260 0x564fab068460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.502+0000 7f865be00640 1 -- 172.21.15.42:0/2523522620 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fab063cb0 con 0x564fab054940 2024-08-26T00:05:05.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.502+0000 7f8661000640 1 --2- 172.21.15.42:0/2523522620 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab05fb20 0x564fab063480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:05:05.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.502+0000 7f865b400640 1 --2- 172.21.15.42:0/2523522620 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fab055260 0x564fab068460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:05:05.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.502+0000 7f865be00640 1 --2- 172.21.15.42:0/2523522620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab054940 0x564fab067f20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f864800a8e0 tx=0x7f864800a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99edf1b8c17bf3ea server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:05.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.502+0000 7f8646000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:05:05.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.503+0000 7f8646000640 1 -- 172.21.15.42:0/2523522620 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864802e060 con 0x564fab054940 2024-08-26T00:05:05.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.503+0000 7f8646000640 1 -- 172.21.15.42:0/2523522620 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f8648004040 con 0x564fab054940 2024-08-26T00:05:05.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.503+0000 7f8665a20740 1 -- 172.21.15.42:0/2523522620 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86540c5600 con 0x564fab054940 2024-08-26T00:05:05.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.504+0000 7f8646000640 1 -- 172.21.15.42:0/2523522620 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8648015040 con 0x564fab054940 2024-08-26T00:05:05.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.504+0000 7f8665a20740 10 client.15420 fetch_fsmap learned FSMap version 27 2024-08-26T00:05:05.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.504+0000 7f8665a20740 1 -- 172.21.15.42:0/2523522620 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564fab0da2e0 con 0x564fab054940 2024-08-26T00:05:05.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.505+0000 7f8646000640 1 -- 172.21.15.42:0/2523522620 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86540c5600 con 0x564fab054940 2024-08-26T00:05:05.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.505+0000 7f8646000640 1 -- 172.21.15.42:0/2523522620 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f8648033070 con 0x564fab054940 2024-08-26T00:05:05.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.505+0000 7f8665a20740 10 client.15420 fetch_fsmap finished waiting for FSMap version 27 2024-08-26T00:05:05.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.505+0000 7f8665a20740 10 client.15420 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:05:05.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.505+0000 7f8665a20740 20 client.15420 populate_metadata read hostname 'smithi042' 2024-08-26T00:05:05.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.505+0000 7f8665a20740 1 --2- 172.21.15.42:0/2523522620 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x564fab0da6f0 0x564fab0dcb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:05.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.505+0000 7f8665a20740 4 client.15420 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-26T00:05:05.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.505+0000 7f8665a20740 1 -- 172.21.15.42:0/2523522620 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564faafc2a40 con 0x564fab0da6f0 2024-08-26T00:05:05.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.505+0000 7f865b400640 1 --2- 172.21.15.42:0/2523522620 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x564fab0da6f0 0x564fab0dcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:05.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.506+0000 7f865b400640 1 --2- 172.21.15.42:0/2523522620 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x564fab0da6f0 0x564fab0dcb10 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4649cbb41494536 server_cookie=6497416e7a3624de in_seq=0 out_seq=0 2024-08-26T00:05:05.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.506+0000 7f8646000640 10 client.15420 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:05:05.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.507+0000 7f8646000640 1 -- 172.21.15.42:0/2523522620 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564faafc2a40 con 0x564fab0da6f0 2024-08-26T00:05:05.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.507+0000 7f8646000640 10 client.15420 handle_command_reply: tid=0 2024-08-26T00:05:05.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.507+0000 7f8665a20740 1 client.15420 shutdown 2024-08-26T00:05:05.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.507+0000 7f8665a20740 1 -- 172.21.15.42:0/2523522620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab054940 msgr2=0x564fab067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:05.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.507+0000 7f8665a20740 1 --2- 172.21.15.42:0/2523522620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab054940 0x564fab067f20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f864800a8e0 tx=0x7f864800a610 comp rx=0 tx=0).stop 2024-08-26T00:05:05.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.507+0000 7f8665a20740 1 -- 172.21.15.42:0/2523522620 shutdown_connections 2024-08-26T00:05:05.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.507+0000 7f8665a20740 1 --2- 172.21.15.42:0/2523522620 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fab05fb20 0x564fab063480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.507+0000 7f8665a20740 1 --2- 172.21.15.42:0/2523522620 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fab055260 0x564fab068460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.507+0000 7f8665a20740 1 --2- 172.21.15.42:0/2523522620 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x564fab0da6f0 0x564fab0dcb10 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.508+0000 7f8665a20740 1 --2- 172.21.15.42:0/2523522620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fab054940 0x564fab067f20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.508+0000 7f8646000640 0 client.15420 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:05:05.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.508+0000 7f8665a20740 1 -- 172.21.15.42:0/2523522620 >> 172.21.15.42:0/2523522620 conn(0x564fab050ed0 msgr2=0x564fab05ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:05.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.508+0000 7f8665a20740 1 -- 172.21.15.42:0/2523522620 shutdown_connections 2024-08-26T00:05:05.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.508+0000 7f8665a20740 1 -- 172.21.15.42:0/2523522620 wait complete. 2024-08-26T00:05:05.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.508+0000 7f8665a20740 20 client.15420 trim_cache size 0 max 16384 2024-08-26T00:05:05.511 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:05:05.511 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-08-26T00:05:05.511 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {} 2024-08-26T00:05:05.511 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:05:05.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.509+0000 7f8663000640 1 -- 172.21.15.42:0/2072272717 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f86400a2cd0 msgr2=0x7f86400a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:05.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.509+0000 7f8663000640 1 --2- 172.21.15.42:0/2072272717 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f86400a2cd0 0x7f86400a5190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f865c10c390 tx=0x7f864c00a5c0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.509+0000 7f8663000640 1 -- 172.21.15.42:0/2072272717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f865c114850 msgr2=0x7f865c10abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:05.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.509+0000 7f8663000640 1 --2- 172.21.15.42:0/2072272717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f865c114850 0x7f865c10abf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f865402ae90 tx=0x7f86540308a0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.509+0000 7f8663000640 1 -- 172.21.15.42:0/2072272717 shutdown_connections 2024-08-26T00:05:05.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.509+0000 7f8663000640 1 --2- 172.21.15.42:0/2072272717 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f86400a2cd0 0x7f86400a5190 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.509+0000 7f8663000640 1 --2- 172.21.15.42:0/2072272717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f865c114850 0x7f865c10abf0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.509+0000 7f8663000640 1 --2- 172.21.15.42:0/2072272717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f865c1098b0 0x7f865c114150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.509+0000 7f8663000640 1 --2- 172.21.15.42:0/2072272717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f865c108f90 0x7f865c113c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:05.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.509+0000 7f8663000640 1 -- 172.21.15.42:0/2072272717 >> 172.21.15.42:0/2072272717 conn(0x7f865c06dee0 msgr2=0x7f865c0718f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:05.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.510+0000 7f8663000640 1 -- 172.21.15.42:0/2072272717 shutdown_connections 2024-08-26T00:05:05.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:05.510+0000 7f8663000640 1 -- 172.21.15.42:0/2072272717 wait complete. 2024-08-26T00:05:05.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:05 smithi042 ceph-mon[17225]: pgmap v416: 97 pgs: 97 active+clean; 222 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 239 op/s 2024-08-26T00:05:06.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:05 smithi043 ceph-mon[22091]: pgmap v416: 97 pgs: 97 active+clean; 222 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 239 op/s 2024-08-26T00:05:06.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:05 smithi181 ceph-mon[22102]: pgmap v416: 97 pgs: 97 active+clean; 222 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 239 op/s 2024-08-26T00:05:07.783 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-26T00:05:07.783 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:05:08.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:07 smithi043 ceph-mon[22091]: pgmap v417: 97 pgs: 97 active+clean; 227 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 266 op/s 2024-08-26T00:05:08.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:07 smithi181 ceph-mon[22102]: pgmap v417: 97 pgs: 97 active+clean; 227 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 266 op/s 2024-08-26T00:05:08.052 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:07 smithi042 ceph-mon[17225]: pgmap v417: 97 pgs: 97 active+clean; 227 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 266 op/s 2024-08-26T00:05:09.692 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:09 smithi042 ceph-mon[17225]: pgmap v418: 97 pgs: 97 active+clean; 230 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.1 MiB/s wr, 326 op/s 2024-08-26T00:05:10.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:09 smithi043 ceph-mon[22091]: pgmap v418: 97 pgs: 97 active+clean; 230 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.1 MiB/s wr, 326 op/s 2024-08-26T00:05:10.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:09 smithi181 ceph-mon[22102]: pgmap v418: 97 pgs: 97 active+clean; 230 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.1 MiB/s wr, 326 op/s 2024-08-26T00:05:11.641 INFO:tasks.workunit.client.0.smithi042.stdout: 92 632281 1154 396499 937 227041 1862 2024-08-26T00:05:12.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:11 smithi043 ceph-mon[22091]: pgmap v419: 97 pgs: 97 active+clean; 232 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.0 MiB/s wr, 297 op/s 2024-08-26T00:05:12.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:11 smithi042 ceph-mon[17225]: pgmap v419: 97 pgs: 97 active+clean; 232 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.0 MiB/s wr, 297 op/s 2024-08-26T00:05:12.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:11 smithi181 ceph-mon[22102]: pgmap v419: 97 pgs: 97 active+clean; 232 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.0 MiB/s wr, 297 op/s 2024-08-26T00:05:13.027 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:05:13.891 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:13 smithi042 ceph-mon[17225]: pgmap v420: 97 pgs: 97 active+clean; 239 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.7 MiB/s wr, 354 op/s 2024-08-26T00:05:14.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:13 smithi043 ceph-mon[22091]: pgmap v420: 97 pgs: 97 active+clean; 239 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.7 MiB/s wr, 354 op/s 2024-08-26T00:05:14.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:13 smithi181 ceph-mon[22102]: pgmap v420: 97 pgs: 97 active+clean; 239 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.7 MiB/s wr, 354 op/s 2024-08-26T00:05:14.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.729+0000 7efe21600640 1 -- 172.21.15.42:0/1005219671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c06e7d0 msgr2=0x7efe1c06ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:14.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.730+0000 7efe21600640 1 --2- 172.21.15.42:0/1005219671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c06e7d0 0x7efe1c06ec10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efe08009860 tx=0x7efe0802a340 comp rx=0 tx=0).stop 2024-08-26T00:05:14.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.730+0000 7efe21600640 1 -- 172.21.15.42:0/1005219671 shutdown_connections 2024-08-26T00:05:14.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.731+0000 7efe21600640 1 --2- 172.21.15.42:0/1005219671 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe1c11aee0 0x7efe1c11d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:14.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.731+0000 7efe21600640 1 --2- 172.21.15.42:0/1005219671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c06e7d0 0x7efe1c06ec10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:14.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.731+0000 7efe21600640 1 --2- 172.21.15.42:0/1005219671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe1c10ff30 0x7efe1c06e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:14.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.731+0000 7efe21600640 1 -- 172.21.15.42:0/1005219671 >> 172.21.15.42:0/1005219671 conn(0x7efe1c072f20 msgr2=0x7efe1c073330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:14.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.731+0000 7efe21600640 1 -- 172.21.15.42:0/1005219671 shutdown_connections 2024-08-26T00:05:14.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.731+0000 7efe21600640 1 -- 172.21.15.42:0/1005219671 wait complete. 2024-08-26T00:05:14.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.734+0000 7efe21600640 1 Processor -- start 2024-08-26T00:05:14.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.735+0000 7efe21600640 1 -- start start 2024-08-26T00:05:14.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.737+0000 7efe21600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe1c06e7d0 0x7efe1c1a6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:14.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.737+0000 7efe21600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c10ff30 0x7efe1c1a73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:14.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.737+0000 7efe21600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe1c11aee0 0x7efe1c1ab760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:14.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.737+0000 7efe21600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c120910 con 0x7efe1c10ff30 2024-08-26T00:05:14.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.737+0000 7efe21600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c120790 con 0x7efe1c11aee0 2024-08-26T00:05:14.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.737+0000 7efe21600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c120a90 con 0x7efe1c06e7d0 2024-08-26T00:05:14.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.738+0000 7efe1be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe1c06e7d0 0x7efe1c1a6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:14.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.739+0000 7efe1b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c10ff30 0x7efe1c1a73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:14.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.739+0000 7efe20c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe1c11aee0 0x7efe1c1ab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:14.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.739+0000 7efe20c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe1c11aee0 0x7efe1c1ab760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:33234/0 (socket says 172.21.15.42:33234) 2024-08-26T00:05:14.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.739+0000 7efe20c00640 1 -- 172.21.15.42:0/3874631277 learned_addr learned my addr 172.21.15.42:0/3874631277 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:14.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.739+0000 7efe20c00640 1 -- 172.21.15.42:0/3874631277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe1c06e7d0 msgr2=0x7efe1c1a6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:14.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.739+0000 7efe20c00640 1 --2- 172.21.15.42:0/3874631277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe1c06e7d0 0x7efe1c1a6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:14.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.739+0000 7efe20c00640 1 -- 172.21.15.42:0/3874631277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c10ff30 msgr2=0x7efe1c1a73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:14.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.740+0000 7efe20c00640 1 --2- 172.21.15.42:0/3874631277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c10ff30 0x7efe1c1a73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:14.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.740+0000 7efe20c00640 1 -- 172.21.15.42:0/3874631277 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1c1abe40 con 0x7efe1c11aee0 2024-08-26T00:05:14.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.740+0000 7efe1b400640 1 --2- 172.21.15.42:0/3874631277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c10ff30 0x7efe1c1a73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:05:14.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.742+0000 7efe20c00640 1 --2- 172.21.15.42:0/3874631277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe1c11aee0 0x7efe1c1ab760 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efe1400eab0 tx=0x7efe14009f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:14.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.743+0000 7efe18c00640 1 -- 172.21.15.42:0/3874631277 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1400ce40 con 0x7efe1c11aee0 2024-08-26T00:05:14.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.743+0000 7efe18c00640 1 -- 172.21.15.42:0/3874631277 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe14005020 con 0x7efe1c11aee0 2024-08-26T00:05:14.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.743+0000 7efe18c00640 1 -- 172.21.15.42:0/3874631277 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe14010760 con 0x7efe1c11aee0 2024-08-26T00:05:14.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.743+0000 7efe21600640 1 -- 172.21.15.42:0/3874631277 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe1c1ac130 con 0x7efe1c11aee0 2024-08-26T00:05:14.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.743+0000 7efe21600640 1 -- 172.21.15.42:0/3874631277 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe1c1b3a10 con 0x7efe1c11aee0 2024-08-26T00:05:14.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.745+0000 7efe21600640 1 -- 172.21.15.42:0/3874631277 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe1c109490 con 0x7efe1c11aee0 2024-08-26T00:05:14.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.748+0000 7efe18c00640 1 -- 172.21.15.42:0/3874631277 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7efe14004a40 con 0x7efe1c11aee0 2024-08-26T00:05:14.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.755+0000 7efe18c00640 1 --2- 172.21.15.42:0/3874631277 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7efe000a2c00 0x7efe000a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:14.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.755+0000 7efe18c00640 1 -- 172.21.15.42:0/3874631277 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7efe140cf780 con 0x7efe1c11aee0 2024-08-26T00:05:14.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.756+0000 7efe1be00640 1 --2- 172.21.15.42:0/3874631277 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7efe000a2c00 0x7efe000a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:14.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.758+0000 7efe1be00640 1 --2- 172.21.15.42:0/3874631277 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7efe000a2c00 0x7efe000a50c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efe0c005fd0 tx=0x7efe0c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:14.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:14.763+0000 7efe18c00640 1 -- 172.21.15.42:0/3874631277 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7efe1409c6e0 con 0x7efe1c11aee0 2024-08-26T00:05:15.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:15.287+0000 7efe21600640 1 -- 172.21.15.42:0/3874631277 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe1c06ec10 con 0x7efe1c11aee0 2024-08-26T00:05:15.303 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:05:15.303 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":27,"btime":"2024-08-26T00:04:33:339600+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3168581452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3168581452},{"type":"v1","addr":"172.21.15.42:6839","nonce":3168581452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/3533492491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":3533492491},{"type":"v1","addr":"172.21.15.42:6841","nonce":3533492491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-26T00:00:30.169633+0000","modified":"2024-08-26T00:04:33.092957+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24532,"mds_1":24527,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6839/2653014277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2653014277},{"type":"v1","addr":"172.21.15.43:6839","nonce":2653014277}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24532,"qdb_cluster":[24514,24527,24532]},"id":1}]} 2024-08-26T00:05:15.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:15.291+0000 7efe18c00640 1 -- 172.21.15.42:0/3874631277 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11915 (secure 0 0 0) 0x7efe1c06ec10 con 0x7efe1c11aee0 2024-08-26T00:05:15.303 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 27 2024-08-26T00:05:15.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:15.296+0000 7efe21600640 1 -- 172.21.15.42:0/3874631277 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7efe000a2c00 msgr2=0x7efe000a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:15.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:15.296+0000 7efe21600640 1 --2- 172.21.15.42:0/3874631277 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7efe000a2c00 0x7efe000a50c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efe0c005fd0 tx=0x7efe0c009260 comp rx=0 tx=0).stop 2024-08-26T00:05:15.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:15.296+0000 7efe21600640 1 -- 172.21.15.42:0/3874631277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe1c11aee0 msgr2=0x7efe1c1ab760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:15.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:15.296+0000 7efe21600640 1 --2- 172.21.15.42:0/3874631277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe1c11aee0 0x7efe1c1ab760 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efe1400eab0 tx=0x7efe14009f80 comp rx=0 tx=0).stop 2024-08-26T00:05:15.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:15.296+0000 7efe21600640 1 -- 172.21.15.42:0/3874631277 shutdown_connections 2024-08-26T00:05:15.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:15.296+0000 7efe21600640 1 --2- 172.21.15.42:0/3874631277 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7efe000a2c00 0x7efe000a50c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:15.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:15.296+0000 7efe21600640 1 --2- 172.21.15.42:0/3874631277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe1c11aee0 0x7efe1c1ab760 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:15.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:15.296+0000 7efe21600640 1 --2- 172.21.15.42:0/3874631277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c10ff30 0x7efe1c1a73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:15.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:15.296+0000 7efe21600640 1 --2- 172.21.15.42:0/3874631277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe1c06e7d0 0x7efe1c1a6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:15.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:15.296+0000 7efe21600640 1 -- 172.21.15.42:0/3874631277 >> 172.21.15.42:0/3874631277 conn(0x7efe1c072f20 msgr2=0x7efe1c119110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:15.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:15.297+0000 7efe21600640 1 -- 172.21.15.42:0/3874631277 shutdown_connections 2024-08-26T00:05:15.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:15.297+0000 7efe21600640 1 -- 172.21.15.42:0/3874631277 wait complete. 2024-08-26T00:05:15.711 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:15 smithi042 ceph-mon[17225]: pgmap v421: 97 pgs: 97 active+clean; 239 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 2.0 MiB/s wr, 291 op/s 2024-08-26T00:05:15.712 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:15 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/3874631277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:05:16.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:15 smithi043 ceph-mon[22091]: pgmap v421: 97 pgs: 97 active+clean; 239 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 2.0 MiB/s wr, 291 op/s 2024-08-26T00:05:16.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:15 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/3874631277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:05:16.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:15 smithi181 ceph-mon[22102]: pgmap v421: 97 pgs: 97 active+clean; 239 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 2.0 MiB/s wr, 291 op/s 2024-08-26T00:05:16.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:15 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/3874631277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:05:16.809 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-26T00:05:18.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:17 smithi043 ceph-mon[22091]: pgmap v422: 97 pgs: 97 active+clean; 246 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.7 MiB/s wr, 319 op/s 2024-08-26T00:05:18.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:17 smithi181 ceph-mon[22102]: pgmap v422: 97 pgs: 97 active+clean; 246 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.7 MiB/s wr, 319 op/s 2024-08-26T00:05:18.048 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:17 smithi042 ceph-mon[17225]: pgmap v422: 97 pgs: 97 active+clean; 246 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.7 MiB/s wr, 319 op/s 2024-08-26T00:05:19.618 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:05:20.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:19 smithi043 ceph-mon[22091]: pgmap v423: 97 pgs: 97 active+clean; 265 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.8 MiB/s wr, 355 op/s 2024-08-26T00:05:20.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:19 smithi181 ceph-mon[22102]: pgmap v423: 97 pgs: 97 active+clean; 265 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.8 MiB/s wr, 355 op/s 2024-08-26T00:05:20.038 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:19 smithi042 ceph-mon[17225]: pgmap v423: 97 pgs: 97 active+clean; 265 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.8 MiB/s wr, 355 op/s 2024-08-26T00:05:21.655 INFO:tasks.workunit.client.0.smithi042.stdout: 104 603432 569 385445 675 228825 1220 2024-08-26T00:05:21.774 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:21 smithi042 ceph-mon[17225]: pgmap v424: 97 pgs: 97 active+clean; 270 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 300 op/s 2024-08-26T00:05:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.930+0000 7fb5dec00640 1 -- 172.21.15.42:0/3717235508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5d8101780 msgr2=0x7fb5d8101be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.930+0000 7fb5dec00640 1 --2- 172.21.15.42:0/3717235508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5d8101780 0x7fb5d8101be0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc009890 tx=0x7fb5cc02a360 comp rx=0 tx=0).stop 2024-08-26T00:05:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.930+0000 7fb5dec00640 1 -- 172.21.15.42:0/3717235508 shutdown_connections 2024-08-26T00:05:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.930+0000 7fb5dec00640 1 --2- 172.21.15.42:0/3717235508 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5d8102120 0x7fb5d810e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.930+0000 7fb5dec00640 1 --2- 172.21.15.42:0/3717235508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5d8101780 0x7fb5d8101be0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.930+0000 7fb5dec00640 1 --2- 172.21.15.42:0/3717235508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5d8107890 0x7fb5d8107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.930+0000 7fb5dec00640 1 -- 172.21.15.42:0/3717235508 >> 172.21.15.42:0/3717235508 conn(0x7fb5d80fd4a0 msgr2=0x7fb5d80ff8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.930+0000 7fb5dec00640 1 -- 172.21.15.42:0/3717235508 shutdown_connections 2024-08-26T00:05:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.930+0000 7fb5dec00640 1 -- 172.21.15.42:0/3717235508 wait complete. 2024-08-26T00:05:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.930+0000 7fb5dec00640 1 Processor -- start 2024-08-26T00:05:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.930+0000 7fb5dec00640 1 -- start start 2024-08-26T00:05:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.930+0000 7fb5dec00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5d8102120 0x7fb5d8073ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.930+0000 7fb5dec00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5d8107890 0x7fb5d806ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.930+0000 7fb5dec00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5d806bfc0 0x7fb5d806c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.930+0000 7fb5dd800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5d8102120 0x7fb5d8073ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.930+0000 7fb5dd800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5d8102120 0x7fb5d8073ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:43676/0 (socket says 172.21.15.42:43676) 2024-08-26T00:05:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.930+0000 7fb5dce00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5d8107890 0x7fb5d806ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.930+0000 7fb5dce00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5d8107890 0x7fb5d806ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:34660/0 (socket says 172.21.15.42:34660) 2024-08-26T00:05:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.930+0000 7fb5dd800640 1 -- 172.21.15.42:0/924152518 learned_addr learned my addr 172.21.15.42:0/924152518 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.930+0000 7fb5dec00640 1 -- 172.21.15.42:0/924152518 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d8111ce0 con 0x7fb5d806bfc0 2024-08-26T00:05:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.930+0000 7fb5dec00640 1 -- 172.21.15.42:0/924152518 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d8111b60 con 0x7fb5d8102120 2024-08-26T00:05:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.930+0000 7fb5dec00640 1 -- 172.21.15.42:0/924152518 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d8111e60 con 0x7fb5d8107890 2024-08-26T00:05:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.935+0000 7fb5de200640 1 --2- 172.21.15.42:0/924152518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5d806bfc0 0x7fb5d806c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.935+0000 7fb5de200640 1 -- 172.21.15.42:0/924152518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5d8107890 msgr2=0x7fb5d806ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.935+0000 7fb5de200640 1 --2- 172.21.15.42:0/924152518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5d8107890 0x7fb5d806ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.935+0000 7fb5de200640 1 -- 172.21.15.42:0/924152518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5d8102120 msgr2=0x7fb5d8073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.935+0000 7fb5de200640 1 --2- 172.21.15.42:0/924152518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5d8102120 0x7fb5d8073ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.935+0000 7fb5de200640 1 -- 172.21.15.42:0/924152518 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d81ace20 con 0x7fb5d806bfc0 2024-08-26T00:05:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.935+0000 7fb5de200640 1 --2- 172.21.15.42:0/924152518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5d806bfc0 0x7fb5d806c470 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb5d000da10 tx=0x7fb5d000ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.935+0000 7fb5d6000640 1 -- 172.21.15.42:0/924152518 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d000bd70 con 0x7fb5d806bfc0 2024-08-26T00:05:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.935+0000 7fb5dec00640 1 -- 172.21.15.42:0/924152518 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5d8074200 con 0x7fb5d806bfc0 2024-08-26T00:05:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.935+0000 7fb5dec00640 1 -- 172.21.15.42:0/924152518 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5d8074740 con 0x7fb5d806bfc0 2024-08-26T00:05:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.935+0000 7fb5d6000640 1 -- 172.21.15.42:0/924152518 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5d0003e50 con 0x7fb5d806bfc0 2024-08-26T00:05:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.935+0000 7fb5d6000640 1 -- 172.21.15.42:0/924152518 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d000bd70 con 0x7fb5d806bfc0 2024-08-26T00:05:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.945+0000 7fb5e2ddc740 1 Processor -- start 2024-08-26T00:05:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.946+0000 7fb5e2ddc740 1 -- start start 2024-08-26T00:05:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.946+0000 7fb5d6000640 1 -- 172.21.15.42:0/924152518 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb5d0004000 con 0x7fb5d806bfc0 2024-08-26T00:05:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.952+0000 7fb5e2ddc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e81300ba30 0x55e81300be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.952+0000 7fb5e2ddc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e81300c350 0x55e8130166d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.952+0000 7fb5e2ddc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813016c10 0x55e813019000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.952+0000 7fb5e2ddc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e812f71f30 con 0x55e813016c10 2024-08-26T00:05:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.952+0000 7fb5e2ddc740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e812f095a0 con 0x55e81300ba30 2024-08-26T00:05:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.952+0000 7fb5e2ddc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55e812f6def0 con 0x55e81300c350 2024-08-26T00:05:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.952+0000 7fb5dce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e81300ba30 0x55e81300be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.952+0000 7fb5dce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e81300ba30 0x55e81300be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:43680/0 (socket says 172.21.15.42:43680) 2024-08-26T00:05:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.952+0000 7fb5dce00640 1 -- 172.21.15.42:0/334630498 learned_addr learned my addr 172.21.15.42:0/334630498 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.952+0000 7fb5dce00640 1 --2- 172.21.15.42:0/334630498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813016c10 0x55e813019000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:21.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.952+0000 7fb5dce00640 1 -- 172.21.15.42:0/334630498 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e81300c350 msgr2=0x55e8130166d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:05:21.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.952+0000 7fb5dce00640 1 --2- 172.21.15.42:0/334630498 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e81300c350 0x55e8130166d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:21.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.952+0000 7fb5dce00640 1 -- 172.21.15.42:0/334630498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813016c10 msgr2=0x55e813019000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:21.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.952+0000 7fb5dce00640 1 --2- 172.21.15.42:0/334630498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813016c10 0x55e813019000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:21.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.952+0000 7fb5dce00640 1 -- 172.21.15.42:0/334630498 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e812ce33c0 con 0x55e81300ba30 2024-08-26T00:05:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.952+0000 7fb5d6000640 1 --2- 172.21.15.42:0/924152518 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb5c00a3050 0x7fb5c00a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.952+0000 7fb5d6000640 1 -- 172.21.15.42:0/924152518 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb5d000bb70 con 0x7fb5d806bfc0 2024-08-26T00:05:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.957+0000 7fb5dce00640 1 --2- 172.21.15.42:0/334630498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e81300ba30 0x55e81300be10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc030af0 tx=0x7fb5cc0092a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27e16624de6ce041 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.957+0000 7fb5dd800640 1 --2- 172.21.15.42:0/924152518 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb5c00a3050 0x7fb5c00a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.959+0000 7fb5caa00640 1 -- 172.21.15.42:0/334630498 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc030da0 con 0x55e81300ba30 2024-08-26T00:05:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.959+0000 7fb5caa00640 1 -- 172.21.15.42:0/334630498 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5cc004040 con 0x55e81300ba30 2024-08-26T00:05:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.959+0000 7fb5caa00640 1 -- 172.21.15.42:0/334630498 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc0038e0 con 0x55e81300ba30 2024-08-26T00:05:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.959+0000 7fb5dd800640 1 --2- 172.21.15.42:0/924152518 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb5c00a3050 0x7fb5c00a5510 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55e813008e20 tx=0x7fb5c4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.961+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/334630498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e81300ba30 msgr2=0x55e81300be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.962+0000 7fb5e2ddc740 1 --2- 172.21.15.42:0/334630498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e81300ba30 0x55e81300be10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc030af0 tx=0x7fb5cc0092a0 comp rx=0 tx=0).stop 2024-08-26T00:05:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.962+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/334630498 shutdown_connections 2024-08-26T00:05:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.962+0000 7fb5e2ddc740 1 --2- 172.21.15.42:0/334630498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813016c10 0x55e813019000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.963+0000 7fb5e2ddc740 1 --2- 172.21.15.42:0/334630498 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e81300c350 0x55e8130166d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.963+0000 7fb5e2ddc740 1 --2- 172.21.15.42:0/334630498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e81300ba30 0x55e81300be10 secure :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc030af0 tx=0x7fb5cc0092a0 comp rx=0 tx=0).stop 2024-08-26T00:05:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.963+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/334630498 >> 172.21.15.42:0/334630498 conn(0x55e813007fc0 msgr2=0x55e8130083a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:21.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.969+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/334630498 shutdown_connections 2024-08-26T00:05:21.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.969+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/334630498 wait complete. 2024-08-26T00:05:21.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.969+0000 7fb5e2ddc740 1 -- start start 2024-08-26T00:05:21.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.969+0000 7fb5e2ddc740 1 Processor -- start 2024-08-26T00:05:21.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.969+0000 7fb5e2ddc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e81300c350 0x55e813013c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:21.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.975+0000 7fb5e2ddc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e813016c10 0x55e8130141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:21.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.975+0000 7fb5e2ddc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813014710 0x55e81302b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:21.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.975+0000 7fb5de200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813014710 0x55e81302b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.975+0000 7fb5de200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813014710 0x55e81302b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44366/0 (socket says 172.21.15.42:44366) 2024-08-26T00:05:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.975+0000 7fb5de200640 1 -- 172.21.15.42:0/2297388036 learned_addr learned my addr 172.21.15.42:0/2297388036 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.975+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/2297388036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e8130197e0 con 0x55e813014710 2024-08-26T00:05:21.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.975+0000 7fb5dd800640 1 --2- 172.21.15.42:0/2297388036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e81300c350 0x55e813013c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.975+0000 7fb5dce00640 1 --2- 172.21.15.42:0/2297388036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e813016c10 0x55e8130141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.975+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/2297388036 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e812f2cde0 con 0x55e813016c10 2024-08-26T00:05:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.975+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/2297388036 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55e813019960 con 0x55e81300c350 2024-08-26T00:05:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.975+0000 7fb5e2ddc740 10 client.0 _ll_register_callbacks cb 0x55e812f1b7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:05:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.975+0000 7fb5de200640 1 -- 172.21.15.42:0/2297388036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e81300c350 msgr2=0x55e813013c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.975+0000 7fb5de200640 1 --2- 172.21.15.42:0/2297388036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e81300c350 0x55e813013c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.975+0000 7fb5de200640 1 -- 172.21.15.42:0/2297388036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e813016c10 msgr2=0x55e8130141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.975+0000 7fb5de200640 1 --2- 172.21.15.42:0/2297388036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e813016c10 0x55e8130141d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.975+0000 7fb5de200640 1 -- 172.21.15.42:0/2297388036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e81302bb00 con 0x55e813014710 2024-08-26T00:05:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.975+0000 7fb5dd800640 1 --2- 172.21.15.42:0/2297388036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e81300c350 0x55e813013c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:05:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.980+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/2297388036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5cc004040 con 0x55e813014710 2024-08-26T00:05:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.980+0000 7fb5dce00640 1 --2- 172.21.15.42:0/2297388036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e813016c10 0x55e8130141d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:05:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.980+0000 7fb5de200640 1 --2- 172.21.15.42:0/2297388036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813014710 0x55e81302b4c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb5d00a2f40 tx=0x7fb5d009b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a625400e168e65a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.980+0000 7fb5bf400640 10 client.15438 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:05:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.982+0000 7fb5bf400640 1 -- 172.21.15.42:0/2297388036 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d00cbaa0 con 0x55e813014710 2024-08-26T00:05:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.982+0000 7fb5bf400640 1 -- 172.21.15.42:0/2297388036 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb5d00a10c0 con 0x55e813014710 2024-08-26T00:05:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.983+0000 7fb5bf400640 1 -- 172.21.15.42:0/2297388036 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb5d00cbaa0 con 0x55e813014710 2024-08-26T00:05:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.983+0000 7fb5e2ddc740 10 client.15438 fetch_fsmap learned FSMap version 27 2024-08-26T00:05:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.983+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/2297388036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55e81302e3e0 con 0x55e813014710 2024-08-26T00:05:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.984+0000 7fb5bf400640 1 -- 172.21.15.42:0/2297388036 <== mon.0 v2:172.21.15.42:3300/0 4 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fb5d0096f00 con 0x55e813014710 2024-08-26T00:05:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.984+0000 7fb5e2ddc740 10 client.15438 fetch_fsmap finished waiting for FSMap version 27 2024-08-26T00:05:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.984+0000 7fb5e2ddc740 10 client.15438 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-26T00:05:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.984+0000 7fb5e2ddc740 20 client.15438 populate_metadata read hostname 'smithi042' 2024-08-26T00:05:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.984+0000 7fb5e2ddc740 1 --2- 172.21.15.42:0/2297388036 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55e81302f730 0x55e813031bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.984+0000 7fb5e2ddc740 4 client.15438 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:05:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.984+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/2297388036 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e812f7f4a0 con 0x55e81302f730 2024-08-26T00:05:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.984+0000 7fb5dd800640 1 --2- 172.21.15.42:0/2297388036 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55e81302f730 0x55e813031bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.984+0000 7fb5dd800640 1 --2- 172.21.15.42:0/2297388036 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55e81302f730 0x55e813031bc0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5ad0de4f2224553c server_cookie=c4c3dafb19af17e0 in_seq=0 out_seq=0 2024-08-26T00:05:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.984+0000 7fb5bf400640 10 client.15438 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:05:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.984+0000 7fb5bf400640 1 -- 172.21.15.42:0/2297388036 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e812f7f4a0 con 0x55e81302f730 2024-08-26T00:05:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.984+0000 7fb5bf400640 10 client.15438 handle_command_reply: tid=0 2024-08-26T00:05:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.984+0000 7fb5e2ddc740 1 client.15438 shutdown 2024-08-26T00:05:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.984+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/2297388036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813014710 msgr2=0x55e81302b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.984+0000 7fb5e2ddc740 1 --2- 172.21.15.42:0/2297388036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813014710 0x55e81302b4c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb5d00a2f40 tx=0x7fb5d009b0d0 comp rx=0 tx=0).stop 2024-08-26T00:05:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.989+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/2297388036 shutdown_connections 2024-08-26T00:05:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.989+0000 7fb5e2ddc740 1 --2- 172.21.15.42:0/2297388036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813014710 0x55e81302b4c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.989+0000 7fb5e2ddc740 1 --2- 172.21.15.42:0/2297388036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e813016c10 0x55e8130141d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.989+0000 7fb5e2ddc740 1 --2- 172.21.15.42:0/2297388036 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55e81302f730 0x55e813031bc0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.989+0000 7fb5e2ddc740 1 --2- 172.21.15.42:0/2297388036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e81300c350 0x55e813013c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.989+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/2297388036 >> 172.21.15.42:0/2297388036 conn(0x55e813007fc0 msgr2=0x55e81300dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.989+0000 7fb5bf400640 0 client.15438 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:05:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.989+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/2297388036 shutdown_connections 2024-08-26T00:05:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.989+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/2297388036 wait complete. 2024-08-26T00:05:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:21.989+0000 7fb5e2ddc740 20 client.15438 trim_cache size 0 max 16384 2024-08-26T00:05:22.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:21 smithi043 ceph-mon[22091]: pgmap v424: 97 pgs: 97 active+clean; 270 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 300 op/s 2024-08-26T00:05:22.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.019+0000 7fb5e2ddc740 1 Processor -- start 2024-08-26T00:05:22.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.019+0000 7fb5e2ddc740 1 -- start start 2024-08-26T00:05:22.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.021+0000 7fb5e2ddc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e81300c350 0x55e81302b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:22.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.021+0000 7fb5e2ddc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813014710 0x55e81300e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:22.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.021+0000 7fb5e2ddc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e813016c10 0x55e813037490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:22.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.021+0000 7fb5dd800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e81300c350 0x55e81302b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:22.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.021+0000 7fb5dd800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e81300c350 0x55e81302b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:43694/0 (socket says 172.21.15.42:43694) 2024-08-26T00:05:22.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.021+0000 7fb5dce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813014710 0x55e81300e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:22.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.021+0000 7fb5de200640 1 --2- 172.21.15.42:0/762964025 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e813016c10 0x55e813037490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:22.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.021+0000 7fb5dd800640 1 -- 172.21.15.42:0/762964025 learned_addr learned my addr 172.21.15.42:0/762964025 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:22.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.021+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/762964025 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b8010e50 con 0x55e813014710 2024-08-26T00:05:22.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.021+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/762964025 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b800e6c0 con 0x55e81300c350 2024-08-26T00:05:22.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.021+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/762964025 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b800c4b0 con 0x55e813016c10 2024-08-26T00:05:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.021+0000 7fb5de200640 1 -- 172.21.15.42:0/762964025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e81300c350 msgr2=0x55e81302b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.021+0000 7fb5de200640 1 --2- 172.21.15.42:0/762964025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e81300c350 0x55e81302b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.021+0000 7fb5de200640 1 -- 172.21.15.42:0/762964025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813014710 msgr2=0x55e81300e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.021+0000 7fb5de200640 1 --2- 172.21.15.42:0/762964025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813014710 0x55e81300e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.021+0000 7fb5de200640 1 -- 172.21.15.42:0/762964025 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e813012bf0 con 0x55e813016c10 2024-08-26T00:05:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.021+0000 7fb5de200640 1 --2- 172.21.15.42:0/762964025 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e813016c10 0x55e813037490 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb5d009a480 tx=0x7fb5d009c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2766dc9106c4af0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:22.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.021+0000 7fb5ca000640 1 -- 172.21.15.42:0/762964025 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0096f00 con 0x55e813016c10 2024-08-26T00:05:22.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.021+0000 7fb5ca000640 1 -- 172.21.15.42:0/762964025 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5cc004040 con 0x55e813016c10 2024-08-26T00:05:22.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.021+0000 7fb5ca000640 1 -- 172.21.15.42:0/762964025 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0018b10 con 0x55e813016c10 2024-08-26T00:05:22.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.021+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/762964025 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e813016c10 msgr2=0x55e813037490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:22.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.021+0000 7fb5e2ddc740 1 --2- 172.21.15.42:0/762964025 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e813016c10 0x55e813037490 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb5d009a480 tx=0x7fb5d009c000 comp rx=0 tx=0).stop 2024-08-26T00:05:22.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.026+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/762964025 shutdown_connections 2024-08-26T00:05:22.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.026+0000 7fb5e2ddc740 1 --2- 172.21.15.42:0/762964025 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e813016c10 0x55e813037490 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:22.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.026+0000 7fb5e2ddc740 1 --2- 172.21.15.42:0/762964025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813014710 0x55e81300e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:22.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.026+0000 7fb5e2ddc740 1 --2- 172.21.15.42:0/762964025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e81300c350 0x55e81302b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:22.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.026+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/762964025 >> 172.21.15.42:0/762964025 conn(0x55e813007fc0 msgr2=0x55e81300efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:22.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.026+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/762964025 shutdown_connections 2024-08-26T00:05:22.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.026+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/762964025 wait complete. 2024-08-26T00:05:22.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.026+0000 7fb5e2ddc740 1 -- start start 2024-08-26T00:05:22.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.026+0000 7fb5e2ddc740 1 Processor -- start 2024-08-26T00:05:22.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.026+0000 7fb5e2ddc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e81300c350 0x55e813010d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:22.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:21 smithi181 ceph-mon[22102]: pgmap v424: 97 pgs: 97 active+clean; 270 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 300 op/s 2024-08-26T00:05:22.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.026+0000 7fb5e2ddc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813014710 0x55e813011270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:22.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.026+0000 7fb5e2ddc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e813016c10 0x55e8130117b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:22.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.026+0000 7fb5e2ddc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b800cb80 con 0x55e813014710 2024-08-26T00:05:22.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.026+0000 7fb5e2ddc740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b800dff0 con 0x55e813016c10 2024-08-26T00:05:22.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.026+0000 7fb5e2ddc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b800d250 con 0x55e81300c350 2024-08-26T00:05:22.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.026+0000 7fb5e2ddc740 10 client.0 _ll_register_callbacks cb 0x7fb5d0096bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:05:22.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.026+0000 7fb5dce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813014710 0x55e813011270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:22.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.031+0000 7fb5dce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813014710 0x55e813011270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44372/0 (socket says 172.21.15.42:44372) 2024-08-26T00:05:22.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.031+0000 7fb5dce00640 1 -- 172.21.15.42:0/2224611295 learned_addr learned my addr 172.21.15.42:0/2224611295 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:22.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.031+0000 7fb5dce00640 1 -- 172.21.15.42:0/2224611295 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e81300c350 msgr2=0x55e813010d30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-26T00:05:22.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.031+0000 7fb5dce00640 1 --2- 172.21.15.42:0/2224611295 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e81300c350 0x55e813010d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:22.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.031+0000 7fb5dce00640 1 -- 172.21.15.42:0/2224611295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e813016c10 msgr2=0x55e8130117b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-26T00:05:22.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.031+0000 7fb5dce00640 1 --2- 172.21.15.42:0/2224611295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e813016c10 0x55e8130117b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:22.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.031+0000 7fb5dce00640 1 -- 172.21.15.42:0/2224611295 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8130994e0 con 0x55e813014710 2024-08-26T00:05:22.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.033+0000 7fb5bf400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:05:22.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.033+0000 7fb5dce00640 1 --2- 172.21.15.42:0/2224611295 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813014710 0x55e813011270 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc030af0 tx=0x7fb5cc009450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f3da67d544df2 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:22.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.033+0000 7fb5bf400640 1 -- 172.21.15.42:0/2224611295 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc04e060 con 0x55e813014710 2024-08-26T00:05:22.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.033+0000 7fb5bf400640 1 -- 172.21.15.42:0/2224611295 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb5cc030340 con 0x55e813014710 2024-08-26T00:05:22.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.033+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/2224611295 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5cc004040 con 0x55e813014710 2024-08-26T00:05:22.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.033+0000 7fb5bf400640 1 -- 172.21.15.42:0/2224611295 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb5cc037040 con 0x55e813014710 2024-08-26T00:05:22.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.033+0000 7fb5e2ddc740 10 client.15444 fetch_fsmap learned FSMap version 27 2024-08-26T00:05:22.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.033+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/2224611295 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e81309a7f0 con 0x55e813014710 2024-08-26T00:05:22.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.033+0000 7fb5bf400640 1 -- 172.21.15.42:0/2224611295 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5cc004040 con 0x55e813014710 2024-08-26T00:05:22.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.033+0000 7fb5bf400640 1 -- 172.21.15.42:0/2224611295 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fb5cc032440 con 0x55e813014710 2024-08-26T00:05:22.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.033+0000 7fb5e2ddc740 10 client.15444 fetch_fsmap finished waiting for FSMap version 27 2024-08-26T00:05:22.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.033+0000 7fb5e2ddc740 10 client.15444 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-26T00:05:22.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.033+0000 7fb5e2ddc740 20 client.15444 populate_metadata read hostname 'smithi042' 2024-08-26T00:05:22.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.033+0000 7fb5e2ddc740 1 --2- 172.21.15.42:0/2224611295 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55e81309aab0 0x55e81309cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:22.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.033+0000 7fb5e2ddc740 4 client.15444 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:05:22.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.033+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/2224611295 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e812f799b0 con 0x55e81309aab0 2024-08-26T00:05:22.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.033+0000 7fb5dd800640 1 --2- 172.21.15.42:0/2224611295 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55e81309aab0 0x55e81309cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:22.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.033+0000 7fb5bf400640 10 client.15444 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:05:22.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.039+0000 7fb5dd800640 1 --2- 172.21.15.42:0/2224611295 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55e81309aab0 0x55e81309cea0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=444aa44f6fa97a21 server_cookie=2d5e0f8c3f275e4 in_seq=0 out_seq=0 2024-08-26T00:05:22.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.039+0000 7fb5bf400640 1 -- 172.21.15.42:0/2224611295 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e812f799b0 con 0x55e81309aab0 2024-08-26T00:05:22.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.039+0000 7fb5bf400640 10 client.15444 handle_command_reply: tid=0 2024-08-26T00:05:22.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.039+0000 7fb5e2ddc740 1 client.15444 shutdown 2024-08-26T00:05:22.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.039+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/2224611295 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813014710 msgr2=0x55e813011270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:22.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.039+0000 7fb5e2ddc740 1 --2- 172.21.15.42:0/2224611295 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813014710 0x55e813011270 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc030af0 tx=0x7fb5cc009450 comp rx=0 tx=0).stop 2024-08-26T00:05:22.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.044+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/2224611295 shutdown_connections 2024-08-26T00:05:22.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.044+0000 7fb5e2ddc740 1 --2- 172.21.15.42:0/2224611295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e813016c10 0x55e8130117b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:22.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.044+0000 7fb5e2ddc740 1 --2- 172.21.15.42:0/2224611295 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e813014710 0x55e813011270 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:22.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.044+0000 7fb5e2ddc740 1 --2- 172.21.15.42:0/2224611295 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55e81309aab0 0x55e81309cea0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:22.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.044+0000 7fb5e2ddc740 1 --2- 172.21.15.42:0/2224611295 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e81300c350 0x55e813010d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:22.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.044+0000 7fb5bf400640 0 client.15444 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:05:22.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.044+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/2224611295 >> 172.21.15.42:0/2224611295 conn(0x55e813007fc0 msgr2=0x55e813006900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:22.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.044+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/2224611295 shutdown_connections 2024-08-26T00:05:22.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.044+0000 7fb5e2ddc740 1 -- 172.21.15.42:0/2224611295 wait complete. 2024-08-26T00:05:22.049 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:05:22.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.044+0000 7fb5e2ddc740 20 client.15444 trim_cache size 0 max 16384 2024-08-26T00:05:22.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.046+0000 7fb5dec00640 1 -- 172.21.15.42:0/924152518 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb5c00a3050 msgr2=0x7fb5c00a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:22.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.046+0000 7fb5dec00640 1 --2- 172.21.15.42:0/924152518 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb5c00a3050 0x7fb5c00a5510 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55e813008e20 tx=0x7fb5c4009260 comp rx=0 tx=0).stop 2024-08-26T00:05:22.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.046+0000 7fb5dec00640 1 -- 172.21.15.42:0/924152518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5d806bfc0 msgr2=0x7fb5d806c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:22.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.046+0000 7fb5dec00640 1 --2- 172.21.15.42:0/924152518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5d806bfc0 0x7fb5d806c470 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb5d000da10 tx=0x7fb5d000ded0 comp rx=0 tx=0).stop 2024-08-26T00:05:22.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.046+0000 7fb5dec00640 1 -- 172.21.15.42:0/924152518 shutdown_connections 2024-08-26T00:05:22.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.046+0000 7fb5dec00640 1 --2- 172.21.15.42:0/924152518 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb5c00a3050 0x7fb5c00a5510 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:22.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.046+0000 7fb5dec00640 1 --2- 172.21.15.42:0/924152518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5d806bfc0 0x7fb5d806c470 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:22.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.046+0000 7fb5dec00640 1 --2- 172.21.15.42:0/924152518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5d8107890 0x7fb5d806ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:22.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.046+0000 7fb5dec00640 1 --2- 172.21.15.42:0/924152518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5d8102120 0x7fb5d8073ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:22.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.046+0000 7fb5dec00640 1 -- 172.21.15.42:0/924152518 >> 172.21.15.42:0/924152518 conn(0x7fb5d80fd4a0 msgr2=0x7fb5d80fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:22.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.046+0000 7fb5dec00640 1 -- 172.21.15.42:0/924152518 shutdown_connections 2024-08-26T00:05:22.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:22.046+0000 7fb5dec00640 1 -- 172.21.15.42:0/924152518 wait complete. 2024-08-26T00:05:23.942 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:23 smithi042 ceph-mon[17225]: pgmap v425: 97 pgs: 97 active+clean; 307 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.0 MiB/s wr, 472 op/s 2024-08-26T00:05:24.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:23 smithi043 ceph-mon[22091]: pgmap v425: 97 pgs: 97 active+clean; 307 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.0 MiB/s wr, 472 op/s 2024-08-26T00:05:24.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:23 smithi181 ceph-mon[22102]: pgmap v425: 97 pgs: 97 active+clean; 307 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.0 MiB/s wr, 472 op/s 2024-08-26T00:05:24.231 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-26T00:05:25.447 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:05:25.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:25 smithi042 ceph-mon[17225]: pgmap v426: 97 pgs: 97 active+clean; 337 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.8 MiB/s wr, 554 op/s 2024-08-26T00:05:26.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:25 smithi043 ceph-mon[22091]: pgmap v426: 97 pgs: 97 active+clean; 337 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.8 MiB/s wr, 554 op/s 2024-08-26T00:05:26.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:25 smithi181 ceph-mon[22102]: pgmap v426: 97 pgs: 97 active+clean; 337 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.8 MiB/s wr, 554 op/s 2024-08-26T00:05:26.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.350+0000 7fc13e000640 1 -- 172.21.15.42:0/2342137646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc138109ba0 msgr2=0x7fc13810dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:26.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.351+0000 7fc13e000640 1 --2- 172.21.15.42:0/2342137646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc138109ba0 0x7fc13810dfe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc124009900 tx=0x7fc12402a420 comp rx=0 tx=0).stop 2024-08-26T00:05:26.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.352+0000 7fc13e000640 1 -- 172.21.15.42:0/2342137646 shutdown_connections 2024-08-26T00:05:26.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.352+0000 7fc13e000640 1 --2- 172.21.15.42:0/2342137646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13810e710 0x7fc1381150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.352+0000 7fc13e000640 1 --2- 172.21.15.42:0/2342137646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc138109ba0 0x7fc13810dfe0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.353+0000 7fc13e000640 1 --2- 172.21.15.42:0/2342137646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1381091f0 0x7fc1381095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.353+0000 7fc13e000640 1 -- 172.21.15.42:0/2342137646 >> 172.21.15.42:0/2342137646 conn(0x7fc138072f20 msgr2=0x7fc138073330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:26.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.353+0000 7fc13e000640 1 -- 172.21.15.42:0/2342137646 shutdown_connections 2024-08-26T00:05:26.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.354+0000 7fc13e000640 1 -- 172.21.15.42:0/2342137646 wait complete. 2024-08-26T00:05:26.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.355+0000 7fc13e000640 1 Processor -- start 2024-08-26T00:05:26.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.359+0000 7fc13e000640 1 -- start start 2024-08-26T00:05:26.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.359+0000 7fc13e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1381091f0 0x7fc1381a8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:26.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.359+0000 7fc13e000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc138109ba0 0x7fc1381a8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:26.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.359+0000 7fc13e000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13810e710 0x7fc1381a28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:26.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.360+0000 7fc13e000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc13811a3c0 con 0x7fc1381091f0 2024-08-26T00:05:26.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.360+0000 7fc13e000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc13811a240 con 0x7fc13810e710 2024-08-26T00:05:26.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.360+0000 7fc13e000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc13811a540 con 0x7fc138109ba0 2024-08-26T00:05:26.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.360+0000 7fc13cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1381091f0 0x7fc1381a8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:26.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.360+0000 7fc13cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1381091f0 0x7fc1381a8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47016/0 (socket says 172.21.15.42:47016) 2024-08-26T00:05:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.360+0000 7fc13cc00640 1 -- 172.21.15.42:0/733815402 learned_addr learned my addr 172.21.15.42:0/733815402 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.361+0000 7fc13d600640 1 --2- 172.21.15.42:0/733815402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13810e710 0x7fc1381a28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.363+0000 7fc13cc00640 1 -- 172.21.15.42:0/733815402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc138109ba0 msgr2=0x7fc1381a8c50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-26T00:05:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.363+0000 7fc13cc00640 1 --2- 172.21.15.42:0/733815402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc138109ba0 0x7fc1381a8c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.364+0000 7fc13cc00640 1 -- 172.21.15.42:0/733815402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13810e710 msgr2=0x7fc1381a28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.364+0000 7fc13cc00640 1 --2- 172.21.15.42:0/733815402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13810e710 0x7fc1381a28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.364+0000 7fc13cc00640 1 -- 172.21.15.42:0/733815402 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1381a3000 con 0x7fc1381091f0 2024-08-26T00:05:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.365+0000 7fc13d600640 1 --2- 172.21.15.42:0/733815402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13810e710 0x7fc1381a28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:05:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.366+0000 7fc13cc00640 1 --2- 172.21.15.42:0/733815402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1381091f0 0x7fc1381a8710 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc12800b4a0 tx=0x7fc12800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.367+0000 7fc135600640 1 -- 172.21.15.42:0/733815402 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128014070 con 0x7fc1381091f0 2024-08-26T00:05:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.367+0000 7fc135600640 1 -- 172.21.15.42:0/733815402 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc128010af0 con 0x7fc1381091f0 2024-08-26T00:05:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.368+0000 7fc13e000640 1 -- 172.21.15.42:0/733815402 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1381a32f0 con 0x7fc1381091f0 2024-08-26T00:05:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.368+0000 7fc13e000640 1 -- 172.21.15.42:0/733815402 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1381af5e0 con 0x7fc1381091f0 2024-08-26T00:05:26.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.369+0000 7fc135600640 1 -- 172.21.15.42:0/733815402 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128014070 con 0x7fc1381091f0 2024-08-26T00:05:26.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.380+0000 7fc135600640 1 -- 172.21.15.42:0/733815402 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc128017070 con 0x7fc1381091f0 2024-08-26T00:05:26.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.382+0000 7fc135600640 1 --2- 172.21.15.42:0/733815402 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc11c0a2c70 0x7fc11c0a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:26.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.384+0000 7fc1421d9740 1 Processor -- start 2024-08-26T00:05:26.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.385+0000 7fc137e00640 1 --2- 172.21.15.42:0/733815402 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc11c0a2c70 0x7fc11c0a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:26.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.386+0000 7fc1421d9740 1 -- start start 2024-08-26T00:05:26.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.387+0000 7fc1421d9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd40240 0x5617ffd40620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:26.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.387+0000 7fc1421d9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40b60 0x5617ffd4aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:26.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.387+0000 7fc1421d9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd4b420 0x5617ffd4d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:26.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.388+0000 7fc137e00640 1 --2- 172.21.15.42:0/733815402 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc11c0a2c70 0x7fc11c0a5130 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc12402a940 tx=0x7fc124005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:26.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.389+0000 7fc13cc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd40240 0x5617ffd40620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:26.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.389+0000 7fc13cc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd40240 0x5617ffd40620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:48004/0 (socket says 172.21.15.42:48004) 2024-08-26T00:05:26.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.390+0000 7fc135600640 1 -- 172.21.15.42:0/733815402 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fc128098920 con 0x7fc1381091f0 2024-08-26T00:05:26.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.390+0000 7fc137e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40b60 0x5617ffd4aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:26.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.390+0000 7fc137e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40b60 0x5617ffd4aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47020/0 (socket says 172.21.15.42:47020) 2024-08-26T00:05:26.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.391+0000 7fc13d600640 1 --2- 172.21.15.42:0/2345691018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd4b420 0x5617ffd4d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:26.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.391+0000 7fc13cc00640 1 -- 172.21.15.42:0/2345691018 learned_addr learned my addr 172.21.15.42:0/2345691018 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:26.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.391+0000 7fc1421d9740 1 -- 172.21.15.42:0/2345691018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5617ffc9df30 con 0x5617ffd40b60 2024-08-26T00:05:26.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.391+0000 7fc1421d9740 1 -- 172.21.15.42:0/2345691018 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5617ffc355a0 con 0x5617ffd40240 2024-08-26T00:05:26.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.391+0000 7fc1421d9740 1 -- 172.21.15.42:0/2345691018 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5617ffc99ef0 con 0x5617ffd4b420 2024-08-26T00:05:26.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.392+0000 7fc13cc00640 1 -- 172.21.15.42:0/2345691018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd4b420 msgr2=0x5617ffd4d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:26.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.392+0000 7fc13cc00640 1 --2- 172.21.15.42:0/2345691018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd4b420 0x5617ffd4d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.392+0000 7fc13cc00640 1 -- 172.21.15.42:0/2345691018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40b60 msgr2=0x5617ffd4aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:26.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.393+0000 7fc13cc00640 1 --2- 172.21.15.42:0/2345691018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40b60 0x5617ffd4aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.393+0000 7fc13cc00640 1 -- 172.21.15.42:0/2345691018 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617ffa0f3c0 con 0x5617ffd40240 2024-08-26T00:05:26.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.393+0000 7fc13d600640 1 --2- 172.21.15.42:0/2345691018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd4b420 0x5617ffd4d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:05:26.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.393+0000 7fc137e00640 1 --2- 172.21.15.42:0/2345691018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40b60 0x5617ffd4aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:05:26.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.397+0000 7fc13cc00640 1 --2- 172.21.15.42:0/2345691018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd40240 0x5617ffd40620 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc12800be60 tx=0x7fc1280a1f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbc42565e5d97366 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:26.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.397+0000 7fc12dc00640 1 -- 172.21.15.42:0/2345691018 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1280972b0 con 0x5617ffd40240 2024-08-26T00:05:26.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.397+0000 7fc12dc00640 1 -- 172.21.15.42:0/2345691018 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc128010940 con 0x5617ffd40240 2024-08-26T00:05:26.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.399+0000 7fc1421d9740 1 -- 172.21.15.42:0/2345691018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd40240 msgr2=0x5617ffd40620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:26.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.399+0000 7fc1421d9740 1 --2- 172.21.15.42:0/2345691018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd40240 0x5617ffd40620 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc12800be60 tx=0x7fc1280a1f40 comp rx=0 tx=0).stop 2024-08-26T00:05:26.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.399+0000 7fc1421d9740 1 -- 172.21.15.42:0/2345691018 shutdown_connections 2024-08-26T00:05:26.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.399+0000 7fc1421d9740 1 --2- 172.21.15.42:0/2345691018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd4b420 0x5617ffd4d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.399+0000 7fc1421d9740 1 --2- 172.21.15.42:0/2345691018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40b60 0x5617ffd4aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.399+0000 7fc1421d9740 1 --2- 172.21.15.42:0/2345691018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd40240 0x5617ffd40620 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.399+0000 7fc1421d9740 1 -- 172.21.15.42:0/2345691018 >> 172.21.15.42:0/2345691018 conn(0x5617ffd3c7d0 msgr2=0x5617ffd3cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:26.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.400+0000 7fc1421d9740 1 -- 172.21.15.42:0/2345691018 shutdown_connections 2024-08-26T00:05:26.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.400+0000 7fc1421d9740 1 -- 172.21.15.42:0/2345691018 wait complete. 2024-08-26T00:05:26.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.401+0000 7fc1421d9740 1 -- start start 2024-08-26T00:05:26.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.401+0000 7fc1421d9740 1 Processor -- start 2024-08-26T00:05:26.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.406+0000 7fc1421d9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd40240 0x5617ffd482b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:26.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.407+0000 7fc1421d9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40b60 0x5617ffd487f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:26.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.407+0000 7fc1421d9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd4b420 0x5617ffd48d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:26.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.407+0000 7fc1421d9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5617ffd4df50 con 0x5617ffd40b60 2024-08-26T00:05:26.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.407+0000 7fc1421d9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5617ffc58de0 con 0x5617ffd4b420 2024-08-26T00:05:26.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.407+0000 7fc1421d9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5617ffd4e0d0 con 0x5617ffd40240 2024-08-26T00:05:26.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.407+0000 7fc13cc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd40240 0x5617ffd482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:26.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.407+0000 7fc1421d9740 10 client.0 _ll_register_callbacks cb 0x5617ffc477b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:05:26.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.407+0000 7fc13cc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd40240 0x5617ffd482b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:43836/0 (socket says 172.21.15.42:43836) 2024-08-26T00:05:26.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.407+0000 7fc13cc00640 1 -- 172.21.15.42:0/4111732925 learned_addr learned my addr 172.21.15.42:0/4111732925 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:26.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.407+0000 7fc13d600640 1 --2- 172.21.15.42:0/4111732925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd4b420 0x5617ffd48d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:26.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.408+0000 7fc13d600640 1 -- 172.21.15.42:0/4111732925 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd40240 msgr2=0x5617ffd482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:26.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.408+0000 7fc13d600640 1 --2- 172.21.15.42:0/4111732925 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd40240 0x5617ffd482b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.408+0000 7fc13d600640 1 -- 172.21.15.42:0/4111732925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40b60 msgr2=0x5617ffd487f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:05:26.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.408+0000 7fc137e00640 1 --2- 172.21.15.42:0/4111732925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40b60 0x5617ffd487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:26.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.408+0000 7fc13d600640 1 --2- 172.21.15.42:0/4111732925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40b60 0x5617ffd487f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.408+0000 7fc13d600640 1 -- 172.21.15.42:0/4111732925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617ffd57410 con 0x5617ffd4b420 2024-08-26T00:05:26.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.409+0000 7fc137e00640 1 --2- 172.21.15.42:0/4111732925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40b60 0x5617ffd487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:05:26.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.410+0000 7fc13d600640 1 --2- 172.21.15.42:0/4111732925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd4b420 0x5617ffd48d30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc130005fd0 tx=0x7fc130012820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d42afa7752ad2c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:26.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.410+0000 7fc122000640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:05:26.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.410+0000 7fc122000640 1 -- 172.21.15.42:0/4111732925 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc130004b20 con 0x5617ffd4b420 2024-08-26T00:05:26.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.410+0000 7fc122000640 1 -- 172.21.15.42:0/4111732925 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fc130004cc0 con 0x5617ffd4b420 2024-08-26T00:05:26.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.410+0000 7fc1421d9740 1 -- 172.21.15.42:0/4111732925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc128010940 con 0x5617ffd4b420 2024-08-26T00:05:26.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.412+0000 7fc122000640 1 -- 172.21.15.42:0/4111732925 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc13001c470 con 0x5617ffd4b420 2024-08-26T00:05:26.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.412+0000 7fc1421d9740 10 client.25481 fetch_fsmap learned FSMap version 27 2024-08-26T00:05:26.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.412+0000 7fc1421d9740 1 -- 172.21.15.42:0/4111732925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5617ffd59dd0 con 0x5617ffd4b420 2024-08-26T00:05:26.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.412+0000 7fc122000640 1 -- 172.21.15.42:0/4111732925 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc128010940 con 0x5617ffd4b420 2024-08-26T00:05:26.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.413+0000 7fc122000640 1 -- 172.21.15.42:0/4111732925 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fc130010640 con 0x5617ffd4b420 2024-08-26T00:05:26.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.413+0000 7fc1421d9740 10 client.25481 fetch_fsmap finished waiting for FSMap version 27 2024-08-26T00:05:26.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.413+0000 7fc1421d9740 10 client.25481 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-26T00:05:26.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.413+0000 7fc1421d9740 20 client.25481 populate_metadata read hostname 'smithi042' 2024-08-26T00:05:26.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.413+0000 7fc1421d9740 1 --2- 172.21.15.42:0/4111732925 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x5617ffd5b6c0 0x5617ffd5db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:26.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.413+0000 7fc1421d9740 4 client.25481 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:05:26.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.413+0000 7fc1421d9740 1 -- 172.21.15.42:0/4111732925 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617ffcab4a0 con 0x5617ffd5b6c0 2024-08-26T00:05:26.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.414+0000 7fc13cc00640 1 --2- 172.21.15.42:0/4111732925 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x5617ffd5b6c0 0x5617ffd5db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:26.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.414+0000 7fc13cc00640 1 --2- 172.21.15.42:0/4111732925 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x5617ffd5b6c0 0x5617ffd5db40 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d7f312ef4ef775bb server_cookie=60ea1633cd2e66 in_seq=0 out_seq=0 2024-08-26T00:05:26.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.414+0000 7fc122000640 10 client.25481 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:05:26.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.417+0000 7fc122000640 1 -- 172.21.15.42:0/4111732925 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5617ffcab4a0 con 0x5617ffd5b6c0 2024-08-26T00:05:26.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.417+0000 7fc122000640 10 client.25481 handle_command_reply: tid=0 2024-08-26T00:05:26.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.417+0000 7fc1421d9740 1 client.25481 shutdown 2024-08-26T00:05:26.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.418+0000 7fc1421d9740 1 -- 172.21.15.42:0/4111732925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd4b420 msgr2=0x5617ffd48d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:26.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.418+0000 7fc1421d9740 1 --2- 172.21.15.42:0/4111732925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd4b420 0x5617ffd48d30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc130005fd0 tx=0x7fc130012820 comp rx=0 tx=0).stop 2024-08-26T00:05:26.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.418+0000 7fc1421d9740 1 -- 172.21.15.42:0/4111732925 shutdown_connections 2024-08-26T00:05:26.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.418+0000 7fc1421d9740 1 --2- 172.21.15.42:0/4111732925 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x5617ffd5b6c0 0x5617ffd5db40 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.418+0000 7fc122000640 0 client.25481 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:05:26.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.418+0000 7fc1421d9740 1 --2- 172.21.15.42:0/4111732925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd4b420 0x5617ffd48d30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.418+0000 7fc1421d9740 1 --2- 172.21.15.42:0/4111732925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40b60 0x5617ffd487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.418+0000 7fc1421d9740 1 --2- 172.21.15.42:0/4111732925 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd40240 0x5617ffd482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.418+0000 7fc1421d9740 1 -- 172.21.15.42:0/4111732925 >> 172.21.15.42:0/4111732925 conn(0x5617ffd3c7d0 msgr2=0x5617ffd33120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:26.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.419+0000 7fc1421d9740 1 -- 172.21.15.42:0/4111732925 shutdown_connections 2024-08-26T00:05:26.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.419+0000 7fc1421d9740 1 -- 172.21.15.42:0/4111732925 wait complete. 2024-08-26T00:05:26.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.419+0000 7fc1421d9740 20 client.25481 trim_cache size 0 max 16384 2024-08-26T00:05:26.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.461+0000 7fc1421d9740 1 Processor -- start 2024-08-26T00:05:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.465+0000 7fc1421d9740 1 -- start start 2024-08-26T00:05:26.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.465+0000 7fc1421d9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40240 0x5617ffd42cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:26.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.465+0000 7fc1421d9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd40b60 0x5617ffd4a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:26.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.465+0000 7fc1421d9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd4b420 0x5617ffd63450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:26.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.465+0000 7fc1421d9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc1381b5ee0 con 0x5617ffd40240 2024-08-26T00:05:26.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.465+0000 7fc1421d9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc1381b3750 con 0x5617ffd4b420 2024-08-26T00:05:26.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.465+0000 7fc1421d9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc1381b1580 con 0x5617ffd40b60 2024-08-26T00:05:26.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.466+0000 7fc137e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd40b60 0x5617ffd4a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:26.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.466+0000 7fc137e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd40b60 0x5617ffd4a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:43850/0 (socket says 172.21.15.42:43850) 2024-08-26T00:05:26.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.466+0000 7fc137e00640 1 -- 172.21.15.42:0/2663892402 learned_addr learned my addr 172.21.15.42:0/2663892402 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:26.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.466+0000 7fc13d600640 1 --2- 172.21.15.42:0/2663892402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd4b420 0x5617ffd63450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:26.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.467+0000 7fc13cc00640 1 --2- 172.21.15.42:0/2663892402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40240 0x5617ffd42cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:26.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.467+0000 7fc13d600640 1 -- 172.21.15.42:0/2663892402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd40b60 msgr2=0x5617ffd4a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:26.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.467+0000 7fc13d600640 1 --2- 172.21.15.42:0/2663892402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd40b60 0x5617ffd4a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.467+0000 7fc13d600640 1 -- 172.21.15.42:0/2663892402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40240 msgr2=0x5617ffd42cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:26.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.467+0000 7fc13d600640 1 --2- 172.21.15.42:0/2663892402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40240 0x5617ffd42cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.467+0000 7fc13d600640 1 -- 172.21.15.42:0/2663892402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617ffd3c600 con 0x5617ffd4b420 2024-08-26T00:05:26.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.468+0000 7fc13d600640 1 --2- 172.21.15.42:0/2663892402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd4b420 0x5617ffd63450 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc130000f80 tx=0x7fc130011e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4869cd07128129e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:26.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.469+0000 7fc12d200640 1 -- 172.21.15.42:0/2663892402 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc130010430 con 0x5617ffd4b420 2024-08-26T00:05:26.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.469+0000 7fc12d200640 1 -- 172.21.15.42:0/2663892402 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc130003e50 con 0x5617ffd4b420 2024-08-26T00:05:26.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.469+0000 7fc12d200640 1 -- 172.21.15.42:0/2663892402 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc130026730 con 0x5617ffd4b420 2024-08-26T00:05:26.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.470+0000 7fc1421d9740 1 -- 172.21.15.42:0/2663892402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd4b420 msgr2=0x5617ffd63450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:26.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.470+0000 7fc1421d9740 1 --2- 172.21.15.42:0/2663892402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd4b420 0x5617ffd63450 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc130000f80 tx=0x7fc130011e70 comp rx=0 tx=0).stop 2024-08-26T00:05:26.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.471+0000 7fc1421d9740 1 -- 172.21.15.42:0/2663892402 shutdown_connections 2024-08-26T00:05:26.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.471+0000 7fc1421d9740 1 --2- 172.21.15.42:0/2663892402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd4b420 0x5617ffd63450 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.471+0000 7fc1421d9740 1 --2- 172.21.15.42:0/2663892402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd40b60 0x5617ffd4a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.471+0000 7fc1421d9740 1 --2- 172.21.15.42:0/2663892402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40240 0x5617ffd42cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.471+0000 7fc1421d9740 1 -- 172.21.15.42:0/2663892402 >> 172.21.15.42:0/2663892402 conn(0x5617ffd3c7d0 msgr2=0x5617ffd49a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:26.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.471+0000 7fc1421d9740 1 -- 172.21.15.42:0/2663892402 shutdown_connections 2024-08-26T00:05:26.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.471+0000 7fc1421d9740 1 -- 172.21.15.42:0/2663892402 wait complete. 2024-08-26T00:05:26.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.472+0000 7fc1421d9740 1 -- start start 2024-08-26T00:05:26.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.473+0000 7fc1421d9740 1 Processor -- start 2024-08-26T00:05:26.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.473+0000 7fc1421d9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40240 0x5617ffdbe780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:26.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.473+0000 7fc1421d9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd40b60 0x5617ffdbecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:26.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.473+0000 7fc1421d9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd4b420 0x5617ffd4e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:26.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.473+0000 7fc1421d9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc1381b1c10 con 0x5617ffd40240 2024-08-26T00:05:26.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.473+0000 7fc1421d9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc1381b3080 con 0x5617ffd40b60 2024-08-26T00:05:26.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.473+0000 7fc1421d9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc1381b22e0 con 0x5617ffd4b420 2024-08-26T00:05:26.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.474+0000 7fc1421d9740 10 client.0 _ll_register_callbacks cb 0x7fc13000f4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:05:26.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.475+0000 7fc137e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd40b60 0x5617ffdbecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:26.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.475+0000 7fc137e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd40b60 0x5617ffdbecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:48024/0 (socket says 172.21.15.42:48024) 2024-08-26T00:05:26.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.475+0000 7fc137e00640 1 -- 172.21.15.42:0/2946414449 learned_addr learned my addr 172.21.15.42:0/2946414449 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:26.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.475+0000 7fc13d600640 1 --2- 172.21.15.42:0/2946414449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd4b420 0x5617ffd4e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:26.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.475+0000 7fc13cc00640 1 --2- 172.21.15.42:0/2946414449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40240 0x5617ffdbe780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:26.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.476+0000 7fc13d600640 1 -- 172.21.15.42:0/2946414449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd40b60 msgr2=0x5617ffdbecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:26.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.476+0000 7fc13d600640 1 --2- 172.21.15.42:0/2946414449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd40b60 0x5617ffdbecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.476+0000 7fc13d600640 1 -- 172.21.15.42:0/2946414449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40240 msgr2=0x5617ffdbe780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:26.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.476+0000 7fc13d600640 1 --2- 172.21.15.42:0/2946414449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40240 0x5617ffdbe780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.476+0000 7fc13d600640 1 -- 172.21.15.42:0/2946414449 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617ffd40070 con 0x5617ffd4b420 2024-08-26T00:05:26.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.476+0000 7fc13cc00640 1 --2- 172.21.15.42:0/2946414449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40240 0x5617ffdbe780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:05:26.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.476+0000 7fc137e00640 1 --2- 172.21.15.42:0/2946414449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd40b60 0x5617ffdbecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:05:26.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.476+0000 7fc13d600640 1 --2- 172.21.15.42:0/2946414449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd4b420 0x5617ffd4e910 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc130010ae0 tx=0x7fc130011fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c552de9671deb5e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:26.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.476+0000 7fc122000640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:05:26.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.477+0000 7fc122000640 1 -- 172.21.15.42:0/2946414449 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc130010640 con 0x5617ffd4b420 2024-08-26T00:05:26.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.477+0000 7fc122000640 1 -- 172.21.15.42:0/2946414449 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fc130018070 con 0x5617ffd4b420 2024-08-26T00:05:26.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.477+0000 7fc1421d9740 1 -- 172.21.15.42:0/2946414449 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc130003e50 con 0x5617ffd4b420 2024-08-26T00:05:26.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.478+0000 7fc122000640 1 -- 172.21.15.42:0/2946414449 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc130003970 con 0x5617ffd4b420 2024-08-26T00:05:26.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.478+0000 7fc1421d9740 10 client.25480 fetch_fsmap learned FSMap version 27 2024-08-26T00:05:26.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.478+0000 7fc1421d9740 1 -- 172.21.15.42:0/2946414449 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5617ffd34190 con 0x5617ffd4b420 2024-08-26T00:05:26.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.478+0000 7fc122000640 1 -- 172.21.15.42:0/2946414449 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc130003e50 con 0x5617ffd4b420 2024-08-26T00:05:26.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.478+0000 7fc122000640 1 -- 172.21.15.42:0/2946414449 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fc130026530 con 0x5617ffd4b420 2024-08-26T00:05:26.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.479+0000 7fc1421d9740 10 client.25480 fetch_fsmap finished waiting for FSMap version 27 2024-08-26T00:05:26.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.479+0000 7fc1421d9740 10 client.25480 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-26T00:05:26.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.479+0000 7fc1421d9740 20 client.25480 populate_metadata read hostname 'smithi042' 2024-08-26T00:05:26.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.479+0000 7fc1421d9740 1 --2- 172.21.15.42:0/2946414449 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x5617ffd5b6c0 0x5617ffd368e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:26.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.479+0000 7fc1421d9740 4 client.25480 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:05:26.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.479+0000 7fc1421d9740 1 -- 172.21.15.42:0/2946414449 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5617ffca59b0 con 0x5617ffd5b6c0 2024-08-26T00:05:26.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.479+0000 7fc13cc00640 1 --2- 172.21.15.42:0/2946414449 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x5617ffd5b6c0 0x5617ffd368e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:26.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.485+0000 7fc13cc00640 1 --2- 172.21.15.42:0/2946414449 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x5617ffd5b6c0 0x5617ffd368e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bdbb06950c713786 server_cookie=f5cc45ad94b7baea in_seq=0 out_seq=0 2024-08-26T00:05:26.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.485+0000 7fc122000640 10 client.25480 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:05:26.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.486+0000 7fc122000640 1 -- 172.21.15.42:0/2946414449 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5617ffca59b0 con 0x5617ffd5b6c0 2024-08-26T00:05:26.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.486+0000 7fc122000640 10 client.25480 handle_command_reply: tid=0 2024-08-26T00:05:26.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.486+0000 7fc1421d9740 1 client.25480 shutdown 2024-08-26T00:05:26.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.486+0000 7fc1421d9740 1 -- 172.21.15.42:0/2946414449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd4b420 msgr2=0x5617ffd4e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:26.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.486+0000 7fc1421d9740 1 --2- 172.21.15.42:0/2946414449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd4b420 0x5617ffd4e910 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc130010ae0 tx=0x7fc130011fe0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.486+0000 7fc1421d9740 1 -- 172.21.15.42:0/2946414449 shutdown_connections 2024-08-26T00:05:26.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.486+0000 7fc1421d9740 1 --2- 172.21.15.42:0/2946414449 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x5617ffd5b6c0 0x5617ffd368e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.486+0000 7fc1421d9740 1 --2- 172.21.15.42:0/2946414449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5617ffd4b420 0x5617ffd4e910 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.486+0000 7fc1421d9740 1 --2- 172.21.15.42:0/2946414449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5617ffd40b60 0x5617ffdbecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.486+0000 7fc122000640 0 client.25480 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:05:26.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.486+0000 7fc1421d9740 1 --2- 172.21.15.42:0/2946414449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5617ffd40240 0x5617ffdbe780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.486+0000 7fc1421d9740 1 -- 172.21.15.42:0/2946414449 >> 172.21.15.42:0/2946414449 conn(0x5617ffd3c7d0 msgr2=0x5617ffd33120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:26.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.486+0000 7fc1421d9740 1 -- 172.21.15.42:0/2946414449 shutdown_connections 2024-08-26T00:05:26.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.487+0000 7fc1421d9740 1 -- 172.21.15.42:0/2946414449 wait complete. 2024-08-26T00:05:26.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.488+0000 7fc1421d9740 20 client.25480 trim_cache size 0 max 16384 2024-08-26T00:05:26.493 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:05:26.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.493+0000 7fc13e000640 1 -- 172.21.15.42:0/733815402 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc11c0a2c70 msgr2=0x7fc11c0a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:26.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.493+0000 7fc13e000640 1 --2- 172.21.15.42:0/733815402 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc11c0a2c70 0x7fc11c0a5130 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc12402a940 tx=0x7fc124005fd0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.493+0000 7fc13e000640 1 -- 172.21.15.42:0/733815402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1381091f0 msgr2=0x7fc1381a8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:26.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.493+0000 7fc13e000640 1 --2- 172.21.15.42:0/733815402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1381091f0 0x7fc1381a8710 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc12800b4a0 tx=0x7fc12800b960 comp rx=0 tx=0).stop 2024-08-26T00:05:26.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.493+0000 7fc13e000640 1 -- 172.21.15.42:0/733815402 shutdown_connections 2024-08-26T00:05:26.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.493+0000 7fc13e000640 1 --2- 172.21.15.42:0/733815402 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc11c0a2c70 0x7fc11c0a5130 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.493+0000 7fc13e000640 1 --2- 172.21.15.42:0/733815402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13810e710 0x7fc1381a28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.493+0000 7fc13e000640 1 --2- 172.21.15.42:0/733815402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc138109ba0 0x7fc1381a8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.493+0000 7fc13e000640 1 --2- 172.21.15.42:0/733815402 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1381091f0 0x7fc1381a8710 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:26.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.493+0000 7fc13e000640 1 -- 172.21.15.42:0/733815402 >> 172.21.15.42:0/733815402 conn(0x7fc138072f20 msgr2=0x7fc138117410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:26.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.494+0000 7fc13e000640 1 -- 172.21.15.42:0/733815402 shutdown_connections 2024-08-26T00:05:26.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:26.494+0000 7fc13e000640 1 -- 172.21.15.42:0/733815402 wait complete. 2024-08-26T00:05:27.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:27 smithi042 ceph-mon[17225]: pgmap v427: 97 pgs: 97 active+clean; 379 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 13 MiB/s wr, 772 op/s 2024-08-26T00:05:28.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:27 smithi043 ceph-mon[22091]: pgmap v427: 97 pgs: 97 active+clean; 379 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 13 MiB/s wr, 772 op/s 2024-08-26T00:05:28.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:27 smithi181 ceph-mon[22102]: pgmap v427: 97 pgs: 97 active+clean; 379 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 13 MiB/s wr, 772 op/s 2024-08-26T00:05:28.172 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-26T00:05:30.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:29 smithi181 ceph-mon[22102]: pgmap v428: 97 pgs: 97 active+clean; 407 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 911 op/s 2024-08-26T00:05:30.036 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:29 smithi042 ceph-mon[17225]: pgmap v428: 97 pgs: 97 active+clean; 407 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 911 op/s 2024-08-26T00:05:30.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:29 smithi043 ceph-mon[22091]: pgmap v428: 97 pgs: 97 active+clean; 407 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 911 op/s 2024-08-26T00:05:31.584 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:05:31.650 INFO:tasks.workunit.client.0.smithi042.stdout: 114 528050 638 333963 473 215416 1330 2024-08-26T00:05:32.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:31 smithi181 ceph-mon[22102]: pgmap v429: 97 pgs: 97 active+clean; 407 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 13 MiB/s wr, 819 op/s 2024-08-26T00:05:32.038 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:31 smithi042 ceph-mon[17225]: pgmap v429: 97 pgs: 97 active+clean; 407 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 13 MiB/s wr, 819 op/s 2024-08-26T00:05:32.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:31 smithi043 ceph-mon[22091]: pgmap v429: 97 pgs: 97 active+clean; 407 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 13 MiB/s wr, 819 op/s 2024-08-26T00:05:33.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.854+0000 7fe143800640 1 -- 172.21.15.42:0/870921648 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe13c1098b0 msgr2=0x7fe13c114310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:33.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.854+0000 7fe143800640 1 --2- 172.21.15.42:0/870921648 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe13c1098b0 0x7fe13c114310 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe128009900 tx=0x7fe12802a4b0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.856+0000 7fe143800640 1 -- 172.21.15.42:0/870921648 shutdown_connections 2024-08-26T00:05:33.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.856+0000 7fe143800640 1 --2- 172.21.15.42:0/870921648 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe13c114850 0x7fe13c116c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.856+0000 7fe143800640 1 --2- 172.21.15.42:0/870921648 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe13c1098b0 0x7fe13c114310 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.856+0000 7fe143800640 1 --2- 172.21.15.42:0/870921648 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe13c108f90 0x7fe13c109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.856+0000 7fe143800640 1 -- 172.21.15.42:0/870921648 >> 172.21.15.42:0/870921648 conn(0x7fe13c06dee0 msgr2=0x7fe13c06e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:33.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.857+0000 7fe143800640 1 -- 172.21.15.42:0/870921648 shutdown_connections 2024-08-26T00:05:33.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.858+0000 7fe143800640 1 -- 172.21.15.42:0/870921648 wait complete. 2024-08-26T00:05:33.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.860+0000 7fe143800640 1 Processor -- start 2024-08-26T00:05:33.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.860+0000 7fe143800640 1 -- start start 2024-08-26T00:05:33.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.860+0000 7fe143800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe13c108f90 0x7fe13c1a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:33.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.861+0000 7fe143800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe13c1098b0 0x7fe13c1a8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:33.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.861+0000 7fe143800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe13c114850 0x7fe13c1a2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:33.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.861+0000 7fe143800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c11a580 con 0x7fe13c114850 2024-08-26T00:05:33.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.861+0000 7fe143800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c11a400 con 0x7fe13c1098b0 2024-08-26T00:05:33.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.861+0000 7fe143800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c11a700 con 0x7fe13c108f90 2024-08-26T00:05:33.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.861+0000 7fe140e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe13c108f90 0x7fe13c1a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:33.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.861+0000 7fe140e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe13c108f90 0x7fe13c1a88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:43876/0 (socket says 172.21.15.42:43876) 2024-08-26T00:05:33.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.861+0000 7fe140e00640 1 -- 172.21.15.42:0/4053624708 learned_addr learned my addr 172.21.15.42:0/4053624708 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:33.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.861+0000 7fe13be00640 1 --2- 172.21.15.42:0/4053624708 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe13c1098b0 0x7fe13c1a8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:33.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.861+0000 7fe141800640 1 --2- 172.21.15.42:0/4053624708 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe13c114850 0x7fe13c1a2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:33.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.862+0000 7fe140e00640 1 -- 172.21.15.42:0/4053624708 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe13c1098b0 msgr2=0x7fe13c1a8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:33.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.862+0000 7fe140e00640 1 --2- 172.21.15.42:0/4053624708 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe13c1098b0 0x7fe13c1a8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.862+0000 7fe140e00640 1 -- 172.21.15.42:0/4053624708 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe13c114850 msgr2=0x7fe13c1a2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:33.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.862+0000 7fe140e00640 1 --2- 172.21.15.42:0/4053624708 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe13c114850 0x7fe13c1a2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.862+0000 7fe140e00640 1 -- 172.21.15.42:0/4053624708 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13c1a31d0 con 0x7fe13c108f90 2024-08-26T00:05:33.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.863+0000 7fe140e00640 1 --2- 172.21.15.42:0/4053624708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe13c108f90 0x7fe13c1a88e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe13000e9f0 tx=0x7fe13000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:33.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.863+0000 7fe139600640 1 -- 172.21.15.42:0/4053624708 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13000cd80 con 0x7fe13c108f90 2024-08-26T00:05:33.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.863+0000 7fe139600640 1 -- 172.21.15.42:0/4053624708 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe130010910 con 0x7fe13c108f90 2024-08-26T00:05:33.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.863+0000 7fe143800640 1 -- 172.21.15.42:0/4053624708 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe13c1a34c0 con 0x7fe13c108f90 2024-08-26T00:05:33.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.863+0000 7fe139600640 1 -- 172.21.15.42:0/4053624708 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130018990 con 0x7fe13c108f90 2024-08-26T00:05:33.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.864+0000 7fe143800640 1 -- 172.21.15.42:0/4053624708 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe13c1af7b0 con 0x7fe13c108f90 2024-08-26T00:05:33.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.872+0000 7fe139600640 1 -- 172.21.15.42:0/4053624708 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe130018b30 con 0x7fe13c108f90 2024-08-26T00:05:33.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.873+0000 7fe146262740 1 Processor -- start 2024-08-26T00:05:33.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.873+0000 7fe146262740 1 -- start start 2024-08-26T00:05:33.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.875+0000 7fe146262740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c5fa820 0x55c21c5fac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:33.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.875+0000 7fe146262740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c5fb140 0x55c21c6054c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:33.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.876+0000 7fe141800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c5fa820 0x55c21c5fac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:33.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.876+0000 7fe141800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c5fa820 0x55c21c5fac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:43886/0 (socket says 172.21.15.42:43886) 2024-08-26T00:05:33.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.880+0000 7fe146262740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21c605a00 0x55c21c607df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:33.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.880+0000 7fe140e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c5fb140 0x55c21c6054c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:33.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.880+0000 7fe140e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c5fb140 0x55c21c6054c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:48056/0 (socket says 172.21.15.42:48056) 2024-08-26T00:05:33.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.880+0000 7fe141800640 1 -- 172.21.15.42:0/3658342713 learned_addr learned my addr 172.21.15.42:0/3658342713 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:33.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.880+0000 7fe146262740 1 -- 172.21.15.42:0/3658342713 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c21c560f30 con 0x55c21c605a00 2024-08-26T00:05:33.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.881+0000 7fe146262740 1 -- 172.21.15.42:0/3658342713 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c21c4f85a0 con 0x55c21c5fb140 2024-08-26T00:05:33.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.881+0000 7fe139600640 1 --2- 172.21.15.42:0/4053624708 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe1240a2c80 0x7fe1240a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:33.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.881+0000 7fe146262740 1 -- 172.21.15.42:0/3658342713 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c21c55cef0 con 0x55c21c5fa820 2024-08-26T00:05:33.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.881+0000 7fe139600640 1 -- 172.21.15.42:0/4053624708 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fe1300cf350 con 0x7fe13c108f90 2024-08-26T00:05:33.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.882+0000 7fe13be00640 1 --2- 172.21.15.42:0/3658342713 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21c605a00 0x55c21c607df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:33.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.883+0000 7fe140e00640 1 -- 172.21.15.42:0/3658342713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c5fa820 msgr2=0x55c21c5fac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.883+0000 7fe140e00640 1 --2- 172.21.15.42:0/3658342713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c5fa820 0x55c21c5fac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.883+0000 7fe140e00640 1 -- 172.21.15.42:0/3658342713 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21c605a00 msgr2=0x55c21c607df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.883+0000 7fe140e00640 1 --2- 172.21.15.42:0/3658342713 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21c605a00 0x55c21c607df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.883+0000 7fe140e00640 1 -- 172.21.15.42:0/3658342713 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c21c2d23c0 con 0x55c21c5fb140 2024-08-26T00:05:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.883+0000 7fe141800640 1 --2- 172.21.15.42:0/3658342713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c5fa820 0x55c21c5fac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:05:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.883+0000 7fe141800640 1 --2- 172.21.15.42:0/4053624708 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe1240a2c80 0x7fe1240a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.883+0000 7fe13be00640 1 --2- 172.21.15.42:0/3658342713 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21c605a00 0x55c21c607df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:05:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.884+0000 7fe140e00640 1 --2- 172.21.15.42:0/3658342713 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c5fb140 0x55c21c6054c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe130000c00 tx=0x7fe13001f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b40f05d23c552c3c server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.884+0000 7fe12e000640 1 -- 172.21.15.42:0/3658342713 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13009bc20 con 0x55c21c5fb140 2024-08-26T00:05:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.884+0000 7fe141800640 1 --2- 172.21.15.42:0/4053624708 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe1240a2c80 0x7fe1240a5140 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe134003b10 tx=0x7fe134014040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.885+0000 7fe12e000640 1 -- 172.21.15.42:0/3658342713 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe13009ff20 con 0x55c21c5fb140 2024-08-26T00:05:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.885+0000 7fe12e000640 1 -- 172.21.15.42:0/3658342713 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130010c50 con 0x55c21c5fb140 2024-08-26T00:05:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.887+0000 7fe146262740 1 -- 172.21.15.42:0/3658342713 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c5fb140 msgr2=0x55c21c6054c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.887+0000 7fe146262740 1 --2- 172.21.15.42:0/3658342713 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c5fb140 0x55c21c6054c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe130000c00 tx=0x7fe13001f000 comp rx=0 tx=0).stop 2024-08-26T00:05:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.889+0000 7fe146262740 1 -- 172.21.15.42:0/3658342713 shutdown_connections 2024-08-26T00:05:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.889+0000 7fe146262740 1 --2- 172.21.15.42:0/3658342713 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21c605a00 0x55c21c607df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.889+0000 7fe146262740 1 --2- 172.21.15.42:0/3658342713 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c5fb140 0x55c21c6054c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.889+0000 7fe146262740 1 --2- 172.21.15.42:0/3658342713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c5fa820 0x55c21c5fac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.889+0000 7fe146262740 1 -- 172.21.15.42:0/3658342713 >> 172.21.15.42:0/3658342713 conn(0x55c21c5f6db0 msgr2=0x55c21c5f7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.889+0000 7fe146262740 1 -- 172.21.15.42:0/3658342713 shutdown_connections 2024-08-26T00:05:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.889+0000 7fe146262740 1 -- 172.21.15.42:0/3658342713 wait complete. 2024-08-26T00:05:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.890+0000 7fe146262740 1 -- start start 2024-08-26T00:05:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.890+0000 7fe146262740 1 Processor -- start 2024-08-26T00:05:33.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.894+0000 7fe146262740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c5fa820 0x55c21c602930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:33.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.895+0000 7fe146262740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21c5fb140 0x55c21c602e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:33.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.895+0000 7fe146262740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c605a00 0x55c21c6033b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:33.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.896+0000 7fe141800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c605a00 0x55c21c6033b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:33.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.896+0000 7fe141800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c605a00 0x55c21c6033b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:48060/0 (socket says 172.21.15.42:48060) 2024-08-26T00:05:33.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.896+0000 7fe146262740 1 -- 172.21.15.42:0/668671424 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c21c608570 con 0x55c21c5fb140 2024-08-26T00:05:33.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.896+0000 7fe141800640 1 -- 172.21.15.42:0/668671424 learned_addr learned my addr 172.21.15.42:0/668671424 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:33.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.896+0000 7fe146262740 1 -- 172.21.15.42:0/668671424 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c21c51bde0 con 0x55c21c605a00 2024-08-26T00:05:33.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.896+0000 7fe146262740 1 -- 172.21.15.42:0/668671424 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c21c6086f0 con 0x55c21c5fa820 2024-08-26T00:05:33.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.896+0000 7fe140e00640 1 --2- 172.21.15.42:0/668671424 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c5fa820 0x55c21c602930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:33.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.896+0000 7fe146262740 10 client.0 _ll_register_callbacks cb 0x55c21c50a7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:05:33.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.897+0000 7fe141800640 1 -- 172.21.15.42:0/668671424 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c5fa820 msgr2=0x55c21c602930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:33.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.897+0000 7fe141800640 1 --2- 172.21.15.42:0/668671424 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c5fa820 0x55c21c602930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.897+0000 7fe141800640 1 -- 172.21.15.42:0/668671424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21c5fb140 msgr2=0x55c21c602e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:33.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.897+0000 7fe141800640 1 --2- 172.21.15.42:0/668671424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21c5fb140 0x55c21c602e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.897+0000 7fe141800640 1 -- 172.21.15.42:0/668671424 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c21c611a10 con 0x55c21c605a00 2024-08-26T00:05:33.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.897+0000 7fe141800640 1 --2- 172.21.15.42:0/668671424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c605a00 0x55c21c6033b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe134005fd0 tx=0x7fe134009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=893d04cde51b25dd server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:33.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.897+0000 7fe122a00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:05:33.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.897+0000 7fe122a00640 1 -- 172.21.15.42:0/668671424 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe134022e60 con 0x55c21c605a00 2024-08-26T00:05:33.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.898+0000 7fe122a00640 1 -- 172.21.15.42:0/668671424 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fe1340240d0 con 0x55c21c605a00 2024-08-26T00:05:33.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.898+0000 7fe146262740 1 -- 172.21.15.42:0/668671424 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe13009ff20 con 0x55c21c605a00 2024-08-26T00:05:33.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.898+0000 7fe122a00640 1 -- 172.21.15.42:0/668671424 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe1340242d0 con 0x55c21c605a00 2024-08-26T00:05:33.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.898+0000 7fe146262740 10 client.25499 fetch_fsmap learned FSMap version 27 2024-08-26T00:05:33.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.898+0000 7fe146262740 1 -- 172.21.15.42:0/668671424 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c21c6143c0 con 0x55c21c605a00 2024-08-26T00:05:33.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.899+0000 7fe122a00640 1 -- 172.21.15.42:0/668671424 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe13009ff20 con 0x55c21c605a00 2024-08-26T00:05:33.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.900+0000 7fe122a00640 1 -- 172.21.15.42:0/668671424 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fe13402ea20 con 0x55c21c605a00 2024-08-26T00:05:33.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.900+0000 7fe146262740 10 client.25499 fetch_fsmap finished waiting for FSMap version 27 2024-08-26T00:05:33.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.900+0000 7fe146262740 10 client.25499 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:05:33.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.900+0000 7fe146262740 20 client.25499 populate_metadata read hostname 'smithi042' 2024-08-26T00:05:33.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.900+0000 7fe146262740 1 --2- 172.21.15.42:0/668671424 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c21c6158f0 0x55c21c617db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:33.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.900+0000 7fe146262740 4 client.25499 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:05:33.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.900+0000 7fe146262740 1 -- 172.21.15.42:0/668671424 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c21c56e4a0 con 0x55c21c6158f0 2024-08-26T00:05:33.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.902+0000 7fe140e00640 1 --2- 172.21.15.42:0/668671424 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c21c6158f0 0x55c21c617db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:33.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.903+0000 7fe140e00640 1 --2- 172.21.15.42:0/668671424 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c21c6158f0 0x55c21c617db0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d0b35d321c92915 server_cookie=17f72df2e9f6fb7a in_seq=0 out_seq=0 2024-08-26T00:05:33.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.903+0000 7fe122a00640 10 client.25499 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:05:33.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.906+0000 7fe122a00640 1 -- 172.21.15.42:0/668671424 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c21c56e4a0 con 0x55c21c6158f0 2024-08-26T00:05:33.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.906+0000 7fe122a00640 10 client.25499 handle_command_reply: tid=0 2024-08-26T00:05:33.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.906+0000 7fe146262740 1 client.25499 shutdown 2024-08-26T00:05:33.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.907+0000 7fe146262740 1 -- 172.21.15.42:0/668671424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c605a00 msgr2=0x55c21c6033b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:33.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.907+0000 7fe146262740 1 --2- 172.21.15.42:0/668671424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c605a00 0x55c21c6033b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe134005fd0 tx=0x7fe134009500 comp rx=0 tx=0).stop 2024-08-26T00:05:33.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.908+0000 7fe146262740 1 -- 172.21.15.42:0/668671424 shutdown_connections 2024-08-26T00:05:33.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.908+0000 7fe146262740 1 --2- 172.21.15.42:0/668671424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c605a00 0x55c21c6033b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.908+0000 7fe146262740 1 --2- 172.21.15.42:0/668671424 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c21c6158f0 0x55c21c617db0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.908+0000 7fe146262740 1 --2- 172.21.15.42:0/668671424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21c5fb140 0x55c21c602e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.908+0000 7fe146262740 1 --2- 172.21.15.42:0/668671424 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c5fa820 0x55c21c602930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.908+0000 7fe146262740 1 -- 172.21.15.42:0/668671424 >> 172.21.15.42:0/668671424 conn(0x55c21c5f6db0 msgr2=0x55c21c5f5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:33.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.908+0000 7fe122a00640 0 client.25499 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:05:33.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.909+0000 7fe146262740 1 -- 172.21.15.42:0/668671424 shutdown_connections 2024-08-26T00:05:33.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.909+0000 7fe146262740 1 -- 172.21.15.42:0/668671424 wait complete. 2024-08-26T00:05:33.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.910+0000 7fe146262740 20 client.25499 trim_cache size 0 max 16384 2024-08-26T00:05:33.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.943+0000 7fe146262740 1 Processor -- start 2024-08-26T00:05:33.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.943+0000 7fe146262740 1 -- start start 2024-08-26T00:05:33.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.944+0000 7fe146262740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21c5fa820 0x55c21c5fd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:33.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.944+0000 7fe146262740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c5fb140 0x55c21c611050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:33.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.944+0000 7fe146262740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c605a00 0x55c21c5ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:33.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.944+0000 7fe13be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c5fb140 0x55c21c611050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:33.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.945+0000 7fe13be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c5fb140 0x55c21c611050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:48068/0 (socket says 172.21.15.42:48068) 2024-08-26T00:05:33.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.945+0000 7fe141800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c605a00 0x55c21c5ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:33.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.945+0000 7fe141800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c605a00 0x55c21c5ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:43916/0 (socket says 172.21.15.42:43916) 2024-08-26T00:05:33.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.945+0000 7fe146262740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c1b6370 con 0x55c21c5fa820 2024-08-26T00:05:33.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.945+0000 7fe146262740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c1b3be0 con 0x55c21c5fb140 2024-08-26T00:05:33.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.945+0000 7fe13be00640 1 -- 172.21.15.42:0/4286602988 learned_addr learned my addr 172.21.15.42:0/4286602988 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:33.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.945+0000 7fe146262740 1 -- 172.21.15.42:0/4286602988 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c1b1a90 con 0x55c21c605a00 2024-08-26T00:05:33.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.946+0000 7fe141800640 1 -- 172.21.15.42:0/4286602988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c5fb140 msgr2=0x55c21c611050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:33.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.946+0000 7fe141800640 1 --2- 172.21.15.42:0/4286602988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c5fb140 0x55c21c611050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.946+0000 7fe140e00640 1 --2- 172.21.15.42:0/4286602988 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21c5fa820 0x55c21c5fd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:33.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.946+0000 7fe141800640 1 -- 172.21.15.42:0/4286602988 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21c5fa820 msgr2=0x55c21c5fd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:33.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.947+0000 7fe141800640 1 --2- 172.21.15.42:0/4286602988 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21c5fa820 0x55c21c5fd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.947+0000 7fe141800640 1 -- 172.21.15.42:0/4286602988 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c21c5f73c0 con 0x55c21c605a00 2024-08-26T00:05:33.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.947+0000 7fe140e00640 1 --2- 172.21.15.42:0/4286602988 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21c5fa820 0x55c21c5fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:05:33.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.947+0000 7fe141800640 1 --2- 172.21.15.42:0/4286602988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c605a00 0x55c21c5ffbb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe13402ee40 tx=0x7fe134003fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f46a4e428cca7391 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:33.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.948+0000 7fe12d600640 1 -- 172.21.15.42:0/4286602988 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe134022e60 con 0x55c21c605a00 2024-08-26T00:05:33.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.948+0000 7fe12d600640 1 -- 172.21.15.42:0/4286602988 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe134004e40 con 0x55c21c605a00 2024-08-26T00:05:33.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.948+0000 7fe12d600640 1 -- 172.21.15.42:0/4286602988 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe134024910 con 0x55c21c605a00 2024-08-26T00:05:33.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.949+0000 7fe146262740 1 -- 172.21.15.42:0/4286602988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c605a00 msgr2=0x55c21c5ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:33.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.949+0000 7fe146262740 1 --2- 172.21.15.42:0/4286602988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c605a00 0x55c21c5ffbb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe13402ee40 tx=0x7fe134003fd0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.949+0000 7fe146262740 1 -- 172.21.15.42:0/4286602988 shutdown_connections 2024-08-26T00:05:33.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.949+0000 7fe146262740 1 --2- 172.21.15.42:0/4286602988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c605a00 0x55c21c5ffbb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.949+0000 7fe146262740 1 --2- 172.21.15.42:0/4286602988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c5fb140 0x55c21c611050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.949+0000 7fe146262740 1 --2- 172.21.15.42:0/4286602988 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21c5fa820 0x55c21c5fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.949+0000 7fe146262740 1 -- 172.21.15.42:0/4286602988 >> 172.21.15.42:0/4286602988 conn(0x55c21c5f6db0 msgr2=0x55c21c610940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:33.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.949+0000 7fe146262740 1 -- 172.21.15.42:0/4286602988 shutdown_connections 2024-08-26T00:05:33.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.950+0000 7fe146262740 1 -- 172.21.15.42:0/4286602988 wait complete. 2024-08-26T00:05:33.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.951+0000 7fe146262740 1 -- start start 2024-08-26T00:05:33.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.951+0000 7fe146262740 1 Processor -- start 2024-08-26T00:05:33.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.952+0000 7fe146262740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c5fa820 0x55c21c61dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:33.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.952+0000 7fe146262740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c5fb140 0x55c21c61af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:33.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.952+0000 7fe146262740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21c605a00 0x55c21c61b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:33.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.953+0000 7fe13be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c5fb140 0x55c21c61af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:33.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.953+0000 7fe13be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c5fb140 0x55c21c61af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:43920/0 (socket says 172.21.15.42:43920) 2024-08-26T00:05:33.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.954+0000 7fe13be00640 1 -- 172.21.15.42:0/3919350023 learned_addr learned my addr 172.21.15.42:0/3919350023 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:33.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.954+0000 7fe141800640 1 --2- 172.21.15.42:0/3919350023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21c605a00 0x55c21c61b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:33.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.953+0000 7fe140e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c5fa820 0x55c21c61dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:33.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.955+0000 7fe146262740 1 -- 172.21.15.42:0/3919350023 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c1b20e0 con 0x55c21c605a00 2024-08-26T00:05:33.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.955+0000 7fe146262740 1 -- 172.21.15.42:0/3919350023 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c1b3510 con 0x55c21c5fa820 2024-08-26T00:05:33.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.955+0000 7fe146262740 1 -- 172.21.15.42:0/3919350023 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c1b2770 con 0x55c21c5fb140 2024-08-26T00:05:33.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.956+0000 7fe146262740 10 client.0 _ll_register_callbacks cb 0x7fe134009dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:05:33.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.958+0000 7fe141800640 1 -- 172.21.15.42:0/3919350023 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c5fb140 msgr2=0x55c21c61af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:33.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.958+0000 7fe141800640 1 --2- 172.21.15.42:0/3919350023 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c5fb140 0x55c21c61af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.958+0000 7fe141800640 1 -- 172.21.15.42:0/3919350023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c5fa820 msgr2=0x55c21c61dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:33.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.958+0000 7fe141800640 1 --2- 172.21.15.42:0/3919350023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c5fa820 0x55c21c61dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:33.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.958+0000 7fe141800640 1 -- 172.21.15.42:0/3919350023 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c21c61bca0 con 0x55c21c605a00 2024-08-26T00:05:33.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.959+0000 7fe140e00640 1 --2- 172.21.15.42:0/3919350023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c5fa820 0x55c21c61dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:05:33.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.960+0000 7fe141800640 1 --2- 172.21.15.42:0/3919350023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21c605a00 0x55c21c61b4c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe13402edc0 tx=0x7fe134037640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc6b0d5fbef615a server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:33.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.960+0000 7fe122a00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:05:33.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.961+0000 7fe122a00640 1 -- 172.21.15.42:0/3919350023 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe134022e60 con 0x55c21c605a00 2024-08-26T00:05:33.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.961+0000 7fe146262740 1 -- 172.21.15.42:0/3919350023 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c21c5689b0 con 0x55c21c605a00 2024-08-26T00:05:33.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.961+0000 7fe122a00640 1 -- 172.21.15.42:0/3919350023 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fe134004b70 con 0x55c21c605a00 2024-08-26T00:05:33.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.962+0000 7fe122a00640 1 -- 172.21.15.42:0/3919350023 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe134024080 con 0x55c21c605a00 2024-08-26T00:05:33.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.962+0000 7fe146262740 10 client.15465 fetch_fsmap learned FSMap version 27 2024-08-26T00:05:33.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.962+0000 7fe146262740 1 -- 172.21.15.42:0/3919350023 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c21c680460 con 0x55c21c605a00 2024-08-26T00:05:33.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.963+0000 7fe122a00640 1 -- 172.21.15.42:0/3919350023 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55c21c5689b0 con 0x55c21c605a00 2024-08-26T00:05:33.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.963+0000 7fe122a00640 1 -- 172.21.15.42:0/3919350023 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fe13402e420 con 0x55c21c605a00 2024-08-26T00:05:33.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.963+0000 7fe146262740 10 client.15465 fetch_fsmap finished waiting for FSMap version 27 2024-08-26T00:05:33.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.963+0000 7fe146262740 10 client.15465 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:05:33.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.964+0000 7fe146262740 20 client.15465 populate_metadata read hostname 'smithi042' 2024-08-26T00:05:33.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.964+0000 7fe146262740 1 --2- 172.21.15.42:0/3919350023 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c21c680a00 0x55c21c682e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:33.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.964+0000 7fe146262740 4 client.15465 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:05:33.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.964+0000 7fe146262740 1 -- 172.21.15.42:0/3919350023 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c21c4e5010 con 0x55c21c680a00 2024-08-26T00:05:34.016 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:33 smithi042 ceph-mon[17225]: pgmap v430: 97 pgs: 97 active+clean; 420 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 14 MiB/s wr, 810 op/s 2024-08-26T00:05:34.017 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:05:34.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.974+0000 7fe140e00640 1 --2- 172.21.15.42:0/3919350023 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c21c680a00 0x55c21c682e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:34.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.975+0000 7fe122a00640 10 client.15465 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:05:34.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.977+0000 7fe140e00640 1 --2- 172.21.15.42:0/3919350023 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c21c680a00 0x55c21c682e20 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5ec978a27f33a48 server_cookie=efedf6faa02f5c27 in_seq=0 out_seq=0 2024-08-26T00:05:34.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.979+0000 7fe122a00640 1 -- 172.21.15.42:0/3919350023 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c21c4e5010 con 0x55c21c680a00 2024-08-26T00:05:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.979+0000 7fe122a00640 10 client.15465 handle_command_reply: tid=0 2024-08-26T00:05:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.979+0000 7fe146262740 1 client.15465 shutdown 2024-08-26T00:05:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.980+0000 7fe146262740 1 -- 172.21.15.42:0/3919350023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21c605a00 msgr2=0x55c21c61b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.980+0000 7fe146262740 1 --2- 172.21.15.42:0/3919350023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21c605a00 0x55c21c61b4c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe13402edc0 tx=0x7fe134037640 comp rx=0 tx=0).stop 2024-08-26T00:05:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.981+0000 7fe146262740 1 -- 172.21.15.42:0/3919350023 shutdown_connections 2024-08-26T00:05:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.981+0000 7fe146262740 1 --2- 172.21.15.42:0/3919350023 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c21c680a00 0x55c21c682e20 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.981+0000 7fe146262740 1 --2- 172.21.15.42:0/3919350023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c21c605a00 0x55c21c61b4c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:34.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.981+0000 7fe122a00640 0 client.15465 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:05:34.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.981+0000 7fe146262740 1 --2- 172.21.15.42:0/3919350023 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c21c5fb140 0x55c21c61af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:34.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.982+0000 7fe146262740 1 --2- 172.21.15.42:0/3919350023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c21c5fa820 0x55c21c61dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:34.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.982+0000 7fe146262740 1 -- 172.21.15.42:0/3919350023 >> 172.21.15.42:0/3919350023 conn(0x55c21c5f6db0 msgr2=0x55c21c611160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:34.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.988+0000 7fe146262740 1 -- 172.21.15.42:0/3919350023 shutdown_connections 2024-08-26T00:05:34.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.988+0000 7fe146262740 1 -- 172.21.15.42:0/3919350023 wait complete. 2024-08-26T00:05:34.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.989+0000 7fe146262740 20 client.15465 trim_cache size 0 max 16384 2024-08-26T00:05:34.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.991+0000 7fe143800640 1 -- 172.21.15.42:0/4053624708 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe1240a2c80 msgr2=0x7fe1240a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:34.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.991+0000 7fe143800640 1 --2- 172.21.15.42:0/4053624708 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe1240a2c80 0x7fe1240a5140 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe134003b10 tx=0x7fe134014040 comp rx=0 tx=0).stop 2024-08-26T00:05:34.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.991+0000 7fe143800640 1 -- 172.21.15.42:0/4053624708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe13c108f90 msgr2=0x7fe13c1a88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:34.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.991+0000 7fe143800640 1 --2- 172.21.15.42:0/4053624708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe13c108f90 0x7fe13c1a88e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe13000e9f0 tx=0x7fe13000eeb0 comp rx=0 tx=0).stop 2024-08-26T00:05:34.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.991+0000 7fe143800640 1 -- 172.21.15.42:0/4053624708 shutdown_connections 2024-08-26T00:05:34.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.991+0000 7fe143800640 1 --2- 172.21.15.42:0/4053624708 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe1240a2c80 0x7fe1240a5140 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:34.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.991+0000 7fe143800640 1 --2- 172.21.15.42:0/4053624708 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe13c114850 0x7fe13c1a2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:34.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.991+0000 7fe143800640 1 --2- 172.21.15.42:0/4053624708 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe13c1098b0 0x7fe13c1a8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:34.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.991+0000 7fe143800640 1 --2- 172.21.15.42:0/4053624708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe13c108f90 0x7fe13c1a88e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:34.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.991+0000 7fe143800640 1 -- 172.21.15.42:0/4053624708 >> 172.21.15.42:0/4053624708 conn(0x7fe13c06dee0 msgr2=0x7fe13c10a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:34.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.992+0000 7fe143800640 1 -- 172.21.15.42:0/4053624708 shutdown_connections 2024-08-26T00:05:34.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:33.992+0000 7fe143800640 1 -- 172.21.15.42:0/4053624708 wait complete. 2024-08-26T00:05:34.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:33 smithi181 ceph-mon[22102]: pgmap v430: 97 pgs: 97 active+clean; 420 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 14 MiB/s wr, 810 op/s 2024-08-26T00:05:34.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:33 smithi043 ceph-mon[22091]: pgmap v430: 97 pgs: 97 active+clean; 420 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 14 MiB/s wr, 810 op/s 2024-08-26T00:05:36.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:35 smithi042 ceph-mon[17225]: pgmap v431: 97 pgs: 97 active+clean; 419 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 10 MiB/s wr, 629 op/s 2024-08-26T00:05:36.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:35 smithi181 ceph-mon[22102]: pgmap v431: 97 pgs: 97 active+clean; 419 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 10 MiB/s wr, 629 op/s 2024-08-26T00:05:36.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:35 smithi043 ceph-mon[22091]: pgmap v431: 97 pgs: 97 active+clean; 419 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 10 MiB/s wr, 629 op/s 2024-08-26T00:05:36.784 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-26T00:05:36.784 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-26T00:05:38.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:37 smithi042 ceph-mon[17225]: pgmap v432: 97 pgs: 97 active+clean; 419 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.9 MiB/s wr, 508 op/s 2024-08-26T00:05:38.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:37 smithi181 ceph-mon[22102]: pgmap v432: 97 pgs: 97 active+clean; 419 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.9 MiB/s wr, 508 op/s 2024-08-26T00:05:38.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:37 smithi043 ceph-mon[22091]: pgmap v432: 97 pgs: 97 active+clean; 419 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.9 MiB/s wr, 508 op/s 2024-08-26T00:05:40.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:39 smithi181 ceph-mon[22102]: pgmap v433: 97 pgs: 97 active+clean; 431 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.1 MiB/s wr, 311 op/s 2024-08-26T00:05:40.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:39 smithi043 ceph-mon[22091]: pgmap v433: 97 pgs: 97 active+clean; 431 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.1 MiB/s wr, 311 op/s 2024-08-26T00:05:40.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:39 smithi042 ceph-mon[17225]: pgmap v433: 97 pgs: 97 active+clean; 431 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.1 MiB/s wr, 311 op/s 2024-08-26T00:05:41.652 INFO:tasks.workunit.client.0.smithi042.stdout: 144 653840 1562 421695 1486 272521 1767 2024-08-26T00:05:42.128 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:41 smithi042 ceph-mon[17225]: pgmap v434: 97 pgs: 97 active+clean; 436 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 148 op/s 2024-08-26T00:05:42.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:41 smithi043 ceph-mon[22091]: pgmap v434: 97 pgs: 97 active+clean; 436 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 148 op/s 2024-08-26T00:05:42.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:41 smithi181 ceph-mon[22102]: pgmap v434: 97 pgs: 97 active+clean; 436 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 148 op/s 2024-08-26T00:05:43.884 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:43 smithi042 ceph-mon[17225]: pgmap v435: 97 pgs: 97 active+clean; 443 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.6 MiB/s wr, 178 op/s 2024-08-26T00:05:44.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:43 smithi043 ceph-mon[22091]: pgmap v435: 97 pgs: 97 active+clean; 443 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.6 MiB/s wr, 178 op/s 2024-08-26T00:05:44.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:43 smithi181 ceph-mon[22102]: pgmap v435: 97 pgs: 97 active+clean; 443 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.6 MiB/s wr, 178 op/s 2024-08-26T00:05:45.580 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:05:46.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:45 smithi043 ceph-mon[22091]: pgmap v436: 97 pgs: 97 active+clean; 446 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 167 op/s 2024-08-26T00:05:46.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:45 smithi042 ceph-mon[17225]: pgmap v436: 97 pgs: 97 active+clean; 446 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 167 op/s 2024-08-26T00:05:46.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:45 smithi181 ceph-mon[22102]: pgmap v436: 97 pgs: 97 active+clean; 446 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 167 op/s 2024-08-26T00:05:47.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.660+0000 7f6842800640 1 -- 172.21.15.42:0/4075257094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f683c107910 msgr2=0x7f683c107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:47.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.662+0000 7f6842800640 1 --2- 172.21.15.42:0/4075257094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f683c107910 0x7f683c107cf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f682c009890 tx=0x7f682c02a3b0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.663+0000 7f6842800640 1 -- 172.21.15.42:0/4075257094 shutdown_connections 2024-08-26T00:05:47.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.663+0000 7f6842800640 1 --2- 172.21.15.42:0/4075257094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f683c1022b0 0x7f683c10e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.663+0000 7f6842800640 1 --2- 172.21.15.42:0/4075257094 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f683c101910 0x7f683c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.663+0000 7f6842800640 1 --2- 172.21.15.42:0/4075257094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f683c107910 0x7f683c107cf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.663+0000 7f6842800640 1 -- 172.21.15.42:0/4075257094 >> 172.21.15.42:0/4075257094 conn(0x7f683c0fd650 msgr2=0x7f683c0ffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:47.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.665+0000 7f6842800640 1 -- 172.21.15.42:0/4075257094 shutdown_connections 2024-08-26T00:05:47.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.665+0000 7f6842800640 1 -- 172.21.15.42:0/4075257094 wait complete. 2024-08-26T00:05:47.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.676+0000 7f6842800640 1 Processor -- start 2024-08-26T00:05:47.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.676+0000 7f6842800640 1 -- start start 2024-08-26T00:05:47.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.680+0000 7f6842800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f683c101910 0x7f683c10e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:47.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.680+0000 7f6842800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f683c1022b0 0x7f683c10b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:47.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.684+0000 7f683b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f683c101910 0x7f683c10e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:47.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.684+0000 7f683b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f683c101910 0x7f683c10e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:36816/0 (socket says 172.21.15.42:36816) 2024-08-26T00:05:47.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.687+0000 7f6842800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f683c107910 0x7f683c10bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:47.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.687+0000 7f683aa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f683c1022b0 0x7f683c10b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:47.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.687+0000 7f683aa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f683c1022b0 0x7f683c10b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:46168/0 (socket says 172.21.15.42:46168) 2024-08-26T00:05:47.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.687+0000 7f683aa00640 1 -- 172.21.15.42:0/2556469810 learned_addr learned my addr 172.21.15.42:0/2556469810 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:47.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.687+0000 7f6842800640 1 -- 172.21.15.42:0/2556469810 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f683c113f60 con 0x7f683c107910 2024-08-26T00:05:47.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.687+0000 7f6842800640 1 -- 172.21.15.42:0/2556469810 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f683c113de0 con 0x7f683c101910 2024-08-26T00:05:47.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.687+0000 7f6842800640 1 -- 172.21.15.42:0/2556469810 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f683c1140e0 con 0x7f683c1022b0 2024-08-26T00:05:47.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.688+0000 7f683b400640 1 -- 172.21.15.42:0/2556469810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f683c1022b0 msgr2=0x7f683c10b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:47.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.688+0000 7f683b400640 1 --2- 172.21.15.42:0/2556469810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f683c1022b0 0x7f683c10b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.688+0000 7f683b400640 1 -- 172.21.15.42:0/2556469810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f683c107910 msgr2=0x7f683c10bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:47.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.688+0000 7f683b400640 1 --2- 172.21.15.42:0/2556469810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f683c107910 0x7f683c10bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.689+0000 7f683b400640 1 -- 172.21.15.42:0/2556469810 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683c10c530 con 0x7f683c101910 2024-08-26T00:05:47.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.689+0000 7f683b400640 1 --2- 172.21.15.42:0/2556469810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f683c101910 0x7f683c10e680 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f682c000c00 tx=0x7f682c033d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:47.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.690+0000 7f6833e00640 1 -- 172.21.15.42:0/2556469810 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c03f030 con 0x7f683c101910 2024-08-26T00:05:47.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.690+0000 7f6833e00640 1 -- 172.21.15.42:0/2556469810 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f682c0304f0 con 0x7f683c101910 2024-08-26T00:05:47.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.690+0000 7f6842800640 1 -- 172.21.15.42:0/2556469810 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f683c1aad00 con 0x7f683c101910 2024-08-26T00:05:47.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.690+0000 7f6842800640 1 -- 172.21.15.42:0/2556469810 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f683c1ab1b0 con 0x7f683c101910 2024-08-26T00:05:47.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.691+0000 7f6833e00640 1 -- 172.21.15.42:0/2556469810 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c037040 con 0x7f683c101910 2024-08-26T00:05:47.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.705+0000 7f684527a740 1 Processor -- start 2024-08-26T00:05:47.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.706+0000 7f6833e00640 1 -- 172.21.15.42:0/2556469810 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f682c042070 con 0x7f683c101910 2024-08-26T00:05:47.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.706+0000 7f684527a740 1 -- start start 2024-08-26T00:05:47.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.706+0000 7f684527a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb60d30 0x55666cb61110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:47.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.706+0000 7f684527a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55666cb61650 0x55666cb6b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:47.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.706+0000 7f684527a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55666cb6bf10 0x55666cb6e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:47.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.706+0000 7f684527a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55666cac7e30 con 0x55666cb6bf10 2024-08-26T00:05:47.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.706+0000 7f684527a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55666ca5f3c0 con 0x55666cb61650 2024-08-26T00:05:47.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.706+0000 7f684527a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55666cac3df0 con 0x55666cb60d30 2024-08-26T00:05:47.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.707+0000 7f683be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb60d30 0x55666cb61110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:47.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.707+0000 7f683be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb60d30 0x55666cb61110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:46182/0 (socket says 172.21.15.42:46182) 2024-08-26T00:05:47.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.707+0000 7f683be00640 1 -- 172.21.15.42:0/3496499571 learned_addr learned my addr 172.21.15.42:0/3496499571 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:47.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.707+0000 7f683be00640 1 -- 172.21.15.42:0/3496499571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55666cb61650 msgr2=0x55666cb6b9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:05:47.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.707+0000 7f683be00640 1 --2- 172.21.15.42:0/3496499571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55666cb61650 0x55666cb6b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.707+0000 7f683be00640 1 -- 172.21.15.42:0/3496499571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55666cb6bf10 msgr2=0x55666cb6e300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:05:47.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.707+0000 7f683be00640 1 --2- 172.21.15.42:0/3496499571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55666cb6bf10 0x55666cb6e300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.707+0000 7f683be00640 1 -- 172.21.15.42:0/3496499571 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55666c8396a0 con 0x55666cb60d30 2024-08-26T00:05:47.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.711+0000 7f683be00640 1 --2- 172.21.15.42:0/3496499571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb60d30 0x55666cb61110 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6834009f00 tx=0x7f683400e7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93e67137ac8e83cb server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:47.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.712+0000 7f6830c00640 1 -- 172.21.15.42:0/3496499571 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f683401b070 con 0x55666cb60d30 2024-08-26T00:05:47.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.713+0000 7f6833e00640 1 --2- 172.21.15.42:0/2556469810 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f68200a2d10 0x7f68200a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:47.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.713+0000 7f6830c00640 1 -- 172.21.15.42:0/3496499571 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f683400cc60 con 0x55666cb60d30 2024-08-26T00:05:47.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.713+0000 7f6830c00640 1 -- 172.21.15.42:0/3496499571 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f683400b360 con 0x55666cb60d30 2024-08-26T00:05:47.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.714+0000 7f6833e00640 1 -- 172.21.15.42:0/2556469810 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f682c0ee5a0 con 0x7f683c101910 2024-08-26T00:05:47.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.714+0000 7f683b400640 1 --2- 172.21.15.42:0/2556469810 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f68200a2d10 0x7f68200a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:47.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.715+0000 7f684527a740 1 -- 172.21.15.42:0/3496499571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb60d30 msgr2=0x55666cb61110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:47.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.715+0000 7f684527a740 1 --2- 172.21.15.42:0/3496499571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb60d30 0x55666cb61110 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6834009f00 tx=0x7f683400e7c0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.716+0000 7f684527a740 1 -- 172.21.15.42:0/3496499571 shutdown_connections 2024-08-26T00:05:47.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.716+0000 7f684527a740 1 --2- 172.21.15.42:0/3496499571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55666cb6bf10 0x55666cb6e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.716+0000 7f684527a740 1 --2- 172.21.15.42:0/3496499571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55666cb61650 0x55666cb6b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.716+0000 7f684527a740 1 --2- 172.21.15.42:0/3496499571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb60d30 0x55666cb61110 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.716+0000 7f684527a740 1 -- 172.21.15.42:0/3496499571 >> 172.21.15.42:0/3496499571 conn(0x55666cb5d2c0 msgr2=0x55666cb5d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:47.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.720+0000 7f684527a740 1 -- 172.21.15.42:0/3496499571 shutdown_connections 2024-08-26T00:05:47.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.721+0000 7f684527a740 1 -- 172.21.15.42:0/3496499571 wait complete. 2024-08-26T00:05:47.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.722+0000 7f683b400640 1 --2- 172.21.15.42:0/2556469810 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f68200a2d10 0x7f68200a51d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f682c0b77d0 tx=0x7f682c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:47.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.723+0000 7f684527a740 1 -- start start 2024-08-26T00:05:47.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.723+0000 7f684527a740 1 Processor -- start 2024-08-26T00:05:47.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.724+0000 7f684527a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55666cb60d30 0x55666cb68e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:47.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.725+0000 7f684527a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb61650 0x55666cb69340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:47.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.725+0000 7f683be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55666cb60d30 0x55666cb68e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:47.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.725+0000 7f683be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55666cb60d30 0x55666cb68e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:36828/0 (socket says 172.21.15.42:36828) 2024-08-26T00:05:47.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.727+0000 7f683be00640 1 -- 172.21.15.42:0/1983063455 learned_addr learned my addr 172.21.15.42:0/1983063455 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:47.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.727+0000 7f684527a740 1 --2- 172.21.15.42:0/1983063455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55666cb6bf10 0x55666cb69880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:47.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.727+0000 7f683aa00640 1 --2- 172.21.15.42:0/1983063455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb61650 0x55666cb69340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:47.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.728+0000 7f684527a740 1 -- 172.21.15.42:0/1983063455 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55666cb7faf0 con 0x55666cb6bf10 2024-08-26T00:05:47.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.728+0000 7f684527a740 1 -- 172.21.15.42:0/1983063455 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55666ca82c30 con 0x55666cb60d30 2024-08-26T00:05:47.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.728+0000 7f684527a740 1 -- 172.21.15.42:0/1983063455 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55666cb7fc70 con 0x55666cb61650 2024-08-26T00:05:47.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.729+0000 7f684527a740 10 client.0 _ll_register_callbacks cb 0x55666c7d6ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:05:47.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.729+0000 7f683be00640 1 --2- 172.21.15.42:0/1983063455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55666cb6bf10 0x55666cb69880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:47.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.730+0000 7f683aa00640 1 -- 172.21.15.42:0/1983063455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55666cb60d30 msgr2=0x55666cb68e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:47.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.730+0000 7f683aa00640 1 --2- 172.21.15.42:0/1983063455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55666cb60d30 0x55666cb68e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.730+0000 7f683aa00640 1 -- 172.21.15.42:0/1983063455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55666cb6bf10 msgr2=0x55666cb69880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:47.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.730+0000 7f683aa00640 1 --2- 172.21.15.42:0/1983063455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55666cb6bf10 0x55666cb69880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.730+0000 7f683aa00640 1 -- 172.21.15.42:0/1983063455 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55666ca8edd0 con 0x55666cb61650 2024-08-26T00:05:47.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.731+0000 7f683aa00640 1 --2- 172.21.15.42:0/1983063455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb61650 0x55666cb69340 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55666cb5e640 tx=0x7f682800eae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d078a29ffe2300a server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:47.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.734+0000 7f6825600640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:05:47.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.735+0000 7f6825600640 1 -- 172.21.15.42:0/1983063455 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828004230 con 0x55666cb61650 2024-08-26T00:05:47.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.735+0000 7f6825600640 1 -- 172.21.15.42:0/1983063455 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f68280043d0 con 0x55666cb61650 2024-08-26T00:05:47.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.737+0000 7f684527a740 1 -- 172.21.15.42:0/1983063455 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f683400cc60 con 0x55666cb61650 2024-08-26T00:05:47.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.737+0000 7f6825600640 1 -- 172.21.15.42:0/1983063455 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f682801f050 con 0x55666cb61650 2024-08-26T00:05:47.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.738+0000 7f684527a740 10 client.25507 fetch_fsmap learned FSMap version 27 2024-08-26T00:05:47.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.738+0000 7f684527a740 1 -- 172.21.15.42:0/1983063455 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55666cb8b7e0 con 0x55666cb61650 2024-08-26T00:05:47.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.743+0000 7f6825600640 1 -- 172.21.15.42:0/1983063455 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f683400cc60 con 0x55666cb61650 2024-08-26T00:05:47.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.752+0000 7f6825600640 1 -- 172.21.15.42:0/1983063455 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f682800c760 con 0x55666cb61650 2024-08-26T00:05:47.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.753+0000 7f684527a740 10 client.25507 fetch_fsmap finished waiting for FSMap version 27 2024-08-26T00:05:47.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.753+0000 7f684527a740 10 client.25507 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:05:47.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.753+0000 7f684527a740 20 client.25507 populate_metadata read hostname 'smithi042' 2024-08-26T00:05:47.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.753+0000 7f684527a740 1 --2- 172.21.15.42:0/1983063455 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55666cb8ccf0 0x55666cb8f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:47.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.753+0000 7f684527a740 4 client.25507 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:05:47.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.753+0000 7f684527a740 1 -- 172.21.15.42:0/1983063455 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55666cad53a0 con 0x55666cb8ccf0 2024-08-26T00:05:47.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.756+0000 7f683be00640 1 --2- 172.21.15.42:0/1983063455 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55666cb8ccf0 0x55666cb8f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:47.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.759+0000 7f683be00640 1 --2- 172.21.15.42:0/1983063455 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55666cb8ccf0 0x55666cb8f0e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b973cbe85cd3b620 server_cookie=88f52272877ee4a0 in_seq=0 out_seq=0 2024-08-26T00:05:47.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.759+0000 7f6825600640 10 client.25507 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:05:47.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.761+0000 7f6825600640 1 -- 172.21.15.42:0/1983063455 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55666cad53a0 con 0x55666cb8ccf0 2024-08-26T00:05:47.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.761+0000 7f6825600640 10 client.25507 handle_command_reply: tid=0 2024-08-26T00:05:47.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.761+0000 7f684527a740 1 client.25507 shutdown 2024-08-26T00:05:47.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.762+0000 7f684527a740 1 -- 172.21.15.42:0/1983063455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb61650 msgr2=0x55666cb69340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:47.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.762+0000 7f684527a740 1 --2- 172.21.15.42:0/1983063455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb61650 0x55666cb69340 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55666cb5e640 tx=0x7f682800eae0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.762+0000 7f684527a740 1 -- 172.21.15.42:0/1983063455 shutdown_connections 2024-08-26T00:05:47.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.762+0000 7f684527a740 1 --2- 172.21.15.42:0/1983063455 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55666cb8ccf0 0x55666cb8f0e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.763+0000 7f6825600640 0 client.25507 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:05:47.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.763+0000 7f684527a740 1 --2- 172.21.15.42:0/1983063455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55666cb6bf10 0x55666cb69880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.763+0000 7f684527a740 1 --2- 172.21.15.42:0/1983063455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb61650 0x55666cb69340 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.763+0000 7f684527a740 1 --2- 172.21.15.42:0/1983063455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55666cb60d30 0x55666cb68e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.763+0000 7f684527a740 1 -- 172.21.15.42:0/1983063455 >> 172.21.15.42:0/1983063455 conn(0x55666cb5d2c0 msgr2=0x55666cb5c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:47.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.767+0000 7f684527a740 1 -- 172.21.15.42:0/1983063455 shutdown_connections 2024-08-26T00:05:47.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.767+0000 7f684527a740 1 -- 172.21.15.42:0/1983063455 wait complete. 2024-08-26T00:05:47.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.768+0000 7f684527a740 20 client.25507 trim_cache size 0 max 16384 2024-08-26T00:05:47.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.814+0000 7f684527a740 1 Processor -- start 2024-08-26T00:05:47.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.814+0000 7f684527a740 1 -- start start 2024-08-26T00:05:47.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.815+0000 7f684527a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb60d30 0x55666cb63790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:47.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.815+0000 7f684527a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55666cb61650 0x55666cb696d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:47.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.815+0000 7f683be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb60d30 0x55666cb63790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:47.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.816+0000 7f683be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb60d30 0x55666cb63790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:46208/0 (socket says 172.21.15.42:46208) 2024-08-26T00:05:47.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.816+0000 7f683be00640 1 -- 172.21.15.42:0/1249094205 learned_addr learned my addr 172.21.15.42:0/1249094205 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:47.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.816+0000 7f684527a740 1 --2- 172.21.15.42:0/1249094205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55666cb6bf10 0x55666cb949f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:47.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.816+0000 7f684527a740 1 -- 172.21.15.42:0/1249094205 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f681c010dd0 con 0x55666cb6bf10 2024-08-26T00:05:47.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.816+0000 7f684527a740 1 -- 172.21.15.42:0/1249094205 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f681c00e640 con 0x55666cb61650 2024-08-26T00:05:47.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.816+0000 7f684527a740 1 -- 172.21.15.42:0/1249094205 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f681c00c470 con 0x55666cb60d30 2024-08-26T00:05:47.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.817+0000 7f683be00640 1 -- 172.21.15.42:0/1249094205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55666cb61650 msgr2=0x55666cb696d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-26T00:05:47.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.817+0000 7f683be00640 1 --2- 172.21.15.42:0/1249094205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55666cb61650 0x55666cb696d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.817+0000 7f683be00640 1 -- 172.21.15.42:0/1249094205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55666cb6bf10 msgr2=0x55666cb949f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:47.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.817+0000 7f683be00640 1 --2- 172.21.15.42:0/1249094205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55666cb6bf10 0x55666cb949f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.817+0000 7f683be00640 1 -- 172.21.15.42:0/1249094205 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55666cb6b6d0 con 0x55666cb60d30 2024-08-26T00:05:47.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.820+0000 7f683be00640 1 --2- 172.21.15.42:0/1249094205 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb60d30 0x55666cb63790 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6834009f00 tx=0x7f6834016730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc44f8c1d73e9019 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:47.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.825+0000 7f6827e00640 1 -- 172.21.15.42:0/1249094205 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f683401b040 con 0x55666cb60d30 2024-08-26T00:05:47.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.825+0000 7f6827e00640 1 -- 172.21.15.42:0/1249094205 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6834003e50 con 0x55666cb60d30 2024-08-26T00:05:47.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.825+0000 7f6827e00640 1 -- 172.21.15.42:0/1249094205 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f683400cbb0 con 0x55666cb60d30 2024-08-26T00:05:47.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.826+0000 7f684527a740 1 -- 172.21.15.42:0/1249094205 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb60d30 msgr2=0x55666cb63790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:47.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.826+0000 7f684527a740 1 --2- 172.21.15.42:0/1249094205 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb60d30 0x55666cb63790 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6834009f00 tx=0x7f6834016730 comp rx=0 tx=0).stop 2024-08-26T00:05:47.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.828+0000 7f684527a740 1 -- 172.21.15.42:0/1249094205 shutdown_connections 2024-08-26T00:05:47.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.829+0000 7f684527a740 1 --2- 172.21.15.42:0/1249094205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55666cb6bf10 0x55666cb949f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.829+0000 7f684527a740 1 --2- 172.21.15.42:0/1249094205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55666cb61650 0x55666cb696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.829+0000 7f684527a740 1 --2- 172.21.15.42:0/1249094205 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb60d30 0x55666cb63790 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.829+0000 7f684527a740 1 -- 172.21.15.42:0/1249094205 >> 172.21.15.42:0/1249094205 conn(0x55666cb5d2c0 msgr2=0x55666cb6ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:47.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.829+0000 7f684527a740 1 -- 172.21.15.42:0/1249094205 shutdown_connections 2024-08-26T00:05:47.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.829+0000 7f684527a740 1 -- 172.21.15.42:0/1249094205 wait complete. 2024-08-26T00:05:47.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.831+0000 7f684527a740 1 -- start start 2024-08-26T00:05:47.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.831+0000 7f684527a740 1 Processor -- start 2024-08-26T00:05:47.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.832+0000 7f684527a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55666cb60d30 0x55666cb84f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:47.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.832+0000 7f684527a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55666cb61650 0x55666cb85490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:47.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.833+0000 7f683be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55666cb60d30 0x55666cb84f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:47.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.833+0000 7f683be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55666cb60d30 0x55666cb84f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:36852/0 (socket says 172.21.15.42:36852) 2024-08-26T00:05:47.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.833+0000 7f683be00640 1 -- 172.21.15.42:0/1876667087 learned_addr learned my addr 172.21.15.42:0/1876667087 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:47.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.833+0000 7f684527a740 1 --2- 172.21.15.42:0/1876667087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb6bf10 0x55666cb81f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:47.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.833+0000 7f684527a740 1 -- 172.21.15.42:0/1876667087 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f681c00cb00 con 0x55666cb61650 2024-08-26T00:05:47.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.833+0000 7f684527a740 1 -- 172.21.15.42:0/1876667087 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f681c00df70 con 0x55666cb60d30 2024-08-26T00:05:47.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.834+0000 7f684527a740 1 -- 172.21.15.42:0/1876667087 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f681c00d1d0 con 0x55666cb6bf10 2024-08-26T00:05:47.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.834+0000 7f684527a740 10 client.0 _ll_register_callbacks cb 0x7f6828008310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:05:47.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.834+0000 7f683be00640 1 -- 172.21.15.42:0/1876667087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb6bf10 msgr2=0x55666cb81f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:47.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.835+0000 7f683be00640 1 --2- 172.21.15.42:0/1876667087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb6bf10 0x55666cb81f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.835+0000 7f683be00640 1 -- 172.21.15.42:0/1876667087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55666cb61650 msgr2=0x55666cb85490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:47.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.835+0000 7f683be00640 1 --2- 172.21.15.42:0/1876667087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55666cb61650 0x55666cb85490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.835+0000 7f683be00640 1 -- 172.21.15.42:0/1876667087 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55666cb85b80 con 0x55666cb60d30 2024-08-26T00:05:47.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.837+0000 7f6825600640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:05:47.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.837+0000 7f683be00640 1 --2- 172.21.15.42:0/1876667087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55666cb60d30 0x55666cb84f50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6834011040 tx=0x7f68340096d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d71fd83d7adf676e server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:47.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.838+0000 7f6825600640 1 -- 172.21.15.42:0/1876667087 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6834031020 con 0x55666cb60d30 2024-08-26T00:05:47.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.838+0000 7f6825600640 1 -- 172.21.15.42:0/1876667087 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f6834003b70 con 0x55666cb60d30 2024-08-26T00:05:47.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.839+0000 7f684527a740 1 -- 172.21.15.42:0/1876667087 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6834003e50 con 0x55666cb60d30 2024-08-26T00:05:47.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.840+0000 7f6825600640 1 -- 172.21.15.42:0/1876667087 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f683401b040 con 0x55666cb60d30 2024-08-26T00:05:47.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.844+0000 7f684527a740 10 client.25517 fetch_fsmap learned FSMap version 27 2024-08-26T00:05:47.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.844+0000 7f684527a740 1 -- 172.21.15.42:0/1876667087 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55666cbf8010 con 0x55666cb60d30 2024-08-26T00:05:47.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.844+0000 7f6825600640 1 -- 172.21.15.42:0/1876667087 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6834003e50 con 0x55666cb60d30 2024-08-26T00:05:47.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.846+0000 7f6825600640 1 -- 172.21.15.42:0/1876667087 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f683400b040 con 0x55666cb60d30 2024-08-26T00:05:47.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.846+0000 7f684527a740 10 client.25517 fetch_fsmap finished waiting for FSMap version 27 2024-08-26T00:05:47.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.846+0000 7f684527a740 10 client.25517 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:05:47.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.846+0000 7f684527a740 20 client.25517 populate_metadata read hostname 'smithi042' 2024-08-26T00:05:47.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.846+0000 7f684527a740 1 --2- 172.21.15.42:0/1876667087 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55666cbf8380 0x55666cbfa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:47.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.846+0000 7f684527a740 4 client.25517 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-26T00:05:47.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.846+0000 7f684527a740 1 -- 172.21.15.42:0/1876667087 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55666cacf8b0 con 0x55666cbf8380 2024-08-26T00:05:47.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.857+0000 7f683aa00640 1 --2- 172.21.15.42:0/1876667087 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55666cbf8380 0x55666cbfa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:47.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.860+0000 7f6825600640 10 client.25517 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:05:47.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.860+0000 7f683aa00640 1 --2- 172.21.15.42:0/1876667087 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55666cbf8380 0x55666cbfa7a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f133d3fd3e9e337 server_cookie=41ab4669a08ba0f4 in_seq=0 out_seq=0 2024-08-26T00:05:47.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.862+0000 7f6825600640 1 -- 172.21.15.42:0/1876667087 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55666cacf8b0 con 0x55666cbf8380 2024-08-26T00:05:47.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.862+0000 7f6825600640 10 client.25517 handle_command_reply: tid=0 2024-08-26T00:05:47.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.864+0000 7f684527a740 1 client.25517 shutdown 2024-08-26T00:05:47.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.868+0000 7f684527a740 1 -- 172.21.15.42:0/1876667087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55666cb60d30 msgr2=0x55666cb84f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:47.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.868+0000 7f684527a740 1 --2- 172.21.15.42:0/1876667087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55666cb60d30 0x55666cb84f50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6834011040 tx=0x7f68340096d0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.868+0000 7f684527a740 1 -- 172.21.15.42:0/1876667087 shutdown_connections 2024-08-26T00:05:47.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.868+0000 7f684527a740 1 --2- 172.21.15.42:0/1876667087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55666cb6bf10 0x55666cb81f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.868+0000 7f684527a740 1 --2- 172.21.15.42:0/1876667087 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55666cbf8380 0x55666cbfa7a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.868+0000 7f6825600640 0 client.25517 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:05:47.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.868+0000 7f684527a740 1 --2- 172.21.15.42:0/1876667087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55666cb61650 0x55666cb85490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.868+0000 7f684527a740 1 --2- 172.21.15.42:0/1876667087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55666cb60d30 0x55666cb84f50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.868+0000 7f684527a740 1 -- 172.21.15.42:0/1876667087 >> 172.21.15.42:0/1876667087 conn(0x55666cb5d2c0 msgr2=0x55666cb5bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:47.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.869+0000 7f684527a740 1 -- 172.21.15.42:0/1876667087 shutdown_connections 2024-08-26T00:05:47.875 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:05:47.875 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-08-26T00:05:47.876 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "81e22388-86d2-4474-8f07-a2d1ce4db7ce", 2024-08-26T00:05:47.876 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-08-26T00:05:47.876 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:05:47.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.869+0000 7f684527a740 1 -- 172.21.15.42:0/1876667087 wait complete. 2024-08-26T00:05:47.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.870+0000 7f684527a740 20 client.25517 trim_cache size 0 max 16384 2024-08-26T00:05:47.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.871+0000 7f6842800640 1 -- 172.21.15.42:0/2556469810 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f68200a2d10 msgr2=0x7f68200a51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:47.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.871+0000 7f6842800640 1 --2- 172.21.15.42:0/2556469810 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f68200a2d10 0x7f68200a51d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f682c0b77d0 tx=0x7f682c005f90 comp rx=0 tx=0).stop 2024-08-26T00:05:47.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.871+0000 7f6842800640 1 -- 172.21.15.42:0/2556469810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f683c101910 msgr2=0x7f683c10e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:47.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.871+0000 7f6842800640 1 --2- 172.21.15.42:0/2556469810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f683c101910 0x7f683c10e680 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f682c000c00 tx=0x7f682c033d10 comp rx=0 tx=0).stop 2024-08-26T00:05:47.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.880+0000 7f6842800640 1 -- 172.21.15.42:0/2556469810 shutdown_connections 2024-08-26T00:05:47.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.880+0000 7f6842800640 1 --2- 172.21.15.42:0/2556469810 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f68200a2d10 0x7f68200a51d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.880+0000 7f6842800640 1 --2- 172.21.15.42:0/2556469810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f683c107910 0x7f683c10bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.880+0000 7f6842800640 1 --2- 172.21.15.42:0/2556469810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f683c1022b0 0x7f683c10b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.880+0000 7f6842800640 1 --2- 172.21.15.42:0/2556469810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f683c101910 0x7f683c10e680 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:47.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.880+0000 7f6842800640 1 -- 172.21.15.42:0/2556469810 >> 172.21.15.42:0/2556469810 conn(0x7f683c0fd650 msgr2=0x7f683c0fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:47.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.884+0000 7f6842800640 1 -- 172.21.15.42:0/2556469810 shutdown_connections 2024-08-26T00:05:47.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:47.884+0000 7f6842800640 1 -- 172.21.15.42:0/2556469810 wait complete. 2024-08-26T00:05:48.041 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:47 smithi042 ceph-mon[17225]: pgmap v437: 97 pgs: 97 active+clean; 458 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.9 MiB/s wr, 212 op/s 2024-08-26T00:05:48.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:47 smithi043 ceph-mon[22091]: pgmap v437: 97 pgs: 97 active+clean; 458 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.9 MiB/s wr, 212 op/s 2024-08-26T00:05:48.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:47 smithi181 ceph-mon[22102]: pgmap v437: 97 pgs: 97 active+clean; 458 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.9 MiB/s wr, 212 op/s 2024-08-26T00:05:48.904 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:48 smithi042 ceph-mon[17225]: scrub queued for path: / 2024-08-26T00:05:48.904 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:48 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:05:48.904 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:48 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:05:48.904 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:48 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:05:48.904 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:48 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:05:48.905 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:48 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:05:48.905 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:48 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:05:49.185 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:48 smithi181 ceph-mon[22102]: scrub queued for path: / 2024-08-26T00:05:49.185 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:48 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:05:49.185 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:48 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:05:49.185 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:48 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:05:49.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:48 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:05:49.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:48 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:05:49.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:48 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:05:49.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:48 smithi043 ceph-mon[22091]: scrub queued for path: / 2024-08-26T00:05:49.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:48 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:05:49.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:48 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:05:49.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:48 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:05:49.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:48 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:05:49.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:48 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:05:49.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:48 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:05:50.044 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:49 smithi042 ceph-mon[17225]: pgmap v438: 97 pgs: 97 active+clean; 469 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.9 MiB/s wr, 267 op/s 2024-08-26T00:05:50.044 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:49 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:05:50.138 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-26T00:05:50.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:49 smithi043 ceph-mon[22091]: pgmap v438: 97 pgs: 97 active+clean; 469 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.9 MiB/s wr, 267 op/s 2024-08-26T00:05:50.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:49 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:05:50.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:49 smithi181 ceph-mon[22102]: pgmap v438: 97 pgs: 97 active+clean; 469 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.9 MiB/s wr, 267 op/s 2024-08-26T00:05:50.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:49 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:05:51.652 INFO:tasks.workunit.client.0.smithi042.stdout: 160 486127 834 324404 857 187565 940 2024-08-26T00:05:52.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:51 smithi042 ceph-mon[17225]: pgmap v439: 97 pgs: 97 active+clean; 507 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.3 MiB/s wr, 444 op/s 2024-08-26T00:05:52.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:51 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:05:52.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:51 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:05:52.057 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:05:52.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:51 smithi043 ceph-mon[22091]: pgmap v439: 97 pgs: 97 active+clean; 507 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.3 MiB/s wr, 444 op/s 2024-08-26T00:05:52.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:51 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:05:52.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:51 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:05:52.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:51 smithi181 ceph-mon[22102]: pgmap v439: 97 pgs: 97 active+clean; 507 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.3 MiB/s wr, 444 op/s 2024-08-26T00:05:52.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:51 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:05:52.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:51 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:05:52.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.776+0000 7f223b200640 1 -- 172.21.15.42:0/1051132306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f223c107760 msgr2=0x7f223c107b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:52.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.776+0000 7f223b200640 1 --2- 172.21.15.42:0/1051132306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f223c107760 0x7f223c107b40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f222c009900 tx=0x7f222c02a3f0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.776+0000 7f223b200640 1 -- 172.21.15.42:0/1051132306 shutdown_connections 2024-08-26T00:05:52.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.776+0000 7f223b200640 1 --2- 172.21.15.42:0/1051132306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f223c102100 0x7f223c10e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.776+0000 7f223b200640 1 --2- 172.21.15.42:0/1051132306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f223c101760 0x7f223c101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.776+0000 7f223b200640 1 --2- 172.21.15.42:0/1051132306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f223c107760 0x7f223c107b40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.776+0000 7f223b200640 1 -- 172.21.15.42:0/1051132306 >> 172.21.15.42:0/1051132306 conn(0x7f223c0fd4e0 msgr2=0x7f223c0ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:52.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.776+0000 7f223b200640 1 -- 172.21.15.42:0/1051132306 shutdown_connections 2024-08-26T00:05:52.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.776+0000 7f223b200640 1 -- 172.21.15.42:0/1051132306 wait complete. 2024-08-26T00:05:52.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.777+0000 7f223b200640 1 Processor -- start 2024-08-26T00:05:52.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.777+0000 7f223b200640 1 -- start start 2024-08-26T00:05:52.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.778+0000 7f223b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f223c101760 0x7f223c19a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:52.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.778+0000 7f223b200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f223c102100 0x7f223c19a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:52.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.778+0000 7f223b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f223c107760 0x7f223c19eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:52.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.778+0000 7f223b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f223c111b60 con 0x7f223c107760 2024-08-26T00:05:52.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.778+0000 7f223b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f223c1119e0 con 0x7f223c101760 2024-08-26T00:05:52.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.778+0000 7f223b200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f223c111ce0 con 0x7f223c102100 2024-08-26T00:05:52.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.778+0000 7f2239e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f223c101760 0x7f223c19a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:52.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.778+0000 7f2239e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f223c101760 0x7f223c19a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:36866/0 (socket says 172.21.15.42:36866) 2024-08-26T00:05:52.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.778+0000 7f2239e00640 1 -- 172.21.15.42:0/453347393 learned_addr learned my addr 172.21.15.42:0/453347393 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:52.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.778+0000 7f223a800640 1 --2- 172.21.15.42:0/453347393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f223c107760 0x7f223c19eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:52.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.778+0000 7f2239400640 1 --2- 172.21.15.42:0/453347393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f223c102100 0x7f223c19a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:52.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.779+0000 7f2239400640 1 -- 172.21.15.42:0/453347393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f223c101760 msgr2=0x7f223c19a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:52.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.779+0000 7f2239400640 1 --2- 172.21.15.42:0/453347393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f223c101760 0x7f223c19a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.779+0000 7f2239400640 1 -- 172.21.15.42:0/453347393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f223c107760 msgr2=0x7f223c19eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:52.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.779+0000 7f2239400640 1 --2- 172.21.15.42:0/453347393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f223c107760 0x7f223c19eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.779+0000 7f2239400640 1 -- 172.21.15.42:0/453347393 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f223c19f210 con 0x7f223c102100 2024-08-26T00:05:52.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.779+0000 7f2239400640 1 --2- 172.21.15.42:0/453347393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f223c102100 0x7f223c19a7a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f222800e9f0 tx=0x7f222800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:52.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.779+0000 7f2232a00640 1 -- 172.21.15.42:0/453347393 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222800ccc0 con 0x7f223c102100 2024-08-26T00:05:52.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.779+0000 7f223b200640 1 -- 172.21.15.42:0/453347393 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f223c19f500 con 0x7f223c102100 2024-08-26T00:05:52.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.779+0000 7f2232a00640 1 -- 172.21.15.42:0/453347393 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2228005020 con 0x7f223c102100 2024-08-26T00:05:52.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.779+0000 7f2232a00640 1 -- 172.21.15.42:0/453347393 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2228004b20 con 0x7f223c102100 2024-08-26T00:05:52.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.780+0000 7f223b200640 1 -- 172.21.15.42:0/453347393 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f223c1a6de0 con 0x7f223c102100 2024-08-26T00:05:52.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.783+0000 7f2243a38740 1 Processor -- start 2024-08-26T00:05:52.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.783+0000 7f2243a38740 1 -- start start 2024-08-26T00:05:52.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.784+0000 7f2243a38740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcf1b40 0x55baabcf1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:52.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.784+0000 7f2243a38740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55baabcf2460 0x55baabcfc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:52.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.784+0000 7f2243a38740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55baabcfcd20 0x55baabcff110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:52.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.784+0000 7f2243a38740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55baabc57fc0 con 0x55baabcf1b40 2024-08-26T00:05:52.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.784+0000 7f2243a38740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55baabbef680 con 0x55baabcfcd20 2024-08-26T00:05:52.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.784+0000 7f2243a38740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55baabc53f80 con 0x55baabcf2460 2024-08-26T00:05:52.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.784+0000 7f223a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcf1b40 0x55baabcf1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:52.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.784+0000 7f223a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcf1b40 0x55baabcf1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38818/0 (socket says 172.21.15.42:38818) 2024-08-26T00:05:52.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.784+0000 7f223a800640 1 -- 172.21.15.42:0/1255351861 learned_addr learned my addr 172.21.15.42:0/1255351861 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:52.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.785+0000 7f223a800640 1 -- 172.21.15.42:0/1255351861 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55baabcf2460 msgr2=0x55baabcfc7e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-26T00:05:52.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.785+0000 7f223a800640 1 --2- 172.21.15.42:0/1255351861 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55baabcf2460 0x55baabcfc7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.785+0000 7f223a800640 1 -- 172.21.15.42:0/1255351861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55baabcfcd20 msgr2=0x55baabcff110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:05:52.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.785+0000 7f223a800640 1 --2- 172.21.15.42:0/1255351861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55baabcfcd20 0x55baabcff110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.785+0000 7f223a800640 1 -- 172.21.15.42:0/1255351861 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baabc0b2c0 con 0x55baabcf1b40 2024-08-26T00:05:52.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.785+0000 7f2232a00640 1 -- 172.21.15.42:0/453347393 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2228004cc0 con 0x7f223c102100 2024-08-26T00:05:52.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.785+0000 7f223a800640 1 --2- 172.21.15.42:0/1255351861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcf1b40 0x55baabcf1f20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2234009f50 tx=0x7f22340118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef087de2710a0ce server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:52.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.785+0000 7f2227400640 1 -- 172.21.15.42:0/1255351861 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2234004d20 con 0x55baabcf1b40 2024-08-26T00:05:52.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.786+0000 7f2227400640 1 -- 172.21.15.42:0/1255351861 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2234004050 con 0x55baabcf1b40 2024-08-26T00:05:52.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.786+0000 7f2227400640 1 -- 172.21.15.42:0/1255351861 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2234005280 con 0x55baabcf1b40 2024-08-26T00:05:52.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.786+0000 7f2243a38740 1 -- 172.21.15.42:0/1255351861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcf1b40 msgr2=0x55baabcf1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:52.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.786+0000 7f2243a38740 1 --2- 172.21.15.42:0/1255351861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcf1b40 0x55baabcf1f20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2234009f50 tx=0x7f22340118d0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.786+0000 7f2243a38740 1 -- 172.21.15.42:0/1255351861 shutdown_connections 2024-08-26T00:05:52.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.786+0000 7f2243a38740 1 --2- 172.21.15.42:0/1255351861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55baabcfcd20 0x55baabcff110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.786+0000 7f2243a38740 1 --2- 172.21.15.42:0/1255351861 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55baabcf2460 0x55baabcfc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.786+0000 7f2243a38740 1 --2- 172.21.15.42:0/1255351861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcf1b40 0x55baabcf1f20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.786+0000 7f2243a38740 1 -- 172.21.15.42:0/1255351861 >> 172.21.15.42:0/1255351861 conn(0x55baabcee080 msgr2=0x55baabcee460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:52.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.787+0000 7f2243a38740 1 -- 172.21.15.42:0/1255351861 shutdown_connections 2024-08-26T00:05:52.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.787+0000 7f2232a00640 1 --2- 172.21.15.42:0/453347393 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f22200a2a90 0x7f22200a4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:52.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.787+0000 7f2232a00640 1 -- 172.21.15.42:0/453347393 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f22280cf070 con 0x7f223c102100 2024-08-26T00:05:52.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.787+0000 7f2243a38740 1 -- 172.21.15.42:0/1255351861 wait complete. 2024-08-26T00:05:52.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.787+0000 7f2239e00640 1 --2- 172.21.15.42:0/453347393 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f22200a2a90 0x7f22200a4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:52.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.788+0000 7f2243a38740 1 -- start start 2024-08-26T00:05:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.788+0000 7f2243a38740 1 Processor -- start 2024-08-26T00:05:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.788+0000 7f2239e00640 1 --2- 172.21.15.42:0/453347393 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f22200a2a90 0x7f22200a4f50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f222c005c40 tx=0x7f222c009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.788+0000 7f2243a38740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55baabcf1b40 0x55baabcf9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.788+0000 7f2243a38740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55baabcf2460 0x55baabcfa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.788+0000 7f2243a38740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcfcd20 0x55baabcfa640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.788+0000 7f2243a38740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55baabcff8f0 con 0x55baabcfcd20 2024-08-26T00:05:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.788+0000 7f2243a38740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55baabc12e50 con 0x55baabcf2460 2024-08-26T00:05:52.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.788+0000 7f2243a38740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55baabcffa70 con 0x55baabcf1b40 2024-08-26T00:05:52.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.788+0000 7f2243a38740 10 client.0 _ll_register_callbacks cb 0x55baabbfdf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:05:52.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.789+0000 7f2239e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55baabcf1b40 0x55baabcf9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:52.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.789+0000 7f2239e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55baabcf1b40 0x55baabcf9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:46252/0 (socket says 172.21.15.42:46252) 2024-08-26T00:05:52.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.789+0000 7f2239400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55baabcf2460 0x55baabcfa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:52.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.789+0000 7f2239e00640 1 -- 172.21.15.42:0/3957783041 learned_addr learned my addr 172.21.15.42:0/3957783041 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:52.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.789+0000 7f223a800640 1 --2- 172.21.15.42:0/3957783041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcfcd20 0x55baabcfa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:52.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.789+0000 7f2239e00640 1 -- 172.21.15.42:0/3957783041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55baabcf2460 msgr2=0x55baabcfa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:52.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.789+0000 7f2239e00640 1 --2- 172.21.15.42:0/3957783041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55baabcf2460 0x55baabcfa100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.789+0000 7f2239e00640 1 -- 172.21.15.42:0/3957783041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcfcd20 msgr2=0x55baabcfa640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:52.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.789+0000 7f2239e00640 1 --2- 172.21.15.42:0/3957783041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcfcd20 0x55baabcfa640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.789+0000 7f2239e00640 1 -- 172.21.15.42:0/3957783041 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baab9c93c0 con 0x55baabcf1b40 2024-08-26T00:05:52.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.789+0000 7f2239400640 1 --2- 172.21.15.42:0/3957783041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55baabcf2460 0x55baabcfa100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:05:52.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.789+0000 7f223a800640 1 --2- 172.21.15.42:0/3957783041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcfcd20 0x55baabcfa640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:05:52.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.790+0000 7f2239e00640 1 --2- 172.21.15.42:0/3957783041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55baabcf1b40 0x55baabcf9bc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f222c009a20 tx=0x7f222c009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a5a677a01160602 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:52.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.790+0000 7f221be00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:05:52.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.790+0000 7f221be00640 1 -- 172.21.15.42:0/3957783041 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c04c020 con 0x55baabcf1b40 2024-08-26T00:05:52.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.790+0000 7f2243a38740 1 -- 172.21.15.42:0/3957783041 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2234004050 con 0x55baabcf1b40 2024-08-26T00:05:52.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.790+0000 7f221be00640 1 -- 172.21.15.42:0/3957783041 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f222c004ad0 con 0x55baabcf1b40 2024-08-26T00:05:52.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.790+0000 7f221be00640 1 -- 172.21.15.42:0/3957783041 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f222c035050 con 0x55baabcf1b40 2024-08-26T00:05:52.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.790+0000 7f2243a38740 10 client.25519 fetch_fsmap learned FSMap version 27 2024-08-26T00:05:52.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.790+0000 7f2243a38740 1 -- 172.21.15.42:0/3957783041 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55baabd0b5d0 con 0x55baabcf1b40 2024-08-26T00:05:52.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.791+0000 7f221be00640 1 -- 172.21.15.42:0/3957783041 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2234004050 con 0x55baabcf1b40 2024-08-26T00:05:52.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.791+0000 7f221be00640 1 -- 172.21.15.42:0/3957783041 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f222c032550 con 0x55baabcf1b40 2024-08-26T00:05:52.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.791+0000 7f2243a38740 10 client.25519 fetch_fsmap finished waiting for FSMap version 27 2024-08-26T00:05:52.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.791+0000 7f2243a38740 10 client.25519 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:05:52.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.791+0000 7f2243a38740 20 client.25519 populate_metadata read hostname 'smithi042' 2024-08-26T00:05:52.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.791+0000 7f2243a38740 1 --2- 172.21.15.42:0/3957783041 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55baabd0ca30 0x55baabd0ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:52.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.791+0000 7f2243a38740 4 client.25519 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:05:52.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.791+0000 7f2243a38740 1 -- 172.21.15.42:0/3957783041 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55baabc65530 con 0x55baabd0ca30 2024-08-26T00:05:52.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.791+0000 7f2239400640 1 --2- 172.21.15.42:0/3957783041 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55baabd0ca30 0x55baabd0ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:52.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.792+0000 7f2239400640 1 --2- 172.21.15.42:0/3957783041 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55baabd0ca30 0x55baabd0ee50 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe85dafd11c4dcfe server_cookie=73e09a336dd6ac7e in_seq=0 out_seq=0 2024-08-26T00:05:52.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.792+0000 7f221be00640 10 client.25519 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:05:52.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.793+0000 7f221be00640 1 -- 172.21.15.42:0/3957783041 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55baabc65530 con 0x55baabd0ca30 2024-08-26T00:05:52.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.793+0000 7f221be00640 10 client.25519 handle_command_reply: tid=0 2024-08-26T00:05:52.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.793+0000 7f2243a38740 1 client.25519 shutdown 2024-08-26T00:05:52.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.794+0000 7f2243a38740 1 -- 172.21.15.42:0/3957783041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55baabcf1b40 msgr2=0x55baabcf9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:52.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.794+0000 7f2243a38740 1 --2- 172.21.15.42:0/3957783041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55baabcf1b40 0x55baabcf9bc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f222c009a20 tx=0x7f222c009260 comp rx=0 tx=0).stop 2024-08-26T00:05:52.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.794+0000 7f2243a38740 1 -- 172.21.15.42:0/3957783041 shutdown_connections 2024-08-26T00:05:52.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.794+0000 7f2243a38740 1 --2- 172.21.15.42:0/3957783041 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55baabd0ca30 0x55baabd0ee50 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.794+0000 7f2243a38740 1 --2- 172.21.15.42:0/3957783041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcfcd20 0x55baabcfa640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.794+0000 7f221be00640 0 client.25519 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:05:52.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.794+0000 7f2243a38740 1 --2- 172.21.15.42:0/3957783041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55baabcf2460 0x55baabcfa100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.794+0000 7f2243a38740 1 --2- 172.21.15.42:0/3957783041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55baabcf1b40 0x55baabcf9bc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.794+0000 7f2243a38740 1 -- 172.21.15.42:0/3957783041 >> 172.21.15.42:0/3957783041 conn(0x55baabcee080 msgr2=0x55baabcf3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:52.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.794+0000 7f2243a38740 1 -- 172.21.15.42:0/3957783041 shutdown_connections 2024-08-26T00:05:52.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.794+0000 7f2243a38740 1 -- 172.21.15.42:0/3957783041 wait complete. 2024-08-26T00:05:52.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.794+0000 7f2243a38740 20 client.25519 trim_cache size 0 max 16384 2024-08-26T00:05:52.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.821+0000 7f2243a38740 1 Processor -- start 2024-08-26T00:05:52.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.821+0000 7f2243a38740 1 -- start start 2024-08-26T00:05:52.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.822+0000 7f2243a38740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55baabcf1b40 0x55baabcfa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:52.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.822+0000 7f2243a38740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcf2460 0x55baabd14720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:52.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.822+0000 7f2243a38740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55baabcfcd20 0x55baabd14c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:52.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.822+0000 7f2243a38740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f223c1b1dd0 con 0x55baabcf2460 2024-08-26T00:05:52.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.822+0000 7f2243a38740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f223c1af640 con 0x55baabcf1b40 2024-08-26T00:05:52.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.822+0000 7f2243a38740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f223c1ad470 con 0x55baabcfcd20 2024-08-26T00:05:52.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.822+0000 7f2239e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55baabcf1b40 0x55baabcfa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:52.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.822+0000 7f2239400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcf2460 0x55baabd14720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:52.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.822+0000 7f2239400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcf2460 0x55baabd14720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38842/0 (socket says 172.21.15.42:38842) 2024-08-26T00:05:52.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.822+0000 7f2239400640 1 -- 172.21.15.42:0/3973751228 learned_addr learned my addr 172.21.15.42:0/3973751228 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:52.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.823+0000 7f2239400640 1 -- 172.21.15.42:0/3973751228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55baabcfcd20 msgr2=0x55baabd14c60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-26T00:05:52.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.823+0000 7f2239400640 1 --2- 172.21.15.42:0/3973751228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55baabcfcd20 0x55baabd14c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.823+0000 7f2239400640 1 -- 172.21.15.42:0/3973751228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55baabcf1b40 msgr2=0x55baabcfa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:52.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.823+0000 7f2239400640 1 --2- 172.21.15.42:0/3973751228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55baabcf1b40 0x55baabcfa440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.823+0000 7f2239400640 1 -- 172.21.15.42:0/3973751228 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baabcf2290 con 0x55baabcf2460 2024-08-26T00:05:52.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.823+0000 7f2239e00640 1 --2- 172.21.15.42:0/3973751228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55baabcf1b40 0x55baabcfa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:05:52.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.823+0000 7f2239400640 1 --2- 172.21.15.42:0/3973751228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcf2460 0x55baabd14720 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2228004fd0 tx=0x7f2228009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e0918abf6749eb server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:52.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.824+0000 7f2226a00640 1 -- 172.21.15.42:0/3973751228 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2228084e60 con 0x55baabcf2460 2024-08-26T00:05:52.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.824+0000 7f2226a00640 1 -- 172.21.15.42:0/3973751228 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22280b3070 con 0x55baabcf2460 2024-08-26T00:05:52.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.824+0000 7f2226a00640 1 -- 172.21.15.42:0/3973751228 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222801c040 con 0x55baabcf2460 2024-08-26T00:05:52.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.825+0000 7f2243a38740 1 -- 172.21.15.42:0/3973751228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcf2460 msgr2=0x55baabd14720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:52.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.825+0000 7f2243a38740 1 --2- 172.21.15.42:0/3973751228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcf2460 0x55baabd14720 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2228004fd0 tx=0x7f2228009f60 comp rx=0 tx=0).stop 2024-08-26T00:05:52.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.825+0000 7f2243a38740 1 -- 172.21.15.42:0/3973751228 shutdown_connections 2024-08-26T00:05:52.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.825+0000 7f2243a38740 1 --2- 172.21.15.42:0/3973751228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55baabcfcd20 0x55baabd14c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.825+0000 7f2243a38740 1 --2- 172.21.15.42:0/3973751228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcf2460 0x55baabd14720 secure :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2228004fd0 tx=0x7f2228009f60 comp rx=0 tx=0).stop 2024-08-26T00:05:52.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.825+0000 7f2243a38740 1 --2- 172.21.15.42:0/3973751228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55baabcf1b40 0x55baabcfa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.825+0000 7f2243a38740 1 -- 172.21.15.42:0/3973751228 >> 172.21.15.42:0/3973751228 conn(0x55baabcee080 msgr2=0x55baabcf8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:52.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.826+0000 7f2243a38740 1 -- 172.21.15.42:0/3973751228 shutdown_connections 2024-08-26T00:05:52.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.826+0000 7f2243a38740 1 -- 172.21.15.42:0/3973751228 wait complete. 2024-08-26T00:05:52.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.826+0000 7f2243a38740 1 -- start start 2024-08-26T00:05:52.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.826+0000 7f2243a38740 1 Processor -- start 2024-08-26T00:05:52.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.827+0000 7f2243a38740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcf1b40 0x55baabd05540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:52.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.827+0000 7f2243a38740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55baabcfcd20 0x55baabd007d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:52.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.827+0000 7f2243a38740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55baabd0ca30 0x55baabd00da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:52.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.827+0000 7f2243a38740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f223c1adb00 con 0x55baabcf1b40 2024-08-26T00:05:52.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.827+0000 7f2243a38740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f223c1aef70 con 0x55baabcfcd20 2024-08-26T00:05:52.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.827+0000 7f2243a38740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f223c1ae1d0 con 0x55baabd0ca30 2024-08-26T00:05:52.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.827+0000 7f2243a38740 10 client.0 _ll_register_callbacks cb 0x7f222c03f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:05:52.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.828+0000 7f2239e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcf1b40 0x55baabd05540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:52.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.828+0000 7f2239e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcf1b40 0x55baabd05540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38854/0 (socket says 172.21.15.42:38854) 2024-08-26T00:05:52.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.828+0000 7f2239e00640 1 -- 172.21.15.42:0/954853487 learned_addr learned my addr 172.21.15.42:0/954853487 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:05:52.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.828+0000 7f2239400640 1 --2- 172.21.15.42:0/954853487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55baabcfcd20 0x55baabd007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:52.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.828+0000 7f223a800640 1 --2- 172.21.15.42:0/954853487 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55baabd0ca30 0x55baabd00da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:52.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.829+0000 7f2239e00640 1 -- 172.21.15.42:0/954853487 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55baabd0ca30 msgr2=0x55baabd00da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:52.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.829+0000 7f2239e00640 1 --2- 172.21.15.42:0/954853487 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55baabd0ca30 0x55baabd00da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.829+0000 7f2239e00640 1 -- 172.21.15.42:0/954853487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55baabcfcd20 msgr2=0x55baabd007d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:05:52.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.829+0000 7f2239e00640 1 --2- 172.21.15.42:0/954853487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55baabcfcd20 0x55baabd007d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.829+0000 7f2239e00640 1 -- 172.21.15.42:0/954853487 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baabd015d0 con 0x55baabcf1b40 2024-08-26T00:05:52.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.829+0000 7f2239400640 1 --2- 172.21.15.42:0/954853487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55baabcfcd20 0x55baabd007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:05:52.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.830+0000 7f2239e00640 1 --2- 172.21.15.42:0/954853487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcf1b40 0x55baabd05540 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f222c02a430 tx=0x7f222c032800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce7a1542286b57b server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:05:52.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.830+0000 7f221be00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:05:52.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.831+0000 7f221be00640 1 -- 172.21.15.42:0/954853487 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c04c040 con 0x55baabcf1b40 2024-08-26T00:05:52.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.831+0000 7f221be00640 1 -- 172.21.15.42:0/954853487 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f222c004da0 con 0x55baabcf1b40 2024-08-26T00:05:52.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.831+0000 7f2243a38740 1 -- 172.21.15.42:0/954853487 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22280b3070 con 0x55baabcf1b40 2024-08-26T00:05:52.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.832+0000 7f221be00640 1 -- 172.21.15.42:0/954853487 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f222c06b050 con 0x55baabcf1b40 2024-08-26T00:05:52.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.832+0000 7f2243a38740 10 client.15486 fetch_fsmap learned FSMap version 27 2024-08-26T00:05:52.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.832+0000 7f2243a38740 1 -- 172.21.15.42:0/954853487 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55baabd77800 con 0x55baabcf1b40 2024-08-26T00:05:52.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.833+0000 7f221be00640 1 -- 172.21.15.42:0/954853487 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22280b3070 con 0x55baabcf1b40 2024-08-26T00:05:52.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.833+0000 7f221be00640 1 -- 172.21.15.42:0/954853487 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f222c048680 con 0x55baabcf1b40 2024-08-26T00:05:52.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.833+0000 7f2243a38740 10 client.15486 fetch_fsmap finished waiting for FSMap version 27 2024-08-26T00:05:52.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.833+0000 7f2243a38740 10 client.15486 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:05:52.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.833+0000 7f2243a38740 20 client.15486 populate_metadata read hostname 'smithi042' 2024-08-26T00:05:52.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.833+0000 7f2243a38740 1 --2- 172.21.15.42:0/954853487 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55baabd77f60 0x55baabd7a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:05:52.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.833+0000 7f2243a38740 4 client.15486 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-26T00:05:52.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.833+0000 7f2243a38740 1 -- 172.21.15.42:0/954853487 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55baabc5fa40 con 0x55baabd77f60 2024-08-26T00:05:52.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.834+0000 7f2239400640 1 --2- 172.21.15.42:0/954853487 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55baabd77f60 0x55baabd7a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:05:52.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.835+0000 7f2239400640 1 --2- 172.21.15.42:0/954853487 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55baabd77f60 0x55baabd7a380 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42fc5e0601118b0b server_cookie=7527bb02323016a4 in_seq=0 out_seq=0 2024-08-26T00:05:52.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.835+0000 7f221be00640 10 client.15486 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:05:52.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.838+0000 7f221be00640 1 -- 172.21.15.42:0/954853487 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x55baabc5fa40 con 0x55baabd77f60 2024-08-26T00:05:52.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.838+0000 7f221be00640 10 client.15486 handle_command_reply: tid=0 2024-08-26T00:05:52.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.838+0000 7f2243a38740 1 client.15486 shutdown 2024-08-26T00:05:52.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.838+0000 7f2243a38740 1 -- 172.21.15.42:0/954853487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcf1b40 msgr2=0x55baabd05540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:52.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.838+0000 7f2243a38740 1 --2- 172.21.15.42:0/954853487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcf1b40 0x55baabd05540 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f222c02a430 tx=0x7f222c032800 comp rx=0 tx=0).stop 2024-08-26T00:05:52.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.839+0000 7f2243a38740 1 -- 172.21.15.42:0/954853487 shutdown_connections 2024-08-26T00:05:52.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.839+0000 7f2243a38740 1 --2- 172.21.15.42:0/954853487 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55baabd0ca30 0x55baabd00da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.839+0000 7f2243a38740 1 --2- 172.21.15.42:0/954853487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55baabcfcd20 0x55baabd007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.839+0000 7f2243a38740 1 --2- 172.21.15.42:0/954853487 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55baabd77f60 0x55baabd7a380 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.839+0000 7f2243a38740 1 --2- 172.21.15.42:0/954853487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55baabcf1b40 0x55baabd05540 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.839+0000 7f2243a38740 1 -- 172.21.15.42:0/954853487 >> 172.21.15.42:0/954853487 conn(0x55baabcee080 msgr2=0x55baabceca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:52.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.839+0000 7f221be00640 0 client.15486 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:05:52.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.839+0000 7f2243a38740 1 -- 172.21.15.42:0/954853487 shutdown_connections 2024-08-26T00:05:52.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.839+0000 7f2243a38740 1 -- 172.21.15.42:0/954853487 wait complete. 2024-08-26T00:05:52.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.839+0000 7f2243a38740 20 client.15486 trim_cache size 0 max 16384 2024-08-26T00:05:52.841 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:05:52.841 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "scrub active (7445 inodes in the stack)", 2024-08-26T00:05:52.841 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-08-26T00:05:52.841 INFO:teuthology.orchestra.run.smithi042.stdout: "81e22388-86d2-4474-8f07-a2d1ce4db7ce": { 2024-08-26T00:05:52.841 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-08-26T00:05:52.841 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "81e22388-86d2-4474-8f07-a2d1ce4db7ce", 2024-08-26T00:05:52.841 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,force" 2024-08-26T00:05:52.841 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:05:52.841 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:05:52.841 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:05:52.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.841+0000 7f223b200640 1 -- 172.21.15.42:0/453347393 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f22200a2a90 msgr2=0x7f22200a4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:52.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.841+0000 7f223b200640 1 --2- 172.21.15.42:0/453347393 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f22200a2a90 0x7f22200a4f50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f222c005c40 tx=0x7f222c009560 comp rx=0 tx=0).stop 2024-08-26T00:05:52.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.841+0000 7f223b200640 1 -- 172.21.15.42:0/453347393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f223c102100 msgr2=0x7f223c19a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:05:52.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.841+0000 7f223b200640 1 --2- 172.21.15.42:0/453347393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f223c102100 0x7f223c19a7a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f222800e9f0 tx=0x7f222800eeb0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.841+0000 7f223b200640 1 -- 172.21.15.42:0/453347393 shutdown_connections 2024-08-26T00:05:52.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.841+0000 7f223b200640 1 --2- 172.21.15.42:0/453347393 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f22200a2a90 0x7f22200a4f50 secure :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f222c005c40 tx=0x7f222c009560 comp rx=0 tx=0).stop 2024-08-26T00:05:52.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.841+0000 7f223b200640 1 --2- 172.21.15.42:0/453347393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f223c107760 0x7f223c19eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.841+0000 7f223b200640 1 --2- 172.21.15.42:0/453347393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f223c102100 0x7f223c19a7a0 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f222800e9f0 tx=0x7f222800eeb0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.841+0000 7f223b200640 1 --2- 172.21.15.42:0/453347393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f223c101760 0x7f223c19a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:05:52.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.841+0000 7f223b200640 1 -- 172.21.15.42:0/453347393 >> 172.21.15.42:0/453347393 conn(0x7f223c0fd4e0 msgr2=0x7f223c10cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:05:52.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.842+0000 7f223b200640 1 -- 172.21.15.42:0/453347393 shutdown_connections 2024-08-26T00:05:52.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:05:52.842+0000 7f223b200640 1 -- 172.21.15.42:0/453347393 wait complete. 2024-08-26T00:05:53.128 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:52 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:05:53.129 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:52 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:05:53.129 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:52 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:05:53.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:52 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:05:53.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:52 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:05:53.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:52 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:05:53.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:52 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:05:53.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:52 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:05:53.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:52 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:05:53.947 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:53 smithi042 ceph-mon[17225]: pgmap v440: 97 pgs: 97 active+clean; 582 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 13 MiB/s wr, 784 op/s 2024-08-26T00:05:53.999 INFO:tasks.cephfs.filesystem:scrub status for tag:81e22388-86d2-4474-8f07-a2d1ce4db7ce - {'path': '/', 'tag': '81e22388-86d2-4474-8f07-a2d1ce4db7ce', 'options': 'recursive,force'} 2024-08-26T00:05:54.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:53 smithi043 ceph-mon[22091]: pgmap v440: 97 pgs: 97 active+clean; 582 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 13 MiB/s wr, 784 op/s 2024-08-26T00:05:54.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:53 smithi181 ceph-mon[22102]: pgmap v440: 97 pgs: 97 active+clean; 582 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 13 MiB/s wr, 784 op/s 2024-08-26T00:05:55.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:54 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:05:55.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:54 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:05:55.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:54 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:05:55.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:54 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:05:55.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:54 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:05:55.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:54 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:05:56.102 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:55 smithi042 ceph-mon[17225]: pgmap v441: 97 pgs: 97 active+clean; 615 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 16 MiB/s wr, 923 op/s 2024-08-26T00:05:56.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:55 smithi043 ceph-mon[22091]: pgmap v441: 97 pgs: 97 active+clean; 615 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 16 MiB/s wr, 923 op/s 2024-08-26T00:05:56.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:55 smithi181 ceph-mon[22102]: pgmap v441: 97 pgs: 97 active+clean; 615 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 16 MiB/s wr, 923 op/s 2024-08-26T00:05:57.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:56 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:05:57.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:56 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:05:57.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:56 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:05:57.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:56 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:05:57.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:56 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:05:57.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:56 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:05:57.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:56 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:05:57.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:56 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:05:57.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:56 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:05:58.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:57 smithi043 ceph-mon[22091]: pgmap v442: 97 pgs: 97 active+clean; 617 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 16 MiB/s wr, 928 op/s 2024-08-26T00:05:58.283 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 26 00:05:57 smithi042 sudo[76498]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-26T00:05:58.283 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 26 00:05:57 smithi042 sudo[76498]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:05:58.283 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 26 00:05:57 smithi042 sudo[76498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:05:58.283 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 26 00:05:57 smithi042 sudo[76498]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:05:58.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:57 smithi181 ceph-mon[22102]: pgmap v442: 97 pgs: 97 active+clean; 617 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 16 MiB/s wr, 928 op/s 2024-08-26T00:05:58.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:57 smithi042 ceph-mon[17225]: pgmap v442: 97 pgs: 97 active+clean; 617 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 16 MiB/s wr, 928 op/s 2024-08-26T00:05:59.288 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 26 00:05:58 smithi042 sudo[76501]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-26T00:05:59.288 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 26 00:05:58 smithi042 sudo[76501]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:05:59.288 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 26 00:05:58 smithi042 sudo[76501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:05:59.288 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 26 00:05:58 smithi042 sudo[76501]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:05:59.456 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 26 00:05:59 smithi043 sudo[55425]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-26T00:05:59.456 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 26 00:05:59 smithi043 sudo[55425]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:05:59.456 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 26 00:05:59 smithi043 sudo[55425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:05:59.456 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 26 00:05:59 smithi043 sudo[55425]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:05:59.760 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 26 00:05:59 smithi043 sudo[55428]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-26T00:05:59.760 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 26 00:05:59 smithi043 sudo[55428]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:05:59.760 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 26 00:05:59 smithi043 sudo[55428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:05:59.760 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 26 00:05:59 smithi043 sudo[55428]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:00.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:59 smithi181 ceph-mon[22102]: pgmap v443: 97 pgs: 97 active+clean; 619 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 15 MiB/s wr, 903 op/s 2024-08-26T00:06:00.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:59 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:06:00.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:05:59 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:06:00.034 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 26 00:05:59 smithi181 sudo[55493]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-26T00:06:00.035 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 26 00:05:59 smithi181 sudo[55493]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:00.035 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 26 00:05:59 smithi181 sudo[55493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:00.035 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 26 00:05:59 smithi181 sudo[55493]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:00.194 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:59 smithi042 ceph-mon[17225]: pgmap v443: 97 pgs: 97 active+clean; 619 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 15 MiB/s wr, 903 op/s 2024-08-26T00:06:00.194 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:59 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:06:00.194 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:05:59 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:06:00.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:59 smithi043 ceph-mon[22091]: pgmap v443: 97 pgs: 97 active+clean; 619 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 15 MiB/s wr, 903 op/s 2024-08-26T00:06:00.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:59 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:06:00.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:05:59 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:06:00.533 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 26 00:06:00 smithi181 sudo[55496]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-26T00:06:00.534 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 26 00:06:00 smithi181 sudo[55496]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:00.534 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 26 00:06:00 smithi181 sudo[55496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:00.534 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 26 00:06:00 smithi181 sudo[55496]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:01.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:01 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:06:01.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:01 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:06:01.550 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:01 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:06:01.551 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 26 00:06:01 smithi042 sudo[76504]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-26T00:06:01.551 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 26 00:06:01 smithi042 sudo[76504]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:01.551 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 26 00:06:01 smithi042 sudo[76504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:01.551 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 26 00:06:01 smithi042 sudo[76504]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:01.652 INFO:tasks.workunit.client.0.smithi042.stdout: 172 297095 679 198888 616 116725 725 2024-08-26T00:06:02.374 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:02 smithi043 ceph-mon[22091]: pgmap v444: 97 pgs: 97 active+clean; 622 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 14 MiB/s wr, 835 op/s 2024-08-26T00:06:02.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:02 smithi181 ceph-mon[22102]: pgmap v444: 97 pgs: 97 active+clean; 622 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 14 MiB/s wr, 835 op/s 2024-08-26T00:06:02.537 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:02 smithi042 ceph-mon[17225]: pgmap v444: 97 pgs: 97 active+clean; 622 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 14 MiB/s wr, 835 op/s 2024-08-26T00:06:02.539 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 26 00:06:02 smithi042 sudo[76507]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-26T00:06:02.539 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 26 00:06:02 smithi042 sudo[76507]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:02.539 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 26 00:06:02 smithi042 sudo[76507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:02.539 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 26 00:06:02 smithi042 sudo[76507]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:02.652 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:06:02 smithi043 sudo[55437]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-26T00:06:02.652 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:06:02 smithi043 sudo[55437]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:02.652 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:06:02 smithi043 sudo[55437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:02.652 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:06:02 smithi043 sudo[55437]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:03.010 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:06:02 smithi043 sudo[55441]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-26T00:06:03.010 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:06:02 smithi043 sudo[55441]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:03.010 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:06:02 smithi043 sudo[55441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:03.010 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:06:02 smithi043 sudo[55441]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:03.283 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:06:02 smithi181 sudo[55501]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-26T00:06:03.284 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:06:02 smithi181 sudo[55501]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:03.284 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:06:02 smithi181 sudo[55501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:03.284 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:06:02 smithi181 sudo[55501]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:03.783 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:06:03 smithi181 sudo[55504]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-26T00:06:03.783 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:06:03 smithi181 sudo[55504]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:03.784 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:06:03 smithi181 sudo[55504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:03.784 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:06:03 smithi181 sudo[55504]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:04.405 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:04 smithi042 ceph-mon[17225]: pgmap v445: 97 pgs: 97 active+clean; 626 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 11 MiB/s wr, 674 op/s 2024-08-26T00:06:04.405 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:04 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:06:04.405 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:06:04 smithi042 sudo[76510]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-26T00:06:04.405 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:06:04 smithi042 sudo[76510]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:04.405 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:06:04 smithi042 sudo[76510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:04.405 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:06:04 smithi042 sudo[76510]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:04.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:04 smithi043 ceph-mon[22091]: pgmap v445: 97 pgs: 97 active+clean; 626 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 11 MiB/s wr, 674 op/s 2024-08-26T00:06:04.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:04 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:06:04.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:04 smithi181 ceph-mon[22102]: pgmap v445: 97 pgs: 97 active+clean; 626 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 11 MiB/s wr, 674 op/s 2024-08-26T00:06:04.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:04 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:06:05.500 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:05 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:06:05.500 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:05 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:06:05.502 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:06:05 smithi042 sudo[76513]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-26T00:06:05.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:05 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:06:05.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:05 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:06:05.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:05 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:06:05.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:05 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:06:05.783 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:06:05 smithi042 sudo[76513]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:05.784 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:06:05 smithi042 sudo[76513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:05.784 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:06:05 smithi042 sudo[76513]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:06.113 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:06:05 smithi043 sudo[55450]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-26T00:06:06.113 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:06:05 smithi043 sudo[55450]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:06.113 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:06:05 smithi043 sudo[55450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:06.113 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:06:05 smithi043 sudo[55450]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:06.419 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:06 smithi181 ceph-mon[22102]: pgmap v446: 97 pgs: 97 active+clean; 628 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 MiB/s wr, 342 op/s 2024-08-26T00:06:06.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:06 smithi043 ceph-mon[22091]: pgmap v446: 97 pgs: 97 active+clean; 628 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 MiB/s wr, 342 op/s 2024-08-26T00:06:06.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:06:06 smithi043 sudo[55454]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-26T00:06:06.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:06:06 smithi043 sudo[55454]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:06.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:06:06 smithi043 sudo[55454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:06.511 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:06:06 smithi043 sudo[55454]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:06.537 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:06 smithi042 ceph-mon[17225]: pgmap v446: 97 pgs: 97 active+clean; 628 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 MiB/s wr, 342 op/s 2024-08-26T00:06:06.729 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:06:06 smithi181 sudo[55510]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-26T00:06:06.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:06:06 smithi181 sudo[55510]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:06.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:06:06 smithi181 sudo[55510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:06.730 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:06:06 smithi181 sudo[55510]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:07.033 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:06:06 smithi181 sudo[55514]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-26T00:06:07.033 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:06:06 smithi181 sudo[55514]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:07.033 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:06:06 smithi181 sudo[55514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:07.034 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:06:06 smithi181 sudo[55514]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:08.033 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:06:07 smithi042 sudo[76516]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-26T00:06:08.033 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:06:07 smithi042 sudo[76516]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:08.034 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:06:07 smithi042 sudo[76516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:08.034 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:06:07 smithi042 sudo[76516]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:08.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:08 smithi043 ceph-mon[22091]: pgmap v447: 97 pgs: 97 active+clean; 635 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 201 op/s 2024-08-26T00:06:08.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:08 smithi042 ceph-mon[17225]: pgmap v447: 97 pgs: 97 active+clean; 635 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 201 op/s 2024-08-26T00:06:08.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:08 smithi181 ceph-mon[22102]: pgmap v447: 97 pgs: 97 active+clean; 635 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 201 op/s 2024-08-26T00:06:09.042 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:06:08 smithi042 sudo[76519]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-26T00:06:09.042 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:06:08 smithi042 sudo[76519]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:09.042 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:06:08 smithi042 sudo[76519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:09.043 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:06:08 smithi042 sudo[76519]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:09.363 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:06:09 smithi043 sudo[55462]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-26T00:06:09.363 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:06:09 smithi043 sudo[55462]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:09.363 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:06:09 smithi043 sudo[55462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:09.364 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:06:09 smithi043 sudo[55462]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:09.760 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:06:09 smithi043 sudo[55466]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-26T00:06:09.760 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:06:09 smithi043 sudo[55466]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:09.760 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:06:09 smithi043 sudo[55466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:09.760 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:06:09 smithi043 sudo[55466]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:09.975 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:06:09 smithi181 sudo[55519]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-26T00:06:09.975 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:06:09 smithi181 sudo[55519]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:09.975 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:06:09 smithi181 sudo[55519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:09.975 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:06:09 smithi181 sudo[55519]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:10.283 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:06:09 smithi181 sudo[55523]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-26T00:06:10.283 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:06:09 smithi181 sudo[55523]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:10.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:06:09 smithi181 sudo[55523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:10.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:06:09 smithi181 sudo[55523]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:11.293 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:10 smithi042 sudo[76522]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-26T00:06:11.293 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:10 smithi042 sudo[76522]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:11.293 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:10 smithi042 sudo[76522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:11.293 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:10 smithi042 sudo[76522]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:11.655 INFO:tasks.workunit.client.0.smithi042.stdout: 196 591775 1529 391565 1189 227152 1903 2024-08-26T00:06:12.224 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:11 smithi181 ceph-mon[22102]: pgmap v448: 97 pgs: 97 active+clean; 640 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 252 op/s 2024-08-26T00:06:12.224 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:11 smithi181 ceph-mon[22102]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-26T00:06:12.224 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:11 smithi181 ceph-mon[22102]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-26T00:06:12.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:11 smithi043 ceph-mon[22091]: pgmap v448: 97 pgs: 97 active+clean; 640 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 252 op/s 2024-08-26T00:06:12.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:11 smithi043 ceph-mon[22091]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-26T00:06:12.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:11 smithi043 ceph-mon[22091]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-26T00:06:12.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:11 smithi042 sudo[76525]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-26T00:06:12.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:11 smithi042 sudo[76525]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:12.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:11 smithi042 sudo[76525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:12.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:11 smithi042 sudo[76525]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:12.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:11 smithi042 ceph-mon[17225]: pgmap v448: 97 pgs: 97 active+clean; 640 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 252 op/s 2024-08-26T00:06:12.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:11 smithi042 ceph-mon[17225]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-26T00:06:12.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:11 smithi042 ceph-mon[17225]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-26T00:06:12.528 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:12 smithi181 sudo[55528]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-26T00:06:12.528 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:12 smithi181 sudo[55528]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:12.528 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:12 smithi181 sudo[55528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:12.528 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:12 smithi181 sudo[55528]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:12.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:12 smithi181 sudo[55531]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-26T00:06:12.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:12 smithi181 sudo[55531]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:12.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:12 smithi181 sudo[55531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:12.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:12 smithi181 sudo[55531]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:13.084 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:12 smithi043 sudo[55475]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-26T00:06:13.084 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:12 smithi043 sudo[55475]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:13.084 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:12 smithi043 sudo[55475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:13.084 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:12 smithi043 sudo[55475]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:13.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:13 smithi043 sudo[55478]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-26T00:06:13.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:13 smithi043 sudo[55478]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-26T00:06:13.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:13 smithi043 sudo[55478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-26T00:06:13.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:13 smithi043 sudo[55478]: pam_unix(sudo:session): session closed for user root 2024-08-26T00:06:13.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:13 smithi043 ceph-mon[22091]: pgmap v449: 97 pgs: 97 active+clean; 642 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 264 op/s 2024-08-26T00:06:13.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:13 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-26T00:06:13.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:13 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-26T00:06:13.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:13 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-26T00:06:13.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:13 smithi043 ceph-mon[22091]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-26T00:06:13.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:13 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-26T00:06:13.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:13 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-26T00:06:13.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:13 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-26T00:06:13.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:13 smithi043 ceph-mon[22091]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-26T00:06:13.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:13 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-26T00:06:13.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:13 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-26T00:06:13.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:13 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-26T00:06:13.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:13 smithi042 ceph-mon[17225]: pgmap v449: 97 pgs: 97 active+clean; 642 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 264 op/s 2024-08-26T00:06:13.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-26T00:06:13.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-26T00:06:13.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-26T00:06:13.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:13 smithi042 ceph-mon[17225]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-26T00:06:13.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-26T00:06:13.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-26T00:06:13.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-26T00:06:13.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:13 smithi042 ceph-mon[17225]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-26T00:06:13.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-26T00:06:13.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-26T00:06:13.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-26T00:06:13.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:13 smithi181 ceph-mon[22102]: pgmap v449: 97 pgs: 97 active+clean; 642 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 264 op/s 2024-08-26T00:06:13.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-26T00:06:13.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-26T00:06:13.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-26T00:06:13.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:13 smithi181 ceph-mon[22102]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-26T00:06:13.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-26T00:06:13.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-26T00:06:13.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-26T00:06:13.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:13 smithi181 ceph-mon[22102]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-26T00:06:13.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-26T00:06:13.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-26T00:06:13.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-26T00:06:14.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:14 smithi043 ceph-mon[22091]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-26T00:06:14.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:14 smithi043 ceph-mon[22091]: pgmap v450: 97 pgs: 97 active+clean; 642 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 301 op/s 2024-08-26T00:06:14.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:14 smithi043 ceph-mon[22091]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-26T00:06:14.512 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:14 smithi042 ceph-mon[17225]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-26T00:06:14.512 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:14 smithi042 ceph-mon[17225]: pgmap v450: 97 pgs: 97 active+clean; 642 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 301 op/s 2024-08-26T00:06:14.512 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:14 smithi042 ceph-mon[17225]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-26T00:06:14.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:14 smithi181 ceph-mon[22102]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-26T00:06:14.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:14 smithi181 ceph-mon[22102]: pgmap v450: 97 pgs: 97 active+clean; 642 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 301 op/s 2024-08-26T00:06:14.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:14 smithi181 ceph-mon[22102]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-26T00:06:16.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:16 smithi043 ceph-mon[22091]: pgmap v451: 97 pgs: 97 active+clean; 645 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 287 op/s 2024-08-26T00:06:16.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:16 smithi042 ceph-mon[17225]: pgmap v451: 97 pgs: 97 active+clean; 645 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 287 op/s 2024-08-26T00:06:16.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:16 smithi181 ceph-mon[22102]: pgmap v451: 97 pgs: 97 active+clean; 645 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 287 op/s 2024-08-26T00:06:18.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:18 smithi043 ceph-mon[22091]: pgmap v452: 97 pgs: 97 active+clean; 668 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.4 MiB/s wr, 381 op/s 2024-08-26T00:06:18.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:18 smithi042 ceph-mon[17225]: pgmap v452: 97 pgs: 97 active+clean; 668 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.4 MiB/s wr, 381 op/s 2024-08-26T00:06:18.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:18 smithi181 ceph-mon[22102]: pgmap v452: 97 pgs: 97 active+clean; 668 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.4 MiB/s wr, 381 op/s 2024-08-26T00:06:20.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:20 smithi042 ceph-mon[17225]: pgmap v453: 97 pgs: 97 active+clean; 687 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.5 MiB/s wr, 448 op/s 2024-08-26T00:06:20.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:20 smithi043 ceph-mon[22091]: pgmap v453: 97 pgs: 97 active+clean; 687 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.5 MiB/s wr, 448 op/s 2024-08-26T00:06:20.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:20 smithi181 ceph-mon[22102]: pgmap v453: 97 pgs: 97 active+clean; 687 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.5 MiB/s wr, 448 op/s 2024-08-26T00:06:21.660 INFO:tasks.workunit.client.0.smithi042.stdout: 216 570932 1215 381349 1060 215719 1671 2024-08-26T00:06:22.265 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:22 smithi042 ceph-mon[17225]: pgmap v454: 97 pgs: 97 active+clean; 699 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.0 MiB/s wr, 416 op/s 2024-08-26T00:06:22.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:22 smithi043 ceph-mon[22091]: pgmap v454: 97 pgs: 97 active+clean; 699 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.0 MiB/s wr, 416 op/s 2024-08-26T00:06:22.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:22 smithi181 ceph-mon[22102]: pgmap v454: 97 pgs: 97 active+clean; 699 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.0 MiB/s wr, 416 op/s 2024-08-26T00:06:24.000 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-26T00:06:24.203 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:24 smithi042 ceph-mon[17225]: pgmap v455: 97 pgs: 97 active+clean; 758 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 11 MiB/s wr, 617 op/s 2024-08-26T00:06:24.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:24 smithi043 ceph-mon[22091]: pgmap v455: 97 pgs: 97 active+clean; 758 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 11 MiB/s wr, 617 op/s 2024-08-26T00:06:24.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:24 smithi181 ceph-mon[22102]: pgmap v455: 97 pgs: 97 active+clean; 758 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 11 MiB/s wr, 617 op/s 2024-08-26T00:06:25.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:25 smithi042 ceph-mon[17225]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:06:25.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:25 smithi043 ceph-mon[22091]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:06:25.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:25 smithi181 ceph-mon[22102]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:06:26.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:26 smithi043 ceph-mon[22091]: pgmap v456: 97 pgs: 97 active+clean; 789 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 719 op/s 2024-08-26T00:06:26.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:26 smithi181 ceph-mon[22102]: pgmap v456: 97 pgs: 97 active+clean; 789 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 719 op/s 2024-08-26T00:06:26.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:26 smithi042 ceph-mon[17225]: pgmap v456: 97 pgs: 97 active+clean; 789 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 719 op/s 2024-08-26T00:06:28.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:28 smithi043 ceph-mon[22091]: pgmap v457: 97 pgs: 97 active+clean; 843 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 18 MiB/s wr, 996 op/s 2024-08-26T00:06:28.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:28 smithi042 ceph-mon[17225]: pgmap v457: 97 pgs: 97 active+clean; 843 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 18 MiB/s wr, 996 op/s 2024-08-26T00:06:28.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:28 smithi181 ceph-mon[22102]: pgmap v457: 97 pgs: 97 active+clean; 843 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 18 MiB/s wr, 996 op/s 2024-08-26T00:06:30.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:30 smithi043 ceph-mon[22091]: pgmap v458: 97 pgs: 97 active+clean; 865 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 18 MiB/s wr, 1.03k op/s 2024-08-26T00:06:30.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:30 smithi043 ceph-mon[22091]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:06:30.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:30 smithi042 ceph-mon[17225]: pgmap v458: 97 pgs: 97 active+clean; 865 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 18 MiB/s wr, 1.03k op/s 2024-08-26T00:06:30.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:30 smithi042 ceph-mon[17225]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:06:30.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:30 smithi181 ceph-mon[22102]: pgmap v458: 97 pgs: 97 active+clean; 865 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 18 MiB/s wr, 1.03k op/s 2024-08-26T00:06:30.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:30 smithi181 ceph-mon[22102]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:06:31.660 INFO:tasks.workunit.client.0.smithi042.stdout: 240 558890 1245 373229 1414 208236 940 2024-08-26T00:06:32.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:32 smithi043 ceph-mon[22091]: pgmap v459: 97 pgs: 97 active+clean; 864 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 956 op/s 2024-08-26T00:06:32.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:32 smithi042 ceph-mon[17225]: pgmap v459: 97 pgs: 97 active+clean; 864 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 956 op/s 2024-08-26T00:06:32.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:32 smithi181 ceph-mon[22102]: pgmap v459: 97 pgs: 97 active+clean; 864 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 956 op/s 2024-08-26T00:06:32.741 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:06:34.339 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:34 smithi042 ceph-mon[17225]: pgmap v460: 97 pgs: 97 active+clean; 865 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 15 MiB/s wr, 928 op/s 2024-08-26T00:06:34.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:34 smithi043 ceph-mon[22091]: pgmap v460: 97 pgs: 97 active+clean; 865 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 15 MiB/s wr, 928 op/s 2024-08-26T00:06:34.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:34 smithi181 ceph-mon[22102]: pgmap v460: 97 pgs: 97 active+clean; 865 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 15 MiB/s wr, 928 op/s 2024-08-26T00:06:34.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.587+0000 7f6b9b200640 1 -- 172.21.15.42:0/3246532693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b9c06ebb0 msgr2=0x7f6b9c114310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:06:34.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.588+0000 7f6b9b200640 1 --2- 172.21.15.42:0/3246532693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b9c06ebb0 0x7f6b9c114310 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c009900 tx=0x7f6b8c02a410 comp rx=0 tx=0).stop 2024-08-26T00:06:34.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.589+0000 7f6b9b200640 1 -- 172.21.15.42:0/3246532693 shutdown_connections 2024-08-26T00:06:34.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.589+0000 7f6b9b200640 1 --2- 172.21.15.42:0/3246532693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b9c114850 0x7f6b9c116c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.589+0000 7f6b9b200640 1 --2- 172.21.15.42:0/3246532693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b9c06ebb0 0x7f6b9c114310 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.589+0000 7f6b9b200640 1 --2- 172.21.15.42:0/3246532693 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b9c06e290 0x7f6b9c06e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.589+0000 7f6b9b200640 1 -- 172.21.15.42:0/3246532693 >> 172.21.15.42:0/3246532693 conn(0x7f6b9c072f20 msgr2=0x7f6b9c073330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:06:34.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.590+0000 7f6b9b200640 1 -- 172.21.15.42:0/3246532693 shutdown_connections 2024-08-26T00:06:34.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.590+0000 7f6b9b200640 1 -- 172.21.15.42:0/3246532693 wait complete. 2024-08-26T00:06:34.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.593+0000 7f6b9b200640 1 Processor -- start 2024-08-26T00:06:34.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.593+0000 7f6b9b200640 1 -- start start 2024-08-26T00:06:34.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.594+0000 7f6b9b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b9c06e290 0x7f6b9c10c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:06:34.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.594+0000 7f6b9b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b9c06ebb0 0x7f6b9c10ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:06:34.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.594+0000 7f6b9b200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b9c114850 0x7f6b9c1b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:06:34.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.595+0000 7f6b99e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b9c06e290 0x7f6b9c10c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:06:34.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.595+0000 7f6b99400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b9c06ebb0 0x7f6b9c10ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:06:34.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.595+0000 7f6b99400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b9c06ebb0 0x7f6b9c10ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59208/0 (socket says 172.21.15.42:59208) 2024-08-26T00:06:34.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.596+0000 7f6b99e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b9c06e290 0x7f6b9c10c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:59806/0 (socket says 172.21.15.42:59806) 2024-08-26T00:06:34.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.596+0000 7f6b99e00640 1 -- 172.21.15.42:0/4198160178 learned_addr learned my addr 172.21.15.42:0/4198160178 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:06:34.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.596+0000 7f6b9a800640 1 --2- 172.21.15.42:0/4198160178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b9c114850 0x7f6b9c1b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:06:34.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.596+0000 7f6b9b200640 1 -- 172.21.15.42:0/4198160178 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c11a3d0 con 0x7f6b9c06ebb0 2024-08-26T00:06:34.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.596+0000 7f6b9b200640 1 -- 172.21.15.42:0/4198160178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c11a250 con 0x7f6b9c06e290 2024-08-26T00:06:34.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.596+0000 7f6b9b200640 1 -- 172.21.15.42:0/4198160178 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c11a550 con 0x7f6b9c114850 2024-08-26T00:06:34.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.598+0000 7f6b99e00640 1 -- 172.21.15.42:0/4198160178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b9c114850 msgr2=0x7f6b9c1b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:06:34.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.598+0000 7f6b99e00640 1 --2- 172.21.15.42:0/4198160178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b9c114850 0x7f6b9c1b2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.598+0000 7f6b99e00640 1 -- 172.21.15.42:0/4198160178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b9c06ebb0 msgr2=0x7f6b9c10ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:06:34.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.598+0000 7f6b99e00640 1 --2- 172.21.15.42:0/4198160178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b9c06ebb0 0x7f6b9c10ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.598+0000 7f6b99e00640 1 -- 172.21.15.42:0/4198160178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9c1b31b0 con 0x7f6b9c06e290 2024-08-26T00:06:34.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.598+0000 7f6b99e00640 1 --2- 172.21.15.42:0/4198160178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b9c06e290 0x7f6b9c10c970 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6b9400ba50 tx=0x7f6b9400bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:06:34.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.599+0000 7f6b92a00640 1 -- 172.21.15.42:0/4198160178 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b94019070 con 0x7f6b9c06e290 2024-08-26T00:06:34.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.599+0000 7f6b92a00640 1 -- 172.21.15.42:0/4198160178 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b9400cc10 con 0x7f6b9c06e290 2024-08-26T00:06:34.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.599+0000 7f6b92a00640 1 -- 172.21.15.42:0/4198160178 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b94007730 con 0x7f6b9c06e290 2024-08-26T00:06:34.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.604+0000 7f6b9b200640 1 -- 172.21.15.42:0/4198160178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9c1b3440 con 0x7f6b9c06e290 2024-08-26T00:06:34.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.604+0000 7f6b9b200640 1 -- 172.21.15.42:0/4198160178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b9c1b3900 con 0x7f6b9c06e290 2024-08-26T00:06:34.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.609+0000 7f6ba35c9740 1 Processor -- start 2024-08-26T00:06:34.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.610+0000 7f6ba35c9740 1 -- start start 2024-08-26T00:06:34.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.611+0000 7f6ba35c9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a444a7b40 0x557a444a7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:06:34.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.611+0000 7f6ba35c9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444a8460 0x557a444b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:06:34.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.612+0000 7f6b9a800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a444a7b40 0x557a444a7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:06:34.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.612+0000 7f6b9a800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a444a7b40 0x557a444a7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:39108/0 (socket says 172.21.15.42:39108) 2024-08-26T00:06:34.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.612+0000 7f6b9a800640 1 -- 172.21.15.42:0/4180142918 learned_addr learned my addr 172.21.15.42:0/4180142918 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:06:34.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.612+0000 7f6ba35c9740 1 --2- 172.21.15.42:0/4180142918 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444b2d20 0x557a444b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:06:34.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.612+0000 7f6ba35c9740 1 -- 172.21.15.42:0/4180142918 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557a4440dfc0 con 0x557a444a8460 2024-08-26T00:06:34.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.613+0000 7f6ba35c9740 1 -- 172.21.15.42:0/4180142918 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557a443a5680 con 0x557a444b2d20 2024-08-26T00:06:34.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.613+0000 7f6b92a00640 1 -- 172.21.15.42:0/4198160178 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6b94014440 con 0x7f6b9c06e290 2024-08-26T00:06:34.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.613+0000 7f6ba35c9740 1 -- 172.21.15.42:0/4180142918 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557a44409f80 con 0x557a444a7b40 2024-08-26T00:06:34.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.613+0000 7f6b9a800640 1 -- 172.21.15.42:0/4180142918 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444b2d20 msgr2=0x557a444b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:06:34.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.613+0000 7f6b99400640 1 --2- 172.21.15.42:0/4180142918 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444b2d20 0x557a444b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:06:34.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.613+0000 7f6b9a800640 1 --2- 172.21.15.42:0/4180142918 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444b2d20 0x557a444b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.614+0000 7f6b9a800640 1 -- 172.21.15.42:0/4180142918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444a8460 msgr2=0x557a444b27e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:06:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.615+0000 7f6b92a00640 1 --2- 172.21.15.42:0/4198160178 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f6b800a2d50 0x7f6b800a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:06:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.617+0000 7f6b99e00640 1 --2- 172.21.15.42:0/4180142918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444a8460 0x557a444b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:06:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.617+0000 7f6b92a00640 1 -- 172.21.15.42:0/4198160178 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f6b940ce570 con 0x7f6b9c06e290 2024-08-26T00:06:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.618+0000 7f6b9a800640 1 --2- 172.21.15.42:0/4180142918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444a8460 0x557a444b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.618+0000 7f6b9a800640 1 -- 172.21.15.42:0/4180142918 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a443c12c0 con 0x557a444a7b40 2024-08-26T00:06:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.619+0000 7f6b9a800640 1 --2- 172.21.15.42:0/4180142918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a444a7b40 0x557a444a7f20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6b88009c10 tx=0x7f6b88011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f159c0feb1daaf0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:06:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.619+0000 7f6b99400640 1 --2- 172.21.15.42:0/4180142918 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444b2d20 0x557a444b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:06:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.619+0000 7f6b87000640 1 -- 172.21.15.42:0/4180142918 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88005220 con 0x557a444a7b40 2024-08-26T00:06:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.620+0000 7f6b99e00640 1 --2- 172.21.15.42:0/4180142918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444a8460 0x557a444b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:06:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.620+0000 7f6b99400640 1 --2- 172.21.15.42:0/4198160178 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f6b800a2d50 0x7f6b800a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:06:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.620+0000 7f6b87000640 1 -- 172.21.15.42:0/4180142918 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b88004c80 con 0x557a444a7b40 2024-08-26T00:06:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.620+0000 7f6b87000640 1 -- 172.21.15.42:0/4180142918 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88019830 con 0x557a444a7b40 2024-08-26T00:06:34.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.621+0000 7f6ba35c9740 1 -- 172.21.15.42:0/4180142918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a444a7b40 msgr2=0x557a444a7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:06:34.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.621+0000 7f6ba35c9740 1 --2- 172.21.15.42:0/4180142918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a444a7b40 0x557a444a7f20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6b88009c10 tx=0x7f6b88011810 comp rx=0 tx=0).stop 2024-08-26T00:06:34.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.622+0000 7f6ba35c9740 1 -- 172.21.15.42:0/4180142918 shutdown_connections 2024-08-26T00:06:34.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.622+0000 7f6ba35c9740 1 --2- 172.21.15.42:0/4180142918 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444b2d20 0x557a444b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.622+0000 7f6ba35c9740 1 --2- 172.21.15.42:0/4180142918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444a8460 0x557a444b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.622+0000 7f6ba35c9740 1 --2- 172.21.15.42:0/4180142918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a444a7b40 0x557a444a7f20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.622+0000 7f6ba35c9740 1 -- 172.21.15.42:0/4180142918 >> 172.21.15.42:0/4180142918 conn(0x557a444a4080 msgr2=0x557a444a4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:06:34.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.629+0000 7f6ba35c9740 1 -- 172.21.15.42:0/4180142918 shutdown_connections 2024-08-26T00:06:34.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.630+0000 7f6b99400640 1 --2- 172.21.15.42:0/4198160178 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f6b800a2d50 0x7f6b800a5210 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c000c00 tx=0x7f6b8c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:06:34.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.630+0000 7f6ba35c9740 1 -- 172.21.15.42:0/4180142918 wait complete. 2024-08-26T00:06:34.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.631+0000 7f6ba35c9740 1 -- start start 2024-08-26T00:06:34.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.632+0000 7f6ba35c9740 1 Processor -- start 2024-08-26T00:06:34.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.634+0000 7f6ba35c9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444a7b40 0x557a444afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:06:34.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.634+0000 7f6ba35c9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444a8460 0x557a444b0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:06:34.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.635+0000 7f6ba35c9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a444b2d20 0x557a444b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:06:34.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.636+0000 7f6b9a800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a444b2d20 0x557a444b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:06:34.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.636+0000 7f6b9a800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a444b2d20 0x557a444b06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:39118/0 (socket says 172.21.15.42:39118) 2024-08-26T00:06:34.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.637+0000 7f6b9a800640 1 -- 172.21.15.42:0/2383407046 learned_addr learned my addr 172.21.15.42:0/2383407046 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:06:34.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.637+0000 7f6b99e00640 1 --2- 172.21.15.42:0/2383407046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444a7b40 0x557a444afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:06:34.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.637+0000 7f6ba35c9740 1 -- 172.21.15.42:0/2383407046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557a444b58f0 con 0x557a444a8460 2024-08-26T00:06:34.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.638+0000 7f6b99400640 1 --2- 172.21.15.42:0/2383407046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444a8460 0x557a444b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:06:34.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.638+0000 7f6ba35c9740 1 -- 172.21.15.42:0/2383407046 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557a443c8e50 con 0x557a444a7b40 2024-08-26T00:06:34.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.640+0000 7f6ba35c9740 1 -- 172.21.15.42:0/2383407046 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557a444b5a70 con 0x557a444b2d20 2024-08-26T00:06:34.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.640+0000 7f6ba35c9740 10 client.0 _ll_register_callbacks cb 0x557a443b3f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:06:34.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.641+0000 7f6b99400640 1 -- 172.21.15.42:0/2383407046 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a444b2d20 msgr2=0x557a444b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:06:34.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.641+0000 7f6b99400640 1 --2- 172.21.15.42:0/2383407046 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a444b2d20 0x557a444b06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.641+0000 7f6b99400640 1 -- 172.21.15.42:0/2383407046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444a7b40 msgr2=0x557a444afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:06:34.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.641+0000 7f6b99400640 1 --2- 172.21.15.42:0/2383407046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444a7b40 0x557a444afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.641+0000 7f6b99400640 1 -- 172.21.15.42:0/2383407046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a4417f3c0 con 0x557a444a8460 2024-08-26T00:06:34.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.642+0000 7f6b99e00640 1 --2- 172.21.15.42:0/2383407046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444a7b40 0x557a444afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:06:34.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.642+0000 7f6b99400640 1 --2- 172.21.15.42:0/2383407046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444a8460 0x557a444b0160 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c02aa00 tx=0x7f6b8c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff9ecf7e2822c9c server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:06:34.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.642+0000 7f6b7b400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:06:34.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.643+0000 7f6b7b400640 1 -- 172.21.15.42:0/2383407046 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c04d020 con 0x557a444a8460 2024-08-26T00:06:34.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.643+0000 7f6b7b400640 1 -- 172.21.15.42:0/2383407046 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f6b8c0048c0 con 0x557a444a8460 2024-08-26T00:06:34.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.643+0000 7f6ba35c9740 1 -- 172.21.15.42:0/2383407046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b88004c80 con 0x557a444a8460 2024-08-26T00:06:34.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.644+0000 7f6b7b400640 1 -- 172.21.15.42:0/2383407046 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6b8c035040 con 0x557a444a8460 2024-08-26T00:06:34.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.644+0000 7f6ba35c9740 10 client.15498 fetch_fsmap learned FSMap version 29 2024-08-26T00:06:34.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.644+0000 7f6ba35c9740 1 -- 172.21.15.42:0/2383407046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557a444c14e0 con 0x557a444a8460 2024-08-26T00:06:34.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.645+0000 7f6b7b400640 1 -- 172.21.15.42:0/2383407046 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b88004c80 con 0x557a444a8460 2024-08-26T00:06:34.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.646+0000 7f6b7b400640 1 -- 172.21.15.42:0/2383407046 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f6b8c004ac0 con 0x557a444a8460 2024-08-26T00:06:34.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.646+0000 7f6ba35c9740 10 client.15498 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:06:34.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.646+0000 7f6ba35c9740 10 client.15498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:06:34.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.647+0000 7f6ba35c9740 20 client.15498 populate_metadata read hostname 'smithi042' 2024-08-26T00:06:34.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.647+0000 7f6ba35c9740 1 --2- 172.21.15.42:0/2383407046 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x557a444c28f0 0x557a444c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:06:34.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.647+0000 7f6ba35c9740 4 client.15498 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:06:34.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.647+0000 7f6ba35c9740 1 -- 172.21.15.42:0/2383407046 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a4441b530 con 0x557a444c28f0 2024-08-26T00:06:34.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.648+0000 7f6b99e00640 1 --2- 172.21.15.42:0/2383407046 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x557a444c28f0 0x557a444c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:06:34.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.648+0000 7f6b99e00640 1 --2- 172.21.15.42:0/2383407046 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x557a444c28f0 0x557a444c4d60 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7e70326df66a81a server_cookie=296dcc81a9640fba in_seq=0 out_seq=0 2024-08-26T00:06:34.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.648+0000 7f6b7b400640 10 client.15498 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:06:34.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.649+0000 7f6b7b400640 1 -- 172.21.15.42:0/2383407046 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557a4441b530 con 0x557a444c28f0 2024-08-26T00:06:34.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.649+0000 7f6b7b400640 10 client.15498 handle_command_reply: tid=0 2024-08-26T00:06:34.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.650+0000 7f6ba35c9740 1 client.15498 shutdown 2024-08-26T00:06:34.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.650+0000 7f6ba35c9740 1 -- 172.21.15.42:0/2383407046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444a8460 msgr2=0x557a444b0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:06:34.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.650+0000 7f6ba35c9740 1 --2- 172.21.15.42:0/2383407046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444a8460 0x557a444b0160 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c02aa00 tx=0x7f6b8c02a410 comp rx=0 tx=0).stop 2024-08-26T00:06:34.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.651+0000 7f6ba35c9740 1 -- 172.21.15.42:0/2383407046 shutdown_connections 2024-08-26T00:06:34.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.651+0000 7f6ba35c9740 1 --2- 172.21.15.42:0/2383407046 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a444b2d20 0x557a444b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.651+0000 7f6ba35c9740 1 --2- 172.21.15.42:0/2383407046 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x557a444c28f0 0x557a444c4d60 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.651+0000 7f6ba35c9740 1 --2- 172.21.15.42:0/2383407046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444a8460 0x557a444b0160 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.651+0000 7f6ba35c9740 1 --2- 172.21.15.42:0/2383407046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444a7b40 0x557a444afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.651+0000 7f6b7b400640 0 client.15498 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:06:34.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.651+0000 7f6ba35c9740 1 -- 172.21.15.42:0/2383407046 >> 172.21.15.42:0/2383407046 conn(0x557a444a4080 msgr2=0x557a444a3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:06:34.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.653+0000 7f6ba35c9740 1 -- 172.21.15.42:0/2383407046 shutdown_connections 2024-08-26T00:06:34.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.653+0000 7f6ba35c9740 1 -- 172.21.15.42:0/2383407046 wait complete. 2024-08-26T00:06:34.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.654+0000 7f6ba35c9740 20 client.15498 trim_cache size 0 max 16384 2024-08-26T00:06:34.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.705+0000 7f6ba35c9740 1 Processor -- start 2024-08-26T00:06:34.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.706+0000 7f6ba35c9740 1 -- start start 2024-08-26T00:06:34.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.706+0000 7f6ba35c9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444a7b40 0x557a444aa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:06:34.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.706+0000 7f6ba35c9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444a8460 0x557a444ca630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:06:34.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.706+0000 7f6ba35c9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a444b2d20 0x557a444cab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:06:34.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.706+0000 7f6ba35c9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c1be920 con 0x557a444a8460 2024-08-26T00:06:34.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.706+0000 7f6ba35c9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c1bc130 con 0x557a444a7b40 2024-08-26T00:06:34.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.706+0000 7f6ba35c9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c1b9f60 con 0x557a444b2d20 2024-08-26T00:06:34.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.707+0000 7f6b99e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444a7b40 0x557a444aa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:06:34.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.707+0000 7f6b99e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444a7b40 0x557a444aa5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:59834/0 (socket says 172.21.15.42:59834) 2024-08-26T00:06:34.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.707+0000 7f6b99e00640 1 -- 172.21.15.42:0/3014061461 learned_addr learned my addr 172.21.15.42:0/3014061461 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:06:34.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.707+0000 7f6b99e00640 1 -- 172.21.15.42:0/3014061461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a444b2d20 msgr2=0x557a444cab70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-26T00:06:34.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.707+0000 7f6b99e00640 1 --2- 172.21.15.42:0/3014061461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a444b2d20 0x557a444cab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.707+0000 7f6b99e00640 1 -- 172.21.15.42:0/3014061461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444a8460 msgr2=0x557a444ca630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:06:34.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.708+0000 7f6b99400640 1 --2- 172.21.15.42:0/3014061461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444a8460 0x557a444ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:06:34.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.708+0000 7f6b99e00640 1 --2- 172.21.15.42:0/3014061461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444a8460 0x557a444ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.708+0000 7f6b99e00640 1 -- 172.21.15.42:0/3014061461 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a444c53e0 con 0x557a444a7b40 2024-08-26T00:06:34.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.708+0000 7f6b99400640 1 --2- 172.21.15.42:0/3014061461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444a8460 0x557a444ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:06:34.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.709+0000 7f6b99e00640 1 --2- 172.21.15.42:0/3014061461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444a7b40 0x557a444aa5a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6b9409add0 tx=0x7f6b940ce040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d473796c0086c7a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:06:34.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.709+0000 7f6b86600640 1 -- 172.21.15.42:0/3014061461 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b940a8070 con 0x557a444a7b40 2024-08-26T00:06:34.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.709+0000 7f6b86600640 1 -- 172.21.15.42:0/3014061461 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b94099140 con 0x557a444a7b40 2024-08-26T00:06:34.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.709+0000 7f6b86600640 1 -- 172.21.15.42:0/3014061461 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b940a3570 con 0x557a444a7b40 2024-08-26T00:06:34.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.711+0000 7f6ba35c9740 1 -- 172.21.15.42:0/3014061461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444a7b40 msgr2=0x557a444aa5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:06:34.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.711+0000 7f6ba35c9740 1 --2- 172.21.15.42:0/3014061461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444a7b40 0x557a444aa5a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6b9409add0 tx=0x7f6b940ce040 comp rx=0 tx=0).stop 2024-08-26T00:06:34.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.711+0000 7f6ba35c9740 1 -- 172.21.15.42:0/3014061461 shutdown_connections 2024-08-26T00:06:34.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.712+0000 7f6ba35c9740 1 --2- 172.21.15.42:0/3014061461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a444b2d20 0x557a444cab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.712+0000 7f6ba35c9740 1 --2- 172.21.15.42:0/3014061461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444a8460 0x557a444ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.712+0000 7f6ba35c9740 1 --2- 172.21.15.42:0/3014061461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444a7b40 0x557a444aa5a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.712+0000 7f6ba35c9740 1 -- 172.21.15.42:0/3014061461 >> 172.21.15.42:0/3014061461 conn(0x557a444a4080 msgr2=0x557a444ae4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:06:34.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.712+0000 7f6ba35c9740 1 -- 172.21.15.42:0/3014061461 shutdown_connections 2024-08-26T00:06:34.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.712+0000 7f6ba35c9740 1 -- 172.21.15.42:0/3014061461 wait complete. 2024-08-26T00:06:34.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.713+0000 7f6ba35c9740 1 -- start start 2024-08-26T00:06:34.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.713+0000 7f6ba35c9740 1 Processor -- start 2024-08-26T00:06:34.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.716+0000 7f6ba35c9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a444a7b40 0x557a444bb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:06:34.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.716+0000 7f6ba35c9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444a8460 0x557a444b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:06:34.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.716+0000 7f6ba35c9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444b2d20 0x557a444b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:06:34.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.717+0000 7f6b9a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444b2d20 0x557a444b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:06:34.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.717+0000 7f6b9a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444b2d20 0x557a444b6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59246/0 (socket says 172.21.15.42:59246) 2024-08-26T00:06:34.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.717+0000 7f6b9a800640 1 -- 172.21.15.42:0/2239565677 learned_addr learned my addr 172.21.15.42:0/2239565677 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:06:34.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.717+0000 7f6ba35c9740 1 -- 172.21.15.42:0/2239565677 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c1ba5f0 con 0x557a444b2d20 2024-08-26T00:06:34.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.717+0000 7f6ba35c9740 1 -- 172.21.15.42:0/2239565677 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c1bba60 con 0x557a444a8460 2024-08-26T00:06:34.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.717+0000 7f6ba35c9740 1 -- 172.21.15.42:0/2239565677 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c1bacc0 con 0x557a444a7b40 2024-08-26T00:06:34.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.718+0000 7f6b99e00640 1 --2- 172.21.15.42:0/2239565677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a444a7b40 0x557a444bb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:06:34.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.719+0000 7f6b99400640 1 --2- 172.21.15.42:0/2239565677 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444a8460 0x557a444b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:06:34.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.720+0000 7f6ba35c9740 10 client.0 _ll_register_callbacks cb 0x7f6b8c040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:06:34.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.721+0000 7f6b99e00640 1 -- 172.21.15.42:0/2239565677 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444a8460 msgr2=0x557a444b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:06:34.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.721+0000 7f6b99e00640 1 --2- 172.21.15.42:0/2239565677 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444a8460 0x557a444b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.721+0000 7f6b99e00640 1 -- 172.21.15.42:0/2239565677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444b2d20 msgr2=0x557a444b6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:06:34.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.721+0000 7f6b99e00640 1 --2- 172.21.15.42:0/2239565677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444b2d20 0x557a444b6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.721+0000 7f6b99e00640 1 -- 172.21.15.42:0/2239565677 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a444b7440 con 0x557a444a7b40 2024-08-26T00:06:34.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.721+0000 7f6b9a800640 1 --2- 172.21.15.42:0/2239565677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444b2d20 0x557a444b6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:06:34.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.722+0000 7f6b99400640 1 --2- 172.21.15.42:0/2239565677 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444a8460 0x557a444b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:06:34.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.723+0000 7f6ba35c9740 1 -- 172.21.15.42:0/2239565677 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b94099140 con 0x557a444a7b40 2024-08-26T00:06:34.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.724+0000 7f6b7b400640 10 client.25537 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:06:34.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.726+0000 7f6b99e00640 1 --2- 172.21.15.42:0/2239565677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a444a7b40 0x557a444bb3d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6b9409ab40 tx=0x7f6b940b3f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2cbbd5df0ce9bc3 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:06:34.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.727+0000 7f6b7b400640 1 -- 172.21.15.42:0/2239565677 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b940a8070 con 0x557a444a7b40 2024-08-26T00:06:34.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.728+0000 7f6b7b400640 1 -- 172.21.15.42:0/2239565677 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f6b94014730 con 0x557a444a7b40 2024-08-26T00:06:34.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.728+0000 7f6b7b400640 1 -- 172.21.15.42:0/2239565677 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6b940a8070 con 0x557a444a7b40 2024-08-26T00:06:34.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.729+0000 7f6ba35c9740 10 client.25537 fetch_fsmap learned FSMap version 29 2024-08-26T00:06:34.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.729+0000 7f6ba35c9740 1 -- 172.21.15.42:0/2239565677 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=29}) -- 0x557a4452d470 con 0x557a444a7b40 2024-08-26T00:06:34.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.729+0000 7f6b7b400640 1 -- 172.21.15.42:0/2239565677 <== mon.1 v2:172.21.15.181:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f6b940974b0 con 0x557a444a7b40 2024-08-26T00:06:34.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.730+0000 7f6ba35c9740 10 client.25537 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:06:34.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.730+0000 7f6ba35c9740 10 client.25537 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:06:34.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.730+0000 7f6ba35c9740 20 client.25537 populate_metadata read hostname 'smithi042' 2024-08-26T00:06:34.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.730+0000 7f6ba35c9740 1 --2- 172.21.15.42:0/2239565677 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x557a4452d970 0x557a4452fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:06:34.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.730+0000 7f6ba35c9740 4 client.25537 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-26T00:06:34.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.730+0000 7f6ba35c9740 1 -- 172.21.15.42:0/2239565677 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557a44415a40 con 0x557a4452d970 2024-08-26T00:06:34.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.730+0000 7f6b99400640 1 --2- 172.21.15.42:0/2239565677 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x557a4452d970 0x557a4452fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:06:34.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.732+0000 7f6b99400640 1 --2- 172.21.15.42:0/2239565677 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x557a4452d970 0x557a4452fd60 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c676a802164e96f server_cookie=241154ebcb77b6de in_seq=0 out_seq=0 2024-08-26T00:06:34.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.732+0000 7f6b7b400640 10 client.25537 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:06:34.751 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:06:34.751 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-08-26T00:06:34.751 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {} 2024-08-26T00:06:34.751 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:06:34.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.732+0000 7f6b7b400640 1 -- 172.21.15.42:0/2239565677 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557a44415a40 con 0x557a4452d970 2024-08-26T00:06:34.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.732+0000 7f6b7b400640 10 client.25537 handle_command_reply: tid=0 2024-08-26T00:06:34.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.735+0000 7f6ba35c9740 1 client.25537 shutdown 2024-08-26T00:06:34.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.735+0000 7f6ba35c9740 1 -- 172.21.15.42:0/2239565677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a444a7b40 msgr2=0x557a444bb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:06:34.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.735+0000 7f6ba35c9740 1 --2- 172.21.15.42:0/2239565677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a444a7b40 0x557a444bb3d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6b9409ab40 tx=0x7f6b940b3f90 comp rx=0 tx=0).stop 2024-08-26T00:06:34.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.735+0000 7f6ba35c9740 1 -- 172.21.15.42:0/2239565677 shutdown_connections 2024-08-26T00:06:34.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.735+0000 7f6ba35c9740 1 --2- 172.21.15.42:0/2239565677 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x557a4452d970 0x557a4452fd60 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.735+0000 7f6ba35c9740 1 --2- 172.21.15.42:0/2239565677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a444b2d20 0x557a444b6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.735+0000 7f6ba35c9740 1 --2- 172.21.15.42:0/2239565677 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a444a8460 0x557a444b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.735+0000 7f6ba35c9740 1 --2- 172.21.15.42:0/2239565677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a444a7b40 0x557a444bb3d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.735+0000 7f6ba35c9740 1 -- 172.21.15.42:0/2239565677 >> 172.21.15.42:0/2239565677 conn(0x557a444a4080 msgr2=0x557a444a2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:06:34.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.735+0000 7f6b7b400640 0 client.25537 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:06:34.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.736+0000 7f6ba35c9740 1 -- 172.21.15.42:0/2239565677 shutdown_connections 2024-08-26T00:06:34.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.736+0000 7f6ba35c9740 1 -- 172.21.15.42:0/2239565677 wait complete. 2024-08-26T00:06:34.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.736+0000 7f6ba35c9740 20 client.25537 trim_cache size 0 max 16384 2024-08-26T00:06:34.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.738+0000 7f6b9b200640 1 -- 172.21.15.42:0/4198160178 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f6b800a2d50 msgr2=0x7f6b800a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:06:34.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.738+0000 7f6b9b200640 1 --2- 172.21.15.42:0/4198160178 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f6b800a2d50 0x7f6b800a5210 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c000c00 tx=0x7f6b8c005b50 comp rx=0 tx=0).stop 2024-08-26T00:06:34.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.738+0000 7f6b9b200640 1 -- 172.21.15.42:0/4198160178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b9c06e290 msgr2=0x7f6b9c10c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:06:34.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.738+0000 7f6b9b200640 1 --2- 172.21.15.42:0/4198160178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b9c06e290 0x7f6b9c10c970 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6b9400ba50 tx=0x7f6b9400bf10 comp rx=0 tx=0).stop 2024-08-26T00:06:34.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.738+0000 7f6b9b200640 1 -- 172.21.15.42:0/4198160178 shutdown_connections 2024-08-26T00:06:34.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.738+0000 7f6b9b200640 1 --2- 172.21.15.42:0/4198160178 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f6b800a2d50 0x7f6b800a5210 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.738+0000 7f6b9b200640 1 --2- 172.21.15.42:0/4198160178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b9c114850 0x7f6b9c1b2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.738+0000 7f6b9b200640 1 --2- 172.21.15.42:0/4198160178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b9c06ebb0 0x7f6b9c10ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.738+0000 7f6b9b200640 1 --2- 172.21.15.42:0/4198160178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b9c06e290 0x7f6b9c10c970 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:34.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.738+0000 7f6b9b200640 1 -- 172.21.15.42:0/4198160178 >> 172.21.15.42:0/4198160178 conn(0x7f6b9c072f20 msgr2=0x7f6b9c06b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:06:34.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.739+0000 7f6b9b200640 1 -- 172.21.15.42:0/4198160178 shutdown_connections 2024-08-26T00:06:34.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:34.739+0000 7f6b9b200640 1 -- 172.21.15.42:0/4198160178 wait complete. 2024-08-26T00:06:36.290 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:36 smithi042 ceph-mon[17225]: pgmap v461: 97 pgs: 97 active+clean; 875 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 11 MiB/s wr, 714 op/s 2024-08-26T00:06:36.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:36 smithi043 ceph-mon[22091]: pgmap v461: 97 pgs: 97 active+clean; 875 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 11 MiB/s wr, 714 op/s 2024-08-26T00:06:36.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:36 smithi181 ceph-mon[22102]: pgmap v461: 97 pgs: 97 active+clean; 875 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 11 MiB/s wr, 714 op/s 2024-08-26T00:06:37.159 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-26T00:06:37.159 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:06:38.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:38 smithi043 ceph-mon[22091]: pgmap v462: 97 pgs: 97 active+clean; 875 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 8.7 MiB/s wr, 589 op/s 2024-08-26T00:06:38.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:38 smithi042 ceph-mon[17225]: pgmap v462: 97 pgs: 97 active+clean; 875 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 8.7 MiB/s wr, 589 op/s 2024-08-26T00:06:38.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:38 smithi181 ceph-mon[22102]: pgmap v462: 97 pgs: 97 active+clean; 875 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 8.7 MiB/s wr, 589 op/s 2024-08-26T00:06:40.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:40 smithi043 ceph-mon[22091]: pgmap v463: 97 pgs: 97 active+clean; 881 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.3 MiB/s wr, 335 op/s 2024-08-26T00:06:40.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:40 smithi181 ceph-mon[22102]: pgmap v463: 97 pgs: 97 active+clean; 881 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.3 MiB/s wr, 335 op/s 2024-08-26T00:06:40.536 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:40 smithi042 ceph-mon[17225]: pgmap v463: 97 pgs: 97 active+clean; 881 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.3 MiB/s wr, 335 op/s 2024-08-26T00:06:41.669 INFO:tasks.workunit.client.0.smithi042.stdout: 276 652356 1948 440119 1943 228123 620 2024-08-26T00:06:42.260 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:42 smithi042 ceph-mon[17225]: pgmap v464: 97 pgs: 97 active+clean; 883 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 200 op/s 2024-08-26T00:06:42.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:42 smithi043 ceph-mon[22091]: pgmap v464: 97 pgs: 97 active+clean; 883 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 200 op/s 2024-08-26T00:06:42.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:42 smithi181 ceph-mon[22102]: pgmap v464: 97 pgs: 97 active+clean; 883 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 200 op/s 2024-08-26T00:06:43.924 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:06:44.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:44 smithi043 ceph-mon[22091]: pgmap v465: 97 pgs: 97 active+clean; 890 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 229 op/s 2024-08-26T00:06:44.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:44 smithi181 ceph-mon[22102]: pgmap v465: 97 pgs: 97 active+clean; 890 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 229 op/s 2024-08-26T00:06:44.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:44 smithi042 ceph-mon[17225]: pgmap v465: 97 pgs: 97 active+clean; 890 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 229 op/s 2024-08-26T00:06:46.411 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:46 smithi042 ceph-mon[17225]: pgmap v466: 97 pgs: 97 active+clean; 905 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.1 MiB/s wr, 273 op/s 2024-08-26T00:06:46.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:46 smithi043 ceph-mon[22091]: pgmap v466: 97 pgs: 97 active+clean; 905 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.1 MiB/s wr, 273 op/s 2024-08-26T00:06:46.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:46 smithi181 ceph-mon[22102]: pgmap v466: 97 pgs: 97 active+clean; 905 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.1 MiB/s wr, 273 op/s 2024-08-26T00:06:46.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.597+0000 7f0fe9000640 1 -- 172.21.15.42:0/445562458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fe4103b50 msgr2=0x7f0fe4103fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:06:46.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.598+0000 7f0fe0a00640 1 -- 172.21.15.42:0/445562458 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0035020 con 0x7f0fe4103b50 2024-08-26T00:06:46.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.598+0000 7f0fe9000640 1 --2- 172.21.15.42:0/445562458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fe4103b50 0x7f0fe4103fb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0009930 tx=0x7f0fd002a420 comp rx=0 tx=0).stop 2024-08-26T00:06:46.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.599+0000 7f0fe9000640 1 -- 172.21.15.42:0/445562458 shutdown_connections 2024-08-26T00:06:46.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.600+0000 7f0fe9000640 1 --2- 172.21.15.42:0/445562458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fe41044f0 0x7f0fe41109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:46.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.600+0000 7f0fe9000640 1 --2- 172.21.15.42:0/445562458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fe4103b50 0x7f0fe4103fb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:46.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.600+0000 7f0fe9000640 1 --2- 172.21.15.42:0/445562458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fe4109c00 0x7f0fe4109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:46.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.600+0000 7f0fe9000640 1 -- 172.21.15.42:0/445562458 >> 172.21.15.42:0/445562458 conn(0x7f0fe40ff830 msgr2=0x7f0fe4101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:06:46.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.601+0000 7f0fe9000640 1 -- 172.21.15.42:0/445562458 shutdown_connections 2024-08-26T00:06:46.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.601+0000 7f0fe9000640 1 -- 172.21.15.42:0/445562458 wait complete. 2024-08-26T00:06:46.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.603+0000 7f0fe9000640 1 Processor -- start 2024-08-26T00:06:46.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.604+0000 7f0fe9000640 1 -- start start 2024-08-26T00:06:46.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.605+0000 7f0fe9000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fe4103b50 0x7f0fe410ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:06:46.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.605+0000 7f0fe9000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fe41044f0 0x7f0fe411ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:06:46.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.605+0000 7f0fe9000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fe4109c00 0x7f0fe410f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:06:46.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.605+0000 7f0fe1e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fe4103b50 0x7f0fe410ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:06:46.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.605+0000 7f0fe1e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fe4103b50 0x7f0fe410ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:39796/0 (socket says 172.21.15.42:39796) 2024-08-26T00:06:46.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.605+0000 7f0fe1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fe41044f0 0x7f0fe411ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:06:46.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.605+0000 7f0fe1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fe41044f0 0x7f0fe411ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51870/0 (socket says 172.21.15.42:51870) 2024-08-26T00:06:46.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.609+0000 7f0fe1e00640 1 -- 172.21.15.42:0/694587309 learned_addr learned my addr 172.21.15.42:0/694587309 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:06:46.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.609+0000 7f0fe9000640 1 -- 172.21.15.42:0/694587309 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe4077570 con 0x7f0fe41044f0 2024-08-26T00:06:46.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.609+0000 7f0fe9000640 1 -- 172.21.15.42:0/694587309 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe40773f0 con 0x7f0fe4109c00 2024-08-26T00:06:46.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.609+0000 7f0fe9000640 1 -- 172.21.15.42:0/694587309 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe40776f0 con 0x7f0fe4103b50 2024-08-26T00:06:46.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.609+0000 7f0fe2800640 1 --2- 172.21.15.42:0/694587309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fe4109c00 0x7f0fe410f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:06:46.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.610+0000 7f0fe1e00640 1 -- 172.21.15.42:0/694587309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fe4109c00 msgr2=0x7f0fe410f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:06:46.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.610+0000 7f0fe1e00640 1 --2- 172.21.15.42:0/694587309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fe4109c00 0x7f0fe410f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:46.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.610+0000 7f0fe1e00640 1 -- 172.21.15.42:0/694587309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fe41044f0 msgr2=0x7f0fe411ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:06:46.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.611+0000 7f0fe1e00640 1 --2- 172.21.15.42:0/694587309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fe41044f0 0x7f0fe411ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:46.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.611+0000 7f0fe1e00640 1 -- 172.21.15.42:0/694587309 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe410fc80 con 0x7f0fe4103b50 2024-08-26T00:06:46.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.611+0000 7f0fe1400640 1 --2- 172.21.15.42:0/694587309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fe41044f0 0x7f0fe411ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:06:46.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.611+0000 7f0fe1e00640 1 --2- 172.21.15.42:0/694587309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fe4103b50 0x7f0fe410ef70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0fd400d950 tx=0x7f0fd400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:06:46.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.613+0000 7f0fdaa00640 1 -- 172.21.15.42:0/694587309 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4017070 con 0x7f0fe4103b50 2024-08-26T00:06:46.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.613+0000 7f0fdaa00640 1 -- 172.21.15.42:0/694587309 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fd4009c30 con 0x7f0fe4103b50 2024-08-26T00:06:46.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.613+0000 7f0fdaa00640 1 -- 172.21.15.42:0/694587309 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd400f6b0 con 0x7f0fe4103b50 2024-08-26T00:06:46.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.616+0000 7f0fe9000640 1 -- 172.21.15.42:0/694587309 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fe41b3350 con 0x7f0fe4103b50 2024-08-26T00:06:46.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.616+0000 7f0fe9000640 1 -- 172.21.15.42:0/694587309 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fe41b3840 con 0x7f0fe4103b50 2024-08-26T00:06:46.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.626+0000 7f0fe9000640 1 -- 172.21.15.42:0/694587309 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fc4005290 con 0x7f0fe4103b50 2024-08-26T00:06:46.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.648+0000 7f0fdaa00640 1 -- 172.21.15.42:0/694587309 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0fd400f850 con 0x7f0fe4103b50 2024-08-26T00:06:46.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.650+0000 7f0fdaa00640 1 --2- 172.21.15.42:0/694587309 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0fc80a2da0 0x7f0fc80a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:06:46.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.652+0000 7f0fe1400640 1 --2- 172.21.15.42:0/694587309 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0fc80a2da0 0x7f0fc80a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:06:46.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.656+0000 7f0fdaa00640 1 -- 172.21.15.42:0/694587309 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f0fd40ce860 con 0x7f0fe4103b50 2024-08-26T00:06:46.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.656+0000 7f0fe1400640 1 --2- 172.21.15.42:0/694587309 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0fc80a2da0 0x7f0fc80a5260 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4110a00 tx=0x7f0fd000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:06:46.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:46.659+0000 7f0fdaa00640 1 -- 172.21.15.42:0/694587309 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f0fd4020070 con 0x7f0fe4103b50 2024-08-26T00:06:47.182 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:06:47.182 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":29,"btime":"2024-08-26T00:06:29:181606+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3168581452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3168581452},{"type":"v1","addr":"172.21.15.42:6839","nonce":3168581452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/3533492491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":3533492491},{"type":"v1","addr":"172.21.15.42:6841","nonce":3533492491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-26T00:00:30.169633+0000","modified":"2024-08-26T00:06:28.596366+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24532,"mds_1":24527,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6839/2653014277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2653014277},{"type":"v1","addr":"172.21.15.43:6839","nonce":2653014277}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24532,"qdb_cluster":[24514,24527,24532]},"id":1}]} 2024-08-26T00:06:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:47.168+0000 7f0fe9000640 1 -- 172.21.15.42:0/694587309 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0fc4005580 con 0x7f0fe4103b50 2024-08-26T00:06:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:47.170+0000 7f0fdaa00640 1 -- 172.21.15.42:0/694587309 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11918 (secure 0 0 0) 0x7f0fd409b800 con 0x7f0fe4103b50 2024-08-26T00:06:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 29 2024-08-26T00:06:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:47.180+0000 7f0fe9000640 1 -- 172.21.15.42:0/694587309 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0fc80a2da0 msgr2=0x7f0fc80a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:06:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:47.180+0000 7f0fe9000640 1 --2- 172.21.15.42:0/694587309 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0fc80a2da0 0x7f0fc80a5260 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4110a00 tx=0x7f0fd000b040 comp rx=0 tx=0).stop 2024-08-26T00:06:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:47.180+0000 7f0fe9000640 1 -- 172.21.15.42:0/694587309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fe4103b50 msgr2=0x7f0fe410ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:06:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:47.180+0000 7f0fe9000640 1 --2- 172.21.15.42:0/694587309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fe4103b50 0x7f0fe410ef70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0fd400d950 tx=0x7f0fd400de10 comp rx=0 tx=0).stop 2024-08-26T00:06:47.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:47.182+0000 7f0fe9000640 1 -- 172.21.15.42:0/694587309 shutdown_connections 2024-08-26T00:06:47.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:47.182+0000 7f0fe9000640 1 --2- 172.21.15.42:0/694587309 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0fc80a2da0 0x7f0fc80a5260 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:47.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:47.182+0000 7f0fe9000640 1 --2- 172.21.15.42:0/694587309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fe4109c00 0x7f0fe410f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:47.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:47.182+0000 7f0fe9000640 1 --2- 172.21.15.42:0/694587309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fe41044f0 0x7f0fe411ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:47.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:47.182+0000 7f0fe9000640 1 --2- 172.21.15.42:0/694587309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fe4103b50 0x7f0fe410ef70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:06:47.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:47.182+0000 7f0fe9000640 1 -- 172.21.15.42:0/694587309 >> 172.21.15.42:0/694587309 conn(0x7f0fe40ff830 msgr2=0x7f0fe4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:06:47.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:47.182+0000 7f0fe9000640 1 -- 172.21.15.42:0/694587309 shutdown_connections 2024-08-26T00:06:47.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:06:47.182+0000 7f0fe9000640 1 -- 172.21.15.42:0/694587309 wait complete. 2024-08-26T00:06:47.261 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:47 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/694587309' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:06:47.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:47 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/694587309' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:06:47.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:47 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/694587309' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:06:48.433 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:48 smithi042 ceph-mon[17225]: pgmap v467: 97 pgs: 97 active+clean; 929 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.4 MiB/s wr, 337 op/s 2024-08-26T00:06:48.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:48 smithi181 ceph-mon[22102]: pgmap v467: 97 pgs: 97 active+clean; 929 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.4 MiB/s wr, 337 op/s 2024-08-26T00:06:48.661 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:48 smithi043 ceph-mon[22091]: pgmap v467: 97 pgs: 97 active+clean; 929 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.4 MiB/s wr, 337 op/s 2024-08-26T00:06:49.141 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-26T00:06:50.339 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:50 smithi042 ceph-mon[17225]: pgmap v468: 97 pgs: 97 active+clean; 943 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.6 MiB/s wr, 398 op/s 2024-08-26T00:06:50.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:50 smithi181 ceph-mon[22102]: pgmap v468: 97 pgs: 97 active+clean; 943 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.6 MiB/s wr, 398 op/s 2024-08-26T00:06:50.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:50 smithi043 ceph-mon[22091]: pgmap v468: 97 pgs: 97 active+clean; 943 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.6 MiB/s wr, 398 op/s 2024-08-26T00:06:51.688 INFO:tasks.workunit.client.0.smithi042.stdout: 288 495646 742 334107 691 164758 486 2024-08-26T00:06:52.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:52 smithi042 ceph-mon[17225]: pgmap v469: 97 pgs: 97 active+clean; 1016 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 12 MiB/s wr, 628 op/s 2024-08-26T00:06:52.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:52 smithi181 ceph-mon[22102]: pgmap v469: 97 pgs: 97 active+clean; 1016 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 12 MiB/s wr, 628 op/s 2024-08-26T00:06:52.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:52 smithi043 ceph-mon[22091]: pgmap v469: 97 pgs: 97 active+clean; 1016 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 12 MiB/s wr, 628 op/s 2024-08-26T00:06:53.487 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:53 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:06:53.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:53 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:06:53.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:53 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:06:54.613 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:54 smithi042 ceph-mon[17225]: pgmap v470: 97 pgs: 97 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 18 MiB/s wr, 885 op/s 2024-08-26T00:06:54.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:54 smithi043 ceph-mon[22091]: pgmap v470: 97 pgs: 97 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 18 MiB/s wr, 885 op/s 2024-08-26T00:06:54.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:54 smithi181 ceph-mon[22102]: pgmap v470: 97 pgs: 97 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 18 MiB/s wr, 885 op/s 2024-08-26T00:06:56.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:56 smithi043 ceph-mon[22091]: pgmap v471: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 21 MiB/s wr, 1.03k op/s 2024-08-26T00:06:56.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:56 smithi042 ceph-mon[17225]: pgmap v471: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 21 MiB/s wr, 1.03k op/s 2024-08-26T00:06:56.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:56 smithi181 ceph-mon[22102]: pgmap v471: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 21 MiB/s wr, 1.03k op/s 2024-08-26T00:06:58.694 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:06:58 smithi042 ceph-mon[17225]: pgmap v472: 97 pgs: 97 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 22 MiB/s wr, 1.06k op/s 2024-08-26T00:06:58.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:06:58 smithi043 ceph-mon[22091]: pgmap v472: 97 pgs: 97 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 22 MiB/s wr, 1.06k op/s 2024-08-26T00:06:58.774 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:06:58.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:06:58 smithi181 ceph-mon[22102]: pgmap v472: 97 pgs: 97 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 22 MiB/s wr, 1.06k op/s 2024-08-26T00:07:00.647 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:00 smithi042 ceph-mon[17225]: pgmap v473: 97 pgs: 97 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 20 MiB/s wr, 1.01k op/s 2024-08-26T00:07:00.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:00 smithi043 ceph-mon[22091]: pgmap v473: 97 pgs: 97 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 20 MiB/s wr, 1.01k op/s 2024-08-26T00:07:00.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:00 smithi181 ceph-mon[22102]: pgmap v473: 97 pgs: 97 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 20 MiB/s wr, 1.01k op/s 2024-08-26T00:07:00.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.846+0000 7f4901400640 1 -- 172.21.15.42:0/597573247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48fc109c00 msgr2=0x7f48fc109fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:00.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.846+0000 7f4901400640 1 --2- 172.21.15.42:0/597573247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48fc109c00 0x7f48fc109fe0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009cd0 tx=0x7f48f402a910 comp rx=0 tx=0).stop 2024-08-26T00:07:00.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.848+0000 7f4901400640 1 -- 172.21.15.42:0/597573247 shutdown_connections 2024-08-26T00:07:00.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.848+0000 7f4901400640 1 --2- 172.21.15.42:0/597573247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48fc1044f0 0x7f48fc1109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.848+0000 7f4901400640 1 --2- 172.21.15.42:0/597573247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48fc103b50 0x7f48fc103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.848+0000 7f4901400640 1 --2- 172.21.15.42:0/597573247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48fc109c00 0x7f48fc109fe0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.848+0000 7f4901400640 1 -- 172.21.15.42:0/597573247 >> 172.21.15.42:0/597573247 conn(0x7f48fc0ff830 msgr2=0x7f48fc101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:00.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.850+0000 7f4901400640 1 -- 172.21.15.42:0/597573247 shutdown_connections 2024-08-26T00:07:00.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.850+0000 7f4901400640 1 -- 172.21.15.42:0/597573247 wait complete. 2024-08-26T00:07:00.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.852+0000 7f4901400640 1 Processor -- start 2024-08-26T00:07:00.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.853+0000 7f4901400640 1 -- start start 2024-08-26T00:07:00.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.857+0000 7f4901400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48fc103b50 0x7f48fc0736c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:00.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.858+0000 7f4901400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48fc1044f0 0x7f48fc073c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:00.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.858+0000 7f4901400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48fc109c00 0x7f48fc06c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:00.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.858+0000 7f48fb200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48fc109c00 0x7f48fc06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:00.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.858+0000 7f48fb200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48fc109c00 0x7f48fc06c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40692/0 (socket says 172.21.15.42:40692) 2024-08-26T00:07:00.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.858+0000 7f48fb200640 1 -- 172.21.15.42:0/1067017016 learned_addr learned my addr 172.21.15.42:0/1067017016 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:00.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.858+0000 7f4901400640 1 -- 172.21.15.42:0/1067017016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc113fb0 con 0x7f48fc109c00 2024-08-26T00:07:00.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.859+0000 7f4901400640 1 -- 172.21.15.42:0/1067017016 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc113e30 con 0x7f48fc1044f0 2024-08-26T00:07:00.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.859+0000 7f4901400640 1 -- 172.21.15.42:0/1067017016 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc114130 con 0x7f48fc103b50 2024-08-26T00:07:00.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.859+0000 7f48f9e00640 1 --2- 172.21.15.42:0/1067017016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48fc1044f0 0x7f48fc073c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:00.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.860+0000 7f48fb200640 1 -- 172.21.15.42:0/1067017016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48fc103b50 msgr2=0x7f48fc0736c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-26T00:07:00.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.860+0000 7f48fb200640 1 --2- 172.21.15.42:0/1067017016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48fc103b50 0x7f48fc0736c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.860+0000 7f48fb200640 1 -- 172.21.15.42:0/1067017016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48fc1044f0 msgr2=0x7f48fc073c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:00.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.860+0000 7f48fb200640 1 --2- 172.21.15.42:0/1067017016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48fc1044f0 0x7f48fc073c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.860+0000 7f48fb200640 1 -- 172.21.15.42:0/1067017016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48fc06d1f0 con 0x7f48fc109c00 2024-08-26T00:07:00.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.862+0000 7f48fb200640 1 --2- 172.21.15.42:0/1067017016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48fc109c00 0x7f48fc06c930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f48ec00d750 tx=0x7f48ec00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:00.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.863+0000 7f48f3400640 1 -- 172.21.15.42:0/1067017016 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec017070 con 0x7f48fc109c00 2024-08-26T00:07:00.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.865+0000 7f4901400640 1 -- 172.21.15.42:0/1067017016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48fc06d4e0 con 0x7f48fc109c00 2024-08-26T00:07:00.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.865+0000 7f4901400640 1 -- 172.21.15.42:0/1067017016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48fc071470 con 0x7f48fc109c00 2024-08-26T00:07:00.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.866+0000 7f48f3400640 1 -- 172.21.15.42:0/1067017016 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48ec005500 con 0x7f48fc109c00 2024-08-26T00:07:00.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.867+0000 7f48f3400640 1 -- 172.21.15.42:0/1067017016 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec004d90 con 0x7f48fc109c00 2024-08-26T00:07:00.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.876+0000 7f48f3400640 1 -- 172.21.15.42:0/1067017016 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f48ec005020 con 0x7f48fc109c00 2024-08-26T00:07:00.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.881+0000 7f48f3400640 1 --2- 172.21.15.42:0/1067017016 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48e00a2cc0 0x7f48e00a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:00.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.881+0000 7f48f3400640 1 -- 172.21.15.42:0/1067017016 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f48ec0cea40 con 0x7f48fc109c00 2024-08-26T00:07:00.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.883+0000 7f4903e17740 1 Processor -- start 2024-08-26T00:07:00.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.884+0000 7f48fa800640 1 --2- 172.21.15.42:0/1067017016 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48e00a2cc0 0x7f48e00a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:00.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.886+0000 7f48fa800640 1 --2- 172.21.15.42:0/1067017016 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48e00a2cc0 0x7f48e00a5180 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f48f4004af0 tx=0x7f48f4000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:00.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.887+0000 7f4903e17740 1 -- start start 2024-08-26T00:07:00.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.887+0000 7f4903e17740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fac030 0x55abe5fac410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:00.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.887+0000 7f4903e17740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55abe5fac950 0x55abe5fb6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:00.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.887+0000 7f4903e17740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55abe5fb7210 0x55abe5fb9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:00.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.887+0000 7f4903e17740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55abe5f09f30 con 0x55abe5fb7210 2024-08-26T00:07:00.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.887+0000 7f4903e17740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55abe5ea15a0 con 0x55abe5fac030 2024-08-26T00:07:00.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.887+0000 7f4903e17740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55abe5f05ef0 con 0x55abe5fac950 2024-08-26T00:07:00.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.888+0000 7f48fa800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fac030 0x55abe5fac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:00.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.888+0000 7f48fa800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fac030 0x55abe5fac410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:58664/0 (socket says 172.21.15.42:58664) 2024-08-26T00:07:00.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.888+0000 7f48fa800640 1 -- 172.21.15.42:0/3729992399 learned_addr learned my addr 172.21.15.42:0/3729992399 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:00.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.888+0000 7f48fb200640 1 --2- 172.21.15.42:0/3729992399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55abe5fb7210 0x55abe5fb9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:00.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.889+0000 7f48f9e00640 1 --2- 172.21.15.42:0/3729992399 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55abe5fac950 0x55abe5fb6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:00.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.889+0000 7f48fa800640 1 -- 172.21.15.42:0/3729992399 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55abe5fac950 msgr2=0x55abe5fb6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:00.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.889+0000 7f48fa800640 1 --2- 172.21.15.42:0/3729992399 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55abe5fac950 0x55abe5fb6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.889+0000 7f48fa800640 1 -- 172.21.15.42:0/3729992399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55abe5fb7210 msgr2=0x55abe5fb9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:00.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.892+0000 7f48fa800640 1 --2- 172.21.15.42:0/3729992399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55abe5fb7210 0x55abe5fb9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.892+0000 7f48fa800640 1 -- 172.21.15.42:0/3729992399 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abe5c7b3c0 con 0x55abe5fac030 2024-08-26T00:07:00.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.892+0000 7f48fb200640 1 --2- 172.21.15.42:0/3729992399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55abe5fb7210 0x55abe5fb9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:07:00.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.893+0000 7f48fa800640 1 --2- 172.21.15.42:0/3729992399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fac030 0x55abe5fac410 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f48f402f470 tx=0x7f48f403c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42dacf7d4b6e3c4e server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:00.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.896+0000 7f48e7400640 1 -- 172.21.15.42:0/3729992399 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f405c070 con 0x55abe5fac030 2024-08-26T00:07:00.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.896+0000 7f48e7400640 1 -- 172.21.15.42:0/3729992399 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48f4036040 con 0x55abe5fac030 2024-08-26T00:07:00.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.897+0000 7f4903e17740 1 -- 172.21.15.42:0/3729992399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fac030 msgr2=0x55abe5fac410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:00.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.897+0000 7f4903e17740 1 --2- 172.21.15.42:0/3729992399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fac030 0x55abe5fac410 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f48f402f470 tx=0x7f48f403c000 comp rx=0 tx=0).stop 2024-08-26T00:07:00.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.897+0000 7f4903e17740 1 -- 172.21.15.42:0/3729992399 shutdown_connections 2024-08-26T00:07:00.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.897+0000 7f4903e17740 1 --2- 172.21.15.42:0/3729992399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55abe5fb7210 0x55abe5fb9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.897+0000 7f4903e17740 1 --2- 172.21.15.42:0/3729992399 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55abe5fac950 0x55abe5fb6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.897+0000 7f4903e17740 1 --2- 172.21.15.42:0/3729992399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fac030 0x55abe5fac410 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.897+0000 7f4903e17740 1 -- 172.21.15.42:0/3729992399 >> 172.21.15.42:0/3729992399 conn(0x55abe5fa85c0 msgr2=0x55abe5fa89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:00.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.898+0000 7f4903e17740 1 -- 172.21.15.42:0/3729992399 shutdown_connections 2024-08-26T00:07:00.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.898+0000 7f4903e17740 1 -- 172.21.15.42:0/3729992399 wait complete. 2024-08-26T00:07:00.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.899+0000 7f4903e17740 1 -- start start 2024-08-26T00:07:00.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.899+0000 7f4903e17740 1 Processor -- start 2024-08-26T00:07:00.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.900+0000 7f4903e17740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fac030 0x55abe5fa52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:00.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.901+0000 7f4903e17740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55abe5fac950 0x55abe5fa5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:00.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.901+0000 7f4903e17740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55abe5fb7210 0x55abe5fb5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:00.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.902+0000 7f4903e17740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55abe5f9fa00 con 0x55abe5fb7210 2024-08-26T00:07:00.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.902+0000 7f48fa800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fac030 0x55abe5fa52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:00.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.902+0000 7f48fa800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fac030 0x55abe5fa52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:58676/0 (socket says 172.21.15.42:58676) 2024-08-26T00:07:00.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.902+0000 7f48fa800640 1 -- 172.21.15.42:0/2404669285 learned_addr learned my addr 172.21.15.42:0/2404669285 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:00.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.902+0000 7f48f9e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55abe5fac950 0x55abe5fa5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:00.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.902+0000 7f4903e17740 1 -- 172.21.15.42:0/2404669285 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55abe5ec4de0 con 0x55abe5fac030 2024-08-26T00:07:00.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.902+0000 7f4903e17740 1 -- 172.21.15.42:0/2404669285 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55abe5f9fb80 con 0x55abe5fac950 2024-08-26T00:07:00.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.902+0000 7f4903e17740 10 client.0 _ll_register_callbacks cb 0x55abe5eb37b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:07:00.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.903+0000 7f48fb200640 1 --2- 172.21.15.42:0/2404669285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55abe5fb7210 0x55abe5fb5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:00.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.904+0000 7f48fa800640 1 -- 172.21.15.42:0/2404669285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55abe5fac950 msgr2=0x55abe5fa5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:00.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.904+0000 7f48fa800640 1 --2- 172.21.15.42:0/2404669285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55abe5fac950 0x55abe5fa5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.905+0000 7f48fa800640 1 -- 172.21.15.42:0/2404669285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55abe5fb7210 msgr2=0x55abe5fb5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:00.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.905+0000 7f48fa800640 1 --2- 172.21.15.42:0/2404669285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55abe5fb7210 0x55abe5fb5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.905+0000 7f48fa800640 1 -- 172.21.15.42:0/2404669285 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abe5fa60f0 con 0x55abe5fac030 2024-08-26T00:07:00.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.905+0000 7f48f9e00640 1 --2- 172.21.15.42:0/2404669285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55abe5fac950 0x55abe5fa5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:07:00.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.906+0000 7f48fa800640 1 --2- 172.21.15.42:0/2404669285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fac030 0x55abe5fa52d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f48f4031040 tx=0x7f48f4031a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a62fb17871b6113 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:00.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.906+0000 7f48dbe00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:07:00.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.907+0000 7f48dbe00640 1 -- 172.21.15.42:0/2404669285 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f405c040 con 0x55abe5fac030 2024-08-26T00:07:00.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.907+0000 7f4903e17740 1 -- 172.21.15.42:0/2404669285 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48f4036040 con 0x55abe5fac030 2024-08-26T00:07:00.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.908+0000 7f48dbe00640 1 -- 172.21.15.42:0/2404669285 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f48f402fc70 con 0x55abe5fac030 2024-08-26T00:07:00.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.909+0000 7f48dbe00640 1 -- 172.21.15.42:0/2404669285 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f48f4074050 con 0x55abe5fac030 2024-08-26T00:07:00.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.909+0000 7f4903e17740 10 client.25568 fetch_fsmap learned FSMap version 29 2024-08-26T00:07:00.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.909+0000 7f4903e17740 1 -- 172.21.15.42:0/2404669285 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55abe5fbd360 con 0x55abe5fac030 2024-08-26T00:07:00.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.909+0000 7f48dbe00640 1 -- 172.21.15.42:0/2404669285 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48f4036040 con 0x55abe5fac030 2024-08-26T00:07:00.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.910+0000 7f48dbe00640 1 -- 172.21.15.42:0/2404669285 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f48f4058550 con 0x55abe5fac030 2024-08-26T00:07:00.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.910+0000 7f4903e17740 10 client.25568 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:07:00.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.910+0000 7f4903e17740 10 client.25568 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-26T00:07:00.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.910+0000 7f4903e17740 20 client.25568 populate_metadata read hostname 'smithi042' 2024-08-26T00:07:00.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.910+0000 7f4903e17740 1 --2- 172.21.15.42:0/2404669285 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55abe5fbe6b0 0x55abe5fc0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:00.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.910+0000 7f4903e17740 4 client.25568 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:07:00.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.910+0000 7f4903e17740 1 -- 172.21.15.42:0/2404669285 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55abe5f174a0 con 0x55abe5fbe6b0 2024-08-26T00:07:00.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.911+0000 7f48f9e00640 1 --2- 172.21.15.42:0/2404669285 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55abe5fbe6b0 0x55abe5fc0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:00.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.912+0000 7f48dbe00640 10 client.25568 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:07:00.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.912+0000 7f48f9e00640 1 --2- 172.21.15.42:0/2404669285 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55abe5fbe6b0 0x55abe5fc0aa0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4572a798bee8c96a server_cookie=e967967379f1d63 in_seq=0 out_seq=0 2024-08-26T00:07:00.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.913+0000 7f48dbe00640 1 -- 172.21.15.42:0/2404669285 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55abe5f174a0 con 0x55abe5fbe6b0 2024-08-26T00:07:00.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.913+0000 7f48dbe00640 10 client.25568 handle_command_reply: tid=0 2024-08-26T00:07:00.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.913+0000 7f4903e17740 1 client.25568 shutdown 2024-08-26T00:07:00.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.917+0000 7f4903e17740 1 -- 172.21.15.42:0/2404669285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fac030 msgr2=0x55abe5fa52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:00.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.917+0000 7f4903e17740 1 --2- 172.21.15.42:0/2404669285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fac030 0x55abe5fa52d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f48f4031040 tx=0x7f48f4031a70 comp rx=0 tx=0).stop 2024-08-26T00:07:00.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.917+0000 7f4903e17740 1 -- 172.21.15.42:0/2404669285 shutdown_connections 2024-08-26T00:07:00.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.917+0000 7f4903e17740 1 --2- 172.21.15.42:0/2404669285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55abe5fb7210 0x55abe5fb5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.917+0000 7f4903e17740 1 --2- 172.21.15.42:0/2404669285 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55abe5fbe6b0 0x55abe5fc0aa0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.917+0000 7f4903e17740 1 --2- 172.21.15.42:0/2404669285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55abe5fac950 0x55abe5fa5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.917+0000 7f4903e17740 1 --2- 172.21.15.42:0/2404669285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fac030 0x55abe5fa52d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.917+0000 7f4903e17740 1 -- 172.21.15.42:0/2404669285 >> 172.21.15.42:0/2404669285 conn(0x55abe5fa85c0 msgr2=0x55abe5f9ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:00.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.917+0000 7f48dbe00640 0 client.25568 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:07:00.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.917+0000 7f4903e17740 1 -- 172.21.15.42:0/2404669285 shutdown_connections 2024-08-26T00:07:00.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.922+0000 7f4903e17740 1 -- 172.21.15.42:0/2404669285 wait complete. 2024-08-26T00:07:00.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.922+0000 7f4903e17740 20 client.25568 trim_cache size 0 max 16384 2024-08-26T00:07:00.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.953+0000 7f4903e17740 1 Processor -- start 2024-08-26T00:07:00.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.954+0000 7f4903e17740 1 -- start start 2024-08-26T00:07:00.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.955+0000 7f4903e17740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55abe5fac030 0x55abe5fc0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:00.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.955+0000 7f4903e17740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55abe5fac950 0x55abe5fb5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:00.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.955+0000 7f4903e17740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fb7210 0x55abe5f9ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:00.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.955+0000 7f48fa800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55abe5fac030 0x55abe5fc0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:00.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.955+0000 7f48fa800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55abe5fac030 0x55abe5fc0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:57608/0 (socket says 172.21.15.42:57608) 2024-08-26T00:07:00.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.955+0000 7f48fa800640 1 -- 172.21.15.42:0/2762631785 learned_addr learned my addr 172.21.15.42:0/2762631785 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:00.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.956+0000 7f48f9e00640 1 --2- 172.21.15.42:0/2762631785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55abe5fac950 0x55abe5fb5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:00.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.956+0000 7f4903e17740 1 -- 172.21.15.42:0/2762631785 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc1b63e0 con 0x55abe5fac950 2024-08-26T00:07:00.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.956+0000 7f48fb200640 1 --2- 172.21.15.42:0/2762631785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fb7210 0x55abe5f9ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:00.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.956+0000 7f4903e17740 1 -- 172.21.15.42:0/2762631785 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc1b3bf0 con 0x55abe5fb7210 2024-08-26T00:07:00.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.956+0000 7f4903e17740 1 -- 172.21.15.42:0/2762631785 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc1b1a20 con 0x55abe5fac030 2024-08-26T00:07:00.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.957+0000 7f48f9e00640 1 -- 172.21.15.42:0/2762631785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55abe5fac030 msgr2=0x55abe5fc0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:00.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.957+0000 7f48f9e00640 1 --2- 172.21.15.42:0/2762631785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55abe5fac030 0x55abe5fc0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.957+0000 7f48f9e00640 1 -- 172.21.15.42:0/2762631785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fb7210 msgr2=0x55abe5f9ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:00.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.957+0000 7f48f9e00640 1 --2- 172.21.15.42:0/2762631785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fb7210 0x55abe5f9ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.957+0000 7f48f9e00640 1 -- 172.21.15.42:0/2762631785 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abe5fa83f0 con 0x55abe5fac950 2024-08-26T00:07:00.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.958+0000 7f48f9e00640 1 --2- 172.21.15.42:0/2762631785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55abe5fac950 0x55abe5fb5c00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55abe5fa6910 tx=0x7f48e8004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b30086ed83354df4 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:00.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.959+0000 7f48e6a00640 1 -- 172.21.15.42:0/2762631785 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8003d20 con 0x55abe5fac950 2024-08-26T00:07:00.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.959+0000 7f48e6a00640 1 -- 172.21.15.42:0/2762631785 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48e801f910 con 0x55abe5fac950 2024-08-26T00:07:00.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.959+0000 7f48e6a00640 1 -- 172.21.15.42:0/2762631785 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8012c90 con 0x55abe5fac950 2024-08-26T00:07:00.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.961+0000 7f4903e17740 1 -- 172.21.15.42:0/2762631785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55abe5fac950 msgr2=0x55abe5fb5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:00.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.961+0000 7f4903e17740 1 --2- 172.21.15.42:0/2762631785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55abe5fac950 0x55abe5fb5c00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55abe5fa6910 tx=0x7f48e8004410 comp rx=0 tx=0).stop 2024-08-26T00:07:00.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.966+0000 7f4903e17740 1 -- 172.21.15.42:0/2762631785 shutdown_connections 2024-08-26T00:07:00.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.966+0000 7f4903e17740 1 --2- 172.21.15.42:0/2762631785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fb7210 0x55abe5f9ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.966+0000 7f4903e17740 1 --2- 172.21.15.42:0/2762631785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55abe5fac950 0x55abe5fb5c00 secure :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55abe5fa6910 tx=0x7f48e8004410 comp rx=0 tx=0).stop 2024-08-26T00:07:00.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.966+0000 7f4903e17740 1 --2- 172.21.15.42:0/2762631785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55abe5fac030 0x55abe5fc0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.966+0000 7f4903e17740 1 -- 172.21.15.42:0/2762631785 >> 172.21.15.42:0/2762631785 conn(0x55abe5fa85c0 msgr2=0x55abe5f9e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:00.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.967+0000 7f4903e17740 1 -- 172.21.15.42:0/2762631785 shutdown_connections 2024-08-26T00:07:00.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.967+0000 7f4903e17740 1 -- 172.21.15.42:0/2762631785 wait complete. 2024-08-26T00:07:00.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.967+0000 7f4903e17740 1 -- start start 2024-08-26T00:07:00.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.968+0000 7f4903e17740 1 Processor -- start 2024-08-26T00:07:00.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.968+0000 7f4903e17740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fac030 0x55abe5fb5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:00.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.968+0000 7f4903e17740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55abe5fb7210 0x55abe5fb0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:00.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.968+0000 7f4903e17740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55abe5fb1590 0x55abe6028160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:00.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.969+0000 7f48fa800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fac030 0x55abe5fb5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:00.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.969+0000 7f48fa800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fac030 0x55abe5fb5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:58688/0 (socket says 172.21.15.42:58688) 2024-08-26T00:07:00.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.972+0000 7f48f9e00640 1 --2- 172.21.15.42:0/4222644748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55abe5fb7210 0x55abe5fb0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:00.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.972+0000 7f48fa800640 1 -- 172.21.15.42:0/4222644748 learned_addr learned my addr 172.21.15.42:0/4222644748 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:00.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.972+0000 7f48fb200640 1 --2- 172.21.15.42:0/4222644748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55abe5fb1590 0x55abe6028160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:00.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.972+0000 7f4903e17740 1 -- 172.21.15.42:0/4222644748 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc1b20b0 con 0x55abe5fb7210 2024-08-26T00:07:00.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.972+0000 7f4903e17740 1 -- 172.21.15.42:0/4222644748 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc1b3520 con 0x55abe5fac030 2024-08-26T00:07:00.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.972+0000 7f4903e17740 1 -- 172.21.15.42:0/4222644748 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc1b2780 con 0x55abe5fb1590 2024-08-26T00:07:00.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.973+0000 7f4903e17740 10 client.0 _ll_register_callbacks cb 0x7f48ec0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:07:00.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.974+0000 7f48fa800640 1 -- 172.21.15.42:0/4222644748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55abe5fb1590 msgr2=0x55abe6028160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:00.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.974+0000 7f48fa800640 1 --2- 172.21.15.42:0/4222644748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55abe5fb1590 0x55abe6028160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.974+0000 7f48fa800640 1 -- 172.21.15.42:0/4222644748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55abe5fb7210 msgr2=0x55abe5fb0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:00.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.974+0000 7f48fa800640 1 --2- 172.21.15.42:0/4222644748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55abe5fb7210 0x55abe5fb0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.974+0000 7f48fa800640 1 -- 172.21.15.42:0/4222644748 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abe60286a0 con 0x55abe5fac030 2024-08-26T00:07:00.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.975+0000 7f48fb200640 1 --2- 172.21.15.42:0/4222644748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55abe5fb1590 0x55abe6028160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:07:00.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.978+0000 7f4903e17740 1 -- 172.21.15.42:0/4222644748 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48e801f910 con 0x55abe5fac030 2024-08-26T00:07:00.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.978+0000 7f48fa800640 1 --2- 172.21.15.42:0/4222644748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fac030 0x55abe5fb5b70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f48f4005f20 tx=0x7f48f4031830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80bec72f5714f030 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:00.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.978+0000 7f48dbe00640 10 client.25574 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:07:00.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.978+0000 7f48dbe00640 1 -- 172.21.15.42:0/4222644748 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f403f050 con 0x55abe5fac030 2024-08-26T00:07:00.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.978+0000 7f48dbe00640 1 -- 172.21.15.42:0/4222644748 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f48f4058430 con 0x55abe5fac030 2024-08-26T00:07:00.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.979+0000 7f48dbe00640 1 -- 172.21.15.42:0/4222644748 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f48f405c040 con 0x55abe5fac030 2024-08-26T00:07:00.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.979+0000 7f4903e17740 10 client.25574 fetch_fsmap learned FSMap version 29 2024-08-26T00:07:00.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.979+0000 7f4903e17740 1 -- 172.21.15.42:0/4222644748 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55abe60295b0 con 0x55abe5fac030 2024-08-26T00:07:00.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.979+0000 7f48dbe00640 1 -- 172.21.15.42:0/4222644748 <== mon.2 v2:172.21.15.43:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f48f402fa70 con 0x55abe5fac030 2024-08-26T00:07:00.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.979+0000 7f4903e17740 10 client.25574 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:07:00.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.979+0000 7f4903e17740 10 client.25574 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-26T00:07:00.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.979+0000 7f4903e17740 20 client.25574 populate_metadata read hostname 'smithi042' 2024-08-26T00:07:00.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.979+0000 7f4903e17740 1 --2- 172.21.15.42:0/4222644748 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55abe6029bb0 0x55abe602c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:00.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.979+0000 7f4903e17740 4 client.25574 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:07:00.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.979+0000 7f4903e17740 1 -- 172.21.15.42:0/4222644748 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55abe5f119b0 con 0x55abe6029bb0 2024-08-26T00:07:00.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.980+0000 7f48f9e00640 1 --2- 172.21.15.42:0/4222644748 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55abe6029bb0 0x55abe602c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:00.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.980+0000 7f48dbe00640 10 client.25574 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:07:00.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.980+0000 7f48f9e00640 1 --2- 172.21.15.42:0/4222644748 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55abe6029bb0 0x55abe602c010 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=862dc727b6271d18 server_cookie=1b20bc9c97fb39dd in_seq=0 out_seq=0 2024-08-26T00:07:00.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.981+0000 7f48dbe00640 1 -- 172.21.15.42:0/4222644748 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55abe5f119b0 con 0x55abe6029bb0 2024-08-26T00:07:00.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.981+0000 7f48dbe00640 10 client.25574 handle_command_reply: tid=0 2024-08-26T00:07:00.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.981+0000 7f4903e17740 1 client.25574 shutdown 2024-08-26T00:07:00.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.981+0000 7f4903e17740 1 -- 172.21.15.42:0/4222644748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fac030 msgr2=0x55abe5fb5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:00.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.981+0000 7f4903e17740 1 --2- 172.21.15.42:0/4222644748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fac030 0x55abe5fb5b70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f48f4005f20 tx=0x7f48f4031830 comp rx=0 tx=0).stop 2024-08-26T00:07:00.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.981+0000 7f4903e17740 1 -- 172.21.15.42:0/4222644748 shutdown_connections 2024-08-26T00:07:00.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.981+0000 7f4903e17740 1 --2- 172.21.15.42:0/4222644748 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55abe6029bb0 0x55abe602c010 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.981+0000 7f4903e17740 1 --2- 172.21.15.42:0/4222644748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55abe5fb1590 0x55abe6028160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.981+0000 7f4903e17740 1 --2- 172.21.15.42:0/4222644748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55abe5fb7210 0x55abe5fb0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.981+0000 7f48dbe00640 0 client.25574 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:07:00.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.981+0000 7f4903e17740 1 --2- 172.21.15.42:0/4222644748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe5fac030 0x55abe5fb5b70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.981+0000 7f4903e17740 1 -- 172.21.15.42:0/4222644748 >> 172.21.15.42:0/4222644748 conn(0x55abe5fa85c0 msgr2=0x55abe5f9ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:00.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.982+0000 7f4903e17740 1 -- 172.21.15.42:0/4222644748 shutdown_connections 2024-08-26T00:07:00.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.982+0000 7f4903e17740 1 -- 172.21.15.42:0/4222644748 wait complete. 2024-08-26T00:07:00.987 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:07:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.984+0000 7f4903e17740 20 client.25574 trim_cache size 0 max 16384 2024-08-26T00:07:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.986+0000 7f4901400640 1 -- 172.21.15.42:0/1067017016 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48e00a2cc0 msgr2=0x7f48e00a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.986+0000 7f4901400640 1 --2- 172.21.15.42:0/1067017016 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48e00a2cc0 0x7f48e00a5180 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f48f4004af0 tx=0x7f48f4000f40 comp rx=0 tx=0).stop 2024-08-26T00:07:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.986+0000 7f4901400640 1 -- 172.21.15.42:0/1067017016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48fc109c00 msgr2=0x7f48fc06c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.986+0000 7f4901400640 1 --2- 172.21.15.42:0/1067017016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48fc109c00 0x7f48fc06c930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f48ec00d750 tx=0x7f48ec00dc10 comp rx=0 tx=0).stop 2024-08-26T00:07:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.986+0000 7f4901400640 1 -- 172.21.15.42:0/1067017016 shutdown_connections 2024-08-26T00:07:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.986+0000 7f4901400640 1 --2- 172.21.15.42:0/1067017016 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48e00a2cc0 0x7f48e00a5180 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.986+0000 7f4901400640 1 --2- 172.21.15.42:0/1067017016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48fc109c00 0x7f48fc06c930 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.986+0000 7f4901400640 1 --2- 172.21.15.42:0/1067017016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f48fc1044f0 0x7f48fc073c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.986+0000 7f4901400640 1 --2- 172.21.15.42:0/1067017016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48fc103b50 0x7f48fc0736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.986+0000 7f4901400640 1 -- 172.21.15.42:0/1067017016 >> 172.21.15.42:0/1067017016 conn(0x7f48fc0ff830 msgr2=0x7f48fc100f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.986+0000 7f4901400640 1 -- 172.21.15.42:0/1067017016 shutdown_connections 2024-08-26T00:07:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:00.986+0000 7f4901400640 1 -- 172.21.15.42:0/1067017016 wait complete. 2024-08-26T00:07:01.701 INFO:tasks.workunit.client.0.smithi042.stdout: 310 634514 1269 436469 1287 205095 1433 2024-08-26T00:07:02.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:02 smithi043 ceph-mon[22091]: pgmap v474: 97 pgs: 97 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 19 MiB/s wr, 956 op/s 2024-08-26T00:07:02.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:02 smithi181 ceph-mon[22102]: pgmap v474: 97 pgs: 97 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 19 MiB/s wr, 956 op/s 2024-08-26T00:07:02.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:02 smithi042 ceph-mon[17225]: pgmap v474: 97 pgs: 97 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 19 MiB/s wr, 956 op/s 2024-08-26T00:07:02.952 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-26T00:07:04.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:04 smithi042 ceph-mon[17225]: pgmap v475: 97 pgs: 97 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 734 op/s 2024-08-26T00:07:04.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:04 smithi043 ceph-mon[22091]: pgmap v475: 97 pgs: 97 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 734 op/s 2024-08-26T00:07:04.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:04 smithi181 ceph-mon[22102]: pgmap v475: 97 pgs: 97 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 734 op/s 2024-08-26T00:07:06.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:06 smithi181 ceph-mon[22102]: pgmap v476: 97 pgs: 97 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.6 MiB/s wr, 481 op/s 2024-08-26T00:07:06.671 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:06 smithi042 ceph-mon[17225]: pgmap v476: 97 pgs: 97 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.6 MiB/s wr, 481 op/s 2024-08-26T00:07:06.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:06 smithi043 ceph-mon[22091]: pgmap v476: 97 pgs: 97 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.6 MiB/s wr, 481 op/s 2024-08-26T00:07:08.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:08 smithi043 ceph-mon[22091]: pgmap v477: 97 pgs: 97 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.7 MiB/s wr, 325 op/s 2024-08-26T00:07:08.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:08 smithi042 ceph-mon[17225]: pgmap v477: 97 pgs: 97 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.7 MiB/s wr, 325 op/s 2024-08-26T00:07:08.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:08 smithi181 ceph-mon[22102]: pgmap v477: 97 pgs: 97 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.7 MiB/s wr, 325 op/s 2024-08-26T00:07:10.519 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:10 smithi042 ceph-mon[17225]: pgmap v478: 97 pgs: 97 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 276 op/s 2024-08-26T00:07:10.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:10 smithi043 ceph-mon[22091]: pgmap v478: 97 pgs: 97 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 276 op/s 2024-08-26T00:07:10.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:10 smithi181 ceph-mon[22102]: pgmap v478: 97 pgs: 97 active+clean; 1.1 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 276 op/s 2024-08-26T00:07:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:07:11.677 INFO:tasks.workunit.client.0.smithi042.stdout: 329 633698 1362 437837 1265 206000 1388 2024-08-26T00:07:12.602 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:12 smithi042 ceph-mon[17225]: pgmap v479: 97 pgs: 97 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 270 op/s 2024-08-26T00:07:12.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:12 smithi043 ceph-mon[22091]: pgmap v479: 97 pgs: 97 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 270 op/s 2024-08-26T00:07:12.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:12 smithi181 ceph-mon[22102]: pgmap v479: 97 pgs: 97 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 270 op/s 2024-08-26T00:07:13.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.493+0000 7f036be00640 1 -- 172.21.15.42:0/1698526949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f036c10bd60 msgr2=0x7f036c10e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:13.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.493+0000 7f036be00640 1 --2- 172.21.15.42:0/1698526949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f036c10bd60 0x7f036c10e200 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0364009ca0 tx=0x7f036402a940 comp rx=0 tx=0).stop 2024-08-26T00:07:13.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.493+0000 7f036be00640 1 -- 172.21.15.42:0/1698526949 shutdown_connections 2024-08-26T00:07:13.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.493+0000 7f036be00640 1 --2- 172.21.15.42:0/1698526949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f036c10bd60 0x7f036c10e200 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.493+0000 7f036be00640 1 --2- 172.21.15.42:0/1698526949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f036c103250 0x7f036c10b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.493+0000 7f036be00640 1 --2- 172.21.15.42:0/1698526949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f036c102930 0x7f036c102d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.493+0000 7f036be00640 1 -- 172.21.15.42:0/1698526949 >> 172.21.15.42:0/1698526949 conn(0x7f036c0fc3b0 msgr2=0x7f036c0fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:13.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.494+0000 7f036be00640 1 -- 172.21.15.42:0/1698526949 shutdown_connections 2024-08-26T00:07:13.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.494+0000 7f036be00640 1 -- 172.21.15.42:0/1698526949 wait complete. 2024-08-26T00:07:13.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.495+0000 7f036be00640 1 Processor -- start 2024-08-26T00:07:13.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.496+0000 7f036be00640 1 -- start start 2024-08-26T00:07:13.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.497+0000 7f036be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f036c102930 0x7f036c10b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:13.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.497+0000 7f036be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f036c103250 0x7f036c1087e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:13.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.497+0000 7f036aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f036c102930 0x7f036c10b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:13.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.497+0000 7f036aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f036c102930 0x7f036c10b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:40884/0 (socket says 172.21.15.42:40884) 2024-08-26T00:07:13.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.497+0000 7f036be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f036c10bd60 0x7f036c108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:13.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.497+0000 7f036be00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f036c1020a0 con 0x7f036c10bd60 2024-08-26T00:07:13.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.497+0000 7f036be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f036c101f20 con 0x7f036c102930 2024-08-26T00:07:13.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.497+0000 7f036be00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f036c102220 con 0x7f036c103250 2024-08-26T00:07:13.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.497+0000 7f036aa00640 1 -- 172.21.15.42:0/479567392 learned_addr learned my addr 172.21.15.42:0/479567392 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:13.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.498+0000 7f036a000640 1 --2- 172.21.15.42:0/479567392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f036c103250 0x7f036c1087e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:13.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.498+0000 7f036b400640 1 --2- 172.21.15.42:0/479567392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f036c10bd60 0x7f036c108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:13.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.499+0000 7f036aa00640 1 -- 172.21.15.42:0/479567392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f036c103250 msgr2=0x7f036c1087e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:13.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.499+0000 7f036aa00640 1 --2- 172.21.15.42:0/479567392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f036c103250 0x7f036c1087e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.499+0000 7f036aa00640 1 -- 172.21.15.42:0/479567392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f036c10bd60 msgr2=0x7f036c108f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:13.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.499+0000 7f036aa00640 1 --2- 172.21.15.42:0/479567392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f036c10bd60 0x7f036c108f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.499+0000 7f036aa00640 1 -- 172.21.15.42:0/479567392 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f036c072a00 con 0x7f036c102930 2024-08-26T00:07:13.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.499+0000 7f036a000640 1 --2- 172.21.15.42:0/479567392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f036c103250 0x7f036c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:07:13.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.499+0000 7f036b400640 1 --2- 172.21.15.42:0/479567392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f036c10bd60 0x7f036c108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:07:13.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.500+0000 7f036aa00640 1 --2- 172.21.15.42:0/479567392 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f036c102930 0x7f036c10b730 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f035c00d950 tx=0x7f035c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:13.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.500+0000 7f0370a00640 1 -- 172.21.15.42:0/479567392 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c017070 con 0x7f036c102930 2024-08-26T00:07:13.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.501+0000 7f0370a00640 1 -- 172.21.15.42:0/479567392 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f035c009bd0 con 0x7f036c102930 2024-08-26T00:07:13.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.501+0000 7f036be00640 1 -- 172.21.15.42:0/479567392 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f036c072cf0 con 0x7f036c102930 2024-08-26T00:07:13.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.501+0000 7f0370a00640 1 -- 172.21.15.42:0/479567392 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c00f620 con 0x7f036c102930 2024-08-26T00:07:13.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.501+0000 7f036be00640 1 -- 172.21.15.42:0/479567392 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f036c073280 con 0x7f036c102930 2024-08-26T00:07:13.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.510+0000 7f0370a00640 1 -- 172.21.15.42:0/479567392 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f035c010460 con 0x7f036c102930 2024-08-26T00:07:13.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.513+0000 7f0370a00640 1 --2- 172.21.15.42:0/479567392 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f03500a2c00 0x7f03500a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:13.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.513+0000 7f0370a00640 1 -- 172.21.15.42:0/479567392 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f035c0ceda0 con 0x7f036c102930 2024-08-26T00:07:13.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.513+0000 7f0374891740 1 Processor -- start 2024-08-26T00:07:13.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.514+0000 7f0374891740 1 -- start start 2024-08-26T00:07:13.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.514+0000 7f0374891740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6ccfea30 0x560e6ccfee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:13.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.514+0000 7f036a000640 1 --2- 172.21.15.42:0/479567392 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f03500a2c00 0x7f03500a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:13.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.514+0000 7f0374891740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560e6ccff350 0x560e6cd096d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:13.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.514+0000 7f0374891740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6cd09c10 0x560e6cd0c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:13.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.514+0000 7f0374891740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560e6cc64f30 con 0x560e6ccfea30 2024-08-26T00:07:13.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.514+0000 7f0374891740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560e6cbfc5a0 con 0x560e6cd09c10 2024-08-26T00:07:13.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.514+0000 7f0374891740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x560e6cc60ef0 con 0x560e6ccff350 2024-08-26T00:07:13.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.515+0000 7f036b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6cd09c10 0x560e6cd0c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:13.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.515+0000 7f036a000640 1 --2- 172.21.15.42:0/479567392 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f03500a2c00 0x7f03500a50c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f036c109fa0 tx=0x7f0358008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:13.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.516+0000 7f036b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6cd09c10 0x560e6cd0c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:40890/0 (socket says 172.21.15.42:40890) 2024-08-26T00:07:13.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.516+0000 7f036b400640 1 -- 172.21.15.42:0/2859840905 learned_addr learned my addr 172.21.15.42:0/2859840905 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:13.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.516+0000 7f036a000640 1 --2- 172.21.15.42:0/2859840905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560e6ccff350 0x560e6cd096d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:13.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.517+0000 7f036aa00640 1 --2- 172.21.15.42:0/2859840905 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6ccfea30 0x560e6ccfee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:13.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.517+0000 7f036b400640 1 -- 172.21.15.42:0/2859840905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560e6ccff350 msgr2=0x560e6cd096d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:13.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.517+0000 7f036b400640 1 --2- 172.21.15.42:0/2859840905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560e6ccff350 0x560e6cd096d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.517+0000 7f036b400640 1 -- 172.21.15.42:0/2859840905 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6ccfea30 msgr2=0x560e6ccfee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:13.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.518+0000 7f036b400640 1 --2- 172.21.15.42:0/2859840905 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6ccfea30 0x560e6ccfee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.518+0000 7f036b400640 1 -- 172.21.15.42:0/2859840905 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e6c9d63c0 con 0x560e6cd09c10 2024-08-26T00:07:13.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.518+0000 7f036aa00640 1 --2- 172.21.15.42:0/2859840905 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6ccfea30 0x560e6ccfee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:07:13.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.519+0000 7f036b400640 1 --2- 172.21.15.42:0/2859840905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6cd09c10 0x560e6cd0c000 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f036402f550 tx=0x7f036402f580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf5717b90053eba5 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:13.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.519+0000 7f0357e00640 1 -- 172.21.15.42:0/2859840905 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0364034040 con 0x560e6cd09c10 2024-08-26T00:07:13.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.519+0000 7f0357e00640 1 -- 172.21.15.42:0/2859840905 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f036402fe10 con 0x560e6cd09c10 2024-08-26T00:07:13.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.519+0000 7f0357e00640 1 -- 172.21.15.42:0/2859840905 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0364030ae0 con 0x560e6cd09c10 2024-08-26T00:07:13.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.520+0000 7f0374891740 1 -- 172.21.15.42:0/2859840905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6cd09c10 msgr2=0x560e6cd0c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:13.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.520+0000 7f0374891740 1 --2- 172.21.15.42:0/2859840905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6cd09c10 0x560e6cd0c000 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f036402f550 tx=0x7f036402f580 comp rx=0 tx=0).stop 2024-08-26T00:07:13.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.521+0000 7f0374891740 1 -- 172.21.15.42:0/2859840905 shutdown_connections 2024-08-26T00:07:13.531 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:07:13.531 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:07:13.531 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:13 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:07:13.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.521+0000 7f0374891740 1 --2- 172.21.15.42:0/2859840905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6cd09c10 0x560e6cd0c000 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.521+0000 7f0374891740 1 --2- 172.21.15.42:0/2859840905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560e6ccff350 0x560e6cd096d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.521+0000 7f0374891740 1 --2- 172.21.15.42:0/2859840905 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6ccfea30 0x560e6ccfee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.521+0000 7f0374891740 1 -- 172.21.15.42:0/2859840905 >> 172.21.15.42:0/2859840905 conn(0x560e6ccfafc0 msgr2=0x560e6ccfb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:13.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.521+0000 7f0374891740 1 -- 172.21.15.42:0/2859840905 shutdown_connections 2024-08-26T00:07:13.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.521+0000 7f0374891740 1 -- 172.21.15.42:0/2859840905 wait complete. 2024-08-26T00:07:13.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.522+0000 7f0374891740 1 -- start start 2024-08-26T00:07:13.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.522+0000 7f0374891740 1 Processor -- start 2024-08-26T00:07:13.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.524+0000 7f0374891740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6ccfea30 0x560e6cd06b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:13.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.524+0000 7f0374891740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560e6ccff350 0x560e6cd070a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:13.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.524+0000 7f0374891740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6cd09c10 0x560e6cd075e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:13.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.525+0000 7f0374891740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560e6cd1d7f0 con 0x560e6ccfea30 2024-08-26T00:07:13.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.525+0000 7f0374891740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560e6cc1fde0 con 0x560e6cd09c10 2024-08-26T00:07:13.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.525+0000 7f036b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6cd09c10 0x560e6cd075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:13.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.525+0000 7f036b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6cd09c10 0x560e6cd075e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:40898/0 (socket says 172.21.15.42:40898) 2024-08-26T00:07:13.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.525+0000 7f036b400640 1 -- 172.21.15.42:0/2394402565 learned_addr learned my addr 172.21.15.42:0/2394402565 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:13.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.525+0000 7f0374891740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x560e6cd1d970 con 0x560e6ccff350 2024-08-26T00:07:13.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.525+0000 7f036a000640 1 --2- 172.21.15.42:0/2394402565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560e6ccff350 0x560e6cd070a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:13.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.526+0000 7f036aa00640 1 --2- 172.21.15.42:0/2394402565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6ccfea30 0x560e6cd06b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:13.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.526+0000 7f036b400640 1 -- 172.21.15.42:0/2394402565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560e6ccff350 msgr2=0x560e6cd070a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:13.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.526+0000 7f036b400640 1 --2- 172.21.15.42:0/2394402565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560e6ccff350 0x560e6cd070a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.526+0000 7f036b400640 1 -- 172.21.15.42:0/2394402565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6ccfea30 msgr2=0x560e6cd06b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:13.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.526+0000 7f036b400640 1 --2- 172.21.15.42:0/2394402565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6ccfea30 0x560e6cd06b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.526+0000 7f036b400640 1 -- 172.21.15.42:0/2394402565 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e6cd26cb0 con 0x560e6cd09c10 2024-08-26T00:07:13.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.526+0000 7f0374891740 10 client.0 _ll_register_callbacks cb 0x560e6cc0e7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:07:13.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.526+0000 7f036aa00640 1 --2- 172.21.15.42:0/2394402565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6ccfea30 0x560e6cd06b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:07:13.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.527+0000 7f036b400640 1 --2- 172.21.15.42:0/2394402565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6cd09c10 0x560e6cd075e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f036402ae60 tx=0x7f036402fb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c315c2c186f6a908 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:13.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.527+0000 7f0354c00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:07:13.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.527+0000 7f0354c00640 1 -- 172.21.15.42:0/2394402565 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0364034040 con 0x560e6cd09c10 2024-08-26T00:07:13.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.527+0000 7f0354c00640 1 -- 172.21.15.42:0/2394402565 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f0364030c70 con 0x560e6cd09c10 2024-08-26T00:07:13.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.528+0000 7f0374891740 1 -- 172.21.15.42:0/2394402565 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f036402fe10 con 0x560e6cd09c10 2024-08-26T00:07:13.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.528+0000 7f0354c00640 1 -- 172.21.15.42:0/2394402565 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0364004000 con 0x560e6cd09c10 2024-08-26T00:07:13.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.528+0000 7f0374891740 10 client.25586 fetch_fsmap learned FSMap version 29 2024-08-26T00:07:13.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.528+0000 7f0374891740 1 -- 172.21.15.42:0/2394402565 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({fsmap=29}) -- 0x560e6cd29140 con 0x560e6cd09c10 2024-08-26T00:07:13.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.529+0000 7f0354c00640 1 -- 172.21.15.42:0/2394402565 <== mon.2 v2:172.21.15.43:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0364042020 con 0x560e6cd09c10 2024-08-26T00:07:13.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.529+0000 7f0374891740 10 client.25586 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:07:13.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.529+0000 7f0374891740 10 client.25586 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-26T00:07:13.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.529+0000 7f0374891740 20 client.25586 populate_metadata read hostname 'smithi042' 2024-08-26T00:07:13.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.529+0000 7f0374891740 1 --2- 172.21.15.42:0/2394402565 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x560e6cd2a8a0 0x560e6cd2cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:13.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.529+0000 7f0374891740 4 client.25586 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:07:13.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.529+0000 7f0374891740 1 -- 172.21.15.42:0/2394402565 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e6cc724a0 con 0x560e6cd2a8a0 2024-08-26T00:07:13.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.529+0000 7f036aa00640 1 --2- 172.21.15.42:0/2394402565 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x560e6cd2a8a0 0x560e6cd2cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:13.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.530+0000 7f036aa00640 1 --2- 172.21.15.42:0/2394402565 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x560e6cd2a8a0 0x560e6cd2cd40 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2bc35d069f13e791 server_cookie=5aa42f9437d0e70 in_seq=0 out_seq=0 2024-08-26T00:07:13.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.530+0000 7f0354c00640 10 client.25586 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:07:13.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.531+0000 7f0354c00640 1 -- 172.21.15.42:0/2394402565 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e6cc724a0 con 0x560e6cd2a8a0 2024-08-26T00:07:13.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.531+0000 7f0354c00640 10 client.25586 handle_command_reply: tid=0 2024-08-26T00:07:13.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.531+0000 7f0374891740 1 client.25586 shutdown 2024-08-26T00:07:13.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.532+0000 7f0374891740 1 -- 172.21.15.42:0/2394402565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6cd09c10 msgr2=0x560e6cd075e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.532+0000 7f0374891740 1 --2- 172.21.15.42:0/2394402565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6cd09c10 0x560e6cd075e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f036402ae60 tx=0x7f036402fb60 comp rx=0 tx=0).stop 2024-08-26T00:07:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.532+0000 7f0374891740 1 -- 172.21.15.42:0/2394402565 shutdown_connections 2024-08-26T00:07:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.532+0000 7f0374891740 1 --2- 172.21.15.42:0/2394402565 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x560e6cd2a8a0 0x560e6cd2cd40 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.532+0000 7f0374891740 1 --2- 172.21.15.42:0/2394402565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6cd09c10 0x560e6cd075e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.532+0000 7f0374891740 1 --2- 172.21.15.42:0/2394402565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560e6ccff350 0x560e6cd070a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.532+0000 7f0374891740 1 --2- 172.21.15.42:0/2394402565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6ccfea30 0x560e6cd06b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.532+0000 7f0374891740 1 -- 172.21.15.42:0/2394402565 >> 172.21.15.42:0/2394402565 conn(0x560e6ccfafc0 msgr2=0x560e6cd00cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.532+0000 7f0354c00640 0 client.25586 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:07:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.532+0000 7f0374891740 1 -- 172.21.15.42:0/2394402565 shutdown_connections 2024-08-26T00:07:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.532+0000 7f0374891740 1 -- 172.21.15.42:0/2394402565 wait complete. 2024-08-26T00:07:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.533+0000 7f0374891740 20 client.25586 trim_cache size 0 max 16384 2024-08-26T00:07:13.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.562+0000 7f0374891740 1 Processor -- start 2024-08-26T00:07:13.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.562+0000 7f0374891740 1 -- start start 2024-08-26T00:07:13.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.563+0000 7f0374891740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6ccfea30 0x560e6cd01490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:13.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.563+0000 7f0374891740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560e6ccff350 0x560e6cd07430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:13.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.563+0000 7f0374891740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6cd09c10 0x560e6cd32650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:13.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.563+0000 7f0374891740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f036c1b6340 con 0x560e6cd09c10 2024-08-26T00:07:13.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.563+0000 7f0374891740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f036c11be20 con 0x560e6ccfea30 2024-08-26T00:07:13.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.563+0000 7f0374891740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f036c119c50 con 0x560e6ccff350 2024-08-26T00:07:13.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.564+0000 7f036a000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560e6ccff350 0x560e6cd07430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:13.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.564+0000 7f036a000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560e6ccff350 0x560e6cd07430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:57644/0 (socket says 172.21.15.42:57644) 2024-08-26T00:07:13.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.564+0000 7f036b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6cd09c10 0x560e6cd32650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:13.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.564+0000 7f036aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6ccfea30 0x560e6cd01490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:13.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.564+0000 7f036aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6ccfea30 0x560e6cd01490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:40908/0 (socket says 172.21.15.42:40908) 2024-08-26T00:07:13.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.564+0000 7f036aa00640 1 -- 172.21.15.42:0/2796456940 learned_addr learned my addr 172.21.15.42:0/2796456940 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:13.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.566+0000 7f036aa00640 1 -- 172.21.15.42:0/2796456940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560e6ccff350 msgr2=0x560e6cd07430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:13.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.566+0000 7f036aa00640 1 --2- 172.21.15.42:0/2796456940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560e6ccff350 0x560e6cd07430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.566+0000 7f036aa00640 1 -- 172.21.15.42:0/2796456940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6cd09c10 msgr2=0x560e6cd32650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:13.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.566+0000 7f036aa00640 1 --2- 172.21.15.42:0/2796456940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6cd09c10 0x560e6cd32650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.566+0000 7f036aa00640 1 -- 172.21.15.42:0/2796456940 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e6cd019d0 con 0x560e6ccfea30 2024-08-26T00:07:13.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.566+0000 7f036b400640 1 --2- 172.21.15.42:0/2796456940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6cd09c10 0x560e6cd32650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:07:13.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.567+0000 7f036a000640 1 --2- 172.21.15.42:0/2796456940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560e6ccff350 0x560e6cd07430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:07:13.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.567+0000 7f036aa00640 1 --2- 172.21.15.42:0/2796456940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6ccfea30 0x560e6cd01490 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f035c097a10 tx=0x7f035c0cc770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2486a25ff402b884 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:13.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.567+0000 7f0357400640 1 -- 172.21.15.42:0/2796456940 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c020040 con 0x560e6ccfea30 2024-08-26T00:07:13.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.567+0000 7f0357400640 1 -- 172.21.15.42:0/2796456940 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f035c015030 con 0x560e6ccfea30 2024-08-26T00:07:13.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.567+0000 7f0357400640 1 -- 172.21.15.42:0/2796456940 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c097040 con 0x560e6ccfea30 2024-08-26T00:07:13.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.568+0000 7f0374891740 1 -- 172.21.15.42:0/2796456940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6ccfea30 msgr2=0x560e6cd01490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:13.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.568+0000 7f0374891740 1 --2- 172.21.15.42:0/2796456940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6ccfea30 0x560e6cd01490 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f035c097a10 tx=0x7f035c0cc770 comp rx=0 tx=0).stop 2024-08-26T00:07:13.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.580+0000 7f0374891740 1 -- 172.21.15.42:0/2796456940 shutdown_connections 2024-08-26T00:07:13.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.580+0000 7f0374891740 1 --2- 172.21.15.42:0/2796456940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6cd09c10 0x560e6cd32650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.580+0000 7f0374891740 1 --2- 172.21.15.42:0/2796456940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560e6ccff350 0x560e6cd07430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.580+0000 7f0374891740 1 --2- 172.21.15.42:0/2796456940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6ccfea30 0x560e6cd01490 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.580+0000 7f0374891740 1 -- 172.21.15.42:0/2796456940 >> 172.21.15.42:0/2796456940 conn(0x560e6ccfafc0 msgr2=0x560e6cd01ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:13.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.581+0000 7f0374891740 1 -- 172.21.15.42:0/2796456940 shutdown_connections 2024-08-26T00:07:13.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.582+0000 7f0374891740 1 -- 172.21.15.42:0/2796456940 wait complete. 2024-08-26T00:07:13.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.582+0000 7f0374891740 1 -- start start 2024-08-26T00:07:13.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.583+0000 7f0374891740 1 Processor -- start 2024-08-26T00:07:13.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.584+0000 7f0374891740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6ccfea30 0x560e6cd22da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:13.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.584+0000 7f0374891740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560e6ccff350 0x560e6cd232e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:13.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.585+0000 7f036aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6ccfea30 0x560e6cd22da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:13.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.585+0000 7f0374891740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6cd09c10 0x560e6cd03370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:13.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.585+0000 7f036aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6ccfea30 0x560e6cd22da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:40922/0 (socket says 172.21.15.42:40922) 2024-08-26T00:07:13.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.586+0000 7f036b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6cd09c10 0x560e6cd03370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:13.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.586+0000 7f036b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6cd09c10 0x560e6cd03370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57812/0 (socket says 172.21.15.42:57812) 2024-08-26T00:07:13.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.586+0000 7f0374891740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f036c11a2e0 con 0x560e6cd09c10 2024-08-26T00:07:13.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.586+0000 7f0374891740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f036c11b750 con 0x560e6ccfea30 2024-08-26T00:07:13.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.586+0000 7f0374891740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f036c11a9b0 con 0x560e6ccff350 2024-08-26T00:07:13.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.586+0000 7f0374891740 10 client.0 _ll_register_callbacks cb 0x7f036c06ad70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:07:13.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.587+0000 7f036aa00640 1 -- 172.21.15.42:0/3954758986 learned_addr learned my addr 172.21.15.42:0/3954758986 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:13.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.588+0000 7f036b400640 1 -- 172.21.15.42:0/3954758986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560e6ccff350 msgr2=0x560e6cd232e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-26T00:07:13.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.588+0000 7f036b400640 1 --2- 172.21.15.42:0/3954758986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560e6ccff350 0x560e6cd232e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.588+0000 7f036b400640 1 -- 172.21.15.42:0/3954758986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6ccfea30 msgr2=0x560e6cd22da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:13.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.588+0000 7f036b400640 1 --2- 172.21.15.42:0/3954758986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6ccfea30 0x560e6cd22da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.588+0000 7f036b400640 1 -- 172.21.15.42:0/3954758986 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e6cd039e0 con 0x560e6cd09c10 2024-08-26T00:07:13.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.588+0000 7f036aa00640 1 --2- 172.21.15.42:0/3954758986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6ccfea30 0x560e6cd22da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-08-26T00:07:13.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.590+0000 7f036b400640 1 --2- 172.21.15.42:0/3954758986 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6cd09c10 0x560e6cd03370 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f036402af30 tx=0x7f0364009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23652da8819d13d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:13.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.590+0000 7f0354c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:07:13.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.591+0000 7f0354c00640 1 -- 172.21.15.42:0/3954758986 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0364034040 con 0x560e6cd09c10 2024-08-26T00:07:13.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.591+0000 7f0354c00640 1 -- 172.21.15.42:0/3954758986 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f0364004530 con 0x560e6cd09c10 2024-08-26T00:07:13.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.592+0000 7f0374891740 1 -- 172.21.15.42:0/3954758986 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f035c015030 con 0x560e6cd09c10 2024-08-26T00:07:13.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.592+0000 7f0354c00640 1 -- 172.21.15.42:0/3954758986 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f03640306b0 con 0x560e6cd09c10 2024-08-26T00:07:13.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.593+0000 7f0374891740 10 client.15537 fetch_fsmap learned FSMap version 29 2024-08-26T00:07:13.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.593+0000 7f0374891740 1 -- 172.21.15.42:0/3954758986 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560e6cd94f80 con 0x560e6cd09c10 2024-08-26T00:07:13.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.594+0000 7f0354c00640 1 -- 172.21.15.42:0/3954758986 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f035c015030 con 0x560e6cd09c10 2024-08-26T00:07:13.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.594+0000 7f0354c00640 1 -- 172.21.15.42:0/3954758986 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0364042040 con 0x560e6cd09c10 2024-08-26T00:07:13.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.594+0000 7f0374891740 10 client.15537 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:07:13.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.595+0000 7f0374891740 10 client.15537 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-26T00:07:13.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.595+0000 7f0374891740 20 client.15537 populate_metadata read hostname 'smithi042' 2024-08-26T00:07:13.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.595+0000 7f0374891740 1 --2- 172.21.15.42:0/3954758986 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x560e6cd956b0 0x560e6cd97ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:13.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.595+0000 7f0374891740 4 client.15537 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:07:13.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.595+0000 7f0374891740 1 -- 172.21.15.42:0/3954758986 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560e6cc6c9b0 con 0x560e6cd956b0 2024-08-26T00:07:13.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.596+0000 7f036aa00640 1 --2- 172.21.15.42:0/3954758986 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x560e6cd956b0 0x560e6cd97ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:13.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.597+0000 7f036aa00640 1 --2- 172.21.15.42:0/3954758986 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x560e6cd956b0 0x560e6cd97ad0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f6788265e993b270 server_cookie=711c8410c9d49c2f in_seq=0 out_seq=0 2024-08-26T00:07:13.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.597+0000 7f0354c00640 10 client.15537 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:07:13.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.597+0000 7f0354c00640 1 -- 172.21.15.42:0/3954758986 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560e6cc6c9b0 con 0x560e6cd956b0 2024-08-26T00:07:13.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.597+0000 7f0354c00640 10 client.15537 handle_command_reply: tid=0 2024-08-26T00:07:13.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.598+0000 7f0374891740 1 client.15537 shutdown 2024-08-26T00:07:13.604 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:07:13.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.598+0000 7f0374891740 1 -- 172.21.15.42:0/3954758986 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6cd09c10 msgr2=0x560e6cd03370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:13.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.598+0000 7f0374891740 1 --2- 172.21.15.42:0/3954758986 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6cd09c10 0x560e6cd03370 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f036402af30 tx=0x7f0364009800 comp rx=0 tx=0).stop 2024-08-26T00:07:13.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.599+0000 7f0374891740 1 -- 172.21.15.42:0/3954758986 shutdown_connections 2024-08-26T00:07:13.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.599+0000 7f0374891740 1 --2- 172.21.15.42:0/3954758986 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x560e6cd956b0 0x560e6cd97ad0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.599+0000 7f0374891740 1 --2- 172.21.15.42:0/3954758986 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560e6cd09c10 0x560e6cd03370 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.599+0000 7f0374891740 1 --2- 172.21.15.42:0/3954758986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560e6ccff350 0x560e6cd232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.599+0000 7f0374891740 1 --2- 172.21.15.42:0/3954758986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560e6ccfea30 0x560e6cd22da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.599+0000 7f0374891740 1 -- 172.21.15.42:0/3954758986 >> 172.21.15.42:0/3954758986 conn(0x560e6ccfafc0 msgr2=0x560e6cd081d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:13.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.599+0000 7f0354c00640 0 client.15537 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:07:13.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.600+0000 7f0374891740 1 -- 172.21.15.42:0/3954758986 shutdown_connections 2024-08-26T00:07:13.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.600+0000 7f0374891740 1 -- 172.21.15.42:0/3954758986 wait complete. 2024-08-26T00:07:13.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.600+0000 7f0374891740 20 client.15537 trim_cache size 0 max 16384 2024-08-26T00:07:13.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.601+0000 7f036be00640 1 -- 172.21.15.42:0/479567392 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f03500a2c00 msgr2=0x7f03500a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:13.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.601+0000 7f036be00640 1 --2- 172.21.15.42:0/479567392 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f03500a2c00 0x7f03500a50c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f036c109fa0 tx=0x7f0358008040 comp rx=0 tx=0).stop 2024-08-26T00:07:13.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.602+0000 7f036be00640 1 -- 172.21.15.42:0/479567392 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f036c102930 msgr2=0x7f036c10b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:13.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.602+0000 7f036be00640 1 --2- 172.21.15.42:0/479567392 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f036c102930 0x7f036c10b730 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f035c00d950 tx=0x7f035c00de10 comp rx=0 tx=0).stop 2024-08-26T00:07:13.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.603+0000 7f036be00640 1 -- 172.21.15.42:0/479567392 shutdown_connections 2024-08-26T00:07:13.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.603+0000 7f036be00640 1 --2- 172.21.15.42:0/479567392 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f03500a2c00 0x7f03500a50c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.603+0000 7f036be00640 1 --2- 172.21.15.42:0/479567392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f036c10bd60 0x7f036c108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.603+0000 7f036be00640 1 --2- 172.21.15.42:0/479567392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f036c103250 0x7f036c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.603+0000 7f036be00640 1 --2- 172.21.15.42:0/479567392 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f036c102930 0x7f036c10b730 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:13.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.603+0000 7f036be00640 1 -- 172.21.15.42:0/479567392 >> 172.21.15.42:0/479567392 conn(0x7f036c0fc3b0 msgr2=0x7f036c0fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:13.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.605+0000 7f036be00640 1 -- 172.21.15.42:0/479567392 shutdown_connections 2024-08-26T00:07:13.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:13.605+0000 7f036be00640 1 -- 172.21.15.42:0/479567392 wait complete. 2024-08-26T00:07:13.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:13 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:07:13.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:13 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:07:13.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:13 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:07:13.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:07:13.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:07:13.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:13 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:07:14.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:14 smithi043 ceph-mon[22091]: pgmap v480: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.1 MiB/s wr, 292 op/s 2024-08-26T00:07:14.761 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:14 smithi042 ceph-mon[17225]: pgmap v480: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.1 MiB/s wr, 292 op/s 2024-08-26T00:07:14.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:14 smithi181 ceph-mon[22102]: pgmap v480: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.1 MiB/s wr, 292 op/s 2024-08-26T00:07:15.223 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-26T00:07:16.488 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:16 smithi042 ceph-mon[17225]: pgmap v481: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.1 MiB/s wr, 319 op/s 2024-08-26T00:07:16.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:16 smithi043 ceph-mon[22091]: pgmap v481: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.1 MiB/s wr, 319 op/s 2024-08-26T00:07:16.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:16 smithi181 ceph-mon[22102]: pgmap v481: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.1 MiB/s wr, 319 op/s 2024-08-26T00:07:18.492 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:18 smithi042 ceph-mon[17225]: pgmap v482: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.9 MiB/s wr, 561 op/s 2024-08-26T00:07:18.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:18 smithi043 ceph-mon[22091]: pgmap v482: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.9 MiB/s wr, 561 op/s 2024-08-26T00:07:18.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:18 smithi181 ceph-mon[22102]: pgmap v482: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.9 MiB/s wr, 561 op/s 2024-08-26T00:07:20.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:20 smithi043 ceph-mon[22091]: pgmap v483: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 16 MiB/s wr, 863 op/s 2024-08-26T00:07:20.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:20 smithi042 ceph-mon[17225]: pgmap v483: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 16 MiB/s wr, 863 op/s 2024-08-26T00:07:20.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:20 smithi181 ceph-mon[22102]: pgmap v483: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 16 MiB/s wr, 863 op/s 2024-08-26T00:07:21.676 INFO:tasks.workunit.client.0.smithi042.stdout: 343 479094 974 334514 786 153001 1183 2024-08-26T00:07:22.660 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:22 smithi042 ceph-mon[17225]: pgmap v484: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 16 MiB/s wr, 884 op/s 2024-08-26T00:07:22.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:22 smithi043 ceph-mon[22091]: pgmap v484: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 16 MiB/s wr, 884 op/s 2024-08-26T00:07:22.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:22 smithi181 ceph-mon[22102]: pgmap v484: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 16 MiB/s wr, 884 op/s 2024-08-26T00:07:24.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:24 smithi043 ceph-mon[22091]: pgmap v485: 97 pgs: 97 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 18 MiB/s wr, 952 op/s 2024-08-26T00:07:24.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:24 smithi181 ceph-mon[22102]: pgmap v485: 97 pgs: 97 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 18 MiB/s wr, 952 op/s 2024-08-26T00:07:24.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:24 smithi042 ceph-mon[17225]: pgmap v485: 97 pgs: 97 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 18 MiB/s wr, 952 op/s 2024-08-26T00:07:25.391 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:07:26.675 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:26 smithi042 ceph-mon[17225]: pgmap v486: 97 pgs: 97 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 17 MiB/s wr, 946 op/s 2024-08-26T00:07:26.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:26 smithi043 ceph-mon[22091]: pgmap v486: 97 pgs: 97 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 17 MiB/s wr, 946 op/s 2024-08-26T00:07:26.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:26 smithi181 ceph-mon[22102]: pgmap v486: 97 pgs: 97 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 17 MiB/s wr, 946 op/s 2024-08-26T00:07:27.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.820+0000 7f77fda00640 1 -- 172.21.15.42:0/3866788563 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77f8104310 msgr2=0x7f77f8110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:27.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.821+0000 7f77fda00640 1 --2- 172.21.15.42:0/3866788563 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77f8104310 0x7f77f8110840 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f77f0009c10 tx=0x7f77f002a6e0 comp rx=0 tx=0).stop 2024-08-26T00:07:27.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.821+0000 7f77fda00640 1 -- 172.21.15.42:0/3866788563 shutdown_connections 2024-08-26T00:07:27.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.821+0000 7f77fda00640 1 --2- 172.21.15.42:0/3866788563 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77f8104310 0x7f77f8110840 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:27.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.822+0000 7f77fda00640 1 --2- 172.21.15.42:0/3866788563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77f8103970 0x7f77f8103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:27.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.822+0000 7f77fda00640 1 --2- 172.21.15.42:0/3866788563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77f8109970 0x7f77f8109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:27.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.822+0000 7f77fda00640 1 -- 172.21.15.42:0/3866788563 >> 172.21.15.42:0/3866788563 conn(0x7f77f80ff6b0 msgr2=0x7f77f8101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:27.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.822+0000 7f77fda00640 1 -- 172.21.15.42:0/3866788563 shutdown_connections 2024-08-26T00:07:27.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.822+0000 7f77fda00640 1 -- 172.21.15.42:0/3866788563 wait complete. 2024-08-26T00:07:27.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.824+0000 7f77fda00640 1 Processor -- start 2024-08-26T00:07:27.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.825+0000 7f77fda00640 1 -- start start 2024-08-26T00:07:27.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.827+0000 7f77fda00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77f8103970 0x7f77f819a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:27.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.827+0000 7f77fda00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77f8104310 0x7f77f819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:27.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.827+0000 7f77fda00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77f8109970 0x7f77f819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:27.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.827+0000 7f77fda00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f77f8113d70 con 0x7f77f8109970 2024-08-26T00:07:27.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.827+0000 7f77fda00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f77f8113bf0 con 0x7f77f8103970 2024-08-26T00:07:27.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.827+0000 7f77fda00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f77f8113ef0 con 0x7f77f8104310 2024-08-26T00:07:27.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.827+0000 7f77f7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77f8103970 0x7f77f819a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:27.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.827+0000 7f77f7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77f8103970 0x7f77f819a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:43386/0 (socket says 172.21.15.42:43386) 2024-08-26T00:07:27.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.827+0000 7f77f7e00640 1 -- 172.21.15.42:0/3734191826 learned_addr learned my addr 172.21.15.42:0/3734191826 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:27.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.828+0000 7f77fd000640 1 --2- 172.21.15.42:0/3734191826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77f8109970 0x7f77f819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:27.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.828+0000 7f77f7400640 1 --2- 172.21.15.42:0/3734191826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77f8104310 0x7f77f819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:27.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.828+0000 7f77f7e00640 1 -- 172.21.15.42:0/3734191826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77f8104310 msgr2=0x7f77f819a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:27.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.828+0000 7f77f7e00640 1 --2- 172.21.15.42:0/3734191826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77f8104310 0x7f77f819a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:27.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.828+0000 7f77f7e00640 1 -- 172.21.15.42:0/3734191826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77f8109970 msgr2=0x7f77f819eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:27.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.828+0000 7f77f7e00640 1 --2- 172.21.15.42:0/3734191826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77f8109970 0x7f77f819eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:27.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.828+0000 7f77f7e00640 1 -- 172.21.15.42:0/3734191826 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f819f220 con 0x7f77f8103970 2024-08-26T00:07:27.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.828+0000 7f77fd000640 1 --2- 172.21.15.42:0/3734191826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77f8109970 0x7f77f819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:07:27.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.829+0000 7f77f7e00640 1 --2- 172.21.15.42:0/3734191826 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77f8103970 0x7f77f819a270 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009e70 tx=0x7f77e800ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:27.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.830+0000 7f77f4c00640 1 -- 172.21.15.42:0/3734191826 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e800c8b0 con 0x7f77f8103970 2024-08-26T00:07:27.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.830+0000 7f77f4c00640 1 -- 172.21.15.42:0/3734191826 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77e8005020 con 0x7f77f8103970 2024-08-26T00:07:27.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.830+0000 7f77f4c00640 1 -- 172.21.15.42:0/3734191826 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e800c8b0 con 0x7f77f8103970 2024-08-26T00:07:27.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.831+0000 7f77fda00640 1 -- 172.21.15.42:0/3734191826 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77f819f510 con 0x7f77f8103970 2024-08-26T00:07:27.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.832+0000 7f77fda00640 1 -- 172.21.15.42:0/3734191826 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77f819f940 con 0x7f77f8103970 2024-08-26T00:07:27.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.846+0000 7f77f4c00640 1 -- 172.21.15.42:0/3734191826 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f77e80051d0 con 0x7f77f8103970 2024-08-26T00:07:27.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.846+0000 7f7801c2a740 1 Processor -- start 2024-08-26T00:07:27.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.848+0000 7f77f4c00640 1 --2- 172.21.15.42:0/3734191826 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f77dc0a2e50 0x7f77dc0a5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:27.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.848+0000 7f77f4c00640 1 -- 172.21.15.42:0/3734191826 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f77e80d7430 con 0x7f77f8103970 2024-08-26T00:07:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.849+0000 7f7801c2a740 1 -- start start 2024-08-26T00:07:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.850+0000 7f7801c2a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313577a30 0x559313577e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.850+0000 7f7801c2a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313578350 0x5593135826d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.850+0000 7f7801c2a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313582c10 0x559313585000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:27.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.850+0000 7f7801c2a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5593134ddf30 con 0x559313577a30 2024-08-26T00:07:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.850+0000 7f7801c2a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5593134755a0 con 0x559313582c10 2024-08-26T00:07:27.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.850+0000 7f7801c2a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5593134d9ef0 con 0x559313578350 2024-08-26T00:07:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.853+0000 7f77f7400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313578350 0x5593135826d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.853+0000 7f77fd000640 1 --2- 172.21.15.42:0/3734191826 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f77dc0a2e50 0x7f77dc0a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.854+0000 7f77f7400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313578350 0x5593135826d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:40242/0 (socket says 172.21.15.42:40242) 2024-08-26T00:07:27.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.854+0000 7f77f7400640 1 -- 172.21.15.42:0/3341444951 learned_addr learned my addr 172.21.15.42:0/3341444951 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:27.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.854+0000 7f77f7e00640 1 --2- 172.21.15.42:0/3341444951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313577a30 0x559313577e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.856+0000 7f77f7400640 1 -- 172.21.15.42:0/3341444951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313582c10 msgr2=0x559313585000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-26T00:07:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.856+0000 7f77fd000640 1 --2- 172.21.15.42:0/3341444951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313582c10 0x559313585000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.856+0000 7f77f7400640 1 --2- 172.21.15.42:0/3341444951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313582c10 0x559313585000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:27.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.856+0000 7f77f7400640 1 -- 172.21.15.42:0/3341444951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313577a30 msgr2=0x559313577e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.856+0000 7f77f7400640 1 --2- 172.21.15.42:0/3341444951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313577a30 0x559313577e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.856+0000 7f77f7400640 1 -- 172.21.15.42:0/3341444951 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55931324f3c0 con 0x559313578350 2024-08-26T00:07:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.856+0000 7f77f7e00640 1 --2- 172.21.15.42:0/3341444951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313577a30 0x559313577e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:07:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.857+0000 7f77fd000640 1 --2- 172.21.15.42:0/3341444951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313582c10 0x559313585000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:07:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.857+0000 7f77f7400640 1 --2- 172.21.15.42:0/3341444951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313578350 0x5593135826d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009c20 tx=0x7f77e40117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4652e85340daefb9 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.858+0000 7f77fd000640 1 --2- 172.21.15.42:0/3734191826 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f77dc0a2e50 0x7f77dc0a5310 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f77f0006010 tx=0x7f77f0030d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.858+0000 7f77ed600640 1 -- 172.21.15.42:0/3341444951 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e4012450 con 0x559313578350 2024-08-26T00:07:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.858+0000 7f77ed600640 1 -- 172.21.15.42:0/3341444951 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77e4012ad0 con 0x559313578350 2024-08-26T00:07:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.858+0000 7f77ed600640 1 -- 172.21.15.42:0/3341444951 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e400fb90 con 0x559313578350 2024-08-26T00:07:27.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.861+0000 7f7801c2a740 1 -- 172.21.15.42:0/3341444951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313578350 msgr2=0x5593135826d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:27.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.861+0000 7f7801c2a740 1 --2- 172.21.15.42:0/3341444951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313578350 0x5593135826d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009c20 tx=0x7f77e40117b0 comp rx=0 tx=0).stop 2024-08-26T00:07:27.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.861+0000 7f7801c2a740 1 -- 172.21.15.42:0/3341444951 shutdown_connections 2024-08-26T00:07:27.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.861+0000 7f7801c2a740 1 --2- 172.21.15.42:0/3341444951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313582c10 0x559313585000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:27.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.861+0000 7f7801c2a740 1 --2- 172.21.15.42:0/3341444951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313578350 0x5593135826d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:27.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.861+0000 7f7801c2a740 1 --2- 172.21.15.42:0/3341444951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313577a30 0x559313577e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:27.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.861+0000 7f7801c2a740 1 -- 172.21.15.42:0/3341444951 >> 172.21.15.42:0/3341444951 conn(0x559313573fc0 msgr2=0x5593135743a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:27.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.861+0000 7f7801c2a740 1 -- 172.21.15.42:0/3341444951 shutdown_connections 2024-08-26T00:07:27.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.862+0000 7f7801c2a740 1 -- 172.21.15.42:0/3341444951 wait complete. 2024-08-26T00:07:27.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.863+0000 7f7801c2a740 1 -- start start 2024-08-26T00:07:27.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.863+0000 7f7801c2a740 1 Processor -- start 2024-08-26T00:07:27.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.868+0000 7f7801c2a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313577a30 0x55931357faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:27.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.868+0000 7f7801c2a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313578350 0x55931357ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.868+0000 7f7801c2a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313582c10 0x559313580520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.868+0000 7f77f7400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313578350 0x55931357ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.868+0000 7f77f7400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313578350 0x55931357ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:43402/0 (socket says 172.21.15.42:43402) 2024-08-26T00:07:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.868+0000 7f77f7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313577a30 0x55931357faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.868+0000 7f77f7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313577a30 0x55931357faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:40254/0 (socket says 172.21.15.42:40254) 2024-08-26T00:07:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.869+0000 7f77f7400640 1 -- 172.21.15.42:0/3715271597 learned_addr learned my addr 172.21.15.42:0/3715271597 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.869+0000 7f77fd000640 1 --2- 172.21.15.42:0/3715271597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313582c10 0x559313580520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.869+0000 7f7801c2a740 1 -- 172.21.15.42:0/3715271597 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5593135967f0 con 0x559313582c10 2024-08-26T00:07:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.869+0000 7f7801c2a740 1 -- 172.21.15.42:0/3715271597 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559313498de0 con 0x559313578350 2024-08-26T00:07:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.869+0000 7f7801c2a740 1 -- 172.21.15.42:0/3715271597 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559313596970 con 0x559313577a30 2024-08-26T00:07:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.870+0000 7f77f7400640 1 -- 172.21.15.42:0/3715271597 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313577a30 msgr2=0x55931357faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.870+0000 7f77f7400640 1 --2- 172.21.15.42:0/3715271597 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313577a30 0x55931357faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.870+0000 7f7801c2a740 10 client.0 _ll_register_callbacks cb 0x5593134877b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:07:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.870+0000 7f77f7400640 1 -- 172.21.15.42:0/3715271597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313582c10 msgr2=0x559313580520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.870+0000 7f77f7400640 1 --2- 172.21.15.42:0/3715271597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313582c10 0x559313580520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.870+0000 7f77f7400640 1 -- 172.21.15.42:0/3715271597 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55931359fc90 con 0x559313578350 2024-08-26T00:07:27.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.870+0000 7f77fd000640 1 --2- 172.21.15.42:0/3715271597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313582c10 0x559313580520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:07:27.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.870+0000 7f77f7400640 1 --2- 172.21.15.42:0/3715271597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313578350 0x55931357ffe0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f77e401c040 tx=0x7f77e4012f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d801cb49db8f0f73 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:27.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.873+0000 7f77e2000640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:07:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.873+0000 7f77e2000640 1 -- 172.21.15.42:0/3715271597 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e4028020 con 0x559313578350 2024-08-26T00:07:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.873+0000 7f77e2000640 1 -- 172.21.15.42:0/3715271597 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f77e4012450 con 0x559313578350 2024-08-26T00:07:27.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.874+0000 7f7801c2a740 1 -- 172.21.15.42:0/3715271597 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77e4012ad0 con 0x559313578350 2024-08-26T00:07:27.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.874+0000 7f77e2000640 1 -- 172.21.15.42:0/3715271597 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f77e4012650 con 0x559313578350 2024-08-26T00:07:27.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.874+0000 7f7801c2a740 10 client.25598 fetch_fsmap learned FSMap version 29 2024-08-26T00:07:27.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.874+0000 7f7801c2a740 1 -- 172.21.15.42:0/3715271597 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5593135a2390 con 0x559313578350 2024-08-26T00:07:27.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.875+0000 7f77e2000640 1 -- 172.21.15.42:0/3715271597 <== mon.2 v2:172.21.15.43:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f77e4005050 con 0x559313578350 2024-08-26T00:07:27.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.875+0000 7f7801c2a740 10 client.25598 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:07:27.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.875+0000 7f7801c2a740 10 client.25598 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:07:27.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.875+0000 7f7801c2a740 20 client.25598 populate_metadata read hostname 'smithi042' 2024-08-26T00:07:27.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.875+0000 7f7801c2a740 1 --2- 172.21.15.42:0/3715271597 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5593135a36e0 0x5593135a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:27.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.875+0000 7f7801c2a740 4 client.25598 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:07:27.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.875+0000 7f7801c2a740 1 -- 172.21.15.42:0/3715271597 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593134eb4a0 con 0x5593135a36e0 2024-08-26T00:07:27.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.902+0000 7f77f7e00640 1 --2- 172.21.15.42:0/3715271597 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5593135a36e0 0x5593135a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:27.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.903+0000 7f77f7e00640 1 --2- 172.21.15.42:0/3715271597 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5593135a36e0 0x5593135a5ad0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc10158617acda7a server_cookie=f810239e76e837e7 in_seq=0 out_seq=0 2024-08-26T00:07:27.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.903+0000 7f77e2000640 10 client.25598 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:07:27.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.905+0000 7f77e2000640 1 -- 172.21.15.42:0/3715271597 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5593134eb4a0 con 0x5593135a36e0 2024-08-26T00:07:27.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.905+0000 7f77e2000640 10 client.25598 handle_command_reply: tid=0 2024-08-26T00:07:27.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.905+0000 7f7801c2a740 1 client.25598 shutdown 2024-08-26T00:07:27.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.906+0000 7f7801c2a740 1 -- 172.21.15.42:0/3715271597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313578350 msgr2=0x55931357ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:27.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.906+0000 7f7801c2a740 1 --2- 172.21.15.42:0/3715271597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313578350 0x55931357ffe0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f77e401c040 tx=0x7f77e4012f20 comp rx=0 tx=0).stop 2024-08-26T00:07:27.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.906+0000 7f7801c2a740 1 -- 172.21.15.42:0/3715271597 shutdown_connections 2024-08-26T00:07:27.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.906+0000 7f7801c2a740 1 --2- 172.21.15.42:0/3715271597 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5593135a36e0 0x5593135a5ad0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:27.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.910+0000 7f7801c2a740 1 --2- 172.21.15.42:0/3715271597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313582c10 0x559313580520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:27.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.910+0000 7f7801c2a740 1 --2- 172.21.15.42:0/3715271597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313578350 0x55931357ffe0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:27.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.910+0000 7f77e2000640 0 client.25598 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:07:27.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.910+0000 7f7801c2a740 1 --2- 172.21.15.42:0/3715271597 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313577a30 0x55931357faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:27.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.910+0000 7f7801c2a740 1 -- 172.21.15.42:0/3715271597 >> 172.21.15.42:0/3715271597 conn(0x559313573fc0 msgr2=0x559313579cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:27.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.910+0000 7f7801c2a740 1 -- 172.21.15.42:0/3715271597 shutdown_connections 2024-08-26T00:07:27.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.910+0000 7f7801c2a740 1 -- 172.21.15.42:0/3715271597 wait complete. 2024-08-26T00:07:27.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.910+0000 7f7801c2a740 20 client.25598 trim_cache size 0 max 16384 2024-08-26T00:07:27.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.956+0000 7f7801c2a740 1 Processor -- start 2024-08-26T00:07:27.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.956+0000 7f7801c2a740 1 -- start start 2024-08-26T00:07:27.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.956+0000 7f7801c2a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313577a30 0x55931357a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:27.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.956+0000 7f7801c2a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313578350 0x559313580370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:27.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.956+0000 7f7801c2a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313582c10 0x5593135ab100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:27.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.956+0000 7f7801c2a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f77f80725a0 con 0x559313578350 2024-08-26T00:07:27.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.956+0000 7f7801c2a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f77f806fdb0 con 0x559313577a30 2024-08-26T00:07:27.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.956+0000 7f7801c2a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f77f806dc00 con 0x559313582c10 2024-08-26T00:07:27.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.957+0000 7f77f7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313577a30 0x55931357a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:27.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.957+0000 7f77f7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313578350 0x559313580370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:27.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.957+0000 7f77f7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313577a30 0x55931357a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:43418/0 (socket says 172.21.15.42:43418) 2024-08-26T00:07:27.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.957+0000 7f77f7e00640 1 -- 172.21.15.42:0/2155119010 learned_addr learned my addr 172.21.15.42:0/2155119010 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:27.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.957+0000 7f77fd000640 1 --2- 172.21.15.42:0/2155119010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313582c10 0x5593135ab100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:27.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.961+0000 7f77f7e00640 1 -- 172.21.15.42:0/2155119010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313582c10 msgr2=0x5593135ab100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:27.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.961+0000 7f77f7e00640 1 --2- 172.21.15.42:0/2155119010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313582c10 0x5593135ab100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:27.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.962+0000 7f77f7e00640 1 -- 172.21.15.42:0/2155119010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313578350 msgr2=0x559313580370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:27.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.962+0000 7f77f7e00640 1 --2- 172.21.15.42:0/2155119010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313578350 0x559313580370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:27.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.962+0000 7f77f7e00640 1 -- 172.21.15.42:0/2155119010 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559313574900 con 0x559313577a30 2024-08-26T00:07:27.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.962+0000 7f77f7400640 1 --2- 172.21.15.42:0/2155119010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313578350 0x559313580370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:07:27.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.962+0000 7f77f7e00640 1 --2- 172.21.15.42:0/2155119010 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313577a30 0x55931357a490 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f77e80a0660 tx=0x7f77e80d4e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f555c195ccf6651 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:27.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.966+0000 7f77ecc00640 1 -- 172.21.15.42:0/2155119010 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e80ac900 con 0x559313577a30 2024-08-26T00:07:27.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.966+0000 7f77ecc00640 1 -- 172.21.15.42:0/2155119010 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77e80a1d30 con 0x559313577a30 2024-08-26T00:07:27.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.966+0000 7f77ecc00640 1 -- 172.21.15.42:0/2155119010 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e80ac470 con 0x559313577a30 2024-08-26T00:07:27.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.967+0000 7f7801c2a740 1 -- 172.21.15.42:0/2155119010 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313577a30 msgr2=0x55931357a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:27.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.967+0000 7f7801c2a740 1 --2- 172.21.15.42:0/2155119010 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313577a30 0x55931357a490 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f77e80a0660 tx=0x7f77e80d4e00 comp rx=0 tx=0).stop 2024-08-26T00:07:27.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.968+0000 7f7801c2a740 1 -- 172.21.15.42:0/2155119010 shutdown_connections 2024-08-26T00:07:27.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.968+0000 7f7801c2a740 1 --2- 172.21.15.42:0/2155119010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313582c10 0x5593135ab100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:27.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.968+0000 7f7801c2a740 1 --2- 172.21.15.42:0/2155119010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313578350 0x559313580370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:27.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.968+0000 7f7801c2a740 1 --2- 172.21.15.42:0/2155119010 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313577a30 0x55931357a490 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:27.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.968+0000 7f7801c2a740 1 -- 172.21.15.42:0/2155119010 >> 172.21.15.42:0/2155119010 conn(0x559313573fc0 msgr2=0x559313581a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:27.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.968+0000 7f7801c2a740 1 -- 172.21.15.42:0/2155119010 shutdown_connections 2024-08-26T00:07:27.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.968+0000 7f7801c2a740 1 -- 172.21.15.42:0/2155119010 wait complete. 2024-08-26T00:07:27.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.969+0000 7f7801c2a740 1 -- start start 2024-08-26T00:07:27.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.969+0000 7f7801c2a740 1 Processor -- start 2024-08-26T00:07:27.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.982+0000 7f7801c2a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313577a30 0x5593136094b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:27.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.982+0000 7f7801c2a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313578350 0x5593136099f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:27.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.982+0000 7f7801c2a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313582c10 0x55931359bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:27.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.983+0000 7f7801c2a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f77f806e270 con 0x559313582c10 2024-08-26T00:07:27.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.983+0000 7f7801c2a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f77f806f6e0 con 0x559313577a30 2024-08-26T00:07:27.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.983+0000 7f7801c2a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f77f806e940 con 0x559313578350 2024-08-26T00:07:27.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.983+0000 7f7801c2a740 10 client.0 _ll_register_callbacks cb 0x7f77e809f890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:07:27.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.988+0000 7f77fd000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313582c10 0x55931359bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:27.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.988+0000 7f77fd000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313582c10 0x55931359bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56734/0 (socket says 172.21.15.42:56734) 2024-08-26T00:07:27.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.988+0000 7f77fd000640 1 -- 172.21.15.42:0/780906263 learned_addr learned my addr 172.21.15.42:0/780906263 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:27.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.989+0000 7f77f7e00640 1 --2- 172.21.15.42:0/780906263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313577a30 0x5593136094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:27.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.989+0000 7f77f7400640 1 --2- 172.21.15.42:0/780906263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313578350 0x5593136099f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:27.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.990+0000 7f77fd000640 1 -- 172.21.15.42:0/780906263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313578350 msgr2=0x5593136099f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:27.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.990+0000 7f77fd000640 1 --2- 172.21.15.42:0/780906263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313578350 0x5593136099f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:28.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.990+0000 7f77fd000640 1 -- 172.21.15.42:0/780906263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313577a30 msgr2=0x5593136094b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:28.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.990+0000 7f77fd000640 1 --2- 172.21.15.42:0/780906263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313577a30 0x5593136094b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:28.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.990+0000 7f77fd000640 1 -- 172.21.15.42:0/780906263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55931359c400 con 0x559313582c10 2024-08-26T00:07:28.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.991+0000 7f77f7400640 1 --2- 172.21.15.42:0/780906263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313578350 0x5593136099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:07:28.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.992+0000 7f77fd000640 1 --2- 172.21.15.42:0/780906263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313582c10 0x55931359bbf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f77f0009be0 tx=0x7f77f002a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891614346cbb0cd6 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:28.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.992+0000 7f77e2000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:07:28.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.992+0000 7f77e2000640 1 -- 172.21.15.42:0/780906263 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f0036040 con 0x559313582c10 2024-08-26T00:07:28.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.993+0000 7f77e2000640 1 -- 172.21.15.42:0/780906263 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f77f0003b70 con 0x559313582c10 2024-08-26T00:07:28.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.993+0000 7f7801c2a740 1 -- 172.21.15.42:0/780906263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77e80a1d30 con 0x559313582c10 2024-08-26T00:07:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.993+0000 7f77e2000640 1 -- 172.21.15.42:0/780906263 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f77f0003d70 con 0x559313582c10 2024-08-26T00:07:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.993+0000 7f7801c2a740 10 client.15555 fetch_fsmap learned FSMap version 29 2024-08-26T00:07:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.993+0000 7f7801c2a740 1 -- 172.21.15.42:0/780906263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559313608d40 con 0x559313582c10 2024-08-26T00:07:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.994+0000 7f77e2000640 1 -- 172.21.15.42:0/780906263 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77e80a1d30 con 0x559313582c10 2024-08-26T00:07:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.994+0000 7f77e2000640 1 -- 172.21.15.42:0/780906263 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f77f00316e0 con 0x559313582c10 2024-08-26T00:07:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.994+0000 7f7801c2a740 10 client.15555 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:07:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.994+0000 7f7801c2a740 10 client.15555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:07:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.994+0000 7f7801c2a740 20 client.15555 populate_metadata read hostname 'smithi042' 2024-08-26T00:07:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.994+0000 7f7801c2a740 1 --2- 172.21.15.42:0/780906263 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55931361f460 0x559313621850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.995+0000 7f7801c2a740 4 client.15555 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:07:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.995+0000 7f7801c2a740 1 -- 172.21.15.42:0/780906263 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5593134e59b0 con 0x55931361f460 2024-08-26T00:07:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.995+0000 7f77f7e00640 1 --2- 172.21.15.42:0/780906263 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55931361f460 0x559313621850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.996+0000 7f77f7e00640 1 --2- 172.21.15.42:0/780906263 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55931361f460 0x559313621850 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8ef112a4ae7875 server_cookie=934c76c8b4e593bd in_seq=0 out_seq=0 2024-08-26T00:07:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.996+0000 7f77e2000640 10 client.15555 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:07:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.996+0000 7f77e2000640 1 -- 172.21.15.42:0/780906263 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5593134e59b0 con 0x55931361f460 2024-08-26T00:07:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.996+0000 7f77e2000640 10 client.15555 handle_command_reply: tid=0 2024-08-26T00:07:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.996+0000 7f7801c2a740 1 client.15555 shutdown 2024-08-26T00:07:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.997+0000 7f7801c2a740 1 -- 172.21.15.42:0/780906263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313582c10 msgr2=0x55931359bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.997+0000 7f7801c2a740 1 --2- 172.21.15.42:0/780906263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313582c10 0x55931359bbf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f77f0009be0 tx=0x7f77f002a6e0 comp rx=0 tx=0).stop 2024-08-26T00:07:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.997+0000 7f7801c2a740 1 -- 172.21.15.42:0/780906263 shutdown_connections 2024-08-26T00:07:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.998+0000 7f7801c2a740 1 --2- 172.21.15.42:0/780906263 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55931361f460 0x559313621850 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.998+0000 7f7801c2a740 1 --2- 172.21.15.42:0/780906263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559313582c10 0x55931359bbf0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.998+0000 7f7801c2a740 1 --2- 172.21.15.42:0/780906263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559313578350 0x5593136099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.998+0000 7f7801c2a740 1 --2- 172.21.15.42:0/780906263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559313577a30 0x5593136094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.998+0000 7f7801c2a740 1 -- 172.21.15.42:0/780906263 >> 172.21.15.42:0/780906263 conn(0x559313573fc0 msgr2=0x55931359ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.998+0000 7f77e2000640 0 client.15555 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:07:28.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.998+0000 7f7801c2a740 1 -- 172.21.15.42:0/780906263 shutdown_connections 2024-08-26T00:07:28.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.998+0000 7f7801c2a740 1 -- 172.21.15.42:0/780906263 wait complete. 2024-08-26T00:07:28.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:27.998+0000 7f7801c2a740 20 client.15555 trim_cache size 0 max 16384 2024-08-26T00:07:28.005 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:07:28.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:28.000+0000 7f77fda00640 1 -- 172.21.15.42:0/3734191826 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f77dc0a2e50 msgr2=0x7f77dc0a5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:28.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:28.000+0000 7f77fda00640 1 --2- 172.21.15.42:0/3734191826 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f77dc0a2e50 0x7f77dc0a5310 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f77f0006010 tx=0x7f77f0030d90 comp rx=0 tx=0).stop 2024-08-26T00:07:28.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:28.000+0000 7f77fda00640 1 -- 172.21.15.42:0/3734191826 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77f8103970 msgr2=0x7f77f819a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:28.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:28.000+0000 7f77fda00640 1 --2- 172.21.15.42:0/3734191826 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77f8103970 0x7f77f819a270 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009e70 tx=0x7f77e800ed90 comp rx=0 tx=0).stop 2024-08-26T00:07:28.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:28.000+0000 7f77fda00640 1 -- 172.21.15.42:0/3734191826 shutdown_connections 2024-08-26T00:07:28.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:28.000+0000 7f77fda00640 1 --2- 172.21.15.42:0/3734191826 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f77dc0a2e50 0x7f77dc0a5310 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:28.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:28.000+0000 7f77fda00640 1 --2- 172.21.15.42:0/3734191826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77f8109970 0x7f77f819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:28.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:28.000+0000 7f77fda00640 1 --2- 172.21.15.42:0/3734191826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77f8104310 0x7f77f819a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:28.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:28.000+0000 7f77fda00640 1 --2- 172.21.15.42:0/3734191826 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77f8103970 0x7f77f819a270 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:28.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:28.000+0000 7f77fda00640 1 -- 172.21.15.42:0/3734191826 >> 172.21.15.42:0/3734191826 conn(0x7f77f80ff6b0 msgr2=0x7f77f8100f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:28.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:28.001+0000 7f77fda00640 1 -- 172.21.15.42:0/3734191826 shutdown_connections 2024-08-26T00:07:28.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:28.001+0000 7f77fda00640 1 -- 172.21.15.42:0/3734191826 wait complete. 2024-08-26T00:07:28.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:28 smithi043 ceph-mon[22091]: pgmap v487: 97 pgs: 97 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 16 MiB/s wr, 922 op/s 2024-08-26T00:07:28.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:28 smithi181 ceph-mon[22102]: pgmap v487: 97 pgs: 97 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 16 MiB/s wr, 922 op/s 2024-08-26T00:07:28.799 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:28 smithi042 ceph-mon[17225]: pgmap v487: 97 pgs: 97 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 16 MiB/s wr, 922 op/s 2024-08-26T00:07:30.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:30 smithi043 ceph-mon[22091]: pgmap v488: 97 pgs: 97 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 12 MiB/s wr, 731 op/s 2024-08-26T00:07:30.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:30 smithi181 ceph-mon[22102]: pgmap v488: 97 pgs: 97 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 12 MiB/s wr, 731 op/s 2024-08-26T00:07:30.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:30 smithi042 ceph-mon[17225]: pgmap v488: 97 pgs: 97 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 12 MiB/s wr, 731 op/s 2024-08-26T00:07:31.012 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-26T00:07:31.012 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-26T00:07:31.679 INFO:tasks.workunit.client.0.smithi042.stdout: 363 618419 1185 435606 1328 212026 2702 2024-08-26T00:07:32.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:32 smithi043 ceph-mon[22091]: pgmap v489: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.0 MiB/s wr, 433 op/s 2024-08-26T00:07:32.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:32 smithi181 ceph-mon[22102]: pgmap v489: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.0 MiB/s wr, 433 op/s 2024-08-26T00:07:32.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:32 smithi042 ceph-mon[17225]: pgmap v489: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.0 MiB/s wr, 433 op/s 2024-08-26T00:07:34.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:34 smithi043 ceph-mon[22091]: pgmap v490: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.3 MiB/s wr, 430 op/s 2024-08-26T00:07:34.761 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:34 smithi042 ceph-mon[17225]: pgmap v490: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.3 MiB/s wr, 430 op/s 2024-08-26T00:07:34.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:34 smithi181 ceph-mon[22102]: pgmap v490: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.3 MiB/s wr, 430 op/s 2024-08-26T00:07:36.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:36 smithi043 ceph-mon[22091]: pgmap v491: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 367 op/s 2024-08-26T00:07:36.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:36 smithi181 ceph-mon[22102]: pgmap v491: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 367 op/s 2024-08-26T00:07:36.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:36 smithi042 ceph-mon[17225]: pgmap v491: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 367 op/s 2024-08-26T00:07:38.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:38 smithi043 ceph-mon[22091]: pgmap v492: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 380 op/s 2024-08-26T00:07:38.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:38 smithi042 ceph-mon[17225]: pgmap v492: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 380 op/s 2024-08-26T00:07:38.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:38 smithi181 ceph-mon[22102]: pgmap v492: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 380 op/s 2024-08-26T00:07:39.658 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:07:40.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:40 smithi043 ceph-mon[22091]: pgmap v493: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.0 MiB/s wr, 372 op/s 2024-08-26T00:07:40.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:40 smithi181 ceph-mon[22102]: pgmap v493: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.0 MiB/s wr, 372 op/s 2024-08-26T00:07:40.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:40 smithi042 ceph-mon[17225]: pgmap v493: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.0 MiB/s wr, 372 op/s 2024-08-26T00:07:41.681 INFO:tasks.workunit.client.0.smithi042.stdout: 386 607285 1317 422436 1140 225262 2725 2024-08-26T00:07:42.733 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:42 smithi042 ceph-mon[17225]: pgmap v494: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 335 op/s 2024-08-26T00:07:42.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:42 smithi043 ceph-mon[22091]: pgmap v494: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 335 op/s 2024-08-26T00:07:42.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:42 smithi181 ceph-mon[22102]: pgmap v494: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 335 op/s 2024-08-26T00:07:43.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.380+0000 7f0abc600640 1 -- 172.21.15.42:0/2661192455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ab4108f90 msgr2=0x7f0ab4109370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:43.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.383+0000 7f0abc600640 1 --2- 172.21.15.42:0/2661192455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ab4108f90 0x7f0ab4109370 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009900 tx=0x7f0aa402a3f0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.383+0000 7f0abc600640 1 -- 172.21.15.42:0/2661192455 shutdown_connections 2024-08-26T00:07:43.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.383+0000 7f0abc600640 1 --2- 172.21.15.42:0/2661192455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ab4116c40 0x7f0ab4119030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.383+0000 7f0abc600640 1 --2- 172.21.15.42:0/2661192455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ab41098b0 0x7f0ab4116700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.383+0000 7f0abc600640 1 --2- 172.21.15.42:0/2661192455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ab4108f90 0x7f0ab4109370 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.383+0000 7f0abc600640 1 -- 172.21.15.42:0/2661192455 >> 172.21.15.42:0/2661192455 conn(0x7f0ab406dee0 msgr2=0x7f0ab406e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:43.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.383+0000 7f0abc600640 1 -- 172.21.15.42:0/2661192455 shutdown_connections 2024-08-26T00:07:43.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.383+0000 7f0abc600640 1 -- 172.21.15.42:0/2661192455 wait complete. 2024-08-26T00:07:43.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.385+0000 7f0abc600640 1 Processor -- start 2024-08-26T00:07:43.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.385+0000 7f0abc600640 1 -- start start 2024-08-26T00:07:43.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.385+0000 7f0abc600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ab4108f90 0x7f0ab4116500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:43.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.385+0000 7f0abc600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ab41098b0 0x7f0ab41135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:43.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.386+0000 7f0ab9200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ab41098b0 0x7f0ab41135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:43.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.386+0000 7f0ab9200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ab41098b0 0x7f0ab41135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:59120/0 (socket says 172.21.15.42:59120) 2024-08-26T00:07:43.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.386+0000 7f0abc600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ab4116c40 0x7f0ab4113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:43.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.386+0000 7f0abc600640 1 -- 172.21.15.42:0/774909123 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab411c770 con 0x7f0ab4108f90 2024-08-26T00:07:43.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.386+0000 7f0abc600640 1 -- 172.21.15.42:0/774909123 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab411c5f0 con 0x7f0ab4116c40 2024-08-26T00:07:43.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.386+0000 7f0abc600640 1 -- 172.21.15.42:0/774909123 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab411c8f0 con 0x7f0ab41098b0 2024-08-26T00:07:43.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.386+0000 7f0ab9200640 1 -- 172.21.15.42:0/774909123 learned_addr learned my addr 172.21.15.42:0/774909123 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:43.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.387+0000 7f0ab9c00640 1 --2- 172.21.15.42:0/774909123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ab4108f90 0x7f0ab4116500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:43.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.387+0000 7f0aba600640 1 --2- 172.21.15.42:0/774909123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ab4116c40 0x7f0ab4113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:43.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.388+0000 7f0ab9200640 1 -- 172.21.15.42:0/774909123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ab4116c40 msgr2=0x7f0ab4113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:43.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.388+0000 7f0ab9200640 1 --2- 172.21.15.42:0/774909123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ab4116c40 0x7f0ab4113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.388+0000 7f0ab9200640 1 -- 172.21.15.42:0/774909123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ab4108f90 msgr2=0x7f0ab4116500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:43.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.388+0000 7f0ab9200640 1 --2- 172.21.15.42:0/774909123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ab4108f90 0x7f0ab4116500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.388+0000 7f0ab9200640 1 -- 172.21.15.42:0/774909123 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab4114380 con 0x7f0ab41098b0 2024-08-26T00:07:43.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.388+0000 7f0ab9200640 1 --2- 172.21.15.42:0/774909123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ab41098b0 0x7f0ab41135b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0aa800d950 tx=0x7f0aa800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:43.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.389+0000 7f0ab2000640 1 -- 172.21.15.42:0/774909123 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8017070 con 0x7f0ab41098b0 2024-08-26T00:07:43.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.389+0000 7f0ab2000640 1 -- 172.21.15.42:0/774909123 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0aa8009c30 con 0x7f0ab41098b0 2024-08-26T00:07:43.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.389+0000 7f0ab2000640 1 -- 172.21.15.42:0/774909123 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa800f690 con 0x7f0ab41098b0 2024-08-26T00:07:43.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.389+0000 7f0abc600640 1 -- 172.21.15.42:0/774909123 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab41b3510 con 0x7f0ab41098b0 2024-08-26T00:07:43.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.389+0000 7f0abc600640 1 -- 172.21.15.42:0/774909123 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab41b3a50 con 0x7f0ab41098b0 2024-08-26T00:07:43.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.397+0000 7f0abf050740 1 Processor -- start 2024-08-26T00:07:43.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.398+0000 7f0ab2000640 1 -- 172.21.15.42:0/774909123 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0aa80109d0 con 0x7f0ab41098b0 2024-08-26T00:07:43.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.400+0000 7f0abf050740 1 -- start start 2024-08-26T00:07:43.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.400+0000 7f0abf050740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b8857fd30 0x561b88580110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:43.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.400+0000 7f0abf050740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b88580650 0x561b8858a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:43.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.400+0000 7f0abf050740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b8858af10 0x561b8858d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:43.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.400+0000 7f0abf050740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561b884e6e30 con 0x561b8857fd30 2024-08-26T00:07:43.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.400+0000 7f0abf050740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561b8847e3c0 con 0x561b88580650 2024-08-26T00:07:43.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.400+0000 7f0abf050740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561b884e2df0 con 0x561b8858af10 2024-08-26T00:07:43.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.401+0000 7f0aba600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b8857fd30 0x561b88580110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:43.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.401+0000 7f0aba600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b8857fd30 0x561b88580110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46408/0 (socket says 172.21.15.42:46408) 2024-08-26T00:07:43.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.401+0000 7f0aba600640 1 -- 172.21.15.42:0/2012226864 learned_addr learned my addr 172.21.15.42:0/2012226864 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:43.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.402+0000 7f0aba600640 1 -- 172.21.15.42:0/2012226864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b8858af10 msgr2=0x561b8858d300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:07:43.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.402+0000 7f0aba600640 1 --2- 172.21.15.42:0/2012226864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b8858af10 0x561b8858d300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.402+0000 7f0aba600640 1 -- 172.21.15.42:0/2012226864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b88580650 msgr2=0x561b8858a9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:07:43.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.402+0000 7f0aba600640 1 --2- 172.21.15.42:0/2012226864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b88580650 0x561b8858a9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.402+0000 7f0aba600640 1 -- 172.21.15.42:0/2012226864 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b882586a0 con 0x561b8857fd30 2024-08-26T00:07:43.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.403+0000 7f0ab2000640 1 --2- 172.21.15.42:0/774909123 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0a9c0a2d50 0x7f0a9c0a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:43.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.403+0000 7f0ab2000640 1 -- 172.21.15.42:0/774909123 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f0aa80ced00 con 0x7f0ab41098b0 2024-08-26T00:07:43.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.404+0000 7f0aba600640 1 --2- 172.21.15.42:0/2012226864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b8857fd30 0x561b88580110 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0aac007fd0 tx=0x7f0aac00e7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eaee587fe04ab17 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:43.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.405+0000 7f0ab9c00640 1 --2- 172.21.15.42:0/774909123 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0a9c0a2d50 0x7f0a9c0a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:43.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.405+0000 7f0aa2a00640 1 -- 172.21.15.42:0/2012226864 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac014070 con 0x561b8857fd30 2024-08-26T00:07:43.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.406+0000 7f0aa2a00640 1 -- 172.21.15.42:0/2012226864 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0aac004d20 con 0x561b8857fd30 2024-08-26T00:07:43.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.407+0000 7f0abf050740 1 -- 172.21.15.42:0/2012226864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b8857fd30 msgr2=0x561b88580110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:43.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.407+0000 7f0abf050740 1 --2- 172.21.15.42:0/2012226864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b8857fd30 0x561b88580110 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0aac007fd0 tx=0x7f0aac00e7e0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.408+0000 7f0abf050740 1 -- 172.21.15.42:0/2012226864 shutdown_connections 2024-08-26T00:07:43.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.408+0000 7f0ab9c00640 1 --2- 172.21.15.42:0/774909123 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0a9c0a2d50 0x7f0a9c0a5210 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4000c00 tx=0x7f0aa4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:43.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.408+0000 7f0abf050740 1 --2- 172.21.15.42:0/2012226864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b8858af10 0x561b8858d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.408+0000 7f0abf050740 1 --2- 172.21.15.42:0/2012226864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b88580650 0x561b8858a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.408+0000 7f0abf050740 1 --2- 172.21.15.42:0/2012226864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b8857fd30 0x561b88580110 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.408+0000 7f0abf050740 1 -- 172.21.15.42:0/2012226864 >> 172.21.15.42:0/2012226864 conn(0x561b8857c2c0 msgr2=0x561b8857c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:43.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.408+0000 7f0abf050740 1 -- 172.21.15.42:0/2012226864 shutdown_connections 2024-08-26T00:07:43.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.409+0000 7f0abf050740 1 -- 172.21.15.42:0/2012226864 wait complete. 2024-08-26T00:07:43.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.409+0000 7f0abf050740 1 -- start start 2024-08-26T00:07:43.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.410+0000 7f0abf050740 1 Processor -- start 2024-08-26T00:07:43.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.413+0000 7f0abf050740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b8857fd30 0x561b88587e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:43.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.413+0000 7f0abf050740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b88580650 0x561b88588350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:43.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.413+0000 7f0abf050740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b8858af10 0x561b88588890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:43.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.414+0000 7f0ab9c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b8857fd30 0x561b88587e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:43.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.414+0000 7f0aba600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b8858af10 0x561b88588890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:43.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.414+0000 7f0aba600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b8858af10 0x561b88588890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:53980/0 (socket says 172.21.15.42:53980) 2024-08-26T00:07:43.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.414+0000 7f0ab9c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b8857fd30 0x561b88587e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46422/0 (socket says 172.21.15.42:46422) 2024-08-26T00:07:43.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.414+0000 7f0ab9200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b88580650 0x561b88588350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:43.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.414+0000 7f0ab9200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b88580650 0x561b88588350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:59124/0 (socket says 172.21.15.42:59124) 2024-08-26T00:07:43.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.414+0000 7f0aba600640 1 -- 172.21.15.42:0/3415707527 learned_addr learned my addr 172.21.15.42:0/3415707527 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:43.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.414+0000 7f0abf050740 1 -- 172.21.15.42:0/3415707527 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561b8858db80 con 0x561b8857fd30 2024-08-26T00:07:43.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.414+0000 7f0abf050740 1 -- 172.21.15.42:0/3415707527 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561b884a1c30 con 0x561b8858af10 2024-08-26T00:07:43.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.414+0000 7f0abf050740 1 -- 172.21.15.42:0/3415707527 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561b8858dd00 con 0x561b88580650 2024-08-26T00:07:43.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.415+0000 7f0aba600640 1 -- 172.21.15.42:0/3415707527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b88580650 msgr2=0x561b88588350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:43.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.415+0000 7f0aba600640 1 --2- 172.21.15.42:0/3415707527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b88580650 0x561b88588350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.415+0000 7f0aba600640 1 -- 172.21.15.42:0/3415707527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b8857fd30 msgr2=0x561b88587e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:43.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.415+0000 7f0aba600640 1 --2- 172.21.15.42:0/3415707527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b8857fd30 0x561b88587e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.415+0000 7f0aba600640 1 -- 172.21.15.42:0/3415707527 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b884addd0 con 0x561b8858af10 2024-08-26T00:07:43.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.416+0000 7f0abf050740 10 client.0 _ll_register_callbacks cb 0x561b881f5ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:07:43.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.416+0000 7f0abf050740 1 -- 172.21.15.42:0/3415707527 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0aac004d20 con 0x561b8858af10 2024-08-26T00:07:43.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.416+0000 7f0aba600640 1 --2- 172.21.15.42:0/3415707527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b8858af10 0x561b88588890 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0aac007ab0 tx=0x7f0aac00efb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c79674c5af422ece server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:43.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.417+0000 7f0a97400640 10 client.25613 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:07:43.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.417+0000 7f0a97400640 1 -- 172.21.15.42:0/3415707527 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac014070 con 0x561b8858af10 2024-08-26T00:07:43.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.417+0000 7f0a97400640 1 -- 172.21.15.42:0/3415707527 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f0aac003cc0 con 0x561b8858af10 2024-08-26T00:07:43.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.417+0000 7f0a97400640 1 -- 172.21.15.42:0/3415707527 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0aac0104f0 con 0x561b8858af10 2024-08-26T00:07:43.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.418+0000 7f0abf050740 10 client.25613 fetch_fsmap learned FSMap version 29 2024-08-26T00:07:43.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.418+0000 7f0abf050740 1 -- 172.21.15.42:0/3415707527 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({fsmap=29}) -- 0x561b88599670 con 0x561b8858af10 2024-08-26T00:07:43.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.418+0000 7f0a97400640 1 -- 172.21.15.42:0/3415707527 <== mon.2 v2:172.21.15.43:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0aac010690 con 0x561b8858af10 2024-08-26T00:07:43.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.419+0000 7f0abf050740 10 client.25613 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:07:43.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.419+0000 7f0abf050740 10 client.25613 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:07:43.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.419+0000 7f0abf050740 20 client.25613 populate_metadata read hostname 'smithi042' 2024-08-26T00:07:43.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.419+0000 7f0abf050740 1 --2- 172.21.15.42:0/3415707527 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x561b8859aa20 0x561b8859ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:43.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.419+0000 7f0abf050740 4 client.25613 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:07:43.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.419+0000 7f0abf050740 1 -- 172.21.15.42:0/3415707527 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b884f43a0 con 0x561b8859aa20 2024-08-26T00:07:43.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.420+0000 7f0ab9c00640 1 --2- 172.21.15.42:0/3415707527 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x561b8859aa20 0x561b8859ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:43.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.420+0000 7f0a97400640 10 client.25613 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:07:43.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.420+0000 7f0ab9c00640 1 --2- 172.21.15.42:0/3415707527 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x561b8859aa20 0x561b8859ce10 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9caf7aa2167d06bd server_cookie=c71e50a6920be05d in_seq=0 out_seq=0 2024-08-26T00:07:43.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.422+0000 7f0a97400640 1 -- 172.21.15.42:0/3415707527 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561b884f43a0 con 0x561b8859aa20 2024-08-26T00:07:43.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.422+0000 7f0a97400640 10 client.25613 handle_command_reply: tid=0 2024-08-26T00:07:43.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.422+0000 7f0abf050740 1 client.25613 shutdown 2024-08-26T00:07:43.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.423+0000 7f0abf050740 1 -- 172.21.15.42:0/3415707527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b8858af10 msgr2=0x561b88588890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:43.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.423+0000 7f0abf050740 1 --2- 172.21.15.42:0/3415707527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b8858af10 0x561b88588890 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0aac007ab0 tx=0x7f0aac00efb0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.423+0000 7f0abf050740 1 -- 172.21.15.42:0/3415707527 shutdown_connections 2024-08-26T00:07:43.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.423+0000 7f0abf050740 1 --2- 172.21.15.42:0/3415707527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b8858af10 0x561b88588890 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.423+0000 7f0abf050740 1 --2- 172.21.15.42:0/3415707527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b88580650 0x561b88588350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.423+0000 7f0abf050740 1 --2- 172.21.15.42:0/3415707527 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x561b8859aa20 0x561b8859ce10 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.423+0000 7f0abf050740 1 --2- 172.21.15.42:0/3415707527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b8857fd30 0x561b88587e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.423+0000 7f0abf050740 1 -- 172.21.15.42:0/3415707527 >> 172.21.15.42:0/3415707527 conn(0x561b8857c2c0 msgr2=0x561b88581ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:43.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.423+0000 7f0a97400640 0 client.25613 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:07:43.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.424+0000 7f0abf050740 1 -- 172.21.15.42:0/3415707527 shutdown_connections 2024-08-26T00:07:43.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.424+0000 7f0abf050740 1 -- 172.21.15.42:0/3415707527 wait complete. 2024-08-26T00:07:43.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.424+0000 7f0abf050740 20 client.25613 trim_cache size 0 max 16384 2024-08-26T00:07:43.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.466+0000 7f0abf050740 1 Processor -- start 2024-08-26T00:07:43.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.466+0000 7f0abf050740 1 -- start start 2024-08-26T00:07:43.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.466+0000 7f0abf050740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b8857fd30 0x561b885886e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:43.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.466+0000 7f0abf050740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b88580650 0x561b885a23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:43.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.467+0000 7f0abf050740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b8858af10 0x561b885a28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:43.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.467+0000 7f0abf050740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab41beb10 con 0x561b8858af10 2024-08-26T00:07:43.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.467+0000 7f0abf050740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab41bc320 con 0x561b8857fd30 2024-08-26T00:07:43.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.467+0000 7f0abf050740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab41ba150 con 0x561b88580650 2024-08-26T00:07:43.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.468+0000 7f0aba600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b8858af10 0x561b885a28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:43.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.468+0000 7f0ab9200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b88580650 0x561b885a23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:43.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.468+0000 7f0ab9200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b88580650 0x561b885a23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:59132/0 (socket says 172.21.15.42:59132) 2024-08-26T00:07:43.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.468+0000 7f0ab9200640 1 -- 172.21.15.42:0/945781585 learned_addr learned my addr 172.21.15.42:0/945781585 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:43.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.468+0000 7f0ab9c00640 1 --2- 172.21.15.42:0/945781585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b8857fd30 0x561b885886e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:43.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.469+0000 7f0aba600640 1 -- 172.21.15.42:0/945781585 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b88580650 msgr2=0x561b885a23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:43.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.469+0000 7f0aba600640 1 --2- 172.21.15.42:0/945781585 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b88580650 0x561b885a23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.469+0000 7f0aba600640 1 -- 172.21.15.42:0/945781585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b8857fd30 msgr2=0x561b885886e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:43.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.469+0000 7f0aba600640 1 --2- 172.21.15.42:0/945781585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b8857fd30 0x561b885886e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.469+0000 7f0aba600640 1 -- 172.21.15.42:0/945781585 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b88580480 con 0x561b8858af10 2024-08-26T00:07:43.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.469+0000 7f0aba600640 1 --2- 172.21.15.42:0/945781585 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b8858af10 0x561b885a28f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0aac000f80 tx=0x7f0aac019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d905b89ea9242a10 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:43.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.470+0000 7f0aa2000640 1 -- 172.21.15.42:0/945781585 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac010af0 con 0x561b8858af10 2024-08-26T00:07:43.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.470+0000 7f0aa2000640 1 -- 172.21.15.42:0/945781585 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0aac004d20 con 0x561b8858af10 2024-08-26T00:07:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.470+0000 7f0aa2000640 1 -- 172.21.15.42:0/945781585 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac010690 con 0x561b8858af10 2024-08-26T00:07:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.471+0000 7f0abf050740 1 -- 172.21.15.42:0/945781585 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b8858af10 msgr2=0x561b885a28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.471+0000 7f0abf050740 1 --2- 172.21.15.42:0/945781585 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b8858af10 0x561b885a28f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0aac000f80 tx=0x7f0aac019000 comp rx=0 tx=0).stop 2024-08-26T00:07:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.472+0000 7f0abf050740 1 -- 172.21.15.42:0/945781585 shutdown_connections 2024-08-26T00:07:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.472+0000 7f0abf050740 1 --2- 172.21.15.42:0/945781585 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b8858af10 0x561b885a28f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.472+0000 7f0abf050740 1 --2- 172.21.15.42:0/945781585 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b88580650 0x561b885a23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.472+0000 7f0abf050740 1 --2- 172.21.15.42:0/945781585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b8857fd30 0x561b885886e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.472+0000 7f0abf050740 1 -- 172.21.15.42:0/945781585 >> 172.21.15.42:0/945781585 conn(0x561b8857c2c0 msgr2=0x561b88589d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.472+0000 7f0abf050740 1 -- 172.21.15.42:0/945781585 shutdown_connections 2024-08-26T00:07:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.472+0000 7f0abf050740 1 -- 172.21.15.42:0/945781585 wait complete. 2024-08-26T00:07:43.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.472+0000 7f0abf050740 1 -- start start 2024-08-26T00:07:43.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.473+0000 7f0abf050740 1 Processor -- start 2024-08-26T00:07:43.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.473+0000 7f0abf050740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b8857fd30 0x561b88593770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:43.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.473+0000 7f0abf050740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b88580650 0x561b8858eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:43.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.474+0000 7f0ab9200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b88580650 0x561b8858eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:43.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.475+0000 7f0ab9c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b8857fd30 0x561b88593770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:43.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.475+0000 7f0ab9c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b8857fd30 0x561b88593770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:53998/0 (socket says 172.21.15.42:53998) 2024-08-26T00:07:43.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.475+0000 7f0ab9c00640 1 -- 172.21.15.42:0/3234930807 learned_addr learned my addr 172.21.15.42:0/3234930807 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:43.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.475+0000 7f0abf050740 1 --2- 172.21.15.42:0/3234930807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b8858af10 0x561b8858f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:43.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.475+0000 7f0abf050740 1 -- 172.21.15.42:0/3234930807 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab41ba7e0 con 0x561b88580650 2024-08-26T00:07:43.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.475+0000 7f0abf050740 1 -- 172.21.15.42:0/3234930807 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab41bbc50 con 0x561b8857fd30 2024-08-26T00:07:43.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.475+0000 7f0abf050740 1 -- 172.21.15.42:0/3234930807 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab41baeb0 con 0x561b8858af10 2024-08-26T00:07:43.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.475+0000 7f0abf050740 10 client.0 _ll_register_callbacks cb 0x7f0aac007dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:07:43.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.476+0000 7f0aba600640 1 --2- 172.21.15.42:0/3234930807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b8858af10 0x561b8858f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:43.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.476+0000 7f0aba600640 1 -- 172.21.15.42:0/3234930807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b8857fd30 msgr2=0x561b88593770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:43.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.476+0000 7f0aba600640 1 --2- 172.21.15.42:0/3234930807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b8857fd30 0x561b88593770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.476+0000 7f0aba600640 1 -- 172.21.15.42:0/3234930807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b88580650 msgr2=0x561b8858eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:43.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.477+0000 7f0aba600640 1 --2- 172.21.15.42:0/3234930807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b88580650 0x561b8858eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.477+0000 7f0aba600640 1 -- 172.21.15.42:0/3234930807 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b8858f830 con 0x561b8858af10 2024-08-26T00:07:43.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.477+0000 7f0ab9200640 1 --2- 172.21.15.42:0/3234930807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b88580650 0x561b8858eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:07:43.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.477+0000 7f0aba600640 1 --2- 172.21.15.42:0/3234930807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b8858af10 0x561b8858f000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0aac005c10 tx=0x7f0aac024660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df10c7b2910dc80b server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:43.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.478+0000 7f0a97400640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:07:43.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.478+0000 7f0a97400640 1 -- 172.21.15.42:0/3234930807 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac014030 con 0x561b8858af10 2024-08-26T00:07:43.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.478+0000 7f0a97400640 1 -- 172.21.15.42:0/3234930807 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f0aac01f040 con 0x561b8858af10 2024-08-26T00:07:43.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.479+0000 7f0abf050740 1 -- 172.21.15.42:0/3234930807 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0aac004d20 con 0x561b8858af10 2024-08-26T00:07:43.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.479+0000 7f0a97400640 1 -- 172.21.15.42:0/3234930807 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0aac010da0 con 0x561b8858af10 2024-08-26T00:07:43.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.479+0000 7f0abf050740 10 client.25603 fetch_fsmap learned FSMap version 29 2024-08-26T00:07:43.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.479+0000 7f0abf050740 1 -- 172.21.15.42:0/3234930807 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561b88616460 con 0x561b8858af10 2024-08-26T00:07:43.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.480+0000 7f0a97400640 1 -- 172.21.15.42:0/3234930807 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0aac004d20 con 0x561b8858af10 2024-08-26T00:07:43.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.480+0000 7f0a97400640 1 -- 172.21.15.42:0/3234930807 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0aac043600 con 0x561b8858af10 2024-08-26T00:07:43.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.481+0000 7f0abf050740 10 client.25603 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:07:43.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.481+0000 7f0abf050740 10 client.25603 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:07:43.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.481+0000 7f0abf050740 20 client.25603 populate_metadata read hostname 'smithi042' 2024-08-26T00:07:43.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.481+0000 7f0abf050740 1 --2- 172.21.15.42:0/3234930807 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x561b88616a00 0x561b88618df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:43.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.481+0000 7f0abf050740 4 client.25603 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-26T00:07:43.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.481+0000 7f0abf050740 1 -- 172.21.15.42:0/3234930807 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561b884ee8b0 con 0x561b88616a00 2024-08-26T00:07:43.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.485+0000 7f0ab9c00640 1 --2- 172.21.15.42:0/3234930807 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x561b88616a00 0x561b88618df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:43.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.490+0000 7f0ab9c00640 1 --2- 172.21.15.42:0/3234930807 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x561b88616a00 0x561b88618df0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=270907426753cc10 server_cookie=77f292174ce20493 in_seq=0 out_seq=0 2024-08-26T00:07:43.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.490+0000 7f0a97400640 10 client.25603 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:07:43.576 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:07:43.576 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-08-26T00:07:43.576 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "209b80cf-fe2c-4db8-9bfa-86e5a0dc0ca3", 2024-08-26T00:07:43.576 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-08-26T00:07:43.576 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:07:43.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.520+0000 7f0a97400640 1 -- 172.21.15.42:0/3234930807 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561b884ee8b0 con 0x561b88616a00 2024-08-26T00:07:43.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.520+0000 7f0a97400640 10 client.25603 handle_command_reply: tid=0 2024-08-26T00:07:43.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.520+0000 7f0abf050740 1 client.25603 shutdown 2024-08-26T00:07:43.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.520+0000 7f0abf050740 1 -- 172.21.15.42:0/3234930807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b8858af10 msgr2=0x561b8858f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:43.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.520+0000 7f0abf050740 1 --2- 172.21.15.42:0/3234930807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b8858af10 0x561b8858f000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0aac005c10 tx=0x7f0aac024660 comp rx=0 tx=0).stop 2024-08-26T00:07:43.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.520+0000 7f0abf050740 1 -- 172.21.15.42:0/3234930807 shutdown_connections 2024-08-26T00:07:43.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.520+0000 7f0abf050740 1 --2- 172.21.15.42:0/3234930807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b8858af10 0x561b8858f000 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.520+0000 7f0abf050740 1 --2- 172.21.15.42:0/3234930807 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x561b88616a00 0x561b88618df0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.520+0000 7f0abf050740 1 --2- 172.21.15.42:0/3234930807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b88580650 0x561b8858eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.520+0000 7f0abf050740 1 --2- 172.21.15.42:0/3234930807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b8857fd30 0x561b88593770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.520+0000 7f0a97400640 0 client.25603 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:07:43.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.520+0000 7f0abf050740 1 -- 172.21.15.42:0/3234930807 >> 172.21.15.42:0/3234930807 conn(0x561b8857c2c0 msgr2=0x561b88581780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:43.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.521+0000 7f0abf050740 1 -- 172.21.15.42:0/3234930807 shutdown_connections 2024-08-26T00:07:43.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.521+0000 7f0abf050740 1 -- 172.21.15.42:0/3234930807 wait complete. 2024-08-26T00:07:43.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.521+0000 7f0abf050740 20 client.25603 trim_cache size 0 max 16384 2024-08-26T00:07:43.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.522+0000 7f0abc600640 1 -- 172.21.15.42:0/774909123 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0a9c0a2d50 msgr2=0x7f0a9c0a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:43.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.522+0000 7f0abc600640 1 --2- 172.21.15.42:0/774909123 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0a9c0a2d50 0x7f0a9c0a5210 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4000c00 tx=0x7f0aa4005a20 comp rx=0 tx=0).stop 2024-08-26T00:07:43.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.522+0000 7f0abc600640 1 -- 172.21.15.42:0/774909123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ab41098b0 msgr2=0x7f0ab41135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:43.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.522+0000 7f0abc600640 1 --2- 172.21.15.42:0/774909123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ab41098b0 0x7f0ab41135b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0aa800d950 tx=0x7f0aa800de10 comp rx=0 tx=0).stop 2024-08-26T00:07:43.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.528+0000 7f0abc600640 1 -- 172.21.15.42:0/774909123 shutdown_connections 2024-08-26T00:07:43.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.528+0000 7f0abc600640 1 --2- 172.21.15.42:0/774909123 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0a9c0a2d50 0x7f0a9c0a5210 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.528+0000 7f0abc600640 1 --2- 172.21.15.42:0/774909123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ab4116c40 0x7f0ab4113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.528+0000 7f0abc600640 1 --2- 172.21.15.42:0/774909123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ab41098b0 0x7f0ab41135b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.528+0000 7f0abc600640 1 --2- 172.21.15.42:0/774909123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ab4108f90 0x7f0ab4116500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:43.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.528+0000 7f0abc600640 1 -- 172.21.15.42:0/774909123 >> 172.21.15.42:0/774909123 conn(0x7f0ab406dee0 msgr2=0x7f0ab41170c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:43.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.530+0000 7f0abc600640 1 -- 172.21.15.42:0/774909123 shutdown_connections 2024-08-26T00:07:43.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:43.530+0000 7f0abc600640 1 -- 172.21.15.42:0/774909123 wait complete. 2024-08-26T00:07:44.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:44 smithi043 ceph-mon[22091]: pgmap v495: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.8 MiB/s wr, 374 op/s 2024-08-26T00:07:44.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:44 smithi043 ceph-mon[22091]: scrub queued for path: / 2024-08-26T00:07:44.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:44 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:07:44.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:44 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:07:44.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:44 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:07:44.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:44 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:07:44.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:44 smithi181 ceph-mon[22102]: pgmap v495: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.8 MiB/s wr, 374 op/s 2024-08-26T00:07:44.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:44 smithi181 ceph-mon[22102]: scrub queued for path: / 2024-08-26T00:07:44.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:44 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:07:44.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:44 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:07:44.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:44 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:07:44.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:44 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:07:44.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:44 smithi042 ceph-mon[17225]: pgmap v495: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.8 MiB/s wr, 374 op/s 2024-08-26T00:07:44.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:44 smithi042 ceph-mon[17225]: scrub queued for path: / 2024-08-26T00:07:44.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:44 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:07:44.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:44 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:07:44.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:44 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:07:44.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:44 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:07:45.293 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-26T00:07:46.563 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:46 smithi042 ceph-mon[17225]: pgmap v496: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.4 MiB/s wr, 376 op/s 2024-08-26T00:07:46.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:46 smithi043 ceph-mon[22091]: pgmap v496: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.4 MiB/s wr, 376 op/s 2024-08-26T00:07:46.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:46 smithi181 ceph-mon[22102]: pgmap v496: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.4 MiB/s wr, 376 op/s 2024-08-26T00:07:48.467 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:48 smithi042 ceph-mon[17225]: pgmap v497: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.0 MiB/s wr, 422 op/s 2024-08-26T00:07:48.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:48 smithi043 ceph-mon[22091]: pgmap v497: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.0 MiB/s wr, 422 op/s 2024-08-26T00:07:48.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:48 smithi181 ceph-mon[22102]: pgmap v497: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.0 MiB/s wr, 422 op/s 2024-08-26T00:07:50.536 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:50 smithi042 ceph-mon[17225]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.0 MiB/s wr, 506 op/s 2024-08-26T00:07:50.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:50 smithi043 ceph-mon[22091]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.0 MiB/s wr, 506 op/s 2024-08-26T00:07:50.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:50 smithi181 ceph-mon[22102]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.0 MiB/s wr, 506 op/s 2024-08-26T00:07:51.681 INFO:tasks.workunit.client.0.smithi042.stdout: 394 417022 393 293485 555 164276 949 2024-08-26T00:07:52.598 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:52 smithi042 ceph-mon[17225]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 728 op/s 2024-08-26T00:07:52.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:52 smithi043 ceph-mon[22091]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 728 op/s 2024-08-26T00:07:52.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:52 smithi181 ceph-mon[22102]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 728 op/s 2024-08-26T00:07:53.199 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:07:53.629 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:53 smithi042 ceph-mon[17225]: pgmap v500: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 17 MiB/s wr, 1.04k op/s 2024-08-26T00:07:53.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:53 smithi181 ceph-mon[22102]: pgmap v500: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 17 MiB/s wr, 1.04k op/s 2024-08-26T00:07:54.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:53 smithi043 ceph-mon[22091]: pgmap v500: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 17 MiB/s wr, 1.04k op/s 2024-08-26T00:07:56.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:55 smithi043 ceph-mon[22091]: pgmap v501: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 21 MiB/s wr, 1.20k op/s 2024-08-26T00:07:56.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:55 smithi181 ceph-mon[22102]: pgmap v501: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 21 MiB/s wr, 1.20k op/s 2024-08-26T00:07:56.035 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:55 smithi042 ceph-mon[17225]: pgmap v501: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 21 MiB/s wr, 1.20k op/s 2024-08-26T00:07:56.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.693+0000 7fb457200640 1 -- 172.21.15.42:0/4157341610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb458107760 msgr2=0x7fb458107b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:56.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.693+0000 7fb457200640 1 --2- 172.21.15.42:0/4157341610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb458107760 0x7fb458107b40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb448009930 tx=0x7fb44802a440 comp rx=0 tx=0).stop 2024-08-26T00:07:56.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.693+0000 7fb457200640 1 -- 172.21.15.42:0/4157341610 shutdown_connections 2024-08-26T00:07:56.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.693+0000 7fb457200640 1 --2- 172.21.15.42:0/4157341610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb458102100 0x7fb45810e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.693+0000 7fb457200640 1 --2- 172.21.15.42:0/4157341610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb458101760 0x7fb458101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.693+0000 7fb457200640 1 --2- 172.21.15.42:0/4157341610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb458107760 0x7fb458107b40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.693+0000 7fb457200640 1 -- 172.21.15.42:0/4157341610 >> 172.21.15.42:0/4157341610 conn(0x7fb4580fd4e0 msgr2=0x7fb4580ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:56.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.693+0000 7fb457200640 1 -- 172.21.15.42:0/4157341610 shutdown_connections 2024-08-26T00:07:56.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.693+0000 7fb457200640 1 -- 172.21.15.42:0/4157341610 wait complete. 2024-08-26T00:07:56.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.695+0000 7fb457200640 1 Processor -- start 2024-08-26T00:07:56.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.696+0000 7fb457200640 1 -- start start 2024-08-26T00:07:56.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.697+0000 7fb457200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb458101760 0x7fb458198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:56.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.697+0000 7fb457200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb458102100 0x7fb458198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:56.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.697+0000 7fb457200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb458107760 0x7fb45819c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:56.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.697+0000 7fb457200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb458111b70 con 0x7fb458101760 2024-08-26T00:07:56.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.698+0000 7fb456800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb458107760 0x7fb45819c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:56.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.698+0000 7fb455e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb458101760 0x7fb458198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:56.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.698+0000 7fb456800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb458107760 0x7fb45819c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:50728/0 (socket says 172.21.15.42:50728) 2024-08-26T00:07:56.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.698+0000 7fb456800640 1 -- 172.21.15.42:0/3455694226 learned_addr learned my addr 172.21.15.42:0/3455694226 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:56.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.698+0000 7fb455400640 1 --2- 172.21.15.42:0/3455694226 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb458102100 0x7fb458198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:56.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.698+0000 7fb457200640 1 -- 172.21.15.42:0/3455694226 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb4581119f0 con 0x7fb458107760 2024-08-26T00:07:56.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.698+0000 7fb457200640 1 -- 172.21.15.42:0/3455694226 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb458111cf0 con 0x7fb458102100 2024-08-26T00:07:56.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.699+0000 7fb456800640 1 -- 172.21.15.42:0/3455694226 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb458102100 msgr2=0x7fb458198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:56.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.699+0000 7fb456800640 1 --2- 172.21.15.42:0/3455694226 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb458102100 0x7fb458198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.699+0000 7fb456800640 1 -- 172.21.15.42:0/3455694226 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb458101760 msgr2=0x7fb458198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:56.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.699+0000 7fb456800640 1 --2- 172.21.15.42:0/3455694226 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb458101760 0x7fb458198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.699+0000 7fb456800640 1 -- 172.21.15.42:0/3455694226 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45819d000 con 0x7fb458107760 2024-08-26T00:07:56.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.699+0000 7fb455e00640 1 --2- 172.21.15.42:0/3455694226 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb458101760 0x7fb458198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:07:56.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.699+0000 7fb456800640 1 --2- 172.21.15.42:0/3455694226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb458107760 0x7fb45819c920 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb450009d10 tx=0x7fb450007590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:56.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.700+0000 7fb44ea00640 1 -- 172.21.15.42:0/3455694226 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450004b20 con 0x7fb458107760 2024-08-26T00:07:56.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.700+0000 7fb457200640 1 -- 172.21.15.42:0/3455694226 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb45819d290 con 0x7fb458107760 2024-08-26T00:07:56.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.700+0000 7fb457200640 1 -- 172.21.15.42:0/3455694226 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4580741c0 con 0x7fb458107760 2024-08-26T00:07:56.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.700+0000 7fb44ea00640 1 -- 172.21.15.42:0/3455694226 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb450004cc0 con 0x7fb458107760 2024-08-26T00:07:56.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.701+0000 7fb44ea00640 1 -- 172.21.15.42:0/3455694226 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450004b20 con 0x7fb458107760 2024-08-26T00:07:56.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.710+0000 7fb45fcaa740 1 Processor -- start 2024-08-26T00:07:56.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.711+0000 7fb44ea00640 1 -- 172.21.15.42:0/3455694226 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb45000eb20 con 0x7fb458107760 2024-08-26T00:07:56.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.714+0000 7fb45fcaa740 1 -- start start 2024-08-26T00:07:56.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.714+0000 7fb45fcaa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a12350 0x561e93a12730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:56.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.714+0000 7fb45fcaa740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12c70 0x561e93a1cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:56.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.714+0000 7fb45fcaa740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561e93a1d530 0x561e93a1f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:56.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.714+0000 7fb45fcaa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561e9396ffc0 con 0x561e93a12350 2024-08-26T00:07:56.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.714+0000 7fb45fcaa740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561e93907680 con 0x561e93a1d530 2024-08-26T00:07:56.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.714+0000 7fb45fcaa740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561e9396bf80 con 0x561e93a12c70 2024-08-26T00:07:56.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.715+0000 7fb455e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12c70 0x561e93a1cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:56.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.715+0000 7fb44ea00640 1 --2- 172.21.15.42:0/3455694226 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb43c0a2c70 0x7fb43c0a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:56.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.715+0000 7fb455400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a12350 0x561e93a12730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:56.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.715+0000 7fb455400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a12350 0x561e93a12730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54482/0 (socket says 172.21.15.42:54482) 2024-08-26T00:07:56.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.715+0000 7fb455400640 1 -- 172.21.15.42:0/2223489932 learned_addr learned my addr 172.21.15.42:0/2223489932 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:56.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.716+0000 7fb456800640 1 --2- 172.21.15.42:0/3455694226 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb43c0a2c70 0x7fb43c0a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:56.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.716+0000 7fb455400640 1 -- 172.21.15.42:0/2223489932 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12c70 msgr2=0x561e93a1cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:56.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.716+0000 7fb455400640 1 --2- 172.21.15.42:0/2223489932 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12c70 0x561e93a1cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.716+0000 7fb455400640 1 -- 172.21.15.42:0/2223489932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561e93a1d530 msgr2=0x561e93a1f920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:07:56.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.716+0000 7fb455400640 1 --2- 172.21.15.42:0/2223489932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561e93a1d530 0x561e93a1f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.716+0000 7fb455400640 1 -- 172.21.15.42:0/2223489932 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e939232c0 con 0x561e93a12350 2024-08-26T00:07:56.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.716+0000 7fb455e00640 1 --2- 172.21.15.42:0/2223489932 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12c70 0x561e93a1cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:07:56.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.717+0000 7fb455400640 1 --2- 172.21.15.42:0/2223489932 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a12350 0x561e93a12730 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb44400bc50 tx=0x7fb4440107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82caa43f80cbd5a server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:56.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.717+0000 7fb456800640 1 --2- 172.21.15.42:0/3455694226 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb43c0a2c70 0x7fb43c0a5130 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb4500cfe00 tx=0x7fb45000dad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:56.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.718+0000 7fb443400640 1 -- 172.21.15.42:0/2223489932 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44401c480 con 0x561e93a12350 2024-08-26T00:07:56.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.718+0000 7fb44ea00640 1 -- 172.21.15.42:0/3455694226 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb45000c2f0 con 0x7fb458107760 2024-08-26T00:07:56.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.718+0000 7fb443400640 1 -- 172.21.15.42:0/2223489932 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb44401cb00 con 0x561e93a12350 2024-08-26T00:07:56.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.718+0000 7fb443400640 1 -- 172.21.15.42:0/2223489932 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb444011c60 con 0x561e93a12350 2024-08-26T00:07:56.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.721+0000 7fb45fcaa740 1 -- 172.21.15.42:0/2223489932 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a12350 msgr2=0x561e93a12730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:56.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.721+0000 7fb45fcaa740 1 --2- 172.21.15.42:0/2223489932 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a12350 0x561e93a12730 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb44400bc50 tx=0x7fb4440107a0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.724+0000 7fb45fcaa740 1 -- 172.21.15.42:0/2223489932 shutdown_connections 2024-08-26T00:07:56.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.724+0000 7fb45fcaa740 1 --2- 172.21.15.42:0/2223489932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561e93a1d530 0x561e93a1f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.724+0000 7fb45fcaa740 1 --2- 172.21.15.42:0/2223489932 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12c70 0x561e93a1cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.724+0000 7fb45fcaa740 1 --2- 172.21.15.42:0/2223489932 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a12350 0x561e93a12730 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.724+0000 7fb45fcaa740 1 -- 172.21.15.42:0/2223489932 >> 172.21.15.42:0/2223489932 conn(0x561e93a0e890 msgr2=0x561e93a0ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:56.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.724+0000 7fb45fcaa740 1 -- 172.21.15.42:0/2223489932 shutdown_connections 2024-08-26T00:07:56.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.724+0000 7fb45fcaa740 1 -- 172.21.15.42:0/2223489932 wait complete. 2024-08-26T00:07:56.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.725+0000 7fb45fcaa740 1 -- start start 2024-08-26T00:07:56.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.725+0000 7fb45fcaa740 1 Processor -- start 2024-08-26T00:07:56.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.726+0000 7fb45fcaa740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12350 0x561e93a1a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:56.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.727+0000 7fb45fcaa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a12c70 0x561e93a1a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:56.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.727+0000 7fb45fcaa740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561e93a1d530 0x561e93a1ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:56.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.727+0000 7fb45fcaa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561e93a31110 con 0x561e93a12c70 2024-08-26T00:07:56.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.727+0000 7fb45fcaa740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561e9392ae50 con 0x561e93a1d530 2024-08-26T00:07:56.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.727+0000 7fb45fcaa740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561e93a31290 con 0x561e93a12350 2024-08-26T00:07:56.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.727+0000 7fb45fcaa740 10 client.0 _ll_register_callbacks cb 0x561e93915f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:07:56.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.727+0000 7fb455400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12350 0x561e93a1a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:56.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.727+0000 7fb455400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12350 0x561e93a1a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:35384/0 (socket says 172.21.15.42:35384) 2024-08-26T00:07:56.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.727+0000 7fb455400640 1 -- 172.21.15.42:0/380180348 learned_addr learned my addr 172.21.15.42:0/380180348 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:56.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.728+0000 7fb455400640 1 --2- 172.21.15.42:0/380180348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561e93a1d530 0x561e93a1ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:56.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.728+0000 7fb455e00640 1 --2- 172.21.15.42:0/380180348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a12c70 0x561e93a1a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:56.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.728+0000 7fb455400640 1 -- 172.21.15.42:0/380180348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561e93a1d530 msgr2=0x561e93a1ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:56.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.728+0000 7fb455400640 1 --2- 172.21.15.42:0/380180348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561e93a1d530 0x561e93a1ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.728+0000 7fb455400640 1 -- 172.21.15.42:0/380180348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a12c70 msgr2=0x561e93a1a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:56.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.728+0000 7fb455400640 1 --2- 172.21.15.42:0/380180348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a12c70 0x561e93a1a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.728+0000 7fb455400640 1 -- 172.21.15.42:0/380180348 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e936e13c0 con 0x561e93a12350 2024-08-26T00:07:56.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.729+0000 7fb455e00640 1 --2- 172.21.15.42:0/380180348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a12c70 0x561e93a1a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:07:56.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.729+0000 7fb455400640 1 --2- 172.21.15.42:0/380180348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12350 0x561e93a1a3c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb444011840 tx=0x7fb4440118a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb894e1f78ad8129 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:56.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.729+0000 7fb437e00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:07:56.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.729+0000 7fb437e00640 1 -- 172.21.15.42:0/380180348 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44401c890 con 0x561e93a12350 2024-08-26T00:07:56.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.729+0000 7fb437e00640 1 -- 172.21.15.42:0/380180348 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb444005030 con 0x561e93a12350 2024-08-26T00:07:56.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.730+0000 7fb45fcaa740 1 -- 172.21.15.42:0/380180348 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb44401cb00 con 0x561e93a12350 2024-08-26T00:07:56.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.730+0000 7fb437e00640 1 -- 172.21.15.42:0/380180348 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb444030050 con 0x561e93a12350 2024-08-26T00:07:56.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.730+0000 7fb45fcaa740 10 client.25612 fetch_fsmap learned FSMap version 29 2024-08-26T00:07:56.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.730+0000 7fb45fcaa740 1 -- 172.21.15.42:0/380180348 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561e93a3cd20 con 0x561e93a12350 2024-08-26T00:07:56.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.730+0000 7fb437e00640 1 -- 172.21.15.42:0/380180348 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb44401cb00 con 0x561e93a12350 2024-08-26T00:07:56.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.731+0000 7fb437e00640 1 -- 172.21.15.42:0/380180348 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fb44402b3f0 con 0x561e93a12350 2024-08-26T00:07:56.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.731+0000 7fb45fcaa740 10 client.25612 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:07:56.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.731+0000 7fb45fcaa740 10 client.25612 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:07:56.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.731+0000 7fb45fcaa740 20 client.25612 populate_metadata read hostname 'smithi042' 2024-08-26T00:07:56.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.731+0000 7fb45fcaa740 1 --2- 172.21.15.42:0/380180348 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x561e93a3e0d0 0x561e93a404c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:56.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.731+0000 7fb45fcaa740 4 client.25612 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:07:56.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.731+0000 7fb45fcaa740 1 -- 172.21.15.42:0/380180348 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e9397d530 con 0x561e93a3e0d0 2024-08-26T00:07:56.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.731+0000 7fb455e00640 1 --2- 172.21.15.42:0/380180348 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x561e93a3e0d0 0x561e93a404c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:56.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.732+0000 7fb455e00640 1 --2- 172.21.15.42:0/380180348 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x561e93a3e0d0 0x561e93a404c0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d29bffcbb5007bd8 server_cookie=f1ff5c5d2018143f in_seq=0 out_seq=0 2024-08-26T00:07:56.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.732+0000 7fb437e00640 10 client.25612 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:07:56.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.734+0000 7fb437e00640 1 -- 172.21.15.42:0/380180348 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561e9397d530 con 0x561e93a3e0d0 2024-08-26T00:07:56.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.734+0000 7fb437e00640 10 client.25612 handle_command_reply: tid=0 2024-08-26T00:07:56.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.734+0000 7fb45fcaa740 1 client.25612 shutdown 2024-08-26T00:07:56.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.735+0000 7fb45fcaa740 1 -- 172.21.15.42:0/380180348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12350 msgr2=0x561e93a1a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:56.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.735+0000 7fb45fcaa740 1 --2- 172.21.15.42:0/380180348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12350 0x561e93a1a3c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb444011840 tx=0x7fb4440118a0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.735+0000 7fb45fcaa740 1 -- 172.21.15.42:0/380180348 shutdown_connections 2024-08-26T00:07:56.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.735+0000 7fb45fcaa740 1 --2- 172.21.15.42:0/380180348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561e93a1d530 0x561e93a1ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.735+0000 7fb45fcaa740 1 --2- 172.21.15.42:0/380180348 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x561e93a3e0d0 0x561e93a404c0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.735+0000 7fb45fcaa740 1 --2- 172.21.15.42:0/380180348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a12c70 0x561e93a1a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.735+0000 7fb45fcaa740 1 --2- 172.21.15.42:0/380180348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12350 0x561e93a1a3c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.735+0000 7fb45fcaa740 1 -- 172.21.15.42:0/380180348 >> 172.21.15.42:0/380180348 conn(0x561e93a0e890 msgr2=0x561e93a05240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:56.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.735+0000 7fb437e00640 0 client.25612 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:07:56.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.735+0000 7fb45fcaa740 1 -- 172.21.15.42:0/380180348 shutdown_connections 2024-08-26T00:07:56.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.735+0000 7fb45fcaa740 1 -- 172.21.15.42:0/380180348 wait complete. 2024-08-26T00:07:56.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.735+0000 7fb45fcaa740 20 client.25612 trim_cache size 0 max 16384 2024-08-26T00:07:56.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.818+0000 7fb45fcaa740 1 Processor -- start 2024-08-26T00:07:56.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.822+0000 7fb45fcaa740 1 -- start start 2024-08-26T00:07:56.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.822+0000 7fb45fcaa740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12c70 0x561e93a1ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:56.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.822+0000 7fb45fcaa740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561e93a1d530 0x561e93a1c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:56.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.822+0000 7fb45fcaa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a05240 0x561e93a45c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:56.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.822+0000 7fb45fcaa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb438010f20 con 0x561e93a05240 2024-08-26T00:07:56.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.822+0000 7fb45fcaa740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb43800e730 con 0x561e93a1d530 2024-08-26T00:07:56.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.822+0000 7fb45fcaa740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb43800c520 con 0x561e93a12c70 2024-08-26T00:07:56.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.823+0000 7fb455400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12c70 0x561e93a1ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:56.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.823+0000 7fb455400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12c70 0x561e93a1ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:35390/0 (socket says 172.21.15.42:35390) 2024-08-26T00:07:56.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.823+0000 7fb455400640 1 -- 172.21.15.42:0/1689439643 learned_addr learned my addr 172.21.15.42:0/1689439643 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:56.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.823+0000 7fb455400640 1 --2- 172.21.15.42:0/1689439643 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a05240 0x561e93a45c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:56.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.825+0000 7fb455400640 1 -- 172.21.15.42:0/1689439643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561e93a1d530 msgr2=0x561e93a1c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:56.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.825+0000 7fb455e00640 1 --2- 172.21.15.42:0/1689439643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561e93a1d530 0x561e93a1c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:56.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.825+0000 7fb455400640 1 --2- 172.21.15.42:0/1689439643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561e93a1d530 0x561e93a1c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.825+0000 7fb455400640 1 -- 172.21.15.42:0/1689439643 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a05240 msgr2=0x561e93a45c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:56.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.825+0000 7fb455400640 1 --2- 172.21.15.42:0/1689439643 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a05240 0x561e93a45c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.825+0000 7fb455400640 1 -- 172.21.15.42:0/1689439643 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e93a0e6c0 con 0x561e93a12c70 2024-08-26T00:07:56.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.827+0000 7fb455e00640 1 --2- 172.21.15.42:0/1689439643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561e93a1d530 0x561e93a1c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:07:56.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.827+0000 7fb455400640 1 --2- 172.21.15.42:0/1689439643 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12c70 0x561e93a1ac90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb44402a530 tx=0x7fb444005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfb45ac7d499fb5b server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:56.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.828+0000 7fb442a00640 1 -- 172.21.15.42:0/1689439643 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb444030050 con 0x561e93a12c70 2024-08-26T00:07:56.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.829+0000 7fb442a00640 1 -- 172.21.15.42:0/1689439643 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb44403a020 con 0x561e93a12c70 2024-08-26T00:07:56.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.830+0000 7fb442a00640 1 -- 172.21.15.42:0/1689439643 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4440116e0 con 0x561e93a12c70 2024-08-26T00:07:56.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.831+0000 7fb45fcaa740 1 -- 172.21.15.42:0/1689439643 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12c70 msgr2=0x561e93a1ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:56.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.831+0000 7fb45fcaa740 1 --2- 172.21.15.42:0/1689439643 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12c70 0x561e93a1ac90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb44402a530 tx=0x7fb444005040 comp rx=0 tx=0).stop 2024-08-26T00:07:56.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.832+0000 7fb45fcaa740 1 -- 172.21.15.42:0/1689439643 shutdown_connections 2024-08-26T00:07:56.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.832+0000 7fb45fcaa740 1 --2- 172.21.15.42:0/1689439643 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a05240 0x561e93a45c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.833+0000 7fb45fcaa740 1 --2- 172.21.15.42:0/1689439643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561e93a1d530 0x561e93a1c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.833+0000 7fb45fcaa740 1 --2- 172.21.15.42:0/1689439643 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12c70 0x561e93a1ac90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.833+0000 7fb45fcaa740 1 -- 172.21.15.42:0/1689439643 >> 172.21.15.42:0/1689439643 conn(0x561e93a0e890 msgr2=0x561e93a1bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:56.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.834+0000 7fb45fcaa740 1 -- 172.21.15.42:0/1689439643 shutdown_connections 2024-08-26T00:07:56.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.834+0000 7fb45fcaa740 1 -- 172.21.15.42:0/1689439643 wait complete. 2024-08-26T00:07:56.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.835+0000 7fb45fcaa740 1 -- start start 2024-08-26T00:07:56.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.835+0000 7fb45fcaa740 1 Processor -- start 2024-08-26T00:07:56.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.836+0000 7fb45fcaa740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561e93a05240 0x561e93a32560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:56.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.837+0000 7fb45fcaa740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12c70 0x561e93a32aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:56.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.837+0000 7fb45fcaa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a1d530 0x561e93a32fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:56.888 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:56 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:07:56.888 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:07:56.888 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "scrub active (16005 inodes in the stack)", 2024-08-26T00:07:56.888 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-08-26T00:07:56.889 INFO:teuthology.orchestra.run.smithi042.stdout: "209b80cf-fe2c-4db8-9bfa-86e5a0dc0ca3": { 2024-08-26T00:07:56.889 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-08-26T00:07:56.889 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "209b80cf-fe2c-4db8-9bfa-86e5a0dc0ca3", 2024-08-26T00:07:56.889 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,force" 2024-08-26T00:07:56.889 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:07:56.889 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:07:56.889 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:07:56.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.837+0000 7fb45fcaa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb43800cbf0 con 0x561e93a1d530 2024-08-26T00:07:56.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.837+0000 7fb45fcaa740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb43800e060 con 0x561e93a05240 2024-08-26T00:07:56.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.837+0000 7fb45fcaa740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb43800d2c0 con 0x561e93a12c70 2024-08-26T00:07:56.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.837+0000 7fb45fcaa740 10 client.0 _ll_register_callbacks cb 0x7fb44400bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:07:56.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.838+0000 7fb455400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561e93a05240 0x561e93a32560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:56.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.838+0000 7fb455400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561e93a05240 0x561e93a32560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:50768/0 (socket says 172.21.15.42:50768) 2024-08-26T00:07:56.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.838+0000 7fb455400640 1 -- 172.21.15.42:0/3149109479 learned_addr learned my addr 172.21.15.42:0/3149109479 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:07:56.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.840+0000 7fb455e00640 1 --2- 172.21.15.42:0/3149109479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12c70 0x561e93a32aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:56.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.842+0000 7fb455400640 1 --2- 172.21.15.42:0/3149109479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a1d530 0x561e93a32fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:56.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.843+0000 7fb455e00640 1 -- 172.21.15.42:0/3149109479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561e93a05240 msgr2=0x561e93a32560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:56.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.843+0000 7fb455e00640 1 --2- 172.21.15.42:0/3149109479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561e93a05240 0x561e93a32560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.843+0000 7fb455e00640 1 -- 172.21.15.42:0/3149109479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a1d530 msgr2=0x561e93a32fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:07:56.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.843+0000 7fb455e00640 1 --2- 172.21.15.42:0/3149109479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a1d530 0x561e93a32fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.843+0000 7fb455e00640 1 -- 172.21.15.42:0/3149109479 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e93aa7f00 con 0x561e93a12c70 2024-08-26T00:07:56.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.843+0000 7fb455400640 1 --2- 172.21.15.42:0/3149109479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a1d530 0x561e93a32fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:07:56.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.844+0000 7fb455e00640 1 --2- 172.21.15.42:0/3149109479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12c70 0x561e93a32aa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb44802a960 tx=0x7fb4480044c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cb7cf23dc21ab84 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:07:56.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.846+0000 7fb437e00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:07:56.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.846+0000 7fb437e00640 1 -- 172.21.15.42:0/3149109479 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb448035040 con 0x561e93a12c70 2024-08-26T00:07:56.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.847+0000 7fb437e00640 1 -- 172.21.15.42:0/3149109479 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb448005250 con 0x561e93a12c70 2024-08-26T00:07:56.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.847+0000 7fb45fcaa740 1 -- 172.21.15.42:0/3149109479 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb44403a020 con 0x561e93a12c70 2024-08-26T00:07:56.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.848+0000 7fb437e00640 1 -- 172.21.15.42:0/3149109479 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb448005450 con 0x561e93a12c70 2024-08-26T00:07:56.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.848+0000 7fb45fcaa740 10 client.25618 fetch_fsmap learned FSMap version 29 2024-08-26T00:07:56.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.848+0000 7fb45fcaa740 1 -- 172.21.15.42:0/3149109479 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561e93aa9180 con 0x561e93a12c70 2024-08-26T00:07:56.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.849+0000 7fb437e00640 1 -- 172.21.15.42:0/3149109479 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb44403a020 con 0x561e93a12c70 2024-08-26T00:07:56.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.849+0000 7fb437e00640 1 -- 172.21.15.42:0/3149109479 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fb448031810 con 0x561e93a12c70 2024-08-26T00:07:56.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.850+0000 7fb45fcaa740 10 client.25618 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:07:56.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.850+0000 7fb45fcaa740 10 client.25618 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:07:56.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.850+0000 7fb45fcaa740 20 client.25618 populate_metadata read hostname 'smithi042' 2024-08-26T00:07:56.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.850+0000 7fb45fcaa740 1 --2- 172.21.15.42:0/3149109479 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x561e93aa9900 0x561e93aabd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:07:56.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.850+0000 7fb45fcaa740 4 client.25618 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-26T00:07:56.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.850+0000 7fb45fcaa740 1 -- 172.21.15.42:0/3149109479 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561e93977a40 con 0x561e93aa9900 2024-08-26T00:07:56.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.851+0000 7fb455400640 1 --2- 172.21.15.42:0/3149109479 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x561e93aa9900 0x561e93aabd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:07:56.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.852+0000 7fb455400640 1 --2- 172.21.15.42:0/3149109479 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x561e93aa9900 0x561e93aabd20 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a642427ff739a58 server_cookie=e4cbc4a2688979a6 in_seq=0 out_seq=0 2024-08-26T00:07:56.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.852+0000 7fb437e00640 10 client.25618 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:07:56.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.857+0000 7fb437e00640 1 -- 172.21.15.42:0/3149109479 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+269 (crc 0 0 0) 0x561e93977a40 con 0x561e93aa9900 2024-08-26T00:07:56.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.857+0000 7fb437e00640 10 client.25618 handle_command_reply: tid=0 2024-08-26T00:07:56.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.857+0000 7fb45fcaa740 1 client.25618 shutdown 2024-08-26T00:07:56.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.858+0000 7fb45fcaa740 1 -- 172.21.15.42:0/3149109479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12c70 msgr2=0x561e93a32aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:56.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.858+0000 7fb45fcaa740 1 --2- 172.21.15.42:0/3149109479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12c70 0x561e93a32aa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb44802a960 tx=0x7fb4480044c0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.858+0000 7fb45fcaa740 1 -- 172.21.15.42:0/3149109479 shutdown_connections 2024-08-26T00:07:56.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.858+0000 7fb45fcaa740 1 --2- 172.21.15.42:0/3149109479 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x561e93aa9900 0x561e93aabd20 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.858+0000 7fb437e00640 0 client.25618 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:07:56.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.858+0000 7fb45fcaa740 1 --2- 172.21.15.42:0/3149109479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561e93a1d530 0x561e93a32fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.858+0000 7fb45fcaa740 1 --2- 172.21.15.42:0/3149109479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e93a12c70 0x561e93a32aa0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.858+0000 7fb45fcaa740 1 --2- 172.21.15.42:0/3149109479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561e93a05240 0x561e93a32560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.858+0000 7fb45fcaa740 1 -- 172.21.15.42:0/3149109479 >> 172.21.15.42:0/3149109479 conn(0x561e93a0e890 msgr2=0x561e93a1c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:56.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.859+0000 7fb45fcaa740 1 -- 172.21.15.42:0/3149109479 shutdown_connections 2024-08-26T00:07:56.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.859+0000 7fb45fcaa740 1 -- 172.21.15.42:0/3149109479 wait complete. 2024-08-26T00:07:56.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.859+0000 7fb45fcaa740 20 client.25618 trim_cache size 0 max 16384 2024-08-26T00:07:56.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.861+0000 7fb457200640 1 -- 172.21.15.42:0/3455694226 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb43c0a2c70 msgr2=0x7fb43c0a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:56.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.861+0000 7fb457200640 1 --2- 172.21.15.42:0/3455694226 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb43c0a2c70 0x7fb43c0a5130 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb4500cfe00 tx=0x7fb45000dad0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.861+0000 7fb457200640 1 -- 172.21.15.42:0/3455694226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb458107760 msgr2=0x7fb45819c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:07:56.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.861+0000 7fb457200640 1 --2- 172.21.15.42:0/3455694226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb458107760 0x7fb45819c920 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb450009d10 tx=0x7fb450007590 comp rx=0 tx=0).stop 2024-08-26T00:07:56.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.862+0000 7fb457200640 1 -- 172.21.15.42:0/3455694226 shutdown_connections 2024-08-26T00:07:56.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.862+0000 7fb457200640 1 --2- 172.21.15.42:0/3455694226 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fb43c0a2c70 0x7fb43c0a5130 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.862+0000 7fb457200640 1 --2- 172.21.15.42:0/3455694226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb458107760 0x7fb45819c920 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.862+0000 7fb457200640 1 --2- 172.21.15.42:0/3455694226 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb458102100 0x7fb458198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.862+0000 7fb457200640 1 --2- 172.21.15.42:0/3455694226 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb458101760 0x7fb458198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:07:56.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.862+0000 7fb457200640 1 -- 172.21.15.42:0/3455694226 >> 172.21.15.42:0/3455694226 conn(0x7fb4580fd4e0 msgr2=0x7fb4580fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:07:56.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.863+0000 7fb457200640 1 -- 172.21.15.42:0/3455694226 shutdown_connections 2024-08-26T00:07:56.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:07:56.865+0000 7fb457200640 1 -- 172.21.15.42:0/3455694226 wait complete. 2024-08-26T00:07:57.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:56 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:07:57.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:56 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:07:58.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:57 smithi043 ceph-mon[22091]: pgmap v502: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 21 MiB/s wr, 1.23k op/s 2024-08-26T00:07:58.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:57 smithi181 ceph-mon[22102]: pgmap v502: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 21 MiB/s wr, 1.23k op/s 2024-08-26T00:07:58.036 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:57 smithi042 ceph-mon[17225]: pgmap v502: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 21 MiB/s wr, 1.23k op/s 2024-08-26T00:07:58.853 INFO:tasks.cephfs.filesystem:scrub status for tag:209b80cf-fe2c-4db8-9bfa-86e5a0dc0ca3 - {'path': '/', 'tag': '209b80cf-fe2c-4db8-9bfa-86e5a0dc0ca3', 'options': 'recursive,force'} 2024-08-26T00:08:00.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:07:59 smithi043 ceph-mon[22091]: pgmap v503: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 20 MiB/s wr, 1.17k op/s 2024-08-26T00:08:00.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:07:59 smithi181 ceph-mon[22102]: pgmap v503: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 20 MiB/s wr, 1.17k op/s 2024-08-26T00:08:00.036 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:07:59 smithi042 ceph-mon[17225]: pgmap v503: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 20 MiB/s wr, 1.17k op/s 2024-08-26T00:08:01.681 INFO:tasks.workunit.client.0.smithi042.stdout: 411 508546 908 358763 1267 200809 2612 2024-08-26T00:08:02.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:01 smithi042 ceph-mon[17225]: pgmap v504: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 18 MiB/s wr, 1.05k op/s 2024-08-26T00:08:02.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:01 smithi181 ceph-mon[22102]: pgmap v504: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 18 MiB/s wr, 1.05k op/s 2024-08-26T00:08:02.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:01 smithi043 ceph-mon[22091]: pgmap v504: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 18 MiB/s wr, 1.05k op/s 2024-08-26T00:08:04.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:03 smithi181 ceph-mon[22102]: pgmap v505: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 14 MiB/s wr, 811 op/s 2024-08-26T00:08:04.035 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:03 smithi042 ceph-mon[17225]: pgmap v505: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 14 MiB/s wr, 811 op/s 2024-08-26T00:08:04.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:03 smithi043 ceph-mon[22091]: pgmap v505: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 14 MiB/s wr, 811 op/s 2024-08-26T00:08:06.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:05 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:08:06.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:05 smithi042 ceph-mon[17225]: pgmap v506: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.9 MiB/s wr, 512 op/s 2024-08-26T00:08:06.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:05 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:08:06.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:05 smithi181 ceph-mon[22102]: pgmap v506: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.9 MiB/s wr, 512 op/s 2024-08-26T00:08:06.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:05 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:08:06.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:05 smithi043 ceph-mon[22091]: pgmap v506: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.9 MiB/s wr, 512 op/s 2024-08-26T00:08:08.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:07 smithi181 ceph-mon[22102]: pgmap v507: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.2 MiB/s wr, 331 op/s 2024-08-26T00:08:08.064 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:07 smithi042 ceph-mon[17225]: pgmap v507: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.2 MiB/s wr, 331 op/s 2024-08-26T00:08:08.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:07 smithi043 ceph-mon[22091]: pgmap v507: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.2 MiB/s wr, 331 op/s 2024-08-26T00:08:08.845 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:08 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:08:09.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:08 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:08:09.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:08 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:08:10.039 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:09 smithi042 ceph-mon[17225]: pgmap v508: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 289 op/s 2024-08-26T00:08:10.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:09 smithi043 ceph-mon[22091]: pgmap v508: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 289 op/s 2024-08-26T00:08:10.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:09 smithi181 ceph-mon[22102]: pgmap v508: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 289 op/s 2024-08-26T00:08:11.684 INFO:tasks.workunit.client.0.smithi042.stdout: 429 548389 1144 386052 972 223907 2068 2024-08-26T00:08:12.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:11 smithi043 ceph-mon[22091]: pgmap v509: 97 pgs: 97 active+clean; 1.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.9 MiB/s wr, 341 op/s 2024-08-26T00:08:12.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:11 smithi042 ceph-mon[17225]: pgmap v509: 97 pgs: 97 active+clean; 1.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.9 MiB/s wr, 341 op/s 2024-08-26T00:08:12.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:11 smithi181 ceph-mon[22102]: pgmap v509: 97 pgs: 97 active+clean; 1.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.9 MiB/s wr, 341 op/s 2024-08-26T00:08:14.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:13 smithi043 ceph-mon[22091]: pgmap v510: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.6 MiB/s wr, 439 op/s 2024-08-26T00:08:14.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:13 smithi181 ceph-mon[22102]: pgmap v510: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.6 MiB/s wr, 439 op/s 2024-08-26T00:08:14.296 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:13 smithi042 ceph-mon[17225]: pgmap v510: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.6 MiB/s wr, 439 op/s 2024-08-26T00:08:15.186 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:14 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:08:15.186 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:14 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:08:15.186 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:14 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:08:15.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:14 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:08:15.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:14 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:08:15.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:14 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:08:15.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:14 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:08:15.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:14 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:08:15.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:14 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:08:16.069 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:15 smithi042 ceph-mon[17225]: pgmap v511: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.2 MiB/s wr, 470 op/s 2024-08-26T00:08:16.069 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:15 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:08:16.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:15 smithi043 ceph-mon[22091]: pgmap v511: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.2 MiB/s wr, 470 op/s 2024-08-26T00:08:16.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:15 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:08:16.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:15 smithi181 ceph-mon[22102]: pgmap v511: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.2 MiB/s wr, 470 op/s 2024-08-26T00:08:16.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:15 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:08:18.247 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:17 smithi042 ceph-mon[17225]: pgmap v512: 97 pgs: 97 active+clean; 1.7 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.6 MiB/s wr, 692 op/s 2024-08-26T00:08:18.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:17 smithi043 ceph-mon[22091]: pgmap v512: 97 pgs: 97 active+clean; 1.7 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.6 MiB/s wr, 692 op/s 2024-08-26T00:08:18.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:17 smithi181 ceph-mon[22102]: pgmap v512: 97 pgs: 97 active+clean; 1.7 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.6 MiB/s wr, 692 op/s 2024-08-26T00:08:20.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:19 smithi043 ceph-mon[22091]: pgmap v513: 97 pgs: 97 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 895 op/s 2024-08-26T00:08:20.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:19 smithi181 ceph-mon[22102]: pgmap v513: 97 pgs: 97 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 895 op/s 2024-08-26T00:08:20.298 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:19 smithi042 ceph-mon[17225]: pgmap v513: 97 pgs: 97 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 895 op/s 2024-08-26T00:08:21.684 INFO:tasks.workunit.client.0.smithi042.stdout: 444 450588 998 317280 686 188822 1593 2024-08-26T00:08:22.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:21 smithi043 ceph-mon[22091]: pgmap v514: 97 pgs: 97 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 15 MiB/s wr, 892 op/s 2024-08-26T00:08:22.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:21 smithi042 ceph-mon[17225]: pgmap v514: 97 pgs: 97 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 15 MiB/s wr, 892 op/s 2024-08-26T00:08:22.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:21 smithi181 ceph-mon[22102]: pgmap v514: 97 pgs: 97 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 15 MiB/s wr, 892 op/s 2024-08-26T00:08:24.197 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:23 smithi042 ceph-mon[17225]: pgmap v515: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 16 MiB/s wr, 970 op/s 2024-08-26T00:08:24.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:23 smithi043 ceph-mon[22091]: pgmap v515: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 16 MiB/s wr, 970 op/s 2024-08-26T00:08:24.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:23 smithi181 ceph-mon[22102]: pgmap v515: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 16 MiB/s wr, 970 op/s 2024-08-26T00:08:26.045 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:25 smithi042 ceph-mon[17225]: pgmap v516: 97 pgs: 97 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 15 MiB/s wr, 896 op/s 2024-08-26T00:08:26.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:25 smithi043 ceph-mon[22091]: pgmap v516: 97 pgs: 97 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 15 MiB/s wr, 896 op/s 2024-08-26T00:08:26.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:25 smithi181 ceph-mon[22102]: pgmap v516: 97 pgs: 97 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 15 MiB/s wr, 896 op/s 2024-08-26T00:08:28.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:27 smithi043 ceph-mon[22091]: pgmap v517: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 15 MiB/s wr, 879 op/s 2024-08-26T00:08:28.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:27 smithi181 ceph-mon[22102]: pgmap v517: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 15 MiB/s wr, 879 op/s 2024-08-26T00:08:28.299 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:27 smithi042 ceph-mon[17225]: pgmap v517: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 15 MiB/s wr, 879 op/s 2024-08-26T00:08:28.854 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-26T00:08:30.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:29 smithi043 ceph-mon[22091]: pgmap v518: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 11 MiB/s wr, 660 op/s 2024-08-26T00:08:30.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:29 smithi181 ceph-mon[22102]: pgmap v518: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 11 MiB/s wr, 660 op/s 2024-08-26T00:08:30.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:29 smithi042 ceph-mon[17225]: pgmap v518: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 11 MiB/s wr, 660 op/s 2024-08-26T00:08:31.708 INFO:tasks.workunit.client.0.smithi042.stdout: 472 618412 1455 433415 1449 259427 1804 2024-08-26T00:08:32.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:31 smithi043 ceph-mon[22091]: pgmap v519: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.1 MiB/s wr, 424 op/s 2024-08-26T00:08:32.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:31 smithi042 ceph-mon[17225]: pgmap v519: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.1 MiB/s wr, 424 op/s 2024-08-26T00:08:32.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:31 smithi181 ceph-mon[22102]: pgmap v519: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.1 MiB/s wr, 424 op/s 2024-08-26T00:08:34.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:33 smithi043 ceph-mon[22091]: pgmap v520: 97 pgs: 97 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.7 MiB/s wr, 415 op/s 2024-08-26T00:08:34.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:33 smithi181 ceph-mon[22102]: pgmap v520: 97 pgs: 97 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.7 MiB/s wr, 415 op/s 2024-08-26T00:08:34.290 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:33 smithi042 ceph-mon[17225]: pgmap v520: 97 pgs: 97 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.7 MiB/s wr, 415 op/s 2024-08-26T00:08:36.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:35 smithi043 ceph-mon[22091]: pgmap v521: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 261 op/s 2024-08-26T00:08:36.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:35 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:08:36.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:35 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:08:36.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:35 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:08:36.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:35 smithi181 ceph-mon[22102]: pgmap v521: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 261 op/s 2024-08-26T00:08:36.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:35 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:08:36.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:35 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:08:36.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:35 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:08:36.313 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:35 smithi042 ceph-mon[17225]: pgmap v521: 97 pgs: 97 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 261 op/s 2024-08-26T00:08:36.313 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:35 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:08:36.313 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:35 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:08:36.313 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:35 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:08:38.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:37 smithi043 ceph-mon[22091]: pgmap v522: 97 pgs: 97 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.1 MiB/s wr, 287 op/s 2024-08-26T00:08:38.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:37 smithi181 ceph-mon[22102]: pgmap v522: 97 pgs: 97 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.1 MiB/s wr, 287 op/s 2024-08-26T00:08:38.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:37 smithi042 ceph-mon[17225]: pgmap v522: 97 pgs: 97 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.1 MiB/s wr, 287 op/s 2024-08-26T00:08:38.985 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:08:40.038 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:39 smithi042 ceph-mon[17225]: pgmap v523: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 346 op/s 2024-08-26T00:08:40.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:39 smithi043 ceph-mon[22091]: pgmap v523: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 346 op/s 2024-08-26T00:08:40.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:39 smithi181 ceph-mon[22102]: pgmap v523: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 346 op/s 2024-08-26T00:08:40.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.752+0000 7f75bf200640 1 -- 172.21.15.42:0/1115849871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75c0102100 msgr2=0x7f75c010e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:08:40.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.752+0000 7f75bf200640 1 --2- 172.21.15.42:0/1115849871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75c0102100 0x7f75c010e630 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f75b8009c10 tx=0x7f75b802a700 comp rx=0 tx=0).stop 2024-08-26T00:08:40.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.752+0000 7f75bf200640 1 -- 172.21.15.42:0/1115849871 shutdown_connections 2024-08-26T00:08:40.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.752+0000 7f75bf200640 1 --2- 172.21.15.42:0/1115849871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75c0102100 0x7f75c010e630 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.752+0000 7f75bf200640 1 --2- 172.21.15.42:0/1115849871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c0101760 0x7f75c0101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.752+0000 7f75bf200640 1 --2- 172.21.15.42:0/1115849871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75c0107760 0x7f75c0107b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.752+0000 7f75bf200640 1 -- 172.21.15.42:0/1115849871 >> 172.21.15.42:0/1115849871 conn(0x7f75c00fd4e0 msgr2=0x7f75c00ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:08:40.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.753+0000 7f75bf200640 1 -- 172.21.15.42:0/1115849871 shutdown_connections 2024-08-26T00:08:40.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.753+0000 7f75bf200640 1 -- 172.21.15.42:0/1115849871 wait complete. 2024-08-26T00:08:40.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.754+0000 7f75bf200640 1 Processor -- start 2024-08-26T00:08:40.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.754+0000 7f75bf200640 1 -- start start 2024-08-26T00:08:40.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.755+0000 7f75bf200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75c0101760 0x7f75c0074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:08:40.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.755+0000 7f75bf200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75c0102100 0x7f75c00747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:08:40.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.755+0000 7f75bf200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c0107760 0x7f75c0074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:08:40.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.755+0000 7f75bf200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f75c0111b80 con 0x7f75c0101760 2024-08-26T00:08:40.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.755+0000 7f75bf200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f75c0111a00 con 0x7f75c0107760 2024-08-26T00:08:40.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.755+0000 7f75bf200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f75c0111d00 con 0x7f75c0102100 2024-08-26T00:08:40.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.755+0000 7f75bd400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75c0102100 0x7f75c00747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:08:40.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.755+0000 7f75bd400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75c0102100 0x7f75c00747d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:50822/0 (socket says 172.21.15.42:50822) 2024-08-26T00:08:40.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.755+0000 7f75bd400640 1 -- 172.21.15.42:0/19335965 learned_addr learned my addr 172.21.15.42:0/19335965 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:08:40.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.755+0000 7f75be800640 1 --2- 172.21.15.42:0/19335965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c0107760 0x7f75c0074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:08:40.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.755+0000 7f75bde00640 1 --2- 172.21.15.42:0/19335965 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75c0101760 0x7f75c0074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:08:40.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.756+0000 7f75be800640 1 -- 172.21.15.42:0/19335965 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75c0102100 msgr2=0x7f75c00747d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:08:40.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.758+0000 7f75be800640 1 --2- 172.21.15.42:0/19335965 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75c0102100 0x7f75c00747d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.758+0000 7f75be800640 1 -- 172.21.15.42:0/19335965 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75c0101760 msgr2=0x7f75c0074290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:08:40.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.758+0000 7f75be800640 1 --2- 172.21.15.42:0/19335965 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75c0101760 0x7f75c0074290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.758+0000 7f75be800640 1 -- 172.21.15.42:0/19335965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c01a65a0 con 0x7f75c0107760 2024-08-26T00:08:40.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.758+0000 7f75bde00640 1 --2- 172.21.15.42:0/19335965 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75c0101760 0x7f75c0074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:08:40.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.758+0000 7f75bd400640 1 --2- 172.21.15.42:0/19335965 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75c0102100 0x7f75c00747d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:08:40.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.759+0000 7f75be800640 1 --2- 172.21.15.42:0/19335965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c0107760 0x7f75c0074d10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f75b8034040 tx=0x7f75b8003b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:08:40.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.760+0000 7f75b6a00640 1 -- 172.21.15.42:0/19335965 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b8041020 con 0x7f75c0107760 2024-08-26T00:08:40.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.760+0000 7f75b6a00640 1 -- 172.21.15.42:0/19335965 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75b8030880 con 0x7f75c0107760 2024-08-26T00:08:40.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.760+0000 7f75bf200640 1 -- 172.21.15.42:0/19335965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c01a6830 con 0x7f75c0107760 2024-08-26T00:08:40.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.760+0000 7f75b6a00640 1 -- 172.21.15.42:0/19335965 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b8041020 con 0x7f75c0107760 2024-08-26T00:08:40.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.760+0000 7f75bf200640 1 -- 172.21.15.42:0/19335965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c01a6c90 con 0x7f75c0107760 2024-08-26T00:08:40.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.767+0000 7f75b6a00640 1 -- 172.21.15.42:0/19335965 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f75b8044020 con 0x7f75c0107760 2024-08-26T00:08:40.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.769+0000 7f75c79cc740 1 Processor -- start 2024-08-26T00:08:40.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.769+0000 7f75c79cc740 1 -- start start 2024-08-26T00:08:40.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.770+0000 7f75c79cc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233e210 0x55698233e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:08:40.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.770+0000 7f75c79cc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698233eb30 0x556982339ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:08:40.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.770+0000 7f75c79cc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556982351fa0 0x556982354390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:08:40.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.770+0000 7f75c79cc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55698229bfc0 con 0x55698233e210 2024-08-26T00:08:40.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.770+0000 7f75c79cc740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556982233680 con 0x55698233eb30 2024-08-26T00:08:40.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.770+0000 7f75c79cc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556982297f80 con 0x556982351fa0 2024-08-26T00:08:40.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.771+0000 7f75bde00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698233eb30 0x556982339ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:08:40.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.771+0000 7f75bde00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698233eb30 0x556982339ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:48748/0 (socket says 172.21.15.42:48748) 2024-08-26T00:08:40.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.771+0000 7f75bde00640 1 -- 172.21.15.42:0/3297307160 learned_addr learned my addr 172.21.15.42:0/3297307160 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:08:40.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.771+0000 7f75bd400640 1 --2- 172.21.15.42:0/3297307160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233e210 0x55698233e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:08:40.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.772+0000 7f75bd400640 1 -- 172.21.15.42:0/3297307160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556982351fa0 msgr2=0x556982354390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:08:40.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.772+0000 7f75bd400640 1 --2- 172.21.15.42:0/3297307160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556982351fa0 0x556982354390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.772+0000 7f75bd400640 1 -- 172.21.15.42:0/3297307160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698233eb30 msgr2=0x556982339ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:08:40.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.772+0000 7f75bd400640 1 --2- 172.21.15.42:0/3297307160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698233eb30 0x556982339ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.772+0000 7f75bd400640 1 -- 172.21.15.42:0/3297307160 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55698224f2c0 con 0x55698233e210 2024-08-26T00:08:40.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.773+0000 7f75bd400640 1 --2- 172.21.15.42:0/3297307160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233e210 0x55698233e5f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0058c0 tx=0x7f75ac011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754e5200fc9bf7dc server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:08:40.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.773+0000 7f75ab400640 1 -- 172.21.15.42:0/3297307160 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ac01e070 con 0x55698233e210 2024-08-26T00:08:40.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.773+0000 7f75ab400640 1 -- 172.21.15.42:0/3297307160 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75ac0035f0 con 0x55698233e210 2024-08-26T00:08:40.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.773+0000 7f75ab400640 1 -- 172.21.15.42:0/3297307160 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ac01e070 con 0x55698233e210 2024-08-26T00:08:40.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.774+0000 7f75c79cc740 1 -- 172.21.15.42:0/3297307160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233e210 msgr2=0x55698233e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:08:40.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.774+0000 7f75c79cc740 1 --2- 172.21.15.42:0/3297307160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233e210 0x55698233e5f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0058c0 tx=0x7f75ac011970 comp rx=0 tx=0).stop 2024-08-26T00:08:40.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.775+0000 7f75c79cc740 1 -- 172.21.15.42:0/3297307160 shutdown_connections 2024-08-26T00:08:40.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.775+0000 7f75c79cc740 1 --2- 172.21.15.42:0/3297307160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556982351fa0 0x556982354390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.775+0000 7f75c79cc740 1 --2- 172.21.15.42:0/3297307160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698233eb30 0x556982339ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.775+0000 7f75c79cc740 1 --2- 172.21.15.42:0/3297307160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233e210 0x55698233e5f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.775+0000 7f75c79cc740 1 -- 172.21.15.42:0/3297307160 >> 172.21.15.42:0/3297307160 conn(0x55698233a890 msgr2=0x55698233ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:08:40.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.775+0000 7f75c79cc740 1 -- 172.21.15.42:0/3297307160 shutdown_connections 2024-08-26T00:08:40.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.775+0000 7f75c79cc740 1 -- 172.21.15.42:0/3297307160 wait complete. 2024-08-26T00:08:40.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.776+0000 7f75c79cc740 1 -- start start 2024-08-26T00:08:40.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.776+0000 7f75c79cc740 1 Processor -- start 2024-08-26T00:08:40.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.777+0000 7f75b6a00640 1 --2- 172.21.15.42:0/19335965 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f75a40a2ce0 0x7f75a40a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:08:40.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.778+0000 7f75c79cc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233e210 0x556982341620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:08:40.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.778+0000 7f75c79cc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698233eb30 0x556982341b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:08:40.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.778+0000 7f75c79cc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556982351fa0 0x55698234c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:08:40.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.782+0000 7f75c79cc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556982340ff0 con 0x55698233e210 2024-08-26T00:08:40.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.782+0000 7f75c79cc740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556982256e50 con 0x55698233eb30 2024-08-26T00:08:40.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.782+0000 7f75c79cc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556982341170 con 0x556982351fa0 2024-08-26T00:08:40.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.782+0000 7f75c79cc740 10 client.0 _ll_register_callbacks cb 0x556982241f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:08:40.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.782+0000 7f75bde00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233e210 0x556982341620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:08:40.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.782+0000 7f75be800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556982351fa0 0x55698234c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:08:40.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.782+0000 7f75bde00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233e210 0x556982341620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35520/0 (socket says 172.21.15.42:35520) 2024-08-26T00:08:40.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.782+0000 7f75bde00640 1 -- 172.21.15.42:0/970097307 learned_addr learned my addr 172.21.15.42:0/970097307 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:08:40.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.783+0000 7f75bde00640 1 -- 172.21.15.42:0/970097307 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556982351fa0 msgr2=0x55698234c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:08:40.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.783+0000 7f75bde00640 1 --2- 172.21.15.42:0/970097307 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556982351fa0 0x55698234c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.783+0000 7f75bde00640 1 -- 172.21.15.42:0/970097307 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698233eb30 msgr2=0x556982341b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:08:40.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.783+0000 7f75bde00640 1 --2- 172.21.15.42:0/970097307 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698233eb30 0x556982341b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.783+0000 7f75bde00640 1 -- 172.21.15.42:0/970097307 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55698200d3c0 con 0x55698233e210 2024-08-26T00:08:40.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.783+0000 7f75bde00640 1 --2- 172.21.15.42:0/970097307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233e210 0x556982341620 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f75b0033910 tx=0x7f75b0033d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=441388eeacb8ecde server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:08:40.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.783+0000 7f759fe00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:08:40.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.784+0000 7f759fe00640 1 -- 172.21.15.42:0/970097307 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b00319e0 con 0x55698233e210 2024-08-26T00:08:40.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.784+0000 7f759fe00640 1 -- 172.21.15.42:0/970097307 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f75b0031b80 con 0x55698233e210 2024-08-26T00:08:40.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.784+0000 7f75c79cc740 1 -- 172.21.15.42:0/970097307 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75ac0035f0 con 0x55698233e210 2024-08-26T00:08:40.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.785+0000 7f759fe00640 1 -- 172.21.15.42:0/970097307 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f75b0031d80 con 0x55698233e210 2024-08-26T00:08:40.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.785+0000 7f75c79cc740 10 client.15591 fetch_fsmap learned FSMap version 29 2024-08-26T00:08:40.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.785+0000 7f75c79cc740 1 -- 172.21.15.42:0/970097307 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55698234f290 con 0x55698233e210 2024-08-26T00:08:40.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.785+0000 7f759fe00640 1 -- 172.21.15.42:0/970097307 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75ac0035f0 con 0x55698233e210 2024-08-26T00:08:40.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.785+0000 7f759fe00640 1 -- 172.21.15.42:0/970097307 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f75b003f510 con 0x55698233e210 2024-08-26T00:08:40.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.787+0000 7f75bd400640 1 --2- 172.21.15.42:0/19335965 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f75a40a2ce0 0x7f75a40a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:08:40.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.787+0000 7f75b6a00640 1 -- 172.21.15.42:0/19335965 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f75b80f2170 con 0x7f75c0107760 2024-08-26T00:08:40.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.788+0000 7f75c79cc740 10 client.15591 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:08:40.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.788+0000 7f75c79cc740 10 client.15591 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:08:40.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.788+0000 7f75c79cc740 20 client.15591 populate_metadata read hostname 'smithi042' 2024-08-26T00:08:40.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.788+0000 7f75c79cc740 1 --2- 172.21.15.42:0/970097307 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5569823507a0 0x556982350c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:08:40.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.788+0000 7f75c79cc740 4 client.15591 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:08:40.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.788+0000 7f75c79cc740 1 -- 172.21.15.42:0/970097307 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569822a9530 con 0x5569823507a0 2024-08-26T00:08:40.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.788+0000 7f75bd400640 1 --2- 172.21.15.42:0/970097307 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5569823507a0 0x556982350c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:08:40.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.790+0000 7f75bd400640 1 --2- 172.21.15.42:0/19335965 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f75a40a2ce0 0x7f75a40a51a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f75ac009e50 tx=0x7f75ac003f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:08:40.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.792+0000 7f75bd400640 1 --2- 172.21.15.42:0/970097307 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5569823507a0 0x556982350c30 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17a170db716b4bd7 server_cookie=2977dfc25427a1e9 in_seq=0 out_seq=0 2024-08-26T00:08:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.792+0000 7f759fe00640 10 client.15591 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:08:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.793+0000 7f759fe00640 1 -- 172.21.15.42:0/970097307 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5569822a9530 con 0x5569823507a0 2024-08-26T00:08:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.793+0000 7f759fe00640 10 client.15591 handle_command_reply: tid=0 2024-08-26T00:08:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.793+0000 7f75c79cc740 1 client.15591 shutdown 2024-08-26T00:08:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.795+0000 7f75c79cc740 1 -- 172.21.15.42:0/970097307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233e210 msgr2=0x556982341620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:08:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.795+0000 7f75c79cc740 1 --2- 172.21.15.42:0/970097307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233e210 0x556982341620 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f75b0033910 tx=0x7f75b0033d10 comp rx=0 tx=0).stop 2024-08-26T00:08:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.795+0000 7f75c79cc740 1 -- 172.21.15.42:0/970097307 shutdown_connections 2024-08-26T00:08:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.795+0000 7f75c79cc740 1 --2- 172.21.15.42:0/970097307 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556982351fa0 0x55698234c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.795+0000 7f75c79cc740 1 --2- 172.21.15.42:0/970097307 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698233eb30 0x556982341b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.795+0000 7f75c79cc740 1 --2- 172.21.15.42:0/970097307 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5569823507a0 0x556982350c30 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.795+0000 7f75c79cc740 1 --2- 172.21.15.42:0/970097307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233e210 0x556982341620 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.795+0000 7f75c79cc740 1 -- 172.21.15.42:0/970097307 >> 172.21.15.42:0/970097307 conn(0x55698233a890 msgr2=0x556982340640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:08:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.795+0000 7f759fe00640 0 client.15591 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:08:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.797+0000 7f75c79cc740 1 -- 172.21.15.42:0/970097307 shutdown_connections 2024-08-26T00:08:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.797+0000 7f75c79cc740 1 -- 172.21.15.42:0/970097307 wait complete. 2024-08-26T00:08:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.797+0000 7f75c79cc740 20 client.15591 trim_cache size 0 max 16384 2024-08-26T00:08:40.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.837+0000 7f75c79cc740 1 Processor -- start 2024-08-26T00:08:40.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.840+0000 7f75c79cc740 1 -- start start 2024-08-26T00:08:40.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.840+0000 7f75c79cc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55698233e210 0x5569823514d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:08:40.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.840+0000 7f75c79cc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233eb30 0x556982351a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:08:40.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.840+0000 7f75c79cc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556982351fa0 0x5569823346f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:08:40.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.840+0000 7f75c79cc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f75c01adb10 con 0x55698233eb30 2024-08-26T00:08:40.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.840+0000 7f75c79cc740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f75c01ab320 con 0x556982351fa0 2024-08-26T00:08:40.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.840+0000 7f75c79cc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f75c01a9150 con 0x55698233e210 2024-08-26T00:08:40.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.841+0000 7f75bd400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233eb30 0x556982351a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:08:40.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.841+0000 7f75bd400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233eb30 0x556982351a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35532/0 (socket says 172.21.15.42:35532) 2024-08-26T00:08:40.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.841+0000 7f75bd400640 1 -- 172.21.15.42:0/3517137020 learned_addr learned my addr 172.21.15.42:0/3517137020 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:08:40.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.842+0000 7f75bd400640 1 -- 172.21.15.42:0/3517137020 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55698233e210 msgr2=0x5569823514d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-26T00:08:40.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.842+0000 7f75bd400640 1 --2- 172.21.15.42:0/3517137020 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55698233e210 0x5569823514d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.842+0000 7f75bd400640 1 -- 172.21.15.42:0/3517137020 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556982351fa0 msgr2=0x5569823346f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:08:40.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.842+0000 7f75bd400640 1 --2- 172.21.15.42:0/3517137020 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556982351fa0 0x5569823346f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.842+0000 7f75bd400640 1 -- 172.21.15.42:0/3517137020 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55698233e960 con 0x55698233eb30 2024-08-26T00:08:40.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.842+0000 7f75bd400640 1 --2- 172.21.15.42:0/3517137020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233eb30 0x556982351a10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0058c0 tx=0x7f75ac02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bfc76c3a7c2ba25 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:08:40.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.843+0000 7f75aaa00640 1 -- 172.21.15.42:0/3517137020 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ac01e070 con 0x55698233eb30 2024-08-26T00:08:40.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.843+0000 7f75aaa00640 1 -- 172.21.15.42:0/3517137020 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75ac02e070 con 0x55698233eb30 2024-08-26T00:08:40.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.843+0000 7f75aaa00640 1 -- 172.21.15.42:0/3517137020 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ac00f560 con 0x55698233eb30 2024-08-26T00:08:40.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.844+0000 7f75c79cc740 1 -- 172.21.15.42:0/3517137020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233eb30 msgr2=0x556982351a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:08:40.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.844+0000 7f75c79cc740 1 --2- 172.21.15.42:0/3517137020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233eb30 0x556982351a10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0058c0 tx=0x7f75ac02c000 comp rx=0 tx=0).stop 2024-08-26T00:08:40.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.844+0000 7f75c79cc740 1 -- 172.21.15.42:0/3517137020 shutdown_connections 2024-08-26T00:08:40.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.844+0000 7f75c79cc740 1 --2- 172.21.15.42:0/3517137020 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556982351fa0 0x5569823346f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.844+0000 7f75c79cc740 1 --2- 172.21.15.42:0/3517137020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233eb30 0x556982351a10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.844+0000 7f75c79cc740 1 --2- 172.21.15.42:0/3517137020 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55698233e210 0x5569823514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.844+0000 7f75c79cc740 1 -- 172.21.15.42:0/3517137020 >> 172.21.15.42:0/3517137020 conn(0x55698233a890 msgr2=0x556982341620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:08:40.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.848+0000 7f75c79cc740 1 -- 172.21.15.42:0/3517137020 shutdown_connections 2024-08-26T00:08:40.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.848+0000 7f75c79cc740 1 -- 172.21.15.42:0/3517137020 wait complete. 2024-08-26T00:08:40.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.848+0000 7f75c79cc740 1 -- start start 2024-08-26T00:08:40.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.849+0000 7f75c79cc740 1 Processor -- start 2024-08-26T00:08:40.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.852+0000 7f75c79cc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698233e210 0x556982356450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:08:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.853+0000 7f75c79cc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233eb30 0x556982356990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:08:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.853+0000 7f75c79cc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556982351fa0 0x5569823ba390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:08:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.854+0000 7f75be800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556982351fa0 0x5569823ba390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:08:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.854+0000 7f75be800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556982351fa0 0x5569823ba390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:50846/0 (socket says 172.21.15.42:50846) 2024-08-26T00:08:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.855+0000 7f75be800640 1 -- 172.21.15.42:0/2006529392 learned_addr learned my addr 172.21.15.42:0/2006529392 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:08:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.855+0000 7f75c79cc740 1 -- 172.21.15.42:0/2006529392 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f75c01a97e0 con 0x55698233eb30 2024-08-26T00:08:40.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.855+0000 7f75c79cc740 1 -- 172.21.15.42:0/2006529392 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f75c01aac50 con 0x55698233e210 2024-08-26T00:08:40.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.855+0000 7f75c79cc740 1 -- 172.21.15.42:0/2006529392 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f75c01a9eb0 con 0x556982351fa0 2024-08-26T00:08:40.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.855+0000 7f75c79cc740 10 client.0 _ll_register_callbacks cb 0x7f75b0009970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:08:40.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.855+0000 7f75bde00640 1 --2- 172.21.15.42:0/2006529392 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698233e210 0x556982356450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:08:40.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.856+0000 7f75be800640 1 -- 172.21.15.42:0/2006529392 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698233e210 msgr2=0x556982356450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:08:40.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.856+0000 7f75be800640 1 --2- 172.21.15.42:0/2006529392 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698233e210 0x556982356450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.856+0000 7f75be800640 1 -- 172.21.15.42:0/2006529392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233eb30 msgr2=0x556982356990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:08:40.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.857+0000 7f75bd400640 1 --2- 172.21.15.42:0/2006529392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233eb30 0x556982356990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:08:40.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.857+0000 7f75be800640 1 --2- 172.21.15.42:0/2006529392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233eb30 0x556982356990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.857+0000 7f75be800640 1 -- 172.21.15.42:0/2006529392 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556982357270 con 0x556982351fa0 2024-08-26T00:08:40.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.857+0000 7f75bd400640 1 --2- 172.21.15.42:0/2006529392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233eb30 0x556982356990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:08:40.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.858+0000 7f75be800640 1 --2- 172.21.15.42:0/2006529392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556982351fa0 0x5569823ba390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f75b80ec550 tx=0x7f75b80eff30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25e5d3078f6c80d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:08:40.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.858+0000 7f759fe00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:08:40.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.862+0000 7f759fe00640 1 -- 172.21.15.42:0/2006529392 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b80f3060 con 0x556982351fa0 2024-08-26T00:08:40.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.862+0000 7f759fe00640 1 -- 172.21.15.42:0/2006529392 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f75b8031440 con 0x556982351fa0 2024-08-26T00:08:40.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.862+0000 7f75c79cc740 1 -- 172.21.15.42:0/2006529392 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75ac02e070 con 0x556982351fa0 2024-08-26T00:08:40.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.865+0000 7f759fe00640 1 -- 172.21.15.42:0/2006529392 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f75b80f3060 con 0x556982351fa0 2024-08-26T00:08:40.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.865+0000 7f75c79cc740 10 client.25630 fetch_fsmap learned FSMap version 29 2024-08-26T00:08:40.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.865+0000 7f75c79cc740 1 -- 172.21.15.42:0/2006529392 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5569823bb9c0 con 0x556982351fa0 2024-08-26T00:08:40.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.866+0000 7f759fe00640 1 -- 172.21.15.42:0/2006529392 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75b80bb9b0 con 0x556982351fa0 2024-08-26T00:08:40.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.866+0000 7f759fe00640 1 -- 172.21.15.42:0/2006529392 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f75b80c3a90 con 0x556982351fa0 2024-08-26T00:08:40.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.867+0000 7f75c79cc740 10 client.25630 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:08:40.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.867+0000 7f75c79cc740 10 client.25630 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:08:40.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.867+0000 7f75c79cc740 20 client.25630 populate_metadata read hostname 'smithi042' 2024-08-26T00:08:40.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.867+0000 7f75c79cc740 1 --2- 172.21.15.42:0/2006529392 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5569823bc110 0x5569823be530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:08:40.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.867+0000 7f75c79cc740 4 client.25630 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-26T00:08:40.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.867+0000 7f75c79cc740 1 -- 172.21.15.42:0/2006529392 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f75ac02e070 con 0x5569823bc110 2024-08-26T00:08:40.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.868+0000 7f75bde00640 1 --2- 172.21.15.42:0/2006529392 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5569823bc110 0x5569823be530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:08:40.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.868+0000 7f75bde00640 1 --2- 172.21.15.42:0/2006529392 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5569823bc110 0x5569823be530 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bec80699814c188 server_cookie=b63ed03752b75eac in_seq=0 out_seq=0 2024-08-26T00:08:40.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.868+0000 7f759fe00640 10 client.25630 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:08:40.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.869+0000 7f759fe00640 1 -- 172.21.15.42:0/2006529392 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f75ac02e070 con 0x5569823bc110 2024-08-26T00:08:40.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.869+0000 7f759fe00640 10 client.25630 handle_command_reply: tid=0 2024-08-26T00:08:40.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.869+0000 7f75c79cc740 1 client.25630 shutdown 2024-08-26T00:08:40.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.870+0000 7f75c79cc740 1 -- 172.21.15.42:0/2006529392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556982351fa0 msgr2=0x5569823ba390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:08:40.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.870+0000 7f75c79cc740 1 --2- 172.21.15.42:0/2006529392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556982351fa0 0x5569823ba390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f75b80ec550 tx=0x7f75b80eff30 comp rx=0 tx=0).stop 2024-08-26T00:08:40.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.870+0000 7f75c79cc740 1 -- 172.21.15.42:0/2006529392 shutdown_connections 2024-08-26T00:08:40.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.870+0000 7f75c79cc740 1 --2- 172.21.15.42:0/2006529392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556982351fa0 0x5569823ba390 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.870+0000 7f75c79cc740 1 --2- 172.21.15.42:0/2006529392 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5569823bc110 0x5569823be530 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.870+0000 7f75c79cc740 1 --2- 172.21.15.42:0/2006529392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55698233eb30 0x556982356990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.870+0000 7f75c79cc740 1 --2- 172.21.15.42:0/2006529392 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698233e210 0x556982356450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.870+0000 7f75c79cc740 1 -- 172.21.15.42:0/2006529392 >> 172.21.15.42:0/2006529392 conn(0x55698233a890 msgr2=0x556982351470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:08:40.877 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:08:40.877 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-08-26T00:08:40.878 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {} 2024-08-26T00:08:40.878 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:08:40.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.871+0000 7f759fe00640 0 client.25630 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:08:40.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.871+0000 7f75c79cc740 1 -- 172.21.15.42:0/2006529392 shutdown_connections 2024-08-26T00:08:40.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.871+0000 7f75c79cc740 1 -- 172.21.15.42:0/2006529392 wait complete. 2024-08-26T00:08:40.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.871+0000 7f75c79cc740 20 client.25630 trim_cache size 0 max 16384 2024-08-26T00:08:40.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.873+0000 7f75bf200640 1 -- 172.21.15.42:0/19335965 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f75a40a2ce0 msgr2=0x7f75a40a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:08:40.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.873+0000 7f75bf200640 1 --2- 172.21.15.42:0/19335965 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f75a40a2ce0 0x7f75a40a51a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f75ac009e50 tx=0x7f75ac003f50 comp rx=0 tx=0).stop 2024-08-26T00:08:40.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.874+0000 7f75bf200640 1 -- 172.21.15.42:0/19335965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c0107760 msgr2=0x7f75c0074d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:08:40.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.874+0000 7f75bf200640 1 --2- 172.21.15.42:0/19335965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c0107760 0x7f75c0074d10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f75b8034040 tx=0x7f75b8003b80 comp rx=0 tx=0).stop 2024-08-26T00:08:40.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.875+0000 7f75bf200640 1 -- 172.21.15.42:0/19335965 shutdown_connections 2024-08-26T00:08:40.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.875+0000 7f75bf200640 1 --2- 172.21.15.42:0/19335965 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f75a40a2ce0 0x7f75a40a51a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.875+0000 7f75bf200640 1 --2- 172.21.15.42:0/19335965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c0107760 0x7f75c0074d10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.875+0000 7f75bf200640 1 --2- 172.21.15.42:0/19335965 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75c0102100 0x7f75c00747d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.875+0000 7f75bf200640 1 --2- 172.21.15.42:0/19335965 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75c0101760 0x7f75c0074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:40.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.875+0000 7f75bf200640 1 -- 172.21.15.42:0/19335965 >> 172.21.15.42:0/19335965 conn(0x7f75c00fd4e0 msgr2=0x7f75c00fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:08:40.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.875+0000 7f75bf200640 1 -- 172.21.15.42:0/19335965 shutdown_connections 2024-08-26T00:08:40.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:40.875+0000 7f75bf200640 1 -- 172.21.15.42:0/19335965 wait complete. 2024-08-26T00:08:41.695 INFO:tasks.workunit.client.0.smithi042.stdout: 493 573730 1342 401553 1330 234370 1555 2024-08-26T00:08:42.221 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:41 smithi042 ceph-mon[17225]: pgmap v524: 97 pgs: 97 active+clean; 1.9 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.4 MiB/s wr, 350 op/s 2024-08-26T00:08:42.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:41 smithi043 ceph-mon[22091]: pgmap v524: 97 pgs: 97 active+clean; 1.9 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.4 MiB/s wr, 350 op/s 2024-08-26T00:08:42.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:41 smithi181 ceph-mon[22102]: pgmap v524: 97 pgs: 97 active+clean; 1.9 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.4 MiB/s wr, 350 op/s 2024-08-26T00:08:42.706 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-26T00:08:42.719 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:08:44.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:44 smithi181 ceph-mon[22102]: pgmap v525: 97 pgs: 97 active+clean; 1.9 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.9 MiB/s wr, 452 op/s 2024-08-26T00:08:44.299 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:44 smithi042 ceph-mon[17225]: pgmap v525: 97 pgs: 97 active+clean; 1.9 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.9 MiB/s wr, 452 op/s 2024-08-26T00:08:44.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:44 smithi043 ceph-mon[22091]: pgmap v525: 97 pgs: 97 active+clean; 1.9 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.9 MiB/s wr, 452 op/s 2024-08-26T00:08:46.194 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:46 smithi042 ceph-mon[17225]: pgmap v526: 97 pgs: 97 active+clean; 1.9 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.1 MiB/s wr, 516 op/s 2024-08-26T00:08:46.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:46 smithi181 ceph-mon[22102]: pgmap v526: 97 pgs: 97 active+clean; 1.9 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.1 MiB/s wr, 516 op/s 2024-08-26T00:08:46.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:46 smithi043 ceph-mon[22091]: pgmap v526: 97 pgs: 97 active+clean; 1.9 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.1 MiB/s wr, 516 op/s 2024-08-26T00:08:48.311 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:48 smithi043 ceph-mon[22091]: pgmap v527: 97 pgs: 97 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 13 MiB/s wr, 760 op/s 2024-08-26T00:08:48.440 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:48 smithi042 ceph-mon[17225]: pgmap v527: 97 pgs: 97 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 13 MiB/s wr, 760 op/s 2024-08-26T00:08:48.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:48 smithi181 ceph-mon[22102]: pgmap v527: 97 pgs: 97 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 13 MiB/s wr, 760 op/s 2024-08-26T00:08:50.336 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:50 smithi181 ceph-mon[22102]: pgmap v528: 97 pgs: 97 active+clean; 2.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 18 MiB/s wr, 1.02k op/s 2024-08-26T00:08:50.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:50 smithi043 ceph-mon[22091]: pgmap v528: 97 pgs: 97 active+clean; 2.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 18 MiB/s wr, 1.02k op/s 2024-08-26T00:08:50.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:50 smithi042 ceph-mon[17225]: pgmap v528: 97 pgs: 97 active+clean; 2.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 18 MiB/s wr, 1.02k op/s 2024-08-26T00:08:51.694 INFO:tasks.workunit.client.0.smithi042.stdout: 505 438617 906 311533 795 177319 1086 2024-08-26T00:08:52.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:52 smithi043 ceph-mon[22091]: pgmap v529: 97 pgs: 97 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 17 MiB/s wr, 955 op/s 2024-08-26T00:08:52.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:52 smithi181 ceph-mon[22102]: pgmap v529: 97 pgs: 97 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 17 MiB/s wr, 955 op/s 2024-08-26T00:08:52.542 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:52 smithi042 ceph-mon[17225]: pgmap v529: 97 pgs: 97 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 17 MiB/s wr, 955 op/s 2024-08-26T00:08:54.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:54 smithi043 ceph-mon[22091]: pgmap v530: 97 pgs: 97 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 17 MiB/s wr, 987 op/s 2024-08-26T00:08:54.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:54 smithi042 ceph-mon[17225]: pgmap v530: 97 pgs: 97 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 17 MiB/s wr, 987 op/s 2024-08-26T00:08:54.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:54 smithi181 ceph-mon[22102]: pgmap v530: 97 pgs: 97 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 17 MiB/s wr, 987 op/s 2024-08-26T00:08:55.017 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:08:56.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:56 smithi043 ceph-mon[22091]: pgmap v531: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 16 MiB/s wr, 901 op/s 2024-08-26T00:08:56.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:56 smithi181 ceph-mon[22102]: pgmap v531: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 16 MiB/s wr, 901 op/s 2024-08-26T00:08:56.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:56 smithi042 ceph-mon[17225]: pgmap v531: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 16 MiB/s wr, 901 op/s 2024-08-26T00:08:57.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.375+0000 7f0bb2a00640 1 -- 172.21.15.42:0/4287941155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac1044f0 msgr2=0x7f0bac1109d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:08:57.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.375+0000 7f0bb2a00640 1 --2- 172.21.15.42:0/4287941155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac1044f0 0x7f0bac1109d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4013490 tx=0x7f0ba4032b30 comp rx=0 tx=0).stop 2024-08-26T00:08:57.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.376+0000 7f0bb2a00640 1 -- 172.21.15.42:0/4287941155 shutdown_connections 2024-08-26T00:08:57.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.377+0000 7f0bb2a00640 1 --2- 172.21.15.42:0/4287941155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac1044f0 0x7f0bac1109d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:57.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.377+0000 7f0bb2a00640 1 --2- 172.21.15.42:0/4287941155 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bac103b50 0x7f0bac103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:57.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.377+0000 7f0bb2a00640 1 --2- 172.21.15.42:0/4287941155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bac109c00 0x7f0bac109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:57.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.377+0000 7f0bb2a00640 1 -- 172.21.15.42:0/4287941155 >> 172.21.15.42:0/4287941155 conn(0x7f0bac0ff830 msgr2=0x7f0bac101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:08:57.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.386+0000 7f0bb2a00640 1 -- 172.21.15.42:0/4287941155 shutdown_connections 2024-08-26T00:08:57.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.386+0000 7f0bb2a00640 1 -- 172.21.15.42:0/4287941155 wait complete. 2024-08-26T00:08:57.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.390+0000 7f0bb2a00640 1 Processor -- start 2024-08-26T00:08:57.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.391+0000 7f0bb2a00640 1 -- start start 2024-08-26T00:08:57.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.392+0000 7f0bb2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac1044f0 0x7f0bac19bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:08:57.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.392+0000 7f0bb2a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bac19c400 0x7f0bac196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:08:57.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.392+0000 7f0bb2a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bac196870 0x7f0bac196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:08:57.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.392+0000 7f0bb2a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0bac078e20 con 0x7f0bac1044f0 2024-08-26T00:08:57.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.392+0000 7f0bb2a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0bac078ca0 con 0x7f0bac196870 2024-08-26T00:08:57.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.392+0000 7f0bb2a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0bac078fa0 con 0x7f0bac19c400 2024-08-26T00:08:57.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.394+0000 7f0bab400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bac19c400 0x7f0bac196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:08:57.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.395+0000 7f0bb0a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bac196870 0x7f0bac196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:08:57.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.395+0000 7f0bb0a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bac196870 0x7f0bac196cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:39900/0 (socket says 172.21.15.42:39900) 2024-08-26T00:08:57.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.395+0000 7f0bb0a00640 1 -- 172.21.15.42:0/3863531182 learned_addr learned my addr 172.21.15.42:0/3863531182 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:08:57.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.396+0000 7f0bb0a00640 1 -- 172.21.15.42:0/3863531182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bac19c400 msgr2=0x7f0bac196330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:08:57.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.397+0000 7f0bb0a00640 1 --2- 172.21.15.42:0/3863531182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bac19c400 0x7f0bac196330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:57.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.397+0000 7f0bb0a00640 1 -- 172.21.15.42:0/3863531182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac1044f0 msgr2=0x7f0bac19bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:08:57.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.397+0000 7f0babe00640 1 --2- 172.21.15.42:0/3863531182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac1044f0 0x7f0bac19bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:08:57.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.397+0000 7f0bb0a00640 1 --2- 172.21.15.42:0/3863531182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac1044f0 0x7f0bac19bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:57.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.397+0000 7f0bb0a00640 1 -- 172.21.15.42:0/3863531182 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bac1a2cb0 con 0x7f0bac196870 2024-08-26T00:08:57.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.397+0000 7f0bab400640 1 --2- 172.21.15.42:0/3863531182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bac19c400 0x7f0bac196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:08:57.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.397+0000 7f0babe00640 1 --2- 172.21.15.42:0/3863531182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac1044f0 0x7f0bac19bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:08:57.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.398+0000 7f0bb0a00640 1 --2- 172.21.15.42:0/3863531182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bac196870 0x7f0bac196cf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4034850 tx=0x7f0ba4034e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:08:57.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.399+0000 7f0ba8c00640 1 -- 172.21.15.42:0/3863531182 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba404c070 con 0x7f0bac196870 2024-08-26T00:08:57.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.399+0000 7f0ba8c00640 1 -- 172.21.15.42:0/3863531182 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ba400fbe0 con 0x7f0bac196870 2024-08-26T00:08:57.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.399+0000 7f0ba8c00640 1 -- 172.21.15.42:0/3863531182 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba403a040 con 0x7f0bac196870 2024-08-26T00:08:57.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.399+0000 7f0bb2a00640 1 -- 172.21.15.42:0/3863531182 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bac1a2ee0 con 0x7f0bac196870 2024-08-26T00:08:57.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.399+0000 7f0bb2a00640 1 -- 172.21.15.42:0/3863531182 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bac1a3360 con 0x7f0bac196870 2024-08-26T00:08:57.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.401+0000 7f0ba2000640 1 -- 172.21.15.42:0/3863531182 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bac109fe0 con 0x7f0bac196870 2024-08-26T00:08:57.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.425+0000 7f0ba8c00640 1 -- 172.21.15.42:0/3863531182 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0ba403d070 con 0x7f0bac196870 2024-08-26T00:08:57.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.428+0000 7f0ba8c00640 1 --2- 172.21.15.42:0/3863531182 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0b900a2c00 0x7f0b900a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:08:57.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.431+0000 7f0babe00640 1 --2- 172.21.15.42:0/3863531182 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0b900a2c00 0x7f0b900a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:08:57.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.432+0000 7f0ba8c00640 1 -- 172.21.15.42:0/3863531182 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f0ba4035e00 con 0x7f0bac196870 2024-08-26T00:08:57.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.433+0000 7f0babe00640 1 --2- 172.21.15.42:0/3863531182 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0b900a2c00 0x7f0b900a50c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0bac104c20 tx=0x7f0b9c005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:08:57.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:57.435+0000 7f0ba8c00640 1 -- 172.21.15.42:0/3863531182 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f0ba40f77e0 con 0x7f0bac196870 2024-08-26T00:08:58.009 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:08:58.009 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":29,"btime":"2024-08-26T00:06:29:181606+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3168581452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3168581452},{"type":"v1","addr":"172.21.15.42:6839","nonce":3168581452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/3533492491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":3533492491},{"type":"v1","addr":"172.21.15.42:6841","nonce":3533492491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-26T00:00:30.169633+0000","modified":"2024-08-26T00:06:28.596366+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24532,"mds_1":24527,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6839/2653014277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2653014277},{"type":"v1","addr":"172.21.15.43:6839","nonce":2653014277}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24532,"qdb_cluster":[24514,24527,24532]},"id":1}]} 2024-08-26T00:08:58.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:58.001+0000 7f0ba2000640 1 -- 172.21.15.42:0/3863531182 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0bac062b90 con 0x7f0bac196870 2024-08-26T00:08:58.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:58.002+0000 7f0ba8c00640 1 -- 172.21.15.42:0/3863531182 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11918 (secure 0 0 0) 0x7f0ba40c4480 con 0x7f0bac196870 2024-08-26T00:08:58.010 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 29 2024-08-26T00:08:58.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:58.007+0000 7f0ba2000640 1 -- 172.21.15.42:0/3863531182 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0b900a2c00 msgr2=0x7f0b900a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:08:58.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:58.007+0000 7f0ba2000640 1 --2- 172.21.15.42:0/3863531182 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0b900a2c00 0x7f0b900a50c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0bac104c20 tx=0x7f0b9c005e50 comp rx=0 tx=0).stop 2024-08-26T00:08:58.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:58.007+0000 7f0ba2000640 1 -- 172.21.15.42:0/3863531182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bac196870 msgr2=0x7f0bac196cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:08:58.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:58.007+0000 7f0ba2000640 1 --2- 172.21.15.42:0/3863531182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bac196870 0x7f0bac196cf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4034850 tx=0x7f0ba4034e50 comp rx=0 tx=0).stop 2024-08-26T00:08:58.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:58.008+0000 7f0ba2000640 1 -- 172.21.15.42:0/3863531182 shutdown_connections 2024-08-26T00:08:58.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:58.008+0000 7f0ba2000640 1 --2- 172.21.15.42:0/3863531182 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0b900a2c00 0x7f0b900a50c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:58.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:58.008+0000 7f0ba2000640 1 --2- 172.21.15.42:0/3863531182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bac196870 0x7f0bac196cf0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:58.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:58.008+0000 7f0ba2000640 1 --2- 172.21.15.42:0/3863531182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bac19c400 0x7f0bac196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:58.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:58.008+0000 7f0ba2000640 1 --2- 172.21.15.42:0/3863531182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac1044f0 0x7f0bac19bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:08:58.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:58.008+0000 7f0ba2000640 1 -- 172.21.15.42:0/3863531182 >> 172.21.15.42:0/3863531182 conn(0x7f0bac0ff830 msgr2=0x7f0bac0ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:08:58.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:58.009+0000 7f0ba2000640 1 -- 172.21.15.42:0/3863531182 shutdown_connections 2024-08-26T00:08:58.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:08:58.009+0000 7f0ba2000640 1 -- 172.21.15.42:0/3863531182 wait complete. 2024-08-26T00:08:58.263 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:58 smithi042 ceph-mon[17225]: pgmap v532: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 14 MiB/s wr, 841 op/s 2024-08-26T00:08:58.263 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:08:58 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/3863531182' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:08:58.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:58 smithi043 ceph-mon[22091]: pgmap v532: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 14 MiB/s wr, 841 op/s 2024-08-26T00:08:58.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:08:58 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/3863531182' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:08:58.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:58 smithi181 ceph-mon[22102]: pgmap v532: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 14 MiB/s wr, 841 op/s 2024-08-26T00:08:58.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:08:58 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/3863531182' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:09:00.331 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-26T00:09:00.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:00 smithi043 ceph-mon[22091]: pgmap v533: 97 pgs: 97 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 660 op/s 2024-08-26T00:09:00.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:00 smithi042 ceph-mon[17225]: pgmap v533: 97 pgs: 97 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 660 op/s 2024-08-26T00:09:00.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:00 smithi181 ceph-mon[22102]: pgmap v533: 97 pgs: 97 active+clean; 2.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 660 op/s 2024-08-26T00:09:01.703 INFO:tasks.workunit.client.0.smithi042.stdout: 530 586009 1594 413278 1281 234050 2709 2024-08-26T00:09:02.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:02 smithi043 ceph-mon[22091]: pgmap v534: 97 pgs: 97 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.9 MiB/s wr, 346 op/s 2024-08-26T00:09:02.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:02 smithi042 ceph-mon[17225]: pgmap v534: 97 pgs: 97 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.9 MiB/s wr, 346 op/s 2024-08-26T00:09:02.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:02 smithi181 ceph-mon[22102]: pgmap v534: 97 pgs: 97 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.9 MiB/s wr, 346 op/s 2024-08-26T00:09:04.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:04 smithi043 ceph-mon[22091]: pgmap v535: 97 pgs: 97 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.0 MiB/s wr, 365 op/s 2024-08-26T00:09:04.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:04 smithi042 ceph-mon[17225]: pgmap v535: 97 pgs: 97 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.0 MiB/s wr, 365 op/s 2024-08-26T00:09:04.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:04 smithi181 ceph-mon[22102]: pgmap v535: 97 pgs: 97 active+clean; 2.0 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.0 MiB/s wr, 365 op/s 2024-08-26T00:09:06.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:06 smithi042 ceph-mon[17225]: pgmap v536: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 317 op/s 2024-08-26T00:09:06.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:06 smithi043 ceph-mon[22091]: pgmap v536: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 317 op/s 2024-08-26T00:09:06.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:06 smithi181 ceph-mon[22102]: pgmap v536: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 317 op/s 2024-08-26T00:09:08.463 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:08 smithi042 ceph-mon[17225]: pgmap v537: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 316 op/s 2024-08-26T00:09:08.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:08 smithi043 ceph-mon[22091]: pgmap v537: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 316 op/s 2024-08-26T00:09:08.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:08 smithi181 ceph-mon[22102]: pgmap v537: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 316 op/s 2024-08-26T00:09:10.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:10 smithi042 ceph-mon[17225]: pgmap v538: 97 pgs: 97 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 371 op/s 2024-08-26T00:09:10.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:10 smithi043 ceph-mon[22091]: pgmap v538: 97 pgs: 97 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 371 op/s 2024-08-26T00:09:10.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:10 smithi181 ceph-mon[22102]: pgmap v538: 97 pgs: 97 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 371 op/s 2024-08-26T00:09:10.749 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:09:11.696 INFO:tasks.workunit.client.0.smithi042.stdout: 553 574238 1622 401986 1247 240696 2633 2024-08-26T00:09:12.245 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:12 smithi042 ceph-mon[17225]: pgmap v539: 97 pgs: 97 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.3 MiB/s wr, 347 op/s 2024-08-26T00:09:12.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.278+0000 7fddb5c00640 1 -- 172.21.15.42:0/2926353961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddb0114850 msgr2=0x7fddb0116c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:12.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.278+0000 7fddb5c00640 1 --2- 172.21.15.42:0/2926353961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddb0114850 0x7fddb0116c40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009cd0 tx=0x7fdda802a8e0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.278+0000 7fddb5c00640 1 -- 172.21.15.42:0/2926353961 shutdown_connections 2024-08-26T00:09:12.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.278+0000 7fddb5c00640 1 --2- 172.21.15.42:0/2926353961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddb0114850 0x7fddb0116c40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.278+0000 7fddb5c00640 1 --2- 172.21.15.42:0/2926353961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddb006ebb0 0x7fddb0114310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.278+0000 7fddb5c00640 1 --2- 172.21.15.42:0/2926353961 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fddb006e290 0x7fddb006e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.278+0000 7fddb5c00640 1 -- 172.21.15.42:0/2926353961 >> 172.21.15.42:0/2926353961 conn(0x7fddb0072f20 msgr2=0x7fddb0073330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:12.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.278+0000 7fddb5c00640 1 -- 172.21.15.42:0/2926353961 shutdown_connections 2024-08-26T00:09:12.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.278+0000 7fddb5c00640 1 -- 172.21.15.42:0/2926353961 wait complete. 2024-08-26T00:09:12.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.279+0000 7fddb5c00640 1 Processor -- start 2024-08-26T00:09:12.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.280+0000 7fddb5c00640 1 -- start start 2024-08-26T00:09:12.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.280+0000 7fddb5c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddb006e290 0x7fddb010a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:12.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.280+0000 7fddb5c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddb006ebb0 0x7fddb010a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:12.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.280+0000 7fddb5c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fddb0114850 0x7fddb010abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:12.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.280+0000 7fddb5c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fddb011a2f0 con 0x7fddb0114850 2024-08-26T00:09:12.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.280+0000 7fddb5c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fddb011a170 con 0x7fddb006ebb0 2024-08-26T00:09:12.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.280+0000 7fddb5c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fddb011a470 con 0x7fddb006e290 2024-08-26T00:09:12.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.281+0000 7fddaf400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddb006ebb0 0x7fddb010a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:12.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.281+0000 7fddaf400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddb006ebb0 0x7fddb010a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:52362/0 (socket says 172.21.15.42:52362) 2024-08-26T00:09:12.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.281+0000 7fddafe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddb006e290 0x7fddb010a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:12.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.281+0000 7fddaf400640 1 -- 172.21.15.42:0/2628599159 learned_addr learned my addr 172.21.15.42:0/2628599159 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:12.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.281+0000 7fddb5200640 1 --2- 172.21.15.42:0/2628599159 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fddb0114850 0x7fddb010abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:12.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.281+0000 7fddaf400640 1 -- 172.21.15.42:0/2628599159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddb006e290 msgr2=0x7fddb010a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:12.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.281+0000 7fddaf400640 1 --2- 172.21.15.42:0/2628599159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddb006e290 0x7fddb010a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.281+0000 7fddaf400640 1 -- 172.21.15.42:0/2628599159 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fddb0114850 msgr2=0x7fddb010abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:12.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.281+0000 7fddaf400640 1 --2- 172.21.15.42:0/2628599159 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fddb0114850 0x7fddb010abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.281+0000 7fddaf400640 1 -- 172.21.15.42:0/2628599159 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb01b31b0 con 0x7fddb006ebb0 2024-08-26T00:09:12.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.281+0000 7fddaf400640 1 --2- 172.21.15.42:0/2628599159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddb006ebb0 0x7fddb010a6b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00e9f0 tx=0x7fdd9c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:12.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.282+0000 7fddacc00640 1 -- 172.21.15.42:0/2628599159 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c00cd80 con 0x7fddb006ebb0 2024-08-26T00:09:12.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.282+0000 7fddacc00640 1 -- 172.21.15.42:0/2628599159 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd9c010910 con 0x7fddb006ebb0 2024-08-26T00:09:12.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.282+0000 7fddacc00640 1 -- 172.21.15.42:0/2628599159 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c018990 con 0x7fddb006ebb0 2024-08-26T00:09:12.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.282+0000 7fddb5c00640 1 -- 172.21.15.42:0/2628599159 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddb01b33e0 con 0x7fddb006ebb0 2024-08-26T00:09:12.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.282+0000 7fddb5c00640 1 -- 172.21.15.42:0/2628599159 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddb01b38d0 con 0x7fddb006ebb0 2024-08-26T00:09:12.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.285+0000 7fddacc00640 1 -- 172.21.15.42:0/2628599159 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdd9c010ac0 con 0x7fddb006ebb0 2024-08-26T00:09:12.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.286+0000 7fddb9c9d740 1 Processor -- start 2024-08-26T00:09:12.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.286+0000 7fddb9c9d740 1 -- start start 2024-08-26T00:09:12.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.286+0000 7fddb9c9d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560607099a30 0x560607099e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:12.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.286+0000 7fddb9c9d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56060709a350 0x5606070a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:12.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.286+0000 7fddb9c9d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606070a4c10 0x5606070a7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:12.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.286+0000 7fddb9c9d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560606ffff30 con 0x5606070a4c10 2024-08-26T00:09:12.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.286+0000 7fddb9c9d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560606f975a0 con 0x56060709a350 2024-08-26T00:09:12.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.286+0000 7fddb9c9d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x560606ffbef0 con 0x560607099a30 2024-08-26T00:09:12.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.287+0000 7fddafe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56060709a350 0x5606070a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:12.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.287+0000 7fddafe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56060709a350 0x5606070a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:52368/0 (socket says 172.21.15.42:52368) 2024-08-26T00:09:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.287+0000 7fddafe00640 1 -- 172.21.15.42:0/3771910411 learned_addr learned my addr 172.21.15.42:0/3771910411 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.287+0000 7fddb5200640 1 --2- 172.21.15.42:0/3771910411 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560607099a30 0x560607099e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.287+0000 7fddaf400640 1 --2- 172.21.15.42:0/3771910411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606070a4c10 0x5606070a7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.287+0000 7fddb5200640 1 -- 172.21.15.42:0/3771910411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56060709a350 msgr2=0x5606070a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.287+0000 7fddb5200640 1 --2- 172.21.15.42:0/3771910411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56060709a350 0x5606070a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.287+0000 7fddb5200640 1 -- 172.21.15.42:0/3771910411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606070a4c10 msgr2=0x5606070a7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.287+0000 7fddb5200640 1 --2- 172.21.15.42:0/3771910411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606070a4c10 0x5606070a7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.287+0000 7fddb5200640 1 -- 172.21.15.42:0/3771910411 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560606d713c0 con 0x560607099a30 2024-08-26T00:09:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.288+0000 7fddacc00640 1 --2- 172.21.15.42:0/2628599159 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fdd940a2b80 0x7fdd940a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.288+0000 7fddb5200640 1 --2- 172.21.15.42:0/3771910411 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560607099a30 0x560607099e10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdda8006010 tx=0x7fdda8009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32b29af50cece11f server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.288+0000 7fddacc00640 1 -- 172.21.15.42:0/2628599159 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fdd9c0cf470 con 0x7fddb006ebb0 2024-08-26T00:09:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.288+0000 7fdda5600640 1 -- 172.21.15.42:0/3771910411 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda80318c0 con 0x560607099a30 2024-08-26T00:09:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.288+0000 7fdda5600640 1 -- 172.21.15.42:0/3771910411 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdda8036040 con 0x560607099a30 2024-08-26T00:09:12.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.288+0000 7fdda5600640 1 -- 172.21.15.42:0/3771910411 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda80044a0 con 0x560607099a30 2024-08-26T00:09:12.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.288+0000 7fddafe00640 1 --2- 172.21.15.42:0/2628599159 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fdd940a2b80 0x7fdd940a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:12.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.289+0000 7fddb9c9d740 1 -- 172.21.15.42:0/3771910411 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560607099a30 msgr2=0x560607099e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:12.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.289+0000 7fddb9c9d740 1 --2- 172.21.15.42:0/3771910411 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560607099a30 0x560607099e10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdda8006010 tx=0x7fdda8009a20 comp rx=0 tx=0).stop 2024-08-26T00:09:12.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.289+0000 7fddafe00640 1 --2- 172.21.15.42:0/2628599159 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fdd940a2b80 0x7fdd940a5040 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x560607096e20 tx=0x7fdda0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:12.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.289+0000 7fddb9c9d740 1 -- 172.21.15.42:0/3771910411 shutdown_connections 2024-08-26T00:09:12.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.289+0000 7fddb9c9d740 1 --2- 172.21.15.42:0/3771910411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606070a4c10 0x5606070a7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.289+0000 7fddb9c9d740 1 --2- 172.21.15.42:0/3771910411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56060709a350 0x5606070a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.289+0000 7fddb9c9d740 1 --2- 172.21.15.42:0/3771910411 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560607099a30 0x560607099e10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.289+0000 7fddb9c9d740 1 -- 172.21.15.42:0/3771910411 >> 172.21.15.42:0/3771910411 conn(0x560607095fc0 msgr2=0x5606070963a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:12.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.290+0000 7fddb9c9d740 1 -- 172.21.15.42:0/3771910411 shutdown_connections 2024-08-26T00:09:12.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.290+0000 7fddb9c9d740 1 -- 172.21.15.42:0/3771910411 wait complete. 2024-08-26T00:09:12.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.290+0000 7fddb9c9d740 1 -- start start 2024-08-26T00:09:12.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.291+0000 7fddb9c9d740 1 Processor -- start 2024-08-26T00:09:12.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.291+0000 7fddb9c9d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560607099a30 0x5606070a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:12.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.291+0000 7fddb9c9d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56060709a350 0x5606070a2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:12.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.291+0000 7fddb9c9d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5606070a4c10 0x5606070a2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:12.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.291+0000 7fddb9c9d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5606070a77e0 con 0x56060709a350 2024-08-26T00:09:12.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.291+0000 7fddb9c9d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560606fbade0 con 0x560607099a30 2024-08-26T00:09:12.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.291+0000 7fddb9c9d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5606070a7960 con 0x5606070a4c10 2024-08-26T00:09:12.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.291+0000 7fddb9c9d740 10 client.0 _ll_register_callbacks cb 0x560606fa97b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:09:12.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.292+0000 7fddafe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560607099a30 0x5606070a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:12.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.292+0000 7fddafe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560607099a30 0x5606070a1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:52382/0 (socket says 172.21.15.42:52382) 2024-08-26T00:09:12.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.292+0000 7fddafe00640 1 -- 172.21.15.42:0/2325288127 learned_addr learned my addr 172.21.15.42:0/2325288127 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:12.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.292+0000 7fddb5200640 1 --2- 172.21.15.42:0/2325288127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5606070a4c10 0x5606070a2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:12.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.292+0000 7fddafe00640 1 -- 172.21.15.42:0/2325288127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5606070a4c10 msgr2=0x5606070a2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:12.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.292+0000 7fddafe00640 1 --2- 172.21.15.42:0/2325288127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5606070a4c10 0x5606070a2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.292+0000 7fddafe00640 1 -- 172.21.15.42:0/2325288127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56060709a350 msgr2=0x5606070a2110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:09:12.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.292+0000 7fddaf400640 1 --2- 172.21.15.42:0/2325288127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56060709a350 0x5606070a2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:12.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.292+0000 7fddafe00640 1 --2- 172.21.15.42:0/2325288127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56060709a350 0x5606070a2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.292+0000 7fddafe00640 1 -- 172.21.15.42:0/2325288127 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606070b0d00 con 0x560607099a30 2024-08-26T00:09:12.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.292+0000 7fddb5200640 1 --2- 172.21.15.42:0/2325288127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5606070a4c10 0x5606070a2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:09:12.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.293+0000 7fddafe00640 1 --2- 172.21.15.42:0/2325288127 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560607099a30 0x5606070a1bd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdda001ea00 tx=0x7fdda0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=813ea136e89bcd5e server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:12.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.293+0000 7fdd9a000640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:09:12.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.293+0000 7fdd9a000640 1 -- 172.21.15.42:0/2325288127 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0005020 con 0x560607099a30 2024-08-26T00:09:12.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.293+0000 7fdd9a000640 1 -- 172.21.15.42:0/2325288127 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fdda0018030 con 0x560607099a30 2024-08-26T00:09:12.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.293+0000 7fddb9c9d740 1 -- 172.21.15.42:0/2325288127 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdda8036040 con 0x560607099a30 2024-08-26T00:09:12.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.293+0000 7fdd9a000640 1 -- 172.21.15.42:0/2325288127 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdda00051c0 con 0x560607099a30 2024-08-26T00:09:12.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.293+0000 7fddb9c9d740 10 client.25658 fetch_fsmap learned FSMap version 29 2024-08-26T00:09:12.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.293+0000 7fddb9c9d740 1 -- 172.21.15.42:0/2325288127 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5606070b36f0 con 0x560607099a30 2024-08-26T00:09:12.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.294+0000 7fdd9a000640 1 -- 172.21.15.42:0/2325288127 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdda8036040 con 0x560607099a30 2024-08-26T00:09:12.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.294+0000 7fdd9a000640 1 -- 172.21.15.42:0/2325288127 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fdda00294b0 con 0x560607099a30 2024-08-26T00:09:12.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.294+0000 7fddb9c9d740 10 client.25658 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:09:12.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.294+0000 7fddb9c9d740 10 client.25658 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-26T00:09:12.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.294+0000 7fddb9c9d740 20 client.25658 populate_metadata read hostname 'smithi042' 2024-08-26T00:09:12.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.294+0000 7fddb9c9d740 1 --2- 172.21.15.42:0/2325288127 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x5606070b4c00 0x5606070b7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:12.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.294+0000 7fddb9c9d740 4 client.25658 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:09:12.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.294+0000 7fddb9c9d740 1 -- 172.21.15.42:0/2325288127 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56060700d4a0 con 0x5606070b4c00 2024-08-26T00:09:12.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.294+0000 7fddaf400640 1 --2- 172.21.15.42:0/2325288127 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x5606070b4c00 0x5606070b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:12.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.295+0000 7fddaf400640 1 --2- 172.21.15.42:0/2325288127 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x5606070b4c00 0x5606070b7050 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2c517a1e810b9913 server_cookie=6c0dcc184b6efe04 in_seq=0 out_seq=0 2024-08-26T00:09:12.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.295+0000 7fdd9a000640 10 client.25658 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:09:12.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.296+0000 7fdd9a000640 1 -- 172.21.15.42:0/2325288127 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56060700d4a0 con 0x5606070b4c00 2024-08-26T00:09:12.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.296+0000 7fdd9a000640 10 client.25658 handle_command_reply: tid=0 2024-08-26T00:09:12.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.296+0000 7fddb9c9d740 1 client.25658 shutdown 2024-08-26T00:09:12.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.296+0000 7fddb9c9d740 1 -- 172.21.15.42:0/2325288127 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560607099a30 msgr2=0x5606070a1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:12.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.296+0000 7fddb9c9d740 1 --2- 172.21.15.42:0/2325288127 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560607099a30 0x5606070a1bd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdda001ea00 tx=0x7fdda0004730 comp rx=0 tx=0).stop 2024-08-26T00:09:12.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.296+0000 7fddb9c9d740 1 -- 172.21.15.42:0/2325288127 shutdown_connections 2024-08-26T00:09:12.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.296+0000 7fddb9c9d740 1 --2- 172.21.15.42:0/2325288127 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x5606070b4c00 0x5606070b7050 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.296+0000 7fddb9c9d740 1 --2- 172.21.15.42:0/2325288127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5606070a4c10 0x5606070a2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.296+0000 7fddb9c9d740 1 --2- 172.21.15.42:0/2325288127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56060709a350 0x5606070a2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.296+0000 7fddb9c9d740 1 --2- 172.21.15.42:0/2325288127 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560607099a30 0x5606070a1bd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.296+0000 7fdd9a000640 0 client.25658 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:09:12.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.296+0000 7fddb9c9d740 1 -- 172.21.15.42:0/2325288127 >> 172.21.15.42:0/2325288127 conn(0x560607095fc0 msgr2=0x56060709bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:12.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.296+0000 7fddb9c9d740 1 -- 172.21.15.42:0/2325288127 shutdown_connections 2024-08-26T00:09:12.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.297+0000 7fddb9c9d740 1 -- 172.21.15.42:0/2325288127 wait complete. 2024-08-26T00:09:12.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.297+0000 7fddb9c9d740 20 client.25658 trim_cache size 0 max 16384 2024-08-26T00:09:12.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.312+0000 7fddb9c9d740 1 Processor -- start 2024-08-26T00:09:12.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.312+0000 7fddb9c9d740 1 -- start start 2024-08-26T00:09:12.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.312+0000 7fddb9c9d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560607099a30 0x5606070a1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:12.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.312+0000 7fddb9c9d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56060709a350 0x56060709bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:12.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.312+0000 7fddb9c9d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606070a4c10 0x5606070bc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:12.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.313+0000 7fddb9c9d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fddb01bea70 con 0x5606070a4c10 2024-08-26T00:09:12.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.313+0000 7fddb9c9d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fddb01bc280 con 0x56060709a350 2024-08-26T00:09:12.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.313+0000 7fddb9c9d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fddb01ba0b0 con 0x560607099a30 2024-08-26T00:09:12.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.313+0000 7fddaf400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56060709a350 0x56060709bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:12.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.313+0000 7fddaf400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56060709a350 0x56060709bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:52392/0 (socket says 172.21.15.42:52392) 2024-08-26T00:09:12.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.313+0000 7fddaf400640 1 -- 172.21.15.42:0/185675306 learned_addr learned my addr 172.21.15.42:0/185675306 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:12.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.313+0000 7fddafe00640 1 --2- 172.21.15.42:0/185675306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560607099a30 0x5606070a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:12.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.313+0000 7fddaf400640 1 -- 172.21.15.42:0/185675306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560607099a30 msgr2=0x5606070a1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.313+0000 7fddb5200640 1 --2- 172.21.15.42:0/185675306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606070a4c10 0x5606070bc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.313+0000 7fddaf400640 1 --2- 172.21.15.42:0/185675306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560607099a30 0x5606070a1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.313+0000 7fddaf400640 1 -- 172.21.15.42:0/185675306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606070a4c10 msgr2=0x5606070bc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.313+0000 7fddaf400640 1 --2- 172.21.15.42:0/185675306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606070a4c10 0x5606070bc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.313+0000 7fddaf400640 1 -- 172.21.15.42:0/185675306 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606070a76c0 con 0x56060709a350 2024-08-26T00:09:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.313+0000 7fddafe00640 1 --2- 172.21.15.42:0/185675306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560607099a30 0x5606070a1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:09:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.313+0000 7fddb5200640 1 --2- 172.21.15.42:0/185675306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606070a4c10 0x5606070bc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:09:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.314+0000 7fddaf400640 1 --2- 172.21.15.42:0/185675306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56060709a350 0x56060709bb90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00c6a0 tx=0x7fdd9c018420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a176de20801cc56 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.314+0000 7fdda4c00640 1 -- 172.21.15.42:0/185675306 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c099fd0 con 0x56060709a350 2024-08-26T00:09:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.314+0000 7fdda4c00640 1 -- 172.21.15.42:0/185675306 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd9c0cd080 con 0x56060709a350 2024-08-26T00:09:12.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.314+0000 7fdda4c00640 1 -- 172.21.15.42:0/185675306 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c018d90 con 0x56060709a350 2024-08-26T00:09:12.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.315+0000 7fddb9c9d740 1 -- 172.21.15.42:0/185675306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56060709a350 msgr2=0x56060709bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:12.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.315+0000 7fddb9c9d740 1 --2- 172.21.15.42:0/185675306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56060709a350 0x56060709bb90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00c6a0 tx=0x7fdd9c018420 comp rx=0 tx=0).stop 2024-08-26T00:09:12.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.315+0000 7fddb9c9d740 1 -- 172.21.15.42:0/185675306 shutdown_connections 2024-08-26T00:09:12.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.315+0000 7fddb9c9d740 1 --2- 172.21.15.42:0/185675306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5606070a4c10 0x5606070bc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.315+0000 7fddb9c9d740 1 --2- 172.21.15.42:0/185675306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56060709a350 0x56060709bb90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.315+0000 7fddb9c9d740 1 --2- 172.21.15.42:0/185675306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560607099a30 0x5606070a1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.315+0000 7fddb9c9d740 1 -- 172.21.15.42:0/185675306 >> 172.21.15.42:0/185675306 conn(0x560607095fc0 msgr2=0x56060709b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:12.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.315+0000 7fddb9c9d740 1 -- 172.21.15.42:0/185675306 shutdown_connections 2024-08-26T00:09:12.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.315+0000 7fddb9c9d740 1 -- 172.21.15.42:0/185675306 wait complete. 2024-08-26T00:09:12.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.316+0000 7fddb9c9d740 1 -- start start 2024-08-26T00:09:12.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.316+0000 7fddb9c9d740 1 Processor -- start 2024-08-26T00:09:12.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.316+0000 7fddb9c9d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560607099a30 0x5606070acbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:12.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.316+0000 7fddb9c9d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56060709a350 0x5606070ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:12.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.316+0000 7fddb9c9d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5606070a4c10 0x5606070a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:12.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.317+0000 7fddb9c9d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fddb01ba740 con 0x56060709a350 2024-08-26T00:09:12.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.317+0000 7fddb9c9d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fddb01bbbb0 con 0x560607099a30 2024-08-26T00:09:12.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.317+0000 7fddb9c9d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fddb01bae10 con 0x5606070a4c10 2024-08-26T00:09:12.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.317+0000 7fddb9c9d740 10 client.0 _ll_register_callbacks cb 0x7fdda0012f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:09:12.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.317+0000 7fddb5200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5606070a4c10 0x5606070a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:12.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.317+0000 7fddaf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56060709a350 0x5606070ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:12.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.317+0000 7fddb5200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5606070a4c10 0x5606070a9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:34692/0 (socket says 172.21.15.42:34692) 2024-08-26T00:09:12.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.317+0000 7fddb5200640 1 -- 172.21.15.42:0/3989462340 learned_addr learned my addr 172.21.15.42:0/3989462340 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:12.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.317+0000 7fddafe00640 1 --2- 172.21.15.42:0/3989462340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560607099a30 0x5606070acbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:12.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.317+0000 7fddb5200640 1 -- 172.21.15.42:0/3989462340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560607099a30 msgr2=0x5606070acbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:12.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.317+0000 7fddb5200640 1 --2- 172.21.15.42:0/3989462340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560607099a30 0x5606070acbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.317+0000 7fddb5200640 1 -- 172.21.15.42:0/3989462340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56060709a350 msgr2=0x5606070ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:12.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.317+0000 7fddb5200640 1 --2- 172.21.15.42:0/3989462340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56060709a350 0x5606070ad0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.317+0000 7fddb5200640 1 -- 172.21.15.42:0/3989462340 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56060709faf0 con 0x5606070a4c10 2024-08-26T00:09:12.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.318+0000 7fddb5200640 1 --2- 172.21.15.42:0/3989462340 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5606070a4c10 0x5606070a9b80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdda8000f80 tx=0x7fdda8031af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85c551c2a3e3852 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:12.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.318+0000 7fdd9a000640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:09:12.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.318+0000 7fdd9a000640 1 -- 172.21.15.42:0/3989462340 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda804e060 con 0x5606070a4c10 2024-08-26T00:09:12.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.318+0000 7fddb9c9d740 1 -- 172.21.15.42:0/3989462340 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd9c0cd080 con 0x5606070a4c10 2024-08-26T00:09:12.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.318+0000 7fdd9a000640 1 -- 172.21.15.42:0/3989462340 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fdda8003b70 con 0x5606070a4c10 2024-08-26T00:09:12.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.318+0000 7fdd9a000640 1 -- 172.21.15.42:0/3989462340 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdda8003d70 con 0x5606070a4c10 2024-08-26T00:09:12.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.318+0000 7fddb9c9d740 10 client.25651 fetch_fsmap learned FSMap version 29 2024-08-26T00:09:12.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.318+0000 7fddb9c9d740 1 -- 172.21.15.42:0/3989462340 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56060711fd90 con 0x5606070a4c10 2024-08-26T00:09:12.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.319+0000 7fdd9a000640 1 -- 172.21.15.42:0/3989462340 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd9c0cd080 con 0x5606070a4c10 2024-08-26T00:09:12.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.319+0000 7fdd9a000640 1 -- 172.21.15.42:0/3989462340 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fdda8053070 con 0x5606070a4c10 2024-08-26T00:09:12.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.319+0000 7fddb9c9d740 10 client.25651 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:09:12.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.319+0000 7fddb9c9d740 10 client.25651 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-26T00:09:12.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.319+0000 7fddb9c9d740 20 client.25651 populate_metadata read hostname 'smithi042' 2024-08-26T00:09:12.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.319+0000 7fddb9c9d740 1 --2- 172.21.15.42:0/3989462340 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x560607120080 0x560607122470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:12.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.319+0000 7fddb9c9d740 4 client.25651 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:09:12.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.319+0000 7fddb9c9d740 1 -- 172.21.15.42:0/3989462340 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5606070079b0 con 0x560607120080 2024-08-26T00:09:12.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.319+0000 7fddafe00640 1 --2- 172.21.15.42:0/3989462340 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x560607120080 0x560607122470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:12.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.320+0000 7fddafe00640 1 --2- 172.21.15.42:0/3989462340 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x560607120080 0x560607122470 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c9e1f8667d71a0b3 server_cookie=c56ab7282c95c48d in_seq=0 out_seq=0 2024-08-26T00:09:12.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.320+0000 7fdd9a000640 10 client.25651 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:09:12.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.320+0000 7fdd9a000640 1 -- 172.21.15.42:0/3989462340 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5606070079b0 con 0x560607120080 2024-08-26T00:09:12.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.320+0000 7fdd9a000640 10 client.25651 handle_command_reply: tid=0 2024-08-26T00:09:12.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.320+0000 7fddb9c9d740 1 client.25651 shutdown 2024-08-26T00:09:12.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.320+0000 7fddb9c9d740 1 -- 172.21.15.42:0/3989462340 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5606070a4c10 msgr2=0x5606070a9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:12.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.320+0000 7fddb9c9d740 1 --2- 172.21.15.42:0/3989462340 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5606070a4c10 0x5606070a9b80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdda8000f80 tx=0x7fdda8031af0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.320+0000 7fddb9c9d740 1 -- 172.21.15.42:0/3989462340 shutdown_connections 2024-08-26T00:09:12.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.320+0000 7fddb9c9d740 1 --2- 172.21.15.42:0/3989462340 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x560607120080 0x560607122470 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.320+0000 7fddb9c9d740 1 --2- 172.21.15.42:0/3989462340 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5606070a4c10 0x5606070a9b80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.320+0000 7fddb9c9d740 1 --2- 172.21.15.42:0/3989462340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56060709a350 0x5606070ad0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.320+0000 7fddb9c9d740 1 --2- 172.21.15.42:0/3989462340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560607099a30 0x5606070acbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.320+0000 7fddb9c9d740 1 -- 172.21.15.42:0/3989462340 >> 172.21.15.42:0/3989462340 conn(0x560607095fc0 msgr2=0x5606070a23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:12.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.320+0000 7fdd9a000640 0 client.25651 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:09:12.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.321+0000 7fddb9c9d740 1 -- 172.21.15.42:0/3989462340 shutdown_connections 2024-08-26T00:09:12.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.321+0000 7fddb9c9d740 1 -- 172.21.15.42:0/3989462340 wait complete. 2024-08-26T00:09:12.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.321+0000 7fddb9c9d740 20 client.25651 trim_cache size 0 max 16384 2024-08-26T00:09:12.326 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:09:12.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.322+0000 7fddb5c00640 1 -- 172.21.15.42:0/2628599159 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fdd940a2b80 msgr2=0x7fdd940a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:12.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.322+0000 7fddb5c00640 1 --2- 172.21.15.42:0/2628599159 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fdd940a2b80 0x7fdd940a5040 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x560607096e20 tx=0x7fdda0005f90 comp rx=0 tx=0).stop 2024-08-26T00:09:12.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.322+0000 7fddb5c00640 1 -- 172.21.15.42:0/2628599159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddb006ebb0 msgr2=0x7fddb010a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:12.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.322+0000 7fddb5c00640 1 --2- 172.21.15.42:0/2628599159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddb006ebb0 0x7fddb010a6b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00e9f0 tx=0x7fdd9c00eeb0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.322+0000 7fddb5c00640 1 -- 172.21.15.42:0/2628599159 shutdown_connections 2024-08-26T00:09:12.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.322+0000 7fddb5c00640 1 --2- 172.21.15.42:0/2628599159 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fdd940a2b80 0x7fdd940a5040 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.322+0000 7fddb5c00640 1 --2- 172.21.15.42:0/2628599159 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fddb0114850 0x7fddb010abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.322+0000 7fddb5c00640 1 --2- 172.21.15.42:0/2628599159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddb006ebb0 0x7fddb010a6b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.322+0000 7fddb5c00640 1 --2- 172.21.15.42:0/2628599159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddb006e290 0x7fddb010a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:12.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.322+0000 7fddb5c00640 1 -- 172.21.15.42:0/2628599159 >> 172.21.15.42:0/2628599159 conn(0x7fddb0072f20 msgr2=0x7fddb006b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:12.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.322+0000 7fddb5c00640 1 -- 172.21.15.42:0/2628599159 shutdown_connections 2024-08-26T00:09:12.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:12.322+0000 7fddb5c00640 1 -- 172.21.15.42:0/2628599159 wait complete. 2024-08-26T00:09:12.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:12 smithi043 ceph-mon[22091]: pgmap v539: 97 pgs: 97 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.3 MiB/s wr, 347 op/s 2024-08-26T00:09:12.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:12 smithi181 ceph-mon[22102]: pgmap v539: 97 pgs: 97 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.3 MiB/s wr, 347 op/s 2024-08-26T00:09:13.205 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-26T00:09:13.657 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:09:14.404 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:14 smithi042 ceph-mon[17225]: pgmap v540: 97 pgs: 97 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.9 MiB/s wr, 432 op/s 2024-08-26T00:09:14.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.463+0000 7ffabe400640 1 -- 172.21.15.42:0/4122358558 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffab8103db0 msgr2=0x7ffab8104190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:14.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.463+0000 7ffabe400640 1 --2- 172.21.15.42:0/4122358558 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffab8103db0 0x7ffab8104190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009ca0 tx=0x7ffab002a8d0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.464+0000 7ffabe400640 1 -- 172.21.15.42:0/4122358558 shutdown_connections 2024-08-26T00:09:14.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.464+0000 7ffabe400640 1 --2- 172.21.15.42:0/4122358558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffab8108ee0 0x7ffab8110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.464+0000 7ffabe400640 1 --2- 172.21.15.42:0/4122358558 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffab8104760 0x7ffab81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.465+0000 7ffabe400640 1 --2- 172.21.15.42:0/4122358558 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffab8103db0 0x7ffab8104190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.465+0000 7ffabe400640 1 -- 172.21.15.42:0/4122358558 >> 172.21.15.42:0/4122358558 conn(0x7ffab80ff7f0 msgr2=0x7ffab8101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:14.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.465+0000 7ffabe400640 1 -- 172.21.15.42:0/4122358558 shutdown_connections 2024-08-26T00:09:14.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.465+0000 7ffabe400640 1 -- 172.21.15.42:0/4122358558 wait complete. 2024-08-26T00:09:14.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.467+0000 7ffabe400640 1 Processor -- start 2024-08-26T00:09:14.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.469+0000 7ffabe400640 1 -- start start 2024-08-26T00:09:14.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.469+0000 7ffabe400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffab8103db0 0x7ffab819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:14.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.469+0000 7ffabe400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffab8104760 0x7ffab819a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:14.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.469+0000 7ffabe400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffab8108ee0 0x7ffab819eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:14.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.469+0000 7ffabe400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffab8113f90 con 0x7ffab8103db0 2024-08-26T00:09:14.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.469+0000 7ffabe400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffab8113e10 con 0x7ffab8104760 2024-08-26T00:09:14.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.469+0000 7ffabe400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ffab8114110 con 0x7ffab8108ee0 2024-08-26T00:09:14.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.470+0000 7ffab7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffab8103db0 0x7ffab819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:14.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.470+0000 7ffab7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffab8103db0 0x7ffab819a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60356/0 (socket says 172.21.15.42:60356) 2024-08-26T00:09:14.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.470+0000 7ffab7400640 1 -- 172.21.15.42:0/656991829 learned_addr learned my addr 172.21.15.42:0/656991829 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:14.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.472+0000 7ffab7400640 1 -- 172.21.15.42:0/656991829 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffab8108ee0 msgr2=0x7ffab819eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:14.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.472+0000 7ffab7e00640 1 --2- 172.21.15.42:0/656991829 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffab8108ee0 0x7ffab819eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:14.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.473+0000 7ffab7400640 1 --2- 172.21.15.42:0/656991829 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffab8108ee0 0x7ffab819eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.473+0000 7ffab7400640 1 -- 172.21.15.42:0/656991829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffab8104760 msgr2=0x7ffab819a910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-26T00:09:14.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.473+0000 7ffab7400640 1 --2- 172.21.15.42:0/656991829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffab8104760 0x7ffab819a910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.473+0000 7ffab7400640 1 -- 172.21.15.42:0/656991829 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab819f380 con 0x7ffab8103db0 2024-08-26T00:09:14.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.473+0000 7ffab7e00640 1 --2- 172.21.15.42:0/656991829 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffab8108ee0 0x7ffab819eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:09:14.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.475+0000 7ffab7400640 1 --2- 172.21.15.42:0/656991829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffab8103db0 0x7ffab819a3d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ffab002ae40 tx=0x7ffab0031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:14.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.476+0000 7ffaafe00640 1 -- 172.21.15.42:0/656991829 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab0003b70 con 0x7ffab8103db0 2024-08-26T00:09:14.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.476+0000 7ffaafe00640 1 -- 172.21.15.42:0/656991829 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffab00318f0 con 0x7ffab8103db0 2024-08-26T00:09:14.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.476+0000 7ffaafe00640 1 -- 172.21.15.42:0/656991829 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab002f980 con 0x7ffab8103db0 2024-08-26T00:09:14.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.476+0000 7ffabe400640 1 -- 172.21.15.42:0/656991829 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab819f610 con 0x7ffab8103db0 2024-08-26T00:09:14.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.476+0000 7ffabe400640 1 -- 172.21.15.42:0/656991829 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab81a6f50 con 0x7ffab8103db0 2024-08-26T00:09:14.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.495+0000 7ffac09fd740 1 Processor -- start 2024-08-26T00:09:14.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.497+0000 7ffac09fd740 1 -- start start 2024-08-26T00:09:14.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.497+0000 7ffaafe00640 1 -- 172.21.15.42:0/656991829 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ffab0003d10 con 0x7ffab8103db0 2024-08-26T00:09:14.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.498+0000 7ffac09fd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5635fb8e1740 0x5635fb8e1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:14.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.498+0000 7ffac09fd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5635fb8e2060 0x5635fb8f4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:14.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.498+0000 7ffac09fd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8f5210 0x5635fb8f7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:14.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.498+0000 7ffac09fd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5635fb847f30 con 0x5635fb8e1740 2024-08-26T00:09:14.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.498+0000 7ffac09fd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5635fb7df5a0 con 0x5635fb8f5210 2024-08-26T00:09:14.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.498+0000 7ffac09fd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5635fb843ef0 con 0x5635fb8e2060 2024-08-26T00:09:14.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.498+0000 7ffab7400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5635fb8e2060 0x5635fb8f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:14.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.499+0000 7ffab6a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8f5210 0x5635fb8f7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:14.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.499+0000 7ffab6a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8f5210 0x5635fb8f7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:52414/0 (socket says 172.21.15.42:52414) 2024-08-26T00:09:14.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.499+0000 7ffab6a00640 1 -- 172.21.15.42:0/2385398037 learned_addr learned my addr 172.21.15.42:0/2385398037 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:14.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.500+0000 7ffab7400640 1 -- 172.21.15.42:0/2385398037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8f5210 msgr2=0x5635fb8f7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:14.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.500+0000 7ffab7400640 1 --2- 172.21.15.42:0/2385398037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8f5210 0x5635fb8f7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.500+0000 7ffab7400640 1 -- 172.21.15.42:0/2385398037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5635fb8e1740 msgr2=0x5635fb8e1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:14.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.500+0000 7ffab7400640 1 --2- 172.21.15.42:0/2385398037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5635fb8e1740 0x5635fb8e1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.500+0000 7ffab7400640 1 -- 172.21.15.42:0/2385398037 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635fb5b93c0 con 0x5635fb8e2060 2024-08-26T00:09:14.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.502+0000 7ffab7400640 1 --2- 172.21.15.42:0/2385398037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5635fb8e2060 0x5635fb8f4cd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffab00edf30 tx=0x7ffab00f84d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8c65adcc9d8da24 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:14.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.503+0000 7ffaafe00640 1 --2- 172.21.15.42:0/656991829 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ffa9c0a2c40 0x7ffa9c0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:14.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.503+0000 7ffaacc00640 1 -- 172.21.15.42:0/2385398037 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab00f0a90 con 0x5635fb8e2060 2024-08-26T00:09:14.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.504+0000 7ffaacc00640 1 -- 172.21.15.42:0/2385398037 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffab00fd030 con 0x5635fb8e2060 2024-08-26T00:09:14.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.504+0000 7ffaacc00640 1 -- 172.21.15.42:0/2385398037 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab00b8a10 con 0x5635fb8e2060 2024-08-26T00:09:14.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.504+0000 7ffab7e00640 1 --2- 172.21.15.42:0/656991829 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ffa9c0a2c40 0x7ffa9c0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:14.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.505+0000 7ffaafe00640 1 -- 172.21.15.42:0/656991829 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7ffab00f0460 con 0x7ffab8103db0 2024-08-26T00:09:14.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.505+0000 7ffac09fd740 1 -- 172.21.15.42:0/2385398037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5635fb8e2060 msgr2=0x5635fb8f4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:14.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.505+0000 7ffac09fd740 1 --2- 172.21.15.42:0/2385398037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5635fb8e2060 0x5635fb8f4cd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffab00edf30 tx=0x7ffab00f84d0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.506+0000 7ffac09fd740 1 -- 172.21.15.42:0/2385398037 shutdown_connections 2024-08-26T00:09:14.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.506+0000 7ffac09fd740 1 --2- 172.21.15.42:0/2385398037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8f5210 0x5635fb8f7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.506+0000 7ffac09fd740 1 --2- 172.21.15.42:0/2385398037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5635fb8e2060 0x5635fb8f4cd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.506+0000 7ffac09fd740 1 --2- 172.21.15.42:0/2385398037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5635fb8e1740 0x5635fb8e1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.506+0000 7ffac09fd740 1 -- 172.21.15.42:0/2385398037 >> 172.21.15.42:0/2385398037 conn(0x5635fb8dddb0 msgr2=0x5635fb8de190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:14.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.508+0000 7ffac09fd740 1 -- 172.21.15.42:0/2385398037 shutdown_connections 2024-08-26T00:09:14.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:14 smithi043 ceph-mon[22091]: pgmap v540: 97 pgs: 97 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.9 MiB/s wr, 432 op/s 2024-08-26T00:09:14.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.508+0000 7ffac09fd740 1 -- 172.21.15.42:0/2385398037 wait complete. 2024-08-26T00:09:14.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.509+0000 7ffac09fd740 1 -- start start 2024-08-26T00:09:14.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.509+0000 7ffab7e00640 1 --2- 172.21.15.42:0/656991829 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ffa9c0a2c40 0x7ffa9c0a5100 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80058c0 tx=0x7ffaa8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:14.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.510+0000 7ffac09fd740 1 Processor -- start 2024-08-26T00:09:14.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.511+0000 7ffac09fd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8e1740 0x5635fb8f2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:14.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.511+0000 7ffac09fd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5635fb8e2060 0x5635fb8f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:14.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.511+0000 7ffac09fd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5635fb8f5210 0x5635fb8f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:14.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.511+0000 7ffac09fd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5635fb8f7b40 con 0x5635fb8e2060 2024-08-26T00:09:14.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.511+0000 7ffac09fd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5635fb802de0 con 0x5635fb8e1740 2024-08-26T00:09:14.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.511+0000 7ffac09fd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5635fb8f7cc0 con 0x5635fb8f5210 2024-08-26T00:09:14.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.511+0000 7ffac09fd740 10 client.0 _ll_register_callbacks cb 0x5635fb7f17b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:09:14.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.512+0000 7ffab7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5635fb8f5210 0x5635fb8f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:14.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.512+0000 7ffab7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5635fb8f5210 0x5635fb8f2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:34722/0 (socket says 172.21.15.42:34722) 2024-08-26T00:09:14.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.512+0000 7ffab7e00640 1 -- 172.21.15.42:0/3816406703 learned_addr learned my addr 172.21.15.42:0/3816406703 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:14.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.512+0000 7ffab7400640 1 --2- 172.21.15.42:0/3816406703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8e1740 0x5635fb8f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:14.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.513+0000 7ffab6a00640 1 --2- 172.21.15.42:0/3816406703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5635fb8e2060 0x5635fb8f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:14.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.513+0000 7ffab7400640 1 -- 172.21.15.42:0/3816406703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5635fb8f5210 msgr2=0x5635fb8f2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:14.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.513+0000 7ffab7400640 1 --2- 172.21.15.42:0/3816406703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5635fb8f5210 0x5635fb8f2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.513+0000 7ffab7400640 1 -- 172.21.15.42:0/3816406703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5635fb8e2060 msgr2=0x5635fb8f26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:14.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.514+0000 7ffab7400640 1 --2- 172.21.15.42:0/3816406703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5635fb8e2060 0x5635fb8f26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.514+0000 7ffab7400640 1 -- 172.21.15.42:0/3816406703 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635fb900fb0 con 0x5635fb8e1740 2024-08-26T00:09:14.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.514+0000 7ffab6a00640 1 --2- 172.21.15.42:0/3816406703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5635fb8e2060 0x5635fb8f26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:09:14.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.515+0000 7ffab7400640 1 --2- 172.21.15.42:0/3816406703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8e1740 0x5635fb8f2190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ffab00c0260 tx=0x7ffab0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d09f4f94d3c9a68e server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:14.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.515+0000 7ffaa5600640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:09:14.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.515+0000 7ffaa5600640 1 -- 172.21.15.42:0/3816406703 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab00bb9c0 con 0x5635fb8e1740 2024-08-26T00:09:14.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.517+0000 7ffac09fd740 1 -- 172.21.15.42:0/3816406703 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffab00fd030 con 0x5635fb8e1740 2024-08-26T00:09:14.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.517+0000 7ffaa5600640 1 -- 172.21.15.42:0/3816406703 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7ffab00c0e10 con 0x5635fb8e1740 2024-08-26T00:09:14.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.518+0000 7ffaa5600640 1 -- 172.21.15.42:0/3816406703 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffab00bb9c0 con 0x5635fb8e1740 2024-08-26T00:09:14.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.518+0000 7ffac09fd740 10 client.25673 fetch_fsmap learned FSMap version 29 2024-08-26T00:09:14.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.518+0000 7ffac09fd740 1 -- 172.21.15.42:0/3816406703 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5635fb8f7b40 con 0x5635fb8e1740 2024-08-26T00:09:14.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.519+0000 7ffaa5600640 1 -- 172.21.15.42:0/3816406703 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffab00fd030 con 0x5635fb8e1740 2024-08-26T00:09:14.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.519+0000 7ffaa5600640 1 -- 172.21.15.42:0/3816406703 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ffab00f0ce0 con 0x5635fb8e1740 2024-08-26T00:09:14.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.519+0000 7ffac09fd740 10 client.25673 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:09:14.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.519+0000 7ffac09fd740 10 client.25673 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-26T00:09:14.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.519+0000 7ffac09fd740 20 client.25673 populate_metadata read hostname 'smithi042' 2024-08-26T00:09:14.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.520+0000 7ffac09fd740 1 --2- 172.21.15.42:0/3816406703 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x5635fb904ac0 0x5635fb906f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:14.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.520+0000 7ffac09fd740 4 client.25673 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:09:14.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.520+0000 7ffac09fd740 1 -- 172.21.15.42:0/3816406703 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635fb8554a0 con 0x5635fb904ac0 2024-08-26T00:09:14.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.523+0000 7ffab6a00640 1 --2- 172.21.15.42:0/3816406703 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x5635fb904ac0 0x5635fb906f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:14.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.529+0000 7ffab6a00640 1 --2- 172.21.15.42:0/3816406703 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x5635fb904ac0 0x5635fb906f30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=227eec44eb97fffb server_cookie=99514114e5ccf7e1 in_seq=0 out_seq=0 2024-08-26T00:09:14.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.529+0000 7ffaa5600640 10 client.25673 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:09:14.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:14 smithi181 ceph-mon[22102]: pgmap v540: 97 pgs: 97 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.9 MiB/s wr, 432 op/s 2024-08-26T00:09:14.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.539+0000 7ffaa5600640 1 -- 172.21.15.42:0/3816406703 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5635fb8554a0 con 0x5635fb904ac0 2024-08-26T00:09:14.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.539+0000 7ffaa5600640 10 client.25673 handle_command_reply: tid=0 2024-08-26T00:09:14.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.540+0000 7ffac09fd740 1 client.25673 shutdown 2024-08-26T00:09:14.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.540+0000 7ffac09fd740 1 -- 172.21.15.42:0/3816406703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8e1740 msgr2=0x5635fb8f2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:14.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.540+0000 7ffac09fd740 1 --2- 172.21.15.42:0/3816406703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8e1740 0x5635fb8f2190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ffab00c0260 tx=0x7ffab0009c00 comp rx=0 tx=0).stop 2024-08-26T00:09:14.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.541+0000 7ffac09fd740 1 -- 172.21.15.42:0/3816406703 shutdown_connections 2024-08-26T00:09:14.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.541+0000 7ffac09fd740 1 --2- 172.21.15.42:0/3816406703 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x5635fb904ac0 0x5635fb906f30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.541+0000 7ffac09fd740 1 --2- 172.21.15.42:0/3816406703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5635fb8f5210 0x5635fb8f2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.541+0000 7ffac09fd740 1 --2- 172.21.15.42:0/3816406703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5635fb8e2060 0x5635fb8f26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.541+0000 7ffac09fd740 1 --2- 172.21.15.42:0/3816406703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8e1740 0x5635fb8f2190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.541+0000 7ffac09fd740 1 -- 172.21.15.42:0/3816406703 >> 172.21.15.42:0/3816406703 conn(0x5635fb8dddb0 msgr2=0x5635fb8dcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:14.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.541+0000 7ffaa5600640 0 client.25673 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:09:14.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.541+0000 7ffac09fd740 1 -- 172.21.15.42:0/3816406703 shutdown_connections 2024-08-26T00:09:14.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.542+0000 7ffac09fd740 1 -- 172.21.15.42:0/3816406703 wait complete. 2024-08-26T00:09:14.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.542+0000 7ffac09fd740 20 client.25673 trim_cache size 0 max 16384 2024-08-26T00:09:14.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.569+0000 7ffac09fd740 1 Processor -- start 2024-08-26T00:09:14.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.569+0000 7ffac09fd740 1 -- start start 2024-08-26T00:09:14.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.570+0000 7ffac09fd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8e1740 0x5635fb90c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:14.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.570+0000 7ffac09fd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5635fb8e2060 0x5635fb90cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:14.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.570+0000 7ffac09fd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5635fb8f5210 0x5635fb8f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:14.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.570+0000 7ffac09fd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffab81adb40 con 0x5635fb8e2060 2024-08-26T00:09:14.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.570+0000 7ffac09fd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffab81ab350 con 0x5635fb8e1740 2024-08-26T00:09:14.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.570+0000 7ffac09fd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ffab81a91a0 con 0x5635fb8f5210 2024-08-26T00:09:14.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.571+0000 7ffab7400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8e1740 0x5635fb90c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:14.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.571+0000 7ffab7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5635fb8f5210 0x5635fb8f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.571+0000 7ffab7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5635fb8f5210 0x5635fb8f38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:34724/0 (socket says 172.21.15.42:34724) 2024-08-26T00:09:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.572+0000 7ffab7e00640 1 -- 172.21.15.42:0/2010879725 learned_addr learned my addr 172.21.15.42:0/2010879725 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.571+0000 7ffab7400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8e1740 0x5635fb90c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:52430/0 (socket says 172.21.15.42:52430) 2024-08-26T00:09:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.572+0000 7ffab6a00640 1 --2- 172.21.15.42:0/2010879725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5635fb8e2060 0x5635fb90cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.572+0000 7ffab7400640 1 -- 172.21.15.42:0/2010879725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5635fb8f5210 msgr2=0x5635fb8f38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.572+0000 7ffab7400640 1 --2- 172.21.15.42:0/2010879725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5635fb8f5210 0x5635fb8f38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.572+0000 7ffab7400640 1 -- 172.21.15.42:0/2010879725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5635fb8e2060 msgr2=0x5635fb90cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.572+0000 7ffab7400640 1 --2- 172.21.15.42:0/2010879725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5635fb8e2060 0x5635fb90cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.572+0000 7ffab7400640 1 -- 172.21.15.42:0/2010879725 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635fb9075b0 con 0x5635fb8e1740 2024-08-26T00:09:14.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.573+0000 7ffab7400640 1 --2- 172.21.15.42:0/2010879725 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8e1740 0x5635fb90c840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009c70 tx=0x7ffab00f3940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c98959c08aa4d25c server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:14.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.574+0000 7ffaa7e00640 1 -- 172.21.15.42:0/2010879725 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab00bc110 con 0x5635fb8e1740 2024-08-26T00:09:14.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.574+0000 7ffaa7e00640 1 -- 172.21.15.42:0/2010879725 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffab00fd050 con 0x5635fb8e1740 2024-08-26T00:09:14.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.575+0000 7ffaa7e00640 1 -- 172.21.15.42:0/2010879725 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab00bc440 con 0x5635fb8e1740 2024-08-26T00:09:14.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.575+0000 7ffac09fd740 1 -- 172.21.15.42:0/2010879725 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8e1740 msgr2=0x5635fb90c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:14.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.575+0000 7ffac09fd740 1 --2- 172.21.15.42:0/2010879725 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8e1740 0x5635fb90c840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009c70 tx=0x7ffab00f3940 comp rx=0 tx=0).stop 2024-08-26T00:09:14.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.575+0000 7ffac09fd740 1 -- 172.21.15.42:0/2010879725 shutdown_connections 2024-08-26T00:09:14.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.575+0000 7ffac09fd740 1 --2- 172.21.15.42:0/2010879725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5635fb8f5210 0x5635fb8f38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.575+0000 7ffac09fd740 1 --2- 172.21.15.42:0/2010879725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5635fb8e2060 0x5635fb90cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.576+0000 7ffac09fd740 1 --2- 172.21.15.42:0/2010879725 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8e1740 0x5635fb90c840 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.576+0000 7ffac09fd740 1 -- 172.21.15.42:0/2010879725 >> 172.21.15.42:0/2010879725 conn(0x5635fb8dddb0 msgr2=0x5635fb8ed490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:14.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.576+0000 7ffac09fd740 1 -- 172.21.15.42:0/2010879725 shutdown_connections 2024-08-26T00:09:14.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.576+0000 7ffac09fd740 1 -- 172.21.15.42:0/2010879725 wait complete. 2024-08-26T00:09:14.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.577+0000 7ffac09fd740 1 -- start start 2024-08-26T00:09:14.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.577+0000 7ffac09fd740 1 Processor -- start 2024-08-26T00:09:14.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.580+0000 7ffac09fd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5635fb8e1740 0x5635fb8fd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:14.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.581+0000 7ffac09fd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5635fb8e2060 0x5635fb8eec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:14.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.581+0000 7ffac09fd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8f5210 0x5635fb8ef190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:14.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.581+0000 7ffab7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8f5210 0x5635fb8ef190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:14.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.582+0000 7ffab7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8f5210 0x5635fb8ef190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:52432/0 (socket says 172.21.15.42:52432) 2024-08-26T00:09:14.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.582+0000 7ffab7e00640 1 -- 172.21.15.42:0/1135417955 learned_addr learned my addr 172.21.15.42:0/1135417955 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:14.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.582+0000 7ffab6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5635fb8e2060 0x5635fb8eec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:14.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.583+0000 7ffac09fd740 1 -- 172.21.15.42:0/1135417955 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffab81a9810 con 0x5635fb8e2060 2024-08-26T00:09:14.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.584+0000 7ffab7400640 1 --2- 172.21.15.42:0/1135417955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5635fb8e1740 0x5635fb8fd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:14.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.584+0000 7ffac09fd740 1 -- 172.21.15.42:0/1135417955 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffab81aac80 con 0x5635fb8f5210 2024-08-26T00:09:14.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.584+0000 7ffac09fd740 1 -- 172.21.15.42:0/1135417955 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ffab81a9ee0 con 0x5635fb8e1740 2024-08-26T00:09:14.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.584+0000 7ffac09fd740 10 client.0 _ll_register_callbacks cb 0x7ffab00f8290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:09:14.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.586+0000 7ffab7e00640 1 -- 172.21.15.42:0/1135417955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5635fb8e1740 msgr2=0x5635fb8fd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:14.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.586+0000 7ffab7e00640 1 --2- 172.21.15.42:0/1135417955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5635fb8e1740 0x5635fb8fd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.586+0000 7ffab7e00640 1 -- 172.21.15.42:0/1135417955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5635fb8e2060 msgr2=0x5635fb8eec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:14.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.586+0000 7ffab7e00640 1 --2- 172.21.15.42:0/1135417955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5635fb8e2060 0x5635fb8eec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.586+0000 7ffab7e00640 1 -- 172.21.15.42:0/1135417955 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635fb8ef750 con 0x5635fb8f5210 2024-08-26T00:09:14.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.587+0000 7ffab6a00640 1 --2- 172.21.15.42:0/1135417955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5635fb8e2060 0x5635fb8eec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:09:14.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.588+0000 7ffab7e00640 1 --2- 172.21.15.42:0/1135417955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8f5210 0x5635fb8ef190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8010fc0 tx=0x7ffaa8005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ab44690383916c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:14.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.588+0000 7ffaa5600640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:09:14.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.588+0000 7ffaa5600640 1 -- 172.21.15.42:0/1135417955 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8005220 con 0x5635fb8f5210 2024-08-26T00:09:14.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.588+0000 7ffaa5600640 1 -- 172.21.15.42:0/1135417955 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7ffaa80053c0 con 0x5635fb8f5210 2024-08-26T00:09:14.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.589+0000 7ffac09fd740 1 -- 172.21.15.42:0/1135417955 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffab00fd050 con 0x5635fb8f5210 2024-08-26T00:09:14.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.591+0000 7ffaa5600640 1 -- 172.21.15.42:0/1135417955 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffaa80055c0 con 0x5635fb8f5210 2024-08-26T00:09:14.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.592+0000 7ffac09fd740 10 client.25679 fetch_fsmap learned FSMap version 29 2024-08-26T00:09:14.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.592+0000 7ffac09fd740 1 -- 172.21.15.42:0/1135417955 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5635fb96f5e0 con 0x5635fb8f5210 2024-08-26T00:09:14.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.593+0000 7ffaa5600640 1 -- 172.21.15.42:0/1135417955 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffab00fd050 con 0x5635fb8f5210 2024-08-26T00:09:14.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.594+0000 7ffaa5600640 1 -- 172.21.15.42:0/1135417955 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ffaa8028030 con 0x5635fb8f5210 2024-08-26T00:09:14.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.594+0000 7ffac09fd740 10 client.25679 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:09:14.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.594+0000 7ffac09fd740 10 client.25679 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-26T00:09:14.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.594+0000 7ffac09fd740 20 client.25679 populate_metadata read hostname 'smithi042' 2024-08-26T00:09:14.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.594+0000 7ffac09fd740 1 --2- 172.21.15.42:0/1135417955 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x5635fb96fd00 0x5635fb972120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:14.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.594+0000 7ffac09fd740 4 client.25679 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:09:14.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.594+0000 7ffac09fd740 1 -- 172.21.15.42:0/1135417955 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5635fb84f9b0 con 0x5635fb96fd00 2024-08-26T00:09:14.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.595+0000 7ffab7400640 1 --2- 172.21.15.42:0/1135417955 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x5635fb96fd00 0x5635fb972120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:14.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.605+0000 7ffab7400640 1 --2- 172.21.15.42:0/1135417955 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x5635fb96fd00 0x5635fb972120 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7234803fe0cf8fe4 server_cookie=39f915ca3827aacd in_seq=0 out_seq=0 2024-08-26T00:09:14.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.605+0000 7ffaa5600640 10 client.25679 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:09:14.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.608+0000 7ffaa5600640 1 -- 172.21.15.42:0/1135417955 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5635fb84f9b0 con 0x5635fb96fd00 2024-08-26T00:09:14.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.608+0000 7ffaa5600640 10 client.25679 handle_command_reply: tid=0 2024-08-26T00:09:14.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.608+0000 7ffac09fd740 1 client.25679 shutdown 2024-08-26T00:09:14.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.609+0000 7ffac09fd740 1 -- 172.21.15.42:0/1135417955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8f5210 msgr2=0x5635fb8ef190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:14.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.609+0000 7ffac09fd740 1 --2- 172.21.15.42:0/1135417955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8f5210 0x5635fb8ef190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8010fc0 tx=0x7ffaa8005f90 comp rx=0 tx=0).stop 2024-08-26T00:09:14.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.609+0000 7ffac09fd740 1 -- 172.21.15.42:0/1135417955 shutdown_connections 2024-08-26T00:09:14.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.609+0000 7ffac09fd740 1 --2- 172.21.15.42:0/1135417955 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x5635fb96fd00 0x5635fb972120 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.609+0000 7ffac09fd740 1 --2- 172.21.15.42:0/1135417955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5635fb8f5210 0x5635fb8ef190 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.609+0000 7ffac09fd740 1 --2- 172.21.15.42:0/1135417955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5635fb8e2060 0x5635fb8eec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.609+0000 7ffac09fd740 1 --2- 172.21.15.42:0/1135417955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5635fb8e1740 0x5635fb8fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.609+0000 7ffac09fd740 1 -- 172.21.15.42:0/1135417955 >> 172.21.15.42:0/1135417955 conn(0x5635fb8dddb0 msgr2=0x5635fb8ffd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:14.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.610+0000 7ffaa5600640 0 client.25679 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:09:14.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.611+0000 7ffac09fd740 1 -- 172.21.15.42:0/1135417955 shutdown_connections 2024-08-26T00:09:14.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.611+0000 7ffac09fd740 1 -- 172.21.15.42:0/1135417955 wait complete. 2024-08-26T00:09:14.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.612+0000 7ffac09fd740 20 client.25679 trim_cache size 0 max 16384 2024-08-26T00:09:14.613 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:09:14.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.614+0000 7ffabe400640 1 -- 172.21.15.42:0/656991829 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ffa9c0a2c40 msgr2=0x7ffa9c0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:14.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.614+0000 7ffabe400640 1 --2- 172.21.15.42:0/656991829 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ffa9c0a2c40 0x7ffa9c0a5100 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80058c0 tx=0x7ffaa8005850 comp rx=0 tx=0).stop 2024-08-26T00:09:14.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.614+0000 7ffabe400640 1 -- 172.21.15.42:0/656991829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffab8103db0 msgr2=0x7ffab819a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:14.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.614+0000 7ffabe400640 1 --2- 172.21.15.42:0/656991829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffab8103db0 0x7ffab819a3d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ffab002ae40 tx=0x7ffab0031700 comp rx=0 tx=0).stop 2024-08-26T00:09:14.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.614+0000 7ffabe400640 1 -- 172.21.15.42:0/656991829 shutdown_connections 2024-08-26T00:09:14.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.614+0000 7ffabe400640 1 --2- 172.21.15.42:0/656991829 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ffa9c0a2c40 0x7ffa9c0a5100 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.614+0000 7ffabe400640 1 --2- 172.21.15.42:0/656991829 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffab8108ee0 0x7ffab819eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.614+0000 7ffabe400640 1 --2- 172.21.15.42:0/656991829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffab8104760 0x7ffab819a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.614+0000 7ffabe400640 1 --2- 172.21.15.42:0/656991829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffab8103db0 0x7ffab819a3d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:14.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.614+0000 7ffabe400640 1 -- 172.21.15.42:0/656991829 >> 172.21.15.42:0/656991829 conn(0x7ffab80ff7f0 msgr2=0x7ffab8100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:14.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.615+0000 7ffabe400640 1 -- 172.21.15.42:0/656991829 shutdown_connections 2024-08-26T00:09:14.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:14.615+0000 7ffabe400640 1 -- 172.21.15.42:0/656991829 wait complete. 2024-08-26T00:09:15.968 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-26T00:09:16.170 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:16 smithi042 ceph-mon[17225]: pgmap v541: 97 pgs: 97 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.3 MiB/s wr, 429 op/s 2024-08-26T00:09:16.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:16 smithi043 ceph-mon[22091]: pgmap v541: 97 pgs: 97 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.3 MiB/s wr, 429 op/s 2024-08-26T00:09:16.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:16 smithi181 ceph-mon[22102]: pgmap v541: 97 pgs: 97 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.3 MiB/s wr, 429 op/s 2024-08-26T00:09:16.778 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:09:17.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.543+0000 7f3e01000640 1 -- 172.21.15.42:0/1847030423 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3dfc10a0f0 msgr2=0x7f3dfc110ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:17.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.543+0000 7f3e01000640 1 --2- 172.21.15.42:0/1847030423 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3dfc10a0f0 0x7f3dfc110ac0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009c10 tx=0x7f3df402a770 comp rx=0 tx=0).stop 2024-08-26T00:09:17.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.545+0000 7f3e01000640 1 -- 172.21.15.42:0/1847030423 shutdown_connections 2024-08-26T00:09:17.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.545+0000 7f3e01000640 1 --2- 172.21.15.42:0/1847030423 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3dfc10a0f0 0x7f3dfc110ac0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.545+0000 7f3e01000640 1 --2- 172.21.15.42:0/1847030423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dfc100540 0x7f3dfc109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.545+0000 7f3e01000640 1 --2- 172.21.15.42:0/1847030423 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dfc0ffc20 0x7f3dfc100000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.545+0000 7f3e01000640 1 -- 172.21.15.42:0/1847030423 >> 172.21.15.42:0/1847030423 conn(0x7f3dfc0fb830 msgr2=0x7f3dfc0fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:17.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.545+0000 7f3e01000640 1 -- 172.21.15.42:0/1847030423 shutdown_connections 2024-08-26T00:09:17.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.546+0000 7f3e01000640 1 -- 172.21.15.42:0/1847030423 wait complete. 2024-08-26T00:09:17.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.547+0000 7f3e01000640 1 Processor -- start 2024-08-26T00:09:17.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.547+0000 7f3e01000640 1 -- start start 2024-08-26T00:09:17.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.548+0000 7f3e01000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3dfc0ffc20 0x7f3dfc110990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:17.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.548+0000 7f3e01000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dfc100540 0x7f3dfc10da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:17.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.548+0000 7f3e01000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dfc10a0f0 0x7f3dfc10dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:17.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.548+0000 7f3e01000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc113f20 con 0x7f3dfc10a0f0 2024-08-26T00:09:17.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.548+0000 7f3e01000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc113da0 con 0x7f3dfc100540 2024-08-26T00:09:17.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.548+0000 7f3e01000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc1140a0 con 0x7f3dfc0ffc20 2024-08-26T00:09:17.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.548+0000 7f3df9e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3dfc0ffc20 0x7f3dfc110990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:17.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.548+0000 7f3df9e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3dfc0ffc20 0x7f3dfc110990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:59168/0 (socket says 172.21.15.42:59168) 2024-08-26T00:09:17.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.548+0000 7f3df9e00640 1 -- 172.21.15.42:0/1209645267 learned_addr learned my addr 172.21.15.42:0/1209645267 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:17.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.549+0000 7f3dfa800640 1 --2- 172.21.15.42:0/1209645267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dfc10a0f0 0x7f3dfc10dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:17.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.549+0000 7f3df9400640 1 --2- 172.21.15.42:0/1209645267 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dfc100540 0x7f3dfc10da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:17.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.551+0000 7f3df9e00640 1 -- 172.21.15.42:0/1209645267 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dfc100540 msgr2=0x7f3dfc10da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:17.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.551+0000 7f3df9e00640 1 --2- 172.21.15.42:0/1209645267 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dfc100540 0x7f3dfc10da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.551+0000 7f3df9e00640 1 -- 172.21.15.42:0/1209645267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dfc10a0f0 msgr2=0x7f3dfc10dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:17.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.551+0000 7f3df9e00640 1 --2- 172.21.15.42:0/1209645267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dfc10a0f0 0x7f3dfc10dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.551+0000 7f3df9e00640 1 -- 172.21.15.42:0/1209645267 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dfc10e860 con 0x7f3dfc0ffc20 2024-08-26T00:09:17.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.552+0000 7f3dfa800640 1 --2- 172.21.15.42:0/1209645267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dfc10a0f0 0x7f3dfc10dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:09:17.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.552+0000 7f3df9400640 1 --2- 172.21.15.42:0/1209645267 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dfc100540 0x7f3dfc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:09:17.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.556+0000 7f3df9e00640 1 --2- 172.21.15.42:0/1209645267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3dfc0ffc20 0x7f3dfc110990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00c920 tx=0x7f3dec00cd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:17.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.557+0000 7f3df2a00640 1 -- 172.21.15.42:0/1209645267 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec007bb0 con 0x7f3dfc0ffc20 2024-08-26T00:09:17.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.557+0000 7f3df2a00640 1 -- 172.21.15.42:0/1209645267 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dec007d50 con 0x7f3dfc0ffc20 2024-08-26T00:09:17.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.557+0000 7f3df2a00640 1 -- 172.21.15.42:0/1209645267 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec0187d0 con 0x7f3dfc0ffc20 2024-08-26T00:09:17.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.557+0000 7f3e01000640 1 -- 172.21.15.42:0/1209645267 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dfc06bad0 con 0x7f3dfc0ffc20 2024-08-26T00:09:17.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.558+0000 7f3e01000640 1 -- 172.21.15.42:0/1209645267 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dfc06bfc0 con 0x7f3dfc0ffc20 2024-08-26T00:09:17.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.566+0000 7f3e03bfb740 1 Processor -- start 2024-08-26T00:09:17.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.567+0000 7f3e03bfb740 1 -- start start 2024-08-26T00:09:17.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.567+0000 7f3df2a00640 1 -- 172.21.15.42:0/1209645267 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3dec00f450 con 0x7f3dfc0ffc20 2024-08-26T00:09:17.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.567+0000 7f3e03bfb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d38820 0x556252d38c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:17.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.568+0000 7f3e03bfb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556252d39140 0x556252d434c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:17.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.568+0000 7f3e03bfb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556252d43a00 0x556252d45df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:17.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.568+0000 7f3e03bfb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556252c9ef30 con 0x556252d39140 2024-08-26T00:09:17.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.568+0000 7f3e03bfb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556252c365a0 con 0x556252d38820 2024-08-26T00:09:17.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.568+0000 7f3e03bfb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556252c9aef0 con 0x556252d43a00 2024-08-26T00:09:17.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.568+0000 7f3dfa800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d38820 0x556252d38c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:17.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.568+0000 7f3dfa800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d38820 0x556252d38c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45134/0 (socket says 172.21.15.42:45134) 2024-08-26T00:09:17.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.568+0000 7f3dfa800640 1 -- 172.21.15.42:0/2908176787 learned_addr learned my addr 172.21.15.42:0/2908176787 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:17.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.569+0000 7f3dfa800640 1 -- 172.21.15.42:0/2908176787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556252d43a00 msgr2=0x556252d45df0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-26T00:09:17.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.569+0000 7f3dfa800640 1 --2- 172.21.15.42:0/2908176787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556252d43a00 0x556252d45df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.569+0000 7f3dfa800640 1 -- 172.21.15.42:0/2908176787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556252d39140 msgr2=0x556252d434c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:09:17.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.569+0000 7f3dfa800640 1 --2- 172.21.15.42:0/2908176787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556252d39140 0x556252d434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.569+0000 7f3dfa800640 1 -- 172.21.15.42:0/2908176787 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556252a103c0 con 0x556252d38820 2024-08-26T00:09:17.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.570+0000 7f3dfa800640 1 --2- 172.21.15.42:0/2908176787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d38820 0x556252d38c00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3df4006010 tx=0x7f3df4030cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=174a42e43bb29d18 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:17.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.572+0000 7f3de7400640 1 -- 172.21.15.42:0/2908176787 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4040030 con 0x556252d38820 2024-08-26T00:09:17.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.572+0000 7f3de7400640 1 -- 172.21.15.42:0/2908176787 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3df4003970 con 0x556252d38820 2024-08-26T00:09:17.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.572+0000 7f3de7400640 1 -- 172.21.15.42:0/2908176787 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4036040 con 0x556252d38820 2024-08-26T00:09:17.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.573+0000 7f3e03bfb740 1 -- 172.21.15.42:0/2908176787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d38820 msgr2=0x556252d38c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:17.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.573+0000 7f3e03bfb740 1 --2- 172.21.15.42:0/2908176787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d38820 0x556252d38c00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3df4006010 tx=0x7f3df4030cf0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.573+0000 7f3df2a00640 1 --2- 172.21.15.42:0/1209645267 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3de00a2d50 0x7f3de00a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:17.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.573+0000 7f3dfa800640 1 --2- 172.21.15.42:0/1209645267 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3de00a2d50 0x7f3de00a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:17.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.574+0000 7f3e03bfb740 1 -- 172.21.15.42:0/2908176787 shutdown_connections 2024-08-26T00:09:17.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.574+0000 7f3e03bfb740 1 --2- 172.21.15.42:0/2908176787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556252d43a00 0x556252d45df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.574+0000 7f3e03bfb740 1 --2- 172.21.15.42:0/2908176787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556252d39140 0x556252d434c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.574+0000 7f3e03bfb740 1 --2- 172.21.15.42:0/2908176787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d38820 0x556252d38c00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.574+0000 7f3e03bfb740 1 -- 172.21.15.42:0/2908176787 >> 172.21.15.42:0/2908176787 conn(0x556252d34db0 msgr2=0x556252d35190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:17.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.574+0000 7f3df2a00640 1 -- 172.21.15.42:0/1209645267 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f3dec0cf0e0 con 0x7f3dfc0ffc20 2024-08-26T00:09:17.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.575+0000 7f3dfa800640 1 --2- 172.21.15.42:0/1209645267 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3de00a2d50 0x7f3de00a5210 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009370 tx=0x7f3df402a770 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:17.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.576+0000 7f3e03bfb740 1 -- 172.21.15.42:0/2908176787 shutdown_connections 2024-08-26T00:09:17.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.576+0000 7f3e03bfb740 1 -- 172.21.15.42:0/2908176787 wait complete. 2024-08-26T00:09:17.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.576+0000 7f3e03bfb740 1 -- start start 2024-08-26T00:09:17.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.577+0000 7f3e03bfb740 1 Processor -- start 2024-08-26T00:09:17.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.577+0000 7f3e03bfb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556252d38820 0x556252d40920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:17.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.578+0000 7f3e03bfb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d39140 0x556252d40e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:17.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.578+0000 7f3e03bfb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556252d43a00 0x556252d413a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:17.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.578+0000 7f3e03bfb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556252d465d0 con 0x556252d43a00 2024-08-26T00:09:17.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.578+0000 7f3e03bfb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556252c59de0 con 0x556252d39140 2024-08-26T00:09:17.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.578+0000 7f3e03bfb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556252d46750 con 0x556252d38820 2024-08-26T00:09:17.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.578+0000 7f3e03bfb740 10 client.0 _ll_register_callbacks cb 0x556252c487b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:09:17.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.578+0000 7f3df9400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d39140 0x556252d40e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:17.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.578+0000 7f3df9400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d39140 0x556252d40e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45144/0 (socket says 172.21.15.42:45144) 2024-08-26T00:09:17.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.578+0000 7f3df9400640 1 -- 172.21.15.42:0/1256703781 learned_addr learned my addr 172.21.15.42:0/1256703781 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:17.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.579+0000 7f3df9400640 1 -- 172.21.15.42:0/1256703781 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556252d38820 msgr2=0x556252d40920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:17.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.579+0000 7f3df9400640 1 --2- 172.21.15.42:0/1256703781 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556252d38820 0x556252d40920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.579+0000 7f3df9400640 1 -- 172.21.15.42:0/1256703781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556252d43a00 msgr2=0x556252d413a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:17.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.579+0000 7f3df9400640 1 --2- 172.21.15.42:0/1256703781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556252d43a00 0x556252d413a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.579+0000 7f3df9400640 1 -- 172.21.15.42:0/1256703781 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556252d4fa70 con 0x556252d39140 2024-08-26T00:09:17.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.579+0000 7f3df9400640 1 --2- 172.21.15.42:0/1256703781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d39140 0x556252d40e60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3de8011920 tx=0x7f3de8011de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd2b6ec1283e7bca server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:17.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.579+0000 7f3ddbe00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:09:17.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.580+0000 7f3ddbe00640 1 -- 172.21.15.42:0/1256703781 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de8004030 con 0x556252d39140 2024-08-26T00:09:17.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.580+0000 7f3ddbe00640 1 -- 172.21.15.42:0/1256703781 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f3de80041d0 con 0x556252d39140 2024-08-26T00:09:17.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.580+0000 7f3e03bfb740 1 -- 172.21.15.42:0/1256703781 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3df4003970 con 0x556252d39140 2024-08-26T00:09:17.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.580+0000 7f3ddbe00640 1 -- 172.21.15.42:0/1256703781 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3de80043d0 con 0x556252d39140 2024-08-26T00:09:17.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.581+0000 7f3e03bfb740 10 client.25691 fetch_fsmap learned FSMap version 29 2024-08-26T00:09:17.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.581+0000 7f3e03bfb740 1 -- 172.21.15.42:0/1256703781 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556252d52490 con 0x556252d39140 2024-08-26T00:09:17.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.581+0000 7f3ddbe00640 1 -- 172.21.15.42:0/1256703781 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3df4003970 con 0x556252d39140 2024-08-26T00:09:17.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.581+0000 7f3ddbe00640 1 -- 172.21.15.42:0/1256703781 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3de80195e0 con 0x556252d39140 2024-08-26T00:09:17.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.582+0000 7f3e03bfb740 10 client.25691 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:09:17.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.582+0000 7f3e03bfb740 10 client.25691 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:09:17.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.582+0000 7f3e03bfb740 20 client.25691 populate_metadata read hostname 'smithi042' 2024-08-26T00:09:17.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.582+0000 7f3e03bfb740 1 --2- 172.21.15.42:0/1256703781 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x556252d539a0 0x556252d55e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:17.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.582+0000 7f3e03bfb740 4 client.25691 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:09:17.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.582+0000 7f3e03bfb740 1 -- 172.21.15.42:0/1256703781 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556252cac4a0 con 0x556252d539a0 2024-08-26T00:09:17.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.582+0000 7f3df9e00640 1 --2- 172.21.15.42:0/1256703781 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x556252d539a0 0x556252d55e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:17.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.583+0000 7f3ddbe00640 10 client.25691 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:09:17.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.583+0000 7f3df9e00640 1 --2- 172.21.15.42:0/1256703781 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x556252d539a0 0x556252d55e20 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d36c6b81985dc14a server_cookie=e3639c7d33e2ee83 in_seq=0 out_seq=0 2024-08-26T00:09:17.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.584+0000 7f3ddbe00640 1 -- 172.21.15.42:0/1256703781 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556252cac4a0 con 0x556252d539a0 2024-08-26T00:09:17.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.584+0000 7f3ddbe00640 10 client.25691 handle_command_reply: tid=0 2024-08-26T00:09:17.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.585+0000 7f3e03bfb740 1 client.25691 shutdown 2024-08-26T00:09:17.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.585+0000 7f3e03bfb740 1 -- 172.21.15.42:0/1256703781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d39140 msgr2=0x556252d40e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:17.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.585+0000 7f3e03bfb740 1 --2- 172.21.15.42:0/1256703781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d39140 0x556252d40e60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3de8011920 tx=0x7f3de8011de0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.585+0000 7f3e03bfb740 1 -- 172.21.15.42:0/1256703781 shutdown_connections 2024-08-26T00:09:17.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.585+0000 7f3e03bfb740 1 --2- 172.21.15.42:0/1256703781 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x556252d539a0 0x556252d55e20 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.585+0000 7f3e03bfb740 1 --2- 172.21.15.42:0/1256703781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556252d43a00 0x556252d413a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.585+0000 7f3e03bfb740 1 --2- 172.21.15.42:0/1256703781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d39140 0x556252d40e60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.585+0000 7f3e03bfb740 1 --2- 172.21.15.42:0/1256703781 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556252d38820 0x556252d40920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.585+0000 7f3e03bfb740 1 -- 172.21.15.42:0/1256703781 >> 172.21.15.42:0/1256703781 conn(0x556252d34db0 msgr2=0x556252d33f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:17.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.585+0000 7f3ddbe00640 0 client.25691 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:09:17.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.586+0000 7f3e03bfb740 1 -- 172.21.15.42:0/1256703781 shutdown_connections 2024-08-26T00:09:17.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.587+0000 7f3e03bfb740 1 -- 172.21.15.42:0/1256703781 wait complete. 2024-08-26T00:09:17.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.587+0000 7f3e03bfb740 20 client.25691 trim_cache size 0 max 16384 2024-08-26T00:09:17.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.613+0000 7f3e03bfb740 1 Processor -- start 2024-08-26T00:09:17.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.614+0000 7f3e03bfb740 1 -- start start 2024-08-26T00:09:17.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.614+0000 7f3e03bfb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556252d38820 0x556252d3b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:17.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.614+0000 7f3e03bfb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d39140 0x556252d411f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:17.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.614+0000 7f3e03bfb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556252d43a00 0x556252d5b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:17.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.614+0000 7f3e03bfb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc1bed00 con 0x556252d43a00 2024-08-26T00:09:17.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.614+0000 7f3e03bfb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc1bc510 con 0x556252d39140 2024-08-26T00:09:17.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.614+0000 7f3e03bfb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc072880 con 0x556252d38820 2024-08-26T00:09:17.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.615+0000 7f3df9400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d39140 0x556252d411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:17.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.615+0000 7f3df9400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d39140 0x556252d411f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45148/0 (socket says 172.21.15.42:45148) 2024-08-26T00:09:17.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.615+0000 7f3df9400640 1 -- 172.21.15.42:0/1696873410 learned_addr learned my addr 172.21.15.42:0/1696873410 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:17.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.615+0000 7f3df9e00640 1 --2- 172.21.15.42:0/1696873410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556252d38820 0x556252d3b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:17.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.615+0000 7f3df9400640 1 -- 172.21.15.42:0/1696873410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556252d38820 msgr2=0x556252d3b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:17.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.615+0000 7f3df9400640 1 --2- 172.21.15.42:0/1696873410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556252d38820 0x556252d3b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.615+0000 7f3df9400640 1 -- 172.21.15.42:0/1696873410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556252d43a00 msgr2=0x556252d5b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:17.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.615+0000 7f3df9400640 1 --2- 172.21.15.42:0/1696873410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556252d43a00 0x556252d5b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.615+0000 7f3df9400640 1 -- 172.21.15.42:0/1696873410 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556252d522a0 con 0x556252d39140 2024-08-26T00:09:17.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.615+0000 7f3df9e00640 1 --2- 172.21.15.42:0/1696873410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556252d38820 0x556252d3b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:09:17.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.616+0000 7f3df9400640 1 --2- 172.21.15.42:0/1696873410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d39140 0x556252d411f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009230 tx=0x7f3de8004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=557ec60095fbae2 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:17.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.617+0000 7f3de6a00640 1 -- 172.21.15.42:0/1696873410 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de8032070 con 0x556252d39140 2024-08-26T00:09:17.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.617+0000 7f3de6a00640 1 -- 172.21.15.42:0/1696873410 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3de800fcb0 con 0x556252d39140 2024-08-26T00:09:17.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.617+0000 7f3de6a00640 1 -- 172.21.15.42:0/1696873410 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de80043d0 con 0x556252d39140 2024-08-26T00:09:17.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.618+0000 7f3e03bfb740 1 -- 172.21.15.42:0/1696873410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d39140 msgr2=0x556252d411f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:17.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.618+0000 7f3e03bfb740 1 --2- 172.21.15.42:0/1696873410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d39140 0x556252d411f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009230 tx=0x7f3de8004360 comp rx=0 tx=0).stop 2024-08-26T00:09:17.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.618+0000 7f3e03bfb740 1 -- 172.21.15.42:0/1696873410 shutdown_connections 2024-08-26T00:09:17.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.618+0000 7f3e03bfb740 1 --2- 172.21.15.42:0/1696873410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556252d43a00 0x556252d5b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.618+0000 7f3e03bfb740 1 --2- 172.21.15.42:0/1696873410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d39140 0x556252d411f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.618+0000 7f3e03bfb740 1 --2- 172.21.15.42:0/1696873410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556252d38820 0x556252d3b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.618+0000 7f3e03bfb740 1 -- 172.21.15.42:0/1696873410 >> 172.21.15.42:0/1696873410 conn(0x556252d34db0 msgr2=0x556252d42890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.618+0000 7f3e03bfb740 1 -- 172.21.15.42:0/1696873410 shutdown_connections 2024-08-26T00:09:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.618+0000 7f3e03bfb740 1 -- 172.21.15.42:0/1696873410 wait complete. 2024-08-26T00:09:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.619+0000 7f3e03bfb740 1 -- start start 2024-08-26T00:09:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.619+0000 7f3e03bfb740 1 Processor -- start 2024-08-26T00:09:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.621+0000 7f3e03bfb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556252d38820 0x556252d47d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.621+0000 7f3e03bfb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556252d39140 0x556252d482d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.622+0000 7f3df9e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556252d38820 0x556252d47d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:17.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.622+0000 7f3e03bfb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d43a00 0x556252dbd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:17.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.622+0000 7f3df9e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556252d38820 0x556252d47d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:59204/0 (socket says 172.21.15.42:59204) 2024-08-26T00:09:17.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.622+0000 7f3e03bfb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc072f50 con 0x556252d39140 2024-08-26T00:09:17.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.622+0000 7f3e03bfb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc1bbe40 con 0x556252d43a00 2024-08-26T00:09:17.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.622+0000 7f3e03bfb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc073620 con 0x556252d38820 2024-08-26T00:09:17.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.622+0000 7f3dfa800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d43a00 0x556252dbd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:17.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.622+0000 7f3dfa800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d43a00 0x556252dbd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45156/0 (socket says 172.21.15.42:45156) 2024-08-26T00:09:17.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.622+0000 7f3dfa800640 1 -- 172.21.15.42:0/2477343129 learned_addr learned my addr 172.21.15.42:0/2477343129 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:17.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.623+0000 7f3e03bfb740 10 client.0 _ll_register_callbacks cb 0x7f3de8009b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:09:17.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.623+0000 7f3df9400640 1 --2- 172.21.15.42:0/2477343129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556252d39140 0x556252d482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:17.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.624+0000 7f3dfa800640 1 -- 172.21.15.42:0/2477343129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556252d38820 msgr2=0x556252d47d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:17.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.624+0000 7f3dfa800640 1 --2- 172.21.15.42:0/2477343129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556252d38820 0x556252d47d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.624+0000 7f3dfa800640 1 -- 172.21.15.42:0/2477343129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556252d39140 msgr2=0x556252d482d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:17.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.625+0000 7f3dfa800640 1 --2- 172.21.15.42:0/2477343129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556252d39140 0x556252d482d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.625+0000 7f3dfa800640 1 -- 172.21.15.42:0/2477343129 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556252dbdc40 con 0x556252d43a00 2024-08-26T00:09:17.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.626+0000 7f3df9e00640 1 --2- 172.21.15.42:0/2477343129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556252d38820 0x556252d47d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:09:17.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.626+0000 7f3df9400640 1 --2- 172.21.15.42:0/2477343129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556252d39140 0x556252d482d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:09:17.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.627+0000 7f3ddbe00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:09:17.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.627+0000 7f3dfa800640 1 --2- 172.21.15.42:0/2477343129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d43a00 0x556252dbd700 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3df40098b0 tx=0x7f3df4005e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb0fdd4bd0d6b98 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:17.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.628+0000 7f3ddbe00640 1 -- 172.21.15.42:0/2477343129 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4055020 con 0x556252d43a00 2024-08-26T00:09:17.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.628+0000 7f3e03bfb740 1 -- 172.21.15.42:0/2477343129 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3de800fcb0 con 0x556252d43a00 2024-08-26T00:09:17.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.629+0000 7f3ddbe00640 1 -- 172.21.15.42:0/2477343129 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f3df40303a0 con 0x556252d43a00 2024-08-26T00:09:17.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.630+0000 7f3ddbe00640 1 -- 172.21.15.42:0/2477343129 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3df4036030 con 0x556252d43a00 2024-08-26T00:09:17.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.630+0000 7f3e03bfb740 10 client.25697 fetch_fsmap learned FSMap version 29 2024-08-26T00:09:17.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.630+0000 7f3e03bfb740 1 -- 172.21.15.42:0/2477343129 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556252dbedf0 con 0x556252d43a00 2024-08-26T00:09:17.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.632+0000 7f3ddbe00640 1 -- 172.21.15.42:0/2477343129 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3de800fcb0 con 0x556252d43a00 2024-08-26T00:09:17.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.632+0000 7f3ddbe00640 1 -- 172.21.15.42:0/2477343129 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3df4031920 con 0x556252d43a00 2024-08-26T00:09:17.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.632+0000 7f3e03bfb740 10 client.25697 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:09:17.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.632+0000 7f3e03bfb740 10 client.25697 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:09:17.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.632+0000 7f3e03bfb740 20 client.25697 populate_metadata read hostname 'smithi042' 2024-08-26T00:09:17.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.632+0000 7f3e03bfb740 1 --2- 172.21.15.42:0/2477343129 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x556252dbf080 0x556252dc1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:17.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.633+0000 7f3e03bfb740 4 client.25697 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:09:17.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.633+0000 7f3e03bfb740 1 -- 172.21.15.42:0/2477343129 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556252ca69b0 con 0x556252dbf080 2024-08-26T00:09:17.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.634+0000 7f3df9e00640 1 --2- 172.21.15.42:0/2477343129 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x556252dbf080 0x556252dc1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:17.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.635+0000 7f3df9e00640 1 --2- 172.21.15.42:0/2477343129 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x556252dbf080 0x556252dc1470 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=433212a98c076d05 server_cookie=85968108218ab8e2 in_seq=0 out_seq=0 2024-08-26T00:09:17.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.635+0000 7f3ddbe00640 10 client.25697 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:09:17.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.636+0000 7f3ddbe00640 1 -- 172.21.15.42:0/2477343129 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556252ca69b0 con 0x556252dbf080 2024-08-26T00:09:17.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.636+0000 7f3ddbe00640 10 client.25697 handle_command_reply: tid=0 2024-08-26T00:09:17.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.636+0000 7f3e03bfb740 1 client.25697 shutdown 2024-08-26T00:09:17.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.637+0000 7f3e03bfb740 1 -- 172.21.15.42:0/2477343129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d43a00 msgr2=0x556252dbd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:17.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.637+0000 7f3e03bfb740 1 --2- 172.21.15.42:0/2477343129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d43a00 0x556252dbd700 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3df40098b0 tx=0x7f3df4005e30 comp rx=0 tx=0).stop 2024-08-26T00:09:17.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.637+0000 7f3e03bfb740 1 -- 172.21.15.42:0/2477343129 shutdown_connections 2024-08-26T00:09:17.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.637+0000 7f3e03bfb740 1 --2- 172.21.15.42:0/2477343129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556252d43a00 0x556252dbd700 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.637+0000 7f3e03bfb740 1 --2- 172.21.15.42:0/2477343129 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x556252dbf080 0x556252dc1470 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.637+0000 7f3e03bfb740 1 --2- 172.21.15.42:0/2477343129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556252d39140 0x556252d482d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.637+0000 7f3e03bfb740 1 --2- 172.21.15.42:0/2477343129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556252d38820 0x556252d47d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.637+0000 7f3e03bfb740 1 -- 172.21.15.42:0/2477343129 >> 172.21.15.42:0/2477343129 conn(0x556252d34db0 msgr2=0x556252d41e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:17.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.637+0000 7f3ddbe00640 0 client.25697 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:09:17.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.639+0000 7f3e03bfb740 1 -- 172.21.15.42:0/2477343129 shutdown_connections 2024-08-26T00:09:17.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.639+0000 7f3e03bfb740 1 -- 172.21.15.42:0/2477343129 wait complete. 2024-08-26T00:09:17.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.640+0000 7f3e03bfb740 20 client.25697 trim_cache size 0 max 16384 2024-08-26T00:09:17.641 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:09:17.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.641+0000 7f3e01000640 1 -- 172.21.15.42:0/1209645267 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3de00a2d50 msgr2=0x7f3de00a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:17.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.641+0000 7f3e01000640 1 --2- 172.21.15.42:0/1209645267 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3de00a2d50 0x7f3de00a5210 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009370 tx=0x7f3df402a770 comp rx=0 tx=0).stop 2024-08-26T00:09:17.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.641+0000 7f3e01000640 1 -- 172.21.15.42:0/1209645267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3dfc0ffc20 msgr2=0x7f3dfc110990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:17.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.641+0000 7f3e01000640 1 --2- 172.21.15.42:0/1209645267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3dfc0ffc20 0x7f3dfc110990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00c920 tx=0x7f3dec00cd20 comp rx=0 tx=0).stop 2024-08-26T00:09:17.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.641+0000 7f3e01000640 1 -- 172.21.15.42:0/1209645267 shutdown_connections 2024-08-26T00:09:17.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.641+0000 7f3e01000640 1 --2- 172.21.15.42:0/1209645267 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3de00a2d50 0x7f3de00a5210 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.641+0000 7f3e01000640 1 --2- 172.21.15.42:0/1209645267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dfc10a0f0 0x7f3dfc10dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.641+0000 7f3e01000640 1 --2- 172.21.15.42:0/1209645267 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dfc100540 0x7f3dfc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.641+0000 7f3e01000640 1 --2- 172.21.15.42:0/1209645267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3dfc0ffc20 0x7f3dfc110990 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:17.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.641+0000 7f3e01000640 1 -- 172.21.15.42:0/1209645267 >> 172.21.15.42:0/1209645267 conn(0x7f3dfc0fb830 msgr2=0x7f3dfc108ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:17.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.642+0000 7f3e01000640 1 -- 172.21.15.42:0/1209645267 shutdown_connections 2024-08-26T00:09:17.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:17.642+0000 7f3e01000640 1 -- 172.21.15.42:0/1209645267 wait complete. 2024-08-26T00:09:18.156 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:18 smithi042 ceph-mon[17225]: pgmap v542: 97 pgs: 97 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 10 MiB/s wr, 653 op/s 2024-08-26T00:09:18.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:18 smithi043 ceph-mon[22091]: pgmap v542: 97 pgs: 97 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 10 MiB/s wr, 653 op/s 2024-08-26T00:09:18.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:18 smithi181 ceph-mon[22102]: pgmap v542: 97 pgs: 97 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 10 MiB/s wr, 653 op/s 2024-08-26T00:09:19.556 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-26T00:09:19.556 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-26T00:09:19.976 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:09:20.379 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:20 smithi042 ceph-mon[17225]: pgmap v543: 97 pgs: 97 active+clean; 2.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 19 MiB/s wr, 1.16k op/s 2024-08-26T00:09:20.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:20 smithi043 ceph-mon[22091]: pgmap v543: 97 pgs: 97 active+clean; 2.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 19 MiB/s wr, 1.16k op/s 2024-08-26T00:09:20.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:20 smithi181 ceph-mon[22102]: pgmap v543: 97 pgs: 97 active+clean; 2.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 19 MiB/s wr, 1.16k op/s 2024-08-26T00:09:20.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.707+0000 7f565de00640 1 -- 172.21.15.42:0/2727088738 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56580743c0 msgr2=0x7f56580747a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:20.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.707+0000 7f565de00640 1 --2- 172.21.15.42:0/2727088738 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56580743c0 0x7f56580747a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5648009900 tx=0x7f564802a480 comp rx=0 tx=0).stop 2024-08-26T00:09:20.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.707+0000 7f565de00640 1 -- 172.21.15.42:0/2727088738 shutdown_connections 2024-08-26T00:09:20.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.707+0000 7f565de00640 1 --2- 172.21.15.42:0/2727088738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f565810e160 0x7f56581105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.707+0000 7f565de00640 1 --2- 172.21.15.42:0/2727088738 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5658074ce0 0x7f565810dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.707+0000 7f565de00640 1 --2- 172.21.15.42:0/2727088738 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56580743c0 0x7f56580747a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.707+0000 7f565de00640 1 -- 172.21.15.42:0/2727088738 >> 172.21.15.42:0/2727088738 conn(0x7f56580fd660 msgr2=0x7f56580ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:20.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.707+0000 7f565de00640 1 -- 172.21.15.42:0/2727088738 shutdown_connections 2024-08-26T00:09:20.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.707+0000 7f565de00640 1 -- 172.21.15.42:0/2727088738 wait complete. 2024-08-26T00:09:20.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.708+0000 7f565de00640 1 Processor -- start 2024-08-26T00:09:20.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.709+0000 7f565de00640 1 -- start start 2024-08-26T00:09:20.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.709+0000 7f565de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56580743c0 0x7f565819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:20.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.709+0000 7f565de00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5658074ce0 0x7f565819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:20.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.709+0000 7f565de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f565810e160 0x7f565819ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:20.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.709+0000 7f565de00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5658113ed0 con 0x7f565810e160 2024-08-26T00:09:20.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.709+0000 7f565de00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5658113d50 con 0x7f56580743c0 2024-08-26T00:09:20.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.709+0000 7f565de00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5658114050 con 0x7f5658074ce0 2024-08-26T00:09:20.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.709+0000 7f5656000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5658074ce0 0x7f565819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:20.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.709+0000 7f5656000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5658074ce0 0x7f565819a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:59218/0 (socket says 172.21.15.42:59218) 2024-08-26T00:09:20.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.709+0000 7f5656000640 1 -- 172.21.15.42:0/2666528944 learned_addr learned my addr 172.21.15.42:0/2666528944 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:20.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.709+0000 7f5657400640 1 --2- 172.21.15.42:0/2666528944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f565810e160 0x7f565819ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:20.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.709+0000 7f5656a00640 1 --2- 172.21.15.42:0/2666528944 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56580743c0 0x7f565819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:20.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.710+0000 7f5656000640 1 -- 172.21.15.42:0/2666528944 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56580743c0 msgr2=0x7f565819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:20.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.710+0000 7f5656000640 1 --2- 172.21.15.42:0/2666528944 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56580743c0 0x7f565819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.710+0000 7f5656000640 1 -- 172.21.15.42:0/2666528944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f565810e160 msgr2=0x7f565819ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:20.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.710+0000 7f5656000640 1 --2- 172.21.15.42:0/2666528944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f565810e160 0x7f565819ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.710+0000 7f5656000640 1 -- 172.21.15.42:0/2666528944 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f565819f430 con 0x7f5658074ce0 2024-08-26T00:09:20.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.710+0000 7f5657400640 1 --2- 172.21.15.42:0/2666528944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f565810e160 0x7f565819ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:09:20.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.710+0000 7f5656000640 1 --2- 172.21.15.42:0/2666528944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5658074ce0 0x7f565819a9c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f564400e9f0 tx=0x7f564400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:20.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.710+0000 7f565ca00640 1 -- 172.21.15.42:0/2666528944 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f564400cd80 con 0x7f5658074ce0 2024-08-26T00:09:20.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.711+0000 7f565ca00640 1 -- 172.21.15.42:0/2666528944 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5644010910 con 0x7f5658074ce0 2024-08-26T00:09:20.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.711+0000 7f565ca00640 1 -- 172.21.15.42:0/2666528944 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5644018990 con 0x7f5658074ce0 2024-08-26T00:09:20.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.711+0000 7f565de00640 1 -- 172.21.15.42:0/2666528944 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f565819f720 con 0x7f5658074ce0 2024-08-26T00:09:20.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.711+0000 7f565de00640 1 -- 172.21.15.42:0/2666528944 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56581a7000 con 0x7f5658074ce0 2024-08-26T00:09:20.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.714+0000 7f5660890740 1 Processor -- start 2024-08-26T00:09:20.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.714+0000 7f5660890740 1 -- start start 2024-08-26T00:09:20.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.714+0000 7f5660890740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646c70a3d30 0x5646c70a4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:20.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.714+0000 7f5660890740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a4650 0x5646c70ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:20.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.714+0000 7f5660890740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 0x5646c70b1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:20.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.714+0000 7f5660890740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5646c700ae30 con 0x5646c70a3d30 2024-08-26T00:09:20.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.714+0000 7f5660890740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5646c6fa23c0 con 0x5646c70a4650 2024-08-26T00:09:20.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.714+0000 7f5660890740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5646c7006df0 con 0x5646c70aef10 2024-08-26T00:09:20.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.715+0000 7f5657400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646c70a3d30 0x5646c70a4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:20.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.715+0000 7f5656a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a4650 0x5646c70ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:20.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.715+0000 7f5657400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646c70a3d30 0x5646c70a4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33762/0 (socket says 172.21.15.42:33762) 2024-08-26T00:09:20.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.715+0000 7f5657400640 1 -- 172.21.15.42:0/3790408693 learned_addr learned my addr 172.21.15.42:0/3790408693 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:20.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.715+0000 7f5656a00640 1 -- 172.21.15.42:0/3790408693 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 msgr2=0x5646c70b1300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:09:20.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.715+0000 7f5656a00640 1 --2- 172.21.15.42:0/3790408693 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 0x5646c70b1300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.715+0000 7f5656a00640 1 -- 172.21.15.42:0/3790408693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646c70a3d30 msgr2=0x5646c70a4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:20.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.715+0000 7f5656a00640 1 --2- 172.21.15.42:0/3790408693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646c70a3d30 0x5646c70a4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.715+0000 7f5656a00640 1 -- 172.21.15.42:0/3790408693 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646c6d7c6a0 con 0x5646c70a4650 2024-08-26T00:09:20.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.715+0000 7f565ca00640 1 -- 172.21.15.42:0/2666528944 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5644010ac0 con 0x7f5658074ce0 2024-08-26T00:09:20.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.716+0000 7f5656a00640 1 --2- 172.21.15.42:0/3790408693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a4650 0x5646c70ae9d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5648005940 tx=0x7f5648005be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4eebe52186a5432 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:20.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.716+0000 7f5643e00640 1 -- 172.21.15.42:0/3790408693 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5648040070 con 0x5646c70a4650 2024-08-26T00:09:20.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.716+0000 7f5643e00640 1 -- 172.21.15.42:0/3790408693 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5648031870 con 0x5646c70a4650 2024-08-26T00:09:20.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.716+0000 7f5643e00640 1 -- 172.21.15.42:0/3790408693 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5648035040 con 0x5646c70a4650 2024-08-26T00:09:20.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.717+0000 7f5660890740 1 -- 172.21.15.42:0/3790408693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a4650 msgr2=0x5646c70ae9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:20.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.717+0000 7f5660890740 1 --2- 172.21.15.42:0/3790408693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a4650 0x5646c70ae9d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5648005940 tx=0x7f5648005be0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.717+0000 7f5660890740 1 -- 172.21.15.42:0/3790408693 shutdown_connections 2024-08-26T00:09:20.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.717+0000 7f5660890740 1 --2- 172.21.15.42:0/3790408693 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 0x5646c70b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.717+0000 7f5660890740 1 --2- 172.21.15.42:0/3790408693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a4650 0x5646c70ae9d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.717+0000 7f5660890740 1 --2- 172.21.15.42:0/3790408693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646c70a3d30 0x5646c70a4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.717+0000 7f5660890740 1 -- 172.21.15.42:0/3790408693 >> 172.21.15.42:0/3790408693 conn(0x5646c70a02c0 msgr2=0x5646c70a06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:20.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.717+0000 7f5660890740 1 -- 172.21.15.42:0/3790408693 shutdown_connections 2024-08-26T00:09:20.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.717+0000 7f5660890740 1 -- 172.21.15.42:0/3790408693 wait complete. 2024-08-26T00:09:20.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.717+0000 7f565ca00640 1 --2- 172.21.15.42:0/2666528944 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f563c0a2b10 0x7f563c0a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:20.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.718+0000 7f565ca00640 1 -- 172.21.15.42:0/2666528944 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f56440cf2f0 con 0x7f5658074ce0 2024-08-26T00:09:20.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.718+0000 7f5656a00640 1 --2- 172.21.15.42:0/2666528944 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f563c0a2b10 0x7f563c0a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:20.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.718+0000 7f5660890740 1 -- start start 2024-08-26T00:09:20.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.718+0000 7f5660890740 1 Processor -- start 2024-08-26T00:09:20.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.718+0000 7f5660890740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a3d30 0x5646c70abea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:20.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.718+0000 7f5660890740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646c70a4650 0x5646c70ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:20.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.719+0000 7f5660890740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 0x5646c70ac920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:20.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.719+0000 7f5660890740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5646c70b1ae0 con 0x5646c70a4650 2024-08-26T00:09:20.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.719+0000 7f5660890740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5646c6fc5c30 con 0x5646c70a3d30 2024-08-26T00:09:20.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.719+0000 7f5660890740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5646c70b1c60 con 0x5646c70aef10 2024-08-26T00:09:20.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.719+0000 7f5656a00640 1 --2- 172.21.15.42:0/2666528944 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f563c0a2b10 0x7f563c0a4fd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5648031ba0 tx=0x7f5648000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:20.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.719+0000 7f5660890740 10 client.0 _ll_register_callbacks cb 0x5646c6d19ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:09:20.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.719+0000 7f5656a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a3d30 0x5646c70abea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:20.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.719+0000 7f5657400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 0x5646c70ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:20.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.719+0000 7f5656a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a3d30 0x5646c70abea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45196/0 (socket says 172.21.15.42:45196) 2024-08-26T00:09:20.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.719+0000 7f5656a00640 1 -- 172.21.15.42:0/1373260373 learned_addr learned my addr 172.21.15.42:0/1373260373 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:20.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.719+0000 7f5656000640 1 --2- 172.21.15.42:0/1373260373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646c70a4650 0x5646c70ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:20.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.719+0000 7f5657400640 1 -- 172.21.15.42:0/1373260373 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a3d30 msgr2=0x5646c70abea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:20.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.719+0000 7f5657400640 1 --2- 172.21.15.42:0/1373260373 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a3d30 0x5646c70abea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.719+0000 7f5657400640 1 -- 172.21.15.42:0/1373260373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646c70a4650 msgr2=0x5646c70ac3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:20.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.719+0000 7f5657400640 1 --2- 172.21.15.42:0/1373260373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646c70a4650 0x5646c70ac3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.719+0000 7f5657400640 1 -- 172.21.15.42:0/1373260373 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646c6fd1dd0 con 0x5646c70aef10 2024-08-26T00:09:20.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.719+0000 7f5656000640 1 --2- 172.21.15.42:0/1373260373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646c70a4650 0x5646c70ac3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:09:20.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.719+0000 7f5656a00640 1 --2- 172.21.15.42:0/1373260373 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a3d30 0x5646c70abea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:09:20.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.720+0000 7f5657400640 1 --2- 172.21.15.42:0/1373260373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 0x5646c70ac920 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5650009fd0 tx=0x7f5650012820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b394dbeb9593d9f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:20.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.720+0000 7f5640c00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:09:20.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.720+0000 7f5640c00640 1 -- 172.21.15.42:0/1373260373 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5650004b20 con 0x5646c70aef10 2024-08-26T00:09:20.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.720+0000 7f5660890740 1 -- 172.21.15.42:0/1373260373 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5648031870 con 0x5646c70aef10 2024-08-26T00:09:20.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.720+0000 7f5640c00640 1 -- 172.21.15.42:0/1373260373 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f5650004cc0 con 0x5646c70aef10 2024-08-26T00:09:20.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.720+0000 7f5640c00640 1 -- 172.21.15.42:0/1373260373 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f565001c470 con 0x5646c70aef10 2024-08-26T00:09:20.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.720+0000 7f5660890740 10 client.25684 fetch_fsmap learned FSMap version 29 2024-08-26T00:09:20.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.720+0000 7f5660890740 1 -- 172.21.15.42:0/1373260373 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5646c70bd7c0 con 0x5646c70aef10 2024-08-26T00:09:20.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.721+0000 7f5640c00640 1 -- 172.21.15.42:0/1373260373 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5648031870 con 0x5646c70aef10 2024-08-26T00:09:20.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.721+0000 7f5640c00640 1 -- 172.21.15.42:0/1373260373 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f565001a530 con 0x5646c70aef10 2024-08-26T00:09:20.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.721+0000 7f5660890740 10 client.25684 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:09:20.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.721+0000 7f5660890740 10 client.25684 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:09:20.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.721+0000 7f5660890740 20 client.25684 populate_metadata read hostname 'smithi042' 2024-08-26T00:09:20.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.721+0000 7f5660890740 1 --2- 172.21.15.42:0/1373260373 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5646c70becd0 0x5646c70c10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:20.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.721+0000 7f5660890740 4 client.25684 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:09:20.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.721+0000 7f5660890740 1 -- 172.21.15.42:0/1373260373 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646c70183a0 con 0x5646c70becd0 2024-08-26T00:09:20.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.721+0000 7f5656a00640 1 --2- 172.21.15.42:0/1373260373 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5646c70becd0 0x5646c70c10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:20.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.722+0000 7f5656a00640 1 --2- 172.21.15.42:0/1373260373 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5646c70becd0 0x5646c70c10c0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dc38f620ce8f549 server_cookie=f702f195e87fb5c in_seq=0 out_seq=0 2024-08-26T00:09:20.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.722+0000 7f5640c00640 10 client.25684 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:09:20.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.723+0000 7f5640c00640 1 -- 172.21.15.42:0/1373260373 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5646c70183a0 con 0x5646c70becd0 2024-08-26T00:09:20.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.723+0000 7f5640c00640 10 client.25684 handle_command_reply: tid=0 2024-08-26T00:09:20.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.723+0000 7f5660890740 1 client.25684 shutdown 2024-08-26T00:09:20.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.723+0000 7f5660890740 1 -- 172.21.15.42:0/1373260373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 msgr2=0x5646c70ac920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:20.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.723+0000 7f5660890740 1 --2- 172.21.15.42:0/1373260373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 0x5646c70ac920 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5650009fd0 tx=0x7f5650012820 comp rx=0 tx=0).stop 2024-08-26T00:09:20.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.723+0000 7f5660890740 1 -- 172.21.15.42:0/1373260373 shutdown_connections 2024-08-26T00:09:20.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.723+0000 7f5660890740 1 --2- 172.21.15.42:0/1373260373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 0x5646c70ac920 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.723+0000 7f5660890740 1 --2- 172.21.15.42:0/1373260373 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5646c70becd0 0x5646c70c10c0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.723+0000 7f5660890740 1 --2- 172.21.15.42:0/1373260373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646c70a4650 0x5646c70ac3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.723+0000 7f5660890740 1 --2- 172.21.15.42:0/1373260373 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a3d30 0x5646c70abea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.723+0000 7f5660890740 1 -- 172.21.15.42:0/1373260373 >> 172.21.15.42:0/1373260373 conn(0x5646c70a02c0 msgr2=0x5646c70a5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:20.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.723+0000 7f5640c00640 0 client.25684 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:09:20.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.723+0000 7f5660890740 1 -- 172.21.15.42:0/1373260373 shutdown_connections 2024-08-26T00:09:20.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.723+0000 7f5660890740 1 -- 172.21.15.42:0/1373260373 wait complete. 2024-08-26T00:09:20.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.724+0000 7f5660890740 20 client.25684 trim_cache size 0 max 16384 2024-08-26T00:09:20.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.742+0000 7f5660890740 1 Processor -- start 2024-08-26T00:09:20.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.742+0000 7f5660890740 1 -- start start 2024-08-26T00:09:20.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.742+0000 7f5660890740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a3d30 0x5646c70c6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:20.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.742+0000 7f5660890740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646c70a4650 0x5646c70c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:20.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.742+0000 7f5660890740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 0x5646c70a9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:20.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.742+0000 7f5660890740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f56581adb30 con 0x5646c70a4650 2024-08-26T00:09:20.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.742+0000 7f5660890740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f56581ab340 con 0x5646c70a3d30 2024-08-26T00:09:20.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.742+0000 7f5660890740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f56581a9170 con 0x5646c70aef10 2024-08-26T00:09:20.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.742+0000 7f5656000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646c70a4650 0x5646c70c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:20.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.743+0000 7f5657400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 0x5646c70a9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:20.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.743+0000 7f5657400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 0x5646c70a9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:59238/0 (socket says 172.21.15.42:59238) 2024-08-26T00:09:20.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.743+0000 7f5657400640 1 -- 172.21.15.42:0/90802676 learned_addr learned my addr 172.21.15.42:0/90802676 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:20.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.743+0000 7f5656a00640 1 --2- 172.21.15.42:0/90802676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a3d30 0x5646c70c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:20.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.743+0000 7f5657400640 1 -- 172.21.15.42:0/90802676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a3d30 msgr2=0x5646c70c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:20.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.743+0000 7f5657400640 1 --2- 172.21.15.42:0/90802676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a3d30 0x5646c70c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.743+0000 7f5657400640 1 -- 172.21.15.42:0/90802676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646c70a4650 msgr2=0x5646c70c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:20.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.743+0000 7f5657400640 1 --2- 172.21.15.42:0/90802676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646c70a4650 0x5646c70c6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.743+0000 7f5657400640 1 -- 172.21.15.42:0/90802676 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646c70a0e70 con 0x5646c70aef10 2024-08-26T00:09:20.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.743+0000 7f5657400640 1 --2- 172.21.15.42:0/90802676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 0x5646c70a9160 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5650005d70 tx=0x7f565000fb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d084f41e4f5d92b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:20.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.744+0000 7f5643400640 1 -- 172.21.15.42:0/90802676 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565002c070 con 0x5646c70aef10 2024-08-26T00:09:20.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.744+0000 7f5643400640 1 -- 172.21.15.42:0/90802676 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f565001abc0 con 0x5646c70aef10 2024-08-26T00:09:20.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.744+0000 7f5643400640 1 -- 172.21.15.42:0/90802676 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565001c870 con 0x5646c70aef10 2024-08-26T00:09:20.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.744+0000 7f5660890740 1 -- 172.21.15.42:0/90802676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 msgr2=0x5646c70a9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:20.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.744+0000 7f5660890740 1 --2- 172.21.15.42:0/90802676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 0x5646c70a9160 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5650005d70 tx=0x7f565000fb00 comp rx=0 tx=0).stop 2024-08-26T00:09:20.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.744+0000 7f5660890740 1 -- 172.21.15.42:0/90802676 shutdown_connections 2024-08-26T00:09:20.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.744+0000 7f5660890740 1 --2- 172.21.15.42:0/90802676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 0x5646c70a9160 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.744+0000 7f5660890740 1 --2- 172.21.15.42:0/90802676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646c70a4650 0x5646c70c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.744+0000 7f5660890740 1 --2- 172.21.15.42:0/90802676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a3d30 0x5646c70c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.744+0000 7f5660890740 1 -- 172.21.15.42:0/90802676 >> 172.21.15.42:0/90802676 conn(0x5646c70a02c0 msgr2=0x5646c70ade10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:20.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.744+0000 7f5660890740 1 -- 172.21.15.42:0/90802676 shutdown_connections 2024-08-26T00:09:20.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.745+0000 7f5660890740 1 -- 172.21.15.42:0/90802676 wait complete. 2024-08-26T00:09:20.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.745+0000 7f5660890740 1 -- start start 2024-08-26T00:09:20.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.745+0000 7f5660890740 1 Processor -- start 2024-08-26T00:09:20.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.745+0000 7f5660890740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a3d30 0x5646c70b6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:20.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.745+0000 7f5660890740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646c70a4650 0x5646c70b73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:20.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.745+0000 7f5660890740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 0x5646c70b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:20.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.746+0000 7f5660890740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f56581a9800 con 0x5646c70a4650 2024-08-26T00:09:20.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.746+0000 7f5660890740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f56581aac70 con 0x5646c70a3d30 2024-08-26T00:09:20.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.746+0000 7f5660890740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f56581a9ed0 con 0x5646c70aef10 2024-08-26T00:09:20.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.746+0000 7f5660890740 10 client.0 _ll_register_callbacks cb 0x7f565000f4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:09:20.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.746+0000 7f5657400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 0x5646c70b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:20.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.746+0000 7f5656a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a3d30 0x5646c70b6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:20.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.746+0000 7f5657400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 0x5646c70b3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:59244/0 (socket says 172.21.15.42:59244) 2024-08-26T00:09:20.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.746+0000 7f5657400640 1 -- 172.21.15.42:0/1501301505 learned_addr learned my addr 172.21.15.42:0/1501301505 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:20.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.746+0000 7f5656000640 1 --2- 172.21.15.42:0/1501301505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646c70a4650 0x5646c70b73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:20.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.746+0000 7f5656a00640 1 -- 172.21.15.42:0/1501301505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 msgr2=0x5646c70b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:20.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.746+0000 7f5656a00640 1 --2- 172.21.15.42:0/1501301505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 0x5646c70b3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.746+0000 7f5656a00640 1 -- 172.21.15.42:0/1501301505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646c70a4650 msgr2=0x5646c70b73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:20.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.746+0000 7f5656a00640 1 --2- 172.21.15.42:0/1501301505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646c70a4650 0x5646c70b73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.746+0000 7f5656a00640 1 -- 172.21.15.42:0/1501301505 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646c70b7b00 con 0x5646c70a3d30 2024-08-26T00:09:20.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.746+0000 7f5657400640 1 --2- 172.21.15.42:0/1501301505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 0x5646c70b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:09:20.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.746+0000 7f5656a00640 1 --2- 172.21.15.42:0/1501301505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a3d30 0x5646c70b6eb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5648005940 tx=0x7f5648005470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fd84bc4a34c7abc server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:20.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.746+0000 7f5640c00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:09:20.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.747+0000 7f5640c00640 1 -- 172.21.15.42:0/1501301505 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5648035050 con 0x5646c70a3d30 2024-08-26T00:09:20.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.747+0000 7f5660890740 1 -- 172.21.15.42:0/1501301505 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f565001abc0 con 0x5646c70a3d30 2024-08-26T00:09:20.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.747+0000 7f5640c00640 1 -- 172.21.15.42:0/1501301505 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f5648004030 con 0x5646c70a3d30 2024-08-26T00:09:20.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.747+0000 7f5640c00640 1 -- 172.21.15.42:0/1501301505 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5648004230 con 0x5646c70a3d30 2024-08-26T00:09:20.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.747+0000 7f5660890740 10 client.25715 fetch_fsmap learned FSMap version 29 2024-08-26T00:09:20.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.747+0000 7f5660890740 1 -- 172.21.15.42:0/1501301505 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5646c7129fc0 con 0x5646c70a3d30 2024-08-26T00:09:20.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.747+0000 7f5640c00640 1 -- 172.21.15.42:0/1501301505 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f565001abc0 con 0x5646c70a3d30 2024-08-26T00:09:20.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.747+0000 7f5640c00640 1 -- 172.21.15.42:0/1501301505 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f564805c4f0 con 0x5646c70a3d30 2024-08-26T00:09:20.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.747+0000 7f5660890740 10 client.25715 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:09:20.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.747+0000 7f5660890740 10 client.25715 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.748+0000 7f5660890740 20 client.25715 populate_metadata read hostname 'smithi042' 2024-08-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.748+0000 7f5660890740 1 --2- 172.21.15.42:0/1501301505 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5646c712a2a0 0x5646c712c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.748+0000 7f5660890740 4 client.25715 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.748+0000 7f5660890740 1 -- 172.21.15.42:0/1501301505 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5646c70128b0 con 0x5646c712a2a0 2024-08-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.748+0000 7f5656000640 1 --2- 172.21.15.42:0/1501301505 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5646c712a2a0 0x5646c712c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.748+0000 7f5656000640 1 --2- 172.21.15.42:0/1501301505 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5646c712a2a0 0x5646c712c6c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=162c9e81be02affa server_cookie=3cd7194c28203752 in_seq=0 out_seq=0 2024-08-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.748+0000 7f5640c00640 10 client.25715 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.749+0000 7f5640c00640 1 -- 172.21.15.42:0/1501301505 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5646c70128b0 con 0x5646c712a2a0 2024-08-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.749+0000 7f5640c00640 10 client.25715 handle_command_reply: tid=0 2024-08-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.749+0000 7f5660890740 1 client.25715 shutdown 2024-08-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.750+0000 7f5660890740 1 -- 172.21.15.42:0/1501301505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a3d30 msgr2=0x5646c70b6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.750+0000 7f5660890740 1 --2- 172.21.15.42:0/1501301505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a3d30 0x5646c70b6eb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5648005940 tx=0x7f5648005470 comp rx=0 tx=0).stop 2024-08-26T00:09:20.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.750+0000 7f5660890740 1 -- 172.21.15.42:0/1501301505 shutdown_connections 2024-08-26T00:09:20.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.750+0000 7f5660890740 1 --2- 172.21.15.42:0/1501301505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5646c70aef10 0x5646c70b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.750+0000 7f5660890740 1 --2- 172.21.15.42:0/1501301505 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5646c712a2a0 0x5646c712c6c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.750+0000 7f5660890740 1 --2- 172.21.15.42:0/1501301505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5646c70a4650 0x5646c70b73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.750+0000 7f5660890740 1 --2- 172.21.15.42:0/1501301505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5646c70a3d30 0x5646c70b6eb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.750+0000 7f5660890740 1 -- 172.21.15.42:0/1501301505 >> 172.21.15.42:0/1501301505 conn(0x5646c70a02c0 msgr2=0x5646c70a57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:20.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.750+0000 7f5640c00640 0 client.25715 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:09:20.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.750+0000 7f5660890740 1 -- 172.21.15.42:0/1501301505 shutdown_connections 2024-08-26T00:09:20.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.750+0000 7f5660890740 1 -- 172.21.15.42:0/1501301505 wait complete. 2024-08-26T00:09:20.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.750+0000 7f5660890740 20 client.25715 trim_cache size 0 max 16384 2024-08-26T00:09:20.756 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:09:20.756 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-08-26T00:09:20.756 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "c707f9d6-8409-4880-982d-664c114e9db4", 2024-08-26T00:09:20.756 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-08-26T00:09:20.756 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:09:20.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.751+0000 7f565de00640 1 -- 172.21.15.42:0/2666528944 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f563c0a2b10 msgr2=0x7f563c0a4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:20.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.751+0000 7f565de00640 1 --2- 172.21.15.42:0/2666528944 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f563c0a2b10 0x7f563c0a4fd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5648031ba0 tx=0x7f5648000bc0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.751+0000 7f565de00640 1 -- 172.21.15.42:0/2666528944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5658074ce0 msgr2=0x7f565819a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.751+0000 7f565de00640 1 --2- 172.21.15.42:0/2666528944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5658074ce0 0x7f565819a9c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f564400e9f0 tx=0x7f564400eeb0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.751+0000 7f565de00640 1 -- 172.21.15.42:0/2666528944 shutdown_connections 2024-08-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.751+0000 7f565de00640 1 --2- 172.21.15.42:0/2666528944 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f563c0a2b10 0x7f563c0a4fd0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.751+0000 7f565de00640 1 --2- 172.21.15.42:0/2666528944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f565810e160 0x7f565819ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.751+0000 7f565de00640 1 --2- 172.21.15.42:0/2666528944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5658074ce0 0x7f565819a9c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.751+0000 7f565de00640 1 --2- 172.21.15.42:0/2666528944 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56580743c0 0x7f565819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.751+0000 7f565de00640 1 -- 172.21.15.42:0/2666528944 >> 172.21.15.42:0/2666528944 conn(0x7f56580fd660 msgr2=0x7f56580fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.751+0000 7f565de00640 1 -- 172.21.15.42:0/2666528944 shutdown_connections 2024-08-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:20.751+0000 7f565de00640 1 -- 172.21.15.42:0/2666528944 wait complete. 2024-08-26T00:09:21.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:21 smithi043 ceph-mon[22091]: scrub queued for path: / 2024-08-26T00:09:21.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:21 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:09:21.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:21 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:09:21.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:21 smithi042 ceph-mon[17225]: scrub queued for path: / 2024-08-26T00:09:21.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:21 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:09:21.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:21 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:09:21.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:21 smithi181 ceph-mon[22102]: scrub queued for path: / 2024-08-26T00:09:21.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:21 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:09:21.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:21 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:09:22.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:22 smithi043 ceph-mon[22091]: pgmap v544: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 22 MiB/s wr, 1.35k op/s 2024-08-26T00:09:22.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:22 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:09:22.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:22 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:09:22.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:22 smithi042 ceph-mon[17225]: pgmap v544: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 22 MiB/s wr, 1.35k op/s 2024-08-26T00:09:22.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:22 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:09:22.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:22 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:09:22.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:22 smithi181 ceph-mon[22102]: pgmap v544: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 22 MiB/s wr, 1.35k op/s 2024-08-26T00:09:22.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:22 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:09:22.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:22 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:09:22.628 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-26T00:09:23.165 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:09:23.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.870+0000 7f06ac000640 1 -- 172.21.15.42:0/1023634303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06a41081f0 msgr2=0x7f06a41085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:23.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.870+0000 7f06ac000640 1 --2- 172.21.15.42:0/1023634303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06a41081f0 0x7f06a41085d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0694009900 tx=0x7f069402a3f0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.871+0000 7f06ac000640 1 -- 172.21.15.42:0/1023634303 shutdown_connections 2024-08-26T00:09:23.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.871+0000 7f06ac000640 1 --2- 172.21.15.42:0/1023634303 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a410d2d0 0x7f06a4114e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.871+0000 7f06ac000640 1 --2- 172.21.15.42:0/1023634303 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06a4108ba0 0x7f06a410cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.871+0000 7f06ac000640 1 --2- 172.21.15.42:0/1023634303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06a41081f0 0x7f06a41085d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.871+0000 7f06ac000640 1 -- 172.21.15.42:0/1023634303 >> 172.21.15.42:0/1023634303 conn(0x7f06a4077940 msgr2=0x7f06a4079d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:23.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.871+0000 7f06ac000640 1 -- 172.21.15.42:0/1023634303 shutdown_connections 2024-08-26T00:09:23.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.871+0000 7f06ac000640 1 -- 172.21.15.42:0/1023634303 wait complete. 2024-08-26T00:09:23.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.873+0000 7f06ac000640 1 Processor -- start 2024-08-26T00:09:23.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.873+0000 7f06ac000640 1 -- start start 2024-08-26T00:09:23.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.874+0000 7f06ac000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a41081f0 0x7f06a41a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:23.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.874+0000 7f06ac000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06a4108ba0 0x7f06a41a4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:23.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.874+0000 7f06ac000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06a410d2d0 0x7f06a419e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:23.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.874+0000 7f06ac000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f06a4118350 con 0x7f06a4108ba0 2024-08-26T00:09:23.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.874+0000 7f06ac000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f06a41181d0 con 0x7f06a41081f0 2024-08-26T00:09:23.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.874+0000 7f06ac000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f06a41184d0 con 0x7f06a410d2d0 2024-08-26T00:09:23.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.874+0000 7f06a9600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a41081f0 0x7f06a41a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:23.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.874+0000 7f06a9600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a41081f0 0x7f06a41a4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45234/0 (socket says 172.21.15.42:45234) 2024-08-26T00:09:23.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.874+0000 7f06a9600640 1 -- 172.21.15.42:0/3853812605 learned_addr learned my addr 172.21.15.42:0/3853812605 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:23.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.874+0000 7f06a8c00640 1 --2- 172.21.15.42:0/3853812605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06a4108ba0 0x7f06a41a4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:23.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.874+0000 7f06aa000640 1 --2- 172.21.15.42:0/3853812605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06a410d2d0 0x7f06a419e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:23.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.875+0000 7f06a9600640 1 -- 172.21.15.42:0/3853812605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06a410d2d0 msgr2=0x7f06a419e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:23.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.875+0000 7f06a9600640 1 --2- 172.21.15.42:0/3853812605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06a410d2d0 0x7f06a419e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.875+0000 7f06a9600640 1 -- 172.21.15.42:0/3853812605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06a4108ba0 msgr2=0x7f06a41a4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:23.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.876+0000 7f06a9600640 1 --2- 172.21.15.42:0/3853812605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06a4108ba0 0x7f06a41a4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.876+0000 7f06a9600640 1 -- 172.21.15.42:0/3853812605 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a419ed30 con 0x7f06a41081f0 2024-08-26T00:09:23.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.876+0000 7f06a8c00640 1 --2- 172.21.15.42:0/3853812605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06a4108ba0 0x7f06a41a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:09:23.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.876+0000 7f06a9600640 1 --2- 172.21.15.42:0/3853812605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a41081f0 0x7f06a41a4440 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f069402a960 tx=0x7f0694003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:23.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.877+0000 7f06a2000640 1 -- 172.21.15.42:0/3853812605 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069403f070 con 0x7f06a41081f0 2024-08-26T00:09:23.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.877+0000 7f06ac000640 1 -- 172.21.15.42:0/3853812605 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a419efc0 con 0x7f06a41081f0 2024-08-26T00:09:23.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.877+0000 7f06a2000640 1 -- 172.21.15.42:0/3853812605 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0694031c90 con 0x7f06a41081f0 2024-08-26T00:09:23.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.877+0000 7f06ac000640 1 -- 172.21.15.42:0/3853812605 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a41ab310 con 0x7f06a41081f0 2024-08-26T00:09:23.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.877+0000 7f06a2000640 1 -- 172.21.15.42:0/3853812605 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0694035030 con 0x7f06a41081f0 2024-08-26T00:09:23.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.882+0000 7f06a2000640 1 -- 172.21.15.42:0/3853812605 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0694042070 con 0x7f06a41081f0 2024-08-26T00:09:23.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.883+0000 7f06aec06740 1 Processor -- start 2024-08-26T00:09:23.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.883+0000 7f06aec06740 1 -- start start 2024-08-26T00:09:23.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.884+0000 7f06aec06740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560ea3f08940 0x560ea3f08d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:23.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.884+0000 7f06aec06740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f09260 0x560ea3f135e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:23.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.884+0000 7f06aec06740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560ea3f13b20 0x560ea3f15f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:23.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.884+0000 7f06aec06740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560ea3e6efc0 con 0x560ea3f13b20 2024-08-26T00:09:23.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.884+0000 7f06aec06740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560ea3e06680 con 0x560ea3f09260 2024-08-26T00:09:23.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.884+0000 7f06aec06740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x560ea3e6af80 con 0x560ea3f08940 2024-08-26T00:09:23.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.884+0000 7f06a9600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f09260 0x560ea3f135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:23.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.884+0000 7f06a9600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f09260 0x560ea3f135e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45242/0 (socket says 172.21.15.42:45242) 2024-08-26T00:09:23.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.884+0000 7f06a9600640 1 -- 172.21.15.42:0/349762399 learned_addr learned my addr 172.21.15.42:0/349762399 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:23.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.884+0000 7f06a8c00640 1 --2- 172.21.15.42:0/349762399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560ea3f13b20 0x560ea3f15f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:23.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.885+0000 7f06a9600640 1 -- 172.21.15.42:0/349762399 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560ea3f08940 msgr2=0x560ea3f08d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:23.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.885+0000 7f06a9600640 1 --2- 172.21.15.42:0/349762399 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560ea3f08940 0x560ea3f08d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.885+0000 7f06a9600640 1 -- 172.21.15.42:0/349762399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560ea3f13b20 msgr2=0x560ea3f15f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:23.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.885+0000 7f06a9600640 1 --2- 172.21.15.42:0/349762399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560ea3f13b20 0x560ea3f15f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.885+0000 7f06a9600640 1 -- 172.21.15.42:0/349762399 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ea3e222c0 con 0x560ea3f09260 2024-08-26T00:09:23.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.885+0000 7f06a2000640 1 --2- 172.21.15.42:0/3853812605 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f06880a2c40 0x7f06880a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:23.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.885+0000 7f06a9600640 1 --2- 172.21.15.42:0/349762399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f09260 0x560ea3f135e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f06940f5c20 tx=0x7f06940f5d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54276b647f5ad578 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:23.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.885+0000 7f06a2000640 1 -- 172.21.15.42:0/3853812605 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f06940ef6c0 con 0x7f06a41081f0 2024-08-26T00:09:23.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.886+0000 7f069a600640 1 -- 172.21.15.42:0/349762399 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06940b8230 con 0x560ea3f09260 2024-08-26T00:09:23.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.886+0000 7f069a600640 1 -- 172.21.15.42:0/349762399 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06940bbf90 con 0x560ea3f09260 2024-08-26T00:09:23.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.886+0000 7f069a600640 1 -- 172.21.15.42:0/349762399 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06940bb8f0 con 0x560ea3f09260 2024-08-26T00:09:23.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.886+0000 7f06aa000640 1 --2- 172.21.15.42:0/3853812605 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f06880a2c40 0x7f06880a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:23.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.887+0000 7f06aec06740 1 -- 172.21.15.42:0/349762399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f09260 msgr2=0x560ea3f135e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:23.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.887+0000 7f06aec06740 1 --2- 172.21.15.42:0/349762399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f09260 0x560ea3f135e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f06940f5c20 tx=0x7f06940f5d10 comp rx=0 tx=0).stop 2024-08-26T00:09:23.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.887+0000 7f06aec06740 1 -- 172.21.15.42:0/349762399 shutdown_connections 2024-08-26T00:09:23.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.887+0000 7f06aec06740 1 --2- 172.21.15.42:0/349762399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560ea3f13b20 0x560ea3f15f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.887+0000 7f06aec06740 1 --2- 172.21.15.42:0/349762399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f09260 0x560ea3f135e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.887+0000 7f06aec06740 1 --2- 172.21.15.42:0/349762399 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560ea3f08940 0x560ea3f08d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.887+0000 7f06aec06740 1 -- 172.21.15.42:0/349762399 >> 172.21.15.42:0/349762399 conn(0x560ea3f04ed0 msgr2=0x560ea3f052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:23.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.888+0000 7f06aa000640 1 --2- 172.21.15.42:0/3853812605 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f06880a2c40 0x7f06880a5100 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f069c005fd0 tx=0x7f069c009a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:23.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.888+0000 7f06aec06740 1 -- 172.21.15.42:0/349762399 shutdown_connections 2024-08-26T00:09:23.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.888+0000 7f06aec06740 1 -- 172.21.15.42:0/349762399 wait complete. 2024-08-26T00:09:23.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.889+0000 7f06aec06740 1 -- start start 2024-08-26T00:09:23.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.889+0000 7f06aec06740 1 Processor -- start 2024-08-26T00:09:23.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.890+0000 7f06aec06740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f08940 0x560ea3f109b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:23.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.890+0000 7f06aec06740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560ea3f09260 0x560ea3f10ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:23.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.890+0000 7f06aec06740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560ea3f13b20 0x560ea3f11430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:23.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.890+0000 7f06aec06740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560ea3f164b0 con 0x560ea3f09260 2024-08-26T00:09:23.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.890+0000 7f06aec06740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560ea3e29e50 con 0x560ea3f08940 2024-08-26T00:09:23.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.890+0000 7f06aec06740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x560ea3f16630 con 0x560ea3f13b20 2024-08-26T00:09:23.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.890+0000 7f06aec06740 10 client.0 _ll_register_callbacks cb 0x560ea3e14f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:09:23.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.890+0000 7f06a9600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f08940 0x560ea3f109b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:23.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.890+0000 7f06a9600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f08940 0x560ea3f109b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45258/0 (socket says 172.21.15.42:45258) 2024-08-26T00:09:23.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.890+0000 7f06a9600640 1 -- 172.21.15.42:0/3552949065 learned_addr learned my addr 172.21.15.42:0/3552949065 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:23.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.890+0000 7f06aa000640 1 --2- 172.21.15.42:0/3552949065 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560ea3f13b20 0x560ea3f11430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:23.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.890+0000 7f06a8c00640 1 --2- 172.21.15.42:0/3552949065 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560ea3f09260 0x560ea3f10ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:23.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.890+0000 7f06a9600640 1 -- 172.21.15.42:0/3552949065 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560ea3f13b20 msgr2=0x560ea3f11430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:23.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.890+0000 7f06a9600640 1 --2- 172.21.15.42:0/3552949065 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560ea3f13b20 0x560ea3f11430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.891+0000 7f06a9600640 1 -- 172.21.15.42:0/3552949065 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560ea3f09260 msgr2=0x560ea3f10ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:23.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.891+0000 7f06a9600640 1 --2- 172.21.15.42:0/3552949065 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560ea3f09260 0x560ea3f10ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.891+0000 7f06a9600640 1 -- 172.21.15.42:0/3552949065 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ea3be03c0 con 0x560ea3f08940 2024-08-26T00:09:23.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.891+0000 7f06a8c00640 1 --2- 172.21.15.42:0/3552949065 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560ea3f09260 0x560ea3f10ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:09:23.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.891+0000 7f06a9600640 1 --2- 172.21.15.42:0/3552949065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f08940 0x560ea3f109b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0694006010 tx=0x7f069402a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d15523d5141aaf3 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:23.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.891+0000 7f068ea00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:09:23.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.892+0000 7f068ea00640 1 -- 172.21.15.42:0/3552949065 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0694049070 con 0x560ea3f08940 2024-08-26T00:09:23.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.892+0000 7f068ea00640 1 -- 172.21.15.42:0/3552949065 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f06940f56d0 con 0x560ea3f08940 2024-08-26T00:09:23.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.892+0000 7f06aec06740 1 -- 172.21.15.42:0/3552949065 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06940bbf90 con 0x560ea3f08940 2024-08-26T00:09:23.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.892+0000 7f068ea00640 1 -- 172.21.15.42:0/3552949065 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f06940bbad0 con 0x560ea3f08940 2024-08-26T00:09:23.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.892+0000 7f06aec06740 10 client.25727 fetch_fsmap learned FSMap version 29 2024-08-26T00:09:23.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.892+0000 7f06aec06740 1 -- 172.21.15.42:0/3552949065 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560ea3f164b0 con 0x560ea3f08940 2024-08-26T00:09:23.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.893+0000 7f068ea00640 1 -- 172.21.15.42:0/3552949065 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06940bbf90 con 0x560ea3f08940 2024-08-26T00:09:23.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.893+0000 7f068ea00640 1 -- 172.21.15.42:0/3552949065 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f069403b460 con 0x560ea3f08940 2024-08-26T00:09:23.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.893+0000 7f06aec06740 10 client.25727 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:09:23.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.893+0000 7f06aec06740 10 client.25727 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:09:23.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.893+0000 7f06aec06740 20 client.25727 populate_metadata read hostname 'smithi042' 2024-08-26T00:09:23.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.893+0000 7f06aec06740 1 --2- 172.21.15.42:0/3552949065 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x560ea3f23310 0x560ea3f257b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:23.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.893+0000 7f06aec06740 4 client.25727 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:09:23.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.893+0000 7f06aec06740 1 -- 172.21.15.42:0/3552949065 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ea3e7c530 con 0x560ea3f23310 2024-08-26T00:09:23.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.893+0000 7f06a8c00640 1 --2- 172.21.15.42:0/3552949065 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x560ea3f23310 0x560ea3f257b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:23.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.894+0000 7f06a8c00640 1 --2- 172.21.15.42:0/3552949065 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x560ea3f23310 0x560ea3f257b0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dfa87cdddec1923 server_cookie=2bb3a5590f8b06da in_seq=0 out_seq=0 2024-08-26T00:09:23.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.894+0000 7f068ea00640 10 client.25727 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:09:23.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.896+0000 7f068ea00640 1 -- 172.21.15.42:0/3552949065 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560ea3e7c530 con 0x560ea3f23310 2024-08-26T00:09:23.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.896+0000 7f068ea00640 10 client.25727 handle_command_reply: tid=0 2024-08-26T00:09:23.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.896+0000 7f06aec06740 1 client.25727 shutdown 2024-08-26T00:09:23.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.896+0000 7f06aec06740 1 -- 172.21.15.42:0/3552949065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f08940 msgr2=0x560ea3f109b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:23.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.896+0000 7f06aec06740 1 --2- 172.21.15.42:0/3552949065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f08940 0x560ea3f109b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0694006010 tx=0x7f069402a3f0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.896+0000 7f06aec06740 1 -- 172.21.15.42:0/3552949065 shutdown_connections 2024-08-26T00:09:23.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.896+0000 7f06aec06740 1 --2- 172.21.15.42:0/3552949065 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560ea3f13b20 0x560ea3f11430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.896+0000 7f06aec06740 1 --2- 172.21.15.42:0/3552949065 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x560ea3f23310 0x560ea3f257b0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.896+0000 7f06aec06740 1 --2- 172.21.15.42:0/3552949065 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560ea3f09260 0x560ea3f10ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.896+0000 7f06aec06740 1 --2- 172.21.15.42:0/3552949065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f08940 0x560ea3f109b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.896+0000 7f06aec06740 1 -- 172.21.15.42:0/3552949065 >> 172.21.15.42:0/3552949065 conn(0x560ea3f04ed0 msgr2=0x560ea3f04050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:23.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.896+0000 7f068ea00640 0 client.25727 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:09:23.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.897+0000 7f06aec06740 1 -- 172.21.15.42:0/3552949065 shutdown_connections 2024-08-26T00:09:23.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.897+0000 7f06aec06740 1 -- 172.21.15.42:0/3552949065 wait complete. 2024-08-26T00:09:23.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.897+0000 7f06aec06740 20 client.25727 trim_cache size 0 max 16384 2024-08-26T00:09:23.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.925+0000 7f06aec06740 1 Processor -- start 2024-08-26T00:09:23.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.925+0000 7f06aec06740 1 -- start start 2024-08-26T00:09:23.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.925+0000 7f06aec06740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560ea3f08940 0x560ea3f25320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:23.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.925+0000 7f06aec06740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560ea3f09260 0x560ea3f12920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:23.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.925+0000 7f06aec06740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f13b20 0x560ea3f2b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:23.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.925+0000 7f06aec06740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0684010ee0 con 0x560ea3f09260 2024-08-26T00:09:23.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.925+0000 7f06aec06740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f068400e6f0 con 0x560ea3f13b20 2024-08-26T00:09:23.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.925+0000 7f06aec06740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f068400c520 con 0x560ea3f08940 2024-08-26T00:09:23.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.926+0000 7f06aa000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f13b20 0x560ea3f2b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:23.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.926+0000 7f06a9600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560ea3f08940 0x560ea3f25320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:23.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.926+0000 7f06a9600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560ea3f08940 0x560ea3f25320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:59300/0 (socket says 172.21.15.42:59300) 2024-08-26T00:09:23.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.926+0000 7f06a9600640 1 -- 172.21.15.42:0/2103343766 learned_addr learned my addr 172.21.15.42:0/2103343766 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:23.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.926+0000 7f06a8c00640 1 --2- 172.21.15.42:0/2103343766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560ea3f09260 0x560ea3f12920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:23.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.926+0000 7f06a9600640 1 -- 172.21.15.42:0/2103343766 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f13b20 msgr2=0x560ea3f2b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:23.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.927+0000 7f06a9600640 1 --2- 172.21.15.42:0/2103343766 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f13b20 0x560ea3f2b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.927+0000 7f06a9600640 1 -- 172.21.15.42:0/2103343766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560ea3f09260 msgr2=0x560ea3f12920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:23.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.927+0000 7f06a9600640 1 --2- 172.21.15.42:0/2103343766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560ea3f09260 0x560ea3f12920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.927+0000 7f06a9600640 1 -- 172.21.15.42:0/2103343766 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ea3f0f960 con 0x560ea3f08940 2024-08-26T00:09:23.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.927+0000 7f06aa000640 1 --2- 172.21.15.42:0/2103343766 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f13b20 0x560ea3f2b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:09:23.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.927+0000 7f06a9600640 1 --2- 172.21.15.42:0/2103343766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560ea3f08940 0x560ea3f25320 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f06940ba240 tx=0x7f0694009680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c9eb0415a11cca0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:23.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.928+0000 7f0699c00640 1 -- 172.21.15.42:0/2103343766 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0694049030 con 0x560ea3f08940 2024-08-26T00:09:23.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.928+0000 7f0699c00640 1 -- 172.21.15.42:0/2103343766 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06940bbf90 con 0x560ea3f08940 2024-08-26T00:09:23.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.928+0000 7f0699c00640 1 -- 172.21.15.42:0/2103343766 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06940bbd60 con 0x560ea3f08940 2024-08-26T00:09:23.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.929+0000 7f06aec06740 1 -- 172.21.15.42:0/2103343766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560ea3f08940 msgr2=0x560ea3f25320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.929+0000 7f06aec06740 1 --2- 172.21.15.42:0/2103343766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560ea3f08940 0x560ea3f25320 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f06940ba240 tx=0x7f0694009680 comp rx=0 tx=0).stop 2024-08-26T00:09:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.929+0000 7f06aec06740 1 -- 172.21.15.42:0/2103343766 shutdown_connections 2024-08-26T00:09:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.929+0000 7f06aec06740 1 --2- 172.21.15.42:0/2103343766 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f13b20 0x560ea3f2b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.929+0000 7f06aec06740 1 --2- 172.21.15.42:0/2103343766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560ea3f09260 0x560ea3f12920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.929+0000 7f06aec06740 1 --2- 172.21.15.42:0/2103343766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560ea3f08940 0x560ea3f25320 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.929+0000 7f06aec06740 1 -- 172.21.15.42:0/2103343766 >> 172.21.15.42:0/2103343766 conn(0x560ea3f04ed0 msgr2=0x560ea3f12210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:23.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.930+0000 7f06aec06740 1 -- 172.21.15.42:0/2103343766 shutdown_connections 2024-08-26T00:09:23.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.930+0000 7f06aec06740 1 -- 172.21.15.42:0/2103343766 wait complete. 2024-08-26T00:09:23.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.930+0000 7f06aec06740 1 -- start start 2024-08-26T00:09:23.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.931+0000 7f06aec06740 1 Processor -- start 2024-08-26T00:09:23.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.931+0000 7f06aec06740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560ea3f08940 0x560ea3f1bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:23.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.931+0000 7f06aec06740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f09260 0x560ea3f1c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:23.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.931+0000 7f06aec06740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560ea3f13b20 0x560ea3f171f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:23.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.931+0000 7f06aec06740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f068400cbb0 con 0x560ea3f08940 2024-08-26T00:09:23.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.931+0000 7f06aec06740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f068400e020 con 0x560ea3f09260 2024-08-26T00:09:23.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.931+0000 7f06aec06740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f068400d280 con 0x560ea3f13b20 2024-08-26T00:09:23.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.932+0000 7f06aec06740 10 client.0 _ll_register_callbacks cb 0x7f06940f5a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:09:23.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.932+0000 7f06a8c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f09260 0x560ea3f1c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:23.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.932+0000 7f06a9600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560ea3f08940 0x560ea3f1bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:23.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.932+0000 7f06a8c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f09260 0x560ea3f1c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45278/0 (socket says 172.21.15.42:45278) 2024-08-26T00:09:23.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.932+0000 7f06a8c00640 1 -- 172.21.15.42:0/991520357 learned_addr learned my addr 172.21.15.42:0/991520357 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:23.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.932+0000 7f06aa000640 1 --2- 172.21.15.42:0/991520357 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560ea3f13b20 0x560ea3f171f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.933+0000 7f06a8c00640 1 -- 172.21.15.42:0/991520357 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560ea3f13b20 msgr2=0x560ea3f171f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.933+0000 7f06a8c00640 1 --2- 172.21.15.42:0/991520357 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560ea3f13b20 0x560ea3f171f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.933+0000 7f06a8c00640 1 -- 172.21.15.42:0/991520357 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560ea3f08940 msgr2=0x560ea3f1bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.933+0000 7f06a8c00640 1 --2- 172.21.15.42:0/991520357 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560ea3f08940 0x560ea3f1bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.933+0000 7f06a8c00640 1 -- 172.21.15.42:0/991520357 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ea3f17a20 con 0x560ea3f09260 2024-08-26T00:09:23.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.934+0000 7f06a8c00640 1 --2- 172.21.15.42:0/991520357 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f09260 0x560ea3f1c1b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x560ea3f06250 tx=0x7f0690005660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fadf9860efb0b10 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:23.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.934+0000 7f068ea00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:09:23.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.934+0000 7f068ea00640 1 -- 172.21.15.42:0/991520357 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0690004220 con 0x560ea3f09260 2024-08-26T00:09:23.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.934+0000 7f068ea00640 1 -- 172.21.15.42:0/991520357 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f06900043c0 con 0x560ea3f09260 2024-08-26T00:09:23.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.934+0000 7f06aec06740 1 -- 172.21.15.42:0/991520357 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06940bbf90 con 0x560ea3f09260 2024-08-26T00:09:23.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.935+0000 7f068ea00640 1 -- 172.21.15.42:0/991520357 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f06900035f0 con 0x560ea3f09260 2024-08-26T00:09:23.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.935+0000 7f06aec06740 10 client.25733 fetch_fsmap learned FSMap version 29 2024-08-26T00:09:23.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.935+0000 7f06aec06740 1 -- 172.21.15.42:0/991520357 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560ea3f8dde0 con 0x560ea3f09260 2024-08-26T00:09:23.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.935+0000 7f068ea00640 1 -- 172.21.15.42:0/991520357 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06940bbf90 con 0x560ea3f09260 2024-08-26T00:09:23.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.935+0000 7f068ea00640 1 -- 172.21.15.42:0/991520357 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0690021030 con 0x560ea3f09260 2024-08-26T00:09:23.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.935+0000 7f06aec06740 10 client.25733 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:09:23.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.935+0000 7f06aec06740 10 client.25733 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:09:23.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.935+0000 7f06aec06740 20 client.25733 populate_metadata read hostname 'smithi042' 2024-08-26T00:09:23.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.935+0000 7f06aec06740 1 --2- 172.21.15.42:0/991520357 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x560ea3f8e5d0 0x560ea3f909f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:23.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.935+0000 7f06aec06740 4 client.25733 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-26T00:09:23.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.935+0000 7f06aec06740 1 -- 172.21.15.42:0/991520357 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560ea3e76a40 con 0x560ea3f8e5d0 2024-08-26T00:09:23.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.936+0000 7f06a9600640 1 --2- 172.21.15.42:0/991520357 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x560ea3f8e5d0 0x560ea3f909f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:23.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.937+0000 7f06a9600640 1 --2- 172.21.15.42:0/991520357 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x560ea3f8e5d0 0x560ea3f909f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d26f00aaa170d920 server_cookie=9e1bc174e807388b in_seq=0 out_seq=0 2024-08-26T00:09:23.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.937+0000 7f068ea00640 10 client.25733 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:09:23.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.938+0000 7f068ea00640 1 -- 172.21.15.42:0/991520357 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+269 (crc 0 0 0) 0x560ea3e76a40 con 0x560ea3f8e5d0 2024-08-26T00:09:23.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.938+0000 7f068ea00640 10 client.25733 handle_command_reply: tid=0 2024-08-26T00:09:23.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.938+0000 7f06aec06740 1 client.25733 shutdown 2024-08-26T00:09:23.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.938+0000 7f06aec06740 1 -- 172.21.15.42:0/991520357 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f09260 msgr2=0x560ea3f1c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:23.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.938+0000 7f06aec06740 1 --2- 172.21.15.42:0/991520357 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f09260 0x560ea3f1c1b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x560ea3f06250 tx=0x7f0690005660 comp rx=0 tx=0).stop 2024-08-26T00:09:23.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.938+0000 7f06aec06740 1 -- 172.21.15.42:0/991520357 shutdown_connections 2024-08-26T00:09:23.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.938+0000 7f06aec06740 1 --2- 172.21.15.42:0/991520357 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560ea3f13b20 0x560ea3f171f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.938+0000 7f06aec06740 1 --2- 172.21.15.42:0/991520357 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560ea3f09260 0x560ea3f1c1b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.938+0000 7f06aec06740 1 --2- 172.21.15.42:0/991520357 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x560ea3f8e5d0 0x560ea3f909f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.938+0000 7f06aec06740 1 --2- 172.21.15.42:0/991520357 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560ea3f08940 0x560ea3f1bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.938+0000 7f068ea00640 0 client.25733 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:09:23.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.938+0000 7f06aec06740 1 -- 172.21.15.42:0/991520357 >> 172.21.15.42:0/991520357 conn(0x560ea3f04ed0 msgr2=0x560ea3f11190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:23.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.939+0000 7f06aec06740 1 -- 172.21.15.42:0/991520357 shutdown_connections 2024-08-26T00:09:23.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.939+0000 7f06aec06740 1 -- 172.21.15.42:0/991520357 wait complete. 2024-08-26T00:09:23.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.939+0000 7f06aec06740 20 client.25733 trim_cache size 0 max 16384 2024-08-26T00:09:23.941 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:09:23.942 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "scrub active (10199 inodes in the stack)", 2024-08-26T00:09:23.942 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-08-26T00:09:23.942 INFO:teuthology.orchestra.run.smithi042.stdout: "c707f9d6-8409-4880-982d-664c114e9db4": { 2024-08-26T00:09:23.942 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-08-26T00:09:23.942 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "c707f9d6-8409-4880-982d-664c114e9db4", 2024-08-26T00:09:23.942 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,force" 2024-08-26T00:09:23.942 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:09:23.942 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:09:23.942 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:09:23.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.940+0000 7f06ac000640 1 -- 172.21.15.42:0/3853812605 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f06880a2c40 msgr2=0x7f06880a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:23.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.940+0000 7f06ac000640 1 --2- 172.21.15.42:0/3853812605 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f06880a2c40 0x7f06880a5100 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f069c005fd0 tx=0x7f069c009a80 comp rx=0 tx=0).stop 2024-08-26T00:09:23.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.940+0000 7f06ac000640 1 -- 172.21.15.42:0/3853812605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a41081f0 msgr2=0x7f06a41a4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:23.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.940+0000 7f06ac000640 1 --2- 172.21.15.42:0/3853812605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a41081f0 0x7f06a41a4440 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f069402a960 tx=0x7f0694003b90 comp rx=0 tx=0).stop 2024-08-26T00:09:23.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.941+0000 7f06ac000640 1 -- 172.21.15.42:0/3853812605 shutdown_connections 2024-08-26T00:09:23.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.941+0000 7f06ac000640 1 --2- 172.21.15.42:0/3853812605 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f06880a2c40 0x7f06880a5100 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.941+0000 7f06ac000640 1 --2- 172.21.15.42:0/3853812605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06a410d2d0 0x7f06a419e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.941+0000 7f06ac000640 1 --2- 172.21.15.42:0/3853812605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06a4108ba0 0x7f06a41a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.941+0000 7f06ac000640 1 --2- 172.21.15.42:0/3853812605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06a41081f0 0x7f06a41a4440 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:23.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.941+0000 7f06ac000640 1 -- 172.21.15.42:0/3853812605 >> 172.21.15.42:0/3853812605 conn(0x7f06a4077940 msgr2=0x7f06a4078c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:23.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.941+0000 7f06ac000640 1 -- 172.21.15.42:0/3853812605 shutdown_connections 2024-08-26T00:09:23.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:23.942+0000 7f06ac000640 1 -- 172.21.15.42:0/3853812605 wait complete. 2024-08-26T00:09:24.456 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:24 smithi042 ceph-mon[17225]: pgmap v545: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 23 MiB/s wr, 1.53k op/s 2024-08-26T00:09:24.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:24 smithi043 ceph-mon[22091]: pgmap v545: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 23 MiB/s wr, 1.53k op/s 2024-08-26T00:09:24.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:24 smithi181 ceph-mon[22102]: pgmap v545: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 23 MiB/s wr, 1.53k op/s 2024-08-26T00:09:24.770 INFO:tasks.cephfs.filesystem:scrub status for tag:c707f9d6-8409-4880-982d-664c114e9db4 - {'path': '/', 'tag': 'c707f9d6-8409-4880-982d-664c114e9db4', 'options': 'recursive,force'} 2024-08-26T00:09:26.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:26 smithi043 ceph-mon[22091]: pgmap v546: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 22 MiB/s wr, 1.57k op/s 2024-08-26T00:09:26.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:26 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:09:26.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:26 smithi042 ceph-mon[17225]: pgmap v546: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 22 MiB/s wr, 1.57k op/s 2024-08-26T00:09:26.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:26 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:09:26.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:26 smithi181 ceph-mon[22102]: pgmap v546: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 22 MiB/s wr, 1.57k op/s 2024-08-26T00:09:26.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:26 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:09:27.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:27 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:09:27.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:27 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:09:27.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:27 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:09:28.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:28 smithi043 ceph-mon[22091]: pgmap v547: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 21 MiB/s wr, 1.63k op/s 2024-08-26T00:09:28.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:28 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:09:28.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:28 smithi042 ceph-mon[17225]: pgmap v547: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 21 MiB/s wr, 1.63k op/s 2024-08-26T00:09:28.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:28 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:09:28.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:28 smithi181 ceph-mon[22102]: pgmap v547: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 21 MiB/s wr, 1.63k op/s 2024-08-26T00:09:28.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:28 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:09:30.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:30 smithi043 ceph-mon[22091]: pgmap v548: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 16 MiB/s wr, 1.44k op/s 2024-08-26T00:09:30.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:30 smithi042 ceph-mon[17225]: pgmap v548: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 16 MiB/s wr, 1.44k op/s 2024-08-26T00:09:30.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:30 smithi181 ceph-mon[22102]: pgmap v548: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 16 MiB/s wr, 1.44k op/s 2024-08-26T00:09:32.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:32 smithi043 ceph-mon[22091]: pgmap v549: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.3 MiB/s wr, 921 op/s 2024-08-26T00:09:32.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:32 smithi042 ceph-mon[17225]: pgmap v549: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.3 MiB/s wr, 921 op/s 2024-08-26T00:09:32.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:32 smithi181 ceph-mon[22102]: pgmap v549: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.3 MiB/s wr, 921 op/s 2024-08-26T00:09:34.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:34 smithi043 ceph-mon[22091]: pgmap v550: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 615 op/s 2024-08-26T00:09:34.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:34 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:09:34.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:34 smithi042 ceph-mon[17225]: pgmap v550: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 615 op/s 2024-08-26T00:09:34.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:34 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:09:34.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:34 smithi181 ceph-mon[22102]: pgmap v550: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 615 op/s 2024-08-26T00:09:34.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:34 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:09:35.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:35 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:09:35.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:35 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:09:35.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:35 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:09:35.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:35 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:09:35.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:35 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:09:35.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:35 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:09:36.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:36 smithi043 ceph-mon[22091]: pgmap v551: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 646 KiB/s wr, 385 op/s 2024-08-26T00:09:36.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:36 smithi042 ceph-mon[17225]: pgmap v551: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 646 KiB/s wr, 385 op/s 2024-08-26T00:09:36.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:36 smithi181 ceph-mon[22102]: pgmap v551: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 646 KiB/s wr, 385 op/s 2024-08-26T00:09:37.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:37 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:09:37.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:37 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:09:37.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:37 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:09:38.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:38 smithi043 ceph-mon[22091]: pgmap v552: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 17 KiB/s wr, 229 op/s 2024-08-26T00:09:38.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:38 smithi043 ceph-mon[22091]: Adjusting osd_memory_target on smithi043 to 177.0M 2024-08-26T00:09:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:38 smithi043 ceph-mon[22091]: Unable to set osd_memory_target on smithi043 to 185702092: error parsing value: Value '185702092' is below minimum 939524096 2024-08-26T00:09:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:09:38.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:09:38.512 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:09:38.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:38 smithi042 ceph-mon[17225]: pgmap v552: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 17 KiB/s wr, 229 op/s 2024-08-26T00:09:38.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:38 smithi042 ceph-mon[17225]: Adjusting osd_memory_target on smithi043 to 177.0M 2024-08-26T00:09:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:38 smithi042 ceph-mon[17225]: Unable to set osd_memory_target on smithi043 to 185702092: error parsing value: Value '185702092' is below minimum 939524096 2024-08-26T00:09:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:09:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:09:38.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:09:38.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:38 smithi181 ceph-mon[22102]: pgmap v552: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 17 KiB/s wr, 229 op/s 2024-08-26T00:09:38.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:38 smithi181 ceph-mon[22102]: Adjusting osd_memory_target on smithi043 to 177.0M 2024-08-26T00:09:38.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:38 smithi181 ceph-mon[22102]: Unable to set osd_memory_target on smithi043 to 185702092: error parsing value: Value '185702092' is below minimum 939524096 2024-08-26T00:09:38.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-26T00:09:38.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:09:38.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:09:38.536 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:09:39.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:39 smithi043 ceph-mon[22091]: Adjusting osd_memory_target on smithi181 to 176.0M 2024-08-26T00:09:39.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:39 smithi043 ceph-mon[22091]: Unable to set osd_memory_target on smithi181 to 184560947: error parsing value: Value '184560947' is below minimum 939524096 2024-08-26T00:09:39.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:39 smithi043 ceph-mon[22091]: Adjusting osd_memory_target on smithi042 to 177.5M 2024-08-26T00:09:39.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:39 smithi043 ceph-mon[22091]: Unable to set osd_memory_target on smithi042 to 186146508: error parsing value: Value '186146508' is below minimum 939524096 2024-08-26T00:09:39.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:39 smithi042 ceph-mon[17225]: Adjusting osd_memory_target on smithi181 to 176.0M 2024-08-26T00:09:39.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:39 smithi042 ceph-mon[17225]: Unable to set osd_memory_target on smithi181 to 184560947: error parsing value: Value '184560947' is below minimum 939524096 2024-08-26T00:09:39.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:39 smithi042 ceph-mon[17225]: Adjusting osd_memory_target on smithi042 to 177.5M 2024-08-26T00:09:39.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:39 smithi042 ceph-mon[17225]: Unable to set osd_memory_target on smithi042 to 186146508: error parsing value: Value '186146508' is below minimum 939524096 2024-08-26T00:09:39.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:39 smithi181 ceph-mon[22102]: Adjusting osd_memory_target on smithi181 to 176.0M 2024-08-26T00:09:39.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:39 smithi181 ceph-mon[22102]: Unable to set osd_memory_target on smithi181 to 184560947: error parsing value: Value '184560947' is below minimum 939524096 2024-08-26T00:09:39.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:39 smithi181 ceph-mon[22102]: Adjusting osd_memory_target on smithi042 to 177.5M 2024-08-26T00:09:39.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:39 smithi181 ceph-mon[22102]: Unable to set osd_memory_target on smithi042 to 186146508: error parsing value: Value '186146508' is below minimum 939524096 2024-08-26T00:09:40.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:40 smithi043 ceph-mon[22091]: pgmap v553: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 23 KiB/s wr, 119 op/s 2024-08-26T00:09:40.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:40 smithi042 ceph-mon[17225]: pgmap v553: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 23 KiB/s wr, 119 op/s 2024-08-26T00:09:40.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:40 smithi181 ceph-mon[22102]: pgmap v553: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 23 KiB/s wr, 119 op/s 2024-08-26T00:09:42.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:42 smithi043 ceph-mon[22091]: pgmap v554: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 365 KiB/s wr, 62 op/s 2024-08-26T00:09:42.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:42 smithi042 ceph-mon[17225]: pgmap v554: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 365 KiB/s wr, 62 op/s 2024-08-26T00:09:42.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:42 smithi181 ceph-mon[22102]: pgmap v554: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 365 KiB/s wr, 62 op/s 2024-08-26T00:09:44.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:44 smithi043 ceph-mon[22091]: pgmap v555: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1023 KiB/s wr, 75 op/s 2024-08-26T00:09:44.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:44 smithi042 ceph-mon[17225]: pgmap v555: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1023 KiB/s wr, 75 op/s 2024-08-26T00:09:44.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:44 smithi181 ceph-mon[22102]: pgmap v555: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1023 KiB/s wr, 75 op/s 2024-08-26T00:09:46.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:46 smithi043 ceph-mon[22091]: pgmap v556: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 1.7 MiB/s wr, 114 op/s 2024-08-26T00:09:46.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:46 smithi042 ceph-mon[17225]: pgmap v556: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 1.7 MiB/s wr, 114 op/s 2024-08-26T00:09:46.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:46 smithi181 ceph-mon[22102]: pgmap v556: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 1.7 MiB/s wr, 114 op/s 2024-08-26T00:09:48.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:48 smithi043 ceph-mon[22091]: pgmap v557: 97 pgs: 97 active+clean; 2.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 2.6 MiB/s wr, 166 op/s 2024-08-26T00:09:48.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:48 smithi042 ceph-mon[17225]: pgmap v557: 97 pgs: 97 active+clean; 2.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 2.6 MiB/s wr, 166 op/s 2024-08-26T00:09:48.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:48 smithi181 ceph-mon[22102]: pgmap v557: 97 pgs: 97 active+clean; 2.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 2.6 MiB/s wr, 166 op/s 2024-08-26T00:09:50.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:50 smithi043 ceph-mon[22091]: pgmap v558: 97 pgs: 97 active+clean; 2.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.6 MiB/s wr, 245 op/s 2024-08-26T00:09:50.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:50 smithi042 ceph-mon[17225]: pgmap v558: 97 pgs: 97 active+clean; 2.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.6 MiB/s wr, 245 op/s 2024-08-26T00:09:50.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:50 smithi181 ceph-mon[22102]: pgmap v558: 97 pgs: 97 active+clean; 2.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.6 MiB/s wr, 245 op/s 2024-08-26T00:09:52.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:52 smithi043 ceph-mon[22091]: pgmap v559: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.7 MiB/s wr, 323 op/s 2024-08-26T00:09:52.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:52 smithi042 ceph-mon[17225]: pgmap v559: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.7 MiB/s wr, 323 op/s 2024-08-26T00:09:52.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:52 smithi181 ceph-mon[22102]: pgmap v559: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.7 MiB/s wr, 323 op/s 2024-08-26T00:09:54.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:54 smithi043 ceph-mon[22091]: pgmap v560: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 324 op/s 2024-08-26T00:09:54.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:54 smithi042 ceph-mon[17225]: pgmap v560: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 324 op/s 2024-08-26T00:09:54.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:54 smithi181 ceph-mon[22102]: pgmap v560: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 324 op/s 2024-08-26T00:09:54.771 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-26T00:09:55.176 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:09:55.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.754+0000 7f52b6a00640 1 -- 172.21.15.42:0/3249584482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52b0074ce0 msgr2=0x7f52b010dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:55.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.754+0000 7f52b6a00640 1 --2- 172.21.15.42:0/3249584482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52b0074ce0 0x7f52b010dc20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5298009900 tx=0x7f529802a480 comp rx=0 tx=0).stop 2024-08-26T00:09:55.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.755+0000 7f52b6a00640 1 -- 172.21.15.42:0/3249584482 shutdown_connections 2024-08-26T00:09:55.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.755+0000 7f52b6a00640 1 --2- 172.21.15.42:0/3249584482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52b010e160 0x7f52b01105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.755+0000 7f52b6a00640 1 --2- 172.21.15.42:0/3249584482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52b0074ce0 0x7f52b010dc20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.755+0000 7f52b6a00640 1 --2- 172.21.15.42:0/3249584482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52b00743c0 0x7f52b00747a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.755+0000 7f52b6a00640 1 -- 172.21.15.42:0/3249584482 >> 172.21.15.42:0/3249584482 conn(0x7f52b00fd660 msgr2=0x7f52b00ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:55.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.755+0000 7f52b6a00640 1 -- 172.21.15.42:0/3249584482 shutdown_connections 2024-08-26T00:09:55.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.755+0000 7f52b6a00640 1 -- 172.21.15.42:0/3249584482 wait complete. 2024-08-26T00:09:55.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.755+0000 7f52b6a00640 1 Processor -- start 2024-08-26T00:09:55.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.756+0000 7f52b6a00640 1 -- start start 2024-08-26T00:09:55.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.756+0000 7f52b6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52b00743c0 0x7f52b019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.756+0000 7f52b6a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52b0074ce0 0x7f52b019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.756+0000 7f52b6a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52b010e160 0x7f52b019ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.756+0000 7f52b6a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f52b0113f60 con 0x7f52b00743c0 2024-08-26T00:09:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.756+0000 7f52b6a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f52b0113de0 con 0x7f52b010e160 2024-08-26T00:09:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.756+0000 7f52b6a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f52b01140e0 con 0x7f52b0074ce0 2024-08-26T00:09:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.756+0000 7f52afe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52b00743c0 0x7f52b019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.756+0000 7f52a7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52b0074ce0 0x7f52b019a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.756+0000 7f52afe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52b00743c0 0x7f52b019a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50976/0 (socket says 172.21.15.42:50976) 2024-08-26T00:09:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.756+0000 7f52afe00640 1 -- 172.21.15.42:0/975658280 learned_addr learned my addr 172.21.15.42:0/975658280 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.756+0000 7f52b4a00640 1 --2- 172.21.15.42:0/975658280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52b010e160 0x7f52b019ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.757+0000 7f52afe00640 1 -- 172.21.15.42:0/975658280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52b0074ce0 msgr2=0x7f52b019a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.757+0000 7f52afe00640 1 --2- 172.21.15.42:0/975658280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52b0074ce0 0x7f52b019a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.757+0000 7f52afe00640 1 -- 172.21.15.42:0/975658280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52b010e160 msgr2=0x7f52b019ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.757+0000 7f52afe00640 1 --2- 172.21.15.42:0/975658280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52b010e160 0x7f52b019ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.757+0000 7f52afe00640 1 -- 172.21.15.42:0/975658280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b019f430 con 0x7f52b00743c0 2024-08-26T00:09:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.757+0000 7f52b4a00640 1 --2- 172.21.15.42:0/975658280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52b010e160 0x7f52b019ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:09:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.757+0000 7f52afe00640 1 --2- 172.21.15.42:0/975658280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52b00743c0 0x7f52b019a480 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f52a000d770 tx=0x7f52a000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.757+0000 7f52ad600640 1 -- 172.21.15.42:0/975658280 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a0017070 con 0x7f52b00743c0 2024-08-26T00:09:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.757+0000 7f52b6a00640 1 -- 172.21.15.42:0/975658280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b019f720 con 0x7f52b00743c0 2024-08-26T00:09:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.757+0000 7f52ad600640 1 -- 172.21.15.42:0/975658280 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52a0005500 con 0x7f52b00743c0 2024-08-26T00:09:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.757+0000 7f52ad600640 1 -- 172.21.15.42:0/975658280 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a0004e00 con 0x7f52b00743c0 2024-08-26T00:09:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.758+0000 7f52b6a00640 1 -- 172.21.15.42:0/975658280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b01a7000 con 0x7f52b00743c0 2024-08-26T00:09:55.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.761+0000 7f52b95ea740 1 Processor -- start 2024-08-26T00:09:55.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.761+0000 7f52ad600640 1 -- 172.21.15.42:0/975658280 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f52a0004fa0 con 0x7f52b00743c0 2024-08-26T00:09:55.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.761+0000 7f52b95ea740 1 -- start start 2024-08-26T00:09:55.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.761+0000 7f52b95ea740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56069fbe2940 0x56069fbe2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:55.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.761+0000 7f52b95ea740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbe3260 0x56069fbed5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:55.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.761+0000 7f52b95ea740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56069fbedb20 0x56069fbeff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:55.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.761+0000 7f52b95ea740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56069fb48fc0 con 0x56069fbe3260 2024-08-26T00:09:55.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.761+0000 7f52b95ea740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56069fae0680 con 0x56069fbedb20 2024-08-26T00:09:55.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.761+0000 7f52b95ea740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56069fb44f80 con 0x56069fbe2940 2024-08-26T00:09:55.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.762+0000 7f52afe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbe3260 0x56069fbed5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:55.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.762+0000 7f52afe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbe3260 0x56069fbed5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50980/0 (socket says 172.21.15.42:50980) 2024-08-26T00:09:55.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.762+0000 7f52afe00640 1 -- 172.21.15.42:0/3511329033 learned_addr learned my addr 172.21.15.42:0/3511329033 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:55.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.762+0000 7f52b4a00640 1 --2- 172.21.15.42:0/3511329033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56069fbe2940 0x56069fbe2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:55.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.762+0000 7f52a7e00640 1 --2- 172.21.15.42:0/3511329033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56069fbedb20 0x56069fbeff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:55.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.762+0000 7f52afe00640 1 -- 172.21.15.42:0/3511329033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56069fbe2940 msgr2=0x56069fbe2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:55.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.762+0000 7f52afe00640 1 --2- 172.21.15.42:0/3511329033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56069fbe2940 0x56069fbe2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.762+0000 7f52afe00640 1 -- 172.21.15.42:0/3511329033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56069fbedb20 msgr2=0x56069fbeff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:55.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.762+0000 7f52afe00640 1 --2- 172.21.15.42:0/3511329033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56069fbedb20 0x56069fbeff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.762+0000 7f52afe00640 1 -- 172.21.15.42:0/3511329033 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56069fafc2c0 con 0x56069fbe3260 2024-08-26T00:09:55.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.763+0000 7f52afe00640 1 --2- 172.21.15.42:0/3511329033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbe3260 0x56069fbed5e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f52a00d2c30 tx=0x7f52a00d7550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e477c22c52fe6134 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:55.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.763+0000 7f52a5200640 1 -- 172.21.15.42:0/3511329033 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a00dc600 con 0x56069fbe3260 2024-08-26T00:09:55.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.763+0000 7f52a5200640 1 -- 172.21.15.42:0/3511329033 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52a00d8040 con 0x56069fbe3260 2024-08-26T00:09:55.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.763+0000 7f52ad600640 1 --2- 172.21.15.42:0/975658280 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f52940a2b80 0x7f52940a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:55.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.763+0000 7f52a5200640 1 -- 172.21.15.42:0/3511329033 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a00db850 con 0x56069fbe3260 2024-08-26T00:09:55.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.763+0000 7f52ad600640 1 -- 172.21.15.42:0/975658280 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f52a00ceb00 con 0x7f52b00743c0 2024-08-26T00:09:55.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.763+0000 7f52b4a00640 1 --2- 172.21.15.42:0/975658280 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f52940a2b80 0x7f52940a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:55.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.764+0000 7f52b95ea740 1 -- 172.21.15.42:0/3511329033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbe3260 msgr2=0x56069fbed5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:55.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.764+0000 7f52b95ea740 1 --2- 172.21.15.42:0/3511329033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbe3260 0x56069fbed5e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f52a00d2c30 tx=0x7f52a00d7550 comp rx=0 tx=0).stop 2024-08-26T00:09:55.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.764+0000 7f52b95ea740 1 -- 172.21.15.42:0/3511329033 shutdown_connections 2024-08-26T00:09:55.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.764+0000 7f52b95ea740 1 --2- 172.21.15.42:0/3511329033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56069fbedb20 0x56069fbeff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.764+0000 7f52b95ea740 1 --2- 172.21.15.42:0/3511329033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbe3260 0x56069fbed5e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.764+0000 7f52b95ea740 1 --2- 172.21.15.42:0/3511329033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56069fbe2940 0x56069fbe2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.764+0000 7f52b95ea740 1 -- 172.21.15.42:0/3511329033 >> 172.21.15.42:0/3511329033 conn(0x56069fbdeed0 msgr2=0x56069fbdf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:55.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.764+0000 7f52b95ea740 1 -- 172.21.15.42:0/3511329033 shutdown_connections 2024-08-26T00:09:55.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.764+0000 7f52b95ea740 1 -- 172.21.15.42:0/3511329033 wait complete. 2024-08-26T00:09:55.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.764+0000 7f52b4a00640 1 --2- 172.21.15.42:0/975658280 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f52940a2b80 0x7f52940a5040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f52a8005fd0 tx=0x7f52a8009820 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:55.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.764+0000 7f52b95ea740 1 -- start start 2024-08-26T00:09:55.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.765+0000 7f52b95ea740 1 Processor -- start 2024-08-26T00:09:55.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.765+0000 7f52b95ea740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56069fbe2940 0x56069fbea9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:55.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.765+0000 7f52b95ea740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56069fbe3260 0x56069fbeaee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:55.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.765+0000 7f52b95ea740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbedb20 0x56069fbeb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:55.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.765+0000 7f52b95ea740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56069fbf06f0 con 0x56069fbedb20 2024-08-26T00:09:55.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.765+0000 7f52b95ea740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56069fb03e50 con 0x56069fbe3260 2024-08-26T00:09:55.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.765+0000 7f52b95ea740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56069fbf0870 con 0x56069fbe2940 2024-08-26T00:09:55.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.765+0000 7f52b95ea740 10 client.0 _ll_register_callbacks cb 0x56069faeef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:09:55.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.765+0000 7f52afe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56069fbe2940 0x56069fbea9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:55.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.765+0000 7f52afe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56069fbe2940 0x56069fbea9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:39074/0 (socket says 172.21.15.42:39074) 2024-08-26T00:09:55.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.765+0000 7f52afe00640 1 -- 172.21.15.42:0/527154827 learned_addr learned my addr 172.21.15.42:0/527154827 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:55.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.766+0000 7f52a7e00640 1 --2- 172.21.15.42:0/527154827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56069fbe3260 0x56069fbeaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:55.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.766+0000 7f52b4a00640 1 --2- 172.21.15.42:0/527154827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbedb20 0x56069fbeb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:55.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.766+0000 7f52afe00640 1 -- 172.21.15.42:0/527154827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56069fbe3260 msgr2=0x56069fbeaee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:55.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.766+0000 7f52afe00640 1 --2- 172.21.15.42:0/527154827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56069fbe3260 0x56069fbeaee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.766+0000 7f52afe00640 1 -- 172.21.15.42:0/527154827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbedb20 msgr2=0x56069fbeb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:55.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.766+0000 7f52afe00640 1 --2- 172.21.15.42:0/527154827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbedb20 0x56069fbeb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.766+0000 7f52afe00640 1 -- 172.21.15.42:0/527154827 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56069f8ba3c0 con 0x56069fbe2940 2024-08-26T00:09:55.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.766+0000 7f52b4a00640 1 --2- 172.21.15.42:0/527154827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbedb20 0x56069fbeb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:09:55.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.766+0000 7f52afe00640 1 --2- 172.21.15.42:0/527154827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56069fbe2940 0x56069fbea9a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f52a0097cf0 tx=0x7f52a00d2740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e21d4c3e5a7f7dfe server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:55.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.766+0000 7f529d600640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:09:55.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.766+0000 7f529d600640 1 -- 172.21.15.42:0/527154827 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a0020050 con 0x56069fbe2940 2024-08-26T00:09:55.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.766+0000 7f52b95ea740 1 -- 172.21.15.42:0/527154827 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52a00d8040 con 0x56069fbe2940 2024-08-26T00:09:55.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.766+0000 7f529d600640 1 -- 172.21.15.42:0/527154827 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f52a0099620 con 0x56069fbe2940 2024-08-26T00:09:55.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.767+0000 7f529d600640 1 -- 172.21.15.42:0/527154827 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f52a00975c0 con 0x56069fbe2940 2024-08-26T00:09:55.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.767+0000 7f52b95ea740 10 client.25717 fetch_fsmap learned FSMap version 29 2024-08-26T00:09:55.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.767+0000 7f52b95ea740 1 -- 172.21.15.42:0/527154827 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56069fbf06f0 con 0x56069fbe2940 2024-08-26T00:09:55.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.767+0000 7f529d600640 1 -- 172.21.15.42:0/527154827 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52a00d8040 con 0x56069fbe2940 2024-08-26T00:09:55.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.767+0000 7f529d600640 1 -- 172.21.15.42:0/527154827 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f52a0097990 con 0x56069fbe2940 2024-08-26T00:09:55.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.767+0000 7f52b95ea740 10 client.25717 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:09:55.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.767+0000 7f52b95ea740 10 client.25717 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:09:55.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.767+0000 7f52b95ea740 20 client.25717 populate_metadata read hostname 'smithi042' 2024-08-26T00:09:55.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.767+0000 7f52b95ea740 1 --2- 172.21.15.42:0/527154827 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x56069fbfd4b0 0x56069fbff8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:55.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.767+0000 7f52b95ea740 4 client.25717 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:09:55.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.767+0000 7f52b95ea740 1 -- 172.21.15.42:0/527154827 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56069fb56530 con 0x56069fbfd4b0 2024-08-26T00:09:55.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.768+0000 7f52a7e00640 1 --2- 172.21.15.42:0/527154827 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x56069fbfd4b0 0x56069fbff8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:55.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.768+0000 7f52a7e00640 1 --2- 172.21.15.42:0/527154827 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x56069fbfd4b0 0x56069fbff8a0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cd620ae689f1d2c server_cookie=bfb20ac004fa6ef8 in_seq=0 out_seq=0 2024-08-26T00:09:55.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.768+0000 7f529d600640 10 client.25717 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:09:55.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.769+0000 7f529d600640 1 -- 172.21.15.42:0/527154827 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56069fb56530 con 0x56069fbfd4b0 2024-08-26T00:09:55.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.769+0000 7f529d600640 10 client.25717 handle_command_reply: tid=0 2024-08-26T00:09:55.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.769+0000 7f52b95ea740 1 client.25717 shutdown 2024-08-26T00:09:55.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.769+0000 7f52b95ea740 1 -- 172.21.15.42:0/527154827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56069fbe2940 msgr2=0x56069fbea9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:55.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.769+0000 7f52b95ea740 1 --2- 172.21.15.42:0/527154827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56069fbe2940 0x56069fbea9a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f52a0097cf0 tx=0x7f52a00d2740 comp rx=0 tx=0).stop 2024-08-26T00:09:55.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.769+0000 7f52b95ea740 1 -- 172.21.15.42:0/527154827 shutdown_connections 2024-08-26T00:09:55.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.769+0000 7f52b95ea740 1 --2- 172.21.15.42:0/527154827 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x56069fbfd4b0 0x56069fbff8a0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.769+0000 7f52b95ea740 1 --2- 172.21.15.42:0/527154827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbedb20 0x56069fbeb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.769+0000 7f52b95ea740 1 --2- 172.21.15.42:0/527154827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56069fbe3260 0x56069fbeaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.769+0000 7f52b95ea740 1 --2- 172.21.15.42:0/527154827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56069fbe2940 0x56069fbea9a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.769+0000 7f529d600640 0 client.25717 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:09:55.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.769+0000 7f52b95ea740 1 -- 172.21.15.42:0/527154827 >> 172.21.15.42:0/527154827 conn(0x56069fbdeed0 msgr2=0x56069fbde050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:55.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.770+0000 7f52b95ea740 1 -- 172.21.15.42:0/527154827 shutdown_connections 2024-08-26T00:09:55.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.770+0000 7f52b95ea740 1 -- 172.21.15.42:0/527154827 wait complete. 2024-08-26T00:09:55.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.770+0000 7f52b95ea740 20 client.25717 trim_cache size 0 max 16384 2024-08-26T00:09:55.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.788+0000 7f52b95ea740 1 Processor -- start 2024-08-26T00:09:55.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.788+0000 7f52b95ea740 1 -- start start 2024-08-26T00:09:55.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.788+0000 7f52b95ea740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56069fbe2940 0x56069fbe53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:55.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.788+0000 7f52b95ea740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56069fbe3260 0x56069fc04f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:55.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.788+0000 7f52b95ea740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbedb20 0x56069fc05440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:55.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.788+0000 7f52b95ea740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f52b01b1f70 con 0x56069fbedb20 2024-08-26T00:09:55.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.788+0000 7f52b95ea740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f52b01af780 con 0x56069fbe2940 2024-08-26T00:09:55.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.788+0000 7f52b95ea740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f52b01ad5b0 con 0x56069fbe3260 2024-08-26T00:09:55.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.788+0000 7f52b4a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbedb20 0x56069fc05440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:55.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.788+0000 7f52b4a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbedb20 0x56069fc05440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50998/0 (socket says 172.21.15.42:50998) 2024-08-26T00:09:55.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.788+0000 7f52b4a00640 1 -- 172.21.15.42:0/2938552359 learned_addr learned my addr 172.21.15.42:0/2938552359 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:55.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.789+0000 7f52afe00640 1 --2- 172.21.15.42:0/2938552359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56069fbe2940 0x56069fbe53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:55.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.789+0000 7f52a7e00640 1 --2- 172.21.15.42:0/2938552359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56069fbe3260 0x56069fc04f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:55.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.789+0000 7f52b4a00640 1 -- 172.21.15.42:0/2938552359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56069fbe3260 msgr2=0x56069fc04f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:55.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.789+0000 7f52b4a00640 1 --2- 172.21.15.42:0/2938552359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56069fbe3260 0x56069fc04f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.789+0000 7f52b4a00640 1 -- 172.21.15.42:0/2938552359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56069fbe2940 msgr2=0x56069fbe53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:55.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.789+0000 7f52b4a00640 1 --2- 172.21.15.42:0/2938552359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56069fbe2940 0x56069fbe53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.789+0000 7f52b4a00640 1 -- 172.21.15.42:0/2938552359 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56069fbed310 con 0x56069fbedb20 2024-08-26T00:09:55.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.789+0000 7f52afe00640 1 --2- 172.21.15.42:0/2938552359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56069fbe2940 0x56069fbe53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:09:55.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.789+0000 7f52b4a00640 1 --2- 172.21.15.42:0/2938552359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbedb20 0x56069fc05440 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009740 tx=0x7f52a8012f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79df0d605e5404a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:55.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.790+0000 7f529fe00640 1 -- 172.21.15.42:0/2938552359 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a8020850 con 0x56069fbedb20 2024-08-26T00:09:55.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.790+0000 7f529fe00640 1 -- 172.21.15.42:0/2938552359 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52a801c420 con 0x56069fbedb20 2024-08-26T00:09:55.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.790+0000 7f529fe00640 1 -- 172.21.15.42:0/2938552359 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a8028640 con 0x56069fbedb20 2024-08-26T00:09:55.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.790+0000 7f52b95ea740 1 -- 172.21.15.42:0/2938552359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbedb20 msgr2=0x56069fc05440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:55.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.790+0000 7f52b95ea740 1 --2- 172.21.15.42:0/2938552359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbedb20 0x56069fc05440 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009740 tx=0x7f52a8012f90 comp rx=0 tx=0).stop 2024-08-26T00:09:55.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.790+0000 7f52b95ea740 1 -- 172.21.15.42:0/2938552359 shutdown_connections 2024-08-26T00:09:55.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.790+0000 7f52b95ea740 1 --2- 172.21.15.42:0/2938552359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbedb20 0x56069fc05440 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.790+0000 7f52b95ea740 1 --2- 172.21.15.42:0/2938552359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56069fbe3260 0x56069fc04f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.790+0000 7f52b95ea740 1 --2- 172.21.15.42:0/2938552359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56069fbe2940 0x56069fbe53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.790+0000 7f52b95ea740 1 -- 172.21.15.42:0/2938552359 >> 172.21.15.42:0/2938552359 conn(0x56069fbdeed0 msgr2=0x56069fbe9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:55.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.790+0000 7f52b95ea740 1 -- 172.21.15.42:0/2938552359 shutdown_connections 2024-08-26T00:09:55.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.790+0000 7f52b95ea740 1 -- 172.21.15.42:0/2938552359 wait complete. 2024-08-26T00:09:55.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.791+0000 7f52b95ea740 1 -- start start 2024-08-26T00:09:55.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.791+0000 7f52b95ea740 1 Processor -- start 2024-08-26T00:09:55.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.791+0000 7f52b95ea740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56069fbe2940 0x56069fbf5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:55.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.791+0000 7f52b95ea740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56069fbe3260 0x56069fbf6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:55.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.791+0000 7f52b95ea740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbedb20 0x56069fbe6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:55.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.791+0000 7f52b95ea740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f52b01adc40 con 0x56069fbedb20 2024-08-26T00:09:55.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.791+0000 7f52b95ea740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f52b01af0b0 con 0x56069fbe3260 2024-08-26T00:09:55.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.791+0000 7f52b95ea740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f52b01ae310 con 0x56069fbe2940 2024-08-26T00:09:55.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.791+0000 7f52b95ea740 10 client.0 _ll_register_callbacks cb 0x7f5298005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:09:55.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.792+0000 7f52b4a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbedb20 0x56069fbe6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:55.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.792+0000 7f52b4a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbedb20 0x56069fbe6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51008/0 (socket says 172.21.15.42:51008) 2024-08-26T00:09:55.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.792+0000 7f52afe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56069fbe2940 0x56069fbf5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:55.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.792+0000 7f52b4a00640 1 -- 172.21.15.42:0/1449744988 learned_addr learned my addr 172.21.15.42:0/1449744988 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.792+0000 7f52a7e00640 1 --2- 172.21.15.42:0/1449744988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56069fbe3260 0x56069fbf6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.792+0000 7f52b4a00640 1 -- 172.21.15.42:0/1449744988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56069fbe2940 msgr2=0x56069fbf5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.792+0000 7f52b4a00640 1 --2- 172.21.15.42:0/1449744988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56069fbe2940 0x56069fbf5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.792+0000 7f52b4a00640 1 -- 172.21.15.42:0/1449744988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56069fbe3260 msgr2=0x56069fbf6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.792+0000 7f52b4a00640 1 --2- 172.21.15.42:0/1449744988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56069fbe3260 0x56069fbf6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.792+0000 7f52b4a00640 1 -- 172.21.15.42:0/1449744988 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56069fbe7540 con 0x56069fbedb20 2024-08-26T00:09:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.792+0000 7f52afe00640 1 --2- 172.21.15.42:0/1449744988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56069fbe2940 0x56069fbf5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:09:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.792+0000 7f52b4a00640 1 --2- 172.21.15.42:0/1449744988 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbedb20 0x56069fbe6fd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f52a801c800 tx=0x7f52a801cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d112b2c400e55f9a server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.792+0000 7f529d600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:09:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.793+0000 7f529d600640 1 -- 172.21.15.42:0/1449744988 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a8036020 con 0x56069fbedb20 2024-08-26T00:09:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.793+0000 7f529d600640 1 -- 172.21.15.42:0/1449744988 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f52a8004c40 con 0x56069fbedb20 2024-08-26T00:09:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.793+0000 7f52b95ea740 1 -- 172.21.15.42:0/1449744988 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52a801c420 con 0x56069fbedb20 2024-08-26T00:09:55.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.793+0000 7f529d600640 1 -- 172.21.15.42:0/1449744988 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f52a802e040 con 0x56069fbedb20 2024-08-26T00:09:55.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.793+0000 7f52b95ea740 10 client.15672 fetch_fsmap learned FSMap version 29 2024-08-26T00:09:55.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.793+0000 7f52b95ea740 1 -- 172.21.15.42:0/1449744988 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56069fc67740 con 0x56069fbedb20 2024-08-26T00:09:55.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.793+0000 7f529d600640 1 -- 172.21.15.42:0/1449744988 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52a801c420 con 0x56069fbedb20 2024-08-26T00:09:55.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.794+0000 7f529d600640 1 -- 172.21.15.42:0/1449744988 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f52a8031030 con 0x56069fbedb20 2024-08-26T00:09:55.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.794+0000 7f52b95ea740 10 client.15672 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:09:55.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.794+0000 7f52b95ea740 10 client.15672 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:09:55.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.794+0000 7f52b95ea740 20 client.15672 populate_metadata read hostname 'smithi042' 2024-08-26T00:09:55.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.794+0000 7f52b95ea740 1 --2- 172.21.15.42:0/1449744988 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x56069fc67e60 0x56069fc6a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:55.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.794+0000 7f52b95ea740 4 client.15672 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-26T00:09:55.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.794+0000 7f52b95ea740 1 -- 172.21.15.42:0/1449744988 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56069fb50a40 con 0x56069fc67e60 2024-08-26T00:09:55.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.794+0000 7f52afe00640 1 --2- 172.21.15.42:0/1449744988 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x56069fc67e60 0x56069fc6a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:55.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.794+0000 7f52afe00640 1 --2- 172.21.15.42:0/1449744988 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x56069fc67e60 0x56069fc6a280 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b957207f28d36ea9 server_cookie=d0774205c9458e0f in_seq=0 out_seq=0 2024-08-26T00:09:55.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.794+0000 7f529d600640 10 client.15672 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:09:55.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.795+0000 7f529d600640 1 -- 172.21.15.42:0/1449744988 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56069fb50a40 con 0x56069fc67e60 2024-08-26T00:09:55.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.795+0000 7f529d600640 10 client.15672 handle_command_reply: tid=0 2024-08-26T00:09:55.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.795+0000 7f52b95ea740 1 client.15672 shutdown 2024-08-26T00:09:55.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.795+0000 7f52b95ea740 1 -- 172.21.15.42:0/1449744988 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbedb20 msgr2=0x56069fbe6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:55.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.795+0000 7f52b95ea740 1 --2- 172.21.15.42:0/1449744988 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbedb20 0x56069fbe6fd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f52a801c800 tx=0x7f52a801cb80 comp rx=0 tx=0).stop 2024-08-26T00:09:55.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.795+0000 7f52b95ea740 1 -- 172.21.15.42:0/1449744988 shutdown_connections 2024-08-26T00:09:55.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.795+0000 7f52b95ea740 1 --2- 172.21.15.42:0/1449744988 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x56069fc67e60 0x56069fc6a280 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.795+0000 7f52b95ea740 1 --2- 172.21.15.42:0/1449744988 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56069fbedb20 0x56069fbe6fd0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.795+0000 7f52b95ea740 1 --2- 172.21.15.42:0/1449744988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56069fbe3260 0x56069fbf6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.795+0000 7f52b95ea740 1 --2- 172.21.15.42:0/1449744988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56069fbe2940 0x56069fbf5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.795+0000 7f529d600640 0 client.15672 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:09:55.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.795+0000 7f52b95ea740 1 -- 172.21.15.42:0/1449744988 >> 172.21.15.42:0/1449744988 conn(0x56069fbdeed0 msgr2=0x56069fbec200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:55.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.795+0000 7f52b95ea740 1 -- 172.21.15.42:0/1449744988 shutdown_connections 2024-08-26T00:09:55.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.795+0000 7f52b95ea740 1 -- 172.21.15.42:0/1449744988 wait complete. 2024-08-26T00:09:55.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.795+0000 7f52b95ea740 20 client.15672 trim_cache size 0 max 16384 2024-08-26T00:09:55.800 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:09:55.800 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-08-26T00:09:55.800 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {} 2024-08-26T00:09:55.800 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:09:55.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.796+0000 7f52b6a00640 1 -- 172.21.15.42:0/975658280 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f52940a2b80 msgr2=0x7f52940a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:55.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.796+0000 7f52b6a00640 1 --2- 172.21.15.42:0/975658280 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f52940a2b80 0x7f52940a5040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f52a8005fd0 tx=0x7f52a8009820 comp rx=0 tx=0).stop 2024-08-26T00:09:55.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.796+0000 7f52b6a00640 1 -- 172.21.15.42:0/975658280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52b00743c0 msgr2=0x7f52b019a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:55.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.796+0000 7f52b6a00640 1 --2- 172.21.15.42:0/975658280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52b00743c0 0x7f52b019a480 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f52a000d770 tx=0x7f52a000dc30 comp rx=0 tx=0).stop 2024-08-26T00:09:55.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.796+0000 7f52b6a00640 1 -- 172.21.15.42:0/975658280 shutdown_connections 2024-08-26T00:09:55.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.796+0000 7f52b6a00640 1 --2- 172.21.15.42:0/975658280 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f52940a2b80 0x7f52940a5040 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.796+0000 7f52b6a00640 1 --2- 172.21.15.42:0/975658280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52b010e160 0x7f52b019ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.796+0000 7f52b6a00640 1 --2- 172.21.15.42:0/975658280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52b0074ce0 0x7f52b019a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.796+0000 7f52b6a00640 1 --2- 172.21.15.42:0/975658280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52b00743c0 0x7f52b019a480 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:55.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.796+0000 7f52b6a00640 1 -- 172.21.15.42:0/975658280 >> 172.21.15.42:0/975658280 conn(0x7f52b00fd660 msgr2=0x7f52b00fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:55.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.796+0000 7f52b6a00640 1 -- 172.21.15.42:0/975658280 shutdown_connections 2024-08-26T00:09:55.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:55.796+0000 7f52b6a00640 1 -- 172.21.15.42:0/975658280 wait complete. 2024-08-26T00:09:56.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:56 smithi043 ceph-mon[22091]: pgmap v561: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 284 op/s 2024-08-26T00:09:56.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:56 smithi042 ceph-mon[17225]: pgmap v561: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 284 op/s 2024-08-26T00:09:56.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:56 smithi181 ceph-mon[22102]: pgmap v561: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 284 op/s 2024-08-26T00:09:56.676 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-26T00:09:56.676 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:09:57.056 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:09:57.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.605+0000 7f6feba00640 1 -- 172.21.15.42:0/2299595220 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6fe40764c0 msgr2=0x7f6fe40768a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:57.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.605+0000 7f6feba00640 1 --2- 172.21.15.42:0/2299595220 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6fe40764c0 0x7f6fe40768a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8009900 tx=0x7f6fd802a410 comp rx=0 tx=0).stop 2024-08-26T00:09:57.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.605+0000 7f6feba00640 1 -- 172.21.15.42:0/2299595220 shutdown_connections 2024-08-26T00:09:57.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.605+0000 7f6feba00640 1 --2- 172.21.15.42:0/2299595220 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fe41127f0 0x7f6fe4114be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:57.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.605+0000 7f6feba00640 1 --2- 172.21.15.42:0/2299595220 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe4076de0 0x7f6fe41122b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:57.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.605+0000 7f6feba00640 1 --2- 172.21.15.42:0/2299595220 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6fe40764c0 0x7f6fe40768a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:57.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.605+0000 7f6feba00640 1 -- 172.21.15.42:0/2299595220 >> 172.21.15.42:0/2299595220 conn(0x7f6fe40ff7f0 msgr2=0x7f6fe4101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:57.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.605+0000 7f6feba00640 1 -- 172.21.15.42:0/2299595220 shutdown_connections 2024-08-26T00:09:57.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.605+0000 7f6feba00640 1 -- 172.21.15.42:0/2299595220 wait complete. 2024-08-26T00:09:57.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.606+0000 7f6feba00640 1 Processor -- start 2024-08-26T00:09:57.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.606+0000 7f6feba00640 1 -- start start 2024-08-26T00:09:57.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.607+0000 7f6feba00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fe40764c0 0x7f6fe41a4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:57.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.607+0000 7f6feba00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe4076de0 0x7f6fe41a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:57.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.607+0000 7f6feba00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6fe41127f0 0x7f6fe419e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:57.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.607+0000 7f6feba00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe4118380 con 0x7f6fe41127f0 2024-08-26T00:09:57.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.607+0000 7f6feba00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe4118200 con 0x7f6fe4076de0 2024-08-26T00:09:57.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.607+0000 7f6feba00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe4118500 con 0x7f6fe40764c0 2024-08-26T00:09:57.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.607+0000 7f6fe9a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6fe41127f0 0x7f6fe419e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:57.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.607+0000 7f6fe9000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fe40764c0 0x7f6fe41a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:57.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.607+0000 7f6fe9a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6fe41127f0 0x7f6fe419e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51036/0 (socket says 172.21.15.42:51036) 2024-08-26T00:09:57.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.607+0000 7f6fe9000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fe40764c0 0x7f6fe41a4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:39102/0 (socket says 172.21.15.42:39102) 2024-08-26T00:09:57.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.607+0000 7f6fe9a00640 1 -- 172.21.15.42:0/1147016011 learned_addr learned my addr 172.21.15.42:0/1147016011 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:57.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.607+0000 7f6fe3e00640 1 --2- 172.21.15.42:0/1147016011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe4076de0 0x7f6fe41a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:57.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.608+0000 7f6fe9a00640 1 -- 172.21.15.42:0/1147016011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fe40764c0 msgr2=0x7f6fe41a4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:57.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.608+0000 7f6fe9a00640 1 --2- 172.21.15.42:0/1147016011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fe40764c0 0x7f6fe41a4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:57.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.608+0000 7f6fe9a00640 1 -- 172.21.15.42:0/1147016011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe4076de0 msgr2=0x7f6fe41a4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:57.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.608+0000 7f6fe9a00640 1 --2- 172.21.15.42:0/1147016011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe4076de0 0x7f6fe41a4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:57.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.608+0000 7f6fe9a00640 1 -- 172.21.15.42:0/1147016011 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe419ef70 con 0x7f6fe41127f0 2024-08-26T00:09:57.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.608+0000 7f6fe3e00640 1 --2- 172.21.15.42:0/1147016011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe4076de0 0x7f6fe41a4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:09:57.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.608+0000 7f6fe9a00640 1 --2- 172.21.15.42:0/1147016011 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6fe41127f0 0x7f6fe419e700 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00eb10 tx=0x7f6fdc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:57.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.608+0000 7f6fe1600640 1 -- 172.21.15.42:0/1147016011 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc004b20 con 0x7f6fe41127f0 2024-08-26T00:09:57.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.608+0000 7f6fe1600640 1 -- 172.21.15.42:0/1147016011 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fdc004cc0 con 0x7f6fe41127f0 2024-08-26T00:09:57.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.609+0000 7f6feba00640 1 -- 172.21.15.42:0/1147016011 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe419f260 con 0x7f6fe41127f0 2024-08-26T00:09:57.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.609+0000 7f6fe1600640 1 -- 172.21.15.42:0/1147016011 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc010790 con 0x7f6fe41127f0 2024-08-26T00:09:57.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.609+0000 7f6feba00640 1 -- 172.21.15.42:0/1147016011 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fe41ab5b0 con 0x7f6fe41127f0 2024-08-26T00:09:57.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.610+0000 7f6feba00640 1 -- 172.21.15.42:0/1147016011 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fe4077c00 con 0x7f6fe41127f0 2024-08-26T00:09:57.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.612+0000 7f6fe1600640 1 -- 172.21.15.42:0/1147016011 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6fdc005020 con 0x7f6fe41127f0 2024-08-26T00:09:57.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.613+0000 7f6fe1600640 1 --2- 172.21.15.42:0/1147016011 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f6fcc0a2b80 0x7f6fcc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:57.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.613+0000 7f6fe1600640 1 -- 172.21.15.42:0/1147016011 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f6fdc0cf730 con 0x7f6fe41127f0 2024-08-26T00:09:57.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.614+0000 7f6fe9000640 1 --2- 172.21.15.42:0/1147016011 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f6fcc0a2b80 0x7f6fcc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:57.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.615+0000 7f6fe9000640 1 --2- 172.21.15.42:0/1147016011 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f6fcc0a2b80 0x7f6fcc0a5040 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8009230 tx=0x7f6fd80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:57.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.618+0000 7f6fe1600640 1 -- 172.21.15.42:0/1147016011 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6fdc09c650 con 0x7f6fe41127f0 2024-08-26T00:09:57.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.845+0000 7f6feba00640 1 -- 172.21.15.42:0/1147016011 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6fe410d980 con 0x7f6fe41127f0 2024-08-26T00:09:57.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.846+0000 7f6fe1600640 1 -- 172.21.15.42:0/1147016011 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11918 (secure 0 0 0) 0x7f6fdc09bf50 con 0x7f6fe41127f0 2024-08-26T00:09:57.847 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:09:57.847 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":29,"btime":"2024-08-26T00:06:29:181606+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3168581452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3168581452},{"type":"v1","addr":"172.21.15.42:6839","nonce":3168581452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/3533492491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":3533492491},{"type":"v1","addr":"172.21.15.42:6841","nonce":3533492491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-26T00:00:30.169633+0000","modified":"2024-08-26T00:06:28.596366+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24532,"mds_1":24527,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6839/2653014277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2653014277},{"type":"v1","addr":"172.21.15.43:6839","nonce":2653014277}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24532,"qdb_cluster":[24514,24527,24532]},"id":1}]} 2024-08-26T00:09:57.847 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 29 2024-08-26T00:09:57.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.849+0000 7f6feba00640 1 -- 172.21.15.42:0/1147016011 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f6fcc0a2b80 msgr2=0x7f6fcc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:57.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.849+0000 7f6feba00640 1 --2- 172.21.15.42:0/1147016011 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f6fcc0a2b80 0x7f6fcc0a5040 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8009230 tx=0x7f6fd80058d0 comp rx=0 tx=0).stop 2024-08-26T00:09:57.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.849+0000 7f6feba00640 1 -- 172.21.15.42:0/1147016011 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6fe41127f0 msgr2=0x7f6fe419e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:57.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.849+0000 7f6feba00640 1 --2- 172.21.15.42:0/1147016011 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6fe41127f0 0x7f6fe419e700 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00eb10 tx=0x7f6fdc00c2d0 comp rx=0 tx=0).stop 2024-08-26T00:09:57.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.849+0000 7f6feba00640 1 -- 172.21.15.42:0/1147016011 shutdown_connections 2024-08-26T00:09:57.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.849+0000 7f6feba00640 1 --2- 172.21.15.42:0/1147016011 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f6fcc0a2b80 0x7f6fcc0a5040 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:57.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.849+0000 7f6feba00640 1 --2- 172.21.15.42:0/1147016011 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6fe41127f0 0x7f6fe419e700 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:57.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.849+0000 7f6feba00640 1 --2- 172.21.15.42:0/1147016011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe4076de0 0x7f6fe41a4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:57.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.849+0000 7f6feba00640 1 --2- 172.21.15.42:0/1147016011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fe40764c0 0x7f6fe41a4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:57.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.849+0000 7f6feba00640 1 -- 172.21.15.42:0/1147016011 >> 172.21.15.42:0/1147016011 conn(0x7f6fe40ff7f0 msgr2=0x7f6fe41145b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:57.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.850+0000 7f6feba00640 1 -- 172.21.15.42:0/1147016011 shutdown_connections 2024-08-26T00:09:57.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:57.850+0000 7f6feba00640 1 -- 172.21.15.42:0/1147016011 wait complete. 2024-08-26T00:09:58.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:58 smithi043 ceph-mon[22091]: pgmap v562: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 245 op/s 2024-08-26T00:09:58.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:09:58 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1147016011' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:09:58.527 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:58 smithi042 ceph-mon[17225]: pgmap v562: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 245 op/s 2024-08-26T00:09:58.527 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:09:58 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1147016011' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:09:58.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:58 smithi181 ceph-mon[22102]: pgmap v562: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 245 op/s 2024-08-26T00:09:58.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:09:58 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1147016011' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:09:58.567 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-26T00:09:58.959 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:09:59.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.514+0000 7f0bfcc00640 1 -- 172.21.15.42:0/1361319781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bf8103b50 msgr2=0x7f0bf8103fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:59.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.514+0000 7f0bfcc00640 1 --2- 172.21.15.42:0/1361319781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bf8103b50 0x7f0bf8103fb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009900 tx=0x7f0be002a3f0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.514+0000 7f0bfcc00640 1 -- 172.21.15.42:0/1361319781 shutdown_connections 2024-08-26T00:09:59.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.514+0000 7f0bfcc00640 1 --2- 172.21.15.42:0/1361319781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bf81044f0 0x7f0bf81109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.514+0000 7f0bfcc00640 1 --2- 172.21.15.42:0/1361319781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bf8103b50 0x7f0bf8103fb0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.514+0000 7f0bfcc00640 1 --2- 172.21.15.42:0/1361319781 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bf8109c00 0x7f0bf8109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.514+0000 7f0bfcc00640 1 -- 172.21.15.42:0/1361319781 >> 172.21.15.42:0/1361319781 conn(0x7f0bf80ff830 msgr2=0x7f0bf8101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:59.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.514+0000 7f0bfcc00640 1 -- 172.21.15.42:0/1361319781 shutdown_connections 2024-08-26T00:09:59.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.514+0000 7f0bfcc00640 1 -- 172.21.15.42:0/1361319781 wait complete. 2024-08-26T00:09:59.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.515+0000 7f0bfcc00640 1 Processor -- start 2024-08-26T00:09:59.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.515+0000 7f0bfcc00640 1 -- start start 2024-08-26T00:09:59.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.516+0000 7f0bfcc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bf8103b50 0x7f0bf819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:59.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.516+0000 7f0bfcc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bf81044f0 0x7f0bf819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:59.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.516+0000 7f0bfcc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bf8109c00 0x7f0bf819ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:59.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.516+0000 7f0bfcc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf8113fb0 con 0x7f0bf8109c00 2024-08-26T00:09:59.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.516+0000 7f0bfcc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf8113e30 con 0x7f0bf81044f0 2024-08-26T00:09:59.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.516+0000 7f0bfcc00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf8114130 con 0x7f0bf8103b50 2024-08-26T00:09:59.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.516+0000 7f0bf6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bf8109c00 0x7f0bf819ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:59.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.516+0000 7f0bf5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bf8103b50 0x7f0bf819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:59.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.516+0000 7f0bf5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bf8103b50 0x7f0bf819a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:39120/0 (socket says 172.21.15.42:39120) 2024-08-26T00:09:59.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.516+0000 7f0bf6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bf8109c00 0x7f0bf819ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51046/0 (socket says 172.21.15.42:51046) 2024-08-26T00:09:59.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.516+0000 7f0bf5e00640 1 -- 172.21.15.42:0/428090427 learned_addr learned my addr 172.21.15.42:0/428090427 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:59.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.516+0000 7f0befe00640 1 --2- 172.21.15.42:0/428090427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bf81044f0 0x7f0bf819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:59.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.517+0000 7f0bf6800640 1 -- 172.21.15.42:0/428090427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bf8103b50 msgr2=0x7f0bf819a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.517+0000 7f0bf6800640 1 --2- 172.21.15.42:0/428090427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bf8103b50 0x7f0bf819a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.517+0000 7f0bf6800640 1 -- 172.21.15.42:0/428090427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bf81044f0 msgr2=0x7f0bf819a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.517+0000 7f0bf6800640 1 --2- 172.21.15.42:0/428090427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bf81044f0 0x7f0bf819a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.517+0000 7f0bf6800640 1 -- 172.21.15.42:0/428090427 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf819f3e0 con 0x7f0bf8109c00 2024-08-26T00:09:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.517+0000 7f0bf5e00640 1 --2- 172.21.15.42:0/428090427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bf8103b50 0x7f0bf819a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:09:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.517+0000 7f0befe00640 1 --2- 172.21.15.42:0/428090427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bf81044f0 0x7f0bf819a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:09:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.517+0000 7f0bf6800640 1 --2- 172.21.15.42:0/428090427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bf8109c00 0x7f0bf819ed00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0009fd0 tx=0x7f0bf000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.517+0000 7f0beea00640 1 -- 172.21.15.42:0/428090427 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000ce20 con 0x7f0bf8109c00 2024-08-26T00:09:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.517+0000 7f0beea00640 1 -- 172.21.15.42:0/428090427 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bf0005020 con 0x7f0bf8109c00 2024-08-26T00:09:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.517+0000 7f0bfcc00640 1 -- 172.21.15.42:0/428090427 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bf819f6d0 con 0x7f0bf8109c00 2024-08-26T00:09:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.517+0000 7f0beea00640 1 -- 172.21.15.42:0/428090427 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0010720 con 0x7f0bf8109c00 2024-08-26T00:09:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.517+0000 7f0bfcc00640 1 -- 172.21.15.42:0/428090427 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bf81a6fb0 con 0x7f0bf8109c00 2024-08-26T00:09:59.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.520+0000 7f0bff6d8740 1 Processor -- start 2024-08-26T00:09:59.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.521+0000 7f0beea00640 1 -- 172.21.15.42:0/428090427 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0bf0005540 con 0x7f0bf8109c00 2024-08-26T00:09:59.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.521+0000 7f0bff6d8740 1 -- start start 2024-08-26T00:09:59.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.521+0000 7f0bff6d8740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d373820 0x559b4d373c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:59.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.521+0000 7f0bff6d8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b4d374140 0x559b4d37e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:59.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.521+0000 7f0bff6d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d37ea00 0x559b4d380df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:59.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.521+0000 7f0bff6d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559b4d2d9f30 con 0x559b4d37ea00 2024-08-26T00:09:59.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.521+0000 7f0bff6d8740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559b4d2715a0 con 0x559b4d373820 2024-08-26T00:09:59.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.521+0000 7f0bff6d8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559b4d2d5ef0 con 0x559b4d374140 2024-08-26T00:09:59.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.522+0000 7f0befe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d373820 0x559b4d373c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:59.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.522+0000 7f0bf5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b4d374140 0x559b4d37e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:59.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.522+0000 7f0befe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d373820 0x559b4d373c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:58624/0 (socket says 172.21.15.42:58624) 2024-08-26T00:09:59.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.522+0000 7f0bf5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b4d374140 0x559b4d37e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:39124/0 (socket says 172.21.15.42:39124) 2024-08-26T00:09:59.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.522+0000 7f0befe00640 1 -- 172.21.15.42:0/2778976000 learned_addr learned my addr 172.21.15.42:0/2778976000 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:59.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.522+0000 7f0befe00640 1 --2- 172.21.15.42:0/2778976000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d37ea00 0x559b4d380df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:59.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.522+0000 7f0bf5e00640 1 -- 172.21.15.42:0/2778976000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d373820 msgr2=0x559b4d373c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:59.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.522+0000 7f0bf5e00640 1 --2- 172.21.15.42:0/2778976000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d373820 0x559b4d373c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.522+0000 7f0bf5e00640 1 -- 172.21.15.42:0/2778976000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d37ea00 msgr2=0x559b4d380df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:59.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.522+0000 7f0bf5e00640 1 --2- 172.21.15.42:0/2778976000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d37ea00 0x559b4d380df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.522+0000 7f0bf5e00640 1 -- 172.21.15.42:0/2778976000 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b4d04b3c0 con 0x559b4d374140 2024-08-26T00:09:59.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.522+0000 7f0befe00640 1 --2- 172.21.15.42:0/2778976000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d37ea00 0x559b4d380df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:09:59.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.523+0000 7f0beea00640 1 --2- 172.21.15.42:0/428090427 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0bdc0a2b80 0x7f0bdc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:59.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.523+0000 7f0bf5e00640 1 --2- 172.21.15.42:0/2778976000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b4d374140 0x559b4d37e4c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0be8011440 tx=0x7f0be8011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b4bffb387d28b1a server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:59.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.523+0000 7f0beea00640 1 -- 172.21.15.42:0/428090427 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f0bf00cf780 con 0x7f0bf8109c00 2024-08-26T00:09:59.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.523+0000 7f0befe00640 1 --2- 172.21.15.42:0/428090427 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0bdc0a2b80 0x7f0bdc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:59.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.523+0000 7f0be7000640 1 -- 172.21.15.42:0/2778976000 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be8004030 con 0x559b4d374140 2024-08-26T00:09:59.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.523+0000 7f0be7000640 1 -- 172.21.15.42:0/2778976000 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0be80041d0 con 0x559b4d374140 2024-08-26T00:09:59.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.523+0000 7f0be7000640 1 -- 172.21.15.42:0/2778976000 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be800f980 con 0x559b4d374140 2024-08-26T00:09:59.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.524+0000 7f0bff6d8740 1 -- 172.21.15.42:0/2778976000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b4d374140 msgr2=0x559b4d37e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:59.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.524+0000 7f0befe00640 1 --2- 172.21.15.42:0/428090427 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0bdc0a2b80 0x7f0bdc0a5040 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0be00096c0 tx=0x7f0be002a3f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:59.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.524+0000 7f0bff6d8740 1 --2- 172.21.15.42:0/2778976000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b4d374140 0x559b4d37e4c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0be8011440 tx=0x7f0be8011900 comp rx=0 tx=0).stop 2024-08-26T00:09:59.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.524+0000 7f0bff6d8740 1 -- 172.21.15.42:0/2778976000 shutdown_connections 2024-08-26T00:09:59.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.524+0000 7f0bff6d8740 1 --2- 172.21.15.42:0/2778976000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d37ea00 0x559b4d380df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.524+0000 7f0bff6d8740 1 --2- 172.21.15.42:0/2778976000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b4d374140 0x559b4d37e4c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.524+0000 7f0bff6d8740 1 --2- 172.21.15.42:0/2778976000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d373820 0x559b4d373c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.524+0000 7f0bff6d8740 1 -- 172.21.15.42:0/2778976000 >> 172.21.15.42:0/2778976000 conn(0x559b4d36fdb0 msgr2=0x559b4d370190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:59.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.524+0000 7f0bff6d8740 1 -- 172.21.15.42:0/2778976000 shutdown_connections 2024-08-26T00:09:59.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.524+0000 7f0bff6d8740 1 -- 172.21.15.42:0/2778976000 wait complete. 2024-08-26T00:09:59.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.525+0000 7f0bff6d8740 1 -- start start 2024-08-26T00:09:59.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.525+0000 7f0bff6d8740 1 Processor -- start 2024-08-26T00:09:59.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.525+0000 7f0bff6d8740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d373820 0x559b4d37b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:59.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.525+0000 7f0bff6d8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b4d374140 0x559b4d37bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:59.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.525+0000 7f0bff6d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d37ea00 0x559b4d37c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:59.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.525+0000 7f0bff6d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559b4d3815d0 con 0x559b4d37ea00 2024-08-26T00:09:59.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.525+0000 7f0bff6d8740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559b4d294de0 con 0x559b4d373820 2024-08-26T00:09:59.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.525+0000 7f0bff6d8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559b4d381750 con 0x559b4d374140 2024-08-26T00:09:59.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.525+0000 7f0bff6d8740 10 client.0 _ll_register_callbacks cb 0x559b4d2837b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:09:59.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.526+0000 7f0bf5e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d373820 0x559b4d37b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:59.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.526+0000 7f0befe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b4d374140 0x559b4d37bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:59.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.526+0000 7f0bf5e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d373820 0x559b4d37b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:58632/0 (socket says 172.21.15.42:58632) 2024-08-26T00:09:59.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.526+0000 7f0bf5e00640 1 -- 172.21.15.42:0/3308426447 learned_addr learned my addr 172.21.15.42:0/3308426447 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:59.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.526+0000 7f0bf6800640 1 --2- 172.21.15.42:0/3308426447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d37ea00 0x559b4d37c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:59.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.526+0000 7f0bf5e00640 1 -- 172.21.15.42:0/3308426447 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b4d374140 msgr2=0x559b4d37bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:59.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.526+0000 7f0bf5e00640 1 --2- 172.21.15.42:0/3308426447 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b4d374140 0x559b4d37bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.526+0000 7f0bf5e00640 1 -- 172.21.15.42:0/3308426447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d37ea00 msgr2=0x559b4d37c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:59.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.526+0000 7f0bf5e00640 1 --2- 172.21.15.42:0/3308426447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d37ea00 0x559b4d37c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.526+0000 7f0bf5e00640 1 -- 172.21.15.42:0/3308426447 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b4d38aa40 con 0x559b4d373820 2024-08-26T00:09:59.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.526+0000 7f0bf5e00640 1 --2- 172.21.15.42:0/3308426447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d373820 0x559b4d37b870 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0be801b040 tx=0x7f0be8003d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3b166f718fbe417 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:59.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.526+0000 7f0bdb400640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:09:59.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.527+0000 7f0bdb400640 1 -- 172.21.15.42:0/3308426447 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be8028020 con 0x559b4d373820 2024-08-26T00:09:59.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.527+0000 7f0bff6d8740 1 -- 172.21.15.42:0/3308426447 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0be80041d0 con 0x559b4d373820 2024-08-26T00:09:59.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.527+0000 7f0bdb400640 1 -- 172.21.15.42:0/3308426447 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f0be8016040 con 0x559b4d373820 2024-08-26T00:09:59.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.527+0000 7f0bdb400640 1 -- 172.21.15.42:0/3308426447 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0be8003ad0 con 0x559b4d373820 2024-08-26T00:09:59.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.527+0000 7f0bff6d8740 10 client.25769 fetch_fsmap learned FSMap version 29 2024-08-26T00:09:59.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.527+0000 7f0bff6d8740 1 -- 172.21.15.42:0/3308426447 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559b4d38d330 con 0x559b4d373820 2024-08-26T00:09:59.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.527+0000 7f0bdb400640 1 -- 172.21.15.42:0/3308426447 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0be80041d0 con 0x559b4d373820 2024-08-26T00:09:59.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.527+0000 7f0bdb400640 1 -- 172.21.15.42:0/3308426447 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0be8004c50 con 0x559b4d373820 2024-08-26T00:09:59.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.528+0000 7f0bff6d8740 10 client.25769 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:09:59.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.528+0000 7f0bff6d8740 10 client.25769 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-26T00:09:59.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.528+0000 7f0bff6d8740 20 client.25769 populate_metadata read hostname 'smithi042' 2024-08-26T00:09:59.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.528+0000 7f0bff6d8740 1 --2- 172.21.15.42:0/3308426447 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x559b4d38e6e0 0x559b4d390ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:59.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.528+0000 7f0bff6d8740 4 client.25769 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:09:59.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.528+0000 7f0bff6d8740 1 -- 172.21.15.42:0/3308426447 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b4d2e74a0 con 0x559b4d38e6e0 2024-08-26T00:09:59.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.528+0000 7f0befe00640 1 --2- 172.21.15.42:0/3308426447 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x559b4d38e6e0 0x559b4d390ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:59.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.529+0000 7f0befe00640 1 --2- 172.21.15.42:0/3308426447 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x559b4d38e6e0 0x559b4d390ad0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=416870e359f79e4 server_cookie=70ddd3aca3723161 in_seq=0 out_seq=0 2024-08-26T00:09:59.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.529+0000 7f0bdb400640 10 client.25769 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:09:59.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.530+0000 7f0bdb400640 1 -- 172.21.15.42:0/3308426447 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559b4d2e74a0 con 0x559b4d38e6e0 2024-08-26T00:09:59.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.530+0000 7f0bdb400640 10 client.25769 handle_command_reply: tid=0 2024-08-26T00:09:59.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.530+0000 7f0bff6d8740 1 client.25769 shutdown 2024-08-26T00:09:59.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.530+0000 7f0bff6d8740 1 -- 172.21.15.42:0/3308426447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d373820 msgr2=0x559b4d37b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:59.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.530+0000 7f0bff6d8740 1 --2- 172.21.15.42:0/3308426447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d373820 0x559b4d37b870 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0be801b040 tx=0x7f0be8003d00 comp rx=0 tx=0).stop 2024-08-26T00:09:59.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.530+0000 7f0bff6d8740 1 -- 172.21.15.42:0/3308426447 shutdown_connections 2024-08-26T00:09:59.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.530+0000 7f0bff6d8740 1 --2- 172.21.15.42:0/3308426447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d37ea00 0x559b4d37c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.530+0000 7f0bff6d8740 1 --2- 172.21.15.42:0/3308426447 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x559b4d38e6e0 0x559b4d390ad0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.530+0000 7f0bff6d8740 1 --2- 172.21.15.42:0/3308426447 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b4d374140 0x559b4d37bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.530+0000 7f0bff6d8740 1 --2- 172.21.15.42:0/3308426447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d373820 0x559b4d37b870 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.530+0000 7f0bdb400640 0 client.25769 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:09:59.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.530+0000 7f0bff6d8740 1 -- 172.21.15.42:0/3308426447 >> 172.21.15.42:0/3308426447 conn(0x559b4d36fdb0 msgr2=0x559b4d375a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:59.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.530+0000 7f0bff6d8740 1 -- 172.21.15.42:0/3308426447 shutdown_connections 2024-08-26T00:09:59.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.531+0000 7f0bff6d8740 1 -- 172.21.15.42:0/3308426447 wait complete. 2024-08-26T00:09:59.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.531+0000 7f0bff6d8740 20 client.25769 trim_cache size 0 max 16384 2024-08-26T00:09:59.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.544+0000 7f0bff6d8740 1 Processor -- start 2024-08-26T00:09:59.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.544+0000 7f0bff6d8740 1 -- start start 2024-08-26T00:09:59.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.545+0000 7f0bff6d8740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d373820 0x559b4d37aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:59.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.545+0000 7f0bff6d8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b4d374140 0x559b4d396300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:59.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.545+0000 7f0bff6d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d37ea00 0x559b4d396840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:59.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.545+0000 7f0bff6d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf81b1e40 con 0x559b4d37ea00 2024-08-26T00:09:59.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.545+0000 7f0bff6d8740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf81af650 con 0x559b4d373820 2024-08-26T00:09:59.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.545+0000 7f0bff6d8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf81ad480 con 0x559b4d374140 2024-08-26T00:09:59.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.545+0000 7f0bf6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d37ea00 0x559b4d396840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:59.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.545+0000 7f0bf5e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d373820 0x559b4d37aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:59.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.545+0000 7f0bf6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d37ea00 0x559b4d396840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51074/0 (socket says 172.21.15.42:51074) 2024-08-26T00:09:59.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.545+0000 7f0bf6800640 1 -- 172.21.15.42:0/809043323 learned_addr learned my addr 172.21.15.42:0/809043323 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:59.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.545+0000 7f0befe00640 1 --2- 172.21.15.42:0/809043323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b4d374140 0x559b4d396300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:59.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.546+0000 7f0bf5e00640 1 -- 172.21.15.42:0/809043323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b4d374140 msgr2=0x559b4d396300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:59.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.546+0000 7f0bf5e00640 1 --2- 172.21.15.42:0/809043323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b4d374140 0x559b4d396300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.546+0000 7f0bf5e00640 1 -- 172.21.15.42:0/809043323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d37ea00 msgr2=0x559b4d396840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:59.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.546+0000 7f0bf5e00640 1 --2- 172.21.15.42:0/809043323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d37ea00 0x559b4d396840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.546+0000 7f0bf5e00640 1 -- 172.21.15.42:0/809043323 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b4d36fbe0 con 0x559b4d373820 2024-08-26T00:09:59.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.546+0000 7f0bf5e00640 1 --2- 172.21.15.42:0/809043323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d373820 0x559b4d37aaf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0be8000c00 tx=0x7f0be8009ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee117a4342a166b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:59.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.546+0000 7f0be6600640 1 -- 172.21.15.42:0/809043323 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be8028040 con 0x559b4d373820 2024-08-26T00:09:59.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.546+0000 7f0be6600640 1 -- 172.21.15.42:0/809043323 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0be80041b0 con 0x559b4d373820 2024-08-26T00:09:59.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.546+0000 7f0be6600640 1 -- 172.21.15.42:0/809043323 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be8004590 con 0x559b4d373820 2024-08-26T00:09:59.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.547+0000 7f0bff6d8740 1 -- 172.21.15.42:0/809043323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d373820 msgr2=0x559b4d37aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:59.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.547+0000 7f0bff6d8740 1 --2- 172.21.15.42:0/809043323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d373820 0x559b4d37aaf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0be8000c00 tx=0x7f0be8009ef0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.547+0000 7f0bff6d8740 1 -- 172.21.15.42:0/809043323 shutdown_connections 2024-08-26T00:09:59.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.547+0000 7f0bff6d8740 1 --2- 172.21.15.42:0/809043323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d37ea00 0x559b4d396840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.547+0000 7f0bff6d8740 1 --2- 172.21.15.42:0/809043323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b4d374140 0x559b4d396300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.547+0000 7f0bff6d8740 1 --2- 172.21.15.42:0/809043323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d373820 0x559b4d37aaf0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.547+0000 7f0bff6d8740 1 -- 172.21.15.42:0/809043323 >> 172.21.15.42:0/809043323 conn(0x559b4d36fdb0 msgr2=0x559b4d37d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:59.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.547+0000 7f0bff6d8740 1 -- 172.21.15.42:0/809043323 shutdown_connections 2024-08-26T00:09:59.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.547+0000 7f0bff6d8740 1 -- 172.21.15.42:0/809043323 wait complete. 2024-08-26T00:09:59.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.547+0000 7f0bff6d8740 1 -- start start 2024-08-26T00:09:59.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.547+0000 7f0bff6d8740 1 Processor -- start 2024-08-26T00:09:59.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.548+0000 7f0bff6d8740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d373820 0x559b4d386c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:59.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.548+0000 7f0bff6d8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b4d374140 0x559b4d387190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:59.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.548+0000 7f0bff6d8740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d37ea00 0x559b4d3782c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:59.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.548+0000 7f0bff6d8740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf81adb10 con 0x559b4d373820 2024-08-26T00:09:59.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.548+0000 7f0bff6d8740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf81aef80 con 0x559b4d37ea00 2024-08-26T00:09:59.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.548+0000 7f0bff6d8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf81ae1e0 con 0x559b4d374140 2024-08-26T00:09:59.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.548+0000 7f0bff6d8740 10 client.0 _ll_register_callbacks cb 0x7f0be8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:09:59.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.548+0000 7f0bf5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d373820 0x559b4d386c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:59.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.548+0000 7f0befe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b4d374140 0x559b4d387190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:59.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.548+0000 7f0bf5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d373820 0x559b4d386c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51090/0 (socket says 172.21.15.42:51090) 2024-08-26T00:09:59.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.548+0000 7f0bf5e00640 1 -- 172.21.15.42:0/163073114 learned_addr learned my addr 172.21.15.42:0/163073114 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:09:59.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.548+0000 7f0bf6800640 1 --2- 172.21.15.42:0/163073114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d37ea00 0x559b4d3782c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:59.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.549+0000 7f0bf5e00640 1 -- 172.21.15.42:0/163073114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b4d374140 msgr2=0x559b4d387190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:59.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.549+0000 7f0bf5e00640 1 --2- 172.21.15.42:0/163073114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b4d374140 0x559b4d387190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.549+0000 7f0bf5e00640 1 -- 172.21.15.42:0/163073114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d37ea00 msgr2=0x559b4d3782c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:09:59.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.549+0000 7f0bf5e00640 1 --2- 172.21.15.42:0/163073114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d37ea00 0x559b4d3782c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.549+0000 7f0bf5e00640 1 -- 172.21.15.42:0/163073114 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b4d37c840 con 0x559b4d373820 2024-08-26T00:09:59.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.549+0000 7f0bf6800640 1 --2- 172.21.15.42:0/163073114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d37ea00 0x559b4d3782c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:09:59.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.549+0000 7f0bf5e00640 1 --2- 172.21.15.42:0/163073114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d373820 0x559b4d386c50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0be8011fd0 tx=0x7f0be800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21c1c6bdeaf45b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:09:59.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.549+0000 7f0bdb400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:09:59.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.549+0000 7f0bdb400640 1 -- 172.21.15.42:0/163073114 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be803c070 con 0x559b4d373820 2024-08-26T00:09:59.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.549+0000 7f0bdb400640 1 -- 172.21.15.42:0/163073114 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f0be8005440 con 0x559b4d373820 2024-08-26T00:09:59.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.549+0000 7f0bff6d8740 1 -- 172.21.15.42:0/163073114 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0be80041b0 con 0x559b4d373820 2024-08-26T00:09:59.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.550+0000 7f0bdb400640 1 -- 172.21.15.42:0/163073114 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0be8048050 con 0x559b4d373820 2024-08-26T00:09:59.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.550+0000 7f0bff6d8740 10 client.15696 fetch_fsmap learned FSMap version 29 2024-08-26T00:09:59.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.550+0000 7f0bff6d8740 1 -- 172.21.15.42:0/163073114 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559b4d3f8d10 con 0x559b4d373820 2024-08-26T00:09:59.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.550+0000 7f0bdb400640 1 -- 172.21.15.42:0/163073114 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0be80041b0 con 0x559b4d373820 2024-08-26T00:09:59.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.550+0000 7f0bdb400640 1 -- 172.21.15.42:0/163073114 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0be8036020 con 0x559b4d373820 2024-08-26T00:09:59.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.550+0000 7f0bff6d8740 10 client.15696 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:09:59.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.550+0000 7f0bff6d8740 10 client.15696 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-26T00:09:59.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.550+0000 7f0bff6d8740 20 client.15696 populate_metadata read hostname 'smithi042' 2024-08-26T00:09:59.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.550+0000 7f0bff6d8740 1 --2- 172.21.15.42:0/163073114 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x559b4d3f9400 0x559b4d3fb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:09:59.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.550+0000 7f0bff6d8740 4 client.15696 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:09:59.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.550+0000 7f0bff6d8740 1 -- 172.21.15.42:0/163073114 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559b4d2e19b0 con 0x559b4d3f9400 2024-08-26T00:09:59.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.551+0000 7f0befe00640 1 --2- 172.21.15.42:0/163073114 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x559b4d3f9400 0x559b4d3fb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:09:59.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.551+0000 7f0befe00640 1 --2- 172.21.15.42:0/163073114 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x559b4d3f9400 0x559b4d3fb820 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=93b694f92106a9a server_cookie=df9847070e60d483 in_seq=0 out_seq=0 2024-08-26T00:09:59.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.551+0000 7f0bdb400640 10 client.15696 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:09:59.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.552+0000 7f0bdb400640 1 -- 172.21.15.42:0/163073114 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559b4d2e19b0 con 0x559b4d3f9400 2024-08-26T00:09:59.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.552+0000 7f0bdb400640 10 client.15696 handle_command_reply: tid=0 2024-08-26T00:09:59.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.552+0000 7f0bff6d8740 1 client.15696 shutdown 2024-08-26T00:09:59.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.552+0000 7f0bff6d8740 1 -- 172.21.15.42:0/163073114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d373820 msgr2=0x559b4d386c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:59.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.552+0000 7f0bff6d8740 1 --2- 172.21.15.42:0/163073114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d373820 0x559b4d386c50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0be8011fd0 tx=0x7f0be800ff90 comp rx=0 tx=0).stop 2024-08-26T00:09:59.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.552+0000 7f0bff6d8740 1 -- 172.21.15.42:0/163073114 shutdown_connections 2024-08-26T00:09:59.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.552+0000 7f0bff6d8740 1 --2- 172.21.15.42:0/163073114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b4d37ea00 0x559b4d3782c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.552+0000 7f0bff6d8740 1 --2- 172.21.15.42:0/163073114 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x559b4d3f9400 0x559b4d3fb820 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.552+0000 7f0bff6d8740 1 --2- 172.21.15.42:0/163073114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b4d374140 0x559b4d387190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.552+0000 7f0bff6d8740 1 --2- 172.21.15.42:0/163073114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b4d373820 0x559b4d386c50 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.552+0000 7f0bff6d8740 1 -- 172.21.15.42:0/163073114 >> 172.21.15.42:0/163073114 conn(0x559b4d36fdb0 msgr2=0x559b4d37b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:59.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.552+0000 7f0bdb400640 0 client.15696 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:09:59.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.552+0000 7f0bff6d8740 1 -- 172.21.15.42:0/163073114 shutdown_connections 2024-08-26T00:09:59.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.552+0000 7f0bff6d8740 1 -- 172.21.15.42:0/163073114 wait complete. 2024-08-26T00:09:59.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.552+0000 7f0bff6d8740 20 client.15696 trim_cache size 0 max 16384 2024-08-26T00:09:59.557 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:09:59.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.553+0000 7f0bfcc00640 1 -- 172.21.15.42:0/428090427 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0bdc0a2b80 msgr2=0x7f0bdc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:59.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.553+0000 7f0bfcc00640 1 --2- 172.21.15.42:0/428090427 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0bdc0a2b80 0x7f0bdc0a5040 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0be00096c0 tx=0x7f0be002a3f0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.553+0000 7f0bfcc00640 1 -- 172.21.15.42:0/428090427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bf8109c00 msgr2=0x7f0bf819ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:09:59.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.553+0000 7f0bfcc00640 1 --2- 172.21.15.42:0/428090427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bf8109c00 0x7f0bf819ed00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0009fd0 tx=0x7f0bf000ef10 comp rx=0 tx=0).stop 2024-08-26T00:09:59.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.553+0000 7f0bfcc00640 1 -- 172.21.15.42:0/428090427 shutdown_connections 2024-08-26T00:09:59.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.553+0000 7f0bfcc00640 1 --2- 172.21.15.42:0/428090427 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f0bdc0a2b80 0x7f0bdc0a5040 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.553+0000 7f0bfcc00640 1 --2- 172.21.15.42:0/428090427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bf8109c00 0x7f0bf819ed00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.553+0000 7f0bfcc00640 1 --2- 172.21.15.42:0/428090427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bf81044f0 0x7f0bf819a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.553+0000 7f0bfcc00640 1 --2- 172.21.15.42:0/428090427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bf8103b50 0x7f0bf819a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:09:59.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.553+0000 7f0bfcc00640 1 -- 172.21.15.42:0/428090427 >> 172.21.15.42:0/428090427 conn(0x7f0bf80ff830 msgr2=0x7f0bf8100f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:09:59.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.553+0000 7f0bfcc00640 1 -- 172.21.15.42:0/428090427 shutdown_connections 2024-08-26T00:09:59.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:09:59.553+0000 7f0bfcc00640 1 -- 172.21.15.42:0/428090427 wait complete. 2024-08-26T00:10:00.266 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-26T00:10:00.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:00 smithi043 ceph-mon[22091]: pgmap v563: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 2.3 MiB/s wr, 191 op/s 2024-08-26T00:10:00.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:00 smithi043 ceph-mon[22091]: overall HEALTH_OK 2024-08-26T00:10:00.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:00 smithi042 ceph-mon[17225]: pgmap v563: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 2.3 MiB/s wr, 191 op/s 2024-08-26T00:10:00.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:00 smithi042 ceph-mon[17225]: overall HEALTH_OK 2024-08-26T00:10:00.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:00 smithi181 ceph-mon[22102]: pgmap v563: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 2.3 MiB/s wr, 191 op/s 2024-08-26T00:10:00.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:00 smithi181 ceph-mon[22102]: overall HEALTH_OK 2024-08-26T00:10:00.643 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:10:01.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.240+0000 7f7d2ca00640 1 -- 172.21.15.42:0/3758704174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d28103b50 msgr2=0x7f7d28103fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:01.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.240+0000 7f7d2ca00640 1 --2- 172.21.15.42:0/3758704174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d28103b50 0x7f7d28103fb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009900 tx=0x7f7d1002a3f0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.240+0000 7f7d2ca00640 1 -- 172.21.15.42:0/3758704174 shutdown_connections 2024-08-26T00:10:01.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.240+0000 7f7d2ca00640 1 --2- 172.21.15.42:0/3758704174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d281044f0 0x7f7d281109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.240+0000 7f7d2ca00640 1 --2- 172.21.15.42:0/3758704174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d28103b50 0x7f7d28103fb0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.240+0000 7f7d2ca00640 1 --2- 172.21.15.42:0/3758704174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d28109c00 0x7f7d28109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.240+0000 7f7d2ca00640 1 -- 172.21.15.42:0/3758704174 >> 172.21.15.42:0/3758704174 conn(0x7f7d280ff830 msgr2=0x7f7d28101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:01.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.241+0000 7f7d2ca00640 1 -- 172.21.15.42:0/3758704174 shutdown_connections 2024-08-26T00:10:01.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.241+0000 7f7d2ca00640 1 -- 172.21.15.42:0/3758704174 wait complete. 2024-08-26T00:10:01.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.242+0000 7f7d2ca00640 1 Processor -- start 2024-08-26T00:10:01.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.242+0000 7f7d2ca00640 1 -- start start 2024-08-26T00:10:01.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.242+0000 7f7d2ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d28103b50 0x7f7d2819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:01.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.242+0000 7f7d2ca00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d281044f0 0x7f7d2819a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:01.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.242+0000 7f7d2ca00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d28109c00 0x7f7d2819ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:01.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.243+0000 7f7d2ca00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7d28113fb0 con 0x7f7d28103b50 2024-08-26T00:10:01.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.243+0000 7f7d2ca00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7d28113e30 con 0x7f7d28109c00 2024-08-26T00:10:01.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.243+0000 7f7d2ca00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7d28114130 con 0x7f7d281044f0 2024-08-26T00:10:01.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.243+0000 7f7d1d400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d281044f0 0x7f7d2819a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:01.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.243+0000 7f7d25e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d28103b50 0x7f7d2819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:01.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.243+0000 7f7d1d400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d281044f0 0x7f7d2819a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:39160/0 (socket says 172.21.15.42:39160) 2024-08-26T00:10:01.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.243+0000 7f7d1d400640 1 -- 172.21.15.42:0/3283527583 learned_addr learned my addr 172.21.15.42:0/3283527583 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:01.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.243+0000 7f7d26800640 1 --2- 172.21.15.42:0/3283527583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d28109c00 0x7f7d2819ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:01.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.243+0000 7f7d25e00640 1 -- 172.21.15.42:0/3283527583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d281044f0 msgr2=0x7f7d2819a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:01.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.243+0000 7f7d25e00640 1 --2- 172.21.15.42:0/3283527583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d281044f0 0x7f7d2819a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.243+0000 7f7d25e00640 1 -- 172.21.15.42:0/3283527583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d28109c00 msgr2=0x7f7d2819ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:01.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.243+0000 7f7d25e00640 1 --2- 172.21.15.42:0/3283527583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d28109c00 0x7f7d2819ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.243+0000 7f7d25e00640 1 -- 172.21.15.42:0/3283527583 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d2819f400 con 0x7f7d28103b50 2024-08-26T00:10:01.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.243+0000 7f7d1d400640 1 --2- 172.21.15.42:0/3283527583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d281044f0 0x7f7d2819a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:10:01.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.243+0000 7f7d26800640 1 --2- 172.21.15.42:0/3283527583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d28109c00 0x7f7d2819ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:10:01.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.244+0000 7f7d25e00640 1 --2- 172.21.15.42:0/3283527583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d28103b50 0x7f7d2819a450 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7d1800e9f0 tx=0x7f7d1800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:01.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.244+0000 7f7d1f400640 1 -- 172.21.15.42:0/3283527583 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1800ccc0 con 0x7f7d28103b50 2024-08-26T00:10:01.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.244+0000 7f7d1f400640 1 -- 172.21.15.42:0/3283527583 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d18005020 con 0x7f7d28103b50 2024-08-26T00:10:01.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.244+0000 7f7d2ca00640 1 -- 172.21.15.42:0/3283527583 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d2819f6f0 con 0x7f7d28103b50 2024-08-26T00:10:01.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.244+0000 7f7d1f400640 1 -- 172.21.15.42:0/3283527583 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d180049e0 con 0x7f7d28103b50 2024-08-26T00:10:01.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.244+0000 7f7d2ca00640 1 -- 172.21.15.42:0/3283527583 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d281a6fd0 con 0x7f7d28103b50 2024-08-26T00:10:01.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.248+0000 7f7d2f457740 1 Processor -- start 2024-08-26T00:10:01.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.248+0000 7f7d2f457740 1 -- start start 2024-08-26T00:10:01.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.249+0000 7f7d1f400640 1 -- 172.21.15.42:0/3283527583 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7d18005560 con 0x7f7d28103b50 2024-08-26T00:10:01.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.249+0000 7f7d2f457740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4140f820 0x561a4140fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:01.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.249+0000 7f7d2f457740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 0x561a4141a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:01.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.249+0000 7f7d2f457740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561a4141aa00 0x561a4141cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:01.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.249+0000 7f7d2f457740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561a41375f30 con 0x561a41410140 2024-08-26T00:10:01.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.249+0000 7f7d2f457740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561a4130d5a0 con 0x561a4140f820 2024-08-26T00:10:01.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.249+0000 7f7d2f457740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561a41371ef0 con 0x561a4141aa00 2024-08-26T00:10:01.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.249+0000 7f7d26800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4140f820 0x561a4140fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:01.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.249+0000 7f7d26800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4140f820 0x561a4140fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:58674/0 (socket says 172.21.15.42:58674) 2024-08-26T00:10:01.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.249+0000 7f7d26800640 1 -- 172.21.15.42:0/2001295045 learned_addr learned my addr 172.21.15.42:0/2001295045 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:01.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.249+0000 7f7d25e00640 1 --2- 172.21.15.42:0/2001295045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 0x561a4141a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:01.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.249+0000 7f7d1d400640 1 --2- 172.21.15.42:0/2001295045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561a4141aa00 0x561a4141cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:01.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.250+0000 7f7d26800640 1 -- 172.21.15.42:0/2001295045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561a4141aa00 msgr2=0x561a4141cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:01.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.250+0000 7f7d26800640 1 --2- 172.21.15.42:0/2001295045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561a4141aa00 0x561a4141cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.250+0000 7f7d26800640 1 -- 172.21.15.42:0/2001295045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 msgr2=0x561a4141a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:01.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.250+0000 7f7d26800640 1 --2- 172.21.15.42:0/2001295045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 0x561a4141a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.250+0000 7f7d26800640 1 -- 172.21.15.42:0/2001295045 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a410e73c0 con 0x561a4140f820 2024-08-26T00:10:01.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.250+0000 7f7d25e00640 1 --2- 172.21.15.42:0/2001295045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 0x561a4141a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:10:01.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.250+0000 7f7d26800640 1 --2- 172.21.15.42:0/2001295045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4140f820 0x561a4140fc00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7d200117e0 tx=0x7f7d20011ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb121205327587b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:01.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.250+0000 7f7d1f400640 1 --2- 172.21.15.42:0/3283527583 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7d0c0a2c00 0x7f7d0c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:01.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.250+0000 7f7d17000640 1 -- 172.21.15.42:0/2001295045 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d20011310 con 0x561a4140f820 2024-08-26T00:10:01.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.251+0000 7f7d1f400640 1 -- 172.21.15.42:0/3283527583 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f7d180ceef0 con 0x7f7d28103b50 2024-08-26T00:10:01.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.251+0000 7f7d17000640 1 -- 172.21.15.42:0/2001295045 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d20003e50 con 0x561a4140f820 2024-08-26T00:10:01.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.251+0000 7f7d17000640 1 -- 172.21.15.42:0/2001295045 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d20004590 con 0x561a4140f820 2024-08-26T00:10:01.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.251+0000 7f7d25e00640 1 --2- 172.21.15.42:0/3283527583 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7d0c0a2c00 0x7f7d0c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:01.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.251+0000 7f7d2f457740 1 -- 172.21.15.42:0/2001295045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4140f820 msgr2=0x561a4140fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:01.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.251+0000 7f7d25e00640 1 --2- 172.21.15.42:0/3283527583 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7d0c0a2c00 0x7f7d0c0a50c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7d180980e0 tx=0x7f7d180096e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:01.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.251+0000 7f7d2f457740 1 --2- 172.21.15.42:0/2001295045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4140f820 0x561a4140fc00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7d200117e0 tx=0x7f7d20011ca0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.251+0000 7f7d2f457740 1 -- 172.21.15.42:0/2001295045 shutdown_connections 2024-08-26T00:10:01.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.251+0000 7f7d2f457740 1 --2- 172.21.15.42:0/2001295045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561a4141aa00 0x561a4141cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.251+0000 7f7d2f457740 1 --2- 172.21.15.42:0/2001295045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 0x561a4141a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.251+0000 7f7d2f457740 1 --2- 172.21.15.42:0/2001295045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4140f820 0x561a4140fc00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.251+0000 7f7d2f457740 1 -- 172.21.15.42:0/2001295045 >> 172.21.15.42:0/2001295045 conn(0x561a4140bdb0 msgr2=0x561a4140c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:01.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.252+0000 7f7d2f457740 1 -- 172.21.15.42:0/2001295045 shutdown_connections 2024-08-26T00:10:01.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.252+0000 7f7d2f457740 1 -- 172.21.15.42:0/2001295045 wait complete. 2024-08-26T00:10:01.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.252+0000 7f7d2f457740 1 -- start start 2024-08-26T00:10:01.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.252+0000 7f7d2f457740 1 Processor -- start 2024-08-26T00:10:01.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.253+0000 7f7d2f457740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4140f820 0x561a414178e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:01.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.253+0000 7f7d2f457740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 0x561a41417e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:01.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.253+0000 7f7d2f457740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561a4141aa00 0x561a41418360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:01.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.253+0000 7f7d2f457740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561a4141d5d0 con 0x561a41410140 2024-08-26T00:10:01.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.253+0000 7f7d2f457740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561a41330de0 con 0x561a4140f820 2024-08-26T00:10:01.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.253+0000 7f7d2f457740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561a4141d750 con 0x561a4141aa00 2024-08-26T00:10:01.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.253+0000 7f7d2f457740 10 client.0 _ll_register_callbacks cb 0x561a4131f7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:10:01.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.253+0000 7f7d26800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4140f820 0x561a414178e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:01.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.253+0000 7f7d26800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4140f820 0x561a414178e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:58682/0 (socket says 172.21.15.42:58682) 2024-08-26T00:10:01.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.253+0000 7f7d26800640 1 -- 172.21.15.42:0/3808214099 learned_addr learned my addr 172.21.15.42:0/3808214099 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:01.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.253+0000 7f7d1d400640 1 --2- 172.21.15.42:0/3808214099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 0x561a41417e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:01.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.253+0000 7f7d26800640 1 --2- 172.21.15.42:0/3808214099 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561a4141aa00 0x561a41418360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:01.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.254+0000 7f7d26800640 1 -- 172.21.15.42:0/3808214099 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561a4141aa00 msgr2=0x561a41418360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:01.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.254+0000 7f7d26800640 1 --2- 172.21.15.42:0/3808214099 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561a4141aa00 0x561a41418360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.254+0000 7f7d26800640 1 -- 172.21.15.42:0/3808214099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 msgr2=0x561a41417e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:01.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.254+0000 7f7d26800640 1 --2- 172.21.15.42:0/3808214099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 0x561a41417e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.254+0000 7f7d26800640 1 -- 172.21.15.42:0/3808214099 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a41426a40 con 0x561a4140f820 2024-08-26T00:10:01.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.254+0000 7f7d1d400640 1 --2- 172.21.15.42:0/3808214099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 0x561a41417e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:10:01.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.254+0000 7f7d26800640 1 --2- 172.21.15.42:0/3808214099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4140f820 0x561a414178e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7d20004270 tx=0x7f7d20004170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f6072868c81400 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:01.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.254+0000 7f7d0b400640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:10:01.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.254+0000 7f7d0b400640 1 -- 172.21.15.42:0/3808214099 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d20025040 con 0x561a4140f820 2024-08-26T00:10:01.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.254+0000 7f7d2f457740 1 -- 172.21.15.42:0/3808214099 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d20003e50 con 0x561a4140f820 2024-08-26T00:10:01.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.254+0000 7f7d0b400640 1 -- 172.21.15.42:0/3808214099 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f7d20011320 con 0x561a4140f820 2024-08-26T00:10:01.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.255+0000 7f7d0b400640 1 -- 172.21.15.42:0/3808214099 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7d20032050 con 0x561a4140f820 2024-08-26T00:10:01.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.255+0000 7f7d2f457740 10 client.25787 fetch_fsmap learned FSMap version 29 2024-08-26T00:10:01.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.255+0000 7f7d2f457740 1 -- 172.21.15.42:0/3808214099 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561a414293a0 con 0x561a4140f820 2024-08-26T00:10:01.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.255+0000 7f7d0b400640 1 -- 172.21.15.42:0/3808214099 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d20003e50 con 0x561a4140f820 2024-08-26T00:10:01.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.255+0000 7f7d0b400640 1 -- 172.21.15.42:0/3808214099 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7d20018020 con 0x561a4140f820 2024-08-26T00:10:01.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.255+0000 7f7d2f457740 10 client.25787 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:10:01.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.255+0000 7f7d2f457740 10 client.25787 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-26T00:10:01.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.255+0000 7f7d2f457740 20 client.25787 populate_metadata read hostname 'smithi042' 2024-08-26T00:10:01.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.255+0000 7f7d2f457740 1 --2- 172.21.15.42:0/3808214099 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x561a4142a6f0 0x561a4142cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:01.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.255+0000 7f7d2f457740 4 client.25787 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:10:01.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.255+0000 7f7d2f457740 1 -- 172.21.15.42:0/3808214099 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a413834a0 con 0x561a4142a6f0 2024-08-26T00:10:01.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.256+0000 7f7d1d400640 1 --2- 172.21.15.42:0/3808214099 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x561a4142a6f0 0x561a4142cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:01.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.256+0000 7f7d1d400640 1 --2- 172.21.15.42:0/3808214099 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x561a4142a6f0 0x561a4142cae0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cbfdefdde92be27 server_cookie=57e7e1e0119e4b84 in_seq=0 out_seq=0 2024-08-26T00:10:01.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.256+0000 7f7d0b400640 10 client.25787 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:10:01.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.257+0000 7f7d0b400640 1 -- 172.21.15.42:0/3808214099 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561a413834a0 con 0x561a4142a6f0 2024-08-26T00:10:01.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.257+0000 7f7d0b400640 10 client.25787 handle_command_reply: tid=0 2024-08-26T00:10:01.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.257+0000 7f7d2f457740 1 client.25787 shutdown 2024-08-26T00:10:01.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.257+0000 7f7d2f457740 1 -- 172.21.15.42:0/3808214099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4140f820 msgr2=0x561a414178e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:01.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.257+0000 7f7d2f457740 1 --2- 172.21.15.42:0/3808214099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4140f820 0x561a414178e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7d20004270 tx=0x7f7d20004170 comp rx=0 tx=0).stop 2024-08-26T00:10:01.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.257+0000 7f7d2f457740 1 -- 172.21.15.42:0/3808214099 shutdown_connections 2024-08-26T00:10:01.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.257+0000 7f7d2f457740 1 --2- 172.21.15.42:0/3808214099 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x561a4142a6f0 0x561a4142cae0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.257+0000 7f7d2f457740 1 --2- 172.21.15.42:0/3808214099 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561a4141aa00 0x561a41418360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.257+0000 7f7d2f457740 1 --2- 172.21.15.42:0/3808214099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 0x561a41417e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.257+0000 7f7d0b400640 0 client.25787 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:10:01.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.257+0000 7f7d2f457740 1 --2- 172.21.15.42:0/3808214099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4140f820 0x561a414178e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.257+0000 7f7d2f457740 1 -- 172.21.15.42:0/3808214099 >> 172.21.15.42:0/3808214099 conn(0x561a4140bdb0 msgr2=0x561a4140af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:01.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.258+0000 7f7d2f457740 1 -- 172.21.15.42:0/3808214099 shutdown_connections 2024-08-26T00:10:01.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.258+0000 7f7d2f457740 1 -- 172.21.15.42:0/3808214099 wait complete. 2024-08-26T00:10:01.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.258+0000 7f7d2f457740 20 client.25787 trim_cache size 0 max 16384 2024-08-26T00:10:01.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.271+0000 7f7d2f457740 1 Processor -- start 2024-08-26T00:10:01.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.271+0000 7f7d2f457740 1 -- start start 2024-08-26T00:10:01.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.272+0000 7f7d2f457740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561a4140f820 0x561a41412280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:01.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.272+0000 7f7d2f457740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 0x561a414171c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:01.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.272+0000 7f7d2f457740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4141aa00 0x561a41419030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:01.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.272+0000 7f7d2f457740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7d281b1f30 con 0x561a41410140 2024-08-26T00:10:01.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.272+0000 7f7d2f457740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7d281af740 con 0x561a4141aa00 2024-08-26T00:10:01.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.272+0000 7f7d2f457740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7d281ad570 con 0x561a4140f820 2024-08-26T00:10:01.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.272+0000 7f7d1d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 0x561a414171c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:01.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.272+0000 7f7d26800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561a4140f820 0x561a41412280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:01.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.272+0000 7f7d1d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 0x561a414171c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51148/0 (socket says 172.21.15.42:51148) 2024-08-26T00:10:01.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.272+0000 7f7d1d400640 1 -- 172.21.15.42:0/2615035052 learned_addr learned my addr 172.21.15.42:0/2615035052 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:01.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.272+0000 7f7d26800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561a4140f820 0x561a41412280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:39178/0 (socket says 172.21.15.42:39178) 2024-08-26T00:10:01.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.272+0000 7f7d26800640 1 --2- 172.21.15.42:0/2615035052 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4141aa00 0x561a41419030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:01.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.273+0000 7f7d1d400640 1 -- 172.21.15.42:0/2615035052 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561a4140f820 msgr2=0x561a41412280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:01.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.273+0000 7f7d1d400640 1 --2- 172.21.15.42:0/2615035052 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561a4140f820 0x561a41412280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.273+0000 7f7d1d400640 1 -- 172.21.15.42:0/2615035052 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4141aa00 msgr2=0x561a41419030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:01.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.273+0000 7f7d1d400640 1 --2- 172.21.15.42:0/2615035052 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4141aa00 0x561a41419030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.273+0000 7f7d1d400640 1 -- 172.21.15.42:0/2615035052 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a41419ee0 con 0x561a41410140 2024-08-26T00:10:01.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.273+0000 7f7d1d400640 1 --2- 172.21.15.42:0/2615035052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 0x561a414171c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7d1002a9e0 tx=0x7f7d100038c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8c975d521c5e4e server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:01.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.273+0000 7f7d16600640 1 -- 172.21.15.42:0/2615035052 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d10035040 con 0x561a41410140 2024-08-26T00:10:01.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.273+0000 7f7d16600640 1 -- 172.21.15.42:0/2615035052 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d100463c0 con 0x561a41410140 2024-08-26T00:10:01.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.273+0000 7f7d16600640 1 -- 172.21.15.42:0/2615035052 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d100317a0 con 0x561a41410140 2024-08-26T00:10:01.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.274+0000 7f7d2f457740 1 -- 172.21.15.42:0/2615035052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 msgr2=0x561a414171c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:01.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.274+0000 7f7d2f457740 1 --2- 172.21.15.42:0/2615035052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 0x561a414171c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7d1002a9e0 tx=0x7f7d100038c0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.274+0000 7f7d2f457740 1 -- 172.21.15.42:0/2615035052 shutdown_connections 2024-08-26T00:10:01.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.274+0000 7f7d2f457740 1 --2- 172.21.15.42:0/2615035052 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4141aa00 0x561a41419030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.274+0000 7f7d2f457740 1 --2- 172.21.15.42:0/2615035052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 0x561a414171c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.274+0000 7f7d2f457740 1 --2- 172.21.15.42:0/2615035052 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561a4140f820 0x561a41412280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.274+0000 7f7d2f457740 1 -- 172.21.15.42:0/2615035052 >> 172.21.15.42:0/2615035052 conn(0x561a4140bdb0 msgr2=0x561a4140af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:01.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.274+0000 7f7d2f457740 1 -- 172.21.15.42:0/2615035052 shutdown_connections 2024-08-26T00:10:01.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.274+0000 7f7d2f457740 1 -- 172.21.15.42:0/2615035052 wait complete. 2024-08-26T00:10:01.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.275+0000 7f7d2f457740 1 -- start start 2024-08-26T00:10:01.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.275+0000 7f7d2f457740 1 Processor -- start 2024-08-26T00:10:01.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.275+0000 7f7d2f457740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4140f820 0x561a4141e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:01.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.275+0000 7f7d2f457740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 0x561a4141e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:01.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.275+0000 7f7d2f457740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561a4141aa00 0x561a4148d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:01.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.275+0000 7f7d2f457740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7d281adc00 con 0x561a41410140 2024-08-26T00:10:01.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.275+0000 7f7d2f457740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7d281af070 con 0x561a4140f820 2024-08-26T00:10:01.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.275+0000 7f7d2f457740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7d281ae2d0 con 0x561a4141aa00 2024-08-26T00:10:01.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.275+0000 7f7d2f457740 10 client.0 _ll_register_callbacks cb 0x7f7d18005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:10:01.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.276+0000 7f7d26800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4140f820 0x561a4141e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:01.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.276+0000 7f7d1d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 0x561a4141e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:01.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.276+0000 7f7d26800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4140f820 0x561a4141e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:58694/0 (socket says 172.21.15.42:58694) 2024-08-26T00:10:01.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.276+0000 7f7d26800640 1 -- 172.21.15.42:0/1564502427 learned_addr learned my addr 172.21.15.42:0/1564502427 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:01.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.276+0000 7f7d26800640 1 --2- 172.21.15.42:0/1564502427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561a4141aa00 0x561a4148d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:01.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.276+0000 7f7d26800640 1 -- 172.21.15.42:0/1564502427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561a4141aa00 msgr2=0x561a4148d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:01.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.276+0000 7f7d26800640 1 --2- 172.21.15.42:0/1564502427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561a4141aa00 0x561a4148d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.276+0000 7f7d26800640 1 -- 172.21.15.42:0/1564502427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 msgr2=0x561a4141e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:01.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.276+0000 7f7d26800640 1 --2- 172.21.15.42:0/1564502427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 0x561a4141e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.276+0000 7f7d26800640 1 -- 172.21.15.42:0/1564502427 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a4148d8f0 con 0x561a4140f820 2024-08-26T00:10:01.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.276+0000 7f7d26800640 1 --2- 172.21.15.42:0/1564502427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4140f820 0x561a4141e080 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7d20009560 tx=0x7f7d20004170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15c33ad131888d09 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:01.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.276+0000 7f7d0b400640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:10:01.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.277+0000 7f7d0b400640 1 -- 172.21.15.42:0/1564502427 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d20003ce0 con 0x561a4140f820 2024-08-26T00:10:01.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.277+0000 7f7d0b400640 1 -- 172.21.15.42:0/1564502427 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f7d20003e80 con 0x561a4140f820 2024-08-26T00:10:01.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.277+0000 7f7d2f457740 1 -- 172.21.15.42:0/1564502427 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d100463c0 con 0x561a4140f820 2024-08-26T00:10:01.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.277+0000 7f7d0b400640 1 -- 172.21.15.42:0/1564502427 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7d20004a00 con 0x561a4140f820 2024-08-26T00:10:01.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.277+0000 7f7d2f457740 10 client.25793 fetch_fsmap learned FSMap version 29 2024-08-26T00:10:01.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.277+0000 7f7d2f457740 1 -- 172.21.15.42:0/1564502427 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561a41494c70 con 0x561a4140f820 2024-08-26T00:10:01.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.277+0000 7f7d0b400640 1 -- 172.21.15.42:0/1564502427 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d100463c0 con 0x561a4140f820 2024-08-26T00:10:01.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.277+0000 7f7d0b400640 1 -- 172.21.15.42:0/1564502427 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7d20018040 con 0x561a4140f820 2024-08-26T00:10:01.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.277+0000 7f7d2f457740 10 client.25793 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:10:01.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.277+0000 7f7d2f457740 10 client.25793 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-26T00:10:01.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.278+0000 7f7d2f457740 20 client.25793 populate_metadata read hostname 'smithi042' 2024-08-26T00:10:01.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.278+0000 7f7d2f457740 1 --2- 172.21.15.42:0/1564502427 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x561a414952d0 0x561a414976f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:01.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.278+0000 7f7d2f457740 4 client.25793 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:10:01.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.278+0000 7f7d2f457740 1 -- 172.21.15.42:0/1564502427 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561a4137d9b0 con 0x561a414952d0 2024-08-26T00:10:01.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.278+0000 7f7d1d400640 1 --2- 172.21.15.42:0/1564502427 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x561a414952d0 0x561a414976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:01.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.278+0000 7f7d1d400640 1 --2- 172.21.15.42:0/1564502427 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x561a414952d0 0x561a414976f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9addff595dd906c5 server_cookie=a4c5e350e48a689 in_seq=0 out_seq=0 2024-08-26T00:10:01.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.278+0000 7f7d0b400640 10 client.25793 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:10:01.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.279+0000 7f7d0b400640 1 -- 172.21.15.42:0/1564502427 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561a4137d9b0 con 0x561a414952d0 2024-08-26T00:10:01.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.279+0000 7f7d0b400640 10 client.25793 handle_command_reply: tid=0 2024-08-26T00:10:01.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.279+0000 7f7d2f457740 1 client.25793 shutdown 2024-08-26T00:10:01.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.279+0000 7f7d2f457740 1 -- 172.21.15.42:0/1564502427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4140f820 msgr2=0x561a4141e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:01.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.279+0000 7f7d2f457740 1 --2- 172.21.15.42:0/1564502427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4140f820 0x561a4141e080 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7d20009560 tx=0x7f7d20004170 comp rx=0 tx=0).stop 2024-08-26T00:10:01.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.279+0000 7f7d2f457740 1 -- 172.21.15.42:0/1564502427 shutdown_connections 2024-08-26T00:10:01.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.279+0000 7f7d2f457740 1 --2- 172.21.15.42:0/1564502427 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x561a414952d0 0x561a414976f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.279+0000 7f7d2f457740 1 --2- 172.21.15.42:0/1564502427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561a4141aa00 0x561a4148d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.279+0000 7f7d2f457740 1 --2- 172.21.15.42:0/1564502427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a41410140 0x561a4141e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.279+0000 7f7d2f457740 1 --2- 172.21.15.42:0/1564502427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561a4140f820 0x561a4141e080 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.279+0000 7f7d2f457740 1 -- 172.21.15.42:0/1564502427 >> 172.21.15.42:0/1564502427 conn(0x561a4140bdb0 msgr2=0x561a41426040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:01.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.279+0000 7f7d0b400640 0 client.25793 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:10:01.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.279+0000 7f7d2f457740 1 -- 172.21.15.42:0/1564502427 shutdown_connections 2024-08-26T00:10:01.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.279+0000 7f7d2f457740 1 -- 172.21.15.42:0/1564502427 wait complete. 2024-08-26T00:10:01.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.279+0000 7f7d2f457740 20 client.25793 trim_cache size 0 max 16384 2024-08-26T00:10:01.286 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:10:01.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.280+0000 7f7d2ca00640 1 -- 172.21.15.42:0/3283527583 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7d0c0a2c00 msgr2=0x7f7d0c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:01.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.280+0000 7f7d2ca00640 1 --2- 172.21.15.42:0/3283527583 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7d0c0a2c00 0x7f7d0c0a50c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7d180980e0 tx=0x7f7d180096e0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.280+0000 7f7d2ca00640 1 -- 172.21.15.42:0/3283527583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d28103b50 msgr2=0x7f7d2819a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:01.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.280+0000 7f7d2ca00640 1 --2- 172.21.15.42:0/3283527583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d28103b50 0x7f7d2819a450 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7d1800e9f0 tx=0x7f7d1800eeb0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.280+0000 7f7d2ca00640 1 -- 172.21.15.42:0/3283527583 shutdown_connections 2024-08-26T00:10:01.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.280+0000 7f7d2ca00640 1 --2- 172.21.15.42:0/3283527583 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f7d0c0a2c00 0x7f7d0c0a50c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.280+0000 7f7d2ca00640 1 --2- 172.21.15.42:0/3283527583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d28109c00 0x7f7d2819ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.280+0000 7f7d2ca00640 1 --2- 172.21.15.42:0/3283527583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d281044f0 0x7f7d2819a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.280+0000 7f7d2ca00640 1 --2- 172.21.15.42:0/3283527583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d28103b50 0x7f7d2819a450 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:01.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.280+0000 7f7d2ca00640 1 -- 172.21.15.42:0/3283527583 >> 172.21.15.42:0/3283527583 conn(0x7f7d280ff830 msgr2=0x7f7d28100f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:01.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.280+0000 7f7d2ca00640 1 -- 172.21.15.42:0/3283527583 shutdown_connections 2024-08-26T00:10:01.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:01.280+0000 7f7d2ca00640 1 -- 172.21.15.42:0/3283527583 wait complete. 2024-08-26T00:10:01.998 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-26T00:10:02.379 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:10:02.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:02 smithi043 ceph-mon[22091]: pgmap v564: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 1.2 MiB/s wr, 113 op/s 2024-08-26T00:10:02.518 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:02 smithi042 ceph-mon[17225]: pgmap v564: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 1.2 MiB/s wr, 113 op/s 2024-08-26T00:10:02.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:02 smithi181 ceph-mon[22102]: pgmap v564: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 1.2 MiB/s wr, 113 op/s 2024-08-26T00:10:02.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.937+0000 7f4912800640 1 -- 172.21.15.42:0/2764194777 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f490c101920 msgr2=0x7f490c101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:02.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.937+0000 7f4912800640 1 --2- 172.21.15.42:0/2764194777 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f490c101920 0x7f490c101d80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009930 tx=0x7f48f402a420 comp rx=0 tx=0).stop 2024-08-26T00:10:02.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.937+0000 7f4912800640 1 -- 172.21.15.42:0/2764194777 shutdown_connections 2024-08-26T00:10:02.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.937+0000 7f4912800640 1 --2- 172.21.15.42:0/2764194777 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f490c1022c0 0x7f490c10e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.937+0000 7f4912800640 1 --2- 172.21.15.42:0/2764194777 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f490c101920 0x7f490c101d80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.937+0000 7f4912800640 1 --2- 172.21.15.42:0/2764194777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f490c107920 0x7f490c107d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.937+0000 7f4912800640 1 -- 172.21.15.42:0/2764194777 >> 172.21.15.42:0/2764194777 conn(0x7f490c0fd660 msgr2=0x7f490c0ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:02.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.937+0000 7f4912800640 1 -- 172.21.15.42:0/2764194777 shutdown_connections 2024-08-26T00:10:02.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.937+0000 7f4912800640 1 -- 172.21.15.42:0/2764194777 wait complete. 2024-08-26T00:10:02.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.938+0000 7f4912800640 1 Processor -- start 2024-08-26T00:10:02.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.938+0000 7f4912800640 1 -- start start 2024-08-26T00:10:02.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.938+0000 7f4912800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f490c101920 0x7f490c198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:02.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.938+0000 7f4912800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f490c1022c0 0x7f490c198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:02.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.938+0000 7f4912800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f490c107920 0x7f490c19caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:02.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.938+0000 7f4912800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f490c111d40 con 0x7f490c101920 2024-08-26T00:10:02.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.938+0000 7f4912800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f490c111bc0 con 0x7f490c1022c0 2024-08-26T00:10:02.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.938+0000 7f4912800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f490c111ec0 con 0x7f490c107920 2024-08-26T00:10:02.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.939+0000 7f490b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f490c101920 0x7f490c198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:02.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.939+0000 7f490b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f490c101920 0x7f490c198220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51182/0 (socket says 172.21.15.42:51182) 2024-08-26T00:10:02.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.939+0000 7f490b400640 1 -- 172.21.15.42:0/324264763 learned_addr learned my addr 172.21.15.42:0/324264763 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:02.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.939+0000 7f4903e00640 1 --2- 172.21.15.42:0/324264763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f490c1022c0 0x7f490c198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:02.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.939+0000 7f490be00640 1 --2- 172.21.15.42:0/324264763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f490c107920 0x7f490c19caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:02.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.939+0000 7f490b400640 1 -- 172.21.15.42:0/324264763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f490c107920 msgr2=0x7f490c19caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:02.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.939+0000 7f490b400640 1 --2- 172.21.15.42:0/324264763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f490c107920 0x7f490c19caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.939+0000 7f490b400640 1 -- 172.21.15.42:0/324264763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f490c1022c0 msgr2=0x7f490c198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:02.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.939+0000 7f490b400640 1 --2- 172.21.15.42:0/324264763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f490c1022c0 0x7f490c198760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.939+0000 7f490b400640 1 -- 172.21.15.42:0/324264763 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f490c19d1d0 con 0x7f490c101920 2024-08-26T00:10:02.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.939+0000 7f4903e00640 1 --2- 172.21.15.42:0/324264763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f490c1022c0 0x7f490c198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:10:02.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.940+0000 7f490b400640 1 --2- 172.21.15.42:0/324264763 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f490c101920 0x7f490c198220 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f48fc00e9f0 tx=0x7f48fc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:02.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.940+0000 7f4908c00640 1 -- 172.21.15.42:0/324264763 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc00cd80 con 0x7f490c101920 2024-08-26T00:10:02.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.940+0000 7f4908c00640 1 -- 172.21.15.42:0/324264763 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48fc010910 con 0x7f490c101920 2024-08-26T00:10:02.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.940+0000 7f4912800640 1 -- 172.21.15.42:0/324264763 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f490c19d4c0 con 0x7f490c101920 2024-08-26T00:10:02.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.940+0000 7f4908c00640 1 -- 172.21.15.42:0/324264763 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc018990 con 0x7f490c101920 2024-08-26T00:10:02.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.940+0000 7f4912800640 1 -- 172.21.15.42:0/324264763 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f490c1a4da0 con 0x7f490c101920 2024-08-26T00:10:02.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.943+0000 7f49151f5740 1 Processor -- start 2024-08-26T00:10:02.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.943+0000 7f4908c00640 1 -- 172.21.15.42:0/324264763 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f48fc010ac0 con 0x7f490c101920 2024-08-26T00:10:02.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.943+0000 7f49151f5740 1 -- start start 2024-08-26T00:10:02.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.944+0000 7f49151f5740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f94d27bc30 0x55f94d27c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:02.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.944+0000 7f49151f5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d27c550 0x55f94d2868d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:02.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.944+0000 7f49151f5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d286e10 0x55f94d289200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:02.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.944+0000 7f49151f5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f94d1ddf30 con 0x55f94d286e10 2024-08-26T00:10:02.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.944+0000 7f49151f5740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f94d1755a0 con 0x55f94d27bc30 2024-08-26T00:10:02.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.944+0000 7f49151f5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f94d1d9ef0 con 0x55f94d27c550 2024-08-26T00:10:02.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.944+0000 7f490be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f94d27bc30 0x55f94d27c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:02.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.944+0000 7f4903e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d286e10 0x55f94d289200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:02.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.944+0000 7f490be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f94d27bc30 0x55f94d27c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:58714/0 (socket says 172.21.15.42:58714) 2024-08-26T00:10:02.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.944+0000 7f490be00640 1 -- 172.21.15.42:0/1755560007 learned_addr learned my addr 172.21.15.42:0/1755560007 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:02.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.944+0000 7f490b400640 1 --2- 172.21.15.42:0/1755560007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d27c550 0x55f94d2868d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:02.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.944+0000 7f490be00640 1 -- 172.21.15.42:0/1755560007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d27c550 msgr2=0x55f94d2868d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:02.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.944+0000 7f490be00640 1 --2- 172.21.15.42:0/1755560007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d27c550 0x55f94d2868d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.944+0000 7f490be00640 1 -- 172.21.15.42:0/1755560007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d286e10 msgr2=0x55f94d289200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:02.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.944+0000 7f490be00640 1 --2- 172.21.15.42:0/1755560007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d286e10 0x55f94d289200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.944+0000 7f490be00640 1 -- 172.21.15.42:0/1755560007 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f94cf4f3c0 con 0x55f94d27bc30 2024-08-26T00:10:02.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.945+0000 7f490be00640 1 --2- 172.21.15.42:0/1755560007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f94d27bc30 0x55f94d27c010 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4904009fd0 tx=0x7f49040118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb1f1648df678f6a server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:02.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.945+0000 7f4908c00640 1 --2- 172.21.15.42:0/324264763 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48f00a2c00 0x7f48f00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:02.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.945+0000 7f4900c00640 1 -- 172.21.15.42:0/1755560007 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4904004d20 con 0x55f94d27bc30 2024-08-26T00:10:02.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.945+0000 7f4900c00640 1 -- 172.21.15.42:0/1755560007 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4904004050 con 0x55f94d27bc30 2024-08-26T00:10:02.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.945+0000 7f4900c00640 1 -- 172.21.15.42:0/1755560007 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4904005260 con 0x55f94d27bc30 2024-08-26T00:10:02.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.945+0000 7f4908c00640 1 -- 172.21.15.42:0/324264763 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f48fc0cf250 con 0x7f490c101920 2024-08-26T00:10:02.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.945+0000 7f490b400640 1 --2- 172.21.15.42:0/324264763 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48f00a2c00 0x7f48f00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:02.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.946+0000 7f49151f5740 1 -- 172.21.15.42:0/1755560007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f94d27bc30 msgr2=0x55f94d27c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:02.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.946+0000 7f49151f5740 1 --2- 172.21.15.42:0/1755560007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f94d27bc30 0x55f94d27c010 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4904009fd0 tx=0x7f49040118d0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.946+0000 7f490b400640 1 --2- 172.21.15.42:0/324264763 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48f00a2c00 0x7f48f00a50c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f48fc09bab0 tx=0x7f48fc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:02.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.946+0000 7f49151f5740 1 -- 172.21.15.42:0/1755560007 shutdown_connections 2024-08-26T00:10:02.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.946+0000 7f49151f5740 1 --2- 172.21.15.42:0/1755560007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d286e10 0x55f94d289200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.946+0000 7f49151f5740 1 --2- 172.21.15.42:0/1755560007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d27c550 0x55f94d2868d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.946+0000 7f49151f5740 1 --2- 172.21.15.42:0/1755560007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f94d27bc30 0x55f94d27c010 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.946+0000 7f49151f5740 1 -- 172.21.15.42:0/1755560007 >> 172.21.15.42:0/1755560007 conn(0x55f94d2781c0 msgr2=0x55f94d2785a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:02.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.946+0000 7f49151f5740 1 -- 172.21.15.42:0/1755560007 shutdown_connections 2024-08-26T00:10:02.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.946+0000 7f49151f5740 1 -- 172.21.15.42:0/1755560007 wait complete. 2024-08-26T00:10:02.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.947+0000 7f49151f5740 1 -- start start 2024-08-26T00:10:02.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.947+0000 7f49151f5740 1 Processor -- start 2024-08-26T00:10:02.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.947+0000 7f49151f5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d27bc30 0x55f94d283cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:02.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.947+0000 7f49151f5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d27c550 0x55f94d284210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:02.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.947+0000 7f49151f5740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f94d286e10 0x55f94d284750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:02.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.947+0000 7f49151f5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f94d2899e0 con 0x55f94d27c550 2024-08-26T00:10:02.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.947+0000 7f49151f5740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f94d198de0 con 0x55f94d286e10 2024-08-26T00:10:02.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.947+0000 7f49151f5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f94d289b60 con 0x55f94d27bc30 2024-08-26T00:10:02.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.947+0000 7f49151f5740 10 client.0 _ll_register_callbacks cb 0x55f94d1877b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:10:02.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.948+0000 7f490be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d27bc30 0x55f94d283cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:02.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.948+0000 7f4903e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d27c550 0x55f94d284210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:02.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.948+0000 7f490be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d27bc30 0x55f94d283cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:39236/0 (socket says 172.21.15.42:39236) 2024-08-26T00:10:02.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.948+0000 7f490be00640 1 -- 172.21.15.42:0/2600042521 learned_addr learned my addr 172.21.15.42:0/2600042521 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:02.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.948+0000 7f490be00640 1 --2- 172.21.15.42:0/2600042521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f94d286e10 0x55f94d284750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:02.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.948+0000 7f490be00640 1 -- 172.21.15.42:0/2600042521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f94d286e10 msgr2=0x55f94d284750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.948+0000 7f490be00640 1 --2- 172.21.15.42:0/2600042521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f94d286e10 0x55f94d284750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.948+0000 7f490be00640 1 -- 172.21.15.42:0/2600042521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d27c550 msgr2=0x55f94d284210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.948+0000 7f490be00640 1 --2- 172.21.15.42:0/2600042521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d27c550 0x55f94d284210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.948+0000 7f490be00640 1 -- 172.21.15.42:0/2600042521 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f94d292e50 con 0x55f94d27bc30 2024-08-26T00:10:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.948+0000 7f4903e00640 1 --2- 172.21.15.42:0/2600042521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d27c550 0x55f94d284210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:10:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.948+0000 7f490be00640 1 --2- 172.21.15.42:0/2600042521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d27bc30 0x55f94d283cd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4904009de0 tx=0x7f4904009be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b1e42c7d2ed09e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.948+0000 7f48f9600640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:10:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.949+0000 7f48f9600640 1 -- 172.21.15.42:0/2600042521 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4904004610 con 0x55f94d27bc30 2024-08-26T00:10:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.949+0000 7f49151f5740 1 -- 172.21.15.42:0/2600042521 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4904004050 con 0x55f94d27bc30 2024-08-26T00:10:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.949+0000 7f48f9600640 1 -- 172.21.15.42:0/2600042521 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f490400f4e0 con 0x55f94d27bc30 2024-08-26T00:10:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.949+0000 7f48f9600640 1 -- 172.21.15.42:0/2600042521 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f490400f6e0 con 0x55f94d27bc30 2024-08-26T00:10:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.949+0000 7f49151f5740 10 client.25777 fetch_fsmap learned FSMap version 29 2024-08-26T00:10:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.949+0000 7f49151f5740 1 -- 172.21.15.42:0/2600042521 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f94d295790 con 0x55f94d27bc30 2024-08-26T00:10:02.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.949+0000 7f48f9600640 1 -- 172.21.15.42:0/2600042521 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4904004050 con 0x55f94d27bc30 2024-08-26T00:10:02.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.949+0000 7f48f9600640 1 -- 172.21.15.42:0/2600042521 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4904025040 con 0x55f94d27bc30 2024-08-26T00:10:02.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.950+0000 7f49151f5740 10 client.25777 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:10:02.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.950+0000 7f49151f5740 10 client.25777 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:10:02.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.950+0000 7f49151f5740 20 client.25777 populate_metadata read hostname 'smithi042' 2024-08-26T00:10:02.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.950+0000 7f49151f5740 1 --2- 172.21.15.42:0/2600042521 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55f94d296ba0 0x55f94d298f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:02.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.950+0000 7f49151f5740 4 client.25777 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:10:02.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.950+0000 7f49151f5740 1 -- 172.21.15.42:0/2600042521 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f94d1eb4a0 con 0x55f94d296ba0 2024-08-26T00:10:02.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.950+0000 7f4903e00640 1 --2- 172.21.15.42:0/2600042521 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55f94d296ba0 0x55f94d298f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.950+0000 7f4903e00640 1 --2- 172.21.15.42:0/2600042521 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55f94d296ba0 0x55f94d298f90 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b06d94f312e82967 server_cookie=8d7f4de10baace5 in_seq=0 out_seq=0 2024-08-26T00:10:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.950+0000 7f48f9600640 10 client.25777 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.951+0000 7f48f9600640 1 -- 172.21.15.42:0/2600042521 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f94d1eb4a0 con 0x55f94d296ba0 2024-08-26T00:10:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.951+0000 7f48f9600640 10 client.25777 handle_command_reply: tid=0 2024-08-26T00:10:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.951+0000 7f49151f5740 1 client.25777 shutdown 2024-08-26T00:10:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.952+0000 7f49151f5740 1 -- 172.21.15.42:0/2600042521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d27bc30 msgr2=0x55f94d283cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.952+0000 7f49151f5740 1 --2- 172.21.15.42:0/2600042521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d27bc30 0x55f94d283cd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4904009de0 tx=0x7f4904009be0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.952+0000 7f49151f5740 1 -- 172.21.15.42:0/2600042521 shutdown_connections 2024-08-26T00:10:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.952+0000 7f49151f5740 1 --2- 172.21.15.42:0/2600042521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f94d286e10 0x55f94d284750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.952+0000 7f49151f5740 1 --2- 172.21.15.42:0/2600042521 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55f94d296ba0 0x55f94d298f90 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.952+0000 7f49151f5740 1 --2- 172.21.15.42:0/2600042521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d27c550 0x55f94d284210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.952+0000 7f49151f5740 1 --2- 172.21.15.42:0/2600042521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d27bc30 0x55f94d283cd0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.952+0000 7f48f9600640 0 client.25777 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.952+0000 7f49151f5740 1 -- 172.21.15.42:0/2600042521 >> 172.21.15.42:0/2600042521 conn(0x55f94d2781c0 msgr2=0x55f94d272f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.952+0000 7f49151f5740 1 -- 172.21.15.42:0/2600042521 shutdown_connections 2024-08-26T00:10:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.952+0000 7f49151f5740 1 -- 172.21.15.42:0/2600042521 wait complete. 2024-08-26T00:10:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.952+0000 7f49151f5740 20 client.25777 trim_cache size 0 max 16384 2024-08-26T00:10:02.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.966+0000 7f49151f5740 1 Processor -- start 2024-08-26T00:10:02.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.966+0000 7f49151f5740 1 -- start start 2024-08-26T00:10:02.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.966+0000 7f49151f5740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f94d27bc30 0x55f94d27dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:02.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.966+0000 7f49151f5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d27c550 0x55f94d284240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:02.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.966+0000 7f49151f5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d286e10 0x55f94d284780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:02.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.966+0000 7f49151f5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f490c1adbc0 con 0x55f94d27c550 2024-08-26T00:10:02.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.966+0000 7f49151f5740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f490c1ab3d0 con 0x55f94d27bc30 2024-08-26T00:10:02.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.966+0000 7f49151f5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f490c1a9200 con 0x55f94d286e10 2024-08-26T00:10:02.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.966+0000 7f4903e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d27c550 0x55f94d284240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:02.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.966+0000 7f4903e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d27c550 0x55f94d284240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51210/0 (socket says 172.21.15.42:51210) 2024-08-26T00:10:02.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.966+0000 7f4903e00640 1 -- 172.21.15.42:0/2673484489 learned_addr learned my addr 172.21.15.42:0/2673484489 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:02.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.966+0000 7f490be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f94d27bc30 0x55f94d27dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:02.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.966+0000 7f490be00640 1 --2- 172.21.15.42:0/2673484489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d286e10 0x55f94d284780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:02.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.967+0000 7f4903e00640 1 -- 172.21.15.42:0/2673484489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d286e10 msgr2=0x55f94d284780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:02.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.967+0000 7f4903e00640 1 --2- 172.21.15.42:0/2673484489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d286e10 0x55f94d284780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.967+0000 7f4903e00640 1 -- 172.21.15.42:0/2673484489 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f94d27bc30 msgr2=0x55f94d27dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:02.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.967+0000 7f4903e00640 1 --2- 172.21.15.42:0/2673484489 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f94d27bc30 0x55f94d27dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.967+0000 7f4903e00640 1 -- 172.21.15.42:0/2673484489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f94d279350 con 0x55f94d27c550 2024-08-26T00:10:02.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.967+0000 7f490be00640 1 --2- 172.21.15.42:0/2673484489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d286e10 0x55f94d284780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:10:02.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.967+0000 7f4903e00640 1 --2- 172.21.15.42:0/2673484489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d27c550 0x55f94d284240 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f48f402aa10 tx=0x7f48f4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99aecdf65fef15f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:02.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.967+0000 7f48fbe00640 1 -- 172.21.15.42:0/2673484489 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f4035040 con 0x55f94d27c550 2024-08-26T00:10:02.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.967+0000 7f48fbe00640 1 -- 172.21.15.42:0/2673484489 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48f404b070 con 0x55f94d27c550 2024-08-26T00:10:02.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.967+0000 7f48fbe00640 1 -- 172.21.15.42:0/2673484489 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f4031930 con 0x55f94d27c550 2024-08-26T00:10:02.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.968+0000 7f49151f5740 1 -- 172.21.15.42:0/2673484489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d27c550 msgr2=0x55f94d284240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:02.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.968+0000 7f49151f5740 1 --2- 172.21.15.42:0/2673484489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d27c550 0x55f94d284240 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f48f402aa10 tx=0x7f48f4000bc0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.968+0000 7f49151f5740 1 -- 172.21.15.42:0/2673484489 shutdown_connections 2024-08-26T00:10:02.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.968+0000 7f49151f5740 1 --2- 172.21.15.42:0/2673484489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d286e10 0x55f94d284780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.968+0000 7f49151f5740 1 --2- 172.21.15.42:0/2673484489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d27c550 0x55f94d284240 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.968+0000 7f49151f5740 1 --2- 172.21.15.42:0/2673484489 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f94d27bc30 0x55f94d27dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.968+0000 7f49151f5740 1 -- 172.21.15.42:0/2673484489 >> 172.21.15.42:0/2673484489 conn(0x55f94d2781c0 msgr2=0x55f94d27d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:02.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.968+0000 7f49151f5740 1 -- 172.21.15.42:0/2673484489 shutdown_connections 2024-08-26T00:10:02.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.968+0000 7f49151f5740 1 -- 172.21.15.42:0/2673484489 wait complete. 2024-08-26T00:10:02.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.968+0000 7f49151f5740 1 -- start start 2024-08-26T00:10:02.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.969+0000 7f49151f5740 1 Processor -- start 2024-08-26T00:10:02.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.969+0000 7f49151f5740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f94d27bc30 0x55f94d28a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:02.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.969+0000 7f49151f5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d27c550 0x55f94d28aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:02.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.969+0000 7f49151f5740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d286e10 0x55f94d2f9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:02.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.969+0000 7f49151f5740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f490c1a9890 con 0x55f94d286e10 2024-08-26T00:10:02.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.969+0000 7f49151f5740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f490c1aad00 con 0x55f94d27bc30 2024-08-26T00:10:02.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.969+0000 7f49151f5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f490c1a9f60 con 0x55f94d27c550 2024-08-26T00:10:02.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.969+0000 7f49151f5740 10 client.0 _ll_register_callbacks cb 0x7f48fc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:10:02.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.969+0000 7f4903e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d27c550 0x55f94d28aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:02.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.969+0000 7f490be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d286e10 0x55f94d2f9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:02.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.969+0000 7f4903e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d27c550 0x55f94d28aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:39256/0 (socket says 172.21.15.42:39256) 2024-08-26T00:10:02.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.969+0000 7f4903e00640 1 -- 172.21.15.42:0/1346482771 learned_addr learned my addr 172.21.15.42:0/1346482771 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:02.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.970+0000 7f490be00640 1 --2- 172.21.15.42:0/1346482771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f94d27bc30 0x55f94d28a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:02.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.970+0000 7f4903e00640 1 -- 172.21.15.42:0/1346482771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f94d27bc30 msgr2=0x55f94d28a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:02.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.970+0000 7f4903e00640 1 --2- 172.21.15.42:0/1346482771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f94d27bc30 0x55f94d28a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.970+0000 7f4903e00640 1 -- 172.21.15.42:0/1346482771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d286e10 msgr2=0x55f94d2f9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:02.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.970+0000 7f4903e00640 1 --2- 172.21.15.42:0/1346482771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d286e10 0x55f94d2f9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.970+0000 7f4903e00640 1 -- 172.21.15.42:0/1346482771 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f94d2f9d70 con 0x55f94d27c550 2024-08-26T00:10:02.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.970+0000 7f490be00640 1 --2- 172.21.15.42:0/1346482771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d286e10 0x55f94d2f9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:10:02.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.970+0000 7f4903e00640 1 --2- 172.21.15.42:0/1346482771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d27c550 0x55f94d28aa70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009230 tx=0x7f48f402a420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f97a4736afcd8cf0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:02.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.970+0000 7f48f9600640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:10:02.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.971+0000 7f48f9600640 1 -- 172.21.15.42:0/1346482771 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f4053030 con 0x55f94d27c550 2024-08-26T00:10:02.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.971+0000 7f48f9600640 1 -- 172.21.15.42:0/1346482771 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f48f4004760 con 0x55f94d27c550 2024-08-26T00:10:02.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.971+0000 7f49151f5740 1 -- 172.21.15.42:0/1346482771 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48f404b070 con 0x55f94d27c550 2024-08-26T00:10:02.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.971+0000 7f48f9600640 1 -- 172.21.15.42:0/1346482771 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f48f4035040 con 0x55f94d27c550 2024-08-26T00:10:02.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.971+0000 7f49151f5740 10 client.25783 fetch_fsmap learned FSMap version 29 2024-08-26T00:10:02.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.971+0000 7f49151f5740 1 -- 172.21.15.42:0/1346482771 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f94d3010b0 con 0x55f94d27c550 2024-08-26T00:10:02.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.971+0000 7f48f9600640 1 -- 172.21.15.42:0/1346482771 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48f404b070 con 0x55f94d27c550 2024-08-26T00:10:02.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.971+0000 7f48f9600640 1 -- 172.21.15.42:0/1346482771 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f48f4031b00 con 0x55f94d27c550 2024-08-26T00:10:02.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.971+0000 7f49151f5740 10 client.25783 fetch_fsmap finished waiting for FSMap version 29 2024-08-26T00:10:02.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.971+0000 7f49151f5740 10 client.25783 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:10:02.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.971+0000 7f49151f5740 20 client.25783 populate_metadata read hostname 'smithi042' 2024-08-26T00:10:02.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.971+0000 7f49151f5740 1 --2- 172.21.15.42:0/1346482771 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55f94d301820 0x55f94d303c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:02.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.971+0000 7f49151f5740 4 client.25783 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:10:02.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.971+0000 7f49151f5740 1 -- 172.21.15.42:0/1346482771 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f94d1e59b0 con 0x55f94d301820 2024-08-26T00:10:02.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.972+0000 7f490be00640 1 --2- 172.21.15.42:0/1346482771 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55f94d301820 0x55f94d303c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:02.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.972+0000 7f490be00640 1 --2- 172.21.15.42:0/1346482771 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55f94d301820 0x55f94d303c40 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5df8fc07931d6e4 server_cookie=995036eddd4e139a in_seq=0 out_seq=0 2024-08-26T00:10:02.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.972+0000 7f48f9600640 10 client.25783 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:02.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.972+0000 7f48f9600640 1 -- 172.21.15.42:0/1346482771 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f94d1e59b0 con 0x55f94d301820 2024-08-26T00:10:02.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.972+0000 7f48f9600640 10 client.25783 handle_command_reply: tid=0 2024-08-26T00:10:02.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.972+0000 7f49151f5740 1 client.25783 shutdown 2024-08-26T00:10:02.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.972+0000 7f49151f5740 1 -- 172.21.15.42:0/1346482771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d27c550 msgr2=0x55f94d28aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:02.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.972+0000 7f49151f5740 1 --2- 172.21.15.42:0/1346482771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d27c550 0x55f94d28aa70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009230 tx=0x7f48f402a420 comp rx=0 tx=0).stop 2024-08-26T00:10:02.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.973+0000 7f49151f5740 1 -- 172.21.15.42:0/1346482771 shutdown_connections 2024-08-26T00:10:02.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.973+0000 7f49151f5740 1 --2- 172.21.15.42:0/1346482771 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55f94d301820 0x55f94d303c40 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.973+0000 7f49151f5740 1 --2- 172.21.15.42:0/1346482771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f94d286e10 0x55f94d2f9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.973+0000 7f49151f5740 1 --2- 172.21.15.42:0/1346482771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f94d27c550 0x55f94d28aa70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.973+0000 7f49151f5740 1 --2- 172.21.15.42:0/1346482771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f94d27bc30 0x55f94d28a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.973+0000 7f48f9600640 0 client.25783 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:02.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.973+0000 7f49151f5740 1 -- 172.21.15.42:0/1346482771 >> 172.21.15.42:0/1346482771 conn(0x55f94d2781c0 msgr2=0x55f94d27dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:02.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.973+0000 7f49151f5740 1 -- 172.21.15.42:0/1346482771 shutdown_connections 2024-08-26T00:10:02.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.973+0000 7f49151f5740 1 -- 172.21.15.42:0/1346482771 wait complete. 2024-08-26T00:10:02.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.973+0000 7f49151f5740 20 client.25783 trim_cache size 0 max 16384 2024-08-26T00:10:02.977 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:10:02.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.973+0000 7f4912800640 1 -- 172.21.15.42:0/324264763 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48f00a2c00 msgr2=0x7f48f00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:02.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.973+0000 7f4912800640 1 --2- 172.21.15.42:0/324264763 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48f00a2c00 0x7f48f00a50c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f48fc09bab0 tx=0x7f48fc000bc0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.974+0000 7f4912800640 1 -- 172.21.15.42:0/324264763 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f490c101920 msgr2=0x7f490c198220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:02.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.974+0000 7f4912800640 1 --2- 172.21.15.42:0/324264763 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f490c101920 0x7f490c198220 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f48fc00e9f0 tx=0x7f48fc00eeb0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.974+0000 7f4912800640 1 -- 172.21.15.42:0/324264763 shutdown_connections 2024-08-26T00:10:02.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.974+0000 7f4912800640 1 --2- 172.21.15.42:0/324264763 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48f00a2c00 0x7f48f00a50c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.974+0000 7f4912800640 1 --2- 172.21.15.42:0/324264763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f490c107920 0x7f490c19caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.974+0000 7f4912800640 1 --2- 172.21.15.42:0/324264763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f490c1022c0 0x7f490c198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.974+0000 7f4912800640 1 --2- 172.21.15.42:0/324264763 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f490c101920 0x7f490c198220 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:02.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.974+0000 7f4912800640 1 -- 172.21.15.42:0/324264763 >> 172.21.15.42:0/324264763 conn(0x7f490c0fd660 msgr2=0x7f490c0fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:02.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.974+0000 7f4912800640 1 -- 172.21.15.42:0/324264763 shutdown_connections 2024-08-26T00:10:02.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:02.974+0000 7f4912800640 1 -- 172.21.15.42:0/324264763 wait complete. 2024-08-26T00:10:04.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:04 smithi043 ceph-mon[22091]: pgmap v565: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 174 KiB/s wr, 32 op/s 2024-08-26T00:10:04.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:04 smithi043 ceph-mon[22091]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:10:04.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:04 smithi042 ceph-mon[17225]: pgmap v565: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 174 KiB/s wr, 32 op/s 2024-08-26T00:10:04.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:04 smithi042 ceph-mon[17225]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:10:04.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:04 smithi181 ceph-mon[22102]: pgmap v565: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 174 KiB/s wr, 32 op/s 2024-08-26T00:10:04.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:04 smithi181 ceph-mon[22102]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:10:04.690 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-26T00:10:04.690 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-26T00:10:05.187 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:10:05.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.791+0000 7f47d5800640 1 -- 172.21.15.42:0/2934832786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47d0107920 msgr2=0x7f47d0107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:05.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.791+0000 7f47d5800640 1 --2- 172.21.15.42:0/2934832786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47d0107920 0x7f47d0107d00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009930 tx=0x7f47c002a440 comp rx=0 tx=0).stop 2024-08-26T00:10:05.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.791+0000 7f47d5800640 1 -- 172.21.15.42:0/2934832786 shutdown_connections 2024-08-26T00:10:05.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.791+0000 7f47d5800640 1 --2- 172.21.15.42:0/2934832786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47d01022c0 0x7f47d010e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.791+0000 7f47d5800640 1 --2- 172.21.15.42:0/2934832786 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47d0101920 0x7f47d0101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.791+0000 7f47d5800640 1 --2- 172.21.15.42:0/2934832786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47d0107920 0x7f47d0107d00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.791+0000 7f47d5800640 1 -- 172.21.15.42:0/2934832786 >> 172.21.15.42:0/2934832786 conn(0x7f47d00fd660 msgr2=0x7f47d00ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:05.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.791+0000 7f47d5800640 1 -- 172.21.15.42:0/2934832786 shutdown_connections 2024-08-26T00:10:05.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.791+0000 7f47d5800640 1 -- 172.21.15.42:0/2934832786 wait complete. 2024-08-26T00:10:05.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.792+0000 7f47d5800640 1 Processor -- start 2024-08-26T00:10:05.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.792+0000 7f47d5800640 1 -- start start 2024-08-26T00:10:05.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.792+0000 7f47d5800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47d0101920 0x7f47d0198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:05.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.792+0000 7f47d5800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47d01022c0 0x7f47d0198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:05.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.792+0000 7f47d5800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47d0107920 0x7f47d019cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:05.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.792+0000 7f47d5800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f47d0111cf0 con 0x7f47d0107920 2024-08-26T00:10:05.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.792+0000 7f47d5800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f47d0111b70 con 0x7f47d0101920 2024-08-26T00:10:05.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.792+0000 7f47d5800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f47d0111e70 con 0x7f47d01022c0 2024-08-26T00:10:05.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.793+0000 7f47cf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47d0107920 0x7f47d019cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:05.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.793+0000 7f47cf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47d0107920 0x7f47d019cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40370/0 (socket says 172.21.15.42:40370) 2024-08-26T00:10:05.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.793+0000 7f47cf400640 1 -- 172.21.15.42:0/3360467768 learned_addr learned my addr 172.21.15.42:0/3360467768 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:05.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.793+0000 7f47cea00640 1 --2- 172.21.15.42:0/3360467768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47d0101920 0x7f47d0198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:05.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.793+0000 7f47c6000640 1 --2- 172.21.15.42:0/3360467768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47d01022c0 0x7f47d0198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:05.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.793+0000 7f47c6000640 1 -- 172.21.15.42:0/3360467768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47d0101920 msgr2=0x7f47d0198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:05.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.793+0000 7f47c6000640 1 --2- 172.21.15.42:0/3360467768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47d0101920 0x7f47d0198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.793+0000 7f47c6000640 1 -- 172.21.15.42:0/3360467768 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47d0107920 msgr2=0x7f47d019cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:05.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.793+0000 7f47c6000640 1 --2- 172.21.15.42:0/3360467768 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47d0107920 0x7f47d019cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.793+0000 7f47c6000640 1 -- 172.21.15.42:0/3360467768 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d019d1e0 con 0x7f47d01022c0 2024-08-26T00:10:05.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.793+0000 7f47cf400640 1 --2- 172.21.15.42:0/3360467768 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47d0107920 0x7f47d019cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:10:05.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.793+0000 7f47c6000640 1 --2- 172.21.15.42:0/3360467768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47d01022c0 0x7f47d0198770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f47b800e9f0 tx=0x7f47b800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:05.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.794+0000 7f47c7e00640 1 -- 172.21.15.42:0/3360467768 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b800cd80 con 0x7f47d01022c0 2024-08-26T00:10:05.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.794+0000 7f47d5800640 1 -- 172.21.15.42:0/3360467768 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d019d4d0 con 0x7f47d01022c0 2024-08-26T00:10:05.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.794+0000 7f47c7e00640 1 -- 172.21.15.42:0/3360467768 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47b80035f0 con 0x7f47d01022c0 2024-08-26T00:10:05.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.794+0000 7f47c7e00640 1 -- 172.21.15.42:0/3360467768 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b8010670 con 0x7f47d01022c0 2024-08-26T00:10:05.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.794+0000 7f47d5800640 1 -- 172.21.15.42:0/3360467768 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d01a4db0 con 0x7f47d01022c0 2024-08-26T00:10:05.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.798+0000 7f47d81fb740 1 Processor -- start 2024-08-26T00:10:05.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.798+0000 7f47d81fb740 1 -- start start 2024-08-26T00:10:05.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.798+0000 7f47c7e00640 1 -- 172.21.15.42:0/3360467768 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f47b80037a0 con 0x7f47d01022c0 2024-08-26T00:10:05.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.799+0000 7f47d81fb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd82c10 0x55d22dd82ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:05.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.799+0000 7f47d81fb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd83530 0x55d22dd91de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:05.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.799+0000 7f47d81fb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d22dd92320 0x55d22dd94710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:05.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.799+0000 7f47d81fb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d22dce9e30 con 0x55d22dd82c10 2024-08-26T00:10:05.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.799+0000 7f47d81fb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d22dc813c0 con 0x55d22dd83530 2024-08-26T00:10:05.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.799+0000 7f47d81fb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d22dce5df0 con 0x55d22dd92320 2024-08-26T00:10:05.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.799+0000 7f47cf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd82c10 0x55d22dd82ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:05.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.799+0000 7f47cf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd82c10 0x55d22dd82ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40382/0 (socket says 172.21.15.42:40382) 2024-08-26T00:10:05.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.799+0000 7f47cf400640 1 -- 172.21.15.42:0/2014777237 learned_addr learned my addr 172.21.15.42:0/2014777237 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:05.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.799+0000 7f47cea00640 1 --2- 172.21.15.42:0/2014777237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd83530 0x55d22dd91de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:05.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.799+0000 7f47c6000640 1 --2- 172.21.15.42:0/2014777237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d22dd92320 0x55d22dd94710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:05.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.799+0000 7f47cf400640 1 -- 172.21.15.42:0/2014777237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d22dd92320 msgr2=0x55d22dd94710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:05.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.799+0000 7f47cf400640 1 --2- 172.21.15.42:0/2014777237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d22dd92320 0x55d22dd94710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.799+0000 7f47cf400640 1 -- 172.21.15.42:0/2014777237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd83530 msgr2=0x55d22dd91de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:05.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.799+0000 7f47cf400640 1 --2- 172.21.15.42:0/2014777237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd83530 0x55d22dd91de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.799+0000 7f47cf400640 1 -- 172.21.15.42:0/2014777237 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d22da5b6a0 con 0x55d22dd82c10 2024-08-26T00:10:05.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.799+0000 7f47cea00640 1 --2- 172.21.15.42:0/2014777237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd83530 0x55d22dd91de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:10:05.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.800+0000 7f47cf400640 1 --2- 172.21.15.42:0/2014777237 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd82c10 0x55d22dd82ff0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f47c800e830 tx=0x7f47c800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97912c9919f562f server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:05.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.800+0000 7f47bfe00640 1 -- 172.21.15.42:0/2014777237 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c8004d20 con 0x55d22dd82c10 2024-08-26T00:10:05.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.800+0000 7f47bfe00640 1 -- 172.21.15.42:0/2014777237 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47c8005020 con 0x55d22dd82c10 2024-08-26T00:10:05.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.800+0000 7f47bfe00640 1 -- 172.21.15.42:0/2014777237 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c800f620 con 0x55d22dd82c10 2024-08-26T00:10:05.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.800+0000 7f47c7e00640 1 --2- 172.21.15.42:0/3360467768 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47b40a2b80 0x7f47b40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:05.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.801+0000 7f47c7e00640 1 -- 172.21.15.42:0/3360467768 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f47b80cf320 con 0x7f47d01022c0 2024-08-26T00:10:05.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.801+0000 7f47d81fb740 1 -- 172.21.15.42:0/2014777237 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd82c10 msgr2=0x55d22dd82ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:05.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.801+0000 7f47d81fb740 1 --2- 172.21.15.42:0/2014777237 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd82c10 0x55d22dd82ff0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f47c800e830 tx=0x7f47c800ecf0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.801+0000 7f47cea00640 1 --2- 172.21.15.42:0/3360467768 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47b40a2b80 0x7f47b40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:05.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.801+0000 7f47d81fb740 1 -- 172.21.15.42:0/2014777237 shutdown_connections 2024-08-26T00:10:05.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.801+0000 7f47d81fb740 1 --2- 172.21.15.42:0/2014777237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d22dd92320 0x55d22dd94710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.801+0000 7f47d81fb740 1 --2- 172.21.15.42:0/2014777237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd83530 0x55d22dd91de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.801+0000 7f47d81fb740 1 --2- 172.21.15.42:0/2014777237 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd82c10 0x55d22dd82ff0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.801+0000 7f47d81fb740 1 -- 172.21.15.42:0/2014777237 >> 172.21.15.42:0/2014777237 conn(0x55d22dd7f2c0 msgr2=0x55d22dd7f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:05.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.801+0000 7f47d81fb740 1 -- 172.21.15.42:0/2014777237 shutdown_connections 2024-08-26T00:10:05.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.801+0000 7f47d81fb740 1 -- 172.21.15.42:0/2014777237 wait complete. 2024-08-26T00:10:05.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.802+0000 7f47cea00640 1 --2- 172.21.15.42:0/3360467768 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47b40a2b80 0x7f47b40a5040 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009900 tx=0x7f47c00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:05.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.802+0000 7f47d81fb740 1 -- start start 2024-08-26T00:10:05.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.802+0000 7f47d81fb740 1 Processor -- start 2024-08-26T00:10:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.803+0000 7f47d81fb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd82c10 0x55d22dd8f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.803+0000 7f47d81fb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd83530 0x55d22dd8f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.803+0000 7f47d81fb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d22dd92320 0x55d22dd8fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.803+0000 7f47d81fb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d22dd94ef0 con 0x55d22dd82c10 2024-08-26T00:10:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.803+0000 7f47d81fb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d22dca4c30 con 0x55d22dd83530 2024-08-26T00:10:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.803+0000 7f47d81fb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d22dd95070 con 0x55d22dd92320 2024-08-26T00:10:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.803+0000 7f47d81fb740 10 client.0 _ll_register_callbacks cb 0x55d22d9f8ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:10:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.803+0000 7f47cea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd82c10 0x55d22dd8f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.803+0000 7f47c6000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd83530 0x55d22dd8f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.803+0000 7f47cf400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d22dd92320 0x55d22dd8fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.803+0000 7f47cea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd82c10 0x55d22dd8f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40388/0 (socket says 172.21.15.42:40388) 2024-08-26T00:10:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.803+0000 7f47cea00640 1 -- 172.21.15.42:0/1725273710 learned_addr learned my addr 172.21.15.42:0/1725273710 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:05.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.803+0000 7f47c6000640 1 -- 172.21.15.42:0/1725273710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d22dd92320 msgr2=0x55d22dd8fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:05.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.803+0000 7f47c6000640 1 --2- 172.21.15.42:0/1725273710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d22dd92320 0x55d22dd8fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.803+0000 7f47c6000640 1 -- 172.21.15.42:0/1725273710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd82c10 msgr2=0x55d22dd8f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:05.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.803+0000 7f47c6000640 1 --2- 172.21.15.42:0/1725273710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd82c10 0x55d22dd8f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.803+0000 7f47c6000640 1 -- 172.21.15.42:0/1725273710 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d22dcb0dd0 con 0x55d22dd83530 2024-08-26T00:10:05.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.804+0000 7f47c6000640 1 --2- 172.21.15.42:0/1725273710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd83530 0x55d22dd8f770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55d22dd803b0 tx=0x7f47b809b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8015b36621155c69 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:05.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.804+0000 7f47bcc00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:10:05.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.804+0000 7f47bcc00640 1 -- 172.21.15.42:0/1725273710 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b809bb80 con 0x55d22dd83530 2024-08-26T00:10:05.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.804+0000 7f47bcc00640 1 -- 172.21.15.42:0/1725273710 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f47b8003b30 con 0x55d22dd83530 2024-08-26T00:10:05.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.804+0000 7f47d81fb740 1 -- 172.21.15.42:0/1725273710 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47c8005020 con 0x55d22dd83530 2024-08-26T00:10:05.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.804+0000 7f47bcc00640 1 -- 172.21.15.42:0/1725273710 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f47b80b9050 con 0x55d22dd83530 2024-08-26T00:10:05.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.804+0000 7f47d81fb740 10 client.25823 fetch_fsmap learned FSMap version 30 2024-08-26T00:10:05.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.804+0000 7f47d81fb740 1 -- 172.21.15.42:0/1725273710 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d22dda0b50 con 0x55d22dd83530 2024-08-26T00:10:05.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.804+0000 7f47bcc00640 1 -- 172.21.15.42:0/1725273710 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47c8005020 con 0x55d22dd83530 2024-08-26T00:10:05.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.805+0000 7f47bcc00640 1 -- 172.21.15.42:0/1725273710 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f47b80a43f0 con 0x55d22dd83530 2024-08-26T00:10:05.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.805+0000 7f47d81fb740 10 client.25823 fetch_fsmap finished waiting for FSMap version 30 2024-08-26T00:10:05.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.805+0000 7f47d81fb740 10 client.25823 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:10:05.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.805+0000 7f47d81fb740 20 client.25823 populate_metadata read hostname 'smithi042' 2024-08-26T00:10:05.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.805+0000 7f47d81fb740 1 --2- 172.21.15.42:0/1725273710 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d22dda1f60 0x55d22dda43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:05.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.805+0000 7f47d81fb740 4 client.25823 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:10:05.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.805+0000 7f47d81fb740 1 -- 172.21.15.42:0/1725273710 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d22dcf73a0 con 0x55d22dda1f60 2024-08-26T00:10:05.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.805+0000 7f47cea00640 1 --2- 172.21.15.42:0/1725273710 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d22dda1f60 0x55d22dda43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:05.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.806+0000 7f47cea00640 1 --2- 172.21.15.42:0/1725273710 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d22dda1f60 0x55d22dda43b0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80950ec5f1a7a506 server_cookie=a4637d9cee0c1a8c in_seq=0 out_seq=0 2024-08-26T00:10:05.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.806+0000 7f47bcc00640 10 client.25823 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:05.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.807+0000 7f47bcc00640 1 -- 172.21.15.42:0/1725273710 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d22dcf73a0 con 0x55d22dda1f60 2024-08-26T00:10:05.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.807+0000 7f47bcc00640 10 client.25823 handle_command_reply: tid=0 2024-08-26T00:10:05.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.807+0000 7f47d81fb740 1 client.25823 shutdown 2024-08-26T00:10:05.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.807+0000 7f47d81fb740 1 -- 172.21.15.42:0/1725273710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd83530 msgr2=0x55d22dd8f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:05.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.807+0000 7f47d81fb740 1 --2- 172.21.15.42:0/1725273710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd83530 0x55d22dd8f770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55d22dd803b0 tx=0x7f47b809b9d0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.807+0000 7f47d81fb740 1 -- 172.21.15.42:0/1725273710 shutdown_connections 2024-08-26T00:10:05.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.807+0000 7f47d81fb740 1 --2- 172.21.15.42:0/1725273710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d22dd92320 0x55d22dd8fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.807+0000 7f47d81fb740 1 --2- 172.21.15.42:0/1725273710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd83530 0x55d22dd8f770 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.807+0000 7f47d81fb740 1 --2- 172.21.15.42:0/1725273710 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d22dda1f60 0x55d22dda43b0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.807+0000 7f47d81fb740 1 --2- 172.21.15.42:0/1725273710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd82c10 0x55d22dd8f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.807+0000 7f47d81fb740 1 -- 172.21.15.42:0/1725273710 >> 172.21.15.42:0/1725273710 conn(0x55d22dd7f2c0 msgr2=0x55d22dd85020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:05.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.807+0000 7f47bcc00640 0 client.25823 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:05.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.807+0000 7f47d81fb740 1 -- 172.21.15.42:0/1725273710 shutdown_connections 2024-08-26T00:10:05.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.807+0000 7f47d81fb740 1 -- 172.21.15.42:0/1725273710 wait complete. 2024-08-26T00:10:05.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.808+0000 7f47d81fb740 20 client.25823 trim_cache size 0 max 16384 2024-08-26T00:10:05.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.826+0000 7f47d81fb740 1 Processor -- start 2024-08-26T00:10:05.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.826+0000 7f47d81fb740 1 -- start start 2024-08-26T00:10:05.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.826+0000 7f47d81fb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd82c10 0x55d22dda9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:05.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.826+0000 7f47d81fb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd83530 0x55d22ddaa1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:05.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.826+0000 7f47d81fb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d22dd92320 0x55d22dd8c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:05.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.826+0000 7f47d81fb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f47d01adba0 con 0x55d22dd82c10 2024-08-26T00:10:05.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.826+0000 7f47d81fb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f47d01ab3e0 con 0x55d22dd83530 2024-08-26T00:10:05.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.826+0000 7f47d81fb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f47d01a9210 con 0x55d22dd92320 2024-08-26T00:10:05.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.826+0000 7f47c6000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd83530 0x55d22ddaa1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:05.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.826+0000 7f47c6000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd83530 0x55d22ddaa1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:58090/0 (socket says 172.21.15.42:58090) 2024-08-26T00:10:05.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.826+0000 7f47c6000640 1 -- 172.21.15.42:0/2164576925 learned_addr learned my addr 172.21.15.42:0/2164576925 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:05.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.826+0000 7f47cea00640 1 --2- 172.21.15.42:0/2164576925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd82c10 0x55d22dda9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:05.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.827+0000 7f47cf400640 1 --2- 172.21.15.42:0/2164576925 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d22dd92320 0x55d22dd8c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:05.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.827+0000 7f47c6000640 1 -- 172.21.15.42:0/2164576925 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d22dd92320 msgr2=0x55d22dd8c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:05.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.827+0000 7f47c6000640 1 --2- 172.21.15.42:0/2164576925 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d22dd92320 0x55d22dd8c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.827+0000 7f47c6000640 1 -- 172.21.15.42:0/2164576925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd82c10 msgr2=0x55d22dda9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:05.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.827+0000 7f47c6000640 1 --2- 172.21.15.42:0/2164576925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd82c10 0x55d22dda9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.827+0000 7f47c6000640 1 -- 172.21.15.42:0/2164576925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d22dd7f0f0 con 0x55d22dd83530 2024-08-26T00:10:05.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.827+0000 7f47cf400640 1 --2- 172.21.15.42:0/2164576925 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d22dd92320 0x55d22dd8c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:10:05.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.827+0000 7f47cea00640 1 --2- 172.21.15.42:0/2164576925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd82c10 0x55d22dda9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:10:05.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.827+0000 7f47c6000640 1 --2- 172.21.15.42:0/2164576925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd83530 0x55d22ddaa1c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f47b809b880 tx=0x7f47b809ba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6409c959ed18208 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:05.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.828+0000 7f47bf400640 1 -- 172.21.15.42:0/2164576925 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b807f070 con 0x55d22dd83530 2024-08-26T00:10:05.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.828+0000 7f47bf400640 1 -- 172.21.15.42:0/2164576925 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47b80a47f0 con 0x55d22dd83530 2024-08-26T00:10:05.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.828+0000 7f47bf400640 1 -- 172.21.15.42:0/2164576925 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b8003c50 con 0x55d22dd83530 2024-08-26T00:10:05.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.828+0000 7f47d81fb740 1 -- 172.21.15.42:0/2164576925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd83530 msgr2=0x55d22ddaa1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:05.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.828+0000 7f47d81fb740 1 --2- 172.21.15.42:0/2164576925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd83530 0x55d22ddaa1c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f47b809b880 tx=0x7f47b809ba40 comp rx=0 tx=0).stop 2024-08-26T00:10:05.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.828+0000 7f47d81fb740 1 -- 172.21.15.42:0/2164576925 shutdown_connections 2024-08-26T00:10:05.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.828+0000 7f47d81fb740 1 --2- 172.21.15.42:0/2164576925 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d22dd92320 0x55d22dd8c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.828+0000 7f47d81fb740 1 --2- 172.21.15.42:0/2164576925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd83530 0x55d22ddaa1c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.828+0000 7f47d81fb740 1 --2- 172.21.15.42:0/2164576925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd82c10 0x55d22dda9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.828+0000 7f47d81fb740 1 -- 172.21.15.42:0/2164576925 >> 172.21.15.42:0/2164576925 conn(0x55d22dd7f2c0 msgr2=0x55d22dd84f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:05.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.829+0000 7f47d81fb740 1 -- 172.21.15.42:0/2164576925 shutdown_connections 2024-08-26T00:10:05.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.829+0000 7f47d81fb740 1 -- 172.21.15.42:0/2164576925 wait complete. 2024-08-26T00:10:05.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.829+0000 7f47d81fb740 1 -- start start 2024-08-26T00:10:05.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.829+0000 7f47d81fb740 1 Processor -- start 2024-08-26T00:10:05.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.830+0000 7f47d81fb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd82c10 0x55d22dd96960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:05.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.830+0000 7f47d81fb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd83530 0x55d22dd96ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:05.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.830+0000 7f47d81fb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d22dd92320 0x55d22de05c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:05.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.830+0000 7f47d81fb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f47d01a98a0 con 0x55d22dd83530 2024-08-26T00:10:05.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.830+0000 7f47d81fb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f47d01aad10 con 0x55d22dd82c10 2024-08-26T00:10:05.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.830+0000 7f47d81fb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f47d01a9f70 con 0x55d22dd92320 2024-08-26T00:10:05.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.830+0000 7f47d81fb740 10 client.0 _ll_register_callbacks cb 0x7f47b800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:10:05.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.830+0000 7f47cea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd82c10 0x55d22dd96960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:05.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.830+0000 7f47c6000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd83530 0x55d22dd96ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:05.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.830+0000 7f47cea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd82c10 0x55d22dd96960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:58104/0 (socket says 172.21.15.42:58104) 2024-08-26T00:10:05.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.830+0000 7f47cea00640 1 -- 172.21.15.42:0/637646621 learned_addr learned my addr 172.21.15.42:0/637646621 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:05.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.830+0000 7f47cf400640 1 --2- 172.21.15.42:0/637646621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d22dd92320 0x55d22de05c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:05.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.831+0000 7f47cea00640 1 -- 172.21.15.42:0/637646621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d22dd92320 msgr2=0x55d22de05c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:05.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.831+0000 7f47cea00640 1 --2- 172.21.15.42:0/637646621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d22dd92320 0x55d22de05c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.831+0000 7f47cea00640 1 -- 172.21.15.42:0/637646621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd83530 msgr2=0x55d22dd96ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:05.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.831+0000 7f47cea00640 1 --2- 172.21.15.42:0/637646621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd83530 0x55d22dd96ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.831+0000 7f47cea00640 1 -- 172.21.15.42:0/637646621 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d22de06250 con 0x55d22dd82c10 2024-08-26T00:10:05.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.831+0000 7f47cea00640 1 --2- 172.21.15.42:0/637646621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd82c10 0x55d22dd96960 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f47c0005940 tx=0x7f47c0009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53e8350514423f1c server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:05.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.831+0000 7f47bcc00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:10:05.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.831+0000 7f47bcc00640 1 -- 172.21.15.42:0/637646621 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c0035040 con 0x55d22dd82c10 2024-08-26T00:10:05.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.832+0000 7f47bcc00640 1 -- 172.21.15.42:0/637646621 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f47c0003bc0 con 0x55d22dd82c10 2024-08-26T00:10:05.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.832+0000 7f47d81fb740 1 -- 172.21.15.42:0/637646621 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47b80a47f0 con 0x55d22dd82c10 2024-08-26T00:10:05.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.832+0000 7f47bcc00640 1 -- 172.21.15.42:0/637646621 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f47c0064050 con 0x55d22dd82c10 2024-08-26T00:10:05.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.832+0000 7f47d81fb740 10 client.25829 fetch_fsmap learned FSMap version 30 2024-08-26T00:10:05.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.832+0000 7f47d81fb740 1 -- 172.21.15.42:0/637646621 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d22de0d6a0 con 0x55d22dd82c10 2024-08-26T00:10:05.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.832+0000 7f47bcc00640 1 -- 172.21.15.42:0/637646621 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47b80a47f0 con 0x55d22dd82c10 2024-08-26T00:10:05.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.832+0000 7f47bcc00640 1 -- 172.21.15.42:0/637646621 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f47c003d450 con 0x55d22dd82c10 2024-08-26T00:10:05.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.833+0000 7f47d81fb740 10 client.25829 fetch_fsmap finished waiting for FSMap version 30 2024-08-26T00:10:05.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.833+0000 7f47d81fb740 10 client.25829 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:10:05.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.833+0000 7f47d81fb740 20 client.25829 populate_metadata read hostname 'smithi042' 2024-08-26T00:10:05.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.833+0000 7f47d81fb740 1 --2- 172.21.15.42:0/637646621 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d22de0ddb0 0x55d22de101d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:05.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.833+0000 7f47d81fb740 4 client.25829 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-26T00:10:05.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.833+0000 7f47d81fb740 1 -- 172.21.15.42:0/637646621 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d22dcf18b0 con 0x55d22de0ddb0 2024-08-26T00:10:05.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.833+0000 7f47c6000640 1 --2- 172.21.15.42:0/637646621 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d22de0ddb0 0x55d22de101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:05.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.833+0000 7f47c6000640 1 --2- 172.21.15.42:0/637646621 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d22de0ddb0 0x55d22de101d0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e933f9170199ea3 server_cookie=eaaf55788f6f2132 in_seq=0 out_seq=0 2024-08-26T00:10:05.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.833+0000 7f47bcc00640 10 client.25829 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:05.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.834+0000 7f47bcc00640 1 -- 172.21.15.42:0/637646621 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d22dcf18b0 con 0x55d22de0ddb0 2024-08-26T00:10:05.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.834+0000 7f47bcc00640 10 client.25829 handle_command_reply: tid=0 2024-08-26T00:10:05.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.834+0000 7f47d81fb740 1 client.25829 shutdown 2024-08-26T00:10:05.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.835+0000 7f47d81fb740 1 -- 172.21.15.42:0/637646621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd82c10 msgr2=0x55d22dd96960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:05.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.835+0000 7f47d81fb740 1 --2- 172.21.15.42:0/637646621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd82c10 0x55d22dd96960 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f47c0005940 tx=0x7f47c0009260 comp rx=0 tx=0).stop 2024-08-26T00:10:05.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.835+0000 7f47d81fb740 1 -- 172.21.15.42:0/637646621 shutdown_connections 2024-08-26T00:10:05.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.835+0000 7f47d81fb740 1 --2- 172.21.15.42:0/637646621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d22dd92320 0x55d22de05c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.835+0000 7f47d81fb740 1 --2- 172.21.15.42:0/637646621 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d22de0ddb0 0x55d22de101d0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.835+0000 7f47d81fb740 1 --2- 172.21.15.42:0/637646621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d22dd83530 0x55d22dd96ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.835+0000 7f47d81fb740 1 --2- 172.21.15.42:0/637646621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d22dd82c10 0x55d22dd96960 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.835+0000 7f47bcc00640 0 client.25829 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:05.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.835+0000 7f47d81fb740 1 -- 172.21.15.42:0/637646621 >> 172.21.15.42:0/637646621 conn(0x55d22dd7f2c0 msgr2=0x55d22dd84770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:05.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.835+0000 7f47d81fb740 1 -- 172.21.15.42:0/637646621 shutdown_connections 2024-08-26T00:10:05.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.835+0000 7f47d81fb740 1 -- 172.21.15.42:0/637646621 wait complete. 2024-08-26T00:10:05.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.835+0000 7f47d81fb740 20 client.25829 trim_cache size 0 max 16384 2024-08-26T00:10:05.838 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:10:05.838 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-08-26T00:10:05.838 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "167dd245-95ce-478b-a2eb-843f32642cbc", 2024-08-26T00:10:05.838 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-08-26T00:10:05.838 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:10:05.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.836+0000 7f47d5800640 1 -- 172.21.15.42:0/3360467768 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47b40a2b80 msgr2=0x7f47b40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:05.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.836+0000 7f47d5800640 1 --2- 172.21.15.42:0/3360467768 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47b40a2b80 0x7f47b40a5040 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009900 tx=0x7f47c00058d0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.836+0000 7f47d5800640 1 -- 172.21.15.42:0/3360467768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47d01022c0 msgr2=0x7f47d0198770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:05.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.836+0000 7f47d5800640 1 --2- 172.21.15.42:0/3360467768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47d01022c0 0x7f47d0198770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f47b800e9f0 tx=0x7f47b800eeb0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.836+0000 7f47d5800640 1 -- 172.21.15.42:0/3360467768 shutdown_connections 2024-08-26T00:10:05.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.836+0000 7f47d5800640 1 --2- 172.21.15.42:0/3360467768 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47b40a2b80 0x7f47b40a5040 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.836+0000 7f47d5800640 1 --2- 172.21.15.42:0/3360467768 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47d0107920 0x7f47d019cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.836+0000 7f47d5800640 1 --2- 172.21.15.42:0/3360467768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47d01022c0 0x7f47d0198770 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.836+0000 7f47d5800640 1 --2- 172.21.15.42:0/3360467768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47d0101920 0x7f47d0198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:05.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.836+0000 7f47d5800640 1 -- 172.21.15.42:0/3360467768 >> 172.21.15.42:0/3360467768 conn(0x7f47d00fd660 msgr2=0x7f47d00fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:05.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.836+0000 7f47d5800640 1 -- 172.21.15.42:0/3360467768 shutdown_connections 2024-08-26T00:10:05.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:05.836+0000 7f47d5800640 1 -- 172.21.15.42:0/3360467768 wait complete. 2024-08-26T00:10:06.371 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-08-26T00:10:06.371 INFO:tasks.workunit.client.0.smithi042.stdout:Final score for writes: 553 2024-08-26T00:10:06.371 INFO:tasks.workunit.client.0.smithi042.stdout:Final score for reads : 308730 2024-08-26T00:10:06.371 INFO:tasks.workunit.client.0.smithi042.stdout: 2024-08-26T00:10:06.372 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-26T00:10:06.373 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-26T00:10:06.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:06 smithi043 ceph-mon[22091]: pgmap v566: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-26T00:10:06.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:06 smithi043 ceph-mon[22091]: scrub queued for path: / 2024-08-26T00:10:06.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:06 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:06.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:06 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:06.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:06 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:06.513 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:06 smithi181 ceph-mon[22102]: pgmap v566: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-26T00:10:06.513 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:06 smithi181 ceph-mon[22102]: scrub queued for path: / 2024-08-26T00:10:06.513 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:06 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:06.513 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:06 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:06.513 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:06 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:06.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:06 smithi042 ceph-mon[17225]: pgmap v566: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-26T00:10:06.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:06 smithi042 ceph-mon[17225]: scrub queued for path: / 2024-08-26T00:10:06.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:06 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:06.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:06 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:06.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:06 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:06.740 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-26T00:10:07.282 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:10:07.439 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:07 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:07.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:07 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:07.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:07 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:08.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.095+0000 7f2156800640 1 -- 172.21.15.42:0/4071523899 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21500764c0 msgr2=0x7f21500768a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:08.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.095+0000 7f2156800640 1 --2- 172.21.15.42:0/4071523899 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21500764c0 0x7f21500768a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2140009900 tx=0x7f214002a410 comp rx=0 tx=0).stop 2024-08-26T00:10:08.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.096+0000 7f2156800640 1 -- 172.21.15.42:0/4071523899 shutdown_connections 2024-08-26T00:10:08.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.096+0000 7f2156800640 1 --2- 172.21.15.42:0/4071523899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21501127a0 0x7f2150114b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.096+0000 7f2156800640 1 --2- 172.21.15.42:0/4071523899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2150076de0 0x7f2150112260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.096+0000 7f2156800640 1 --2- 172.21.15.42:0/4071523899 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21500764c0 0x7f21500768a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.096+0000 7f2156800640 1 -- 172.21.15.42:0/4071523899 >> 172.21.15.42:0/4071523899 conn(0x7f21500ff7c0 msgr2=0x7f2150101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:08.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.096+0000 7f2156800640 1 -- 172.21.15.42:0/4071523899 shutdown_connections 2024-08-26T00:10:08.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.096+0000 7f2156800640 1 -- 172.21.15.42:0/4071523899 wait complete. 2024-08-26T00:10:08.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.097+0000 7f2156800640 1 Processor -- start 2024-08-26T00:10:08.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.097+0000 7f2156800640 1 -- start start 2024-08-26T00:10:08.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.098+0000 7f2156800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21500764c0 0x7f21501a4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:08.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.098+0000 7f2156800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2150076de0 0x7f21501a4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:08.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.098+0000 7f2156800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21501127a0 0x7f215019e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:08.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.098+0000 7f2156800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2150118380 con 0x7f21501127a0 2024-08-26T00:10:08.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.098+0000 7f2156800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2150118200 con 0x7f2150076de0 2024-08-26T00:10:08.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.098+0000 7f2156800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2150118500 con 0x7f21500764c0 2024-08-26T00:10:08.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.099+0000 7f214fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21501127a0 0x7f215019e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:08.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.099+0000 7f214f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21500764c0 0x7f21501a4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:08.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.099+0000 7f214fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21501127a0 0x7f215019e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40436/0 (socket says 172.21.15.42:40436) 2024-08-26T00:10:08.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.099+0000 7f214fe00640 1 -- 172.21.15.42:0/1581289565 learned_addr learned my addr 172.21.15.42:0/1581289565 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:08.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.099+0000 7f214ea00640 1 --2- 172.21.15.42:0/1581289565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2150076de0 0x7f21501a4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:08.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.099+0000 7f214fe00640 1 -- 172.21.15.42:0/1581289565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21500764c0 msgr2=0x7f21501a4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:08.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.100+0000 7f214fe00640 1 --2- 172.21.15.42:0/1581289565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21500764c0 0x7f21501a4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.100+0000 7f214fe00640 1 -- 172.21.15.42:0/1581289565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2150076de0 msgr2=0x7f21501a4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:08.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.100+0000 7f214fe00640 1 --2- 172.21.15.42:0/1581289565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2150076de0 0x7f21501a4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.100+0000 7f214fe00640 1 -- 172.21.15.42:0/1581289565 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215019eea0 con 0x7f21501127a0 2024-08-26T00:10:08.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.100+0000 7f214fe00640 1 --2- 172.21.15.42:0/1581289565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21501127a0 0x7f215019e630 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f214800eb10 tx=0x7f214800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:08.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.100+0000 7f2147e00640 1 -- 172.21.15.42:0/1581289565 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2148004b20 con 0x7f21501127a0 2024-08-26T00:10:08.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.100+0000 7f2156800640 1 -- 172.21.15.42:0/1581289565 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215019f190 con 0x7f21501127a0 2024-08-26T00:10:08.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.101+0000 7f2156800640 1 -- 172.21.15.42:0/1581289565 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21501ab4e0 con 0x7f21501127a0 2024-08-26T00:10:08.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.101+0000 7f2147e00640 1 -- 172.21.15.42:0/1581289565 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2148004cc0 con 0x7f21501127a0 2024-08-26T00:10:08.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.101+0000 7f2147e00640 1 -- 172.21.15.42:0/1581289565 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2148010690 con 0x7f21501127a0 2024-08-26T00:10:08.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.106+0000 7f2147e00640 1 -- 172.21.15.42:0/1581289565 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2148005000 con 0x7f21501127a0 2024-08-26T00:10:08.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.107+0000 7f215946f740 1 Processor -- start 2024-08-26T00:10:08.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.108+0000 7f215946f740 1 -- start start 2024-08-26T00:10:08.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.108+0000 7f215946f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56015646d940 0x56015646dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:08.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.108+0000 7f215946f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56015646e260 0x5601564785e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:08.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.108+0000 7f215946f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560156478b20 0x56015647af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:08.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.108+0000 7f215946f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5601563d3fc0 con 0x56015646e260 2024-08-26T00:10:08.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.108+0000 7f215946f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56015636b680 con 0x560156478b20 2024-08-26T00:10:08.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.108+0000 7f215946f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5601563cff80 con 0x56015646d940 2024-08-26T00:10:08.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.109+0000 7f214ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56015646d940 0x56015646dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:08.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.109+0000 7f214ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56015646d940 0x56015646dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:48882/0 (socket says 172.21.15.42:48882) 2024-08-26T00:10:08.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.109+0000 7f214ea00640 1 -- 172.21.15.42:0/3429673004 learned_addr learned my addr 172.21.15.42:0/3429673004 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:08.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.109+0000 7f214ea00640 1 --2- 172.21.15.42:0/3429673004 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560156478b20 0x56015647af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:08.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.109+0000 7f214f400640 1 --2- 172.21.15.42:0/3429673004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56015646e260 0x5601564785e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:08.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.110+0000 7f214ea00640 1 -- 172.21.15.42:0/3429673004 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560156478b20 msgr2=0x56015647af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:08.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.110+0000 7f214ea00640 1 --2- 172.21.15.42:0/3429673004 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560156478b20 0x56015647af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.110+0000 7f214ea00640 1 -- 172.21.15.42:0/3429673004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56015646e260 msgr2=0x5601564785e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:08.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.110+0000 7f214ea00640 1 --2- 172.21.15.42:0/3429673004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56015646e260 0x5601564785e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.110+0000 7f214ea00640 1 -- 172.21.15.42:0/3429673004 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601563872c0 con 0x56015646d940 2024-08-26T00:10:08.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.110+0000 7f214f400640 1 --2- 172.21.15.42:0/3429673004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56015646e260 0x5601564785e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:10:08.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.110+0000 7f2147e00640 1 --2- 172.21.15.42:0/1581289565 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f21340a2c00 0x7f21340a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:08.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.110+0000 7f214ea00640 1 --2- 172.21.15.42:0/3429673004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56015646d940 0x56015646dd20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f213c009fd0 tx=0x7f213c005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cfa2fc906c65c89 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:08.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.110+0000 7f2147e00640 1 -- 172.21.15.42:0/1581289565 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f21480cf5f0 con 0x7f21501127a0 2024-08-26T00:10:08.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.111+0000 7f214f400640 1 --2- 172.21.15.42:0/1581289565 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f21340a2c00 0x7f21340a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:08.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.111+0000 7f2144c00640 1 -- 172.21.15.42:0/3429673004 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213c004030 con 0x56015646d940 2024-08-26T00:10:08.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.112+0000 7f2144c00640 1 -- 172.21.15.42:0/3429673004 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f213c005500 con 0x56015646d940 2024-08-26T00:10:08.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.112+0000 7f2144c00640 1 -- 172.21.15.42:0/3429673004 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213c004d70 con 0x56015646d940 2024-08-26T00:10:08.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.113+0000 7f215946f740 1 -- 172.21.15.42:0/3429673004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56015646d940 msgr2=0x56015646dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:08.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.113+0000 7f215946f740 1 --2- 172.21.15.42:0/3429673004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56015646d940 0x56015646dd20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f213c009fd0 tx=0x7f213c005850 comp rx=0 tx=0).stop 2024-08-26T00:10:08.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.113+0000 7f214f400640 1 --2- 172.21.15.42:0/1581289565 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f21340a2c00 0x7f21340a50c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2140000c00 tx=0x7f2140005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:08.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.113+0000 7f215946f740 1 -- 172.21.15.42:0/3429673004 shutdown_connections 2024-08-26T00:10:08.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.113+0000 7f215946f740 1 --2- 172.21.15.42:0/3429673004 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560156478b20 0x56015647af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.113+0000 7f215946f740 1 --2- 172.21.15.42:0/3429673004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56015646e260 0x5601564785e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.113+0000 7f215946f740 1 --2- 172.21.15.42:0/3429673004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56015646d940 0x56015646dd20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.113+0000 7f215946f740 1 -- 172.21.15.42:0/3429673004 >> 172.21.15.42:0/3429673004 conn(0x560156469ed0 msgr2=0x56015646a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:08.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.113+0000 7f215946f740 1 -- 172.21.15.42:0/3429673004 shutdown_connections 2024-08-26T00:10:08.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.113+0000 7f215946f740 1 -- 172.21.15.42:0/3429673004 wait complete. 2024-08-26T00:10:08.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.114+0000 7f215946f740 1 -- start start 2024-08-26T00:10:08.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.114+0000 7f215946f740 1 Processor -- start 2024-08-26T00:10:08.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.115+0000 7f215946f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56015646d940 0x5601564759f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:08.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.115+0000 7f215946f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56015646e260 0x560156475f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:08.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.115+0000 7f215946f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560156478b20 0x560156476470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:08.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.115+0000 7f215946f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56015647b6f0 con 0x56015646e260 2024-08-26T00:10:08.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.115+0000 7f215946f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56015638ee50 con 0x560156478b20 2024-08-26T00:10:08.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.115+0000 7f215946f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56015647b870 con 0x56015646d940 2024-08-26T00:10:08.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.115+0000 7f215946f740 10 client.0 _ll_register_callbacks cb 0x560156379f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:10:08.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.116+0000 7f214f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56015646d940 0x5601564759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:08.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.116+0000 7f214fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560156478b20 0x560156476470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:08.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.116+0000 7f214fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560156478b20 0x560156476470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:58142/0 (socket says 172.21.15.42:58142) 2024-08-26T00:10:08.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.116+0000 7f214f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56015646d940 0x5601564759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:48896/0 (socket says 172.21.15.42:48896) 2024-08-26T00:10:08.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.116+0000 7f214fe00640 1 -- 172.21.15.42:0/2027678792 learned_addr learned my addr 172.21.15.42:0/2027678792 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:08.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.116+0000 7f214ea00640 1 --2- 172.21.15.42:0/2027678792 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56015646e260 0x560156475f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:08.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.117+0000 7f214fe00640 1 -- 172.21.15.42:0/2027678792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56015646d940 msgr2=0x5601564759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:08.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.117+0000 7f214fe00640 1 --2- 172.21.15.42:0/2027678792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56015646d940 0x5601564759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.117+0000 7f214fe00640 1 -- 172.21.15.42:0/2027678792 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56015646e260 msgr2=0x560156475f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:08.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.117+0000 7f214fe00640 1 --2- 172.21.15.42:0/2027678792 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56015646e260 0x560156475f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.117+0000 7f214fe00640 1 -- 172.21.15.42:0/2027678792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601561453c0 con 0x560156478b20 2024-08-26T00:10:08.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.117+0000 7f214fe00640 1 --2- 172.21.15.42:0/2027678792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560156478b20 0x560156476470 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f21480a4590 tx=0x7f214809c550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d94e695170929573 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:08.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.117+0000 7f2139600640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:10:08.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.117+0000 7f2139600640 1 -- 172.21.15.42:0/2027678792 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21480a4830 con 0x560156478b20 2024-08-26T00:10:08.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.118+0000 7f2139600640 1 -- 172.21.15.42:0/2027678792 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f214809b2a0 con 0x560156478b20 2024-08-26T00:10:08.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.118+0000 7f215946f740 1 -- 172.21.15.42:0/2027678792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f213c005500 con 0x560156478b20 2024-08-26T00:10:08.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.118+0000 7f2139600640 1 -- 172.21.15.42:0/2027678792 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f21480ba020 con 0x560156478b20 2024-08-26T00:10:08.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.118+0000 7f215946f740 10 client.25841 fetch_fsmap learned FSMap version 30 2024-08-26T00:10:08.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.118+0000 7f215946f740 1 -- 172.21.15.42:0/2027678792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560156487380 con 0x560156478b20 2024-08-26T00:10:08.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.119+0000 7f2139600640 1 -- 172.21.15.42:0/2027678792 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f213c005500 con 0x560156478b20 2024-08-26T00:10:08.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.119+0000 7f2139600640 1 -- 172.21.15.42:0/2027678792 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f214809af10 con 0x560156478b20 2024-08-26T00:10:08.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.119+0000 7f215946f740 10 client.25841 fetch_fsmap finished waiting for FSMap version 30 2024-08-26T00:10:08.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.119+0000 7f215946f740 10 client.25841 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:10:08.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.119+0000 7f215946f740 20 client.25841 populate_metadata read hostname 'smithi042' 2024-08-26T00:10:08.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.119+0000 7f215946f740 1 --2- 172.21.15.42:0/2027678792 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x560156488840 0x56015648ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:08.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.119+0000 7f215946f740 4 client.25841 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:10:08.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.119+0000 7f215946f740 1 -- 172.21.15.42:0/2027678792 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601563e1530 con 0x560156488840 2024-08-26T00:10:08.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.121+0000 7f214f400640 1 --2- 172.21.15.42:0/2027678792 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x560156488840 0x56015648ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:08.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.122+0000 7f214f400640 1 --2- 172.21.15.42:0/2027678792 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x560156488840 0x56015648ac70 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52b4be02657d5b4 server_cookie=8a76637f1b251948 in_seq=0 out_seq=0 2024-08-26T00:10:08.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.122+0000 7f2139600640 10 client.25841 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:08.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.123+0000 7f2139600640 1 -- 172.21.15.42:0/2027678792 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5601563e1530 con 0x560156488840 2024-08-26T00:10:08.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.123+0000 7f2139600640 10 client.25841 handle_command_reply: tid=0 2024-08-26T00:10:08.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.123+0000 7f215946f740 1 client.25841 shutdown 2024-08-26T00:10:08.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.124+0000 7f215946f740 1 -- 172.21.15.42:0/2027678792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560156478b20 msgr2=0x560156476470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:08.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.124+0000 7f215946f740 1 --2- 172.21.15.42:0/2027678792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560156478b20 0x560156476470 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f21480a4590 tx=0x7f214809c550 comp rx=0 tx=0).stop 2024-08-26T00:10:08.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.124+0000 7f215946f740 1 -- 172.21.15.42:0/2027678792 shutdown_connections 2024-08-26T00:10:08.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.124+0000 7f215946f740 1 --2- 172.21.15.42:0/2027678792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560156478b20 0x560156476470 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.124+0000 7f215946f740 1 --2- 172.21.15.42:0/2027678792 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x560156488840 0x56015648ac70 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.124+0000 7f215946f740 1 --2- 172.21.15.42:0/2027678792 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56015646e260 0x560156475f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.124+0000 7f215946f740 1 --2- 172.21.15.42:0/2027678792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56015646d940 0x5601564759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.124+0000 7f215946f740 1 -- 172.21.15.42:0/2027678792 >> 172.21.15.42:0/2027678792 conn(0x560156469ed0 msgr2=0x560156469050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:08.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.125+0000 7f2139600640 0 client.25841 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:08.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.125+0000 7f215946f740 1 -- 172.21.15.42:0/2027678792 shutdown_connections 2024-08-26T00:10:08.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.125+0000 7f215946f740 1 -- 172.21.15.42:0/2027678792 wait complete. 2024-08-26T00:10:08.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.125+0000 7f215946f740 20 client.25841 trim_cache size 0 max 16384 2024-08-26T00:10:08.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.152+0000 7f215946f740 1 Processor -- start 2024-08-26T00:10:08.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.152+0000 7f215946f740 1 -- start start 2024-08-26T00:10:08.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.153+0000 7f215946f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56015646d940 0x560156470d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:08.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.153+0000 7f215946f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56015646e260 0x560156468f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:08.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.153+0000 7f215946f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560156478b20 0x560156490580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:08.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.153+0000 7f215946f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2130010df0 con 0x56015646e260 2024-08-26T00:10:08.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.153+0000 7f215946f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f213000e630 con 0x56015646d940 2024-08-26T00:10:08.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.153+0000 7f215946f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f213000c460 con 0x560156478b20 2024-08-26T00:10:08.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.153+0000 7f214fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560156478b20 0x560156490580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:08.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.153+0000 7f214fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560156478b20 0x560156490580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:48902/0 (socket says 172.21.15.42:48902) 2024-08-26T00:10:08.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.153+0000 7f214fe00640 1 -- 172.21.15.42:0/3587113304 learned_addr learned my addr 172.21.15.42:0/3587113304 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:08.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.153+0000 7f214ea00640 1 --2- 172.21.15.42:0/3587113304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56015646e260 0x560156468f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:08.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.154+0000 7f214f400640 1 --2- 172.21.15.42:0/3587113304 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56015646d940 0x560156470d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:08.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.154+0000 7f214fe00640 1 -- 172.21.15.42:0/3587113304 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56015646d940 msgr2=0x560156470d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:08.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.154+0000 7f214fe00640 1 --2- 172.21.15.42:0/3587113304 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56015646d940 0x560156470d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.154+0000 7f214fe00640 1 -- 172.21.15.42:0/3587113304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56015646e260 msgr2=0x560156468f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:08.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.154+0000 7f214fe00640 1 --2- 172.21.15.42:0/3587113304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56015646e260 0x560156468f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.154+0000 7f214fe00640 1 -- 172.21.15.42:0/3587113304 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601564749a0 con 0x560156478b20 2024-08-26T00:10:08.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.154+0000 7f214fe00640 1 --2- 172.21.15.42:0/3587113304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560156478b20 0x560156490580 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f214809bb50 tx=0x7f214809a360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=924262b3bfb5059a server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:08.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.155+0000 7f213be00640 1 -- 172.21.15.42:0/3587113304 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21480a4ac0 con 0x560156478b20 2024-08-26T00:10:08.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.155+0000 7f213be00640 1 -- 172.21.15.42:0/3587113304 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f214809e050 con 0x560156478b20 2024-08-26T00:10:08.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.155+0000 7f213be00640 1 -- 172.21.15.42:0/3587113304 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2148097e00 con 0x560156478b20 2024-08-26T00:10:08.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.156+0000 7f215946f740 1 -- 172.21.15.42:0/3587113304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560156478b20 msgr2=0x560156490580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:08.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.156+0000 7f215946f740 1 --2- 172.21.15.42:0/3587113304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560156478b20 0x560156490580 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f214809bb50 tx=0x7f214809a360 comp rx=0 tx=0).stop 2024-08-26T00:10:08.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.156+0000 7f215946f740 1 -- 172.21.15.42:0/3587113304 shutdown_connections 2024-08-26T00:10:08.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.156+0000 7f215946f740 1 --2- 172.21.15.42:0/3587113304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560156478b20 0x560156490580 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.156+0000 7f215946f740 1 --2- 172.21.15.42:0/3587113304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56015646e260 0x560156468f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.156+0000 7f215946f740 1 --2- 172.21.15.42:0/3587113304 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56015646d940 0x560156470d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.156+0000 7f215946f740 1 -- 172.21.15.42:0/3587113304 >> 172.21.15.42:0/3587113304 conn(0x560156469ed0 msgr2=0x560156468830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:08.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.157+0000 7f215946f740 1 -- 172.21.15.42:0/3587113304 shutdown_connections 2024-08-26T00:10:08.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.157+0000 7f215946f740 1 -- 172.21.15.42:0/3587113304 wait complete. 2024-08-26T00:10:08.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.157+0000 7f215946f740 1 -- start start 2024-08-26T00:10:08.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.157+0000 7f215946f740 1 Processor -- start 2024-08-26T00:10:08.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.158+0000 7f215946f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56015646d940 0x560156481200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:08.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.158+0000 7f215946f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56015646e260 0x56015647c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:08.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.158+0000 7f215946f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560156478b20 0x56015647cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:08.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.158+0000 7f215946f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f213000caf0 con 0x56015646d940 2024-08-26T00:10:08.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.158+0000 7f215946f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f213000df60 con 0x560156478b20 2024-08-26T00:10:08.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.158+0000 7f215946f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f213000d1c0 con 0x56015646e260 2024-08-26T00:10:08.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.158+0000 7f215946f740 10 client.0 _ll_register_callbacks cb 0x7f2148004ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:10:08.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.159+0000 7f214f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56015646d940 0x560156481200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:08.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.159+0000 7f214f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56015646d940 0x560156481200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40464/0 (socket says 172.21.15.42:40464) 2024-08-26T00:10:08.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.159+0000 7f214f400640 1 -- 172.21.15.42:0/3809995903 learned_addr learned my addr 172.21.15.42:0/3809995903 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:08.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.160+0000 7f214f400640 1 -- 172.21.15.42:0/3809995903 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56015646e260 msgr2=0x56015647c580 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-26T00:10:08.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.160+0000 7f214f400640 1 --2- 172.21.15.42:0/3809995903 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56015646e260 0x56015647c580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.160+0000 7f214f400640 1 -- 172.21.15.42:0/3809995903 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560156478b20 msgr2=0x56015647cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:08.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.160+0000 7f214fe00640 1 --2- 172.21.15.42:0/3809995903 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560156478b20 0x56015647cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:08.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.160+0000 7f214f400640 1 --2- 172.21.15.42:0/3809995903 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560156478b20 0x56015647cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.160+0000 7f214f400640 1 -- 172.21.15.42:0/3809995903 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56015647d2f0 con 0x56015646d940 2024-08-26T00:10:08.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.160+0000 7f214fe00640 1 --2- 172.21.15.42:0/3809995903 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560156478b20 0x56015647cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:10:08.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.160+0000 7f214f400640 1 --2- 172.21.15.42:0/3809995903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56015646d940 0x560156481200 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2140009230 tx=0x7f2140009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f504112feae85e server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:08.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.161+0000 7f2139600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:10:08.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.161+0000 7f2139600640 1 -- 172.21.15.42:0/3809995903 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2140035040 con 0x56015646d940 2024-08-26T00:10:08.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.161+0000 7f2139600640 1 -- 172.21.15.42:0/3809995903 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f2140005300 con 0x56015646d940 2024-08-26T00:10:08.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.161+0000 7f215946f740 1 -- 172.21.15.42:0/3809995903 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f214809e050 con 0x56015646d940 2024-08-26T00:10:08.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.162+0000 7f2139600640 1 -- 172.21.15.42:0/3809995903 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f214005f050 con 0x56015646d940 2024-08-26T00:10:08.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.162+0000 7f215946f740 10 client.15765 fetch_fsmap learned FSMap version 30 2024-08-26T00:10:08.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.162+0000 7f215946f740 1 -- 172.21.15.42:0/3809995903 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5601564f34f0 con 0x56015646d940 2024-08-26T00:10:08.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.163+0000 7f2139600640 1 -- 172.21.15.42:0/3809995903 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f214809e050 con 0x56015646d940 2024-08-26T00:10:08.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.163+0000 7f2139600640 1 -- 172.21.15.42:0/3809995903 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f2140032800 con 0x56015646d940 2024-08-26T00:10:08.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.163+0000 7f215946f740 10 client.15765 fetch_fsmap finished waiting for FSMap version 30 2024-08-26T00:10:08.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.163+0000 7f215946f740 10 client.15765 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:10:08.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.163+0000 7f215946f740 20 client.15765 populate_metadata read hostname 'smithi042' 2024-08-26T00:10:08.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.163+0000 7f215946f740 1 --2- 172.21.15.42:0/3809995903 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5601564f3c90 0x5601564f60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:08.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.163+0000 7f215946f740 4 client.15765 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-26T00:10:08.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.163+0000 7f215946f740 1 -- 172.21.15.42:0/3809995903 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5601563dba40 con 0x5601564f3c90 2024-08-26T00:10:08.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.163+0000 7f214ea00640 1 --2- 172.21.15.42:0/3809995903 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5601564f3c90 0x5601564f60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:08.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.164+0000 7f214ea00640 1 --2- 172.21.15.42:0/3809995903 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5601564f3c90 0x5601564f60d0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b8c23878cb2f65a server_cookie=641f027a4f3cd435 in_seq=0 out_seq=0 2024-08-26T00:10:08.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.164+0000 7f2139600640 10 client.15765 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:08.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.171+0000 7f2139600640 1 -- 172.21.15.42:0/3809995903 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+269 (crc 0 0 0) 0x5601563dba40 con 0x5601564f3c90 2024-08-26T00:10:08.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.171+0000 7f2139600640 10 client.15765 handle_command_reply: tid=0 2024-08-26T00:10:08.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.171+0000 7f215946f740 1 client.15765 shutdown 2024-08-26T00:10:08.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.171+0000 7f215946f740 1 -- 172.21.15.42:0/3809995903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56015646d940 msgr2=0x560156481200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:08.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.171+0000 7f215946f740 1 --2- 172.21.15.42:0/3809995903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56015646d940 0x560156481200 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2140009230 tx=0x7f2140009260 comp rx=0 tx=0).stop 2024-08-26T00:10:08.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.172+0000 7f215946f740 1 -- 172.21.15.42:0/3809995903 shutdown_connections 2024-08-26T00:10:08.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.172+0000 7f215946f740 1 --2- 172.21.15.42:0/3809995903 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560156478b20 0x56015647cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.172+0000 7f215946f740 1 --2- 172.21.15.42:0/3809995903 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56015646e260 0x56015647c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.172+0000 7f215946f740 1 --2- 172.21.15.42:0/3809995903 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5601564f3c90 0x5601564f60d0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.172+0000 7f215946f740 1 --2- 172.21.15.42:0/3809995903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56015646d940 0x560156481200 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.172+0000 7f215946f740 1 -- 172.21.15.42:0/3809995903 >> 172.21.15.42:0/3809995903 conn(0x560156469ed0 msgr2=0x560156469050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:08.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.172+0000 7f2139600640 0 client.15765 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:08.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.172+0000 7f215946f740 1 -- 172.21.15.42:0/3809995903 shutdown_connections 2024-08-26T00:10:08.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.172+0000 7f215946f740 1 -- 172.21.15.42:0/3809995903 wait complete. 2024-08-26T00:10:08.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.172+0000 7f215946f740 20 client.15765 trim_cache size 0 max 16384 2024-08-26T00:10:08.174 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:10:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "scrub active (30634 inodes in the stack)", 2024-08-26T00:10:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-08-26T00:10:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "167dd245-95ce-478b-a2eb-843f32642cbc": { 2024-08-26T00:10:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-08-26T00:10:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "167dd245-95ce-478b-a2eb-843f32642cbc", 2024-08-26T00:10:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,force" 2024-08-26T00:10:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:10:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:10:08.175 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:10:08.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.173+0000 7f2156800640 1 -- 172.21.15.42:0/1581289565 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f21340a2c00 msgr2=0x7f21340a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:08.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.173+0000 7f2156800640 1 --2- 172.21.15.42:0/1581289565 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f21340a2c00 0x7f21340a50c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2140000c00 tx=0x7f2140005b50 comp rx=0 tx=0).stop 2024-08-26T00:10:08.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.173+0000 7f2156800640 1 -- 172.21.15.42:0/1581289565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21501127a0 msgr2=0x7f215019e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:08.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.173+0000 7f2156800640 1 --2- 172.21.15.42:0/1581289565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21501127a0 0x7f215019e630 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f214800eb10 tx=0x7f214800c2d0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.173+0000 7f2156800640 1 -- 172.21.15.42:0/1581289565 shutdown_connections 2024-08-26T00:10:08.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.173+0000 7f2156800640 1 --2- 172.21.15.42:0/1581289565 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f21340a2c00 0x7f21340a50c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.173+0000 7f2156800640 1 --2- 172.21.15.42:0/1581289565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21501127a0 0x7f215019e630 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.173+0000 7f2156800640 1 --2- 172.21.15.42:0/1581289565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2150076de0 0x7f21501a4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.173+0000 7f2156800640 1 --2- 172.21.15.42:0/1581289565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21500764c0 0x7f21501a4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:08.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.173+0000 7f2156800640 1 -- 172.21.15.42:0/1581289565 >> 172.21.15.42:0/1581289565 conn(0x7f21500ff7c0 msgr2=0x7f2150101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:08.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.174+0000 7f2156800640 1 -- 172.21.15.42:0/1581289565 shutdown_connections 2024-08-26T00:10:08.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:08.174+0000 7f2156800640 1 -- 172.21.15.42:0/1581289565 wait complete. 2024-08-26T00:10:08.312 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:08 smithi042 ceph-mon[17225]: pgmap v567: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 133 KiB/s wr, 20 op/s 2024-08-26T00:10:08.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:08 smithi043 ceph-mon[22091]: pgmap v567: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 133 KiB/s wr, 20 op/s 2024-08-26T00:10:08.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:08 smithi181 ceph-mon[22102]: pgmap v567: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 133 KiB/s wr, 20 op/s 2024-08-26T00:10:09.144 INFO:tasks.cephfs.filesystem:scrub status for tag:167dd245-95ce-478b-a2eb-843f32642cbc - {'path': '/', 'tag': '167dd245-95ce-478b-a2eb-843f32642cbc', 'options': 'recursive,force'} 2024-08-26T00:10:10.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:10 smithi042 ceph-mon[17225]: pgmap v568: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 422 KiB/s wr, 88 op/s 2024-08-26T00:10:10.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:10 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:10.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:10 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:10.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:10 smithi181 ceph-mon[22102]: pgmap v568: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 422 KiB/s wr, 88 op/s 2024-08-26T00:10:10.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:10 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:10.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:10 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:10.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:10 smithi043 ceph-mon[22091]: pgmap v568: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 422 KiB/s wr, 88 op/s 2024-08-26T00:10:10.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:10 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:10.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:10 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:12.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:12 smithi042 ceph-mon[17225]: pgmap v569: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 767 KiB/s wr, 164 op/s 2024-08-26T00:10:12.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:12 smithi181 ceph-mon[22102]: pgmap v569: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 767 KiB/s wr, 164 op/s 2024-08-26T00:10:12.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:12 smithi043 ceph-mon[22091]: pgmap v569: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 767 KiB/s wr, 164 op/s 2024-08-26T00:10:14.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:14 smithi042 ceph-mon[17225]: pgmap v570: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 771 KiB/s wr, 262 op/s 2024-08-26T00:10:14.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:14 smithi181 ceph-mon[22102]: pgmap v570: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 771 KiB/s wr, 262 op/s 2024-08-26T00:10:14.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:14 smithi043 ceph-mon[22091]: pgmap v570: 97 pgs: 97 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 771 KiB/s wr, 262 op/s 2024-08-26T00:10:16.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:16 smithi042 ceph-mon[17225]: pgmap v571: 97 pgs: 97 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 311 op/s 2024-08-26T00:10:16.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:16 smithi181 ceph-mon[22102]: pgmap v571: 97 pgs: 97 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 311 op/s 2024-08-26T00:10:16.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:16 smithi043 ceph-mon[22091]: pgmap v571: 97 pgs: 97 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 311 op/s 2024-08-26T00:10:18.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:18 smithi042 ceph-mon[17225]: pgmap v572: 97 pgs: 97 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 390 op/s 2024-08-26T00:10:18.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:18 smithi181 ceph-mon[22102]: pgmap v572: 97 pgs: 97 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 390 op/s 2024-08-26T00:10:18.561 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:18 smithi043 ceph-mon[22091]: pgmap v572: 97 pgs: 97 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 390 op/s 2024-08-26T00:10:20.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:20 smithi042 ceph-mon[17225]: pgmap v573: 97 pgs: 97 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 478 op/s 2024-08-26T00:10:20.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:20 smithi181 ceph-mon[22102]: pgmap v573: 97 pgs: 97 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 478 op/s 2024-08-26T00:10:20.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:20 smithi043 ceph-mon[22091]: pgmap v573: 97 pgs: 97 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 478 op/s 2024-08-26T00:10:22.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:22 smithi042 ceph-mon[17225]: pgmap v574: 97 pgs: 97 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 454 op/s 2024-08-26T00:10:22.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:22 smithi181 ceph-mon[22102]: pgmap v574: 97 pgs: 97 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 454 op/s 2024-08-26T00:10:22.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:22 smithi043 ceph-mon[22091]: pgmap v574: 97 pgs: 97 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 454 op/s 2024-08-26T00:10:24.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:24 smithi042 ceph-mon[17225]: pgmap v575: 97 pgs: 97 active+clean; 2.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 570 op/s 2024-08-26T00:10:24.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:24 smithi181 ceph-mon[22102]: pgmap v575: 97 pgs: 97 active+clean; 2.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 570 op/s 2024-08-26T00:10:24.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:24 smithi043 ceph-mon[22091]: pgmap v575: 97 pgs: 97 active+clean; 2.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 570 op/s 2024-08-26T00:10:26.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:26 smithi042 ceph-mon[17225]: pgmap v576: 97 pgs: 97 active+clean; 2.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 624 op/s 2024-08-26T00:10:26.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:26 smithi181 ceph-mon[22102]: pgmap v576: 97 pgs: 97 active+clean; 2.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 624 op/s 2024-08-26T00:10:26.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:26 smithi043 ceph-mon[22091]: pgmap v576: 97 pgs: 97 active+clean; 2.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 624 op/s 2024-08-26T00:10:28.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:28 smithi043 ceph-mon[22091]: pgmap v577: 97 pgs: 97 active+clean; 2.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 923 op/s 2024-08-26T00:10:28.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:28 smithi042 ceph-mon[17225]: pgmap v577: 97 pgs: 97 active+clean; 2.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 923 op/s 2024-08-26T00:10:28.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:28 smithi181 ceph-mon[22102]: pgmap v577: 97 pgs: 97 active+clean; 2.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 923 op/s 2024-08-26T00:10:30.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:30 smithi043 ceph-mon[22091]: pgmap v578: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.7 MiB/s wr, 1.28k op/s 2024-08-26T00:10:30.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:30 smithi042 ceph-mon[17225]: pgmap v578: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.7 MiB/s wr, 1.28k op/s 2024-08-26T00:10:30.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:30 smithi181 ceph-mon[22102]: pgmap v578: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.7 MiB/s wr, 1.28k op/s 2024-08-26T00:10:31.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:31.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:31.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:32.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:32 smithi043 ceph-mon[22091]: pgmap v579: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.1 MiB/s wr, 1.38k op/s 2024-08-26T00:10:32.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:32 smithi042 ceph-mon[17225]: pgmap v579: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.1 MiB/s wr, 1.38k op/s 2024-08-26T00:10:32.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:32 smithi181 ceph-mon[22102]: pgmap v579: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.1 MiB/s wr, 1.38k op/s 2024-08-26T00:10:34.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:34 smithi043 ceph-mon[22091]: pgmap v580: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.9 MiB/s wr, 1.55k op/s 2024-08-26T00:10:34.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:34 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:10:34.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:34 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:10:34.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:34 smithi181 ceph-mon[22102]: pgmap v580: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.9 MiB/s wr, 1.55k op/s 2024-08-26T00:10:34.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:34 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:10:34.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:34 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:10:34.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:34 smithi042 ceph-mon[17225]: pgmap v580: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.9 MiB/s wr, 1.55k op/s 2024-08-26T00:10:34.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:34 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:10:34.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:34 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:10:35.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:35 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:10:35.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:35 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:10:35.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:35 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:10:36.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:36 smithi043 ceph-mon[22091]: pgmap v581: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 6.3 MiB/s wr, 1.42k op/s 2024-08-26T00:10:36.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:36 smithi042 ceph-mon[17225]: pgmap v581: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 6.3 MiB/s wr, 1.42k op/s 2024-08-26T00:10:36.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:36 smithi181 ceph-mon[22102]: pgmap v581: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 6.3 MiB/s wr, 1.42k op/s 2024-08-26T00:10:38.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:38 smithi043 ceph-mon[22091]: pgmap v582: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 7.2 MiB/s wr, 1.44k op/s 2024-08-26T00:10:38.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:38 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:10:38.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:38 smithi042 ceph-mon[17225]: pgmap v582: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 7.2 MiB/s wr, 1.44k op/s 2024-08-26T00:10:38.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:38 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:10:38.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:38 smithi181 ceph-mon[22102]: pgmap v582: 97 pgs: 97 active+clean; 2.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 7.2 MiB/s wr, 1.44k op/s 2024-08-26T00:10:38.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:38 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:10:39.144 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-26T00:10:39.535 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:10:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.070+0000 7f2fef200640 1 -- 172.21.15.42:0/116628312 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ff0074c80 msgr2=0x7f2ff010dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.070+0000 7f2fef200640 1 --2- 172.21.15.42:0/116628312 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ff0074c80 0x7f2ff010dac0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc009900 tx=0x7f2fdc02a480 comp rx=0 tx=0).stop 2024-08-26T00:10:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.070+0000 7f2fef200640 1 -- 172.21.15.42:0/116628312 shutdown_connections 2024-08-26T00:10:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.070+0000 7f2fef200640 1 --2- 172.21.15.42:0/116628312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff010e000 0x7f2ff01103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.070+0000 7f2fef200640 1 --2- 172.21.15.42:0/116628312 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ff0074c80 0x7f2ff010dac0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.070+0000 7f2fef200640 1 --2- 172.21.15.42:0/116628312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ff0074360 0x7f2ff0074740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.070+0000 7f2fef200640 1 -- 172.21.15.42:0/116628312 >> 172.21.15.42:0/116628312 conn(0x7f2ff00fd4e0 msgr2=0x7f2ff00ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.070+0000 7f2fef200640 1 -- 172.21.15.42:0/116628312 shutdown_connections 2024-08-26T00:10:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.070+0000 7f2fef200640 1 -- 172.21.15.42:0/116628312 wait complete. 2024-08-26T00:10:40.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.071+0000 7f2fef200640 1 Processor -- start 2024-08-26T00:10:40.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.071+0000 7f2fef200640 1 -- start start 2024-08-26T00:10:40.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.072+0000 7f2fef200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff0074360 0x7f2ff019a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:40.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.072+0000 7f2fef200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ff0074c80 0x7f2ff019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.072+0000 7f2fef200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ff010e000 0x7f2ff019eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.072+0000 7f2fef200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff0113da0 con 0x7f2ff010e000 2024-08-26T00:10:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.072+0000 7f2fef200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff0113c20 con 0x7f2ff0074c80 2024-08-26T00:10:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.072+0000 7f2fef200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff0113f20 con 0x7f2ff0074360 2024-08-26T00:10:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.072+0000 7f2fede00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff0074360 0x7f2ff019a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.072+0000 7f2fede00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff0074360 0x7f2ff019a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:57252/0 (socket says 172.21.15.42:57252) 2024-08-26T00:10:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.072+0000 7f2fede00640 1 -- 172.21.15.42:0/3146868779 learned_addr learned my addr 172.21.15.42:0/3146868779 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.072+0000 7f2fed400640 1 --2- 172.21.15.42:0/3146868779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ff0074c80 0x7f2ff019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.072+0000 7f2fee800640 1 --2- 172.21.15.42:0/3146868779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ff010e000 0x7f2ff019eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.072+0000 7f2fede00640 1 -- 172.21.15.42:0/3146868779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ff0074c80 msgr2=0x7f2ff019a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.072+0000 7f2fede00640 1 --2- 172.21.15.42:0/3146868779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ff0074c80 0x7f2ff019a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.072+0000 7f2fede00640 1 -- 172.21.15.42:0/3146868779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ff010e000 msgr2=0x7f2ff019eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.072+0000 7f2fede00640 1 --2- 172.21.15.42:0/3146868779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ff010e000 0x7f2ff019eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.072+0000 7f2fede00640 1 -- 172.21.15.42:0/3146868779 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff019f200 con 0x7f2ff0074360 2024-08-26T00:10:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.073+0000 7f2fee800640 1 --2- 172.21.15.42:0/3146868779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ff010e000 0x7f2ff019eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:10:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.073+0000 7f2fede00640 1 --2- 172.21.15.42:0/3146868779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff0074360 0x7f2ff019a250 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000e9f0 tx=0x7f2fe000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.073+0000 7f2fe6a00640 1 -- 172.21.15.42:0/3146868779 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe000cd80 con 0x7f2ff0074360 2024-08-26T00:10:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.073+0000 7f2fef200640 1 -- 172.21.15.42:0/3146868779 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff019f4f0 con 0x7f2ff0074360 2024-08-26T00:10:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.073+0000 7f2fe6a00640 1 -- 172.21.15.42:0/3146868779 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fe0010910 con 0x7f2ff0074360 2024-08-26T00:10:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.073+0000 7f2fe6a00640 1 -- 172.21.15.42:0/3146868779 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe00188f0 con 0x7f2ff0074360 2024-08-26T00:10:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.073+0000 7f2fef200640 1 -- 172.21.15.42:0/3146868779 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff01a6dd0 con 0x7f2ff0074360 2024-08-26T00:10:40.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.076+0000 7f2ff7811740 1 Processor -- start 2024-08-26T00:10:40.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.076+0000 7f2ff7811740 1 -- start start 2024-08-26T00:10:40.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.076+0000 7f2fe6a00640 1 -- 172.21.15.42:0/3146868779 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2fe0010ac0 con 0x7f2ff0074360 2024-08-26T00:10:40.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.077+0000 7f2ff7811740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 0x564b9803a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:40.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.077+0000 7f2ff7811740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b9803ac70 0x564b98044ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:40.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.077+0000 7f2ff7811740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564b98045530 0x564b98047920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:40.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.077+0000 7f2ff7811740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564b97f97fc0 con 0x564b9803ac70 2024-08-26T00:10:40.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.077+0000 7f2ff7811740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564b97f2f680 con 0x564b98045530 2024-08-26T00:10:40.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.077+0000 7f2ff7811740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564b97f93f80 con 0x564b9803a350 2024-08-26T00:10:40.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.077+0000 7f2fed400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564b98045530 0x564b98047920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:40.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.077+0000 7f2fede00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b9803ac70 0x564b98044ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:40.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.077+0000 7f2fed400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564b98045530 0x564b98047920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45618/0 (socket says 172.21.15.42:45618) 2024-08-26T00:10:40.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.077+0000 7f2fed400640 1 -- 172.21.15.42:0/846224844 learned_addr learned my addr 172.21.15.42:0/846224844 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:40.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.078+0000 7f2fed400640 1 -- 172.21.15.42:0/846224844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 msgr2=0x564b9803a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:40.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.078+0000 7f2fed400640 1 --2- 172.21.15.42:0/846224844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 0x564b9803a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.078+0000 7f2fed400640 1 -- 172.21.15.42:0/846224844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b9803ac70 msgr2=0x564b98044ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:40.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.078+0000 7f2fed400640 1 --2- 172.21.15.42:0/846224844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b9803ac70 0x564b98044ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.078+0000 7f2fed400640 1 -- 172.21.15.42:0/846224844 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b97f4b2c0 con 0x564b98045530 2024-08-26T00:10:40.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.078+0000 7f2fede00640 1 --2- 172.21.15.42:0/846224844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b9803ac70 0x564b98044ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:10:40.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.078+0000 7f2fed400640 1 --2- 172.21.15.42:0/846224844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564b98045530 0x564b98047920 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc009900 tx=0x7f2fdc005e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b0e1c172a78ef3 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:40.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.078+0000 7f2fdb400640 1 -- 172.21.15.42:0/846224844 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc035030 con 0x564b98045530 2024-08-26T00:10:40.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.078+0000 7f2fe6a00640 1 --2- 172.21.15.42:0/3146868779 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f2fd40a2b80 0x7f2fd40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:40.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.078+0000 7f2fdb400640 1 -- 172.21.15.42:0/846224844 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fdc0043c0 con 0x564b98045530 2024-08-26T00:10:40.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.078+0000 7f2fdb400640 1 -- 172.21.15.42:0/846224844 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc0035f0 con 0x564b98045530 2024-08-26T00:10:40.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.078+0000 7f2fe6a00640 1 -- 172.21.15.42:0/3146868779 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f2fe00cf570 con 0x7f2ff0074360 2024-08-26T00:10:40.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.079+0000 7f2fee800640 1 --2- 172.21.15.42:0/3146868779 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f2fd40a2b80 0x7f2fd40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:40.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.079+0000 7f2ff7811740 1 -- 172.21.15.42:0/846224844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564b98045530 msgr2=0x564b98047920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:40.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.079+0000 7f2ff7811740 1 --2- 172.21.15.42:0/846224844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564b98045530 0x564b98047920 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc009900 tx=0x7f2fdc005e60 comp rx=0 tx=0).stop 2024-08-26T00:10:40.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.079+0000 7f2ff7811740 1 -- 172.21.15.42:0/846224844 shutdown_connections 2024-08-26T00:10:40.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.079+0000 7f2ff7811740 1 --2- 172.21.15.42:0/846224844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564b98045530 0x564b98047920 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.079+0000 7f2ff7811740 1 --2- 172.21.15.42:0/846224844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b9803ac70 0x564b98044ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.079+0000 7f2ff7811740 1 --2- 172.21.15.42:0/846224844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 0x564b9803a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.079+0000 7f2ff7811740 1 -- 172.21.15.42:0/846224844 >> 172.21.15.42:0/846224844 conn(0x564b98036890 msgr2=0x564b98036c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:40.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.079+0000 7f2ff7811740 1 -- 172.21.15.42:0/846224844 shutdown_connections 2024-08-26T00:10:40.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.079+0000 7f2ff7811740 1 -- 172.21.15.42:0/846224844 wait complete. 2024-08-26T00:10:40.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.079+0000 7f2fee800640 1 --2- 172.21.15.42:0/3146868779 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f2fd40a2b80 0x7f2fd40a5040 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2ff006a490 tx=0x7f2fe8009a90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:40.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.080+0000 7f2ff7811740 1 -- start start 2024-08-26T00:10:40.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.080+0000 7f2ff7811740 1 Processor -- start 2024-08-26T00:10:40.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.080+0000 7f2ff7811740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 0x564b98042470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:40.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.080+0000 7f2ff7811740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564b9803ac70 0x564b980429b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:40.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.080+0000 7f2ff7811740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98045530 0x564b98042ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:40.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.080+0000 7f2ff7811740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564b98048100 con 0x564b98045530 2024-08-26T00:10:40.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.080+0000 7f2ff7811740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564b97f52e50 con 0x564b9803ac70 2024-08-26T00:10:40.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.080+0000 7f2ff7811740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564b98048280 con 0x564b9803a350 2024-08-26T00:10:40.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.081+0000 7f2ff7811740 10 client.0 _ll_register_callbacks cb 0x564b97f3df30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:10:40.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.081+0000 7f2fede00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 0x564b98042470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:40.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.081+0000 7f2fede00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 0x564b98042470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:57268/0 (socket says 172.21.15.42:57268) 2024-08-26T00:10:40.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.081+0000 7f2fede00640 1 -- 172.21.15.42:0/738752660 learned_addr learned my addr 172.21.15.42:0/738752660 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:40.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.081+0000 7f2fed400640 1 --2- 172.21.15.42:0/738752660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564b9803ac70 0x564b980429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:40.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.081+0000 7f2fede00640 1 -- 172.21.15.42:0/738752660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564b9803ac70 msgr2=0x564b980429b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:40.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.081+0000 7f2fede00640 1 --2- 172.21.15.42:0/738752660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564b9803ac70 0x564b980429b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.081+0000 7f2fede00640 1 -- 172.21.15.42:0/738752660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98045530 msgr2=0x564b98042ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:40.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.081+0000 7f2fee800640 1 --2- 172.21.15.42:0/738752660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98045530 0x564b98042ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:40.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.081+0000 7f2fede00640 1 --2- 172.21.15.42:0/738752660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98045530 0x564b98042ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.081+0000 7f2fede00640 1 -- 172.21.15.42:0/738752660 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b97d093c0 con 0x564b9803a350 2024-08-26T00:10:40.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.081+0000 7f2fee800640 1 --2- 172.21.15.42:0/738752660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98045530 0x564b98042ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:10:40.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.081+0000 7f2fede00640 1 --2- 172.21.15.42:0/738752660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 0x564b98042470 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000e9c0 tx=0x7f2fe0098120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd87424a0007d6fd server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:40.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.081+0000 7f2fcfe00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:10:40.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.082+0000 7f2fcfe00640 1 -- 172.21.15.42:0/738752660 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe00cf310 con 0x564b9803a350 2024-08-26T00:10:40.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.082+0000 7f2ff7811740 1 -- 172.21.15.42:0/738752660 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fdc0043c0 con 0x564b9803a350 2024-08-26T00:10:40.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.082+0000 7f2fcfe00640 1 -- 172.21.15.42:0/738752660 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f2fe009b1e0 con 0x564b9803a350 2024-08-26T00:10:40.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.082+0000 7f2fcfe00640 1 -- 172.21.15.42:0/738752660 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2fe009c490 con 0x564b9803a350 2024-08-26T00:10:40.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.082+0000 7f2ff7811740 10 client.25825 fetch_fsmap learned FSMap version 30 2024-08-26T00:10:40.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.082+0000 7f2ff7811740 1 -- 172.21.15.42:0/738752660 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564b98053eb0 con 0x564b9803a350 2024-08-26T00:10:40.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.082+0000 7f2fcfe00640 1 -- 172.21.15.42:0/738752660 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fdc0043c0 con 0x564b9803a350 2024-08-26T00:10:40.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.082+0000 7f2fcfe00640 1 -- 172.21.15.42:0/738752660 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f2fe0097c00 con 0x564b9803a350 2024-08-26T00:10:40.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.082+0000 7f2ff7811740 10 client.25825 fetch_fsmap finished waiting for FSMap version 30 2024-08-26T00:10:40.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.082+0000 7f2ff7811740 10 client.25825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:10:40.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.082+0000 7f2ff7811740 20 client.25825 populate_metadata read hostname 'smithi042' 2024-08-26T00:10:40.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.082+0000 7f2ff7811740 1 --2- 172.21.15.42:0/738752660 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x564b98055370 0x564b980577c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:40.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.083+0000 7f2ff7811740 4 client.25825 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:10:40.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.083+0000 7f2ff7811740 1 -- 172.21.15.42:0/738752660 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b97fa5530 con 0x564b98055370 2024-08-26T00:10:40.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.083+0000 7f2fed400640 1 --2- 172.21.15.42:0/738752660 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x564b98055370 0x564b980577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:40.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.083+0000 7f2fed400640 1 --2- 172.21.15.42:0/738752660 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x564b98055370 0x564b980577c0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b792aca01ebe8fbd server_cookie=f69b2ee7b1e01628 in_seq=0 out_seq=0 2024-08-26T00:10:40.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.083+0000 7f2fcfe00640 10 client.25825 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:40.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.084+0000 7f2fcfe00640 1 -- 172.21.15.42:0/738752660 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564b97fa5530 con 0x564b98055370 2024-08-26T00:10:40.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.084+0000 7f2fcfe00640 10 client.25825 handle_command_reply: tid=0 2024-08-26T00:10:40.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.084+0000 7f2ff7811740 1 client.25825 shutdown 2024-08-26T00:10:40.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.084+0000 7f2ff7811740 1 -- 172.21.15.42:0/738752660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 msgr2=0x564b98042470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:40.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.084+0000 7f2ff7811740 1 --2- 172.21.15.42:0/738752660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 0x564b98042470 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000e9c0 tx=0x7f2fe0098120 comp rx=0 tx=0).stop 2024-08-26T00:10:40.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.084+0000 7f2ff7811740 1 -- 172.21.15.42:0/738752660 shutdown_connections 2024-08-26T00:10:40.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.084+0000 7f2ff7811740 1 --2- 172.21.15.42:0/738752660 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x564b98055370 0x564b980577c0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.085+0000 7f2ff7811740 1 --2- 172.21.15.42:0/738752660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b98045530 0x564b98042ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.085+0000 7f2ff7811740 1 --2- 172.21.15.42:0/738752660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564b9803ac70 0x564b980429b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.085+0000 7f2fcfe00640 0 client.25825 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:40.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.085+0000 7f2ff7811740 1 --2- 172.21.15.42:0/738752660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 0x564b98042470 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.085+0000 7f2ff7811740 1 -- 172.21.15.42:0/738752660 >> 172.21.15.42:0/738752660 conn(0x564b98036890 msgr2=0x564b9802d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:40.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.085+0000 7f2ff7811740 1 -- 172.21.15.42:0/738752660 shutdown_connections 2024-08-26T00:10:40.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.085+0000 7f2ff7811740 1 -- 172.21.15.42:0/738752660 wait complete. 2024-08-26T00:10:40.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.085+0000 7f2ff7811740 20 client.25825 trim_cache size 0 max 16384 2024-08-26T00:10:40.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.104+0000 7f2ff7811740 1 Processor -- start 2024-08-26T00:10:40.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.104+0000 7f2ff7811740 1 -- start start 2024-08-26T00:10:40.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.104+0000 7f2ff7811740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 0x564b980443e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:40.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.104+0000 7f2ff7811740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b9803ac70 0x564b9805d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:40.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.104+0000 7f2ff7811740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564b98045530 0x564b9805d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:40.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.104+0000 7f2ff7811740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff01ad900 con 0x564b9803ac70 2024-08-26T00:10:40.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.104+0000 7f2ff7811740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff01ab140 con 0x564b98045530 2024-08-26T00:10:40.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.104+0000 7f2ff7811740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff01a8f70 con 0x564b9803a350 2024-08-26T00:10:40.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.104+0000 7f2fede00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 0x564b980443e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:40.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.104+0000 7f2fede00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 0x564b980443e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:57276/0 (socket says 172.21.15.42:57276) 2024-08-26T00:10:40.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.104+0000 7f2fede00640 1 -- 172.21.15.42:0/221756302 learned_addr learned my addr 172.21.15.42:0/221756302 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:40.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.104+0000 7f2fed400640 1 --2- 172.21.15.42:0/221756302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b9803ac70 0x564b9805d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:40.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.104+0000 7f2fee800640 1 --2- 172.21.15.42:0/221756302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564b98045530 0x564b9805d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:40.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.105+0000 7f2fede00640 1 -- 172.21.15.42:0/221756302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564b98045530 msgr2=0x564b9805d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:40.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.105+0000 7f2fede00640 1 --2- 172.21.15.42:0/221756302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564b98045530 0x564b9805d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.105+0000 7f2fede00640 1 -- 172.21.15.42:0/221756302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b9803ac70 msgr2=0x564b9805d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:40.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.105+0000 7f2fede00640 1 --2- 172.21.15.42:0/221756302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b9803ac70 0x564b9805d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.105+0000 7f2fede00640 1 -- 172.21.15.42:0/221756302 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b980366c0 con 0x564b9803a350 2024-08-26T00:10:40.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.105+0000 7f2fede00640 1 --2- 172.21.15.42:0/221756302 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 0x564b980443e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2fe009bd20 tx=0x7f2fe000c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51f88ab6e0d51894 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:40.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.105+0000 7f2fdaa00640 1 -- 172.21.15.42:0/221756302 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe00b9070 con 0x564b9803a350 2024-08-26T00:10:40.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.105+0000 7f2fdaa00640 1 -- 172.21.15.42:0/221756302 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fe009bd90 con 0x564b9803a350 2024-08-26T00:10:40.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.105+0000 7f2fdaa00640 1 -- 172.21.15.42:0/221756302 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0097d40 con 0x564b9803a350 2024-08-26T00:10:40.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.106+0000 7f2ff7811740 1 -- 172.21.15.42:0/221756302 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 msgr2=0x564b980443e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:40.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.106+0000 7f2ff7811740 1 --2- 172.21.15.42:0/221756302 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 0x564b980443e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2fe009bd20 tx=0x7f2fe000c7d0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.106+0000 7f2ff7811740 1 -- 172.21.15.42:0/221756302 shutdown_connections 2024-08-26T00:10:40.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.106+0000 7f2ff7811740 1 --2- 172.21.15.42:0/221756302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564b98045530 0x564b9805d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.106+0000 7f2ff7811740 1 --2- 172.21.15.42:0/221756302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b9803ac70 0x564b9805d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.106+0000 7f2ff7811740 1 --2- 172.21.15.42:0/221756302 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 0x564b980443e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.106+0000 7f2ff7811740 1 -- 172.21.15.42:0/221756302 >> 172.21.15.42:0/221756302 conn(0x564b98036890 msgr2=0x564b98043cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:40.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.106+0000 7f2ff7811740 1 -- 172.21.15.42:0/221756302 shutdown_connections 2024-08-26T00:10:40.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.106+0000 7f2ff7811740 1 -- 172.21.15.42:0/221756302 wait complete. 2024-08-26T00:10:40.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.107+0000 7f2ff7811740 1 -- start start 2024-08-26T00:10:40.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.107+0000 7f2ff7811740 1 Processor -- start 2024-08-26T00:10:40.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.107+0000 7f2ff7811740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 0x564b9804dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:40.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.107+0000 7f2ff7811740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b9803ac70 0x564b98048f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:40.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.108+0000 7f2ff7811740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564b98045530 0x564b980494d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:40.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.108+0000 7f2ff7811740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff01a9600 con 0x564b9803ac70 2024-08-26T00:10:40.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.108+0000 7f2ff7811740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff01aaa70 con 0x564b98045530 2024-08-26T00:10:40.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.108+0000 7f2ff7811740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff01a9cd0 con 0x564b9803a350 2024-08-26T00:10:40.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.108+0000 7f2ff7811740 10 client.0 _ll_register_callbacks cb 0x7f2fe000cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:10:40.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.108+0000 7f2fede00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 0x564b9804dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:40.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.108+0000 7f2fede00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 0x564b9804dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:57290/0 (socket says 172.21.15.42:57290) 2024-08-26T00:10:40.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.108+0000 7f2fede00640 1 -- 172.21.15.42:0/570981052 learned_addr learned my addr 172.21.15.42:0/570981052 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:40.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.108+0000 7f2fed400640 1 --2- 172.21.15.42:0/570981052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b9803ac70 0x564b98048f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:40.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.108+0000 7f2fee800640 1 --2- 172.21.15.42:0/570981052 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564b98045530 0x564b980494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:40.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.108+0000 7f2fede00640 1 -- 172.21.15.42:0/570981052 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564b98045530 msgr2=0x564b980494d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:40.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.108+0000 7f2fede00640 1 --2- 172.21.15.42:0/570981052 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564b98045530 0x564b980494d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.108+0000 7f2fede00640 1 -- 172.21.15.42:0/570981052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b9803ac70 msgr2=0x564b98048f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:40.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.108+0000 7f2fede00640 1 --2- 172.21.15.42:0/570981052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b9803ac70 0x564b98048f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.108+0000 7f2fede00640 1 -- 172.21.15.42:0/570981052 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b9803a180 con 0x564b9803a350 2024-08-26T00:10:40.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.109+0000 7f2fede00640 1 --2- 172.21.15.42:0/570981052 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 0x564b9804dc60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000c6a0 tx=0x7f2fe000c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe96ac9ab1e50d16 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:40.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.109+0000 7f2fcfe00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:10:40.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.109+0000 7f2fcfe00640 1 -- 172.21.15.42:0/570981052 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe00b9070 con 0x564b9803a350 2024-08-26T00:10:40.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.109+0000 7f2fcfe00640 1 -- 172.21.15.42:0/570981052 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f2fe0010640 con 0x564b9803a350 2024-08-26T00:10:40.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.109+0000 7f2ff7811740 1 -- 172.21.15.42:0/570981052 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fe009bd90 con 0x564b9803a350 2024-08-26T00:10:40.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.109+0000 7f2fcfe00640 1 -- 172.21.15.42:0/570981052 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2fe009b8d0 con 0x564b9803a350 2024-08-26T00:10:40.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.109+0000 7f2ff7811740 10 client.25831 fetch_fsmap learned FSMap version 30 2024-08-26T00:10:40.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.109+0000 7f2ff7811740 1 -- 172.21.15.42:0/570981052 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564b980bfed0 con 0x564b9803a350 2024-08-26T00:10:40.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.109+0000 7f2fcfe00640 1 -- 172.21.15.42:0/570981052 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fe009bd90 con 0x564b9803a350 2024-08-26T00:10:40.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.109+0000 7f2fcfe00640 1 -- 172.21.15.42:0/570981052 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f2fe00a12d0 con 0x564b9803a350 2024-08-26T00:10:40.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.109+0000 7f2ff7811740 10 client.25831 fetch_fsmap finished waiting for FSMap version 30 2024-08-26T00:10:40.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.109+0000 7f2ff7811740 10 client.25831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:10:40.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.109+0000 7f2ff7811740 20 client.25831 populate_metadata read hostname 'smithi042' 2024-08-26T00:10:40.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.109+0000 7f2ff7811740 1 --2- 172.21.15.42:0/570981052 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x564b98055370 0x564b980c23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:40.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.109+0000 7f2ff7811740 4 client.25831 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-26T00:10:40.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.109+0000 7f2ff7811740 1 -- 172.21.15.42:0/570981052 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564b97f9fa40 con 0x564b98055370 2024-08-26T00:10:40.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.110+0000 7f2fed400640 1 --2- 172.21.15.42:0/570981052 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x564b98055370 0x564b980c23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:40.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.110+0000 7f2fed400640 1 --2- 172.21.15.42:0/570981052 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x564b98055370 0x564b980c23e0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac78e3ceb787434b server_cookie=232f1b63c6a27ca6 in_seq=0 out_seq=0 2024-08-26T00:10:40.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.110+0000 7f2fcfe00640 10 client.25831 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:40.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.111+0000 7f2fcfe00640 1 -- 172.21.15.42:0/570981052 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564b97f9fa40 con 0x564b98055370 2024-08-26T00:10:40.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.111+0000 7f2fcfe00640 10 client.25831 handle_command_reply: tid=0 2024-08-26T00:10:40.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.111+0000 7f2ff7811740 1 client.25831 shutdown 2024-08-26T00:10:40.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.111+0000 7f2ff7811740 1 -- 172.21.15.42:0/570981052 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 msgr2=0x564b9804dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:40.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.111+0000 7f2ff7811740 1 --2- 172.21.15.42:0/570981052 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 0x564b9804dc60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000c6a0 tx=0x7f2fe000c840 comp rx=0 tx=0).stop 2024-08-26T00:10:40.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.111+0000 7f2ff7811740 1 -- 172.21.15.42:0/570981052 shutdown_connections 2024-08-26T00:10:40.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.111+0000 7f2ff7811740 1 --2- 172.21.15.42:0/570981052 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564b98045530 0x564b980494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.111+0000 7f2ff7811740 1 --2- 172.21.15.42:0/570981052 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x564b98055370 0x564b980c23e0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.111+0000 7f2ff7811740 1 --2- 172.21.15.42:0/570981052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b9803ac70 0x564b98048f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.111+0000 7f2ff7811740 1 --2- 172.21.15.42:0/570981052 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b9803a350 0x564b9804dc60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.111+0000 7f2fcfe00640 0 client.25831 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:40.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.111+0000 7f2ff7811740 1 -- 172.21.15.42:0/570981052 >> 172.21.15.42:0/570981052 conn(0x564b98036890 msgr2=0x564b9802d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:40.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.111+0000 7f2ff7811740 1 -- 172.21.15.42:0/570981052 shutdown_connections 2024-08-26T00:10:40.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.111+0000 7f2ff7811740 1 -- 172.21.15.42:0/570981052 wait complete. 2024-08-26T00:10:40.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.111+0000 7f2ff7811740 20 client.25831 trim_cache size 0 max 16384 2024-08-26T00:10:40.116 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:10:40.117 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-08-26T00:10:40.117 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {} 2024-08-26T00:10:40.117 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:10:40.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.112+0000 7f2fef200640 1 -- 172.21.15.42:0/3146868779 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f2fd40a2b80 msgr2=0x7f2fd40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:40.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.112+0000 7f2fef200640 1 --2- 172.21.15.42:0/3146868779 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f2fd40a2b80 0x7f2fd40a5040 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2ff006a490 tx=0x7f2fe8009a90 comp rx=0 tx=0).stop 2024-08-26T00:10:40.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.112+0000 7f2fef200640 1 -- 172.21.15.42:0/3146868779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff0074360 msgr2=0x7f2ff019a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:40.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.112+0000 7f2fef200640 1 --2- 172.21.15.42:0/3146868779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff0074360 0x7f2ff019a250 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000e9f0 tx=0x7f2fe000eeb0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.112+0000 7f2fef200640 1 -- 172.21.15.42:0/3146868779 shutdown_connections 2024-08-26T00:10:40.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.112+0000 7f2fef200640 1 --2- 172.21.15.42:0/3146868779 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f2fd40a2b80 0x7f2fd40a5040 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.112+0000 7f2fef200640 1 --2- 172.21.15.42:0/3146868779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ff010e000 0x7f2ff019eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.112+0000 7f2fef200640 1 --2- 172.21.15.42:0/3146868779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ff0074c80 0x7f2ff019a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.112+0000 7f2fef200640 1 --2- 172.21.15.42:0/3146868779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff0074360 0x7f2ff019a250 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:40.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.112+0000 7f2fef200640 1 -- 172.21.15.42:0/3146868779 >> 172.21.15.42:0/3146868779 conn(0x7f2ff00fd4e0 msgr2=0x7f2ff00fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:40.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.112+0000 7f2fef200640 1 -- 172.21.15.42:0/3146868779 shutdown_connections 2024-08-26T00:10:40.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:40.112+0000 7f2fef200640 1 -- 172.21.15.42:0/3146868779 wait complete. 2024-08-26T00:10:40.613 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:40 smithi042 ceph-mon[17225]: pgmap v583: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.9 MiB/s wr, 1.35k op/s 2024-08-26T00:10:40.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:40 smithi043 ceph-mon[22091]: pgmap v583: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.9 MiB/s wr, 1.35k op/s 2024-08-26T00:10:40.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:40 smithi181 ceph-mon[22102]: pgmap v583: 97 pgs: 97 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.9 MiB/s wr, 1.35k op/s 2024-08-26T00:10:41.040 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-26T00:10:41.040 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:10:41.525 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:10:42.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.071+0000 7f000b200640 1 -- 172.21.15.42:0/813692777 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0004100cd0 msgr2=0x7f0004104a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:42.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.071+0000 7f000b200640 1 --2- 172.21.15.42:0/813692777 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0004100cd0 0x7f0004104a80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efff4009860 tx=0x7efff402a340 comp rx=0 tx=0).stop 2024-08-26T00:10:42.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.072+0000 7f000b200640 1 -- 172.21.15.42:0/813692777 shutdown_connections 2024-08-26T00:10:42.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.072+0000 7f000b200640 1 --2- 172.21.15.42:0/813692777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0004105190 0x7f000410cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:42.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.072+0000 7f000b200640 1 --2- 172.21.15.42:0/813692777 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0004100cd0 0x7f0004104a80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:42.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.072+0000 7f000b200640 1 --2- 172.21.15.42:0/813692777 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0004100320 0x7f0004100700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:42.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.072+0000 7f000b200640 1 -- 172.21.15.42:0/813692777 >> 172.21.15.42:0/813692777 conn(0x7f00040fb6c0 msgr2=0x7f00040fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:42.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.072+0000 7f000b200640 1 -- 172.21.15.42:0/813692777 shutdown_connections 2024-08-26T00:10:42.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.072+0000 7f000b200640 1 -- 172.21.15.42:0/813692777 wait complete. 2024-08-26T00:10:42.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.073+0000 7f000b200640 1 Processor -- start 2024-08-26T00:10:42.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.074+0000 7f000b200640 1 -- start start 2024-08-26T00:10:42.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.074+0000 7f000b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0004100320 0x7f000419a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:42.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.075+0000 7f000b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0004100cd0 0x7f000419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:42.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.075+0000 7f000b200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0004105190 0x7f000419eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:42.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.075+0000 7f000b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0004111b80 con 0x7f0004100320 2024-08-26T00:10:42.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.075+0000 7f000b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0004111a00 con 0x7f0004100cd0 2024-08-26T00:10:42.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.075+0000 7f000b200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0004111d00 con 0x7f0004105190 2024-08-26T00:10:42.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.075+0000 7f0009400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0004100cd0 0x7f000419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:42.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.075+0000 7f0009400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0004100cd0 0x7f000419a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45676/0 (socket says 172.21.15.42:45676) 2024-08-26T00:10:42.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.075+0000 7f0009400640 1 -- 172.21.15.42:0/3004811505 learned_addr learned my addr 172.21.15.42:0/3004811505 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:42.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.075+0000 7f0009e00640 1 --2- 172.21.15.42:0/3004811505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0004100320 0x7f000419a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:42.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.076+0000 7f000a800640 1 --2- 172.21.15.42:0/3004811505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0004105190 0x7f000419eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:42.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.076+0000 7f0009400640 1 -- 172.21.15.42:0/3004811505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0004105190 msgr2=0x7f000419eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:42.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.076+0000 7f0009400640 1 --2- 172.21.15.42:0/3004811505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0004105190 0x7f000419eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:42.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.076+0000 7f0009400640 1 -- 172.21.15.42:0/3004811505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0004100320 msgr2=0x7f000419a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:42.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.077+0000 7f0009400640 1 --2- 172.21.15.42:0/3004811505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0004100320 0x7f000419a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:42.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.077+0000 7f0009400640 1 -- 172.21.15.42:0/3004811505 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000419f1c0 con 0x7f0004100cd0 2024-08-26T00:10:42.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.077+0000 7f0009e00640 1 --2- 172.21.15.42:0/3004811505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0004100320 0x7f000419a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:10:42.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.077+0000 7f000a800640 1 --2- 172.21.15.42:0/3004811505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0004105190 0x7f000419eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:10:42.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.078+0000 7f0009400640 1 --2- 172.21.15.42:0/3004811505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0004100cd0 0x7f000419a750 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efff4000c00 tx=0x7efff4033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:42.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.078+0000 7efffea00640 1 -- 172.21.15.42:0/3004811505 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff4037070 con 0x7f0004100cd0 2024-08-26T00:10:42.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.078+0000 7efffea00640 1 -- 172.21.15.42:0/3004811505 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efff4041070 con 0x7f0004100cd0 2024-08-26T00:10:42.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.078+0000 7f000b200640 1 -- 172.21.15.42:0/3004811505 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f000419f450 con 0x7f0004100cd0 2024-08-26T00:10:42.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.079+0000 7f000b200640 1 -- 172.21.15.42:0/3004811505 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00041a6d90 con 0x7f0004100cd0 2024-08-26T00:10:42.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.079+0000 7efffea00640 1 -- 172.21.15.42:0/3004811505 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff40046c0 con 0x7f0004100cd0 2024-08-26T00:10:42.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.081+0000 7f000b200640 1 -- 172.21.15.42:0/3004811505 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effe8005290 con 0x7f0004100cd0 2024-08-26T00:10:42.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.084+0000 7efffea00640 1 -- 172.21.15.42:0/3004811505 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7efff4005040 con 0x7f0004100cd0 2024-08-26T00:10:42.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.086+0000 7efffea00640 1 --2- 172.21.15.42:0/3004811505 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7effec0a2c00 0x7effec0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:42.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.087+0000 7efffea00640 1 -- 172.21.15.42:0/3004811505 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7efff40eef20 con 0x7f0004100cd0 2024-08-26T00:10:42.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.087+0000 7f0009e00640 1 --2- 172.21.15.42:0/3004811505 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7effec0a2c00 0x7effec0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:42.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.088+0000 7f0009e00640 1 --2- 172.21.15.42:0/3004811505 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7effec0a2c00 0x7effec0a50c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efff8009c20 tx=0x7efff8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:42.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.089+0000 7efffea00640 1 -- 172.21.15.42:0/3004811505 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7efff40bbe80 con 0x7f0004100cd0 2024-08-26T00:10:42.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.353+0000 7f000b200640 1 -- 172.21.15.42:0/3004811505 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effe8005580 con 0x7f0004100cd0 2024-08-26T00:10:42.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.354+0000 7efffea00640 1 -- 172.21.15.42:0/3004811505 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11916 (secure 0 0 0) 0x7efff40bb780 con 0x7f0004100cd0 2024-08-26T00:10:42.356 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:10:42.356 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":30,"btime":"2024-08-26T00:10:03:238338+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3168581452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3168581452},{"type":"v1","addr":"172.21.15.42:6839","nonce":3168581452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/3533492491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":3533492491},{"type":"v1","addr":"172.21.15.42:6841","nonce":3533492491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-26T00:00:30.169633+0000","modified":"2024-08-26T00:10:03.120712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24532,"mds_1":24527,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6839/2653014277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2653014277},{"type":"v1","addr":"172.21.15.43:6839","nonce":2653014277}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24532,"qdb_cluster":[24532,24527,24514]},"id":1}]} 2024-08-26T00:10:42.356 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 30 2024-08-26T00:10:42.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.356+0000 7f000b200640 1 -- 172.21.15.42:0/3004811505 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7effec0a2c00 msgr2=0x7effec0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:42.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.356+0000 7f000b200640 1 --2- 172.21.15.42:0/3004811505 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7effec0a2c00 0x7effec0a50c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efff8009c20 tx=0x7efff8005f90 comp rx=0 tx=0).stop 2024-08-26T00:10:42.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.356+0000 7f000b200640 1 -- 172.21.15.42:0/3004811505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0004100cd0 msgr2=0x7f000419a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:42.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.356+0000 7f000b200640 1 --2- 172.21.15.42:0/3004811505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0004100cd0 0x7f000419a750 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efff4000c00 tx=0x7efff4033d90 comp rx=0 tx=0).stop 2024-08-26T00:10:42.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.356+0000 7f000b200640 1 -- 172.21.15.42:0/3004811505 shutdown_connections 2024-08-26T00:10:42.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.356+0000 7f000b200640 1 --2- 172.21.15.42:0/3004811505 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7effec0a2c00 0x7effec0a50c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:42.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.356+0000 7f000b200640 1 --2- 172.21.15.42:0/3004811505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0004105190 0x7f000419eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:42.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.356+0000 7f000b200640 1 --2- 172.21.15.42:0/3004811505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0004100cd0 0x7f000419a750 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:42.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.356+0000 7f000b200640 1 --2- 172.21.15.42:0/3004811505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0004100320 0x7f000419a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:42.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.356+0000 7f000b200640 1 -- 172.21.15.42:0/3004811505 >> 172.21.15.42:0/3004811505 conn(0x7f00040fb6c0 msgr2=0x7f00040fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:42.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.357+0000 7f000b200640 1 -- 172.21.15.42:0/3004811505 shutdown_connections 2024-08-26T00:10:42.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:42.357+0000 7f000b200640 1 -- 172.21.15.42:0/3004811505 wait complete. 2024-08-26T00:10:42.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:42 smithi042 ceph-mon[17225]: pgmap v584: 97 pgs: 97 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.5 MiB/s wr, 1.02k op/s 2024-08-26T00:10:42.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:42 smithi043 ceph-mon[22091]: pgmap v584: 97 pgs: 97 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.5 MiB/s wr, 1.02k op/s 2024-08-26T00:10:42.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:42 smithi181 ceph-mon[22102]: pgmap v584: 97 pgs: 97 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.5 MiB/s wr, 1.02k op/s 2024-08-26T00:10:43.162 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-26T00:10:43.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:43 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/3004811505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:10:43.590 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:10:43.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:43 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/3004811505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:10:43.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:43 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/3004811505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:10:44.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.312+0000 7ff2bfa00640 1 -- 172.21.15.42:0/3626501444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2b81044f0 msgr2=0x7ff2b81109d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:44.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.312+0000 7ff2bfa00640 1 --2- 172.21.15.42:0/3626501444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2b81044f0 0x7ff2b81109d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0009cd0 tx=0x7ff2b002a8f0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.312+0000 7ff2bfa00640 1 -- 172.21.15.42:0/3626501444 shutdown_connections 2024-08-26T00:10:44.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.312+0000 7ff2bfa00640 1 --2- 172.21.15.42:0/3626501444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2b81044f0 0x7ff2b81109d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.312+0000 7ff2bfa00640 1 --2- 172.21.15.42:0/3626501444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b8103b50 0x7ff2b8103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.312+0000 7ff2bfa00640 1 --2- 172.21.15.42:0/3626501444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2b8109c00 0x7ff2b8109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.312+0000 7ff2bfa00640 1 -- 172.21.15.42:0/3626501444 >> 172.21.15.42:0/3626501444 conn(0x7ff2b80ff830 msgr2=0x7ff2b8101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:44.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.312+0000 7ff2bfa00640 1 -- 172.21.15.42:0/3626501444 shutdown_connections 2024-08-26T00:10:44.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.312+0000 7ff2bfa00640 1 -- 172.21.15.42:0/3626501444 wait complete. 2024-08-26T00:10:44.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.314+0000 7ff2bfa00640 1 Processor -- start 2024-08-26T00:10:44.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.314+0000 7ff2bfa00640 1 -- start start 2024-08-26T00:10:44.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.314+0000 7ff2bfa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2b8103b50 0x7ff2b819a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:44.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.314+0000 7ff2bfa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2b81044f0 0x7ff2b819a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:44.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.314+0000 7ff2bfa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b8109c00 0x7ff2b819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:44.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.314+0000 7ff2bfa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b8113f60 con 0x7ff2b8109c00 2024-08-26T00:10:44.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.315+0000 7ff2bfa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b8113de0 con 0x7ff2b81044f0 2024-08-26T00:10:44.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.315+0000 7ff2bfa00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b81140e0 con 0x7ff2b8103b50 2024-08-26T00:10:44.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.315+0000 7ff2bd000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2b8103b50 0x7ff2b819a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:44.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.315+0000 7ff2bd000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2b8103b50 0x7ff2b819a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:57316/0 (socket says 172.21.15.42:57316) 2024-08-26T00:10:44.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.315+0000 7ff2bd000640 1 -- 172.21.15.42:0/2076851596 learned_addr learned my addr 172.21.15.42:0/2076851596 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:44.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.315+0000 7ff2afe00640 1 --2- 172.21.15.42:0/2076851596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2b81044f0 0x7ff2b819a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:44.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.315+0000 7ff2bda00640 1 --2- 172.21.15.42:0/2076851596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b8109c00 0x7ff2b819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:44.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.315+0000 7ff2bd000640 1 -- 172.21.15.42:0/2076851596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2b81044f0 msgr2=0x7ff2b819a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.315+0000 7ff2bd000640 1 --2- 172.21.15.42:0/2076851596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2b81044f0 0x7ff2b819a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.315+0000 7ff2bd000640 1 -- 172.21.15.42:0/2076851596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b8109c00 msgr2=0x7ff2b819eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.315+0000 7ff2bd000640 1 --2- 172.21.15.42:0/2076851596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b8109c00 0x7ff2b819eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.315+0000 7ff2bd000640 1 -- 172.21.15.42:0/2076851596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b819f280 con 0x7ff2b8103b50 2024-08-26T00:10:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.315+0000 7ff2bd000640 1 --2- 172.21.15.42:0/2076851596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2b8103b50 0x7ff2b819a2d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800e9f0 tx=0x7ff2a800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.316+0000 7ff2b6000640 1 -- 172.21.15.42:0/2076851596 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a800cd80 con 0x7ff2b8103b50 2024-08-26T00:10:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.316+0000 7ff2b6000640 1 -- 172.21.15.42:0/2076851596 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2a8005500 con 0x7ff2b8103b50 2024-08-26T00:10:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.316+0000 7ff2b6000640 1 -- 172.21.15.42:0/2076851596 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8010690 con 0x7ff2b8103b50 2024-08-26T00:10:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.316+0000 7ff2bfa00640 1 -- 172.21.15.42:0/2076851596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b819f570 con 0x7ff2b8103b50 2024-08-26T00:10:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.316+0000 7ff2bfa00640 1 -- 172.21.15.42:0/2076851596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2b81a6e50 con 0x7ff2b8103b50 2024-08-26T00:10:44.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.320+0000 7ff2c25c3740 1 Processor -- start 2024-08-26T00:10:44.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.320+0000 7ff2c25c3740 1 -- start start 2024-08-26T00:10:44.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.320+0000 7ff2b6000640 1 -- 172.21.15.42:0/2076851596 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff2a80046c0 con 0x7ff2b8103b50 2024-08-26T00:10:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.320+0000 7ff2c25c3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560f7bd29820 0x560f7bd29c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.320+0000 7ff2c25c3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560f7bd2a140 0x560f7bd344c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.320+0000 7ff2c25c3740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd34a00 0x560f7bd36df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.320+0000 7ff2c25c3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560f7bc8ff30 con 0x560f7bd29820 2024-08-26T00:10:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.320+0000 7ff2c25c3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560f7bc275a0 con 0x560f7bd2a140 2024-08-26T00:10:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.320+0000 7ff2c25c3740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x560f7bc8bef0 con 0x560f7bd34a00 2024-08-26T00:10:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.321+0000 7ff2bd000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560f7bd2a140 0x560f7bd344c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.321+0000 7ff2bd000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560f7bd2a140 0x560f7bd344c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45700/0 (socket says 172.21.15.42:45700) 2024-08-26T00:10:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.321+0000 7ff2bd000640 1 -- 172.21.15.42:0/309841389 learned_addr learned my addr 172.21.15.42:0/309841389 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.321+0000 7ff2bda00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560f7bd29820 0x560f7bd29c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.321+0000 7ff2bd000640 1 -- 172.21.15.42:0/309841389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd34a00 msgr2=0x560f7bd36df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.321+0000 7ff2bd000640 1 --2- 172.21.15.42:0/309841389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd34a00 0x560f7bd36df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.321+0000 7ff2bd000640 1 -- 172.21.15.42:0/309841389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560f7bd29820 msgr2=0x560f7bd29c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.321+0000 7ff2bd000640 1 --2- 172.21.15.42:0/309841389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560f7bd29820 0x560f7bd29c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.321+0000 7ff2bd000640 1 -- 172.21.15.42:0/309841389 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f7ba013c0 con 0x560f7bd2a140 2024-08-26T00:10:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.321+0000 7ff2bda00640 1 --2- 172.21.15.42:0/309841389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560f7bd29820 0x560f7bd29c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:10:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.321+0000 7ff2bd000640 1 --2- 172.21.15.42:0/309841389 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560f7bd2a140 0x560f7bd344c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff2a80d54c0 tx=0x7ff2a80d55b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbf12511d9b04ee3 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.322+0000 7ff2ae000640 1 -- 172.21.15.42:0/309841389 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a80e3070 con 0x560f7bd2a140 2024-08-26T00:10:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.322+0000 7ff2ae000640 1 -- 172.21.15.42:0/309841389 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2a80d15b0 con 0x560f7bd2a140 2024-08-26T00:10:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.322+0000 7ff2ae000640 1 -- 172.21.15.42:0/309841389 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a80db810 con 0x560f7bd2a140 2024-08-26T00:10:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.322+0000 7ff2b6000640 1 --2- 172.21.15.42:0/2076851596 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff29c0a2b80 0x7ff29c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.322+0000 7ff2b6000640 1 -- 172.21.15.42:0/2076851596 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7ff2a80cf510 con 0x7ff2b8103b50 2024-08-26T00:10:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.323+0000 7ff2bda00640 1 --2- 172.21.15.42:0/2076851596 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff29c0a2b80 0x7ff29c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.323+0000 7ff2c25c3740 1 -- 172.21.15.42:0/309841389 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560f7bd2a140 msgr2=0x560f7bd344c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.323+0000 7ff2c25c3740 1 --2- 172.21.15.42:0/309841389 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560f7bd2a140 0x560f7bd344c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff2a80d54c0 tx=0x7ff2a80d55b0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.323+0000 7ff2c25c3740 1 -- 172.21.15.42:0/309841389 shutdown_connections 2024-08-26T00:10:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.323+0000 7ff2c25c3740 1 --2- 172.21.15.42:0/309841389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd34a00 0x560f7bd36df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.323+0000 7ff2c25c3740 1 --2- 172.21.15.42:0/309841389 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560f7bd2a140 0x560f7bd344c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.323+0000 7ff2c25c3740 1 --2- 172.21.15.42:0/309841389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560f7bd29820 0x560f7bd29c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.323+0000 7ff2c25c3740 1 -- 172.21.15.42:0/309841389 >> 172.21.15.42:0/309841389 conn(0x560f7bd25db0 msgr2=0x560f7bd26190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:44.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.323+0000 7ff2c25c3740 1 -- 172.21.15.42:0/309841389 shutdown_connections 2024-08-26T00:10:44.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.323+0000 7ff2c25c3740 1 -- 172.21.15.42:0/309841389 wait complete. 2024-08-26T00:10:44.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.324+0000 7ff2bda00640 1 --2- 172.21.15.42:0/2076851596 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff29c0a2b80 0x7ff29c0a5040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0031040 tx=0x7ff2b0009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:44.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.324+0000 7ff2c25c3740 1 -- start start 2024-08-26T00:10:44.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.324+0000 7ff2c25c3740 1 Processor -- start 2024-08-26T00:10:44.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.324+0000 7ff2c25c3740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd29820 0x560f7bd31900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:44.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.324+0000 7ff2c25c3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560f7bd2a140 0x560f7bd31e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.324+0000 7ff2c25c3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560f7bd34a00 0x560f7bd32380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.324+0000 7ff2c25c3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560f7bd375d0 con 0x560f7bd34a00 2024-08-26T00:10:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.324+0000 7ff2c25c3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560f7bc4ade0 con 0x560f7bd2a140 2024-08-26T00:10:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.324+0000 7ff2c25c3740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x560f7bd37750 con 0x560f7bd29820 2024-08-26T00:10:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.324+0000 7ff2c25c3740 10 client.0 _ll_register_callbacks cb 0x560f7bc397b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:10:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.325+0000 7ff2bd000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd29820 0x560f7bd31900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.325+0000 7ff2bd000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd29820 0x560f7bd31900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:57322/0 (socket says 172.21.15.42:57322) 2024-08-26T00:10:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.325+0000 7ff2bd000640 1 -- 172.21.15.42:0/1593073031 learned_addr learned my addr 172.21.15.42:0/1593073031 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.325+0000 7ff2afe00640 1 --2- 172.21.15.42:0/1593073031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560f7bd2a140 0x560f7bd31e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.325+0000 7ff2bda00640 1 --2- 172.21.15.42:0/1593073031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560f7bd34a00 0x560f7bd32380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.325+0000 7ff2bd000640 1 -- 172.21.15.42:0/1593073031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560f7bd2a140 msgr2=0x560f7bd31e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.325+0000 7ff2bd000640 1 --2- 172.21.15.42:0/1593073031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560f7bd2a140 0x560f7bd31e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.325+0000 7ff2bd000640 1 -- 172.21.15.42:0/1593073031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560f7bd34a00 msgr2=0x560f7bd32380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:44.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.325+0000 7ff2bd000640 1 --2- 172.21.15.42:0/1593073031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560f7bd34a00 0x560f7bd32380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.325+0000 7ff2bd000640 1 -- 172.21.15.42:0/1593073031 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f7bd40a40 con 0x560f7bd29820 2024-08-26T00:10:44.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.325+0000 7ff2bd000640 1 --2- 172.21.15.42:0/1593073031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd29820 0x560f7bd31900 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8098740 tx=0x7ff2a8009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d2c3bf4d1797c76 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:44.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.325+0000 7ff2a6a00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:10:44.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.325+0000 7ff2a6a00640 1 -- 172.21.15.42:0/1593073031 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8098010 con 0x560f7bd29820 2024-08-26T00:10:44.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.326+0000 7ff2a6a00640 1 -- 172.21.15.42:0/1593073031 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7ff2a809bfd0 con 0x560f7bd29820 2024-08-26T00:10:44.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.326+0000 7ff2c25c3740 1 -- 172.21.15.42:0/1593073031 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2a80d15b0 con 0x560f7bd29820 2024-08-26T00:10:44.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.326+0000 7ff2a6a00640 1 -- 172.21.15.42:0/1593073031 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff2a80b9050 con 0x560f7bd29820 2024-08-26T00:10:44.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.326+0000 7ff2c25c3740 10 client.25843 fetch_fsmap learned FSMap version 30 2024-08-26T00:10:44.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.326+0000 7ff2c25c3740 1 -- 172.21.15.42:0/1593073031 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560f7bd375d0 con 0x560f7bd29820 2024-08-26T00:10:44.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.326+0000 7ff2a6a00640 1 -- 172.21.15.42:0/1593073031 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2a80d15b0 con 0x560f7bd29820 2024-08-26T00:10:44.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.326+0000 7ff2a6a00640 1 -- 172.21.15.42:0/1593073031 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7ff2a80a4550 con 0x560f7bd29820 2024-08-26T00:10:44.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.326+0000 7ff2c25c3740 10 client.25843 fetch_fsmap finished waiting for FSMap version 30 2024-08-26T00:10:44.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.326+0000 7ff2c25c3740 10 client.25843 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-26T00:10:44.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.326+0000 7ff2c25c3740 20 client.25843 populate_metadata read hostname 'smithi042' 2024-08-26T00:10:44.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.326+0000 7ff2c25c3740 1 --2- 172.21.15.42:0/1593073031 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x560f7bd44550 0x560f7bd46940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:44.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.326+0000 7ff2c25c3740 4 client.25843 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:10:44.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.327+0000 7ff2c25c3740 1 -- 172.21.15.42:0/1593073031 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f7bc9d4a0 con 0x560f7bd44550 2024-08-26T00:10:44.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.327+0000 7ff2afe00640 1 --2- 172.21.15.42:0/1593073031 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x560f7bd44550 0x560f7bd46940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:44.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.327+0000 7ff2afe00640 1 --2- 172.21.15.42:0/1593073031 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x560f7bd44550 0x560f7bd46940 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2026b0dc97b09984 server_cookie=3ab32e86a89b4789 in_seq=0 out_seq=0 2024-08-26T00:10:44.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.327+0000 7ff2a6a00640 10 client.25843 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:10:44.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.328+0000 7ff2a6a00640 1 -- 172.21.15.42:0/1593073031 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560f7bc9d4a0 con 0x560f7bd44550 2024-08-26T00:10:44.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.328+0000 7ff2a6a00640 10 client.25843 handle_command_reply: tid=0 2024-08-26T00:10:44.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.328+0000 7ff2c25c3740 1 client.25843 shutdown 2024-08-26T00:10:44.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.328+0000 7ff2c25c3740 1 -- 172.21.15.42:0/1593073031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd29820 msgr2=0x560f7bd31900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:44.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.328+0000 7ff2c25c3740 1 --2- 172.21.15.42:0/1593073031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd29820 0x560f7bd31900 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8098740 tx=0x7ff2a8009310 comp rx=0 tx=0).stop 2024-08-26T00:10:44.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.328+0000 7ff2c25c3740 1 -- 172.21.15.42:0/1593073031 shutdown_connections 2024-08-26T00:10:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.328+0000 7ff2c25c3740 1 --2- 172.21.15.42:0/1593073031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560f7bd34a00 0x560f7bd32380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.328+0000 7ff2c25c3740 1 --2- 172.21.15.42:0/1593073031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560f7bd2a140 0x560f7bd31e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.328+0000 7ff2c25c3740 1 --2- 172.21.15.42:0/1593073031 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x560f7bd44550 0x560f7bd46940 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.328+0000 7ff2c25c3740 1 --2- 172.21.15.42:0/1593073031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd29820 0x560f7bd31900 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.328+0000 7ff2a6a00640 0 client.25843 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:10:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.328+0000 7ff2c25c3740 1 -- 172.21.15.42:0/1593073031 >> 172.21.15.42:0/1593073031 conn(0x560f7bd25db0 msgr2=0x560f7bd2bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.329+0000 7ff2c25c3740 1 -- 172.21.15.42:0/1593073031 shutdown_connections 2024-08-26T00:10:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.329+0000 7ff2c25c3740 1 -- 172.21.15.42:0/1593073031 wait complete. 2024-08-26T00:10:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.329+0000 7ff2c25c3740 20 client.25843 trim_cache size 0 max 16384 2024-08-26T00:10:44.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.344+0000 7ff2c25c3740 1 Processor -- start 2024-08-26T00:10:44.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.344+0000 7ff2c25c3740 1 -- start start 2024-08-26T00:10:44.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.344+0000 7ff2c25c3740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd29820 0x560f7bd301f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:44.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.344+0000 7ff2c25c3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560f7bd2a140 0x560f7bd321d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:44.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.344+0000 7ff2c25c3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560f7bd34a00 0x560f7bd4c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:44.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.344+0000 7ff2c25c3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b81b1e90 con 0x560f7bd2a140 2024-08-26T00:10:44.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.344+0000 7ff2c25c3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b81af6d0 con 0x560f7bd34a00 2024-08-26T00:10:44.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.344+0000 7ff2c25c3740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b81ad500 con 0x560f7bd29820 2024-08-26T00:10:44.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.344+0000 7ff2bd000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd29820 0x560f7bd301f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:44.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.344+0000 7ff2afe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560f7bd2a140 0x560f7bd321d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:44.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.344+0000 7ff2bd000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd29820 0x560f7bd301f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:57328/0 (socket says 172.21.15.42:57328) 2024-08-26T00:10:44.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.344+0000 7ff2bd000640 1 -- 172.21.15.42:0/1244973373 learned_addr learned my addr 172.21.15.42:0/1244973373 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:44.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.345+0000 7ff2bda00640 1 --2- 172.21.15.42:0/1244973373 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560f7bd34a00 0x560f7bd4c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:44.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.345+0000 7ff2bd000640 1 -- 172.21.15.42:0/1244973373 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560f7bd34a00 msgr2=0x560f7bd4c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:44.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.345+0000 7ff2bd000640 1 --2- 172.21.15.42:0/1244973373 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560f7bd34a00 0x560f7bd4c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.345+0000 7ff2bd000640 1 -- 172.21.15.42:0/1244973373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560f7bd2a140 msgr2=0x560f7bd321d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:44.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.345+0000 7ff2bd000640 1 --2- 172.21.15.42:0/1244973373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560f7bd2a140 0x560f7bd321d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.345+0000 7ff2bd000640 1 -- 172.21.15.42:0/1244973373 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f7bd2c7d0 con 0x560f7bd29820 2024-08-26T00:10:44.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.345+0000 7ff2afe00640 1 --2- 172.21.15.42:0/1244973373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560f7bd2a140 0x560f7bd321d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:10:44.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.345+0000 7ff2bd000640 1 --2- 172.21.15.42:0/1244973373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd29820 0x560f7bd301f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff2a80049d0 tx=0x7ff2a809a280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cad4fd799f49d22a server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:44.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.345+0000 7ff2ad600640 1 -- 172.21.15.42:0/1244973373 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a809b6d0 con 0x560f7bd29820 2024-08-26T00:10:44.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.345+0000 7ff2ad600640 1 -- 172.21.15.42:0/1244973373 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2a80d5ab0 con 0x560f7bd29820 2024-08-26T00:10:44.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.346+0000 7ff2ad600640 1 -- 172.21.15.42:0/1244973373 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a809b8b0 con 0x560f7bd29820 2024-08-26T00:10:44.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.346+0000 7ff2c25c3740 1 -- 172.21.15.42:0/1244973373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd29820 msgr2=0x560f7bd301f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:44.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.346+0000 7ff2c25c3740 1 --2- 172.21.15.42:0/1244973373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd29820 0x560f7bd301f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff2a80049d0 tx=0x7ff2a809a280 comp rx=0 tx=0).stop 2024-08-26T00:10:44.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.346+0000 7ff2c25c3740 1 -- 172.21.15.42:0/1244973373 shutdown_connections 2024-08-26T00:10:44.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.346+0000 7ff2c25c3740 1 --2- 172.21.15.42:0/1244973373 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560f7bd34a00 0x560f7bd4c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.346+0000 7ff2c25c3740 1 --2- 172.21.15.42:0/1244973373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560f7bd2a140 0x560f7bd321d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.346+0000 7ff2c25c3740 1 --2- 172.21.15.42:0/1244973373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd29820 0x560f7bd301f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.346+0000 7ff2c25c3740 1 -- 172.21.15.42:0/1244973373 >> 172.21.15.42:0/1244973373 conn(0x560f7bd25db0 msgr2=0x560f7bd33870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:44.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.346+0000 7ff2c25c3740 1 -- 172.21.15.42:0/1244973373 shutdown_connections 2024-08-26T00:10:44.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.346+0000 7ff2c25c3740 1 -- 172.21.15.42:0/1244973373 wait complete. 2024-08-26T00:10:44.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.347+0000 7ff2c25c3740 1 -- start start 2024-08-26T00:10:44.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.347+0000 7ff2c25c3740 1 Processor -- start 2024-08-26T00:10:44.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.347+0000 7ff2c25c3740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd29820 0x560f7bd3ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:44.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.347+0000 7ff2c25c3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560f7bd2a140 0x560f7bd2e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:44.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.347+0000 7ff2c25c3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560f7bd34a00 0x560f7bd2e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.348+0000 7ff2c25c3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b81adb90 con 0x560f7bd34a00 2024-08-26T00:10:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.348+0000 7ff2c25c3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b81af000 con 0x560f7bd2a140 2024-08-26T00:10:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.348+0000 7ff2c25c3740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b81ae260 con 0x560f7bd29820 2024-08-26T00:10:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.348+0000 7ff2c25c3740 10 client.0 _ll_register_callbacks cb 0x7ff2a80e1070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:10:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.348+0000 7ff2bd000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd29820 0x560f7bd3ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.348+0000 7ff2bd000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd29820 0x560f7bd3ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:57334/0 (socket says 172.21.15.42:57334) 2024-08-26T00:10:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.348+0000 7ff2bd000640 1 -- 172.21.15.42:0/206739003 learned_addr learned my addr 172.21.15.42:0/206739003 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.348+0000 7ff2afe00640 1 --2- 172.21.15.42:0/206739003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560f7bd2a140 0x560f7bd2e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.348+0000 7ff2bda00640 1 --2- 172.21.15.42:0/206739003 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560f7bd34a00 0x560f7bd2e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.348+0000 7ff2bd000640 1 -- 172.21.15.42:0/206739003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560f7bd2a140 msgr2=0x560f7bd2e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.348+0000 7ff2bd000640 1 --2- 172.21.15.42:0/206739003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560f7bd2a140 0x560f7bd2e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.348+0000 7ff2bd000640 1 -- 172.21.15.42:0/206739003 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560f7bd34a00 msgr2=0x560f7bd2e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.348+0000 7ff2bd000640 1 --2- 172.21.15.42:0/206739003 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560f7bd34a00 0x560f7bd2e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.348+0000 7ff2bd000640 1 -- 172.21.15.42:0/206739003 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f7bd2eef0 con 0x560f7bd29820 2024-08-26T00:10:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.348+0000 7ff2bda00640 1 --2- 172.21.15.42:0/206739003 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560f7bd34a00 0x560f7bd2e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:10:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.348+0000 7ff2bd000640 1 --2- 172.21.15.42:0/206739003 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd29820 0x560f7bd3ce60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff2a809bd00 tx=0x7ff2a80a4a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a437f35219d0c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.348+0000 7ff2a6a00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:10:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.349+0000 7ff2a6a00640 1 -- 172.21.15.42:0/206739003 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a809bb40 con 0x560f7bd29820 2024-08-26T00:10:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.349+0000 7ff2a6a00640 1 -- 172.21.15.42:0/206739003 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7ff2a809bfd0 con 0x560f7bd29820 2024-08-26T00:10:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.349+0000 7ff2c25c3740 1 -- 172.21.15.42:0/206739003 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2a80d5ab0 con 0x560f7bd29820 2024-08-26T00:10:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.349+0000 7ff2a6a00640 1 -- 172.21.15.42:0/206739003 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff2a809b8b0 con 0x560f7bd29820 2024-08-26T00:10:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.349+0000 7ff2c25c3740 10 client.25849 fetch_fsmap learned FSMap version 30 2024-08-26T00:10:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.349+0000 7ff2c25c3740 1 -- 172.21.15.42:0/206739003 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560f7bd2eef0 con 0x560f7bd29820 2024-08-26T00:10:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.349+0000 7ff2a6a00640 1 -- 172.21.15.42:0/206739003 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2a80d5ab0 con 0x560f7bd29820 2024-08-26T00:10:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.349+0000 7ff2a6a00640 1 -- 172.21.15.42:0/206739003 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7ff2a80cf080 con 0x560f7bd29820 2024-08-26T00:10:44.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.349+0000 7ff2c25c3740 10 client.25849 fetch_fsmap finished waiting for FSMap version 30 2024-08-26T00:10:44.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.349+0000 7ff2c25c3740 10 client.25849 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-26T00:10:44.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.349+0000 7ff2c25c3740 20 client.25849 populate_metadata read hostname 'smithi042' 2024-08-26T00:10:44.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.349+0000 7ff2c25c3740 1 --2- 172.21.15.42:0/206739003 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x560f7bdaf160 0x560f7bdb1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:44.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.349+0000 7ff2c25c3740 4 client.25849 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:10:44.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.349+0000 7ff2c25c3740 1 -- 172.21.15.42:0/206739003 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560f7bc979b0 con 0x560f7bdaf160 2024-08-26T00:10:44.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.350+0000 7ff2afe00640 1 --2- 172.21.15.42:0/206739003 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x560f7bdaf160 0x560f7bdb1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:44.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.350+0000 7ff2afe00640 1 --2- 172.21.15.42:0/206739003 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x560f7bdaf160 0x560f7bdb1580 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5fc7375ba0eb7d70 server_cookie=14b86f9e5e6eb639 in_seq=0 out_seq=0 2024-08-26T00:10:44.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.350+0000 7ff2a6a00640 10 client.25849 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:10:44.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.350+0000 7ff2a6a00640 1 -- 172.21.15.42:0/206739003 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560f7bc979b0 con 0x560f7bdaf160 2024-08-26T00:10:44.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.350+0000 7ff2a6a00640 10 client.25849 handle_command_reply: tid=0 2024-08-26T00:10:44.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.350+0000 7ff2c25c3740 1 client.25849 shutdown 2024-08-26T00:10:44.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.351+0000 7ff2c25c3740 1 -- 172.21.15.42:0/206739003 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd29820 msgr2=0x560f7bd3ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:44.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.351+0000 7ff2c25c3740 1 --2- 172.21.15.42:0/206739003 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd29820 0x560f7bd3ce60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff2a809bd00 tx=0x7ff2a80a4a30 comp rx=0 tx=0).stop 2024-08-26T00:10:44.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.351+0000 7ff2c25c3740 1 -- 172.21.15.42:0/206739003 shutdown_connections 2024-08-26T00:10:44.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.351+0000 7ff2c25c3740 1 --2- 172.21.15.42:0/206739003 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560f7bd34a00 0x560f7bd2e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.351+0000 7ff2c25c3740 1 --2- 172.21.15.42:0/206739003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560f7bd2a140 0x560f7bd2e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.351+0000 7ff2c25c3740 1 --2- 172.21.15.42:0/206739003 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x560f7bdaf160 0x560f7bdb1580 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.351+0000 7ff2c25c3740 1 --2- 172.21.15.42:0/206739003 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560f7bd29820 0x560f7bd3ce60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.351+0000 7ff2c25c3740 1 -- 172.21.15.42:0/206739003 >> 172.21.15.42:0/206739003 conn(0x560f7bd25db0 msgr2=0x560f7bd32f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:44.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.351+0000 7ff2a6a00640 0 client.25849 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:10:44.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.351+0000 7ff2c25c3740 1 -- 172.21.15.42:0/206739003 shutdown_connections 2024-08-26T00:10:44.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.351+0000 7ff2c25c3740 1 -- 172.21.15.42:0/206739003 wait complete. 2024-08-26T00:10:44.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.351+0000 7ff2c25c3740 20 client.25849 trim_cache size 0 max 16384 2024-08-26T00:10:44.357 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:10:44.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.352+0000 7ff2bfa00640 1 -- 172.21.15.42:0/2076851596 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff29c0a2b80 msgr2=0x7ff29c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:44.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.352+0000 7ff2bfa00640 1 --2- 172.21.15.42:0/2076851596 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff29c0a2b80 0x7ff29c0a5040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0031040 tx=0x7ff2b0009360 comp rx=0 tx=0).stop 2024-08-26T00:10:44.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.352+0000 7ff2bfa00640 1 -- 172.21.15.42:0/2076851596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2b8103b50 msgr2=0x7ff2b819a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:44.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.352+0000 7ff2bfa00640 1 --2- 172.21.15.42:0/2076851596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2b8103b50 0x7ff2b819a2d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800e9f0 tx=0x7ff2a800edf0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.352+0000 7ff2bfa00640 1 -- 172.21.15.42:0/2076851596 shutdown_connections 2024-08-26T00:10:44.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.352+0000 7ff2bfa00640 1 --2- 172.21.15.42:0/2076851596 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff29c0a2b80 0x7ff29c0a5040 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.352+0000 7ff2bfa00640 1 --2- 172.21.15.42:0/2076851596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b8109c00 0x7ff2b819eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.352+0000 7ff2bfa00640 1 --2- 172.21.15.42:0/2076851596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2b81044f0 0x7ff2b819a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.352+0000 7ff2bfa00640 1 --2- 172.21.15.42:0/2076851596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2b8103b50 0x7ff2b819a2d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:44.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.352+0000 7ff2bfa00640 1 -- 172.21.15.42:0/2076851596 >> 172.21.15.42:0/2076851596 conn(0x7ff2b80ff830 msgr2=0x7ff2b8100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:44.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.352+0000 7ff2bfa00640 1 -- 172.21.15.42:0/2076851596 shutdown_connections 2024-08-26T00:10:44.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:44.352+0000 7ff2bfa00640 1 -- 172.21.15.42:0/2076851596 wait complete. 2024-08-26T00:10:44.723 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:44 smithi042 ceph-mon[17225]: pgmap v585: 97 pgs: 97 active+clean; 2.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 939 op/s 2024-08-26T00:10:44.723 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:44 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:10:44.723 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:44 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:10:44.723 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:44 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:10:44.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:44 smithi043 ceph-mon[22091]: pgmap v585: 97 pgs: 97 active+clean; 2.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 939 op/s 2024-08-26T00:10:44.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:44 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:10:44.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:44 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:10:44.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:44 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:10:44.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:44 smithi181 ceph-mon[22102]: pgmap v585: 97 pgs: 97 active+clean; 2.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 939 op/s 2024-08-26T00:10:44.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:44 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:10:44.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:44 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:10:44.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:44 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:10:45.166 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-26T00:10:45.631 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:10:46.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.214+0000 7f9279e00640 1 -- 172.21.15.42:0/1225364286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9274104310 msgr2=0x7f9274110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:46.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.214+0000 7f9279e00640 1 --2- 172.21.15.42:0/1225364286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9274104310 0x7f9274110840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f926c009cd0 tx=0x7f926c02a8f0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.214+0000 7f9279e00640 1 -- 172.21.15.42:0/1225364286 shutdown_connections 2024-08-26T00:10:46.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.214+0000 7f9279e00640 1 --2- 172.21.15.42:0/1225364286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9274104310 0x7f9274110840 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.214+0000 7f9279e00640 1 --2- 172.21.15.42:0/1225364286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9274103970 0x7f9274103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.214+0000 7f9279e00640 1 --2- 172.21.15.42:0/1225364286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9274109970 0x7f9274109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.214+0000 7f9279e00640 1 -- 172.21.15.42:0/1225364286 >> 172.21.15.42:0/1225364286 conn(0x7f92740ff670 msgr2=0x7f9274101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:46.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.215+0000 7f9279e00640 1 -- 172.21.15.42:0/1225364286 shutdown_connections 2024-08-26T00:10:46.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.215+0000 7f9279e00640 1 -- 172.21.15.42:0/1225364286 wait complete. 2024-08-26T00:10:46.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.215+0000 7f9279e00640 1 Processor -- start 2024-08-26T00:10:46.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.216+0000 7f9279e00640 1 -- start start 2024-08-26T00:10:46.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.216+0000 7f9279e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9274103970 0x7f927419a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:46.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.216+0000 7f9279e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9274104310 0x7f927419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:46.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.216+0000 7f9279e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9274109970 0x7f927419ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:46.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.216+0000 7f9279e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9274113dc0 con 0x7f9274103970 2024-08-26T00:10:46.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.216+0000 7f9279e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9274113c40 con 0x7f9274109970 2024-08-26T00:10:46.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.216+0000 7f9279e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9274113f40 con 0x7f9274104310 2024-08-26T00:10:46.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.216+0000 7f9273e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9274104310 0x7f927419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:46.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.216+0000 7f9278a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9274103970 0x7f927419a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:46.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.216+0000 7f9273e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9274104310 0x7f927419a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:37304/0 (socket says 172.21.15.42:37304) 2024-08-26T00:10:46.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.216+0000 7f9273e00640 1 -- 172.21.15.42:0/3378557906 learned_addr learned my addr 172.21.15.42:0/3378557906 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:46.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.216+0000 7f9279400640 1 --2- 172.21.15.42:0/3378557906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9274109970 0x7f927419ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:46.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.217+0000 7f9273e00640 1 -- 172.21.15.42:0/3378557906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9274109970 msgr2=0x7f927419ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:46.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.217+0000 7f9273e00640 1 --2- 172.21.15.42:0/3378557906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9274109970 0x7f927419ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.217+0000 7f9273e00640 1 -- 172.21.15.42:0/3378557906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9274103970 msgr2=0x7f927419a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:46.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.217+0000 7f9273e00640 1 --2- 172.21.15.42:0/3378557906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9274103970 0x7f927419a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.217+0000 7f9273e00640 1 -- 172.21.15.42:0/3378557906 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f927419f150 con 0x7f9274104310 2024-08-26T00:10:46.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.217+0000 7f9278a00640 1 --2- 172.21.15.42:0/3378557906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9274103970 0x7f927419a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:10:46.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.217+0000 7f9273e00640 1 --2- 172.21.15.42:0/3378557906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9274104310 0x7f927419a6e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f926000e9f0 tx=0x7f926000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:46.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.217+0000 7f9271600640 1 -- 172.21.15.42:0/3378557906 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926000cd80 con 0x7f9274104310 2024-08-26T00:10:46.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.217+0000 7f9271600640 1 -- 172.21.15.42:0/3378557906 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9260010910 con 0x7f9274104310 2024-08-26T00:10:46.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.217+0000 7f9271600640 1 -- 172.21.15.42:0/3378557906 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9260018990 con 0x7f9274104310 2024-08-26T00:10:46.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.217+0000 7f9279e00640 1 -- 172.21.15.42:0/3378557906 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f927419f440 con 0x7f9274104310 2024-08-26T00:10:46.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.218+0000 7f9279e00640 1 -- 172.21.15.42:0/3378557906 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92741a6d20 con 0x7f9274104310 2024-08-26T00:10:46.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.221+0000 7f927e06b740 1 Processor -- start 2024-08-26T00:10:46.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.221+0000 7f927e06b740 1 -- start start 2024-08-26T00:10:46.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.221+0000 7f927e06b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e7925fa30 0x562e7925fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:46.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.221+0000 7f927e06b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 0x562e7926a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:46.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.221+0000 7f9271600640 1 -- 172.21.15.42:0/3378557906 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9260010ac0 con 0x7f9274104310 2024-08-26T00:10:46.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.221+0000 7f927e06b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e7926ac10 0x562e7926d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:46.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.221+0000 7f927e06b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562e791c5f30 con 0x562e7926ac10 2024-08-26T00:10:46.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.221+0000 7f927e06b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562e7915d5a0 con 0x562e7925fa30 2024-08-26T00:10:46.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.221+0000 7f927e06b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562e791c1ef0 con 0x562e79260350 2024-08-26T00:10:46.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.221+0000 7f9279400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e7925fa30 0x562e7925fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:46.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.221+0000 7f9279400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e7925fa30 0x562e7925fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:40510/0 (socket says 172.21.15.42:40510) 2024-08-26T00:10:46.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.221+0000 7f9278a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 0x562e7926a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:46.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.221+0000 7f9279400640 1 -- 172.21.15.42:0/2084924039 learned_addr learned my addr 172.21.15.42:0/2084924039 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:46.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.222+0000 7f9279400640 1 -- 172.21.15.42:0/2084924039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 msgr2=0x562e7926a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:46.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.222+0000 7f9279400640 1 --2- 172.21.15.42:0/2084924039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 0x562e7926a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.222+0000 7f9273e00640 1 --2- 172.21.15.42:0/2084924039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e7926ac10 0x562e7926d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:46.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.222+0000 7f9279400640 1 -- 172.21.15.42:0/2084924039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e7926ac10 msgr2=0x562e7926d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:46.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.222+0000 7f9279400640 1 --2- 172.21.15.42:0/2084924039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e7926ac10 0x562e7926d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.222+0000 7f9279400640 1 -- 172.21.15.42:0/2084924039 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e78f373c0 con 0x562e7925fa30 2024-08-26T00:10:46.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.222+0000 7f9273e00640 1 --2- 172.21.15.42:0/2084924039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e7926ac10 0x562e7926d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:10:46.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.222+0000 7f9279400640 1 --2- 172.21.15.42:0/2084924039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e7925fa30 0x562e7925fe10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f926c009cd0 tx=0x7f926c005f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11421a87d0af96ab server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:46.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.222+0000 7f9265c00640 1 -- 172.21.15.42:0/2084924039 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c030760 con 0x562e7925fa30 2024-08-26T00:10:46.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.222+0000 7f9265c00640 1 -- 172.21.15.42:0/2084924039 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f926c036030 con 0x562e7925fa30 2024-08-26T00:10:46.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.222+0000 7f9265c00640 1 -- 172.21.15.42:0/2084924039 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c0043a0 con 0x562e7925fa30 2024-08-26T00:10:46.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.223+0000 7f9271600640 1 --2- 172.21.15.42:0/3378557906 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f925c0a2c00 0x7f925c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:46.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.223+0000 7f9271600640 1 -- 172.21.15.42:0/3378557906 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f92600cf2e0 con 0x7f9274104310 2024-08-26T00:10:46.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.223+0000 7f9278a00640 1 --2- 172.21.15.42:0/3378557906 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f925c0a2c00 0x7f925c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:46.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.223+0000 7f927e06b740 1 -- 172.21.15.42:0/2084924039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e7925fa30 msgr2=0x562e7925fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:46.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.223+0000 7f927e06b740 1 --2- 172.21.15.42:0/2084924039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e7925fa30 0x562e7925fe10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f926c009cd0 tx=0x7f926c005f80 comp rx=0 tx=0).stop 2024-08-26T00:10:46.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.223+0000 7f927e06b740 1 -- 172.21.15.42:0/2084924039 shutdown_connections 2024-08-26T00:10:46.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.223+0000 7f927e06b740 1 --2- 172.21.15.42:0/2084924039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e7926ac10 0x562e7926d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.223+0000 7f927e06b740 1 --2- 172.21.15.42:0/2084924039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 0x562e7926a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.223+0000 7f927e06b740 1 --2- 172.21.15.42:0/2084924039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e7925fa30 0x562e7925fe10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.223+0000 7f927e06b740 1 -- 172.21.15.42:0/2084924039 >> 172.21.15.42:0/2084924039 conn(0x562e7925bfc0 msgr2=0x562e7925c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:46.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.224+0000 7f927e06b740 1 -- 172.21.15.42:0/2084924039 shutdown_connections 2024-08-26T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.224+0000 7f927e06b740 1 -- 172.21.15.42:0/2084924039 wait complete. 2024-08-26T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.224+0000 7f9278a00640 1 --2- 172.21.15.42:0/3378557906 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f925c0a2c00 0x7f925c0a50c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x562e7925ce20 tx=0x7f9268005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.224+0000 7f927e06b740 1 -- start start 2024-08-26T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.224+0000 7f927e06b740 1 Processor -- start 2024-08-26T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.225+0000 7f927e06b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e7925fa30 0x562e79267a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.225+0000 7f927e06b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 0x562e79267fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.225+0000 7f927e06b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e7926ac10 0x562e79268500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.225+0000 7f927e06b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562e7926d7e0 con 0x562e7926ac10 2024-08-26T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.225+0000 7f927e06b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562e79180de0 con 0x562e7925fa30 2024-08-26T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.225+0000 7f927e06b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562e7926d960 con 0x562e79260350 2024-08-26T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.225+0000 7f927e06b740 10 client.0 _ll_register_callbacks cb 0x562e7916f7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:10:46.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.225+0000 7f9273e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 0x562e79267fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:46.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.225+0000 7f9279400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e7926ac10 0x562e79268500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:46.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.225+0000 7f9273e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 0x562e79267fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:37318/0 (socket says 172.21.15.42:37318) 2024-08-26T00:10:46.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.225+0000 7f9273e00640 1 -- 172.21.15.42:0/4142724617 learned_addr learned my addr 172.21.15.42:0/4142724617 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:46.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.226+0000 7f9278a00640 1 --2- 172.21.15.42:0/4142724617 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e7925fa30 0x562e79267a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:46.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.226+0000 7f9273e00640 1 -- 172.21.15.42:0/4142724617 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e7925fa30 msgr2=0x562e79267a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:46.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.226+0000 7f9273e00640 1 --2- 172.21.15.42:0/4142724617 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e7925fa30 0x562e79267a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.226+0000 7f9273e00640 1 -- 172.21.15.42:0/4142724617 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e7926ac10 msgr2=0x562e79268500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:46.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.226+0000 7f9273e00640 1 --2- 172.21.15.42:0/4142724617 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e7926ac10 0x562e79268500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.226+0000 7f9273e00640 1 -- 172.21.15.42:0/4142724617 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e7927f490 con 0x562e79260350 2024-08-26T00:10:46.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.226+0000 7f9273e00640 1 --2- 172.21.15.42:0/4142724617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 0x562e79267fc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f926009b8b0 tx=0x7f926009bc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdac0d4c7e8d6112 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:46.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.226+0000 7f925a000640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:10:46.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.226+0000 7f925a000640 1 -- 172.21.15.42:0/4142724617 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9260018b30 con 0x562e79260350 2024-08-26T00:10:46.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.226+0000 7f925a000640 1 -- 172.21.15.42:0/4142724617 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f9260018cd0 con 0x562e79260350 2024-08-26T00:10:46.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.226+0000 7f927e06b740 1 -- 172.21.15.42:0/4142724617 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f926c036030 con 0x562e79260350 2024-08-26T00:10:46.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.226+0000 7f925a000640 1 -- 172.21.15.42:0/4142724617 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f926009b000 con 0x562e79260350 2024-08-26T00:10:46.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.226+0000 7f927e06b740 10 client.25861 fetch_fsmap learned FSMap version 30 2024-08-26T00:10:46.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.226+0000 7f927e06b740 1 -- 172.21.15.42:0/4142724617 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562e79281cf0 con 0x562e79260350 2024-08-26T00:10:46.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.227+0000 7f925a000640 1 -- 172.21.15.42:0/4142724617 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f926c036030 con 0x562e79260350 2024-08-26T00:10:46.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.227+0000 7f925a000640 1 -- 172.21.15.42:0/4142724617 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f926009aa70 con 0x562e79260350 2024-08-26T00:10:46.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.227+0000 7f927e06b740 10 client.25861 fetch_fsmap finished waiting for FSMap version 30 2024-08-26T00:10:46.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.227+0000 7f927e06b740 10 client.25861 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-26T00:10:46.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.227+0000 7f927e06b740 20 client.25861 populate_metadata read hostname 'smithi042' 2024-08-26T00:10:46.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.227+0000 7f927e06b740 1 --2- 172.21.15.42:0/4142724617 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562e792831b0 0x562e792855a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:46.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.227+0000 7f927e06b740 4 client.25861 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:10:46.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.227+0000 7f927e06b740 1 -- 172.21.15.42:0/4142724617 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e791d34a0 con 0x562e792831b0 2024-08-26T00:10:46.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.227+0000 7f9278a00640 1 --2- 172.21.15.42:0/4142724617 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562e792831b0 0x562e792855a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:46.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.228+0000 7f9278a00640 1 --2- 172.21.15.42:0/4142724617 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562e792831b0 0x562e792855a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5af3ac8bfbbce85c server_cookie=7a0e5b14a0c3d884 in_seq=0 out_seq=0 2024-08-26T00:10:46.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.228+0000 7f925a000640 10 client.25861 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:10:46.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.229+0000 7f925a000640 1 -- 172.21.15.42:0/4142724617 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562e791d34a0 con 0x562e792831b0 2024-08-26T00:10:46.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.229+0000 7f925a000640 10 client.25861 handle_command_reply: tid=0 2024-08-26T00:10:46.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.229+0000 7f927e06b740 1 client.25861 shutdown 2024-08-26T00:10:46.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.229+0000 7f927e06b740 1 -- 172.21.15.42:0/4142724617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 msgr2=0x562e79267fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:46.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.229+0000 7f927e06b740 1 --2- 172.21.15.42:0/4142724617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 0x562e79267fc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f926009b8b0 tx=0x7f926009bc70 comp rx=0 tx=0).stop 2024-08-26T00:10:46.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.229+0000 7f927e06b740 1 -- 172.21.15.42:0/4142724617 shutdown_connections 2024-08-26T00:10:46.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.229+0000 7f927e06b740 1 --2- 172.21.15.42:0/4142724617 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562e792831b0 0x562e792855a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.229+0000 7f927e06b740 1 --2- 172.21.15.42:0/4142724617 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e7926ac10 0x562e79268500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.229+0000 7f927e06b740 1 --2- 172.21.15.42:0/4142724617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 0x562e79267fc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.229+0000 7f927e06b740 1 --2- 172.21.15.42:0/4142724617 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e7925fa30 0x562e79267a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.229+0000 7f925a000640 0 client.25861 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:10:46.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.229+0000 7f927e06b740 1 -- 172.21.15.42:0/4142724617 >> 172.21.15.42:0/4142724617 conn(0x562e7925bfc0 msgr2=0x562e79261ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:46.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.229+0000 7f927e06b740 1 -- 172.21.15.42:0/4142724617 shutdown_connections 2024-08-26T00:10:46.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.230+0000 7f927e06b740 1 -- 172.21.15.42:0/4142724617 wait complete. 2024-08-26T00:10:46.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.230+0000 7f927e06b740 20 client.25861 trim_cache size 0 max 16384 2024-08-26T00:10:46.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.245+0000 7f927e06b740 1 Processor -- start 2024-08-26T00:10:46.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.245+0000 7f927e06b740 1 -- start start 2024-08-26T00:10:46.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.245+0000 7f927e06b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e7925fa30 0x562e79262490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:46.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.245+0000 7f927e06b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 0x562e792691d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:46.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.246+0000 7f927e06b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e7926ac10 0x562e7928ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:46.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.246+0000 7f927e06b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f92741ad910 con 0x562e7925fa30 2024-08-26T00:10:46.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.246+0000 7f927e06b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f92741ab150 con 0x562e7926ac10 2024-08-26T00:10:46.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.246+0000 7f927e06b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f92741a8fc0 con 0x562e79260350 2024-08-26T00:10:46.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.246+0000 7f9278a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e7925fa30 0x562e79262490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:46.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.246+0000 7f9273e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 0x562e792691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:46.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.246+0000 7f9278a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e7925fa30 0x562e79262490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41198/0 (socket says 172.21.15.42:41198) 2024-08-26T00:10:46.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.246+0000 7f9278a00640 1 -- 172.21.15.42:0/3708198871 learned_addr learned my addr 172.21.15.42:0/3708198871 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:46.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.246+0000 7f9279400640 1 --2- 172.21.15.42:0/3708198871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e7926ac10 0x562e7928ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:46.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.246+0000 7f9273e00640 1 -- 172.21.15.42:0/3708198871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e7926ac10 msgr2=0x562e7928ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:46.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.246+0000 7f9273e00640 1 --2- 172.21.15.42:0/3708198871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e7926ac10 0x562e7928ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.246+0000 7f9273e00640 1 -- 172.21.15.42:0/3708198871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e7925fa30 msgr2=0x562e79262490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:46.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.246+0000 7f9273e00640 1 --2- 172.21.15.42:0/3708198871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e7925fa30 0x562e79262490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.246+0000 7f9273e00640 1 -- 172.21.15.42:0/3708198871 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e7926a080 con 0x562e79260350 2024-08-26T00:10:46.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.246+0000 7f9279400640 1 --2- 172.21.15.42:0/3708198871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e7926ac10 0x562e7928ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:10:46.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.246+0000 7f9273e00640 1 --2- 172.21.15.42:0/3708198871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 0x562e792691d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9260098010 tx=0x7f92600a48f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58b3752e78d80c86 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:46.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.247+0000 7f9265200640 1 -- 172.21.15.42:0/3708198871 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926009b1a0 con 0x562e79260350 2024-08-26T00:10:46.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.247+0000 7f9265200640 1 -- 172.21.15.42:0/3708198871 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f926009aa70 con 0x562e79260350 2024-08-26T00:10:46.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.247+0000 7f9265200640 1 -- 172.21.15.42:0/3708198871 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9260018b30 con 0x562e79260350 2024-08-26T00:10:46.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.247+0000 7f927e06b740 1 -- 172.21.15.42:0/3708198871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 msgr2=0x562e792691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:46.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.247+0000 7f927e06b740 1 --2- 172.21.15.42:0/3708198871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 0x562e792691d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9260098010 tx=0x7f92600a48f0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.247+0000 7f927e06b740 1 -- 172.21.15.42:0/3708198871 shutdown_connections 2024-08-26T00:10:46.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.247+0000 7f927e06b740 1 --2- 172.21.15.42:0/3708198871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e7926ac10 0x562e7928ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.247+0000 7f927e06b740 1 --2- 172.21.15.42:0/3708198871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 0x562e792691d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.247+0000 7f927e06b740 1 --2- 172.21.15.42:0/3708198871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e7925fa30 0x562e79262490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.247+0000 7f927e06b740 1 -- 172.21.15.42:0/3708198871 >> 172.21.15.42:0/3708198871 conn(0x562e7925bfc0 msgr2=0x562e79266a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:46.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.248+0000 7f927e06b740 1 -- 172.21.15.42:0/3708198871 shutdown_connections 2024-08-26T00:10:46.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.248+0000 7f927e06b740 1 -- 172.21.15.42:0/3708198871 wait complete. 2024-08-26T00:10:46.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.248+0000 7f927e06b740 1 -- start start 2024-08-26T00:10:46.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.248+0000 7f927e06b740 1 Processor -- start 2024-08-26T00:10:46.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.249+0000 7f927e06b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e7925fa30 0x562e7927ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:46.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.249+0000 7f927e06b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 0x562e79264680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:46.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.249+0000 7f927e06b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e7926ac10 0x562e79264bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:46.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.249+0000 7f927e06b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f92741a9610 con 0x562e7925fa30 2024-08-26T00:10:46.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.249+0000 7f927e06b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f92741aaa80 con 0x562e7926ac10 2024-08-26T00:10:46.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.249+0000 7f927e06b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f92741a9ce0 con 0x562e79260350 2024-08-26T00:10:46.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.249+0000 7f927e06b740 10 client.0 _ll_register_callbacks cb 0x7f9260009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:10:46.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.249+0000 7f9278a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e7925fa30 0x562e7927ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:46.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.249+0000 7f9273e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 0x562e79264680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:46.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.249+0000 7f9273e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 0x562e79264680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:37336/0 (socket says 172.21.15.42:37336) 2024-08-26T00:10:46.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.249+0000 7f9273e00640 1 -- 172.21.15.42:0/3570818997 learned_addr learned my addr 172.21.15.42:0/3570818997 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:46.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.249+0000 7f9279400640 1 --2- 172.21.15.42:0/3570818997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e7926ac10 0x562e79264bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:46.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.250+0000 7f9273e00640 1 -- 172.21.15.42:0/3570818997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e7926ac10 msgr2=0x562e79264bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:46.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.250+0000 7f9273e00640 1 --2- 172.21.15.42:0/3570818997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e7926ac10 0x562e79264bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.250+0000 7f9273e00640 1 -- 172.21.15.42:0/3570818997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e7925fa30 msgr2=0x562e7927ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:46.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.250+0000 7f9273e00640 1 --2- 172.21.15.42:0/3570818997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e7925fa30 0x562e7927ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.250+0000 7f9273e00640 1 -- 172.21.15.42:0/3570818997 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e79260180 con 0x562e79260350 2024-08-26T00:10:46.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.250+0000 7f9273e00640 1 --2- 172.21.15.42:0/3570818997 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 0x562e79264680 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9260098530 tx=0x7f926009ace0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4934fdc2c72d3369 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:46.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.250+0000 7f925a000640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:10:46.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.250+0000 7f925a000640 1 -- 172.21.15.42:0/3570818997 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92600a12c0 con 0x562e79260350 2024-08-26T00:10:46.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.250+0000 7f925a000640 1 -- 172.21.15.42:0/3570818997 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f9260018b30 con 0x562e79260350 2024-08-26T00:10:46.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.250+0000 7f927e06b740 1 -- 172.21.15.42:0/3570818997 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f926009aa70 con 0x562e79260350 2024-08-26T00:10:46.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.250+0000 7f925a000640 1 -- 172.21.15.42:0/3570818997 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9260018d70 con 0x562e79260350 2024-08-26T00:10:46.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.250+0000 7f927e06b740 10 client.25867 fetch_fsmap learned FSMap version 30 2024-08-26T00:10:46.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.250+0000 7f927e06b740 1 -- 172.21.15.42:0/3570818997 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562e79260180 con 0x562e79260350 2024-08-26T00:10:46.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.251+0000 7f925a000640 1 -- 172.21.15.42:0/3570818997 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f926009aa70 con 0x562e79260350 2024-08-26T00:10:46.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.251+0000 7f925a000640 1 -- 172.21.15.42:0/3570818997 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f92600861b0 con 0x562e79260350 2024-08-26T00:10:46.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.251+0000 7f927e06b740 10 client.25867 fetch_fsmap finished waiting for FSMap version 30 2024-08-26T00:10:46.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.251+0000 7f927e06b740 10 client.25867 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-26T00:10:46.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.251+0000 7f927e06b740 20 client.25867 populate_metadata read hostname 'smithi042' 2024-08-26T00:10:46.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.251+0000 7f927e06b740 1 --2- 172.21.15.42:0/3570818997 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562e792ede00 0x562e792f0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:46.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.251+0000 7f927e06b740 4 client.25867 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:10:46.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.251+0000 7f927e06b740 1 -- 172.21.15.42:0/3570818997 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562e791cd9b0 con 0x562e792ede00 2024-08-26T00:10:46.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.251+0000 7f9278a00640 1 --2- 172.21.15.42:0/3570818997 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562e792ede00 0x562e792f0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:46.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.252+0000 7f9278a00640 1 --2- 172.21.15.42:0/3570818997 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562e792ede00 0x562e792f0220 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=14381aad0dde9366 server_cookie=65656a9334dbb7be in_seq=0 out_seq=0 2024-08-26T00:10:46.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.252+0000 7f925a000640 10 client.25867 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:10:46.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.252+0000 7f925a000640 1 -- 172.21.15.42:0/3570818997 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562e791cd9b0 con 0x562e792ede00 2024-08-26T00:10:46.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.252+0000 7f925a000640 10 client.25867 handle_command_reply: tid=0 2024-08-26T00:10:46.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.252+0000 7f927e06b740 1 client.25867 shutdown 2024-08-26T00:10:46.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.252+0000 7f927e06b740 1 -- 172.21.15.42:0/3570818997 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 msgr2=0x562e79264680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:46.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.252+0000 7f927e06b740 1 --2- 172.21.15.42:0/3570818997 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 0x562e79264680 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9260098530 tx=0x7f926009ace0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.252+0000 7f927e06b740 1 -- 172.21.15.42:0/3570818997 shutdown_connections 2024-08-26T00:10:46.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.252+0000 7f927e06b740 1 --2- 172.21.15.42:0/3570818997 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562e792ede00 0x562e792f0220 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.252+0000 7f927e06b740 1 --2- 172.21.15.42:0/3570818997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562e7926ac10 0x562e79264bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.252+0000 7f927e06b740 1 --2- 172.21.15.42:0/3570818997 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e79260350 0x562e79264680 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.252+0000 7f927e06b740 1 --2- 172.21.15.42:0/3570818997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e7925fa30 0x562e7927ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.252+0000 7f927e06b740 1 -- 172.21.15.42:0/3570818997 >> 172.21.15.42:0/3570818997 conn(0x562e7925bfc0 msgr2=0x562e7925b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:46.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.252+0000 7f925a000640 0 client.25867 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:10:46.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.252+0000 7f927e06b740 1 -- 172.21.15.42:0/3570818997 shutdown_connections 2024-08-26T00:10:46.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.252+0000 7f927e06b740 1 -- 172.21.15.42:0/3570818997 wait complete. 2024-08-26T00:10:46.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.253+0000 7f927e06b740 20 client.25867 trim_cache size 0 max 16384 2024-08-26T00:10:46.259 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:10:46.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.253+0000 7f9279e00640 1 -- 172.21.15.42:0/3378557906 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f925c0a2c00 msgr2=0x7f925c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:46.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.253+0000 7f9279e00640 1 --2- 172.21.15.42:0/3378557906 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f925c0a2c00 0x7f925c0a50c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x562e7925ce20 tx=0x7f9268005f90 comp rx=0 tx=0).stop 2024-08-26T00:10:46.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.253+0000 7f9279e00640 1 -- 172.21.15.42:0/3378557906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9274104310 msgr2=0x7f927419a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:46.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.253+0000 7f9279e00640 1 --2- 172.21.15.42:0/3378557906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9274104310 0x7f927419a6e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f926000e9f0 tx=0x7f926000eeb0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.253+0000 7f9279e00640 1 -- 172.21.15.42:0/3378557906 shutdown_connections 2024-08-26T00:10:46.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.253+0000 7f9279e00640 1 --2- 172.21.15.42:0/3378557906 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f925c0a2c00 0x7f925c0a50c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.253+0000 7f9279e00640 1 --2- 172.21.15.42:0/3378557906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9274109970 0x7f927419ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.253+0000 7f9279e00640 1 --2- 172.21.15.42:0/3378557906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9274104310 0x7f927419a6e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.253+0000 7f9279e00640 1 --2- 172.21.15.42:0/3378557906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9274103970 0x7f927419a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:46.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.253+0000 7f9279e00640 1 -- 172.21.15.42:0/3378557906 >> 172.21.15.42:0/3378557906 conn(0x7f92740ff670 msgr2=0x7f9274100c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:46.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.254+0000 7f9279e00640 1 -- 172.21.15.42:0/3378557906 shutdown_connections 2024-08-26T00:10:46.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:46.254+0000 7f9279e00640 1 -- 172.21.15.42:0/3378557906 wait complete. 2024-08-26T00:10:46.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:46 smithi042 ceph-mon[17225]: pgmap v586: 97 pgs: 97 active+clean; 2.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.3 MiB/s wr, 775 op/s 2024-08-26T00:10:46.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:46 smithi043 ceph-mon[22091]: pgmap v586: 97 pgs: 97 active+clean; 2.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.3 MiB/s wr, 775 op/s 2024-08-26T00:10:46.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:46 smithi181 ceph-mon[22102]: pgmap v586: 97 pgs: 97 active+clean; 2.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.3 MiB/s wr, 775 op/s 2024-08-26T00:10:47.088 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-26T00:10:47.509 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:10:48.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.045+0000 7f1a5b200640 1 -- 172.21.15.42:0/4187169016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a5c107760 msgr2=0x7f1a5c107b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:48.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.045+0000 7f1a5b200640 1 --2- 172.21.15.42:0/4187169016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a5c107760 0x7f1a5c107b40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009930 tx=0x7f1a4c02a440 comp rx=0 tx=0).stop 2024-08-26T00:10:48.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.045+0000 7f1a5b200640 1 -- 172.21.15.42:0/4187169016 shutdown_connections 2024-08-26T00:10:48.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.045+0000 7f1a5b200640 1 --2- 172.21.15.42:0/4187169016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a5c102100 0x7f1a5c10e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.045+0000 7f1a5b200640 1 --2- 172.21.15.42:0/4187169016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a5c101760 0x7f1a5c101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.045+0000 7f1a5b200640 1 --2- 172.21.15.42:0/4187169016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a5c107760 0x7f1a5c107b40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.045+0000 7f1a5b200640 1 -- 172.21.15.42:0/4187169016 >> 172.21.15.42:0/4187169016 conn(0x7f1a5c0fd4e0 msgr2=0x7f1a5c0ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:48.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.045+0000 7f1a5b200640 1 -- 172.21.15.42:0/4187169016 shutdown_connections 2024-08-26T00:10:48.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.045+0000 7f1a5b200640 1 -- 172.21.15.42:0/4187169016 wait complete. 2024-08-26T00:10:48.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.046+0000 7f1a5b200640 1 Processor -- start 2024-08-26T00:10:48.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.046+0000 7f1a5b200640 1 -- start start 2024-08-26T00:10:48.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.046+0000 7f1a5b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a5c101760 0x7f1a5c19a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:48.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.046+0000 7f1a5b200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a5c102100 0x7f1a5c19a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:48.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.046+0000 7f1a5b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a5c107760 0x7f1a5c19eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:48.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.046+0000 7f1a5b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5c111bb0 con 0x7f1a5c101760 2024-08-26T00:10:48.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.046+0000 7f1a5b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5c111a30 con 0x7f1a5c107760 2024-08-26T00:10:48.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.046+0000 7f1a5b200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5c111d30 con 0x7f1a5c102100 2024-08-26T00:10:48.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.047+0000 7f1a59400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a5c102100 0x7f1a5c19a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:48.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.047+0000 7f1a59400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a5c102100 0x7f1a5c19a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:37346/0 (socket says 172.21.15.42:37346) 2024-08-26T00:10:48.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.047+0000 7f1a59400640 1 -- 172.21.15.42:0/2475886022 learned_addr learned my addr 172.21.15.42:0/2475886022 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:48.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.047+0000 7f1a59e00640 1 --2- 172.21.15.42:0/2475886022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a5c101760 0x7f1a5c19a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:48.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.047+0000 7f1a5a800640 1 --2- 172.21.15.42:0/2475886022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a5c107760 0x7f1a5c19eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:48.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.047+0000 7f1a59400640 1 -- 172.21.15.42:0/2475886022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a5c107760 msgr2=0x7f1a5c19eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:48.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.047+0000 7f1a59400640 1 --2- 172.21.15.42:0/2475886022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a5c107760 0x7f1a5c19eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.047+0000 7f1a59400640 1 -- 172.21.15.42:0/2475886022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a5c101760 msgr2=0x7f1a5c19a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:48.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.047+0000 7f1a59400640 1 --2- 172.21.15.42:0/2475886022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a5c101760 0x7f1a5c19a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.047+0000 7f1a59400640 1 -- 172.21.15.42:0/2475886022 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a5c19f220 con 0x7f1a5c102100 2024-08-26T00:10:48.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.048+0000 7f1a59400640 1 --2- 172.21.15.42:0/2475886022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a5c102100 0x7f1a5c19a7b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800e9f0 tx=0x7f1a4800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:48.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.048+0000 7f1a52a00640 1 -- 172.21.15.42:0/2475886022 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4800cd80 con 0x7f1a5c102100 2024-08-26T00:10:48.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.048+0000 7f1a52a00640 1 -- 172.21.15.42:0/2475886022 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a48010910 con 0x7f1a5c102100 2024-08-26T00:10:48.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.048+0000 7f1a5b200640 1 -- 172.21.15.42:0/2475886022 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a5c19f510 con 0x7f1a5c102100 2024-08-26T00:10:48.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.048+0000 7f1a52a00640 1 -- 172.21.15.42:0/2475886022 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a48018990 con 0x7f1a5c102100 2024-08-26T00:10:48.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.048+0000 7f1a5b200640 1 -- 172.21.15.42:0/2475886022 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a5c1a6df0 con 0x7f1a5c102100 2024-08-26T00:10:48.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.051+0000 7f1a52a00640 1 -- 172.21.15.42:0/2475886022 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1a48010ac0 con 0x7f1a5c102100 2024-08-26T00:10:48.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.051+0000 7f1a63c14740 1 Processor -- start 2024-08-26T00:10:48.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.052+0000 7f1a63c14740 1 -- start start 2024-08-26T00:10:48.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.052+0000 7f1a63c14740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da2df40a30 0x55da2df40e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:48.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.052+0000 7f1a63c14740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55da2df41350 0x55da2df4b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:48.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.052+0000 7f1a63c14740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df4bc10 0x55da2df4e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:48.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.052+0000 7f1a63c14740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55da2dea6f30 con 0x55da2df41350 2024-08-26T00:10:48.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.052+0000 7f1a63c14740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55da2de3e5a0 con 0x55da2df40a30 2024-08-26T00:10:48.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.052+0000 7f1a63c14740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55da2dea2ef0 con 0x55da2df4bc10 2024-08-26T00:10:48.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.052+0000 7f1a59400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df4bc10 0x55da2df4e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:48.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.052+0000 7f1a59e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55da2df41350 0x55da2df4b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:48.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.052+0000 7f1a5a800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da2df40a30 0x55da2df40e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:48.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.052+0000 7f1a59400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df4bc10 0x55da2df4e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:37354/0 (socket says 172.21.15.42:37354) 2024-08-26T00:10:48.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.052+0000 7f1a59400640 1 -- 172.21.15.42:0/1897970986 learned_addr learned my addr 172.21.15.42:0/1897970986 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:48.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.053+0000 7f1a59400640 1 -- 172.21.15.42:0/1897970986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da2df40a30 msgr2=0x55da2df40e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:48.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.053+0000 7f1a59400640 1 --2- 172.21.15.42:0/1897970986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da2df40a30 0x55da2df40e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.053+0000 7f1a59400640 1 -- 172.21.15.42:0/1897970986 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55da2df41350 msgr2=0x55da2df4b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:48.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.053+0000 7f1a59400640 1 --2- 172.21.15.42:0/1897970986 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55da2df41350 0x55da2df4b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.053+0000 7f1a59400640 1 -- 172.21.15.42:0/1897970986 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da2dc183c0 con 0x55da2df4bc10 2024-08-26T00:10:48.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.053+0000 7f1a59e00640 1 --2- 172.21.15.42:0/1897970986 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55da2df41350 0x55da2df4b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:10:48.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.053+0000 7f1a52a00640 1 --2- 172.21.15.42:0/2475886022 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1a400a2b80 0x7f1a400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:48.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.053+0000 7f1a52a00640 1 -- 172.21.15.42:0/2475886022 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f1a480cf350 con 0x7f1a5c102100 2024-08-26T00:10:48.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.053+0000 7f1a59400640 1 --2- 172.21.15.42:0/1897970986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df4bc10 0x55da2df4e000 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1a480d7510 tx=0x7f1a480d79d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2ed979d8d46d4e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:48.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.053+0000 7f1a5a800640 1 --2- 172.21.15.42:0/2475886022 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1a400a2b80 0x7f1a400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:48.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.053+0000 7f1a47400640 1 -- 172.21.15.42:0/1897970986 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a48097f00 con 0x55da2df4bc10 2024-08-26T00:10:48.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.054+0000 7f1a47400640 1 -- 172.21.15.42:0/1897970986 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a4809bc60 con 0x55da2df4bc10 2024-08-26T00:10:48.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.054+0000 7f1a47400640 1 -- 172.21.15.42:0/1897970986 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4809b5c0 con 0x55da2df4bc10 2024-08-26T00:10:48.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.054+0000 7f1a63c14740 1 -- 172.21.15.42:0/1897970986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df4bc10 msgr2=0x55da2df4e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:48.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.054+0000 7f1a5a800640 1 --2- 172.21.15.42:0/2475886022 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1a400a2b80 0x7f1a400a5040 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1a54005fd0 tx=0x7f1a54009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:48.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.054+0000 7f1a63c14740 1 --2- 172.21.15.42:0/1897970986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df4bc10 0x55da2df4e000 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1a480d7510 tx=0x7f1a480d79d0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.054+0000 7f1a63c14740 1 -- 172.21.15.42:0/1897970986 shutdown_connections 2024-08-26T00:10:48.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.054+0000 7f1a63c14740 1 --2- 172.21.15.42:0/1897970986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df4bc10 0x55da2df4e000 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.054+0000 7f1a63c14740 1 --2- 172.21.15.42:0/1897970986 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55da2df41350 0x55da2df4b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.054+0000 7f1a63c14740 1 --2- 172.21.15.42:0/1897970986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da2df40a30 0x55da2df40e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.054+0000 7f1a63c14740 1 -- 172.21.15.42:0/1897970986 >> 172.21.15.42:0/1897970986 conn(0x55da2df3cfc0 msgr2=0x55da2df3d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:48.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.055+0000 7f1a63c14740 1 -- 172.21.15.42:0/1897970986 shutdown_connections 2024-08-26T00:10:48.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.055+0000 7f1a63c14740 1 -- 172.21.15.42:0/1897970986 wait complete. 2024-08-26T00:10:48.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.055+0000 7f1a63c14740 1 -- start start 2024-08-26T00:10:48.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.056+0000 7f1a63c14740 1 Processor -- start 2024-08-26T00:10:48.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.056+0000 7f1a63c14740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55da2df40a30 0x55da2df48b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:48.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.056+0000 7f1a63c14740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da2df41350 0x55da2df49060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:48.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.056+0000 7f1a63c14740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df4bc10 0x55da2df495a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:48.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.056+0000 7f1a63c14740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55da2df4e7e0 con 0x55da2df40a30 2024-08-26T00:10:48.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.056+0000 7f1a63c14740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55da2de61de0 con 0x55da2df41350 2024-08-26T00:10:48.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.056+0000 7f1a63c14740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55da2df4e960 con 0x55da2df4bc10 2024-08-26T00:10:48.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.056+0000 7f1a63c14740 10 client.0 _ll_register_callbacks cb 0x55da2de507b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:10:48.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.056+0000 7f1a59e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55da2df40a30 0x55da2df48b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:48.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.056+0000 7f1a59400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da2df41350 0x55da2df49060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:48.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.057+0000 7f1a5a800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df4bc10 0x55da2df495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:48.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.056+0000 7f1a59400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da2df41350 0x55da2df49060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:40562/0 (socket says 172.21.15.42:40562) 2024-08-26T00:10:48.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.057+0000 7f1a59400640 1 -- 172.21.15.42:0/3945575313 learned_addr learned my addr 172.21.15.42:0/3945575313 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:48.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.056+0000 7f1a59e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55da2df40a30 0x55da2df48b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41242/0 (socket says 172.21.15.42:41242) 2024-08-26T00:10:48.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.057+0000 7f1a59400640 1 -- 172.21.15.42:0/3945575313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df4bc10 msgr2=0x55da2df495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:48.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.057+0000 7f1a59400640 1 --2- 172.21.15.42:0/3945575313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df4bc10 0x55da2df495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.057+0000 7f1a59400640 1 -- 172.21.15.42:0/3945575313 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55da2df40a30 msgr2=0x55da2df48b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:48.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.057+0000 7f1a59400640 1 --2- 172.21.15.42:0/3945575313 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55da2df40a30 0x55da2df48b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.057+0000 7f1a59400640 1 -- 172.21.15.42:0/3945575313 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da2df57c50 con 0x55da2df41350 2024-08-26T00:10:48.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.057+0000 7f1a59400640 1 --2- 172.21.15.42:0/3945575313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da2df41350 0x55da2df49060 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1a480d7ed0 tx=0x7f1a480cf5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ebd1cc628654ca8 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:48.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.057+0000 7f1a3be00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:10:48.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.057+0000 7f1a3be00640 1 -- 172.21.15.42:0/3945575313 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4809b7a0 con 0x55da2df41350 2024-08-26T00:10:48.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.057+0000 7f1a63c14740 1 -- 172.21.15.42:0/3945575313 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a4809bc60 con 0x55da2df41350 2024-08-26T00:10:48.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.057+0000 7f1a3be00640 1 -- 172.21.15.42:0/3945575313 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f1a480a4390 con 0x55da2df41350 2024-08-26T00:10:48.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.058+0000 7f1a3be00640 1 -- 172.21.15.42:0/3945575313 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1a4809ba30 con 0x55da2df41350 2024-08-26T00:10:48.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.058+0000 7f1a63c14740 10 client.25913 fetch_fsmap learned FSMap version 30 2024-08-26T00:10:48.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.058+0000 7f1a63c14740 1 -- 172.21.15.42:0/3945575313 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55da2df4e7e0 con 0x55da2df41350 2024-08-26T00:10:48.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.058+0000 7f1a3be00640 1 -- 172.21.15.42:0/3945575313 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a4809bc60 con 0x55da2df41350 2024-08-26T00:10:48.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.058+0000 7f1a3be00640 1 -- 172.21.15.42:0/3945575313 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f1a480ba2e0 con 0x55da2df41350 2024-08-26T00:10:48.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.058+0000 7f1a63c14740 10 client.25913 fetch_fsmap finished waiting for FSMap version 30 2024-08-26T00:10:48.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.058+0000 7f1a63c14740 10 client.25913 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:10:48.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.059+0000 7f1a63c14740 20 client.25913 populate_metadata read hostname 'smithi042' 2024-08-26T00:10:48.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.059+0000 7f1a63c14740 1 --2- 172.21.15.42:0/3945575313 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55da2df5b760 0x55da2df5db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:48.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.059+0000 7f1a63c14740 4 client.25913 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:10:48.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.059+0000 7f1a63c14740 1 -- 172.21.15.42:0/3945575313 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da2deb44a0 con 0x55da2df5b760 2024-08-26T00:10:48.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.059+0000 7f1a59e00640 1 --2- 172.21.15.42:0/3945575313 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55da2df5b760 0x55da2df5db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:48.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.059+0000 7f1a59e00640 1 --2- 172.21.15.42:0/3945575313 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55da2df5b760 0x55da2df5db50 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebc73c4c9b765799 server_cookie=cd7bf18952709183 in_seq=0 out_seq=0 2024-08-26T00:10:48.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.059+0000 7f1a3be00640 10 client.25913 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:48.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.062+0000 7f1a3be00640 1 -- 172.21.15.42:0/3945575313 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55da2deb44a0 con 0x55da2df5b760 2024-08-26T00:10:48.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.062+0000 7f1a3be00640 10 client.25913 handle_command_reply: tid=0 2024-08-26T00:10:48.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.062+0000 7f1a63c14740 1 client.25913 shutdown 2024-08-26T00:10:48.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.062+0000 7f1a63c14740 1 -- 172.21.15.42:0/3945575313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da2df41350 msgr2=0x55da2df49060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:48.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.062+0000 7f1a63c14740 1 --2- 172.21.15.42:0/3945575313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da2df41350 0x55da2df49060 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1a480d7ed0 tx=0x7f1a480cf5d0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.062+0000 7f1a63c14740 1 -- 172.21.15.42:0/3945575313 shutdown_connections 2024-08-26T00:10:48.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.062+0000 7f1a63c14740 1 --2- 172.21.15.42:0/3945575313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df4bc10 0x55da2df495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.062+0000 7f1a63c14740 1 --2- 172.21.15.42:0/3945575313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da2df41350 0x55da2df49060 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.062+0000 7f1a63c14740 1 --2- 172.21.15.42:0/3945575313 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55da2df5b760 0x55da2df5db50 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.062+0000 7f1a63c14740 1 --2- 172.21.15.42:0/3945575313 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55da2df40a30 0x55da2df48b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.062+0000 7f1a63c14740 1 -- 172.21.15.42:0/3945575313 >> 172.21.15.42:0/3945575313 conn(0x55da2df3cfc0 msgr2=0x55da2df42cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:48.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.062+0000 7f1a3be00640 0 client.25913 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:48.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.062+0000 7f1a63c14740 1 -- 172.21.15.42:0/3945575313 shutdown_connections 2024-08-26T00:10:48.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.062+0000 7f1a63c14740 1 -- 172.21.15.42:0/3945575313 wait complete. 2024-08-26T00:10:48.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.062+0000 7f1a63c14740 20 client.25913 trim_cache size 0 max 16384 2024-08-26T00:10:48.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.076+0000 7f1a63c14740 1 Processor -- start 2024-08-26T00:10:48.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.076+0000 7f1a63c14740 1 -- start start 2024-08-26T00:10:48.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.076+0000 7f1a63c14740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55da2df40a30 0x55da2df4a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:48.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.076+0000 7f1a63c14740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df41350 0x55da2df63310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:48.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.076+0000 7f1a63c14740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da2df4bc10 0x55da2df63850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:48.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.076+0000 7f1a63c14740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5c1b1d20 con 0x55da2df40a30 2024-08-26T00:10:48.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.076+0000 7f1a63c14740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5c1af560 con 0x55da2df4bc10 2024-08-26T00:10:48.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.076+0000 7f1a63c14740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5c1ad390 con 0x55da2df41350 2024-08-26T00:10:48.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.077+0000 7f1a59400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df41350 0x55da2df63310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:48.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.077+0000 7f1a59e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55da2df40a30 0x55da2df4a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:48.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.077+0000 7f1a59400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df41350 0x55da2df63310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:37376/0 (socket says 172.21.15.42:37376) 2024-08-26T00:10:48.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.077+0000 7f1a59400640 1 -- 172.21.15.42:0/2676896327 learned_addr learned my addr 172.21.15.42:0/2676896327 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:48.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.077+0000 7f1a5a800640 1 --2- 172.21.15.42:0/2676896327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da2df4bc10 0x55da2df63850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:48.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.077+0000 7f1a59400640 1 -- 172.21.15.42:0/2676896327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da2df4bc10 msgr2=0x55da2df63850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:48.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.077+0000 7f1a59400640 1 --2- 172.21.15.42:0/2676896327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da2df4bc10 0x55da2df63850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.077+0000 7f1a59400640 1 -- 172.21.15.42:0/2676896327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55da2df40a30 msgr2=0x55da2df4a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:48.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.077+0000 7f1a59400640 1 --2- 172.21.15.42:0/2676896327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55da2df40a30 0x55da2df4a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.077+0000 7f1a59400640 1 -- 172.21.15.42:0/2676896327 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da2df5dec0 con 0x55da2df41350 2024-08-26T00:10:48.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.077+0000 7f1a59400640 1 --2- 172.21.15.42:0/2676896327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df41350 0x55da2df63310 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1a480980c0 tx=0x7f1a480cf640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3db2aab9c3034a5a server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:48.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.078+0000 7f1a46a00640 1 -- 172.21.15.42:0/2676896327 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4809b7a0 con 0x55da2df41350 2024-08-26T00:10:48.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.078+0000 7f1a46a00640 1 -- 172.21.15.42:0/2676896327 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a4809bc60 con 0x55da2df41350 2024-08-26T00:10:48.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.078+0000 7f1a46a00640 1 -- 172.21.15.42:0/2676896327 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a48097f00 con 0x55da2df41350 2024-08-26T00:10:48.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.078+0000 7f1a63c14740 1 -- 172.21.15.42:0/2676896327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df41350 msgr2=0x55da2df63310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:48.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.078+0000 7f1a63c14740 1 --2- 172.21.15.42:0/2676896327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df41350 0x55da2df63310 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1a480980c0 tx=0x7f1a480cf640 comp rx=0 tx=0).stop 2024-08-26T00:10:48.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.078+0000 7f1a63c14740 1 -- 172.21.15.42:0/2676896327 shutdown_connections 2024-08-26T00:10:48.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.078+0000 7f1a63c14740 1 --2- 172.21.15.42:0/2676896327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da2df4bc10 0x55da2df63850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.078+0000 7f1a63c14740 1 --2- 172.21.15.42:0/2676896327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df41350 0x55da2df63310 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.078+0000 7f1a63c14740 1 --2- 172.21.15.42:0/2676896327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55da2df40a30 0x55da2df4a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.078+0000 7f1a63c14740 1 -- 172.21.15.42:0/2676896327 >> 172.21.15.42:0/2676896327 conn(0x55da2df3cfc0 msgr2=0x55da2df4a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:48.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.078+0000 7f1a63c14740 1 -- 172.21.15.42:0/2676896327 shutdown_connections 2024-08-26T00:10:48.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.079+0000 7f1a63c14740 1 -- 172.21.15.42:0/2676896327 wait complete. 2024-08-26T00:10:48.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.079+0000 7f1a63c14740 1 -- start start 2024-08-26T00:10:48.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.079+0000 7f1a63c14740 1 Processor -- start 2024-08-26T00:10:48.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.079+0000 7f1a63c14740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df40a30 0x55da2df54010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:48.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.079+0000 7f1a63c14740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55da2df41350 0x55da2df4f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:48.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.079+0000 7f1a63c14740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da2df4bc10 0x55da2df4f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:48.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.079+0000 7f1a63c14740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5c1ada20 con 0x55da2df41350 2024-08-26T00:10:48.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.079+0000 7f1a63c14740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5c1aee90 con 0x55da2df4bc10 2024-08-26T00:10:48.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.079+0000 7f1a63c14740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5c1ae0f0 con 0x55da2df40a30 2024-08-26T00:10:48.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.080+0000 7f1a63c14740 10 client.0 _ll_register_callbacks cb 0x7f1a540093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:10:48.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.080+0000 7f1a59e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df40a30 0x55da2df54010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:48.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.080+0000 7f1a59e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df40a30 0x55da2df54010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:37390/0 (socket says 172.21.15.42:37390) 2024-08-26T00:10:48.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.080+0000 7f1a59e00640 1 -- 172.21.15.42:0/668847078 learned_addr learned my addr 172.21.15.42:0/668847078 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:48.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.080+0000 7f1a59400640 1 --2- 172.21.15.42:0/668847078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55da2df41350 0x55da2df4f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:48.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.080+0000 7f1a5a800640 1 --2- 172.21.15.42:0/668847078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da2df4bc10 0x55da2df4f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:48.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.080+0000 7f1a59e00640 1 -- 172.21.15.42:0/668847078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da2df4bc10 msgr2=0x55da2df4f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:48.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.080+0000 7f1a59e00640 1 --2- 172.21.15.42:0/668847078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da2df4bc10 0x55da2df4f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.080+0000 7f1a59e00640 1 -- 172.21.15.42:0/668847078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55da2df41350 msgr2=0x55da2df4f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:48.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.080+0000 7f1a59e00640 1 --2- 172.21.15.42:0/668847078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55da2df41350 0x55da2df4f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.080+0000 7f1a59e00640 1 -- 172.21.15.42:0/668847078 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da2df4fdc0 con 0x55da2df40a30 2024-08-26T00:10:48.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.080+0000 7f1a5a800640 1 --2- 172.21.15.42:0/668847078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da2df4bc10 0x55da2df4f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:10:48.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.081+0000 7f1a59e00640 1 --2- 172.21.15.42:0/668847078 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df40a30 0x55da2df54010 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c02aa30 tx=0x7f1a4c02aba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c59465148ca21095 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:48.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.081+0000 7f1a3be00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:10:48.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.081+0000 7f1a3be00640 1 -- 172.21.15.42:0/668847078 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c04a070 con 0x55da2df40a30 2024-08-26T00:10:48.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.081+0000 7f1a3be00640 1 -- 172.21.15.42:0/668847078 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f1a4c0046c0 con 0x55da2df40a30 2024-08-26T00:10:48.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.081+0000 7f1a63c14740 1 -- 172.21.15.42:0/668847078 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a4809bc60 con 0x55da2df40a30 2024-08-26T00:10:48.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.081+0000 7f1a3be00640 1 -- 172.21.15.42:0/668847078 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1a4c035040 con 0x55da2df40a30 2024-08-26T00:10:48.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.081+0000 7f1a63c14740 10 client.25885 fetch_fsmap learned FSMap version 30 2024-08-26T00:10:48.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.081+0000 7f1a63c14740 1 -- 172.21.15.42:0/668847078 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55da2dfc6050 con 0x55da2df40a30 2024-08-26T00:10:48.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.082+0000 7f1a3be00640 1 -- 172.21.15.42:0/668847078 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a4809bc60 con 0x55da2df40a30 2024-08-26T00:10:48.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.082+0000 7f1a3be00640 1 -- 172.21.15.42:0/668847078 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f1a4c031b00 con 0x55da2df40a30 2024-08-26T00:10:48.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.082+0000 7f1a63c14740 10 client.25885 fetch_fsmap finished waiting for FSMap version 30 2024-08-26T00:10:48.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.082+0000 7f1a63c14740 10 client.25885 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:10:48.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.082+0000 7f1a63c14740 20 client.25885 populate_metadata read hostname 'smithi042' 2024-08-26T00:10:48.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.082+0000 7f1a63c14740 1 --2- 172.21.15.42:0/668847078 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55da2dfc67f0 0x55da2dfc8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:48.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.082+0000 7f1a63c14740 4 client.25885 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:10:48.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.082+0000 7f1a63c14740 1 -- 172.21.15.42:0/668847078 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55da2deae9b0 con 0x55da2dfc67f0 2024-08-26T00:10:48.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.082+0000 7f1a59400640 1 --2- 172.21.15.42:0/668847078 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55da2dfc67f0 0x55da2dfc8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:48.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.083+0000 7f1a59400640 1 --2- 172.21.15.42:0/668847078 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55da2dfc67f0 0x55da2dfc8c10 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1add0344dc8f9e27 server_cookie=390416b512cded1a in_seq=0 out_seq=0 2024-08-26T00:10:48.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.083+0000 7f1a3be00640 10 client.25885 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:48.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.090+0000 7f1a3be00640 1 -- 172.21.15.42:0/668847078 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55da2deae9b0 con 0x55da2dfc67f0 2024-08-26T00:10:48.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.090+0000 7f1a3be00640 10 client.25885 handle_command_reply: tid=0 2024-08-26T00:10:48.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.090+0000 7f1a63c14740 1 client.25885 shutdown 2024-08-26T00:10:48.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.090+0000 7f1a63c14740 1 -- 172.21.15.42:0/668847078 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df40a30 msgr2=0x55da2df54010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:48.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.090+0000 7f1a63c14740 1 --2- 172.21.15.42:0/668847078 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df40a30 0x55da2df54010 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c02aa30 tx=0x7f1a4c02aba0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.090+0000 7f1a63c14740 1 -- 172.21.15.42:0/668847078 shutdown_connections 2024-08-26T00:10:48.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.090+0000 7f1a63c14740 1 --2- 172.21.15.42:0/668847078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da2df4bc10 0x55da2df4f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.090+0000 7f1a63c14740 1 --2- 172.21.15.42:0/668847078 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55da2dfc67f0 0x55da2dfc8c10 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.090+0000 7f1a63c14740 1 --2- 172.21.15.42:0/668847078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55da2df41350 0x55da2df4f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.090+0000 7f1a63c14740 1 --2- 172.21.15.42:0/668847078 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55da2df40a30 0x55da2df54010 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.090+0000 7f1a3be00640 0 client.25885 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:48.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.090+0000 7f1a63c14740 1 -- 172.21.15.42:0/668847078 >> 172.21.15.42:0/668847078 conn(0x55da2df3cfc0 msgr2=0x55da2df492e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:48.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.091+0000 7f1a63c14740 1 -- 172.21.15.42:0/668847078 shutdown_connections 2024-08-26T00:10:48.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.091+0000 7f1a63c14740 1 -- 172.21.15.42:0/668847078 wait complete. 2024-08-26T00:10:48.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.091+0000 7f1a63c14740 20 client.25885 trim_cache size 0 max 16384 2024-08-26T00:10:48.093 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:10:48.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.092+0000 7f1a5b200640 1 -- 172.21.15.42:0/2475886022 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1a400a2b80 msgr2=0x7f1a400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:48.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.092+0000 7f1a5b200640 1 --2- 172.21.15.42:0/2475886022 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1a400a2b80 0x7f1a400a5040 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1a54005fd0 tx=0x7f1a54009500 comp rx=0 tx=0).stop 2024-08-26T00:10:48.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.092+0000 7f1a5b200640 1 -- 172.21.15.42:0/2475886022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a5c102100 msgr2=0x7f1a5c19a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:48.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.092+0000 7f1a5b200640 1 --2- 172.21.15.42:0/2475886022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a5c102100 0x7f1a5c19a7b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800e9f0 tx=0x7f1a4800eeb0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.092+0000 7f1a5b200640 1 -- 172.21.15.42:0/2475886022 shutdown_connections 2024-08-26T00:10:48.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.092+0000 7f1a5b200640 1 --2- 172.21.15.42:0/2475886022 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1a400a2b80 0x7f1a400a5040 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.092+0000 7f1a5b200640 1 --2- 172.21.15.42:0/2475886022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a5c107760 0x7f1a5c19eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.092+0000 7f1a5b200640 1 --2- 172.21.15.42:0/2475886022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a5c102100 0x7f1a5c19a7b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.092+0000 7f1a5b200640 1 --2- 172.21.15.42:0/2475886022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a5c101760 0x7f1a5c19a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:48.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.092+0000 7f1a5b200640 1 -- 172.21.15.42:0/2475886022 >> 172.21.15.42:0/2475886022 conn(0x7f1a5c0fd4e0 msgr2=0x7f1a5c10cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:48.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.092+0000 7f1a5b200640 1 -- 172.21.15.42:0/2475886022 shutdown_connections 2024-08-26T00:10:48.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:48.092+0000 7f1a5b200640 1 -- 172.21.15.42:0/2475886022 wait complete. 2024-08-26T00:10:48.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:48 smithi043 ceph-mon[22091]: pgmap v587: 97 pgs: 97 active+clean; 2.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.9 MiB/s wr, 805 op/s 2024-08-26T00:10:48.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:48 smithi042 ceph-mon[17225]: pgmap v587: 97 pgs: 97 active+clean; 2.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.9 MiB/s wr, 805 op/s 2024-08-26T00:10:48.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:48 smithi181 ceph-mon[22102]: pgmap v587: 97 pgs: 97 active+clean; 2.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.9 MiB/s wr, 805 op/s 2024-08-26T00:10:50.237 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-26T00:10:50.237 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-26T00:10:50.586 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:50 smithi181 ceph-mon[22102]: pgmap v588: 97 pgs: 97 active+clean; 2.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.3 MiB/s wr, 804 op/s 2024-08-26T00:10:50.686 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:10:50.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:50 smithi043 ceph-mon[22091]: pgmap v588: 97 pgs: 97 active+clean; 2.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.3 MiB/s wr, 804 op/s 2024-08-26T00:10:50.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:50 smithi042 ceph-mon[17225]: pgmap v588: 97 pgs: 97 active+clean; 2.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.3 MiB/s wr, 804 op/s 2024-08-26T00:10:51.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.328+0000 7f9cc7200640 1 -- 172.21.15.42:0/92633350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cc010ff30 msgr2=0x7f9cc006e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:51.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.328+0000 7f9cc7200640 1 --2- 172.21.15.42:0/92633350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cc010ff30 0x7f9cc006e290 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc009be0 tx=0x7f9cbc02a6d0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.328+0000 7f9cc7200640 1 -- 172.21.15.42:0/92633350 shutdown_connections 2024-08-26T00:10:51.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.328+0000 7f9cc7200640 1 --2- 172.21.15.42:0/92633350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9cc011aee0 0x7f9cc011d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.329+0000 7f9cc7200640 1 --2- 172.21.15.42:0/92633350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cc006e7d0 0x7f9cc006ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.329+0000 7f9cc7200640 1 --2- 172.21.15.42:0/92633350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cc010ff30 0x7f9cc006e290 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.329+0000 7f9cc7200640 1 -- 172.21.15.42:0/92633350 >> 172.21.15.42:0/92633350 conn(0x7f9cc0072f20 msgr2=0x7f9cc0073330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:51.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.330+0000 7f9cc7200640 1 -- 172.21.15.42:0/92633350 shutdown_connections 2024-08-26T00:10:51.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.330+0000 7f9cc7200640 1 -- 172.21.15.42:0/92633350 wait complete. 2024-08-26T00:10:51.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.331+0000 7f9cc7200640 1 Processor -- start 2024-08-26T00:10:51.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.333+0000 7f9cc7200640 1 -- start start 2024-08-26T00:10:51.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.333+0000 7f9cc7200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9cc006e7d0 0x7f9cc01a6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:51.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.333+0000 7f9cc7200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cc010ff30 0x7f9cc01a7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:51.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.333+0000 7f9cc7200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cc011aee0 0x7f9cc01ab690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:51.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.333+0000 7f9cc7200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc0120920 con 0x7f9cc006e7d0 2024-08-26T00:10:51.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.333+0000 7f9cc7200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc01207a0 con 0x7f9cc011aee0 2024-08-26T00:10:51.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.333+0000 7f9cc7200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc0120aa0 con 0x7f9cc010ff30 2024-08-26T00:10:51.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.334+0000 7f9cc6800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cc011aee0 0x7f9cc01ab690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:51.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.335+0000 7f9cc5400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cc010ff30 0x7f9cc01a7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:51.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.335+0000 7f9cc5400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cc010ff30 0x7f9cc01a7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:37404/0 (socket says 172.21.15.42:37404) 2024-08-26T00:10:51.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.335+0000 7f9cc5400640 1 -- 172.21.15.42:0/3638440260 learned_addr learned my addr 172.21.15.42:0/3638440260 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:51.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.335+0000 7f9cc5e00640 1 --2- 172.21.15.42:0/3638440260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9cc006e7d0 0x7f9cc01a6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:51.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.336+0000 7f9cc5400640 1 -- 172.21.15.42:0/3638440260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cc011aee0 msgr2=0x7f9cc01ab690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:51.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.336+0000 7f9cc5400640 1 --2- 172.21.15.42:0/3638440260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cc011aee0 0x7f9cc01ab690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.336+0000 7f9cc5400640 1 -- 172.21.15.42:0/3638440260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9cc006e7d0 msgr2=0x7f9cc01a6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:51.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.336+0000 7f9cc5400640 1 --2- 172.21.15.42:0/3638440260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9cc006e7d0 0x7f9cc01a6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.336+0000 7f9cc5400640 1 -- 172.21.15.42:0/3638440260 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc01abd70 con 0x7f9cc010ff30 2024-08-26T00:10:51.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.336+0000 7f9cc5400640 1 --2- 172.21.15.42:0/3638440260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cc010ff30 0x7f9cc01a7300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400d950 tx=0x7f9cb400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:51.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.337+0000 7f9cbaa00640 1 -- 172.21.15.42:0/3638440260 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4017070 con 0x7f9cc010ff30 2024-08-26T00:10:51.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.337+0000 7f9cbaa00640 1 -- 172.21.15.42:0/3638440260 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cb4009c30 con 0x7f9cc010ff30 2024-08-26T00:10:51.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.337+0000 7f9cbaa00640 1 -- 172.21.15.42:0/3638440260 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb400f690 con 0x7f9cc010ff30 2024-08-26T00:10:51.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.338+0000 7f9cc7200640 1 -- 172.21.15.42:0/3638440260 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cc01ac060 con 0x7f9cc010ff30 2024-08-26T00:10:51.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.338+0000 7f9cc7200640 1 -- 172.21.15.42:0/3638440260 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cc01b3940 con 0x7f9cc010ff30 2024-08-26T00:10:51.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.343+0000 7f9cbaa00640 1 -- 172.21.15.42:0/3638440260 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9cb40109d0 con 0x7f9cc010ff30 2024-08-26T00:10:51.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.346+0000 7f9cbaa00640 1 --2- 172.21.15.42:0/3638440260 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9ca80a2c40 0x7f9ca80a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:51.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.346+0000 7f9ccb289740 1 Processor -- start 2024-08-26T00:10:51.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.347+0000 7f9ccb289740 1 -- start start 2024-08-26T00:10:51.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.348+0000 7f9ccb289740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fa2c2def60 0x55fa2c2df340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:51.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.348+0000 7f9ccb289740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa2c2df880 0x55fa2c2e9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:51.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.348+0000 7f9ccb289740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2ea140 0x55fa2c2ec530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:51.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.348+0000 7f9ccb289740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55fa2c245e30 con 0x55fa2c2def60 2024-08-26T00:10:51.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.348+0000 7f9ccb289740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fa2c1dd3c0 con 0x55fa2c2df880 2024-08-26T00:10:51.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.348+0000 7f9ccb289740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55fa2c241df0 con 0x55fa2c2ea140 2024-08-26T00:10:51.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.349+0000 7f9cbaa00640 1 -- 172.21.15.42:0/3638440260 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f9cb40ce980 con 0x7f9cc010ff30 2024-08-26T00:10:51.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.349+0000 7f9cc5e00640 1 --2- 172.21.15.42:0/3638440260 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9ca80a2c40 0x7f9ca80a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:51.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.350+0000 7f9cc6800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2ea140 0x55fa2c2ec530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:51.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.350+0000 7f9cc5400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa2c2df880 0x55fa2c2e9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:51.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.350+0000 7f9cc6800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2ea140 0x55fa2c2ec530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:37420/0 (socket says 172.21.15.42:37420) 2024-08-26T00:10:51.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.350+0000 7f9cc6800640 1 -- 172.21.15.42:0/1257529239 learned_addr learned my addr 172.21.15.42:0/1257529239 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:51.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.350+0000 7f9cc6800640 1 -- 172.21.15.42:0/1257529239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa2c2df880 msgr2=0x55fa2c2e9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:51.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.350+0000 7f9cc6800640 1 --2- 172.21.15.42:0/1257529239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa2c2df880 0x55fa2c2e9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.350+0000 7f9cc6800640 1 -- 172.21.15.42:0/1257529239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fa2c2def60 msgr2=0x55fa2c2df340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:51.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.350+0000 7f9cc6800640 1 --2- 172.21.15.42:0/1257529239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fa2c2def60 0x55fa2c2df340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.350+0000 7f9cc6800640 1 -- 172.21.15.42:0/1257529239 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa2bfb76a0 con 0x55fa2c2ea140 2024-08-26T00:10:51.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.353+0000 7f9cc6800640 1 --2- 172.21.15.42:0/1257529239 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2ea140 0x55fa2c2ec530 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000ab50 tx=0x7f9cb000f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=134a1abcff1ac712 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:51.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.353+0000 7f9cc5e00640 1 --2- 172.21.15.42:0/3638440260 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9ca80a2c40 0x7f9ca80a5100 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc000f80 tx=0x7f9cbc030db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:51.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.353+0000 7f9caf000640 1 -- 172.21.15.42:0/1257529239 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0005220 con 0x55fa2c2ea140 2024-08-26T00:10:51.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.354+0000 7f9caf000640 1 -- 172.21.15.42:0/1257529239 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cb000ae50 con 0x55fa2c2ea140 2024-08-26T00:10:51.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.354+0000 7f9caf000640 1 -- 172.21.15.42:0/1257529239 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb00187c0 con 0x55fa2c2ea140 2024-08-26T00:10:51.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.356+0000 7f9ccb289740 1 -- 172.21.15.42:0/1257529239 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2ea140 msgr2=0x55fa2c2ec530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:51.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.356+0000 7f9ccb289740 1 --2- 172.21.15.42:0/1257529239 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2ea140 0x55fa2c2ec530 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000ab50 tx=0x7f9cb000f790 comp rx=0 tx=0).stop 2024-08-26T00:10:51.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.357+0000 7f9ccb289740 1 -- 172.21.15.42:0/1257529239 shutdown_connections 2024-08-26T00:10:51.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.357+0000 7f9ccb289740 1 --2- 172.21.15.42:0/1257529239 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2ea140 0x55fa2c2ec530 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.357+0000 7f9ccb289740 1 --2- 172.21.15.42:0/1257529239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa2c2df880 0x55fa2c2e9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.357+0000 7f9ccb289740 1 --2- 172.21.15.42:0/1257529239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fa2c2def60 0x55fa2c2df340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.357+0000 7f9ccb289740 1 -- 172.21.15.42:0/1257529239 >> 172.21.15.42:0/1257529239 conn(0x55fa2c2db4f0 msgr2=0x55fa2c2db8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:51.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.357+0000 7f9ccb289740 1 -- 172.21.15.42:0/1257529239 shutdown_connections 2024-08-26T00:10:51.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.358+0000 7f9ccb289740 1 -- 172.21.15.42:0/1257529239 wait complete. 2024-08-26T00:10:51.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.360+0000 7f9ccb289740 1 -- start start 2024-08-26T00:10:51.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.360+0000 7f9ccb289740 1 Processor -- start 2024-08-26T00:10:51.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.363+0000 7f9ccb289740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fa2c2def60 0x55fa2c2e9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:51.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.363+0000 7f9ccb289740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa2c2df880 0x55fa2c2e6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:51.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.363+0000 7f9ccb289740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2ea140 0x55fa2c2e7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:51.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.365+0000 7f9cc5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fa2c2def60 0x55fa2c2e9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:51.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.365+0000 7f9cc5400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa2c2df880 0x55fa2c2e6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:51.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.365+0000 7f9ccb289740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55fa2c2ecd60 con 0x55fa2c2def60 2024-08-26T00:10:51.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.365+0000 7f9ccb289740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fa2c200c30 con 0x55fa2c2df880 2024-08-26T00:10:51.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.365+0000 7f9ccb289740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55fa2c2ecee0 con 0x55fa2c2ea140 2024-08-26T00:10:51.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.365+0000 7f9ccb289740 10 client.0 _ll_register_callbacks cb 0x55fa2bf54ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:10:51.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.365+0000 7f9cc6800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2ea140 0x55fa2c2e7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:51.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.365+0000 7f9cc6800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2ea140 0x55fa2c2e7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:37422/0 (socket says 172.21.15.42:37422) 2024-08-26T00:10:51.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.365+0000 7f9cc6800640 1 -- 172.21.15.42:0/484892013 learned_addr learned my addr 172.21.15.42:0/484892013 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:51.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.366+0000 7f9cc6800640 1 -- 172.21.15.42:0/484892013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa2c2df880 msgr2=0x55fa2c2e6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:51.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.366+0000 7f9cc6800640 1 --2- 172.21.15.42:0/484892013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa2c2df880 0x55fa2c2e6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.366+0000 7f9cc6800640 1 -- 172.21.15.42:0/484892013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fa2c2def60 msgr2=0x55fa2c2e9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:51.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.367+0000 7f9cc6800640 1 --2- 172.21.15.42:0/484892013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fa2c2def60 0x55fa2c2e9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.367+0000 7f9cc6800640 1 -- 172.21.15.42:0/484892013 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa2c20cdd0 con 0x55fa2c2ea140 2024-08-26T00:10:51.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.367+0000 7f9cc5e00640 1 --2- 172.21.15.42:0/484892013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fa2c2def60 0x55fa2c2e9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:10:51.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.368+0000 7f9cc6800640 1 --2- 172.21.15.42:0/484892013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2ea140 0x55fa2c2e7640 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000a750 tx=0x7f9cb0018b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b548156849cf3c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:51.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.369+0000 7f9ca3400640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:10:51.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.369+0000 7f9ca3400640 1 -- 172.21.15.42:0/484892013 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0027020 con 0x55fa2c2ea140 2024-08-26T00:10:51.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.369+0000 7f9ca3400640 1 -- 172.21.15.42:0/484892013 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f9cb0018560 con 0x55fa2c2ea140 2024-08-26T00:10:51.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.369+0000 7f9ccb289740 1 -- 172.21.15.42:0/484892013 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cb000ae50 con 0x55fa2c2ea140 2024-08-26T00:10:51.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.369+0000 7f9ca3400640 1 -- 172.21.15.42:0/484892013 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9cb00187c0 con 0x55fa2c2ea140 2024-08-26T00:10:51.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.370+0000 7f9ccb289740 10 client.25897 fetch_fsmap learned FSMap version 30 2024-08-26T00:10:51.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.370+0000 7f9ccb289740 1 -- 172.21.15.42:0/484892013 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fa2c2f8850 con 0x55fa2c2ea140 2024-08-26T00:10:51.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.371+0000 7f9ca3400640 1 -- 172.21.15.42:0/484892013 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cb000ae50 con 0x55fa2c2ea140 2024-08-26T00:10:51.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.371+0000 7f9ca3400640 1 -- 172.21.15.42:0/484892013 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f9cb0023590 con 0x55fa2c2ea140 2024-08-26T00:10:51.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.371+0000 7f9ccb289740 10 client.25897 fetch_fsmap finished waiting for FSMap version 30 2024-08-26T00:10:51.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.372+0000 7f9ccb289740 10 client.25897 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:10:51.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.372+0000 7f9ccb289740 20 client.25897 populate_metadata read hostname 'smithi042' 2024-08-26T00:10:51.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.372+0000 7f9ccb289740 1 --2- 172.21.15.42:0/484892013 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55fa2c2f9c60 0x55fa2c2fc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:51.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.372+0000 7f9ccb289740 4 client.25897 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:10:51.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.372+0000 7f9ccb289740 1 -- 172.21.15.42:0/484892013 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa2c2533a0 con 0x55fa2c2f9c60 2024-08-26T00:10:51.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.372+0000 7f9cc5e00640 1 --2- 172.21.15.42:0/484892013 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55fa2c2f9c60 0x55fa2c2fc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:51.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.375+0000 7f9ca3400640 10 client.25897 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:51.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.375+0000 7f9cc5e00640 1 --2- 172.21.15.42:0/484892013 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55fa2c2f9c60 0x55fa2c2fc050 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5602b48bbf2d334b server_cookie=ef85f3c3c8798a7c in_seq=0 out_seq=0 2024-08-26T00:10:51.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.377+0000 7f9ca3400640 1 -- 172.21.15.42:0/484892013 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fa2c2533a0 con 0x55fa2c2f9c60 2024-08-26T00:10:51.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.377+0000 7f9ca3400640 10 client.25897 handle_command_reply: tid=0 2024-08-26T00:10:51.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.377+0000 7f9ccb289740 1 client.25897 shutdown 2024-08-26T00:10:51.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.377+0000 7f9ccb289740 1 -- 172.21.15.42:0/484892013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2ea140 msgr2=0x55fa2c2e7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:51.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.377+0000 7f9ccb289740 1 --2- 172.21.15.42:0/484892013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2ea140 0x55fa2c2e7640 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000a750 tx=0x7f9cb0018b90 comp rx=0 tx=0).stop 2024-08-26T00:10:51.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.377+0000 7f9ccb289740 1 -- 172.21.15.42:0/484892013 shutdown_connections 2024-08-26T00:10:51.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.377+0000 7f9ccb289740 1 --2- 172.21.15.42:0/484892013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2ea140 0x55fa2c2e7640 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.377+0000 7f9ccb289740 1 --2- 172.21.15.42:0/484892013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa2c2df880 0x55fa2c2e6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.377+0000 7f9ccb289740 1 --2- 172.21.15.42:0/484892013 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55fa2c2f9c60 0x55fa2c2fc050 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.377+0000 7f9ccb289740 1 --2- 172.21.15.42:0/484892013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fa2c2def60 0x55fa2c2e9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.377+0000 7f9ccb289740 1 -- 172.21.15.42:0/484892013 >> 172.21.15.42:0/484892013 conn(0x55fa2c2db4f0 msgr2=0x55fa2c2e1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:51.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.377+0000 7f9ca3400640 0 client.25897 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:51.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.378+0000 7f9ccb289740 1 -- 172.21.15.42:0/484892013 shutdown_connections 2024-08-26T00:10:51.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.378+0000 7f9ccb289740 1 -- 172.21.15.42:0/484892013 wait complete. 2024-08-26T00:10:51.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.378+0000 7f9ccb289740 20 client.25897 trim_cache size 0 max 16384 2024-08-26T00:10:51.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.416+0000 7f9ccb289740 1 Processor -- start 2024-08-26T00:10:51.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.417+0000 7f9ccb289740 1 -- start start 2024-08-26T00:10:51.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.417+0000 7f9ccb289740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2def60 0x55fa2c2f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:51.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.417+0000 7f9ccb289740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa2c2df880 0x55fa2c2e8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:51.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.417+0000 7f9ccb289740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fa2c2ea140 0x55fa2c3016b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:51.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.417+0000 7f9ccb289740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc01be9c0 con 0x55fa2c2ea140 2024-08-26T00:10:51.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.417+0000 7f9ccb289740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc01bc200 con 0x55fa2c2df880 2024-08-26T00:10:51.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.417+0000 7f9ccb289740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc01ba030 con 0x55fa2c2def60 2024-08-26T00:10:51.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.418+0000 7f9cc5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2def60 0x55fa2c2f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:51.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.418+0000 7f9cc5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2def60 0x55fa2c2f5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:37432/0 (socket says 172.21.15.42:37432) 2024-08-26T00:10:51.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.418+0000 7f9cc5e00640 1 -- 172.21.15.42:0/1910818189 learned_addr learned my addr 172.21.15.42:0/1910818189 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:51.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.418+0000 7f9cc6800640 1 --2- 172.21.15.42:0/1910818189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fa2c2ea140 0x55fa2c3016b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:51.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.418+0000 7f9cc5e00640 1 -- 172.21.15.42:0/1910818189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa2c2df880 msgr2=0x55fa2c2e8d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:10:51.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.419+0000 7f9cc5400640 1 --2- 172.21.15.42:0/1910818189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa2c2df880 0x55fa2c2e8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:51.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.420+0000 7f9cc5e00640 1 --2- 172.21.15.42:0/1910818189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa2c2df880 0x55fa2c2e8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.420+0000 7f9cc5e00640 1 -- 172.21.15.42:0/1910818189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fa2c2ea140 msgr2=0x55fa2c3016b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:51.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.420+0000 7f9cc5e00640 1 --2- 172.21.15.42:0/1910818189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fa2c2ea140 0x55fa2c3016b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.420+0000 7f9cc5e00640 1 -- 172.21.15.42:0/1910818189 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa2c2f6500 con 0x55fa2c2def60 2024-08-26T00:10:51.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.420+0000 7f9cc6800640 1 --2- 172.21.15.42:0/1910818189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fa2c2ea140 0x55fa2c3016b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:10:51.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.421+0000 7f9cc5400640 1 --2- 172.21.15.42:0/1910818189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa2c2df880 0x55fa2c2e8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:10:51.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.421+0000 7f9cc5e00640 1 --2- 172.21.15.42:0/1910818189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2def60 0x55fa2c2f5fc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc009be0 tx=0x7f9cbc03e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56072d900a653a77 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:51.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.422+0000 7f9cae600640 1 -- 172.21.15.42:0/1910818189 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc058070 con 0x55fa2c2def60 2024-08-26T00:10:51.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.422+0000 7f9cae600640 1 -- 172.21.15.42:0/1910818189 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cbc004520 con 0x55fa2c2def60 2024-08-26T00:10:51.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.422+0000 7f9cae600640 1 -- 172.21.15.42:0/1910818189 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc042040 con 0x55fa2c2def60 2024-08-26T00:10:51.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.423+0000 7f9ccb289740 1 -- 172.21.15.42:0/1910818189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2def60 msgr2=0x55fa2c2f5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:51.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.423+0000 7f9ccb289740 1 --2- 172.21.15.42:0/1910818189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2def60 0x55fa2c2f5fc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc009be0 tx=0x7f9cbc03e000 comp rx=0 tx=0).stop 2024-08-26T00:10:51.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.424+0000 7f9ccb289740 1 -- 172.21.15.42:0/1910818189 shutdown_connections 2024-08-26T00:10:51.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.424+0000 7f9ccb289740 1 --2- 172.21.15.42:0/1910818189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fa2c2ea140 0x55fa2c3016b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.424+0000 7f9ccb289740 1 --2- 172.21.15.42:0/1910818189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa2c2df880 0x55fa2c2e8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.424+0000 7f9ccb289740 1 --2- 172.21.15.42:0/1910818189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2def60 0x55fa2c2f5fc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.424+0000 7f9ccb289740 1 -- 172.21.15.42:0/1910818189 >> 172.21.15.42:0/1910818189 conn(0x55fa2c2db4f0 msgr2=0x55fa2c2e8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:51.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.424+0000 7f9ccb289740 1 -- 172.21.15.42:0/1910818189 shutdown_connections 2024-08-26T00:10:51.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.424+0000 7f9ccb289740 1 -- 172.21.15.42:0/1910818189 wait complete. 2024-08-26T00:10:51.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.425+0000 7f9ccb289740 1 -- start start 2024-08-26T00:10:51.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.426+0000 7f9ccb289740 1 Processor -- start 2024-08-26T00:10:51.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.427+0000 7f9ccb289740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fa2c2def60 0x55fa2c2e3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:51.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.427+0000 7f9ccb289740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2df880 0x55fa2c2e4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:51.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.427+0000 7f9ccb289740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa2c2ea140 0x55fa2c2e49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:51.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.427+0000 7f9ccb289740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc01ba6c0 con 0x55fa2c2def60 2024-08-26T00:10:51.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.427+0000 7f9ccb289740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc01bbb30 con 0x55fa2c2ea140 2024-08-26T00:10:51.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.427+0000 7f9ccb289740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc01bad90 con 0x55fa2c2df880 2024-08-26T00:10:51.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.427+0000 7f9cc5400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2df880 0x55fa2c2e4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:51.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.427+0000 7f9cc5400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2df880 0x55fa2c2e4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:37436/0 (socket says 172.21.15.42:37436) 2024-08-26T00:10:51.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.428+0000 7f9cc5400640 1 -- 172.21.15.42:0/1668595628 learned_addr learned my addr 172.21.15.42:0/1668595628 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:51.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.428+0000 7f9ccb289740 10 client.0 _ll_register_callbacks cb 0x7f9cb400df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:10:51.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.428+0000 7f9cc6800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa2c2ea140 0x55fa2c2e49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:51.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.428+0000 7f9cc5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fa2c2def60 0x55fa2c2e3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:51.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.429+0000 7f9cc5400640 1 -- 172.21.15.42:0/1668595628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa2c2ea140 msgr2=0x55fa2c2e49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:51.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.429+0000 7f9cc5400640 1 --2- 172.21.15.42:0/1668595628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa2c2ea140 0x55fa2c2e49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.429+0000 7f9cc5400640 1 -- 172.21.15.42:0/1668595628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fa2c2def60 msgr2=0x55fa2c2e3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:51.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.429+0000 7f9cc5400640 1 --2- 172.21.15.42:0/1668595628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fa2c2def60 0x55fa2c2e3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.429+0000 7f9cc5400640 1 -- 172.21.15.42:0/1668595628 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa2c3636d0 con 0x55fa2c2df880 2024-08-26T00:10:51.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.429+0000 7f9cc5e00640 1 --2- 172.21.15.42:0/1668595628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fa2c2def60 0x55fa2c2e3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:10:51.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.429+0000 7f9cc6800640 1 --2- 172.21.15.42:0/1668595628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa2c2ea140 0x55fa2c2e49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:10:51.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.430+0000 7f9cc5400640 1 --2- 172.21.15.42:0/1668595628 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2df880 0x55fa2c2e4490 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40a3920 tx=0x7f9cb4097480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=542e3bf87e0edc47 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:51.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.430+0000 7f9ca3400640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:10:51.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.430+0000 7f9ca3400640 1 -- 172.21.15.42:0/1668595628 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb40b4060 con 0x55fa2c2df880 2024-08-26T00:10:51.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.430+0000 7f9ccb289740 1 -- 172.21.15.42:0/1668595628 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cbc004520 con 0x55fa2c2df880 2024-08-26T00:10:51.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.430+0000 7f9ca3400640 1 -- 172.21.15.42:0/1668595628 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f9cb40cc590 con 0x55fa2c2df880 2024-08-26T00:10:51.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.431+0000 7f9ca3400640 1 -- 172.21.15.42:0/1668595628 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9cb409b1e0 con 0x55fa2c2df880 2024-08-26T00:10:51.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.431+0000 7f9ccb289740 10 client.25903 fetch_fsmap learned FSMap version 30 2024-08-26T00:10:51.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.431+0000 7f9ccb289740 1 -- 172.21.15.42:0/1668595628 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fa2c364940 con 0x55fa2c2df880 2024-08-26T00:10:51.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.436+0000 7f9ca3400640 1 -- 172.21.15.42:0/1668595628 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cbc004520 con 0x55fa2c2df880 2024-08-26T00:10:51.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.436+0000 7f9ca3400640 1 -- 172.21.15.42:0/1668595628 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f9cb4097850 con 0x55fa2c2df880 2024-08-26T00:10:51.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.436+0000 7f9ccb289740 10 client.25903 fetch_fsmap finished waiting for FSMap version 30 2024-08-26T00:10:51.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.436+0000 7f9ccb289740 10 client.25903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:10:51.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.436+0000 7f9ccb289740 20 client.25903 populate_metadata read hostname 'smithi042' 2024-08-26T00:10:51.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.436+0000 7f9ccb289740 1 --2- 172.21.15.42:0/1668595628 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55fa2c365140 0x55fa2c367560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:51.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.436+0000 7f9ccb289740 4 client.25903 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-26T00:10:51.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.436+0000 7f9ccb289740 1 -- 172.21.15.42:0/1668595628 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fa2c24d8b0 con 0x55fa2c365140 2024-08-26T00:10:51.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.436+0000 7f9cc5e00640 1 --2- 172.21.15.42:0/1668595628 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55fa2c365140 0x55fa2c367560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:51.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.437+0000 7f9cc5e00640 1 --2- 172.21.15.42:0/1668595628 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55fa2c365140 0x55fa2c367560 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93128d5a01b44c6b server_cookie=525db397c1fe0d06 in_seq=0 out_seq=0 2024-08-26T00:10:51.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.437+0000 7f9ca3400640 10 client.25903 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:51.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.438+0000 7f9ca3400640 1 -- 172.21.15.42:0/1668595628 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fa2c24d8b0 con 0x55fa2c365140 2024-08-26T00:10:51.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.438+0000 7f9ca3400640 10 client.25903 handle_command_reply: tid=0 2024-08-26T00:10:51.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.439+0000 7f9ccb289740 1 client.25903 shutdown 2024-08-26T00:10:51.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.439+0000 7f9ccb289740 1 -- 172.21.15.42:0/1668595628 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2df880 msgr2=0x55fa2c2e4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:51.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.439+0000 7f9ccb289740 1 --2- 172.21.15.42:0/1668595628 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2df880 0x55fa2c2e4490 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40a3920 tx=0x7f9cb4097480 comp rx=0 tx=0).stop 2024-08-26T00:10:51.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.439+0000 7f9ccb289740 1 -- 172.21.15.42:0/1668595628 shutdown_connections 2024-08-26T00:10:51.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.439+0000 7f9ccb289740 1 --2- 172.21.15.42:0/1668595628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fa2c2ea140 0x55fa2c2e49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.439+0000 7f9ccb289740 1 --2- 172.21.15.42:0/1668595628 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fa2c2df880 0x55fa2c2e4490 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.439+0000 7f9ccb289740 1 --2- 172.21.15.42:0/1668595628 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55fa2c365140 0x55fa2c367560 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.439+0000 7f9ccb289740 1 --2- 172.21.15.42:0/1668595628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fa2c2def60 0x55fa2c2e3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.439+0000 7f9ca3400640 0 client.25903 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:51.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.439+0000 7f9ccb289740 1 -- 172.21.15.42:0/1668595628 >> 172.21.15.42:0/1668595628 conn(0x55fa2c2db4f0 msgr2=0x55fa2c2da520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:51.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.440+0000 7f9ccb289740 1 -- 172.21.15.42:0/1668595628 shutdown_connections 2024-08-26T00:10:51.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.440+0000 7f9ccb289740 1 -- 172.21.15.42:0/1668595628 wait complete. 2024-08-26T00:10:51.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.440+0000 7f9ccb289740 20 client.25903 trim_cache size 0 max 16384 2024-08-26T00:10:51.442 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:10:51.442 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-08-26T00:10:51.442 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "7c40f04b-47c8-4b30-bffc-93676ebde4ba", 2024-08-26T00:10:51.442 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-08-26T00:10:51.442 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:10:51.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.441+0000 7f9cc7200640 1 -- 172.21.15.42:0/3638440260 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9ca80a2c40 msgr2=0x7f9ca80a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:51.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.441+0000 7f9cc7200640 1 --2- 172.21.15.42:0/3638440260 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9ca80a2c40 0x7f9ca80a5100 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc000f80 tx=0x7f9cbc030db0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.441+0000 7f9cc7200640 1 -- 172.21.15.42:0/3638440260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cc010ff30 msgr2=0x7f9cc01a7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:51.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.441+0000 7f9cc7200640 1 --2- 172.21.15.42:0/3638440260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cc010ff30 0x7f9cc01a7300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400d950 tx=0x7f9cb400de10 comp rx=0 tx=0).stop 2024-08-26T00:10:51.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.442+0000 7f9cc7200640 1 -- 172.21.15.42:0/3638440260 shutdown_connections 2024-08-26T00:10:51.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.442+0000 7f9cc7200640 1 --2- 172.21.15.42:0/3638440260 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9ca80a2c40 0x7f9ca80a5100 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.442+0000 7f9cc7200640 1 --2- 172.21.15.42:0/3638440260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cc011aee0 0x7f9cc01ab690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.442+0000 7f9cc7200640 1 --2- 172.21.15.42:0/3638440260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9cc010ff30 0x7f9cc01a7300 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.442+0000 7f9cc7200640 1 --2- 172.21.15.42:0/3638440260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9cc006e7d0 0x7f9cc01a6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:51.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.442+0000 7f9cc7200640 1 -- 172.21.15.42:0/3638440260 >> 172.21.15.42:0/3638440260 conn(0x7f9cc0072f20 msgr2=0x7f9cc010e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:51.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.442+0000 7f9cc7200640 1 -- 172.21.15.42:0/3638440260 shutdown_connections 2024-08-26T00:10:51.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:51.442+0000 7f9cc7200640 1 -- 172.21.15.42:0/3638440260 wait complete. 2024-08-26T00:10:52.224 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-26T00:10:52.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:52 smithi042 ceph-mon[17225]: pgmap v589: 97 pgs: 97 active+clean; 2.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 MiB/s wr, 617 op/s 2024-08-26T00:10:52.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:52 smithi042 ceph-mon[17225]: scrub queued for path: / 2024-08-26T00:10:52.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:52 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:52.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:52 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:52.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:52 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:52.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:52 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:52.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:52 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:52.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:52 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:52.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:52 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:52.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:52 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:52.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:52 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:52.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:52 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:52.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:52 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:52.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:52 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:52.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:52 smithi043 ceph-mon[22091]: pgmap v589: 97 pgs: 97 active+clean; 2.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 MiB/s wr, 617 op/s 2024-08-26T00:10:52.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:52 smithi043 ceph-mon[22091]: scrub queued for path: / 2024-08-26T00:10:52.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:52 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:52.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:52 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:52.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:52 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:52.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:52 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:52.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:52 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:52.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:52 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:52.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:52 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:52.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:52 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:52.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:52 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:52.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:52 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:52.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:52 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:52.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:52 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:52.779 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:10:52.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:52 smithi181 ceph-mon[22102]: pgmap v589: 97 pgs: 97 active+clean; 2.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 MiB/s wr, 617 op/s 2024-08-26T00:10:52.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:52 smithi181 ceph-mon[22102]: scrub queued for path: / 2024-08-26T00:10:52.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:52 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:52.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:52 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:52.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:52 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:52.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:52 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:52.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:52 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:52.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:52 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:52.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:52 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:52.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:52 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:52.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:52 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:52.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:52 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:52.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:52 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:52.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:52 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:53.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.457+0000 7f975d600640 1 -- 172.21.15.42:0/598321127 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97581001d0 msgr2=0x7f97581005b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:53.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.457+0000 7f975d600640 1 --2- 172.21.15.42:0/598321127 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97581001d0 0x7f97581005b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9740009900 tx=0x7f974002a3f0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.457+0000 7f975d600640 1 -- 172.21.15.42:0/598321127 shutdown_connections 2024-08-26T00:10:53.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.457+0000 7f975d600640 1 --2- 172.21.15.42:0/598321127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9758105300 0x7f975810ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.457+0000 7f975d600640 1 --2- 172.21.15.42:0/598321127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9758100b80 0x7f9758104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.457+0000 7f975d600640 1 --2- 172.21.15.42:0/598321127 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97581001d0 0x7f97581005b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.457+0000 7f975d600640 1 -- 172.21.15.42:0/598321127 >> 172.21.15.42:0/598321127 conn(0x7f9758076fd0 msgr2=0x7f97580fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:53.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.458+0000 7f975d600640 1 -- 172.21.15.42:0/598321127 shutdown_connections 2024-08-26T00:10:53.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.458+0000 7f975d600640 1 -- 172.21.15.42:0/598321127 wait complete. 2024-08-26T00:10:53.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.459+0000 7f975d600640 1 Processor -- start 2024-08-26T00:10:53.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.460+0000 7f975d600640 1 -- start start 2024-08-26T00:10:53.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.460+0000 7f975d600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97581001d0 0x7f975810c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:53.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.460+0000 7f975d600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9758100b80 0x7f975810ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:53.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.460+0000 7f975d600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9758105300 0x7f9758109be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:53.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.460+0000 7f975d600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f975810fb20 con 0x7f9758105300 2024-08-26T00:10:53.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.460+0000 7f975d600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f975810f9a0 con 0x7f97581001d0 2024-08-26T00:10:53.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.460+0000 7f975d600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f975810fca0 con 0x7f9758100b80 2024-08-26T00:10:53.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.461+0000 7f9757400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9758105300 0x7f9758109be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:53.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.461+0000 7f9757400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9758105300 0x7f9758109be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41320/0 (socket says 172.21.15.42:41320) 2024-08-26T00:10:53.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.461+0000 7f9757400640 1 -- 172.21.15.42:0/3074594765 learned_addr learned my addr 172.21.15.42:0/3074594765 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:53.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.462+0000 7f9756a00640 1 --2- 172.21.15.42:0/3074594765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97581001d0 0x7f975810c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:53.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.462+0000 7f9756000640 1 --2- 172.21.15.42:0/3074594765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9758100b80 0x7f975810ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:53.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.462+0000 7f9757400640 1 -- 172.21.15.42:0/3074594765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9758100b80 msgr2=0x7f975810ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:53.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.462+0000 7f9757400640 1 --2- 172.21.15.42:0/3074594765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9758100b80 0x7f975810ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.462+0000 7f9757400640 1 -- 172.21.15.42:0/3074594765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97581001d0 msgr2=0x7f975810c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:53.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.462+0000 7f9757400640 1 --2- 172.21.15.42:0/3074594765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97581001d0 0x7f975810c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.462+0000 7f9757400640 1 -- 172.21.15.42:0/3074594765 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975810a4a0 con 0x7f9758105300 2024-08-26T00:10:53.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.463+0000 7f9757400640 1 --2- 172.21.15.42:0/3074594765 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9758105300 0x7f9758109be0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f975000eaa0 tx=0x7f975000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:53.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.464+0000 7f974f400640 1 -- 172.21.15.42:0/3074594765 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975000cdb0 con 0x7f9758105300 2024-08-26T00:10:53.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.464+0000 7f975d600640 1 -- 172.21.15.42:0/3074594765 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f975810a790 con 0x7f9758105300 2024-08-26T00:10:53.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.464+0000 7f975d600640 1 -- 172.21.15.42:0/3074594765 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97581a0ad0 con 0x7f9758105300 2024-08-26T00:10:53.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.464+0000 7f974f400640 1 -- 172.21.15.42:0/3074594765 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9750005020 con 0x7f9758105300 2024-08-26T00:10:53.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.465+0000 7f974f400640 1 -- 172.21.15.42:0/3074594765 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975001f060 con 0x7f9758105300 2024-08-26T00:10:53.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.469+0000 7f9760012740 1 Processor -- start 2024-08-26T00:10:53.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.471+0000 7f974f400640 1 -- 172.21.15.42:0/3074594765 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9750004a40 con 0x7f9758105300 2024-08-26T00:10:53.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.472+0000 7f9760012740 1 -- start start 2024-08-26T00:10:53.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.472+0000 7f9760012740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f03530940 0x556f03530d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:53.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.472+0000 7f9760012740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556f03531260 0x556f0353b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:53.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.472+0000 7f9760012740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f0353bb20 0x556f0353df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:53.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.472+0000 7f9760012740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556f03496fc0 con 0x556f03530940 2024-08-26T00:10:53.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.472+0000 7f9760012740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556f0342e680 con 0x556f03531260 2024-08-26T00:10:53.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.472+0000 7f9760012740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556f03492f80 con 0x556f0353bb20 2024-08-26T00:10:53.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.473+0000 7f9756000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f03530940 0x556f03530d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:53.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.473+0000 7f9756a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556f03531260 0x556f0353b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:53.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.473+0000 7f9756a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556f03531260 0x556f0353b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:40670/0 (socket says 172.21.15.42:40670) 2024-08-26T00:10:53.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.473+0000 7f9756a00640 1 -- 172.21.15.42:0/4224296340 learned_addr learned my addr 172.21.15.42:0/4224296340 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:53.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.473+0000 7f9756000640 1 --2- 172.21.15.42:0/4224296340 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f0353bb20 0x556f0353df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:53.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.474+0000 7f974f400640 1 --2- 172.21.15.42:0/3074594765 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f973c0a2c00 0x7f973c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:53.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.474+0000 7f9756a00640 1 -- 172.21.15.42:0/4224296340 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f0353bb20 msgr2=0x556f0353df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:53.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.474+0000 7f9756a00640 1 --2- 172.21.15.42:0/4224296340 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f0353bb20 0x556f0353df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.474+0000 7f9756a00640 1 -- 172.21.15.42:0/4224296340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f03530940 msgr2=0x556f03530d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:53.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.474+0000 7f9756a00640 1 --2- 172.21.15.42:0/4224296340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f03530940 0x556f03530d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.474+0000 7f9756a00640 1 -- 172.21.15.42:0/4224296340 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f0344a2c0 con 0x556f03531260 2024-08-26T00:10:53.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.474+0000 7f974f400640 1 -- 172.21.15.42:0/3074594765 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f97500cefa0 con 0x7f9758105300 2024-08-26T00:10:53.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.474+0000 7f9756a00640 1 --2- 172.21.15.42:0/4224296340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556f03531260 0x556f0353b5e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9740009900 tx=0x7f9740005e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=723ec19ba33846e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:53.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.475+0000 7f9747400640 1 -- 172.21.15.42:0/4224296340 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740035030 con 0x556f03531260 2024-08-26T00:10:53.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.475+0000 7f9747400640 1 -- 172.21.15.42:0/4224296340 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97400043c0 con 0x556f03531260 2024-08-26T00:10:53.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.475+0000 7f9747400640 1 -- 172.21.15.42:0/4224296340 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740004d90 con 0x556f03531260 2024-08-26T00:10:53.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.476+0000 7f9757400640 1 --2- 172.21.15.42:0/3074594765 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f973c0a2c00 0x7f973c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:53.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.476+0000 7f9760012740 1 -- 172.21.15.42:0/4224296340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556f03531260 msgr2=0x556f0353b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:53.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.476+0000 7f9760012740 1 --2- 172.21.15.42:0/4224296340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556f03531260 0x556f0353b5e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9740009900 tx=0x7f9740005e60 comp rx=0 tx=0).stop 2024-08-26T00:10:53.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.477+0000 7f9760012740 1 -- 172.21.15.42:0/4224296340 shutdown_connections 2024-08-26T00:10:53.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.477+0000 7f9760012740 1 --2- 172.21.15.42:0/4224296340 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f0353bb20 0x556f0353df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.477+0000 7f9760012740 1 --2- 172.21.15.42:0/4224296340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556f03531260 0x556f0353b5e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.477+0000 7f9760012740 1 --2- 172.21.15.42:0/4224296340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f03530940 0x556f03530d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.477+0000 7f9760012740 1 -- 172.21.15.42:0/4224296340 >> 172.21.15.42:0/4224296340 conn(0x556f0352ced0 msgr2=0x556f0352d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:53.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.477+0000 7f9760012740 1 -- 172.21.15.42:0/4224296340 shutdown_connections 2024-08-26T00:10:53.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.477+0000 7f9760012740 1 -- 172.21.15.42:0/4224296340 wait complete. 2024-08-26T00:10:53.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.477+0000 7f9757400640 1 --2- 172.21.15.42:0/3074594765 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f973c0a2c00 0x7f973c0a50c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9750097d00 tx=0x7f975000cf50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:53.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.478+0000 7f9760012740 1 -- start start 2024-08-26T00:10:53.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.478+0000 7f9760012740 1 Processor -- start 2024-08-26T00:10:53.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.479+0000 7f9760012740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f03530940 0x556f035389b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:53.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.479+0000 7f9760012740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f03531260 0x556f03538ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:53.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.479+0000 7f9760012740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556f0353bb20 0x556f03539430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:53.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.479+0000 7f9760012740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556f0353e6f0 con 0x556f03531260 2024-08-26T00:10:53.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.479+0000 7f9760012740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556f03451e50 con 0x556f0353bb20 2024-08-26T00:10:53.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.479+0000 7f9760012740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556f0353e870 con 0x556f03530940 2024-08-26T00:10:53.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.479+0000 7f9760012740 10 client.0 _ll_register_callbacks cb 0x556f0343cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:10:53.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.479+0000 7f9756000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f03530940 0x556f035389b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:53.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.479+0000 7f9756000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f03530940 0x556f035389b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:37454/0 (socket says 172.21.15.42:37454) 2024-08-26T00:10:53.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.479+0000 7f9756000640 1 -- 172.21.15.42:0/1597217539 learned_addr learned my addr 172.21.15.42:0/1597217539 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:53.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.479+0000 7f9756000640 1 --2- 172.21.15.42:0/1597217539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556f0353bb20 0x556f03539430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:53.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.480+0000 7f9756a00640 1 --2- 172.21.15.42:0/1597217539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f03531260 0x556f03538ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:53.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.480+0000 7f9756000640 1 -- 172.21.15.42:0/1597217539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556f0353bb20 msgr2=0x556f03539430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:53.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.480+0000 7f9756000640 1 --2- 172.21.15.42:0/1597217539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556f0353bb20 0x556f03539430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.480+0000 7f9756000640 1 -- 172.21.15.42:0/1597217539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f03531260 msgr2=0x556f03538ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:53.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.480+0000 7f9756000640 1 --2- 172.21.15.42:0/1597217539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f03531260 0x556f03538ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.480+0000 7f9756000640 1 -- 172.21.15.42:0/1597217539 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f032083c0 con 0x556f03530940 2024-08-26T00:10:53.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.481+0000 7f9756000640 1 --2- 172.21.15.42:0/1597217539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f03530940 0x556f035389b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9748012b70 tx=0x7f9748009ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56cde5d9f4245ea7 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:53.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.481+0000 7f973be00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:10:53.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.481+0000 7f973be00640 1 -- 172.21.15.42:0/1597217539 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974800ed00 con 0x556f03530940 2024-08-26T00:10:53.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.482+0000 7f973be00640 1 -- 172.21.15.42:0/1597217539 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f9748004020 con 0x556f03530940 2024-08-26T00:10:53.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.482+0000 7f9760012740 1 -- 172.21.15.42:0/1597217539 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97400043c0 con 0x556f03530940 2024-08-26T00:10:53.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.482+0000 7f973be00640 1 -- 172.21.15.42:0/1597217539 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f974800eea0 con 0x556f03530940 2024-08-26T00:10:53.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.482+0000 7f9760012740 10 client.25915 fetch_fsmap learned FSMap version 31 2024-08-26T00:10:53.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.482+0000 7f9760012740 1 -- 172.21.15.42:0/1597217539 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556f0354a420 con 0x556f03530940 2024-08-26T00:10:53.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.483+0000 7f973be00640 1 -- 172.21.15.42:0/1597217539 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97400043c0 con 0x556f03530940 2024-08-26T00:10:53.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.483+0000 7f973be00640 1 -- 172.21.15.42:0/1597217539 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f9748004870 con 0x556f03530940 2024-08-26T00:10:53.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.483+0000 7f9760012740 10 client.25915 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:10:53.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.483+0000 7f9760012740 10 client.25915 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:10:53.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.483+0000 7f9760012740 20 client.25915 populate_metadata read hostname 'smithi042' 2024-08-26T00:10:53.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.483+0000 7f9760012740 1 --2- 172.21.15.42:0/1597217539 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x556f0354b830 0x556f0354dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:53.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.483+0000 7f9760012740 4 client.25915 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:10:53.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.483+0000 7f9760012740 1 -- 172.21.15.42:0/1597217539 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f034a4530 con 0x556f0354b830 2024-08-26T00:10:53.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.484+0000 7f9756a00640 1 --2- 172.21.15.42:0/1597217539 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x556f0354b830 0x556f0354dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:53.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.485+0000 7f9756a00640 1 --2- 172.21.15.42:0/1597217539 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x556f0354b830 0x556f0354dca0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f8d48202ac145fa server_cookie=676b2d6b3d3a9441 in_seq=0 out_seq=0 2024-08-26T00:10:53.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.485+0000 7f973be00640 10 client.25915 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:53.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.486+0000 7f973be00640 1 -- 172.21.15.42:0/1597217539 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556f034a4530 con 0x556f0354b830 2024-08-26T00:10:53.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.486+0000 7f973be00640 10 client.25915 handle_command_reply: tid=0 2024-08-26T00:10:53.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.486+0000 7f9760012740 1 client.25915 shutdown 2024-08-26T00:10:53.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.487+0000 7f9760012740 1 -- 172.21.15.42:0/1597217539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f03530940 msgr2=0x556f035389b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:53.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.487+0000 7f9760012740 1 --2- 172.21.15.42:0/1597217539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f03530940 0x556f035389b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9748012b70 tx=0x7f9748009ad0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.487+0000 7f9760012740 1 -- 172.21.15.42:0/1597217539 shutdown_connections 2024-08-26T00:10:53.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.487+0000 7f9760012740 1 --2- 172.21.15.42:0/1597217539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556f0353bb20 0x556f03539430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.487+0000 7f9760012740 1 --2- 172.21.15.42:0/1597217539 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x556f0354b830 0x556f0354dca0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.487+0000 7f9760012740 1 --2- 172.21.15.42:0/1597217539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f03531260 0x556f03538ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.487+0000 7f9760012740 1 --2- 172.21.15.42:0/1597217539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f03530940 0x556f035389b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.487+0000 7f9760012740 1 -- 172.21.15.42:0/1597217539 >> 172.21.15.42:0/1597217539 conn(0x556f0352ced0 msgr2=0x556f03532c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:53.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.487+0000 7f973be00640 0 client.25915 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:53.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.488+0000 7f9760012740 1 -- 172.21.15.42:0/1597217539 shutdown_connections 2024-08-26T00:10:53.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.488+0000 7f9760012740 1 -- 172.21.15.42:0/1597217539 wait complete. 2024-08-26T00:10:53.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.488+0000 7f9760012740 20 client.25915 trim_cache size 0 max 16384 2024-08-26T00:10:53.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.515+0000 7f9760012740 1 Processor -- start 2024-08-26T00:10:53.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.515+0000 7f9760012740 1 -- start start 2024-08-26T00:10:53.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.515+0000 7f9760012740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f03530940 0x556f035333a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:53.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.515+0000 7f9760012740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f03531260 0x556f0353a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:53.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.515+0000 7f9760012740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556f0353bb20 0x556f035535c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:53.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.515+0000 7f9760012740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9734010e20 con 0x556f03530940 2024-08-26T00:10:53.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.515+0000 7f9760012740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f973400e630 con 0x556f0353bb20 2024-08-26T00:10:53.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.515+0000 7f9760012740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f973400c460 con 0x556f03531260 2024-08-26T00:10:53.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.516+0000 7f9756000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f03530940 0x556f035333a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:53.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.516+0000 7f9756a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f03531260 0x556f0353a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:53.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.516+0000 7f9756000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f03530940 0x556f035333a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41362/0 (socket says 172.21.15.42:41362) 2024-08-26T00:10:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.516+0000 7f9756000640 1 -- 172.21.15.42:0/4042457150 learned_addr learned my addr 172.21.15.42:0/4042457150 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.516+0000 7f9756000640 1 --2- 172.21.15.42:0/4042457150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556f0353bb20 0x556f035535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.516+0000 7f9756000640 1 -- 172.21.15.42:0/4042457150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f03531260 msgr2=0x556f0353a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.516+0000 7f9756000640 1 --2- 172.21.15.42:0/4042457150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f03531260 0x556f0353a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.516+0000 7f9756000640 1 -- 172.21.15.42:0/4042457150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556f0353bb20 msgr2=0x556f035535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.516+0000 7f9756000640 1 --2- 172.21.15.42:0/4042457150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556f0353bb20 0x556f035535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.516+0000 7f9756000640 1 -- 172.21.15.42:0/4042457150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f0354e010 con 0x556f03530940 2024-08-26T00:10:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.517+0000 7f9756000640 1 --2- 172.21.15.42:0/4042457150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f03530940 0x556f035333a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f974801e8b0 tx=0x7f9748009cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e1cdeef3a93b6c server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:53.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.517+0000 7f9746a00640 1 -- 172.21.15.42:0/4042457150 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974800ed00 con 0x556f03530940 2024-08-26T00:10:53.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.517+0000 7f9746a00640 1 -- 172.21.15.42:0/4042457150 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f974801e2d0 con 0x556f03530940 2024-08-26T00:10:53.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.517+0000 7f9746a00640 1 -- 172.21.15.42:0/4042457150 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974801ed10 con 0x556f03530940 2024-08-26T00:10:53.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.518+0000 7f9760012740 1 -- 172.21.15.42:0/4042457150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f03530940 msgr2=0x556f035333a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:53.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.518+0000 7f9760012740 1 --2- 172.21.15.42:0/4042457150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f03530940 0x556f035333a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f974801e8b0 tx=0x7f9748009cf0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.519+0000 7f9760012740 1 -- 172.21.15.42:0/4042457150 shutdown_connections 2024-08-26T00:10:53.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.519+0000 7f9760012740 1 --2- 172.21.15.42:0/4042457150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556f0353bb20 0x556f035535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.519+0000 7f9760012740 1 --2- 172.21.15.42:0/4042457150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f03531260 0x556f0353a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.519+0000 7f9760012740 1 --2- 172.21.15.42:0/4042457150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f03530940 0x556f035333a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.519+0000 7f9760012740 1 -- 172.21.15.42:0/4042457150 >> 172.21.15.42:0/4042457150 conn(0x556f0352ced0 msgr2=0x556f0353a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:53.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.519+0000 7f9760012740 1 -- 172.21.15.42:0/4042457150 shutdown_connections 2024-08-26T00:10:53.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.520+0000 7f9760012740 1 -- 172.21.15.42:0/4042457150 wait complete. 2024-08-26T00:10:53.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.520+0000 7f9760012740 1 -- start start 2024-08-26T00:10:53.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.520+0000 7f9760012740 1 Processor -- start 2024-08-26T00:10:53.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.522+0000 7f9760012740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556f03530940 0x556f0353f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:53.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.522+0000 7f9760012740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f03531260 0x556f0353f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:53.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.522+0000 7f9760012740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f0353bb20 0x556f035ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:53.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.522+0000 7f9760012740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f973400caf0 con 0x556f0353bb20 2024-08-26T00:10:53.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.522+0000 7f9760012740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f973400df60 con 0x556f03530940 2024-08-26T00:10:53.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.522+0000 7f9760012740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f973400d1c0 con 0x556f03531260 2024-08-26T00:10:53.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.522+0000 7f9760012740 10 client.0 _ll_register_callbacks cb 0x7f9748009c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:10:53.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.522+0000 7f9756a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f03531260 0x556f0353f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:53.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.522+0000 7f9756a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f03531260 0x556f0353f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:37470/0 (socket says 172.21.15.42:37470) 2024-08-26T00:10:53.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.522+0000 7f9756a00640 1 -- 172.21.15.42:0/2567704556 learned_addr learned my addr 172.21.15.42:0/2567704556 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:10:53.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.522+0000 7f9756000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556f03530940 0x556f0353f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:53.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.523+0000 7f9756000640 1 --2- 172.21.15.42:0/2567704556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f0353bb20 0x556f035ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:53.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.523+0000 7f9756a00640 1 -- 172.21.15.42:0/2567704556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556f03530940 msgr2=0x556f0353f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:53.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.523+0000 7f9756a00640 1 --2- 172.21.15.42:0/2567704556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556f03530940 0x556f0353f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.523+0000 7f9756a00640 1 -- 172.21.15.42:0/2567704556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f0353bb20 msgr2=0x556f035ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:10:53.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.523+0000 7f9756a00640 1 --2- 172.21.15.42:0/2567704556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f0353bb20 0x556f035ae5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.523+0000 7f9756a00640 1 -- 172.21.15.42:0/2567704556 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f035aeb80 con 0x556f03531260 2024-08-26T00:10:53.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.524+0000 7f9756000640 1 --2- 172.21.15.42:0/2567704556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556f03530940 0x556f0353f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:10:53.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.524+0000 7f9756a00640 1 --2- 172.21.15.42:0/2567704556 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f03531260 0x556f0353f7d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9740009900 tx=0x7f9740005a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4168feb7a2dd214 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:10:53.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.524+0000 7f973be00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:10:53.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.524+0000 7f973be00640 1 -- 172.21.15.42:0/2567704556 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740035040 con 0x556f03531260 2024-08-26T00:10:53.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.524+0000 7f973be00640 1 -- 172.21.15.42:0/2567704556 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f97400315b0 con 0x556f03531260 2024-08-26T00:10:53.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.525+0000 7f9760012740 1 -- 172.21.15.42:0/2567704556 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f974801e2d0 con 0x556f03531260 2024-08-26T00:10:53.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.525+0000 7f973be00640 1 -- 172.21.15.42:0/2567704556 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9740004780 con 0x556f03531260 2024-08-26T00:10:53.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.526+0000 7f9760012740 10 client.25921 fetch_fsmap learned FSMap version 31 2024-08-26T00:10:53.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.526+0000 7f9760012740 1 -- 172.21.15.42:0/2567704556 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556f035b5f40 con 0x556f03531260 2024-08-26T00:10:53.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.526+0000 7f973be00640 1 -- 172.21.15.42:0/2567704556 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f974801e2d0 con 0x556f03531260 2024-08-26T00:10:53.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.527+0000 7f973be00640 1 -- 172.21.15.42:0/2567704556 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f9740003ab0 con 0x556f03531260 2024-08-26T00:10:53.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.527+0000 7f9760012740 10 client.25921 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:10:53.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.527+0000 7f9760012740 10 client.25921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:10:53.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.527+0000 7f9760012740 20 client.25921 populate_metadata read hostname 'smithi042' 2024-08-26T00:10:53.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.527+0000 7f9760012740 1 --2- 172.21.15.42:0/2567704556 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x556f035b6270 0x556f035b8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:10:53.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.527+0000 7f9760012740 4 client.25921 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-26T00:10:53.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.527+0000 7f9760012740 1 -- 172.21.15.42:0/2567704556 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556f0349ea40 con 0x556f035b6270 2024-08-26T00:10:53.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.527+0000 7f9756000640 1 --2- 172.21.15.42:0/2567704556 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x556f035b6270 0x556f035b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:10:53.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.528+0000 7f9756000640 1 --2- 172.21.15.42:0/2567704556 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x556f035b6270 0x556f035b8660 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe34cf1e81465e7 server_cookie=3ca5cc625f868c6 in_seq=0 out_seq=0 2024-08-26T00:10:53.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.529+0000 7f973be00640 10 client.25921 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:53.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.531+0000 7f973be00640 1 -- 172.21.15.42:0/2567704556 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+269 (crc 0 0 0) 0x556f0349ea40 con 0x556f035b6270 2024-08-26T00:10:53.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.531+0000 7f973be00640 10 client.25921 handle_command_reply: tid=0 2024-08-26T00:10:53.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.531+0000 7f9760012740 1 client.25921 shutdown 2024-08-26T00:10:53.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.531+0000 7f9760012740 1 -- 172.21.15.42:0/2567704556 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f03531260 msgr2=0x556f0353f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:53.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.531+0000 7f9760012740 1 --2- 172.21.15.42:0/2567704556 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f03531260 0x556f0353f7d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9740009900 tx=0x7f9740005a60 comp rx=0 tx=0).stop 2024-08-26T00:10:53.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.532+0000 7f9760012740 1 -- 172.21.15.42:0/2567704556 shutdown_connections 2024-08-26T00:10:53.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.532+0000 7f9760012740 1 --2- 172.21.15.42:0/2567704556 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x556f035b6270 0x556f035b8660 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.532+0000 7f9760012740 1 --2- 172.21.15.42:0/2567704556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556f0353bb20 0x556f035ae5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.532+0000 7f9760012740 1 --2- 172.21.15.42:0/2567704556 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556f03531260 0x556f0353f7d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.532+0000 7f973be00640 0 client.25921 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:10:53.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.532+0000 7f9760012740 1 --2- 172.21.15.42:0/2567704556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556f03530940 0x556f0353f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.532+0000 7f9760012740 1 -- 172.21.15.42:0/2567704556 >> 172.21.15.42:0/2567704556 conn(0x556f0352ced0 msgr2=0x556f0352c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:53.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.532+0000 7f9760012740 1 -- 172.21.15.42:0/2567704556 shutdown_connections 2024-08-26T00:10:53.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.532+0000 7f9760012740 1 -- 172.21.15.42:0/2567704556 wait complete. 2024-08-26T00:10:53.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.532+0000 7f9760012740 20 client.25921 trim_cache size 0 max 16384 2024-08-26T00:10:53.535 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:10:53.535 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "scrub active (15191 inodes in the stack)", 2024-08-26T00:10:53.535 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-08-26T00:10:53.535 INFO:teuthology.orchestra.run.smithi042.stdout: "7c40f04b-47c8-4b30-bffc-93676ebde4ba": { 2024-08-26T00:10:53.535 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-08-26T00:10:53.535 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "7c40f04b-47c8-4b30-bffc-93676ebde4ba", 2024-08-26T00:10:53.535 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,force" 2024-08-26T00:10:53.536 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:10:53.536 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:10:53.536 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:10:53.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.533+0000 7f975d600640 1 -- 172.21.15.42:0/3074594765 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f973c0a2c00 msgr2=0x7f973c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:53.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.533+0000 7f975d600640 1 --2- 172.21.15.42:0/3074594765 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f973c0a2c00 0x7f973c0a50c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9750097d00 tx=0x7f975000cf50 comp rx=0 tx=0).stop 2024-08-26T00:10:53.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.533+0000 7f975d600640 1 -- 172.21.15.42:0/3074594765 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9758105300 msgr2=0x7f9758109be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:10:53.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.533+0000 7f975d600640 1 --2- 172.21.15.42:0/3074594765 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9758105300 0x7f9758109be0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f975000eaa0 tx=0x7f975000ef60 comp rx=0 tx=0).stop 2024-08-26T00:10:53.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.534+0000 7f975d600640 1 -- 172.21.15.42:0/3074594765 shutdown_connections 2024-08-26T00:10:53.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.534+0000 7f975d600640 1 --2- 172.21.15.42:0/3074594765 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f973c0a2c00 0x7f973c0a50c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.534+0000 7f975d600640 1 --2- 172.21.15.42:0/3074594765 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9758105300 0x7f9758109be0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.534+0000 7f975d600640 1 --2- 172.21.15.42:0/3074594765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9758100b80 0x7f975810ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.534+0000 7f975d600640 1 --2- 172.21.15.42:0/3074594765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97581001d0 0x7f975810c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:10:53.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.534+0000 7f975d600640 1 -- 172.21.15.42:0/3074594765 >> 172.21.15.42:0/3074594765 conn(0x7f9758076fd0 msgr2=0x7f9758102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:10:53.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.534+0000 7f975d600640 1 -- 172.21.15.42:0/3074594765 shutdown_connections 2024-08-26T00:10:53.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:10:53.534+0000 7f975d600640 1 -- 172.21.15.42:0/3074594765 wait complete. 2024-08-26T00:10:54.716 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:54 smithi042 ceph-mon[17225]: pgmap v590: 97 pgs: 97 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 765 op/s 2024-08-26T00:10:54.716 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:54 smithi042 ceph-mon[17225]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:10:54.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:54 smithi043 ceph-mon[22091]: pgmap v590: 97 pgs: 97 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 765 op/s 2024-08-26T00:10:54.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:54 smithi043 ceph-mon[22091]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:10:54.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:54 smithi181 ceph-mon[22102]: pgmap v590: 97 pgs: 97 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 765 op/s 2024-08-26T00:10:54.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:54 smithi181 ceph-mon[22102]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:10:54.891 INFO:tasks.cephfs.filesystem:scrub status for tag:7c40f04b-47c8-4b30-bffc-93676ebde4ba - {'path': '/', 'tag': '7c40f04b-47c8-4b30-bffc-93676ebde4ba', 'options': 'recursive,force'} 2024-08-26T00:10:56.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:56 smithi043 ceph-mon[22091]: pgmap v591: 97 pgs: 97 active+clean; 2.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 816 op/s 2024-08-26T00:10:56.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:56 smithi042 ceph-mon[17225]: pgmap v591: 97 pgs: 97 active+clean; 2.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 816 op/s 2024-08-26T00:10:56.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:56 smithi181 ceph-mon[22102]: pgmap v591: 97 pgs: 97 active+clean; 2.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 816 op/s 2024-08-26T00:10:57.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:57.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:57.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:57.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:57.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:57.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:57.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:57.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:57.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:57.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:57.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:57.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:57.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:57.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:57.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:57.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:57.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:10:57.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:57 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:57.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:57.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:57.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:57.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:57.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:57.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:57.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:57.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:57.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:57.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:57.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:57.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:57.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:57.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:57.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:57.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:10:57.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:57 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:57.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:57.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:57.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:57.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:57.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:57.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:57.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:57.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:57.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:57.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:57.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:57.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:57.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:57.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:57.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:57.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:57.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:10:57.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:57 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:10:58.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:10:58 smithi043 ceph-mon[22091]: pgmap v592: 97 pgs: 97 active+clean; 2.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 1.23k op/s 2024-08-26T00:10:58.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:10:58 smithi042 ceph-mon[17225]: pgmap v592: 97 pgs: 97 active+clean; 2.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 1.23k op/s 2024-08-26T00:10:58.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:10:58 smithi181 ceph-mon[22102]: pgmap v592: 97 pgs: 97 active+clean; 2.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 1.23k op/s 2024-08-26T00:11:00.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:00 smithi043 ceph-mon[22091]: pgmap v593: 97 pgs: 97 active+clean; 2.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.8 MiB/s wr, 1.84k op/s 2024-08-26T00:11:00.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:00 smithi042 ceph-mon[17225]: pgmap v593: 97 pgs: 97 active+clean; 2.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.8 MiB/s wr, 1.84k op/s 2024-08-26T00:11:00.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:00 smithi181 ceph-mon[22102]: pgmap v593: 97 pgs: 97 active+clean; 2.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.8 MiB/s wr, 1.84k op/s 2024-08-26T00:11:02.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: pgmap v594: 97 pgs: 97 active+clean; 2.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.6 MiB/s wr, 1.80k op/s 2024-08-26T00:11:02.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.779 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.779 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.779 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.779 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.779 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.780 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.780 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.780 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.780 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.780 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.781 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.781 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.781 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.782 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.782 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.782 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.782 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.782 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.782 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.783 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.783 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.783 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.783 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.783 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.784 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.784 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.784 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.784 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.784 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.784 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.784 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.785 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.785 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.785 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.785 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.785 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.785 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.786 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.786 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.786 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.786 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.786 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.786 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.787 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.787 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.787 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.787 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.787 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.787 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.787 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.788 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.788 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.788 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.788 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.788 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.788 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.789 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.789 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.789 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.789 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.789 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.789 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.790 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.790 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.790 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.790 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.790 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.791 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.791 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.791 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.791 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.791 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.791 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.791 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.792 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.792 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.792 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.792 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.792 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.792 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.793 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.794 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.794 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.794 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.794 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.794 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.795 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.795 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.795 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.795 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.795 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.795 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.796 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.796 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.796 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.796 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.796 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.796 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.797 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.797 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.797 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.797 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.797 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.797 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.798 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.798 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.798 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.798 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.798 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.798 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.799 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.799 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.799 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.799 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.799 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.799 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.800 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.800 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.800 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.800 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.800 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.801 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.801 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.801 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.801 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.801 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.801 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.802 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.802 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.802 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.802 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.802 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.803 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.803 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.803 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.803 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.803 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.803 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.804 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.804 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.804 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.804 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.804 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.804 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.805 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.805 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.805 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.805 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.805 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.805 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.806 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.806 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.806 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.806 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.806 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.807 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.807 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.807 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.807 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.807 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.807 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.808 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.808 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.808 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.808 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.808 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.809 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.809 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.809 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.809 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.809 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.809 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.810 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.810 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.810 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.810 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.810 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.810 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.811 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.811 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.811 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.811 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.811 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.812 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.812 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.812 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.812 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.812 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.812 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.812 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.812 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.812 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.812 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.812 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.812 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.813 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.813 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.813 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.813 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.813 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:02 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:02.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: pgmap v594: 97 pgs: 97 active+clean; 2.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.6 MiB/s wr, 1.80k op/s 2024-08-26T00:11:02.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.822 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.823 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.824 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.825 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.827 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.828 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.828 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.828 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.828 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.828 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.828 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.828 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.828 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.828 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.828 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.828 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.828 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.828 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.828 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.829 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.829 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.829 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.829 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.829 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.829 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.829 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.829 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.829 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.829 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.829 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.829 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.829 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.829 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.829 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.830 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.830 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.830 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.830 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.830 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.830 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.830 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.830 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.830 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.830 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.830 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.830 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.830 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.831 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.831 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.831 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.831 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.831 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.831 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.831 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.831 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.831 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.831 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.831 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.831 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.831 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.831 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.831 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.832 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.832 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.832 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.832 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.832 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.832 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.832 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.832 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.832 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.832 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.832 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.832 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.832 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.832 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.833 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.833 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.833 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.833 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.833 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.833 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.833 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.833 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.833 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.833 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.833 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.833 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.833 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.833 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.834 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.834 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.834 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.834 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.834 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.834 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.834 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.834 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.834 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:02 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:02.834 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.834 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.834 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: pgmap v594: 97 pgs: 97 active+clean; 2.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.6 MiB/s wr, 1.80k op/s 2024-08-26T00:11:02.834 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.835 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.835 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.835 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.835 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.835 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.835 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.835 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.835 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.835 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.835 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.835 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.835 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.835 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.835 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.836 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.836 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.836 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.836 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.836 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.836 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.836 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.836 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.836 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.836 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.836 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.836 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.836 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.836 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.837 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.837 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.837 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.837 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.837 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.837 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.837 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.837 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.837 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.837 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.837 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.837 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.837 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.838 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.838 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.838 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.838 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.838 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.838 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.838 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.838 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.838 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.838 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.838 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.838 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.838 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.838 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.839 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.839 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.839 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.839 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.839 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.839 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.839 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.839 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.839 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.839 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.839 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.839 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.839 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.840 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.840 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.840 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.840 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.840 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.840 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.840 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.840 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.840 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.840 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.840 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.840 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.840 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.840 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.841 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.841 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.841 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.841 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.841 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.841 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.841 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.841 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.841 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.841 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.841 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.841 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.841 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.842 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.842 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.842 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.842 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.842 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.842 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.842 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.842 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.842 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.842 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.842 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.842 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.842 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.843 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.843 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.843 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.843 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.843 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.843 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.843 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.843 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.843 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.843 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.843 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.843 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.843 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.844 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.844 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.844 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.844 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.844 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.844 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.844 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.844 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.844 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.844 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.844 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.844 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.844 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.844 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.845 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.845 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.845 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.845 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.845 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.845 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.845 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.845 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.845 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.845 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.845 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.845 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.845 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.846 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.846 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.846 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.846 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.846 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.846 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.846 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.846 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.846 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.846 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.846 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.846 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.846 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.846 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.847 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.847 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.847 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.847 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.847 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.847 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.847 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.847 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.847 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.847 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.847 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.847 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.847 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.847 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.848 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.848 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.848 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.848 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.848 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.848 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.848 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.848 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.848 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.848 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.848 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.848 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.848 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.848 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.849 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.849 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.849 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.849 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.849 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.849 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.849 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.849 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.849 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.849 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.849 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.849 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.849 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.849 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.850 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.850 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.850 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.850 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.850 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.850 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.850 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.850 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.850 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.850 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.850 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.850 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.850 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.851 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.851 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.851 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.851 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.851 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.851 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.851 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.851 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.851 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.851 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.851 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.851 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.851 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.852 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.852 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.852 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.852 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.852 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.852 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.852 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.852 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.852 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.852 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.852 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.852 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.852 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.852 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.853 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.853 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.853 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.853 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.853 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.853 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.853 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.853 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.853 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.853 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.853 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.853 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.853 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.853 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.854 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.854 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.854 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.854 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.854 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.854 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.854 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.854 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:02.854 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:02.854 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:02 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.409 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.409 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.409 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.409 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.409 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.409 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.409 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.409 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.409 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.410 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.410 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.410 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.410 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.410 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.410 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.410 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.410 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.410 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.410 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.410 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.410 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.410 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.410 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.411 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.411 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.411 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.411 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.411 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.411 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.411 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.411 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.411 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.411 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.411 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.411 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.411 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.411 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.412 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.412 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.412 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.412 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.412 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.412 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.412 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.412 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.412 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.412 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.412 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.412 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.412 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.412 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.413 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.414 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.414 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.414 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.414 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.414 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.414 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.414 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.414 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.414 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.414 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.414 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.414 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.415 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.415 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.415 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.415 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.415 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.415 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.415 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.415 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.415 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.415 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.415 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.415 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.415 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.416 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.416 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.416 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.416 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.416 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.416 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.416 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.416 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.416 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.416 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.416 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.416 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.416 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.417 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.417 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.417 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.417 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.417 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.417 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.417 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.417 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.417 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.417 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.417 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.417 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.417 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.418 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.418 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.418 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.418 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.418 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.418 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.418 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.418 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.418 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.418 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.418 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.418 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.418 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.419 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.419 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.419 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.419 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.419 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.419 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.419 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.419 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.419 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.419 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.419 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.419 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.419 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.419 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.420 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.420 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.420 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.420 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.420 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.420 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.420 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.420 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.420 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.420 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.420 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.420 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.420 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.421 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.421 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.421 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.421 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.421 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.421 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.421 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.421 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.421 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.421 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.421 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.421 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.421 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.421 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.422 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.422 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.422 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.422 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.422 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.422 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.422 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.422 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.422 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.422 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.422 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.422 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.422 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.423 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.423 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.423 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.423 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.423 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.423 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.423 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.423 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.423 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.423 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.423 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.423 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.423 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.423 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.424 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.424 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.424 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.424 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.424 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.424 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.424 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.424 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.424 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.424 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.424 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.424 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.424 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.424 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.425 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.425 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.425 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.425 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.425 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.425 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.425 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.425 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.425 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.425 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.425 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.425 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.425 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.425 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.426 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.426 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.426 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.426 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.426 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.426 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.426 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.426 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.426 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.426 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.426 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.426 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.426 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.426 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.427 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.427 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.427 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.427 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.427 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.427 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.427 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.427 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.427 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.427 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.427 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.427 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.427 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.427 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.428 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.428 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.428 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.428 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.428 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.428 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.428 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.428 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.428 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.428 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.428 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.428 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.428 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.428 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.429 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.429 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.429 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.429 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.429 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.429 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.429 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.429 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.429 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.429 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.429 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.429 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.429 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.430 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.430 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.430 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.430 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.430 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.430 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.430 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.430 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.430 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.430 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.430 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.430 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.430 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.430 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.431 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.431 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.431 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.431 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.431 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.431 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.431 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.431 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.431 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.431 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.431 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.431 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.431 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.432 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.432 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.432 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.432 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.432 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.432 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.432 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.432 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.432 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.432 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.432 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.432 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.432 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.432 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.433 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.433 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.433 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.433 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.433 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.433 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.433 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.433 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.433 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.433 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.433 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.433 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.433 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.433 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.434 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.434 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.434 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.434 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.434 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.434 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.434 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.434 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.434 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.434 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.434 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.434 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.434 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.435 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.435 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.435 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.435 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.435 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.435 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.435 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.435 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.435 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.435 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.435 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.435 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.435 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.435 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.436 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.436 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.436 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.436 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.436 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.436 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.436 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.436 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.436 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.436 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.436 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.436 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.436 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.436 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.437 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.437 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.437 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.437 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.438 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.438 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.438 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.438 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.438 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.438 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.438 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.439 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.439 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.439 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.439 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.439 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.439 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.439 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.439 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.439 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.439 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.439 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.439 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.439 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.440 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.440 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.440 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.440 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.440 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.440 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.440 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.440 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.440 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.440 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.440 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.440 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.440 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.440 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.441 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.441 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.441 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.441 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.441 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.441 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.441 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.441 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.441 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.441 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.441 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.441 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.441 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.441 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.442 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.442 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.442 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.442 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.442 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.442 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.442 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.442 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.442 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.442 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.442 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.442 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.442 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.442 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.443 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.443 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.443 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.443 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.443 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.443 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.443 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.443 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.443 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.443 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.443 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.443 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.443 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.444 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.444 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.444 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.444 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.444 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.444 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.444 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.444 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.444 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.444 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.444 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.444 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.444 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.444 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.445 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.445 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.445 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.445 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.445 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.445 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.445 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.445 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.445 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.445 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.445 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.445 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.445 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.445 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.445 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.446 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.446 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.446 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.446 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.446 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.446 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.446 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.446 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.446 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.446 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.446 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.446 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.446 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.447 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.447 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.447 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.447 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.447 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.447 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.447 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.447 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.447 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.447 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.447 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.447 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.447 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.447 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.447 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.448 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.448 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.448 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.448 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.448 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.448 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.448 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.448 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.448 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.448 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.448 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.448 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.448 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.449 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.449 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.449 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.449 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.449 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.449 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.449 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.449 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.449 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.449 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.449 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.449 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.449 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.449 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.450 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.450 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.450 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.450 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.450 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.450 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.450 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.450 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.450 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.450 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.450 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.450 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.450 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.450 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.451 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.451 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.451 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.451 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.451 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.451 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.451 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.451 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.451 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.451 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.451 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.451 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.451 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.451 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.452 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.452 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.452 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.452 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.452 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.452 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.452 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.452 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.452 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.452 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.452 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.452 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.452 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.452 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.453 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.453 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.453 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.453 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.453 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.453 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.453 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.453 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.453 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.453 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.453 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.453 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.453 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.453 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.454 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.454 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.454 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.454 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.454 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.454 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.454 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.454 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.454 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.454 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.454 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.454 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:03 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:03.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.786 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.787 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.787 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.787 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.787 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.787 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.787 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.787 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.787 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.787 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.787 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.787 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.787 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.787 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.787 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.788 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.788 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.788 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.788 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.788 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.788 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.788 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.788 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.788 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.788 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.805 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.805 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.805 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.805 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.805 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.805 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.805 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.805 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.805 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.805 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.805 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.805 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.805 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.805 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.806 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.806 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.806 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.806 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.806 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.806 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.806 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.806 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.806 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.806 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.806 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.806 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.806 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.807 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.807 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.807 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.807 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.807 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.807 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.807 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.807 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.807 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.807 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.807 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.807 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.807 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.807 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.808 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.808 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.808 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.808 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.808 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.808 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.808 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.808 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.808 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.808 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.808 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.808 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.808 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.808 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.809 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.809 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.809 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.809 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.809 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.809 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.809 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.809 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.809 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.809 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.809 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.809 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.809 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.810 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.810 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.810 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.810 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.810 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.810 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.810 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.810 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.810 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.810 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.810 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.810 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.810 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.810 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.810 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.811 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.811 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.811 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.811 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.811 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.811 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.811 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.811 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.811 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.811 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.811 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.811 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.811 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.811 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.812 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.812 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.812 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.812 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.812 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.812 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.812 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.812 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.812 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.812 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.812 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.812 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.812 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.812 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.813 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.813 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.813 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.813 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.813 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.813 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.813 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.813 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.813 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.813 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.813 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.813 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.813 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.814 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.814 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.814 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.814 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.814 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.814 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.814 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.814 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.814 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.814 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.814 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.814 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.814 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.814 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.815 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.815 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.815 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.815 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.815 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.815 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.815 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.815 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.815 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.815 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.815 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.815 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.815 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.815 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.816 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.816 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.816 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.816 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.816 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.816 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.816 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.816 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.816 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.816 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.816 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.816 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.816 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.816 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.817 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.817 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.817 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.817 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.817 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.817 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.817 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.817 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.817 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.817 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.817 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.817 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.817 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.818 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.818 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.818 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.818 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.818 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.818 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.818 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.818 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.818 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.818 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.818 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.818 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.818 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.819 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.819 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.819 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.819 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.819 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.819 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.819 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.819 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.819 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.819 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.819 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.819 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.819 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.819 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.819 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.820 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.820 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.820 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.820 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.820 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.820 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.820 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.820 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.820 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.820 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.820 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.820 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.820 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.823 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.823 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.823 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.823 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.823 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.823 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.823 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.823 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.823 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.823 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.823 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.823 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.823 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.823 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.824 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.824 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.824 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.824 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.824 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.824 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.824 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.824 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.824 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.824 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.824 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.824 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.824 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.824 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.825 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.825 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.825 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.825 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.825 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.825 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.825 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.825 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.825 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.825 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.825 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.825 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.825 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.825 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.826 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.826 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.826 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.826 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.826 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.826 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.826 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.826 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.826 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.826 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.826 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.826 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.826 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.826 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.827 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.827 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.827 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.827 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.827 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.827 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.827 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.827 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.827 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.827 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.827 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.827 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.827 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.827 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.828 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.828 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.828 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.828 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.828 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.828 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.828 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.828 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.828 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.828 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.828 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.828 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.828 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.828 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.829 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.829 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.829 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.829 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.829 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.829 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.829 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.829 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.829 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.829 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.829 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.829 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.829 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.829 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.830 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.830 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.830 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.830 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.830 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.830 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.830 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.830 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.830 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.830 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.830 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.830 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.830 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.830 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.831 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.831 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.831 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.831 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.831 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.831 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.831 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.831 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.831 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.831 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.831 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.831 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.831 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.831 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.832 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.832 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.832 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.832 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.832 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.832 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.832 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.832 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.832 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.832 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.832 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.832 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.832 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.832 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.832 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:03 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:03.834 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.834 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.834 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.834 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.835 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.837 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.837 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.837 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.837 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.837 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.837 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.837 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.837 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.837 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.837 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.837 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.837 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.837 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.838 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.838 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.838 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.838 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.838 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.838 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.838 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.838 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.838 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.838 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.838 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.838 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.838 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.839 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.839 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.839 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.839 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.839 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.839 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.839 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.839 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.839 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.839 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.839 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.839 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.839 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.840 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.840 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.840 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.840 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.840 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.840 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.840 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.840 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.840 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.840 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.840 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.840 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.840 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.840 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.841 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.841 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.841 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.841 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.841 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.841 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.841 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.841 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.841 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.841 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.841 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.841 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.841 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.841 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.841 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.842 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.842 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.842 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.842 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.842 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.842 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.842 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.842 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.842 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.842 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.842 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.842 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.842 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.843 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.843 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.843 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.843 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.843 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.843 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.843 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.843 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.843 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.843 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.843 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.843 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.843 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.843 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.844 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.844 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.844 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.844 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.844 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.844 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.844 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.844 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.844 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.844 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.844 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.844 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.844 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.844 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.845 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.845 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.845 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.845 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.845 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.845 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.845 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.845 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.845 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.845 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.845 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.845 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.845 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.845 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.846 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.846 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.846 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.846 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.846 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.846 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.846 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.846 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.846 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.846 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.846 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.846 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.846 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.846 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.847 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.847 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.847 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.847 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.847 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.847 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.847 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.847 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.847 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.847 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.847 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.847 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.847 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.847 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.847 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.848 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.848 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.848 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.848 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.848 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.848 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.848 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.848 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.848 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.848 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.848 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.848 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.848 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.848 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.851 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.851 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.851 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.851 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.851 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.851 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.851 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.851 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.851 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.851 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.851 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.851 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.851 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.851 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.852 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.852 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.852 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.852 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.852 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.852 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.852 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.852 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.852 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.852 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.852 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.852 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.852 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.852 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.852 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.853 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.853 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.853 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.853 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.853 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.853 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.853 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.853 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.853 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.853 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.853 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.853 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.853 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.854 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.854 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.854 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.854 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.854 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.854 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.854 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.854 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.854 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.854 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.854 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.854 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.854 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.854 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.855 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.855 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.855 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.855 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.855 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.855 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.855 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.855 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.855 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.855 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.855 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.855 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.855 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.855 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.856 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.856 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.856 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.856 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.856 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.856 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.856 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.856 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.856 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.856 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.856 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.856 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.856 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.856 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.857 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.857 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.857 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.857 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.857 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.857 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.857 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.857 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.857 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.857 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.857 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.858 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.858 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.858 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.858 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.858 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.858 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.858 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.858 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.858 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.858 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.858 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.858 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.858 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.859 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.859 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.859 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.859 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.859 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.859 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.859 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.859 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.859 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.859 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.859 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.859 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.859 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.859 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.860 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.860 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.860 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.860 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.860 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.860 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.860 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.860 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.860 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.860 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.860 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.860 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.860 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.861 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.861 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.861 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.861 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.861 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.861 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.861 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.861 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.861 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.861 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.861 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.861 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.861 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.861 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.862 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.862 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.862 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.862 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.862 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.862 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.862 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.862 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.862 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.862 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.862 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.862 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.862 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.863 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.863 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.863 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.863 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.863 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.863 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.863 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.863 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.863 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.863 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.863 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.863 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.863 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.863 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.864 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.864 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.864 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.864 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.864 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.864 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.864 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.864 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.864 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.864 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.864 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.864 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.864 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.864 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.864 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.865 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.865 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.865 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.865 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.865 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.865 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.865 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.865 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.865 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.865 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.865 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.865 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.865 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.865 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.866 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.866 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.866 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.866 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.866 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.866 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.866 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.866 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.866 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.866 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.866 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.866 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.866 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.867 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.867 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.867 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.867 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.867 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.867 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.867 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.867 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.867 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.867 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.867 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.867 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.867 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.867 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.868 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.868 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.868 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.868 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.868 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.868 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.868 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.868 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.868 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.868 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.868 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.868 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.868 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.868 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.869 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.870 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.870 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.870 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.870 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.870 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.870 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.870 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.870 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.870 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.870 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.870 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.870 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.870 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.870 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.871 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.871 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.871 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.871 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.871 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.871 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.871 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.871 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.871 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.871 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.871 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.871 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.871 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.872 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.872 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.872 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.872 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.872 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.872 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.872 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.872 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.872 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.872 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.872 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.872 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.872 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.872 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.873 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.873 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.873 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.873 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.873 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.873 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.873 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.873 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.873 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.873 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.873 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.873 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.873 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.873 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:03.873 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:03.874 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:03 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:04.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:04 smithi043 ceph-mon[22091]: pgmap v595: 97 pgs: 97 active+clean; 2.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.2 MiB/s wr, 1.88k op/s 2024-08-26T00:11:04.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:04 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:04.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:04 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:04.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:04 smithi042 ceph-mon[17225]: pgmap v595: 97 pgs: 97 active+clean; 2.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.2 MiB/s wr, 1.88k op/s 2024-08-26T00:11:04.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:04 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:04.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:04 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:04.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:04 smithi181 ceph-mon[22102]: pgmap v595: 97 pgs: 97 active+clean; 2.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.2 MiB/s wr, 1.88k op/s 2024-08-26T00:11:04.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:04 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:04.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:04 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:06.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:06 smithi043 ceph-mon[22091]: pgmap v596: 97 pgs: 97 active+clean; 2.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 1.72k op/s 2024-08-26T00:11:06.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:06 smithi042 ceph-mon[17225]: pgmap v596: 97 pgs: 97 active+clean; 2.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 1.72k op/s 2024-08-26T00:11:06.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:06 smithi181 ceph-mon[22102]: pgmap v596: 97 pgs: 97 active+clean; 2.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 1.72k op/s 2024-08-26T00:11:08.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:08 smithi043 ceph-mon[22091]: pgmap v597: 97 pgs: 97 active+clean; 2.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.1 MiB/s wr, 1.71k op/s 2024-08-26T00:11:08.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:08 smithi042 ceph-mon[17225]: pgmap v597: 97 pgs: 97 active+clean; 2.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.1 MiB/s wr, 1.71k op/s 2024-08-26T00:11:08.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:08 smithi181 ceph-mon[22102]: pgmap v597: 97 pgs: 97 active+clean; 2.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.1 MiB/s wr, 1.71k op/s 2024-08-26T00:11:10.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:10 smithi043 ceph-mon[22091]: pgmap v598: 97 pgs: 97 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.1 MiB/s wr, 1.43k op/s 2024-08-26T00:11:10.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:10 smithi042 ceph-mon[17225]: pgmap v598: 97 pgs: 97 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.1 MiB/s wr, 1.43k op/s 2024-08-26T00:11:10.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:10 smithi181 ceph-mon[22102]: pgmap v598: 97 pgs: 97 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.1 MiB/s wr, 1.43k op/s 2024-08-26T00:11:12.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:12 smithi043 ceph-mon[22091]: pgmap v599: 97 pgs: 97 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 790 op/s 2024-08-26T00:11:12.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:12 smithi042 ceph-mon[17225]: pgmap v599: 97 pgs: 97 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 790 op/s 2024-08-26T00:11:12.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:12 smithi181 ceph-mon[22102]: pgmap v599: 97 pgs: 97 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 790 op/s 2024-08-26T00:11:14.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:14 smithi043 ceph-mon[22091]: pgmap v600: 97 pgs: 97 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 799 op/s 2024-08-26T00:11:14.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:14 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:11:14.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:14 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:11:14.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:14 smithi042 ceph-mon[17225]: pgmap v600: 97 pgs: 97 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 799 op/s 2024-08-26T00:11:14.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:14 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:11:14.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:14 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:11:14.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:14 smithi181 ceph-mon[22102]: pgmap v600: 97 pgs: 97 active+clean; 2.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 799 op/s 2024-08-26T00:11:14.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:14 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:11:14.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:14 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:11:15.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:15 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:11:15.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:15 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:11:15.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:15 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:11:16.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:16 smithi043 ceph-mon[22091]: pgmap v601: 97 pgs: 97 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 702 op/s 2024-08-26T00:11:16.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:16 smithi042 ceph-mon[17225]: pgmap v601: 97 pgs: 97 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 702 op/s 2024-08-26T00:11:16.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:16 smithi181 ceph-mon[22102]: pgmap v601: 97 pgs: 97 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 702 op/s 2024-08-26T00:11:18.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:18 smithi043 ceph-mon[22091]: pgmap v602: 97 pgs: 97 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 696 op/s 2024-08-26T00:11:18.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:18 smithi042 ceph-mon[17225]: pgmap v602: 97 pgs: 97 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 696 op/s 2024-08-26T00:11:18.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:18 smithi181 ceph-mon[22102]: pgmap v602: 97 pgs: 97 active+clean; 2.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 696 op/s 2024-08-26T00:11:20.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:20 smithi043 ceph-mon[22091]: pgmap v603: 97 pgs: 97 active+clean; 2.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 666 op/s 2024-08-26T00:11:20.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:20 smithi042 ceph-mon[17225]: pgmap v603: 97 pgs: 97 active+clean; 2.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 666 op/s 2024-08-26T00:11:20.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:20 smithi181 ceph-mon[22102]: pgmap v603: 97 pgs: 97 active+clean; 2.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 666 op/s 2024-08-26T00:11:22.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:22 smithi043 ceph-mon[22091]: pgmap v604: 97 pgs: 97 active+clean; 2.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 523 op/s 2024-08-26T00:11:22.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:22 smithi042 ceph-mon[17225]: pgmap v604: 97 pgs: 97 active+clean; 2.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 523 op/s 2024-08-26T00:11:22.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:22 smithi181 ceph-mon[22102]: pgmap v604: 97 pgs: 97 active+clean; 2.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 523 op/s 2024-08-26T00:11:24.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:24 smithi043 ceph-mon[22091]: pgmap v605: 97 pgs: 97 active+clean; 2.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 561 op/s 2024-08-26T00:11:24.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:24 smithi042 ceph-mon[17225]: pgmap v605: 97 pgs: 97 active+clean; 2.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 561 op/s 2024-08-26T00:11:24.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:24 smithi181 ceph-mon[22102]: pgmap v605: 97 pgs: 97 active+clean; 2.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 561 op/s 2024-08-26T00:11:24.891 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-26T00:11:25.341 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:11:26.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.060+0000 7fcaa3200640 1 -- 172.21.15.42:0/3340005825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcaa4106670 msgr2=0x7fcaa4106a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:26.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.060+0000 7fcaa3200640 1 --2- 172.21.15.42:0/3340005825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcaa4106670 0x7fcaa4106a50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fca94009930 tx=0x7fca9402a440 comp rx=0 tx=0).stop 2024-08-26T00:11:26.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.060+0000 7fcaa3200640 1 -- 172.21.15.42:0/3340005825 shutdown_connections 2024-08-26T00:11:26.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.060+0000 7fcaa3200640 1 --2- 172.21.15.42:0/3340005825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcaa4101010 0x7fcaa410d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.060+0000 7fcaa3200640 1 --2- 172.21.15.42:0/3340005825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcaa4100670 0x7fcaa4100ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.060+0000 7fcaa3200640 1 --2- 172.21.15.42:0/3340005825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcaa4106670 0x7fcaa4106a50 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.060+0000 7fcaa3200640 1 -- 172.21.15.42:0/3340005825 >> 172.21.15.42:0/3340005825 conn(0x7fcaa40fc3b0 msgr2=0x7fcaa40fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:26.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.060+0000 7fcaa3200640 1 -- 172.21.15.42:0/3340005825 shutdown_connections 2024-08-26T00:11:26.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.060+0000 7fcaa3200640 1 -- 172.21.15.42:0/3340005825 wait complete. 2024-08-26T00:11:26.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.061+0000 7fcaa3200640 1 Processor -- start 2024-08-26T00:11:26.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.061+0000 7fcaa3200640 1 -- start start 2024-08-26T00:11:26.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.061+0000 7fcaa3200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcaa4100670 0x7fcaa419a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:26.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.061+0000 7fcaa3200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcaa4101010 0x7fcaa419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:26.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.061+0000 7fcaa3200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcaa4106670 0x7fcaa419eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:26.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.061+0000 7fcaa3200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa4111bd0 con 0x7fcaa4101010 2024-08-26T00:11:26.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.061+0000 7fcaa3200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa4111a50 con 0x7fcaa4100670 2024-08-26T00:11:26.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.061+0000 7fcaa3200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa4111d50 con 0x7fcaa4106670 2024-08-26T00:11:26.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.061+0000 7fcaa2800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcaa4106670 0x7fcaa419eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:26.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.061+0000 7fcaa1e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcaa4100670 0x7fcaa419a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:26.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.062+0000 7fcaa2800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcaa4106670 0x7fcaa419eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:42938/0 (socket says 172.21.15.42:42938) 2024-08-26T00:11:26.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.062+0000 7fcaa2800640 1 -- 172.21.15.42:0/1345909002 learned_addr learned my addr 172.21.15.42:0/1345909002 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:26.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.062+0000 7fcaa1400640 1 --2- 172.21.15.42:0/1345909002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcaa4101010 0x7fcaa419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:26.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.062+0000 7fcaa2800640 1 -- 172.21.15.42:0/1345909002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcaa4100670 msgr2=0x7fcaa419a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:26.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.062+0000 7fcaa2800640 1 --2- 172.21.15.42:0/1345909002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcaa4100670 0x7fcaa419a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.062+0000 7fcaa2800640 1 -- 172.21.15.42:0/1345909002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcaa4101010 msgr2=0x7fcaa419a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:26.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.062+0000 7fcaa2800640 1 --2- 172.21.15.42:0/1345909002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcaa4101010 0x7fcaa419a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.062+0000 7fcaa2800640 1 -- 172.21.15.42:0/1345909002 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa419f200 con 0x7fcaa4106670 2024-08-26T00:11:26.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.062+0000 7fcaa1e00640 1 --2- 172.21.15.42:0/1345909002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcaa4100670 0x7fcaa419a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:11:26.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.062+0000 7fcaa2800640 1 --2- 172.21.15.42:0/1345909002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcaa4106670 0x7fcaa419eb20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00eb10 tx=0x7fca9c00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:26.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.062+0000 7fca9aa00640 1 -- 172.21.15.42:0/1345909002 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c004b20 con 0x7fcaa4106670 2024-08-26T00:11:26.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.063+0000 7fcaa3200640 1 -- 172.21.15.42:0/1345909002 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa419f4f0 con 0x7fcaa4106670 2024-08-26T00:11:26.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.063+0000 7fca9aa00640 1 -- 172.21.15.42:0/1345909002 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca9c004cc0 con 0x7fcaa4106670 2024-08-26T00:11:26.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.063+0000 7fca9aa00640 1 -- 172.21.15.42:0/1345909002 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c010760 con 0x7fcaa4106670 2024-08-26T00:11:26.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.063+0000 7fcaa3200640 1 -- 172.21.15.42:0/1345909002 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa41a6dd0 con 0x7fcaa4106670 2024-08-26T00:11:26.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.066+0000 7fcaab5d4740 1 Processor -- start 2024-08-26T00:11:26.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.066+0000 7fca9aa00640 1 -- 172.21.15.42:0/1345909002 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fca9c005020 con 0x7fcaa4106670 2024-08-26T00:11:26.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.066+0000 7fcaab5d4740 1 -- start start 2024-08-26T00:11:26.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.066+0000 7fcaab5d4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ce2a31bb40 0x55ce2a31bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:26.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.067+0000 7fcaab5d4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31c460 0x55ce2a3267e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:26.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.067+0000 7fcaab5d4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ce2a326d20 0x55ce2a329110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:26.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.067+0000 7fcaab5d4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ce2a281fc0 con 0x55ce2a326d20 2024-08-26T00:11:26.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.067+0000 7fcaab5d4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ce2a219680 con 0x55ce2a31bb40 2024-08-26T00:11:26.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.067+0000 7fcaab5d4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ce2a27df80 con 0x55ce2a31c460 2024-08-26T00:11:26.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.067+0000 7fcaa1e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31c460 0x55ce2a3267e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:26.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.067+0000 7fcaa1e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31c460 0x55ce2a3267e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:42942/0 (socket says 172.21.15.42:42942) 2024-08-26T00:11:26.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.067+0000 7fcaa1e00640 1 -- 172.21.15.42:0/1796243007 learned_addr learned my addr 172.21.15.42:0/1796243007 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:26.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.067+0000 7fcaa1400640 1 --2- 172.21.15.42:0/1796243007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ce2a31bb40 0x55ce2a31bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:26.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.067+0000 7fcaa1400640 1 --2- 172.21.15.42:0/1796243007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ce2a326d20 0x55ce2a329110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:26.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.067+0000 7fcaa1e00640 1 -- 172.21.15.42:0/1796243007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ce2a31bb40 msgr2=0x55ce2a31bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:26.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.067+0000 7fcaa1e00640 1 --2- 172.21.15.42:0/1796243007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ce2a31bb40 0x55ce2a31bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.067+0000 7fcaa1e00640 1 -- 172.21.15.42:0/1796243007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ce2a326d20 msgr2=0x55ce2a329110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:26.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.067+0000 7fcaa1e00640 1 --2- 172.21.15.42:0/1796243007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ce2a326d20 0x55ce2a329110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.067+0000 7fcaa1e00640 1 -- 172.21.15.42:0/1796243007 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce2a2352c0 con 0x55ce2a31c460 2024-08-26T00:11:26.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.067+0000 7fcaa1400640 1 --2- 172.21.15.42:0/1796243007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ce2a326d20 0x55ce2a329110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:11:26.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.068+0000 7fcaa1e00640 1 --2- 172.21.15.42:0/1796243007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31c460 0x55ce2a3267e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fca94009930 tx=0x7fca94000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8db63986361e8fa3 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:26.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.068+0000 7fca9aa00640 1 --2- 172.21.15.42:0/1345909002 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fca880a2b80 0x7fca880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:26.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.068+0000 7fca8f000640 1 -- 172.21.15.42:0/1796243007 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca94035040 con 0x55ce2a31c460 2024-08-26T00:11:26.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.068+0000 7fca8f000640 1 -- 172.21.15.42:0/1796243007 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca94004760 con 0x55ce2a31c460 2024-08-26T00:11:26.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.068+0000 7fca9aa00640 1 -- 172.21.15.42:0/1345909002 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fca9c0cf570 con 0x7fcaa4106670 2024-08-26T00:11:26.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.068+0000 7fcaa1400640 1 --2- 172.21.15.42:0/1345909002 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fca880a2b80 0x7fca880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:26.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.069+0000 7fca8f000640 1 -- 172.21.15.42:0/1796243007 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca94003950 con 0x55ce2a31c460 2024-08-26T00:11:26.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.069+0000 7fcaab5d4740 1 -- 172.21.15.42:0/1796243007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31c460 msgr2=0x55ce2a3267e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:26.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.069+0000 7fcaab5d4740 1 --2- 172.21.15.42:0/1796243007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31c460 0x55ce2a3267e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fca94009930 tx=0x7fca94000bc0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.069+0000 7fcaab5d4740 1 -- 172.21.15.42:0/1796243007 shutdown_connections 2024-08-26T00:11:26.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.069+0000 7fcaab5d4740 1 --2- 172.21.15.42:0/1796243007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ce2a326d20 0x55ce2a329110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.069+0000 7fcaab5d4740 1 --2- 172.21.15.42:0/1796243007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31c460 0x55ce2a3267e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.069+0000 7fcaab5d4740 1 --2- 172.21.15.42:0/1796243007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ce2a31bb40 0x55ce2a31bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.069+0000 7fcaab5d4740 1 -- 172.21.15.42:0/1796243007 >> 172.21.15.42:0/1796243007 conn(0x55ce2a318080 msgr2=0x55ce2a318460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:26.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.069+0000 7fcaa1400640 1 --2- 172.21.15.42:0/1345909002 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fca880a2b80 0x7fca880a5040 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55ce2a319450 tx=0x7fca90005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:26.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.069+0000 7fcaab5d4740 1 -- 172.21.15.42:0/1796243007 shutdown_connections 2024-08-26T00:11:26.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.069+0000 7fcaab5d4740 1 -- 172.21.15.42:0/1796243007 wait complete. 2024-08-26T00:11:26.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.069+0000 7fcaab5d4740 1 -- start start 2024-08-26T00:11:26.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.070+0000 7fcaab5d4740 1 Processor -- start 2024-08-26T00:11:26.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.070+0000 7fcaab5d4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31bb40 0x55ce2a323ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:26.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.070+0000 7fcaab5d4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ce2a31c460 0x55ce2a323ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:26.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.070+0000 7fcaab5d4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ce2a326d20 0x55ce2a324530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:26.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.070+0000 7fcaab5d4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ce2a329940 con 0x55ce2a31c460 2024-08-26T00:11:26.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.070+0000 7fcaab5d4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ce2a23ce50 con 0x55ce2a326d20 2024-08-26T00:11:26.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.070+0000 7fcaab5d4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ce2a329ac0 con 0x55ce2a31bb40 2024-08-26T00:11:26.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.070+0000 7fcaab5d4740 10 client.0 _ll_register_callbacks cb 0x55ce2a227f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:11:26.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.070+0000 7fcaa1e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31bb40 0x55ce2a323ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:26.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.071+0000 7fcaa2800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ce2a326d20 0x55ce2a324530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:26.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.071+0000 7fcaa1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ce2a31c460 0x55ce2a323ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:26.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.071+0000 7fcaa1e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31bb40 0x55ce2a323ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:42956/0 (socket says 172.21.15.42:42956) 2024-08-26T00:11:26.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.071+0000 7fcaa1e00640 1 -- 172.21.15.42:0/3148932191 learned_addr learned my addr 172.21.15.42:0/3148932191 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:26.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.071+0000 7fcaa1e00640 1 -- 172.21.15.42:0/3148932191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ce2a326d20 msgr2=0x55ce2a324530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:26.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.071+0000 7fcaa1e00640 1 --2- 172.21.15.42:0/3148932191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ce2a326d20 0x55ce2a324530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.071+0000 7fcaa1e00640 1 -- 172.21.15.42:0/3148932191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ce2a31c460 msgr2=0x55ce2a323ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:26.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.071+0000 7fcaa1e00640 1 --2- 172.21.15.42:0/3148932191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ce2a31c460 0x55ce2a323ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.071+0000 7fcaa1e00640 1 -- 172.21.15.42:0/3148932191 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce29ff33c0 con 0x55ce2a31bb40 2024-08-26T00:11:26.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.071+0000 7fcaa2800640 1 --2- 172.21.15.42:0/3148932191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ce2a326d20 0x55ce2a324530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:11:26.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.071+0000 7fcaa1400640 1 --2- 172.21.15.42:0/3148932191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ce2a31c460 0x55ce2a323ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:11:26.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.071+0000 7fcaa1e00640 1 --2- 172.21.15.42:0/3148932191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31bb40 0x55ce2a323ab0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fca94004f00 tx=0x7fca94004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c066da8c3f93a31 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:26.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.071+0000 7fca83400640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:11:26.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.072+0000 7fca83400640 1 -- 172.21.15.42:0/3148932191 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca94052060 con 0x55ce2a31bb40 2024-08-26T00:11:26.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.072+0000 7fca83400640 1 -- 172.21.15.42:0/3148932191 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fca94005210 con 0x55ce2a31bb40 2024-08-26T00:11:26.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.072+0000 7fcaab5d4740 1 -- 172.21.15.42:0/3148932191 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca94004760 con 0x55ce2a31bb40 2024-08-26T00:11:26.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.072+0000 7fca83400640 1 -- 172.21.15.42:0/3148932191 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fca94035070 con 0x55ce2a31bb40 2024-08-26T00:11:26.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.072+0000 7fcaab5d4740 10 client.25933 fetch_fsmap learned FSMap version 31 2024-08-26T00:11:26.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.072+0000 7fcaab5d4740 1 -- 172.21.15.42:0/3148932191 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ce2a329940 con 0x55ce2a31bb40 2024-08-26T00:11:26.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.072+0000 7fca83400640 1 -- 172.21.15.42:0/3148932191 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca94004760 con 0x55ce2a31bb40 2024-08-26T00:11:26.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.072+0000 7fca83400640 1 -- 172.21.15.42:0/3148932191 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fca94057070 con 0x55ce2a31bb40 2024-08-26T00:11:26.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.072+0000 7fcaab5d4740 10 client.25933 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:11:26.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.072+0000 7fcaab5d4740 10 client.25933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:11:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.073+0000 7fcaab5d4740 20 client.25933 populate_metadata read hostname 'smithi042' 2024-08-26T00:11:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.073+0000 7fcaab5d4740 1 --2- 172.21.15.42:0/3148932191 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55ce2a336600 0x55ce2a3389f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.073+0000 7fcaab5d4740 4 client.25933 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:11:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.073+0000 7fcaab5d4740 1 -- 172.21.15.42:0/3148932191 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce2a28f530 con 0x55ce2a336600 2024-08-26T00:11:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.073+0000 7fcaa1400640 1 --2- 172.21.15.42:0/3148932191 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55ce2a336600 0x55ce2a3389f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.074+0000 7fcaa1400640 1 --2- 172.21.15.42:0/3148932191 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55ce2a336600 0x55ce2a3389f0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc1b41fc12a8bac1 server_cookie=b1a0b84116c1492e in_seq=0 out_seq=0 2024-08-26T00:11:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.074+0000 7fca83400640 10 client.25933 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:11:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.074+0000 7fca83400640 1 -- 172.21.15.42:0/3148932191 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ce2a28f530 con 0x55ce2a336600 2024-08-26T00:11:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.074+0000 7fca83400640 10 client.25933 handle_command_reply: tid=0 2024-08-26T00:11:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.074+0000 7fcaab5d4740 1 client.25933 shutdown 2024-08-26T00:11:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.075+0000 7fcaab5d4740 1 -- 172.21.15.42:0/3148932191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31bb40 msgr2=0x55ce2a323ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.075+0000 7fcaab5d4740 1 --2- 172.21.15.42:0/3148932191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31bb40 0x55ce2a323ab0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fca94004f00 tx=0x7fca94004b40 comp rx=0 tx=0).stop 2024-08-26T00:11:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.075+0000 7fcaab5d4740 1 -- 172.21.15.42:0/3148932191 shutdown_connections 2024-08-26T00:11:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.075+0000 7fcaab5d4740 1 --2- 172.21.15.42:0/3148932191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ce2a326d20 0x55ce2a324530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.075+0000 7fcaab5d4740 1 --2- 172.21.15.42:0/3148932191 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55ce2a336600 0x55ce2a3389f0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.075+0000 7fcaab5d4740 1 --2- 172.21.15.42:0/3148932191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ce2a31c460 0x55ce2a323ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.075+0000 7fcaab5d4740 1 --2- 172.21.15.42:0/3148932191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31bb40 0x55ce2a323ab0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.075+0000 7fcaab5d4740 1 -- 172.21.15.42:0/3148932191 >> 172.21.15.42:0/3148932191 conn(0x55ce2a318080 msgr2=0x55ce2a31ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:26.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.075+0000 7fca83400640 0 client.25933 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:11:26.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.075+0000 7fcaab5d4740 1 -- 172.21.15.42:0/3148932191 shutdown_connections 2024-08-26T00:11:26.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.075+0000 7fcaab5d4740 1 -- 172.21.15.42:0/3148932191 wait complete. 2024-08-26T00:11:26.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.075+0000 7fcaab5d4740 20 client.25933 trim_cache size 0 max 16384 2024-08-26T00:11:26.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.098+0000 7fcaab5d4740 1 Processor -- start 2024-08-26T00:11:26.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.098+0000 7fcaab5d4740 1 -- start start 2024-08-26T00:11:26.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.098+0000 7fcaab5d4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31bb40 0x55ce2a33e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:26.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.099+0000 7fcaab5d4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ce2a31c460 0x55ce2a33e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:26.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.099+0000 7fcaab5d4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ce2a326d20 0x55ce2a320d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:26.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.099+0000 7fcaab5d4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa41b1d40 con 0x55ce2a326d20 2024-08-26T00:11:26.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.099+0000 7fcaab5d4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa41af550 con 0x55ce2a31c460 2024-08-26T00:11:26.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.099+0000 7fcaab5d4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa41ad380 con 0x55ce2a31bb40 2024-08-26T00:11:26.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.099+0000 7fcaa1e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31bb40 0x55ce2a33e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:26.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.099+0000 7fcaa1e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31bb40 0x55ce2a33e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:42968/0 (socket says 172.21.15.42:42968) 2024-08-26T00:11:26.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.099+0000 7fcaa2800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ce2a326d20 0x55ce2a320d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:26.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.099+0000 7fcaa1e00640 1 -- 172.21.15.42:0/2565842865 learned_addr learned my addr 172.21.15.42:0/2565842865 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:26.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.099+0000 7fcaa1400640 1 --2- 172.21.15.42:0/2565842865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ce2a31c460 0x55ce2a33e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:26.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.099+0000 7fcaa1400640 1 -- 172.21.15.42:0/2565842865 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31bb40 msgr2=0x55ce2a33e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:26.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.099+0000 7fcaa1400640 1 --2- 172.21.15.42:0/2565842865 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31bb40 0x55ce2a33e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.099+0000 7fcaa1400640 1 -- 172.21.15.42:0/2565842865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ce2a326d20 msgr2=0x55ce2a320d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:26.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.099+0000 7fcaa1400640 1 --2- 172.21.15.42:0/2565842865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ce2a326d20 0x55ce2a320d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.099+0000 7fcaa1400640 1 -- 172.21.15.42:0/2565842865 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce2a317eb0 con 0x55ce2a31c460 2024-08-26T00:11:26.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.099+0000 7fcaa1e00640 1 --2- 172.21.15.42:0/2565842865 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31bb40 0x55ce2a33e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:11:26.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.100+0000 7fcaa1400640 1 --2- 172.21.15.42:0/2565842865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ce2a31c460 0x55ce2a33e720 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55ce2a325060 tx=0x7fca90018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa2135424bde3f6e server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:26.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.100+0000 7fca8e600640 1 -- 172.21.15.42:0/2565842865 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9000f810 con 0x55ce2a31c460 2024-08-26T00:11:26.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.100+0000 7fca8e600640 1 -- 172.21.15.42:0/2565842865 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca9000fe90 con 0x55ce2a31c460 2024-08-26T00:11:26.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.100+0000 7fca8e600640 1 -- 172.21.15.42:0/2565842865 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9002a380 con 0x55ce2a31c460 2024-08-26T00:11:26.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.101+0000 7fcaab5d4740 1 -- 172.21.15.42:0/2565842865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ce2a31c460 msgr2=0x55ce2a33e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:26.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.101+0000 7fcaab5d4740 1 --2- 172.21.15.42:0/2565842865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ce2a31c460 0x55ce2a33e720 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55ce2a325060 tx=0x7fca90018000 comp rx=0 tx=0).stop 2024-08-26T00:11:26.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.101+0000 7fcaab5d4740 1 -- 172.21.15.42:0/2565842865 shutdown_connections 2024-08-26T00:11:26.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.101+0000 7fcaab5d4740 1 --2- 172.21.15.42:0/2565842865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ce2a326d20 0x55ce2a320d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.101+0000 7fcaab5d4740 1 --2- 172.21.15.42:0/2565842865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ce2a31c460 0x55ce2a33e720 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.101+0000 7fcaab5d4740 1 --2- 172.21.15.42:0/2565842865 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31bb40 0x55ce2a33e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.101+0000 7fcaab5d4740 1 -- 172.21.15.42:0/2565842865 >> 172.21.15.42:0/2565842865 conn(0x55ce2a318080 msgr2=0x55ce2a325b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:26.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.101+0000 7fcaab5d4740 1 -- 172.21.15.42:0/2565842865 shutdown_connections 2024-08-26T00:11:26.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.101+0000 7fcaab5d4740 1 -- 172.21.15.42:0/2565842865 wait complete. 2024-08-26T00:11:26.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.101+0000 7fcaab5d4740 1 -- start start 2024-08-26T00:11:26.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.101+0000 7fcaab5d4740 1 Processor -- start 2024-08-26T00:11:26.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.102+0000 7fcaab5d4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ce2a31bb40 0x55ce2a32f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:26.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.102+0000 7fcaab5d4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31c460 0x55ce2a3208b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:26.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.102+0000 7fcaab5d4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ce2a326d20 0x55ce2a320ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:26.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.102+0000 7fcaab5d4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa41ada10 con 0x55ce2a326d20 2024-08-26T00:11:26.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.102+0000 7fcaab5d4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa41aee80 con 0x55ce2a31bb40 2024-08-26T00:11:26.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.102+0000 7fcaab5d4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa41ae0e0 con 0x55ce2a31c460 2024-08-26T00:11:26.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.102+0000 7fcaab5d4740 10 client.0 _ll_register_callbacks cb 0x7fca94009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:11:26.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.102+0000 7fcaa1400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31c460 0x55ce2a3208b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:26.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.102+0000 7fcaa2800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ce2a326d20 0x55ce2a320ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:26.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.102+0000 7fcaa1400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31c460 0x55ce2a3208b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:42974/0 (socket says 172.21.15.42:42974) 2024-08-26T00:11:26.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.102+0000 7fcaa1400640 1 -- 172.21.15.42:0/2478408577 learned_addr learned my addr 172.21.15.42:0/2478408577 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:26.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.102+0000 7fcaa1e00640 1 --2- 172.21.15.42:0/2478408577 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ce2a31bb40 0x55ce2a32f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:26.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.102+0000 7fcaa1400640 1 -- 172.21.15.42:0/2478408577 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ce2a31bb40 msgr2=0x55ce2a32f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:26.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.102+0000 7fcaa1400640 1 --2- 172.21.15.42:0/2478408577 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ce2a31bb40 0x55ce2a32f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.103+0000 7fcaa1400640 1 -- 172.21.15.42:0/2478408577 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ce2a326d20 msgr2=0x55ce2a320ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:26.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.103+0000 7fcaa1400640 1 --2- 172.21.15.42:0/2478408577 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ce2a326d20 0x55ce2a320ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.103+0000 7fcaa1400640 1 -- 172.21.15.42:0/2478408577 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce2a32d0d0 con 0x55ce2a31c460 2024-08-26T00:11:26.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.103+0000 7fcaa1e00640 1 --2- 172.21.15.42:0/2478408577 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ce2a31bb40 0x55ce2a32f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:11:26.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.103+0000 7fcaa1400640 1 --2- 172.21.15.42:0/2478408577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31c460 0x55ce2a3208b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55ce2a325060 tx=0x7fca9001eaa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87c598f9dc683b6e server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:26.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.103+0000 7fca83400640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:11:26.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.103+0000 7fca83400640 1 -- 172.21.15.42:0/2478408577 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9000fce0 con 0x55ce2a31c460 2024-08-26T00:11:26.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.103+0000 7fcaab5d4740 1 -- 172.21.15.42:0/2478408577 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca9000fe90 con 0x55ce2a31c460 2024-08-26T00:11:26.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.103+0000 7fca83400640 1 -- 172.21.15.42:0/2478408577 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fca90005040 con 0x55ce2a31c460 2024-08-26T00:11:26.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.103+0000 7fca83400640 1 -- 172.21.15.42:0/2478408577 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fca90005240 con 0x55ce2a31c460 2024-08-26T00:11:26.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.103+0000 7fcaab5d4740 10 client.25939 fetch_fsmap learned FSMap version 31 2024-08-26T00:11:26.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.103+0000 7fcaab5d4740 1 -- 172.21.15.42:0/2478408577 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ce2a3a1300 con 0x55ce2a31c460 2024-08-26T00:11:26.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.104+0000 7fca83400640 1 -- 172.21.15.42:0/2478408577 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca9000fe90 con 0x55ce2a31c460 2024-08-26T00:11:26.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.104+0000 7fca83400640 1 -- 172.21.15.42:0/2478408577 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fca90045020 con 0x55ce2a31c460 2024-08-26T00:11:26.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.104+0000 7fcaab5d4740 10 client.25939 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:11:26.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.104+0000 7fcaab5d4740 10 client.25939 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:11:26.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.104+0000 7fcaab5d4740 20 client.25939 populate_metadata read hostname 'smithi042' 2024-08-26T00:11:26.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.104+0000 7fcaab5d4740 1 --2- 172.21.15.42:0/2478408577 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55ce2a3a1990 0x55ce2a3a3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:26.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.104+0000 7fcaab5d4740 4 client.25939 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-26T00:11:26.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.104+0000 7fcaab5d4740 1 -- 172.21.15.42:0/2478408577 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ce2a289a40 con 0x55ce2a3a1990 2024-08-26T00:11:26.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.104+0000 7fcaa1e00640 1 --2- 172.21.15.42:0/2478408577 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55ce2a3a1990 0x55ce2a3a3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:26.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.105+0000 7fcaa1e00640 1 --2- 172.21.15.42:0/2478408577 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55ce2a3a1990 0x55ce2a3a3db0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7966e489beb272aa server_cookie=6c94fc532031209d in_seq=0 out_seq=0 2024-08-26T00:11:26.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.105+0000 7fca83400640 10 client.25939 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:11:26.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.105+0000 7fca83400640 1 -- 172.21.15.42:0/2478408577 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ce2a289a40 con 0x55ce2a3a1990 2024-08-26T00:11:26.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.105+0000 7fca83400640 10 client.25939 handle_command_reply: tid=0 2024-08-26T00:11:26.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.105+0000 7fcaab5d4740 1 client.25939 shutdown 2024-08-26T00:11:26.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.105+0000 7fcaab5d4740 1 -- 172.21.15.42:0/2478408577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31c460 msgr2=0x55ce2a3208b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:26.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.105+0000 7fcaab5d4740 1 --2- 172.21.15.42:0/2478408577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31c460 0x55ce2a3208b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55ce2a325060 tx=0x7fca9001eaa0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.105+0000 7fcaab5d4740 1 -- 172.21.15.42:0/2478408577 shutdown_connections 2024-08-26T00:11:26.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.105+0000 7fcaab5d4740 1 --2- 172.21.15.42:0/2478408577 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55ce2a3a1990 0x55ce2a3a3db0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.105+0000 7fcaab5d4740 1 --2- 172.21.15.42:0/2478408577 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ce2a326d20 0x55ce2a320ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.105+0000 7fcaab5d4740 1 --2- 172.21.15.42:0/2478408577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ce2a31c460 0x55ce2a3208b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.105+0000 7fcaab5d4740 1 --2- 172.21.15.42:0/2478408577 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ce2a31bb40 0x55ce2a32f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.105+0000 7fcaab5d4740 1 -- 172.21.15.42:0/2478408577 >> 172.21.15.42:0/2478408577 conn(0x55ce2a318080 msgr2=0x55ce2a31d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:26.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.105+0000 7fca83400640 0 client.25939 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:11:26.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.106+0000 7fcaab5d4740 1 -- 172.21.15.42:0/2478408577 shutdown_connections 2024-08-26T00:11:26.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.106+0000 7fcaab5d4740 1 -- 172.21.15.42:0/2478408577 wait complete. 2024-08-26T00:11:26.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.106+0000 7fcaab5d4740 20 client.25939 trim_cache size 0 max 16384 2024-08-26T00:11:26.112 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:11:26.112 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-08-26T00:11:26.113 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {} 2024-08-26T00:11:26.113 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:11:26.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.107+0000 7fcaa3200640 1 -- 172.21.15.42:0/1345909002 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fca880a2b80 msgr2=0x7fca880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:26.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.107+0000 7fcaa3200640 1 --2- 172.21.15.42:0/1345909002 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fca880a2b80 0x7fca880a5040 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55ce2a319450 tx=0x7fca90005f90 comp rx=0 tx=0).stop 2024-08-26T00:11:26.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.107+0000 7fcaa3200640 1 -- 172.21.15.42:0/1345909002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcaa4106670 msgr2=0x7fcaa419eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:26.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.107+0000 7fcaa3200640 1 --2- 172.21.15.42:0/1345909002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcaa4106670 0x7fcaa419eb20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00eb10 tx=0x7fca9c00c2d0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.107+0000 7fcaa3200640 1 -- 172.21.15.42:0/1345909002 shutdown_connections 2024-08-26T00:11:26.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.107+0000 7fcaa3200640 1 --2- 172.21.15.42:0/1345909002 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fca880a2b80 0x7fca880a5040 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.107+0000 7fcaa3200640 1 --2- 172.21.15.42:0/1345909002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcaa4106670 0x7fcaa419eb20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.107+0000 7fcaa3200640 1 --2- 172.21.15.42:0/1345909002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcaa4101010 0x7fcaa419a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.107+0000 7fcaa3200640 1 --2- 172.21.15.42:0/1345909002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcaa4100670 0x7fcaa419a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:26.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.107+0000 7fcaa3200640 1 -- 172.21.15.42:0/1345909002 >> 172.21.15.42:0/1345909002 conn(0x7fcaa40fc3b0 msgr2=0x7fcaa40fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:26.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.107+0000 7fcaa3200640 1 -- 172.21.15.42:0/1345909002 shutdown_connections 2024-08-26T00:11:26.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:26.107+0000 7fcaa3200640 1 -- 172.21.15.42:0/1345909002 wait complete. 2024-08-26T00:11:26.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:26 smithi043 ceph-mon[22091]: pgmap v606: 97 pgs: 97 active+clean; 2.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 459 op/s 2024-08-26T00:11:26.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:26 smithi042 ceph-mon[17225]: pgmap v606: 97 pgs: 97 active+clean; 2.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 459 op/s 2024-08-26T00:11:26.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:26 smithi181 ceph-mon[22102]: pgmap v606: 97 pgs: 97 active+clean; 2.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 459 op/s 2024-08-26T00:11:27.291 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-26T00:11:27.292 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:11:27.684 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:11:28.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.260+0000 7f9fb9000640 1 -- 172.21.15.42:0/2142847731 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9fb41044f0 msgr2=0x7f9fb41109d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:28.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.260+0000 7f9fb9000640 1 --2- 172.21.15.42:0/2142847731 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9fb41044f0 0x7f9fb41109d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9fac009be0 tx=0x7f9fac02a6c0 comp rx=0 tx=0).stop 2024-08-26T00:11:28.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.260+0000 7f9fb9000640 1 -- 172.21.15.42:0/2142847731 shutdown_connections 2024-08-26T00:11:28.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.260+0000 7f9fb9000640 1 --2- 172.21.15.42:0/2142847731 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9fb41044f0 0x7f9fb41109d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:28.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.260+0000 7f9fb9000640 1 --2- 172.21.15.42:0/2142847731 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9fb4103b50 0x7f9fb4103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:28.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.260+0000 7f9fb9000640 1 --2- 172.21.15.42:0/2142847731 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fb4109c00 0x7f9fb4109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:28.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.260+0000 7f9fb9000640 1 -- 172.21.15.42:0/2142847731 >> 172.21.15.42:0/2142847731 conn(0x7f9fb40ff830 msgr2=0x7f9fb4101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:28.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.261+0000 7f9fb9000640 1 -- 172.21.15.42:0/2142847731 shutdown_connections 2024-08-26T00:11:28.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.261+0000 7f9fb9000640 1 -- 172.21.15.42:0/2142847731 wait complete. 2024-08-26T00:11:28.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.264+0000 7f9fb9000640 1 Processor -- start 2024-08-26T00:11:28.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.265+0000 7f9fb9000640 1 -- start start 2024-08-26T00:11:28.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.265+0000 7f9fb9000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9fb4103b50 0x7f9fb40735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:28.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.265+0000 7f9fb9000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9fb41044f0 0x7f9fb4073b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:28.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.266+0000 7f9fb9000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fb4109c00 0x7f9fb406c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:28.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.267+0000 7f9fb9000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb4113f60 con 0x7f9fb4103b50 2024-08-26T00:11:28.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.267+0000 7f9fb9000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb4113de0 con 0x7f9fb41044f0 2024-08-26T00:11:28.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.267+0000 7f9fb9000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb41140e0 con 0x7f9fb4109c00 2024-08-26T00:11:28.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.267+0000 7f9fb1400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9fb41044f0 0x7f9fb4073b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:28.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.267+0000 7f9fb1400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9fb41044f0 0x7f9fb4073b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:48022/0 (socket says 172.21.15.42:48022) 2024-08-26T00:11:28.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.267+0000 7f9fb1400640 1 -- 172.21.15.42:0/3476081063 learned_addr learned my addr 172.21.15.42:0/3476081063 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:28.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.267+0000 7f9fb2800640 1 --2- 172.21.15.42:0/3476081063 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fb4109c00 0x7f9fb406c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:28.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.267+0000 7f9fb1e00640 1 --2- 172.21.15.42:0/3476081063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9fb4103b50 0x7f9fb40735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:28.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.267+0000 7f9fb1400640 1 -- 172.21.15.42:0/3476081063 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fb4109c00 msgr2=0x7f9fb406c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:28.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.267+0000 7f9fb1400640 1 --2- 172.21.15.42:0/3476081063 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fb4109c00 0x7f9fb406c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:28.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.267+0000 7f9fb1400640 1 -- 172.21.15.42:0/3476081063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9fb4103b50 msgr2=0x7f9fb40735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:28.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.267+0000 7f9fb1400640 1 --2- 172.21.15.42:0/3476081063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9fb4103b50 0x7f9fb40735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:28.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.267+0000 7f9fb1400640 1 -- 172.21.15.42:0/3476081063 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb406cfb0 con 0x7f9fb41044f0 2024-08-26T00:11:28.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.267+0000 7f9fb2800640 1 --2- 172.21.15.42:0/3476081063 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fb4109c00 0x7f9fb406c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:11:28.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.268+0000 7f9fb1400640 1 --2- 172.21.15.42:0/3476081063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9fb41044f0 0x7f9fb4073b20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9fa000e9c0 tx=0x7f9fa000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:28.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.268+0000 7f9faaa00640 1 -- 172.21.15.42:0/3476081063 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa000ccc0 con 0x7f9fb41044f0 2024-08-26T00:11:28.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.269+0000 7f9fb9000640 1 -- 172.21.15.42:0/3476081063 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb406d2a0 con 0x7f9fb41044f0 2024-08-26T00:11:28.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.269+0000 7f9fb9000640 1 -- 172.21.15.42:0/3476081063 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fb40712e0 con 0x7f9fb41044f0 2024-08-26T00:11:28.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.269+0000 7f9faaa00640 1 -- 172.21.15.42:0/3476081063 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fa0005500 con 0x7f9fb41044f0 2024-08-26T00:11:28.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.269+0000 7f9faaa00640 1 -- 172.21.15.42:0/3476081063 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0010430 con 0x7f9fb41044f0 2024-08-26T00:11:28.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.270+0000 7f9fb9000640 1 -- 172.21.15.42:0/3476081063 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f94005290 con 0x7f9fb41044f0 2024-08-26T00:11:28.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.276+0000 7f9faaa00640 1 -- 172.21.15.42:0/3476081063 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9fa0005020 con 0x7f9fb41044f0 2024-08-26T00:11:28.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.279+0000 7f9faaa00640 1 --2- 172.21.15.42:0/3476081063 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9f980a2c80 0x7f9f980a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:28.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.279+0000 7f9faaa00640 1 -- 172.21.15.42:0/3476081063 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f9fa00cf360 con 0x7f9fb41044f0 2024-08-26T00:11:28.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.280+0000 7f9fb1e00640 1 --2- 172.21.15.42:0/3476081063 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9f980a2c80 0x7f9f980a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:28.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.281+0000 7f9fb1e00640 1 --2- 172.21.15.42:0/3476081063 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9f980a2c80 0x7f9f980a5140 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400cac0 tx=0x7f9fa400c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:28.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.283+0000 7f9faaa00640 1 -- 172.21.15.42:0/3476081063 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f9fa009c280 con 0x7f9fb41044f0 2024-08-26T00:11:28.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.581+0000 7f9fb9000640 1 -- 172.21.15.42:0/3476081063 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f94005580 con 0x7f9fb41044f0 2024-08-26T00:11:28.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.582+0000 7f9faaa00640 1 -- 172.21.15.42:0/3476081063 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11918 (secure 0 0 0) 0x7f9fa009bb80 con 0x7f9fb41044f0 2024-08-26T00:11:28.583 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:11:28.583 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":31,"btime":"2024-08-26T00:10:53:344411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3168581452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3168581452},{"type":"v1","addr":"172.21.15.42:6839","nonce":3168581452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/3533492491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":3533492491},{"type":"v1","addr":"172.21.15.42:6841","nonce":3533492491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-26T00:00:30.169633+0000","modified":"2024-08-26T00:10:53.123094+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24532,"mds_1":24527,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6839/2653014277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2653014277},{"type":"v1","addr":"172.21.15.43:6839","nonce":2653014277}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24532,"qdb_cluster":[24514,24527,24532]},"id":1}]} 2024-08-26T00:11:28.584 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 31 2024-08-26T00:11:28.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.584+0000 7f9fb9000640 1 -- 172.21.15.42:0/3476081063 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9f980a2c80 msgr2=0x7f9f980a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:28.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.584+0000 7f9fb9000640 1 --2- 172.21.15.42:0/3476081063 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9f980a2c80 0x7f9f980a5140 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400cac0 tx=0x7f9fa400c4a0 comp rx=0 tx=0).stop 2024-08-26T00:11:28.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.584+0000 7f9fb9000640 1 -- 172.21.15.42:0/3476081063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9fb41044f0 msgr2=0x7f9fb4073b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:28.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.584+0000 7f9fb9000640 1 --2- 172.21.15.42:0/3476081063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9fb41044f0 0x7f9fb4073b20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9fa000e9c0 tx=0x7f9fa000ee80 comp rx=0 tx=0).stop 2024-08-26T00:11:28.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.584+0000 7f9fb9000640 1 -- 172.21.15.42:0/3476081063 shutdown_connections 2024-08-26T00:11:28.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.584+0000 7f9fb9000640 1 --2- 172.21.15.42:0/3476081063 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9f980a2c80 0x7f9f980a5140 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:28.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.584+0000 7f9fb9000640 1 --2- 172.21.15.42:0/3476081063 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fb4109c00 0x7f9fb406c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:28.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.584+0000 7f9fb9000640 1 --2- 172.21.15.42:0/3476081063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9fb41044f0 0x7f9fb4073b20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:28.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.584+0000 7f9fb9000640 1 --2- 172.21.15.42:0/3476081063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9fb4103b50 0x7f9fb40735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:28.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.584+0000 7f9fb9000640 1 -- 172.21.15.42:0/3476081063 >> 172.21.15.42:0/3476081063 conn(0x7f9fb40ff830 msgr2=0x7f9fb4100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:28.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.584+0000 7f9fb9000640 1 -- 172.21.15.42:0/3476081063 shutdown_connections 2024-08-26T00:11:28.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:28.585+0000 7f9fb9000640 1 -- 172.21.15.42:0/3476081063 wait complete. 2024-08-26T00:11:28.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:28 smithi043 ceph-mon[22091]: pgmap v607: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 481 op/s 2024-08-26T00:11:28.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:28 smithi042 ceph-mon[17225]: pgmap v607: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 481 op/s 2024-08-26T00:11:28.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:28 smithi181 ceph-mon[22102]: pgmap v607: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 481 op/s 2024-08-26T00:11:29.423 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-26T00:11:29.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:29 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/3476081063' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:11:29.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:29 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/3476081063' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:11:29.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:29 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/3476081063' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:11:29.817 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:11:30.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.402+0000 7f4427200640 1 -- 172.21.15.42:0/2003769704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f442810e000 msgr2=0x7f44281103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:30.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.402+0000 7f4427200640 1 --2- 172.21.15.42:0/2003769704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f442810e000 0x7f44281103f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4420009ca0 tx=0x7f442002a950 comp rx=0 tx=0).stop 2024-08-26T00:11:30.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.403+0000 7f4427200640 1 -- 172.21.15.42:0/2003769704 shutdown_connections 2024-08-26T00:11:30.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.403+0000 7f4427200640 1 --2- 172.21.15.42:0/2003769704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f442810e000 0x7f44281103f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.403+0000 7f4427200640 1 --2- 172.21.15.42:0/2003769704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4428074c80 0x7f442810dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.403+0000 7f4427200640 1 --2- 172.21.15.42:0/2003769704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4428074360 0x7f4428074740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.403+0000 7f4427200640 1 -- 172.21.15.42:0/2003769704 >> 172.21.15.42:0/2003769704 conn(0x7f44280fd4e0 msgr2=0x7f44280ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:30.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.403+0000 7f4427200640 1 -- 172.21.15.42:0/2003769704 shutdown_connections 2024-08-26T00:11:30.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.403+0000 7f4427200640 1 -- 172.21.15.42:0/2003769704 wait complete. 2024-08-26T00:11:30.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.404+0000 7f4427200640 1 Processor -- start 2024-08-26T00:11:30.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.404+0000 7f4427200640 1 -- start start 2024-08-26T00:11:30.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.404+0000 7f4427200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4428074360 0x7f442819a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:30.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.404+0000 7f4427200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4428074c80 0x7f442819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:30.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.404+0000 7f4427200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f442810e000 0x7f442819eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.404+0000 7f4427200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4428113da0 con 0x7f4428074c80 2024-08-26T00:11:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.404+0000 7f4427200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4428113c20 con 0x7f442810e000 2024-08-26T00:11:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.404+0000 7f4427200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4428113f20 con 0x7f4428074360 2024-08-26T00:11:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.404+0000 7f4425e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4428074360 0x7f442819a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.404+0000 7f4425400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4428074c80 0x7f442819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.404+0000 7f4425e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4428074360 0x7f442819a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:43004/0 (socket says 172.21.15.42:43004) 2024-08-26T00:11:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.404+0000 7f4425e00640 1 -- 172.21.15.42:0/1610270078 learned_addr learned my addr 172.21.15.42:0/1610270078 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.404+0000 7f4426800640 1 --2- 172.21.15.42:0/1610270078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f442810e000 0x7f442819eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.405+0000 7f4425e00640 1 -- 172.21.15.42:0/1610270078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f442810e000 msgr2=0x7f442819eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.405+0000 7f4425e00640 1 --2- 172.21.15.42:0/1610270078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f442810e000 0x7f442819eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.405+0000 7f4425e00640 1 -- 172.21.15.42:0/1610270078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4428074c80 msgr2=0x7f442819a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.405+0000 7f4425e00640 1 --2- 172.21.15.42:0/1610270078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4428074c80 0x7f442819a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.405+0000 7f4425e00640 1 -- 172.21.15.42:0/1610270078 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442819f1a0 con 0x7f4428074360 2024-08-26T00:11:30.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.405+0000 7f4425400640 1 --2- 172.21.15.42:0/1610270078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4428074c80 0x7f442819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:11:30.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.405+0000 7f4425e00640 1 --2- 172.21.15.42:0/1610270078 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4428074360 0x7f442819a1f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f441800d950 tx=0x7f441800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:30.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.405+0000 7f441ea00640 1 -- 172.21.15.42:0/1610270078 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4418017070 con 0x7f4428074360 2024-08-26T00:11:30.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.405+0000 7f441ea00640 1 -- 172.21.15.42:0/1610270078 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4418009c30 con 0x7f4428074360 2024-08-26T00:11:30.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.405+0000 7f4427200640 1 -- 172.21.15.42:0/1610270078 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f442819f490 con 0x7f4428074360 2024-08-26T00:11:30.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.406+0000 7f441ea00640 1 -- 172.21.15.42:0/1610270078 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441800f6b0 con 0x7f4428074360 2024-08-26T00:11:30.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.406+0000 7f4427200640 1 -- 172.21.15.42:0/1610270078 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44281a6d70 con 0x7f4428074360 2024-08-26T00:11:30.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.410+0000 7f442fc68740 1 Processor -- start 2024-08-26T00:11:30.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.410+0000 7f442fc68740 1 -- start start 2024-08-26T00:11:30.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.410+0000 7f441ea00640 1 -- 172.21.15.42:0/1610270078 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f44180109d0 con 0x7f4428074360 2024-08-26T00:11:30.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.410+0000 7f442fc68740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa7fa30 0x56022fa7fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:30.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.410+0000 7f442fc68740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56022fa80350 0x56022fa8a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:30.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.410+0000 7f442fc68740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa8ac10 0x56022fa8d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:30.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.410+0000 7f442fc68740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56022f9e5f30 con 0x56022fa80350 2024-08-26T00:11:30.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.410+0000 7f442fc68740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56022f97d5a0 con 0x56022fa7fa30 2024-08-26T00:11:30.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.410+0000 7f442fc68740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56022f9e1ef0 con 0x56022fa8ac10 2024-08-26T00:11:30.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.411+0000 7f4426800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa7fa30 0x56022fa7fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:30.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.411+0000 7f4426800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa7fa30 0x56022fa7fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:48040/0 (socket says 172.21.15.42:48040) 2024-08-26T00:11:30.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.411+0000 7f4425400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa8ac10 0x56022fa8d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.411+0000 7f4426800640 1 -- 172.21.15.42:0/3725331354 learned_addr learned my addr 172.21.15.42:0/3725331354 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.411+0000 7f4425e00640 1 --2- 172.21.15.42:0/3725331354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56022fa80350 0x56022fa8a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.411+0000 7f4426800640 1 -- 172.21.15.42:0/3725331354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa8ac10 msgr2=0x56022fa8d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.411+0000 7f4426800640 1 --2- 172.21.15.42:0/3725331354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa8ac10 0x56022fa8d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.411+0000 7f4426800640 1 -- 172.21.15.42:0/3725331354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56022fa80350 msgr2=0x56022fa8a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.411+0000 7f4426800640 1 --2- 172.21.15.42:0/3725331354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56022fa80350 0x56022fa8a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.411+0000 7f4426800640 1 -- 172.21.15.42:0/3725331354 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56022f7573c0 con 0x56022fa7fa30 2024-08-26T00:11:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.412+0000 7f4426800640 1 --2- 172.21.15.42:0/3725331354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa7fa30 0x56022fa7fe10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4420009ca0 tx=0x7f442002f3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5eab4d1385f6eb7d server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.412+0000 7f4413400640 1 -- 172.21.15.42:0/3725331354 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4420048070 con 0x56022fa7fa30 2024-08-26T00:11:30.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.412+0000 7f4413400640 1 -- 172.21.15.42:0/3725331354 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4420003e50 con 0x56022fa7fa30 2024-08-26T00:11:30.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.412+0000 7f4413400640 1 -- 172.21.15.42:0/3725331354 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4420034040 con 0x56022fa7fa30 2024-08-26T00:11:30.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.412+0000 7f441ea00640 1 --2- 172.21.15.42:0/1610270078 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f440c0a2b80 0x7f440c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:30.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.412+0000 7f441ea00640 1 -- 172.21.15.42:0/1610270078 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f44180cec30 con 0x7f4428074360 2024-08-26T00:11:30.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.413+0000 7f4425e00640 1 --2- 172.21.15.42:0/1610270078 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f440c0a2b80 0x7f440c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:30.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.413+0000 7f442fc68740 1 -- 172.21.15.42:0/3725331354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa7fa30 msgr2=0x56022fa7fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:30.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.413+0000 7f442fc68740 1 --2- 172.21.15.42:0/3725331354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa7fa30 0x56022fa7fe10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4420009ca0 tx=0x7f442002f3a0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.413+0000 7f442fc68740 1 -- 172.21.15.42:0/3725331354 shutdown_connections 2024-08-26T00:11:30.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.413+0000 7f442fc68740 1 --2- 172.21.15.42:0/3725331354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa8ac10 0x56022fa8d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.413+0000 7f442fc68740 1 --2- 172.21.15.42:0/3725331354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56022fa80350 0x56022fa8a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.413+0000 7f442fc68740 1 --2- 172.21.15.42:0/3725331354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa7fa30 0x56022fa7fe10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.413+0000 7f442fc68740 1 -- 172.21.15.42:0/3725331354 >> 172.21.15.42:0/3725331354 conn(0x56022fa7bfc0 msgr2=0x56022fa7c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:30.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.413+0000 7f442fc68740 1 -- 172.21.15.42:0/3725331354 shutdown_connections 2024-08-26T00:11:30.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.413+0000 7f442fc68740 1 -- 172.21.15.42:0/3725331354 wait complete. 2024-08-26T00:11:30.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.413+0000 7f4425e00640 1 --2- 172.21.15.42:0/1610270078 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f440c0a2b80 0x7f440c0a5040 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f44180a3bd0 tx=0x7f4418000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:30.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.414+0000 7f442fc68740 1 -- start start 2024-08-26T00:11:30.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.414+0000 7f442fc68740 1 Processor -- start 2024-08-26T00:11:30.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.414+0000 7f442fc68740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa7fa30 0x56022fa87ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:30.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.414+0000 7f442fc68740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56022fa80350 0x56022fa88010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:30.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.414+0000 7f442fc68740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa8ac10 0x56022fa88550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:30.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.414+0000 7f442fc68740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56022fa8d7e0 con 0x56022fa80350 2024-08-26T00:11:30.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.414+0000 7f442fc68740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56022f9a0de0 con 0x56022fa7fa30 2024-08-26T00:11:30.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.414+0000 7f442fc68740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56022fa8d960 con 0x56022fa8ac10 2024-08-26T00:11:30.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.414+0000 7f442fc68740 10 client.0 _ll_register_callbacks cb 0x56022f98f7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:11:30.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.415+0000 7f4426800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa7fa30 0x56022fa87ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:30.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.415+0000 7f4426800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa7fa30 0x56022fa87ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:48054/0 (socket says 172.21.15.42:48054) 2024-08-26T00:11:30.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.415+0000 7f4426800640 1 -- 172.21.15.42:0/2099351688 learned_addr learned my addr 172.21.15.42:0/2099351688 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:30.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.415+0000 7f4426800640 1 --2- 172.21.15.42:0/2099351688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa8ac10 0x56022fa88550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:30.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.415+0000 7f4425400640 1 --2- 172.21.15.42:0/2099351688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56022fa80350 0x56022fa88010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:30.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.415+0000 7f4426800640 1 -- 172.21.15.42:0/2099351688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa8ac10 msgr2=0x56022fa88550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:30.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.415+0000 7f4426800640 1 --2- 172.21.15.42:0/2099351688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa8ac10 0x56022fa88550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.415+0000 7f4426800640 1 -- 172.21.15.42:0/2099351688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56022fa80350 msgr2=0x56022fa88010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:30.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.415+0000 7f4426800640 1 --2- 172.21.15.42:0/2099351688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56022fa80350 0x56022fa88010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.415+0000 7f4426800640 1 -- 172.21.15.42:0/2099351688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56022fa96c50 con 0x56022fa7fa30 2024-08-26T00:11:30.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.415+0000 7f4425400640 1 --2- 172.21.15.42:0/2099351688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56022fa80350 0x56022fa88010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:11:30.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.415+0000 7f4426800640 1 --2- 172.21.15.42:0/2099351688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa7fa30 0x56022fa87ad0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4420030040 tx=0x7f442002fb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2d2ab58de9850e server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:30.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.415+0000 7f4407e00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:11:30.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.416+0000 7f4407e00640 1 -- 172.21.15.42:0/2099351688 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4420048070 con 0x56022fa7fa30 2024-08-26T00:11:30.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.416+0000 7f442fc68740 1 -- 172.21.15.42:0/2099351688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4420003e50 con 0x56022fa7fa30 2024-08-26T00:11:30.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.416+0000 7f4407e00640 1 -- 172.21.15.42:0/2099351688 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f4420004250 con 0x56022fa7fa30 2024-08-26T00:11:30.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.416+0000 7f4407e00640 1 -- 172.21.15.42:0/2099351688 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4420003c90 con 0x56022fa7fa30 2024-08-26T00:11:30.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.416+0000 7f442fc68740 10 client.25988 fetch_fsmap learned FSMap version 31 2024-08-26T00:11:30.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.416+0000 7f442fc68740 1 -- 172.21.15.42:0/2099351688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56022fa99590 con 0x56022fa7fa30 2024-08-26T00:11:30.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.416+0000 7f4407e00640 1 -- 172.21.15.42:0/2099351688 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4420003e50 con 0x56022fa7fa30 2024-08-26T00:11:30.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.416+0000 7f4407e00640 1 -- 172.21.15.42:0/2099351688 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f44200309c0 con 0x56022fa7fa30 2024-08-26T00:11:30.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.416+0000 7f442fc68740 10 client.25988 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:11:30.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.416+0000 7f442fc68740 10 client.25988 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-26T00:11:30.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.416+0000 7f442fc68740 20 client.25988 populate_metadata read hostname 'smithi042' 2024-08-26T00:11:30.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.416+0000 7f442fc68740 1 --2- 172.21.15.42:0/2099351688 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x56022fa9a8e0 0x56022fa9ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:30.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.417+0000 7f442fc68740 4 client.25988 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:11:30.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.417+0000 7f442fc68740 1 -- 172.21.15.42:0/2099351688 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56022f9f34a0 con 0x56022fa9a8e0 2024-08-26T00:11:30.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.417+0000 7f4425400640 1 --2- 172.21.15.42:0/2099351688 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x56022fa9a8e0 0x56022fa9ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:30.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.417+0000 7f4425400640 1 --2- 172.21.15.42:0/2099351688 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x56022fa9a8e0 0x56022fa9ccd0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=52cbdd0fc10e7227 server_cookie=35a6812736394640 in_seq=0 out_seq=0 2024-08-26T00:11:30.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.417+0000 7f4407e00640 10 client.25988 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:11:30.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.419+0000 7f4407e00640 1 -- 172.21.15.42:0/2099351688 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56022f9f34a0 con 0x56022fa9a8e0 2024-08-26T00:11:30.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.419+0000 7f4407e00640 10 client.25988 handle_command_reply: tid=0 2024-08-26T00:11:30.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.419+0000 7f442fc68740 1 client.25988 shutdown 2024-08-26T00:11:30.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.419+0000 7f442fc68740 1 -- 172.21.15.42:0/2099351688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa7fa30 msgr2=0x56022fa87ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:30.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.419+0000 7f442fc68740 1 --2- 172.21.15.42:0/2099351688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa7fa30 0x56022fa87ad0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4420030040 tx=0x7f442002fb80 comp rx=0 tx=0).stop 2024-08-26T00:11:30.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.419+0000 7f442fc68740 1 -- 172.21.15.42:0/2099351688 shutdown_connections 2024-08-26T00:11:30.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.419+0000 7f442fc68740 1 --2- 172.21.15.42:0/2099351688 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x56022fa9a8e0 0x56022fa9ccd0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.419+0000 7f442fc68740 1 --2- 172.21.15.42:0/2099351688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa8ac10 0x56022fa88550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.419+0000 7f442fc68740 1 --2- 172.21.15.42:0/2099351688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56022fa80350 0x56022fa88010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.419+0000 7f4407e00640 0 client.25988 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:11:30.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.419+0000 7f442fc68740 1 --2- 172.21.15.42:0/2099351688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa7fa30 0x56022fa87ad0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.419+0000 7f442fc68740 1 -- 172.21.15.42:0/2099351688 >> 172.21.15.42:0/2099351688 conn(0x56022fa7bfc0 msgr2=0x56022fa7b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:30.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.419+0000 7f442fc68740 1 -- 172.21.15.42:0/2099351688 shutdown_connections 2024-08-26T00:11:30.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.419+0000 7f442fc68740 1 -- 172.21.15.42:0/2099351688 wait complete. 2024-08-26T00:11:30.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.419+0000 7f442fc68740 20 client.25988 trim_cache size 0 max 16384 2024-08-26T00:11:30.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.436+0000 7f442fc68740 1 Processor -- start 2024-08-26T00:11:30.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.436+0000 7f442fc68740 1 -- start start 2024-08-26T00:11:30.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.436+0000 7f442fc68740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa7fa30 0x56022fa883a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:30.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.436+0000 7f442fc68740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa80350 0x56022fa84d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:30.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.436+0000 7f442fc68740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56022fa8ac10 0x56022fa85270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:30.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.436+0000 7f442fc68740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f44281b1d40 con 0x56022fa8ac10 2024-08-26T00:11:30.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.436+0000 7f442fc68740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f44281af550 con 0x56022fa7fa30 2024-08-26T00:11:30.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.436+0000 7f442fc68740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f44281ad380 con 0x56022fa80350 2024-08-26T00:11:30.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.437+0000 7f4425400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa80350 0x56022fa84d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:30.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.437+0000 7f4425400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa80350 0x56022fa84d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:43034/0 (socket says 172.21.15.42:43034) 2024-08-26T00:11:30.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.437+0000 7f4426800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa7fa30 0x56022fa883a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:30.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.437+0000 7f4425400640 1 -- 172.21.15.42:0/692970685 learned_addr learned my addr 172.21.15.42:0/692970685 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:30.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.437+0000 7f4426800640 1 --2- 172.21.15.42:0/692970685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56022fa8ac10 0x56022fa85270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:30.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.437+0000 7f4425400640 1 -- 172.21.15.42:0/692970685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa7fa30 msgr2=0x56022fa883a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:30.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.437+0000 7f4425400640 1 --2- 172.21.15.42:0/692970685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa7fa30 0x56022fa883a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.437+0000 7f4425400640 1 -- 172.21.15.42:0/692970685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56022fa8ac10 msgr2=0x56022fa85270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:30.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.437+0000 7f4425400640 1 --2- 172.21.15.42:0/692970685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56022fa8ac10 0x56022fa85270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.437+0000 7f4425400640 1 -- 172.21.15.42:0/692970685 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56022fa80180 con 0x56022fa80350 2024-08-26T00:11:30.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.437+0000 7f4425400640 1 --2- 172.21.15.42:0/692970685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa80350 0x56022fa84d30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x56022fa7d340 tx=0x7f4414012db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=213117edb770dd8 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:30.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.438+0000 7f4412a00640 1 -- 172.21.15.42:0/692970685 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44140122d0 con 0x56022fa80350 2024-08-26T00:11:30.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.438+0000 7f4412a00640 1 -- 172.21.15.42:0/692970685 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4414012470 con 0x56022fa80350 2024-08-26T00:11:30.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.438+0000 7f4412a00640 1 -- 172.21.15.42:0/692970685 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44140047a0 con 0x56022fa80350 2024-08-26T00:11:30.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.438+0000 7f442fc68740 1 -- 172.21.15.42:0/692970685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa80350 msgr2=0x56022fa84d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:30.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.438+0000 7f442fc68740 1 --2- 172.21.15.42:0/692970685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa80350 0x56022fa84d30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x56022fa7d340 tx=0x7f4414012db0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.438+0000 7f442fc68740 1 -- 172.21.15.42:0/692970685 shutdown_connections 2024-08-26T00:11:30.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.438+0000 7f442fc68740 1 --2- 172.21.15.42:0/692970685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56022fa8ac10 0x56022fa85270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.438+0000 7f442fc68740 1 --2- 172.21.15.42:0/692970685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa80350 0x56022fa84d30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.438+0000 7f442fc68740 1 --2- 172.21.15.42:0/692970685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa7fa30 0x56022fa883a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.438+0000 7f442fc68740 1 -- 172.21.15.42:0/692970685 >> 172.21.15.42:0/692970685 conn(0x56022fa7bfc0 msgr2=0x56022fa86bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:30.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.439+0000 7f442fc68740 1 -- 172.21.15.42:0/692970685 shutdown_connections 2024-08-26T00:11:30.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.439+0000 7f442fc68740 1 -- 172.21.15.42:0/692970685 wait complete. 2024-08-26T00:11:30.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.439+0000 7f442fc68740 1 -- start start 2024-08-26T00:11:30.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.439+0000 7f442fc68740 1 Processor -- start 2024-08-26T00:11:30.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.439+0000 7f442fc68740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56022fa7fa30 0x56022fa9d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:30.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.439+0000 7f442fc68740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa80350 0x56022fa9d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:30.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.440+0000 7f442fc68740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa8ac10 0x56022fb03210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:30.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.440+0000 7f442fc68740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f44281ada10 con 0x56022fa7fa30 2024-08-26T00:11:30.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.440+0000 7f442fc68740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f44281aee80 con 0x56022fa8ac10 2024-08-26T00:11:30.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.440+0000 7f442fc68740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f44281ae0e0 con 0x56022fa80350 2024-08-26T00:11:30.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.440+0000 7f442fc68740 10 client.0 _ll_register_callbacks cb 0x7f4420046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:11:30.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.440+0000 7f4425400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa80350 0x56022fa9d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:30.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.440+0000 7f4426800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56022fa7fa30 0x56022fa9d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:30.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.440+0000 7f4425400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa80350 0x56022fa9d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:43048/0 (socket says 172.21.15.42:43048) 2024-08-26T00:11:30.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.440+0000 7f4425400640 1 -- 172.21.15.42:0/3283705332 learned_addr learned my addr 172.21.15.42:0/3283705332 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:30.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.440+0000 7f4426800640 1 --2- 172.21.15.42:0/3283705332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa8ac10 0x56022fb03210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:30.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.440+0000 7f4425400640 1 -- 172.21.15.42:0/3283705332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa8ac10 msgr2=0x56022fb03210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:30.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.440+0000 7f4425400640 1 --2- 172.21.15.42:0/3283705332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa8ac10 0x56022fb03210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.440+0000 7f4425400640 1 -- 172.21.15.42:0/3283705332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56022fa7fa30 msgr2=0x56022fa9d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:30.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.440+0000 7f4425400640 1 --2- 172.21.15.42:0/3283705332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56022fa7fa30 0x56022fa9d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.440+0000 7f4425400640 1 -- 172.21.15.42:0/3283705332 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56022fb03750 con 0x56022fa80350 2024-08-26T00:11:30.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.440+0000 7f4426800640 1 --2- 172.21.15.42:0/3283705332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa8ac10 0x56022fb03210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:11:30.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.441+0000 7f4425400640 1 --2- 172.21.15.42:0/3283705332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa80350 0x56022fa9d650 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f441400fd00 tx=0x7f44140126e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=293a197b25d5fc24 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:30.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.441+0000 7f4407e00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:11:30.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.441+0000 7f4407e00640 1 -- 172.21.15.42:0/3283705332 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441400f9f0 con 0x56022fa80350 2024-08-26T00:11:30.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.441+0000 7f4407e00640 1 -- 172.21.15.42:0/3283705332 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f4414004030 con 0x56022fa80350 2024-08-26T00:11:30.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.441+0000 7f442fc68740 1 -- 172.21.15.42:0/3283705332 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4414012470 con 0x56022fa80350 2024-08-26T00:11:30.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.441+0000 7f4407e00640 1 -- 172.21.15.42:0/3283705332 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4414004230 con 0x56022fa80350 2024-08-26T00:11:30.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.441+0000 7f442fc68740 10 client.25960 fetch_fsmap learned FSMap version 31 2024-08-26T00:11:30.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.441+0000 7f442fc68740 1 -- 172.21.15.42:0/3283705332 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56022fb049b0 con 0x56022fa80350 2024-08-26T00:11:30.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.441+0000 7f4407e00640 1 -- 172.21.15.42:0/3283705332 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4414012470 con 0x56022fa80350 2024-08-26T00:11:30.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.442+0000 7f4407e00640 1 -- 172.21.15.42:0/3283705332 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f4414004750 con 0x56022fa80350 2024-08-26T00:11:30.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.442+0000 7f442fc68740 10 client.25960 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:11:30.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.442+0000 7f442fc68740 10 client.25960 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-26T00:11:30.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.442+0000 7f442fc68740 20 client.25960 populate_metadata read hostname 'smithi042' 2024-08-26T00:11:30.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.442+0000 7f442fc68740 1 --2- 172.21.15.42:0/3283705332 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x56022fb05020 0x56022fb07440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:30.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.442+0000 7f442fc68740 4 client.25960 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:11:30.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.442+0000 7f442fc68740 1 -- 172.21.15.42:0/3283705332 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56022f9ed9b0 con 0x56022fb05020 2024-08-26T00:11:30.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.442+0000 7f4426800640 1 --2- 172.21.15.42:0/3283705332 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x56022fb05020 0x56022fb07440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:30.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.442+0000 7f4426800640 1 --2- 172.21.15.42:0/3283705332 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x56022fb05020 0x56022fb07440 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e1d5e789bd540408 server_cookie=5680eb24f999ca6 in_seq=0 out_seq=0 2024-08-26T00:11:30.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.442+0000 7f4407e00640 10 client.25960 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:11:30.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.443+0000 7f4407e00640 1 -- 172.21.15.42:0/3283705332 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56022f9ed9b0 con 0x56022fb05020 2024-08-26T00:11:30.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.443+0000 7f4407e00640 10 client.25960 handle_command_reply: tid=0 2024-08-26T00:11:30.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.443+0000 7f442fc68740 1 client.25960 shutdown 2024-08-26T00:11:30.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.443+0000 7f442fc68740 1 -- 172.21.15.42:0/3283705332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa80350 msgr2=0x56022fa9d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:30.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.443+0000 7f442fc68740 1 --2- 172.21.15.42:0/3283705332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa80350 0x56022fa9d650 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f441400fd00 tx=0x7f44140126e0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.443+0000 7f442fc68740 1 -- 172.21.15.42:0/3283705332 shutdown_connections 2024-08-26T00:11:30.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.443+0000 7f442fc68740 1 --2- 172.21.15.42:0/3283705332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56022fa8ac10 0x56022fb03210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.443+0000 7f442fc68740 1 --2- 172.21.15.42:0/3283705332 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x56022fb05020 0x56022fb07440 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.443+0000 7f442fc68740 1 --2- 172.21.15.42:0/3283705332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56022fa80350 0x56022fa9d650 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.443+0000 7f442fc68740 1 --2- 172.21.15.42:0/3283705332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56022fa7fa30 0x56022fa9d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.443+0000 7f442fc68740 1 -- 172.21.15.42:0/3283705332 >> 172.21.15.42:0/3283705332 conn(0x56022fa7bfc0 msgr2=0x56022fa7a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:30.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.443+0000 7f4407e00640 0 client.25960 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:11:30.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.443+0000 7f442fc68740 1 -- 172.21.15.42:0/3283705332 shutdown_connections 2024-08-26T00:11:30.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.443+0000 7f442fc68740 1 -- 172.21.15.42:0/3283705332 wait complete. 2024-08-26T00:11:30.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.443+0000 7f442fc68740 20 client.25960 trim_cache size 0 max 16384 2024-08-26T00:11:30.448 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:11:30.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.444+0000 7f4427200640 1 -- 172.21.15.42:0/1610270078 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f440c0a2b80 msgr2=0x7f440c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:30.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.444+0000 7f4427200640 1 --2- 172.21.15.42:0/1610270078 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f440c0a2b80 0x7f440c0a5040 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f44180a3bd0 tx=0x7f4418000bc0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.444+0000 7f4427200640 1 -- 172.21.15.42:0/1610270078 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4428074360 msgr2=0x7f442819a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:30.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.444+0000 7f4427200640 1 --2- 172.21.15.42:0/1610270078 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4428074360 0x7f442819a1f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f441800d950 tx=0x7f441800de10 comp rx=0 tx=0).stop 2024-08-26T00:11:30.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.444+0000 7f4427200640 1 -- 172.21.15.42:0/1610270078 shutdown_connections 2024-08-26T00:11:30.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.444+0000 7f4427200640 1 --2- 172.21.15.42:0/1610270078 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f440c0a2b80 0x7f440c0a5040 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.444+0000 7f4427200640 1 --2- 172.21.15.42:0/1610270078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f442810e000 0x7f442819eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.444+0000 7f4427200640 1 --2- 172.21.15.42:0/1610270078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4428074c80 0x7f442819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.444+0000 7f4427200640 1 --2- 172.21.15.42:0/1610270078 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4428074360 0x7f442819a1f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:30.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.444+0000 7f4427200640 1 -- 172.21.15.42:0/1610270078 >> 172.21.15.42:0/1610270078 conn(0x7f44280fd4e0 msgr2=0x7f44280fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:30.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.444+0000 7f4427200640 1 -- 172.21.15.42:0/1610270078 shutdown_connections 2024-08-26T00:11:30.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:30.444+0000 7f4427200640 1 -- 172.21.15.42:0/1610270078 wait complete. 2024-08-26T00:11:30.597 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:30 smithi042 ceph-mon[17225]: pgmap v608: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 524 op/s 2024-08-26T00:11:30.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:30 smithi043 ceph-mon[22091]: pgmap v608: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 524 op/s 2024-08-26T00:11:30.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:30 smithi181 ceph-mon[22102]: pgmap v608: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 524 op/s 2024-08-26T00:11:32.067 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-26T00:11:32.556 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:11:32.696 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:32 smithi042 ceph-mon[17225]: pgmap v609: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 461 op/s 2024-08-26T00:11:32.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:32 smithi043 ceph-mon[22091]: pgmap v609: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 461 op/s 2024-08-26T00:11:32.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:32 smithi181 ceph-mon[22102]: pgmap v609: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 461 op/s 2024-08-26T00:11:33.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.067+0000 7f4828c00640 1 -- 172.21.15.42:0/2910286912 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4824104310 msgr2=0x7f4824110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:33.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.067+0000 7f4828c00640 1 --2- 172.21.15.42:0/2910286912 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4824104310 0x7f4824110840 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f481c009860 tx=0x7f481c02a340 comp rx=0 tx=0).stop 2024-08-26T00:11:33.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.068+0000 7f4828c00640 1 -- 172.21.15.42:0/2910286912 shutdown_connections 2024-08-26T00:11:33.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.068+0000 7f4828c00640 1 --2- 172.21.15.42:0/2910286912 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4824104310 0x7f4824110840 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.068+0000 7f4828c00640 1 --2- 172.21.15.42:0/2910286912 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4824103970 0x7f4824103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.068+0000 7f4828c00640 1 --2- 172.21.15.42:0/2910286912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4824109970 0x7f4824109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.068+0000 7f4828c00640 1 -- 172.21.15.42:0/2910286912 >> 172.21.15.42:0/2910286912 conn(0x7f48240ff6b0 msgr2=0x7f4824101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:33.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.068+0000 7f4828c00640 1 -- 172.21.15.42:0/2910286912 shutdown_connections 2024-08-26T00:11:33.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.068+0000 7f4828c00640 1 -- 172.21.15.42:0/2910286912 wait complete. 2024-08-26T00:11:33.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.069+0000 7f4828c00640 1 Processor -- start 2024-08-26T00:11:33.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.069+0000 7f4828c00640 1 -- start start 2024-08-26T00:11:33.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.069+0000 7f4828c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4824103970 0x7f482419a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:33.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.069+0000 7f4828c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4824104310 0x7f482419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:33.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.069+0000 7f4828c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4824109970 0x7f482419eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:33.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.069+0000 7f4828c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4824113d70 con 0x7f4824103970 2024-08-26T00:11:33.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.069+0000 7f4828c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4824113bf0 con 0x7f4824109970 2024-08-26T00:11:33.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.069+0000 7f4828c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4824113ef0 con 0x7f4824104310 2024-08-26T00:11:33.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.070+0000 7f481aa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4824104310 0x7f482419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:33.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.070+0000 7f4823e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4824109970 0x7f482419eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:33.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.070+0000 7f481aa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4824104310 0x7f482419a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:43062/0 (socket says 172.21.15.42:43062) 2024-08-26T00:11:33.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.070+0000 7f481aa00640 1 -- 172.21.15.42:0/3719577309 learned_addr learned my addr 172.21.15.42:0/3719577309 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:33.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.070+0000 7f4823400640 1 --2- 172.21.15.42:0/3719577309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4824103970 0x7f482419a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:33.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.070+0000 7f4823e00640 1 -- 172.21.15.42:0/3719577309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4824104310 msgr2=0x7f482419a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:33.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.070+0000 7f4823e00640 1 --2- 172.21.15.42:0/3719577309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4824104310 0x7f482419a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.070+0000 7f4823e00640 1 -- 172.21.15.42:0/3719577309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4824103970 msgr2=0x7f482419a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:33.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.070+0000 7f4823e00640 1 --2- 172.21.15.42:0/3719577309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4824103970 0x7f482419a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.070+0000 7f4823e00640 1 -- 172.21.15.42:0/3719577309 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f482419f1c0 con 0x7f4824109970 2024-08-26T00:11:33.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.071+0000 7f4823e00640 1 --2- 172.21.15.42:0/3719577309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4824109970 0x7f482419eae0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f481c02a860 tx=0x7f481c033ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:33.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.071+0000 7f4820c00640 1 -- 172.21.15.42:0/3719577309 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481c03f020 con 0x7f4824109970 2024-08-26T00:11:33.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.071+0000 7f4820c00640 1 -- 172.21.15.42:0/3719577309 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f481c004050 con 0x7f4824109970 2024-08-26T00:11:33.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.071+0000 7f4828c00640 1 -- 172.21.15.42:0/3719577309 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f482419f450 con 0x7f4824109970 2024-08-26T00:11:33.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.071+0000 7f4820c00640 1 -- 172.21.15.42:0/3719577309 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481c037040 con 0x7f4824109970 2024-08-26T00:11:33.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.071+0000 7f4828c00640 1 -- 172.21.15.42:0/3719577309 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48241a6d90 con 0x7f4824109970 2024-08-26T00:11:33.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.075+0000 7f482cbcb740 1 Processor -- start 2024-08-26T00:11:33.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.076+0000 7f4820c00640 1 -- 172.21.15.42:0/3719577309 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f481c042070 con 0x7f4824109970 2024-08-26T00:11:33.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.076+0000 7f482cbcb740 1 -- start start 2024-08-26T00:11:33.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.077+0000 7f482cbcb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50ac8240 0x556d50ac8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:33.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.077+0000 7f482cbcb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d50ac8b60 0x556d50ad2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:33.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.077+0000 7f482cbcb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556d50ad3420 0x556d50ad5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:33.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.077+0000 7f482cbcb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556d50a25f30 con 0x556d50ac8b60 2024-08-26T00:11:33.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.077+0000 7f482cbcb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556d509bd5a0 con 0x556d50ac8240 2024-08-26T00:11:33.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.077+0000 7f482cbcb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556d50a21ef0 con 0x556d50ad3420 2024-08-26T00:11:33.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.077+0000 7f481aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50ac8240 0x556d50ac8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:33.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.077+0000 7f481aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50ac8240 0x556d50ac8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:48076/0 (socket says 172.21.15.42:48076) 2024-08-26T00:11:33.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.077+0000 7f481aa00640 1 -- 172.21.15.42:0/2724681204 learned_addr learned my addr 172.21.15.42:0/2724681204 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:33.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.077+0000 7f481aa00640 1 --2- 172.21.15.42:0/2724681204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556d50ad3420 0x556d50ad5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:33.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.077+0000 7f4823400640 1 --2- 172.21.15.42:0/2724681204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d50ac8b60 0x556d50ad2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:33.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.078+0000 7f481aa00640 1 -- 172.21.15.42:0/2724681204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556d50ad3420 msgr2=0x556d50ad5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:33.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.078+0000 7f481aa00640 1 --2- 172.21.15.42:0/2724681204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556d50ad3420 0x556d50ad5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.078+0000 7f481aa00640 1 -- 172.21.15.42:0/2724681204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d50ac8b60 msgr2=0x556d50ad2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:33.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.078+0000 7f481aa00640 1 --2- 172.21.15.42:0/2724681204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d50ac8b60 0x556d50ad2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.078+0000 7f481aa00640 1 -- 172.21.15.42:0/2724681204 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d507973c0 con 0x556d50ac8240 2024-08-26T00:11:33.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.078+0000 7f481aa00640 1 --2- 172.21.15.42:0/2724681204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50ac8240 0x556d50ac8620 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f480c0096c0 tx=0x7f480c0095d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6018ea8a073a14b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:33.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.078+0000 7f4820c00640 1 --2- 172.21.15.42:0/3719577309 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48080a2c00 0x7f48080a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:33.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.078+0000 7f4813e00640 1 -- 172.21.15.42:0/2724681204 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480c004030 con 0x556d50ac8240 2024-08-26T00:11:33.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.078+0000 7f4820c00640 1 -- 172.21.15.42:0/3719577309 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f481c0ee1d0 con 0x7f4824109970 2024-08-26T00:11:33.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.078+0000 7f4813e00640 1 -- 172.21.15.42:0/2724681204 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f480c005500 con 0x556d50ac8240 2024-08-26T00:11:33.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.078+0000 7f4813e00640 1 -- 172.21.15.42:0/2724681204 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480c004c60 con 0x556d50ac8240 2024-08-26T00:11:33.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.078+0000 7f4823400640 1 --2- 172.21.15.42:0/3719577309 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48080a2c00 0x7f48080a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:33.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.079+0000 7f482cbcb740 1 -- 172.21.15.42:0/2724681204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50ac8240 msgr2=0x556d50ac8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:33.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.079+0000 7f482cbcb740 1 --2- 172.21.15.42:0/2724681204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50ac8240 0x556d50ac8620 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f480c0096c0 tx=0x7f480c0095d0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.079+0000 7f4823400640 1 --2- 172.21.15.42:0/3719577309 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48080a2c00 0x7f48080a50c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x556d50ac5630 tx=0x7f4814009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:33.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.079+0000 7f482cbcb740 1 -- 172.21.15.42:0/2724681204 shutdown_connections 2024-08-26T00:11:33.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.079+0000 7f482cbcb740 1 --2- 172.21.15.42:0/2724681204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556d50ad3420 0x556d50ad5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.079+0000 7f482cbcb740 1 --2- 172.21.15.42:0/2724681204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d50ac8b60 0x556d50ad2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.079+0000 7f482cbcb740 1 --2- 172.21.15.42:0/2724681204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50ac8240 0x556d50ac8620 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.079+0000 7f482cbcb740 1 -- 172.21.15.42:0/2724681204 >> 172.21.15.42:0/2724681204 conn(0x556d50ac47d0 msgr2=0x556d50ac4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:33.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.079+0000 7f482cbcb740 1 -- 172.21.15.42:0/2724681204 shutdown_connections 2024-08-26T00:11:33.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.080+0000 7f482cbcb740 1 -- 172.21.15.42:0/2724681204 wait complete. 2024-08-26T00:11:33.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.080+0000 7f482cbcb740 1 -- start start 2024-08-26T00:11:33.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.080+0000 7f482cbcb740 1 Processor -- start 2024-08-26T00:11:33.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.081+0000 7f482cbcb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d50ac8240 0x556d50ad02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:33.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.081+0000 7f482cbcb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50ac8b60 0x556d50ad0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:33.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.081+0000 7f482cbcb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556d50ad3420 0x556d50ad0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:33.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.081+0000 7f482cbcb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556d50ad5ff0 con 0x556d50ac8240 2024-08-26T00:11:33.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.081+0000 7f482cbcb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556d509e0de0 con 0x556d50ac8b60 2024-08-26T00:11:33.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.081+0000 7f482cbcb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556d50ad6170 con 0x556d50ad3420 2024-08-26T00:11:33.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.081+0000 7f482cbcb740 10 client.0 _ll_register_callbacks cb 0x556d509cf7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:11:33.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.081+0000 7f481aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50ac8b60 0x556d50ad0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:33.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.081+0000 7f481aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50ac8b60 0x556d50ad0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:48086/0 (socket says 172.21.15.42:48086) 2024-08-26T00:11:33.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.081+0000 7f481aa00640 1 -- 172.21.15.42:0/1011717848 learned_addr learned my addr 172.21.15.42:0/1011717848 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:33.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.081+0000 7f4823400640 1 --2- 172.21.15.42:0/1011717848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d50ac8240 0x556d50ad02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:33.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.081+0000 7f4823e00640 1 --2- 172.21.15.42:0/1011717848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556d50ad3420 0x556d50ad0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:33.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.082+0000 7f4823400640 1 -- 172.21.15.42:0/1011717848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556d50ad3420 msgr2=0x556d50ad0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:33.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.082+0000 7f4823400640 1 --2- 172.21.15.42:0/1011717848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556d50ad3420 0x556d50ad0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.082+0000 7f4823400640 1 -- 172.21.15.42:0/1011717848 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50ac8b60 msgr2=0x556d50ad0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:33.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.082+0000 7f4823400640 1 --2- 172.21.15.42:0/1011717848 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50ac8b60 0x556d50ad0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.082+0000 7f4823400640 1 -- 172.21.15.42:0/1011717848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d50adf4f0 con 0x556d50ac8240 2024-08-26T00:11:33.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.082+0000 7f481aa00640 1 --2- 172.21.15.42:0/1011717848 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50ac8b60 0x556d50ad0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:11:33.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.083+0000 7f4823400640 1 --2- 172.21.15.42:0/1011717848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d50ac8240 0x556d50ad02c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4814003fb0 tx=0x7f4814004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41be46175f14255 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:33.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.083+0000 7f4810c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-26T00:11:33.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.084+0000 7f4810c00640 1 -- 172.21.15.42:0/1011717848 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4814004b20 con 0x556d50ac8240 2024-08-26T00:11:33.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.084+0000 7f4810c00640 1 -- 172.21.15.42:0/1011717848 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f4814004cc0 con 0x556d50ac8240 2024-08-26T00:11:33.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.084+0000 7f482cbcb740 1 -- 172.21.15.42:0/1011717848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f480c005500 con 0x556d50ac8240 2024-08-26T00:11:33.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.084+0000 7f4810c00640 1 -- 172.21.15.42:0/1011717848 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f481400f870 con 0x556d50ac8240 2024-08-26T00:11:33.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.084+0000 7f482cbcb740 10 client.15906 fetch_fsmap learned FSMap version 31 2024-08-26T00:11:33.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.084+0000 7f482cbcb740 1 -- 172.21.15.42:0/1011717848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556d50ae1eb0 con 0x556d50ac8240 2024-08-26T00:11:33.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.086+0000 7f4810c00640 1 -- 172.21.15.42:0/1011717848 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f480c005500 con 0x556d50ac8240 2024-08-26T00:11:33.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.087+0000 7f4810c00640 1 -- 172.21.15.42:0/1011717848 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f4814026030 con 0x556d50ac8240 2024-08-26T00:11:33.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.088+0000 7f482cbcb740 10 client.15906 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:11:33.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.088+0000 7f482cbcb740 10 client.15906 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-26T00:11:33.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.088+0000 7f482cbcb740 20 client.15906 populate_metadata read hostname 'smithi042' 2024-08-26T00:11:33.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.088+0000 7f482cbcb740 1 --2- 172.21.15.42:0/1011717848 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x556d50ae33f0 0x556d50ae5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:33.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.088+0000 7f482cbcb740 4 client.15906 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:11:33.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.088+0000 7f482cbcb740 1 -- 172.21.15.42:0/1011717848 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d50a334a0 con 0x556d50ae33f0 2024-08-26T00:11:33.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.089+0000 7f481aa00640 1 --2- 172.21.15.42:0/1011717848 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x556d50ae33f0 0x556d50ae5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:33.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.090+0000 7f481aa00640 1 --2- 172.21.15.42:0/1011717848 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x556d50ae33f0 0x556d50ae5870 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3d887b7ca0a56b8d server_cookie=e40fda8d896f5179 in_seq=0 out_seq=0 2024-08-26T00:11:33.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.090+0000 7f4810c00640 10 client.15906 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:11:33.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.091+0000 7f4810c00640 1 -- 172.21.15.42:0/1011717848 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556d50a334a0 con 0x556d50ae33f0 2024-08-26T00:11:33.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.091+0000 7f4810c00640 10 client.15906 handle_command_reply: tid=0 2024-08-26T00:11:33.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.091+0000 7f482cbcb740 1 client.15906 shutdown 2024-08-26T00:11:33.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.094+0000 7f482cbcb740 1 -- 172.21.15.42:0/1011717848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d50ac8240 msgr2=0x556d50ad02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:33.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.094+0000 7f482cbcb740 1 --2- 172.21.15.42:0/1011717848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d50ac8240 0x556d50ad02c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4814003fb0 tx=0x7f4814004ab0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.094+0000 7f482cbcb740 1 -- 172.21.15.42:0/1011717848 shutdown_connections 2024-08-26T00:11:33.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.094+0000 7f482cbcb740 1 --2- 172.21.15.42:0/1011717848 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x556d50ae33f0 0x556d50ae5870 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.094+0000 7f482cbcb740 1 --2- 172.21.15.42:0/1011717848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556d50ad3420 0x556d50ad0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.094+0000 7f482cbcb740 1 --2- 172.21.15.42:0/1011717848 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50ac8b60 0x556d50ad0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.094+0000 7f482cbcb740 1 --2- 172.21.15.42:0/1011717848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d50ac8240 0x556d50ad02c0 secure :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4814003fb0 tx=0x7f4814004ab0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.094+0000 7f482cbcb740 1 -- 172.21.15.42:0/1011717848 >> 172.21.15.42:0/1011717848 conn(0x556d50ac47d0 msgr2=0x556d50aca500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:33.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.095+0000 7f4810c00640 0 client.15906 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:11:33.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.097+0000 7f482cbcb740 1 -- 172.21.15.42:0/1011717848 shutdown_connections 2024-08-26T00:11:33.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.097+0000 7f482cbcb740 1 -- 172.21.15.42:0/1011717848 wait complete. 2024-08-26T00:11:33.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.098+0000 7f482cbcb740 20 client.15906 trim_cache size 0 max 16384 2024-08-26T00:11:33.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.134+0000 7f482cbcb740 1 Processor -- start 2024-08-26T00:11:33.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.134+0000 7f482cbcb740 1 -- start start 2024-08-26T00:11:33.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.135+0000 7f482cbcb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d50ac8b60 0x556d50acb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:33.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.135+0000 7f482cbcb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556d50ad3420 0x556d50aeb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:33.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.135+0000 7f482cbcb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50aeb680 0x556d50aba900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:33.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.135+0000 7f482cbcb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4800010ee0 con 0x556d50ac8b60 2024-08-26T00:11:33.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.135+0000 7f482cbcb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f480000e6f0 con 0x556d50aeb680 2024-08-26T00:11:33.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.135+0000 7f482cbcb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f480000c520 con 0x556d50ad3420 2024-08-26T00:11:33.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.135+0000 7f4823400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d50ac8b60 0x556d50acb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:33.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.135+0000 7f4823400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d50ac8b60 0x556d50acb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36520/0 (socket says 172.21.15.42:36520) 2024-08-26T00:11:33.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.135+0000 7f4823400640 1 -- 172.21.15.42:0/519024651 learned_addr learned my addr 172.21.15.42:0/519024651 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:33.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.136+0000 7f4823e00640 1 --2- 172.21.15.42:0/519024651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50aeb680 0x556d50aba900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:33.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.137+0000 7f481aa00640 1 --2- 172.21.15.42:0/519024651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556d50ad3420 0x556d50aeb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:33.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.137+0000 7f4823400640 1 -- 172.21.15.42:0/519024651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556d50ad3420 msgr2=0x556d50aeb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:33.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.137+0000 7f4823400640 1 --2- 172.21.15.42:0/519024651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556d50ad3420 0x556d50aeb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.137+0000 7f4823400640 1 -- 172.21.15.42:0/519024651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50aeb680 msgr2=0x556d50aba900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:33.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.137+0000 7f4823400640 1 --2- 172.21.15.42:0/519024651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50aeb680 0x556d50aba900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.137+0000 7f4823400640 1 -- 172.21.15.42:0/519024651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d50ac4600 con 0x556d50ac8b60 2024-08-26T00:11:33.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.140+0000 7f4823400640 1 --2- 172.21.15.42:0/519024651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d50ac8b60 0x556d50acb660 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4814000f80 tx=0x7f48140048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a15385e6627a21 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:33.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.142+0000 7f4813400640 1 -- 172.21.15.42:0/519024651 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4814011040 con 0x556d50ac8b60 2024-08-26T00:11:33.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.142+0000 7f4813400640 1 -- 172.21.15.42:0/519024651 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48140111e0 con 0x556d50ac8b60 2024-08-26T00:11:33.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.142+0000 7f4813400640 1 -- 172.21.15.42:0/519024651 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481401ec30 con 0x556d50ac8b60 2024-08-26T00:11:33.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.144+0000 7f482cbcb740 1 -- 172.21.15.42:0/519024651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d50ac8b60 msgr2=0x556d50acb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:33.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.144+0000 7f482cbcb740 1 --2- 172.21.15.42:0/519024651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d50ac8b60 0x556d50acb660 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4814000f80 tx=0x7f48140048a0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.144+0000 7f482cbcb740 1 -- 172.21.15.42:0/519024651 shutdown_connections 2024-08-26T00:11:33.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.144+0000 7f482cbcb740 1 --2- 172.21.15.42:0/519024651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50aeb680 0x556d50aba900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.144+0000 7f482cbcb740 1 --2- 172.21.15.42:0/519024651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556d50ad3420 0x556d50aeb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.144+0000 7f482cbcb740 1 --2- 172.21.15.42:0/519024651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d50ac8b60 0x556d50acb660 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.144+0000 7f482cbcb740 1 -- 172.21.15.42:0/519024651 >> 172.21.15.42:0/519024651 conn(0x556d50ac47d0 msgr2=0x556d50ad2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:33.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.145+0000 7f482cbcb740 1 -- 172.21.15.42:0/519024651 shutdown_connections 2024-08-26T00:11:33.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.145+0000 7f482cbcb740 1 -- 172.21.15.42:0/519024651 wait complete. 2024-08-26T00:11:33.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.146+0000 7f482cbcb740 1 -- start start 2024-08-26T00:11:33.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.147+0000 7f482cbcb740 1 Processor -- start 2024-08-26T00:11:33.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.148+0000 7f482cbcb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d50ac8b60 0x556d50adbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:33.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.148+0000 7f482cbcb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556d50ad3420 0x556d50ad6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:33.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.148+0000 7f482cbcb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50aeb680 0x556d50ad7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:33.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.148+0000 7f482cbcb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f480000cbb0 con 0x556d50ac8b60 2024-08-26T00:11:33.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.148+0000 7f482cbcb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f480000e020 con 0x556d50aeb680 2024-08-26T00:11:33.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.148+0000 7f482cbcb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f480000d280 con 0x556d50ad3420 2024-08-26T00:11:33.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.148+0000 7f482cbcb740 10 client.0 _ll_register_callbacks cb 0x7f4814003970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:11:33.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.150+0000 7f4823e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50aeb680 0x556d50ad7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:33.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.150+0000 7f4823e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50aeb680 0x556d50ad7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:48118/0 (socket says 172.21.15.42:48118) 2024-08-26T00:11:33.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.150+0000 7f4823e00640 1 -- 172.21.15.42:0/851586360 learned_addr learned my addr 172.21.15.42:0/851586360 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:33.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.150+0000 7f4823e00640 1 -- 172.21.15.42:0/851586360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556d50ad3420 msgr2=0x556d50ad6e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:11:33.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.150+0000 7f4823e00640 1 --2- 172.21.15.42:0/851586360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556d50ad3420 0x556d50ad6e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.150+0000 7f4823e00640 1 -- 172.21.15.42:0/851586360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d50ac8b60 msgr2=0x556d50adbb20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:11:33.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.150+0000 7f4823e00640 1 --2- 172.21.15.42:0/851586360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d50ac8b60 0x556d50adbb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.150+0000 7f4823e00640 1 -- 172.21.15.42:0/851586360 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d50ac8070 con 0x556d50aeb680 2024-08-26T00:11:33.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.152+0000 7f4823e00640 1 --2- 172.21.15.42:0/851586360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50aeb680 0x556d50ad7390 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f481c0c3170 tx=0x7f481c0ba630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83c15fb589e1dda8 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:33.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.152+0000 7f4810c00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:11:33.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.153+0000 7f4810c00640 1 -- 172.21.15.42:0/851586360 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481c0d3060 con 0x556d50aeb680 2024-08-26T00:11:33.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.153+0000 7f4810c00640 1 -- 172.21.15.42:0/851586360 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f481c0c3410 con 0x556d50aeb680 2024-08-26T00:11:33.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.153+0000 7f482cbcb740 1 -- 172.21.15.42:0/851586360 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48140111e0 con 0x556d50aeb680 2024-08-26T00:11:33.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.153+0000 7f4810c00640 1 -- 172.21.15.42:0/851586360 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f481c0bb130 con 0x556d50aeb680 2024-08-26T00:11:33.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.153+0000 7f482cbcb740 10 client.26012 fetch_fsmap learned FSMap version 31 2024-08-26T00:11:33.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.153+0000 7f482cbcb740 1 -- 172.21.15.42:0/851586360 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556d50abb9f0 con 0x556d50aeb680 2024-08-26T00:11:33.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.154+0000 7f4810c00640 1 -- 172.21.15.42:0/851586360 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48140111e0 con 0x556d50aeb680 2024-08-26T00:11:33.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.154+0000 7f4810c00640 1 -- 172.21.15.42:0/851586360 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f481c03a070 con 0x556d50aeb680 2024-08-26T00:11:33.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.154+0000 7f482cbcb740 10 client.26012 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:11:33.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.154+0000 7f482cbcb740 10 client.26012 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-26T00:11:33.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.154+0000 7f482cbcb740 20 client.26012 populate_metadata read hostname 'smithi042' 2024-08-26T00:11:33.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.154+0000 7f482cbcb740 1 --2- 172.21.15.42:0/851586360 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x556d50abc0c0 0x556d50abe540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:33.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.154+0000 7f482cbcb740 4 client.26012 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:11:33.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.154+0000 7f482cbcb740 1 -- 172.21.15.42:0/851586360 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556d50a2d9b0 con 0x556d50abc0c0 2024-08-26T00:11:33.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.155+0000 7f4823400640 1 --2- 172.21.15.42:0/851586360 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x556d50abc0c0 0x556d50abe540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:33.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.156+0000 7f4823400640 1 --2- 172.21.15.42:0/851586360 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x556d50abc0c0 0x556d50abe540 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=73be6b2265df5e71 server_cookie=43b3312ac3f641d3 in_seq=0 out_seq=0 2024-08-26T00:11:33.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.156+0000 7f4810c00640 10 client.26012 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:11:33.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.156+0000 7f4810c00640 1 -- 172.21.15.42:0/851586360 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556d50a2d9b0 con 0x556d50abc0c0 2024-08-26T00:11:33.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.157+0000 7f4810c00640 10 client.26012 handle_command_reply: tid=0 2024-08-26T00:11:33.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.157+0000 7f482cbcb740 1 client.26012 shutdown 2024-08-26T00:11:33.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.157+0000 7f482cbcb740 1 -- 172.21.15.42:0/851586360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50aeb680 msgr2=0x556d50ad7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:33.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.157+0000 7f482cbcb740 1 --2- 172.21.15.42:0/851586360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50aeb680 0x556d50ad7390 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f481c0c3170 tx=0x7f481c0ba630 comp rx=0 tx=0).stop 2024-08-26T00:11:33.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.158+0000 7f482cbcb740 1 -- 172.21.15.42:0/851586360 shutdown_connections 2024-08-26T00:11:33.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.158+0000 7f482cbcb740 1 --2- 172.21.15.42:0/851586360 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x556d50abc0c0 0x556d50abe540 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.158+0000 7f482cbcb740 1 --2- 172.21.15.42:0/851586360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556d50aeb680 0x556d50ad7390 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.158+0000 7f482cbcb740 1 --2- 172.21.15.42:0/851586360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556d50ad3420 0x556d50ad6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.158+0000 7f482cbcb740 1 --2- 172.21.15.42:0/851586360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556d50ac8b60 0x556d50adbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.158+0000 7f482cbcb740 1 -- 172.21.15.42:0/851586360 >> 172.21.15.42:0/851586360 conn(0x556d50ac47d0 msgr2=0x556d50acea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:33.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.158+0000 7f4810c00640 0 client.26012 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:11:33.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.159+0000 7f482cbcb740 1 -- 172.21.15.42:0/851586360 shutdown_connections 2024-08-26T00:11:33.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.161+0000 7f482cbcb740 1 -- 172.21.15.42:0/851586360 wait complete. 2024-08-26T00:11:33.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.161+0000 7f482cbcb740 20 client.26012 trim_cache size 0 max 16384 2024-08-26T00:11:33.163 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:11:33.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.162+0000 7f4828c00640 1 -- 172.21.15.42:0/3719577309 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48080a2c00 msgr2=0x7f48080a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:33.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.163+0000 7f4828c00640 1 --2- 172.21.15.42:0/3719577309 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48080a2c00 0x7f48080a50c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x556d50ac5630 tx=0x7f4814009500 comp rx=0 tx=0).stop 2024-08-26T00:11:33.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.163+0000 7f4828c00640 1 -- 172.21.15.42:0/3719577309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4824109970 msgr2=0x7f482419eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:33.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.163+0000 7f4828c00640 1 --2- 172.21.15.42:0/3719577309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4824109970 0x7f482419eae0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f481c02a860 tx=0x7f481c033ae0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.163+0000 7f4828c00640 1 -- 172.21.15.42:0/3719577309 shutdown_connections 2024-08-26T00:11:33.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.163+0000 7f4828c00640 1 --2- 172.21.15.42:0/3719577309 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f48080a2c00 0x7f48080a50c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.163+0000 7f4828c00640 1 --2- 172.21.15.42:0/3719577309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4824109970 0x7f482419eae0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.163+0000 7f4828c00640 1 --2- 172.21.15.42:0/3719577309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4824104310 0x7f482419a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.163+0000 7f4828c00640 1 --2- 172.21.15.42:0/3719577309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4824103970 0x7f482419a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:33.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.163+0000 7f4828c00640 1 -- 172.21.15.42:0/3719577309 >> 172.21.15.42:0/3719577309 conn(0x7f48240ff6b0 msgr2=0x7f48240ffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:33.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.164+0000 7f4828c00640 1 -- 172.21.15.42:0/3719577309 shutdown_connections 2024-08-26T00:11:33.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:33.164+0000 7f4828c00640 1 -- 172.21.15.42:0/3719577309 wait complete. 2024-08-26T00:11:34.226 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-26T00:11:34.603 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:11:34.742 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:34 smithi042 ceph-mon[17225]: pgmap v610: 97 pgs: 97 active+clean; 1.9 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 575 op/s 2024-08-26T00:11:34.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:34 smithi043 ceph-mon[22091]: pgmap v610: 97 pgs: 97 active+clean; 1.9 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 575 op/s 2024-08-26T00:11:34.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:34 smithi181 ceph-mon[22102]: pgmap v610: 97 pgs: 97 active+clean; 1.9 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 575 op/s 2024-08-26T00:11:35.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.175+0000 7f94f7200640 1 -- 172.21.15.42:0/2601846836 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94f8074330 msgr2=0x7f94f8074710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:35.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.175+0000 7f94f7200640 1 --2- 172.21.15.42:0/2601846836 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94f8074330 0x7f94f8074710 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009900 tx=0x7f94e802a480 comp rx=0 tx=0).stop 2024-08-26T00:11:35.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.175+0000 7f94f7200640 1 -- 172.21.15.42:0/2601846836 shutdown_connections 2024-08-26T00:11:35.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.175+0000 7f94f7200640 1 --2- 172.21.15.42:0/2601846836 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94f8112780 0x7f94f8114b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.175+0000 7f94f7200640 1 --2- 172.21.15.42:0/2601846836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94f8074c50 0x7f94f8112240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.175+0000 7f94f7200640 1 --2- 172.21.15.42:0/2601846836 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94f8074330 0x7f94f8074710 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.175+0000 7f94f7200640 1 -- 172.21.15.42:0/2601846836 >> 172.21.15.42:0/2601846836 conn(0x7f94f80fd4b0 msgr2=0x7f94f80ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:35.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.176+0000 7f94f7200640 1 -- 172.21.15.42:0/2601846836 shutdown_connections 2024-08-26T00:11:35.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.176+0000 7f94f7200640 1 -- 172.21.15.42:0/2601846836 wait complete. 2024-08-26T00:11:35.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.179+0000 7f94f7200640 1 Processor -- start 2024-08-26T00:11:35.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.179+0000 7f94f7200640 1 -- start start 2024-08-26T00:11:35.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.180+0000 7f94f7200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94f8074330 0x7f94f81a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:35.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.180+0000 7f94f7200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94f8074c50 0x7f94f81a4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:35.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.180+0000 7f94f7200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94f8112780 0x7f94f819e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:35.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.180+0000 7f94f7200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f94f8118200 con 0x7f94f8074330 2024-08-26T00:11:35.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.180+0000 7f94f7200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f94f8118080 con 0x7f94f8074c50 2024-08-26T00:11:35.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.180+0000 7f94f7200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f94f8118380 con 0x7f94f8112780 2024-08-26T00:11:35.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.181+0000 7f94f6800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94f8112780 0x7f94f819e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:35.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.181+0000 7f94f6800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94f8112780 0x7f94f819e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:55454/0 (socket says 172.21.15.42:55454) 2024-08-26T00:11:35.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.181+0000 7f94f6800640 1 -- 172.21.15.42:0/3282794955 learned_addr learned my addr 172.21.15.42:0/3282794955 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:35.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.181+0000 7f94f5400640 1 --2- 172.21.15.42:0/3282794955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94f8074c50 0x7f94f81a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:35.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.181+0000 7f94f5e00640 1 --2- 172.21.15.42:0/3282794955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94f8074330 0x7f94f81a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:35.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.181+0000 7f94f5400640 1 -- 172.21.15.42:0/3282794955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94f8112780 msgr2=0x7f94f819e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:35.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.181+0000 7f94f5400640 1 --2- 172.21.15.42:0/3282794955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94f8112780 0x7f94f819e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.181+0000 7f94f5400640 1 -- 172.21.15.42:0/3282794955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94f8074330 msgr2=0x7f94f81a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:35.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.182+0000 7f94f5400640 1 --2- 172.21.15.42:0/3282794955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94f8074330 0x7f94f81a4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.182+0000 7f94f5400640 1 -- 172.21.15.42:0/3282794955 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f819ed00 con 0x7f94f8074c50 2024-08-26T00:11:35.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.182+0000 7f94f5e00640 1 --2- 172.21.15.42:0/3282794955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94f8074330 0x7f94f81a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:11:35.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.182+0000 7f94f5400640 1 --2- 172.21.15.42:0/3282794955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94f8074c50 0x7f94f81a4950 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f94e400b3f0 tx=0x7f94e400b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:35.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.183+0000 7f94eea00640 1 -- 172.21.15.42:0/3282794955 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e4015020 con 0x7f94f8074c50 2024-08-26T00:11:35.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.183+0000 7f94f7200640 1 -- 172.21.15.42:0/3282794955 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f819eff0 con 0x7f94f8074c50 2024-08-26T00:11:35.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.183+0000 7f94eea00640 1 -- 172.21.15.42:0/3282794955 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94e4011d10 con 0x7f94f8074c50 2024-08-26T00:11:35.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.184+0000 7f94eea00640 1 -- 172.21.15.42:0/3282794955 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e400f2e0 con 0x7f94f8074c50 2024-08-26T00:11:35.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.184+0000 7f94f7200640 1 -- 172.21.15.42:0/3282794955 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f81ab2e0 con 0x7f94f8074c50 2024-08-26T00:11:35.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.192+0000 7f94eea00640 1 -- 172.21.15.42:0/3282794955 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f94e4018020 con 0x7f94f8074c50 2024-08-26T00:11:35.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.193+0000 7f94ffc4e740 1 Processor -- start 2024-08-26T00:11:35.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.193+0000 7f94ffc4e740 1 -- start start 2024-08-26T00:11:35.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.193+0000 7f94ffc4e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc5934a30 0x562fc5934e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:35.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.194+0000 7f94ffc4e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562fc5935350 0x562fc593f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:35.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.194+0000 7f94ffc4e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc593fc10 0x562fc5942000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:35.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.194+0000 7f94ffc4e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562fc589af30 con 0x562fc593fc10 2024-08-26T00:11:35.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.194+0000 7f94ffc4e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562fc58325a0 con 0x562fc5935350 2024-08-26T00:11:35.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.194+0000 7f94ffc4e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562fc5896ef0 con 0x562fc5934a30 2024-08-26T00:11:35.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.194+0000 7f94f6800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc5934a30 0x562fc5934e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:35.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.194+0000 7f94f6800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc5934a30 0x562fc5934e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:55464/0 (socket says 172.21.15.42:55464) 2024-08-26T00:11:35.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.194+0000 7f94f6800640 1 -- 172.21.15.42:0/3295192831 learned_addr learned my addr 172.21.15.42:0/3295192831 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:35.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.194+0000 7f94f5400640 1 --2- 172.21.15.42:0/3295192831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc593fc10 0x562fc5942000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:35.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.195+0000 7f94eea00640 1 --2- 172.21.15.42:0/3282794955 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f94dc0a2c80 0x7f94dc0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:35.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.195+0000 7f94eea00640 1 -- 172.21.15.42:0/3282794955 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f94e40ce6b0 con 0x7f94f8074c50 2024-08-26T00:11:35.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.195+0000 7f94f6800640 1 -- 172.21.15.42:0/3295192831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562fc5935350 msgr2=0x562fc593f6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:11:35.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.195+0000 7f94f6800640 1 --2- 172.21.15.42:0/3295192831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562fc5935350 0x562fc593f6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.195+0000 7f94f6800640 1 -- 172.21.15.42:0/3295192831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc593fc10 msgr2=0x562fc5942000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:35.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.196+0000 7f94f6800640 1 --2- 172.21.15.42:0/3295192831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc593fc10 0x562fc5942000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.196+0000 7f94f6800640 1 -- 172.21.15.42:0/3295192831 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fc560c3c0 con 0x562fc5934a30 2024-08-26T00:11:35.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.196+0000 7f94f5400640 1 --2- 172.21.15.42:0/3295192831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc593fc10 0x562fc5942000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:11:35.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.197+0000 7f94f6800640 1 --2- 172.21.15.42:0/3282794955 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f94dc0a2c80 0x7f94dc0a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:35.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.197+0000 7f94f6800640 1 --2- 172.21.15.42:0/3295192831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc5934a30 0x562fc5934e10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f94f0011610 tx=0x7f94f0011ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4031c6af07104408 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:35.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.198+0000 7f94e3400640 1 -- 172.21.15.42:0/3295192831 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f0017050 con 0x562fc5934a30 2024-08-26T00:11:35.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.198+0000 7f94e3400640 1 -- 172.21.15.42:0/3295192831 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94f000fe00 con 0x562fc5934a30 2024-08-26T00:11:35.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.198+0000 7f94e3400640 1 -- 172.21.15.42:0/3295192831 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f000ea60 con 0x562fc5934a30 2024-08-26T00:11:35.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.199+0000 7f94ffc4e740 1 -- 172.21.15.42:0/3295192831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc5934a30 msgr2=0x562fc5934e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:35.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.199+0000 7f94ffc4e740 1 --2- 172.21.15.42:0/3295192831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc5934a30 0x562fc5934e10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f94f0011610 tx=0x7f94f0011ad0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.199+0000 7f94f6800640 1 --2- 172.21.15.42:0/3282794955 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f94dc0a2c80 0x7f94dc0a5140 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f94f0020000 tx=0x7f94f001a760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:35.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.199+0000 7f94ffc4e740 1 -- 172.21.15.42:0/3295192831 shutdown_connections 2024-08-26T00:11:35.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.199+0000 7f94ffc4e740 1 --2- 172.21.15.42:0/3295192831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc593fc10 0x562fc5942000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.199+0000 7f94ffc4e740 1 --2- 172.21.15.42:0/3295192831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562fc5935350 0x562fc593f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.200+0000 7f94ffc4e740 1 --2- 172.21.15.42:0/3295192831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc5934a30 0x562fc5934e10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.200+0000 7f94ffc4e740 1 -- 172.21.15.42:0/3295192831 >> 172.21.15.42:0/3295192831 conn(0x562fc5930fc0 msgr2=0x562fc59313a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:35.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.200+0000 7f94ffc4e740 1 -- 172.21.15.42:0/3295192831 shutdown_connections 2024-08-26T00:11:35.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.200+0000 7f94ffc4e740 1 -- 172.21.15.42:0/3295192831 wait complete. 2024-08-26T00:11:35.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.200+0000 7f94ffc4e740 1 -- start start 2024-08-26T00:11:35.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.201+0000 7f94ffc4e740 1 Processor -- start 2024-08-26T00:11:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.201+0000 7f94ffc4e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562fc5934a30 0x562fc593f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.201+0000 7f94ffc4e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc5935350 0x562fc593ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.201+0000 7f94ffc4e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc593fc10 0x562fc593d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.201+0000 7f94ffc4e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562fc59427e0 con 0x562fc5935350 2024-08-26T00:11:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.201+0000 7f94ffc4e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562fc5855de0 con 0x562fc5934a30 2024-08-26T00:11:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.201+0000 7f94ffc4e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562fc5942960 con 0x562fc593fc10 2024-08-26T00:11:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.201+0000 7f94ffc4e740 10 client.0 _ll_register_callbacks cb 0x562fc58447b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:11:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.202+0000 7f94f5e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562fc5934a30 0x562fc593f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:35.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.202+0000 7f94f5e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562fc5934a30 0x562fc593f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:46486/0 (socket says 172.21.15.42:46486) 2024-08-26T00:11:35.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.202+0000 7f94f5e00640 1 -- 172.21.15.42:0/1526354319 learned_addr learned my addr 172.21.15.42:0/1526354319 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:35.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.202+0000 7f94f5400640 1 --2- 172.21.15.42:0/1526354319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc5935350 0x562fc593ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:35.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.202+0000 7f94f6800640 1 --2- 172.21.15.42:0/1526354319 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc593fc10 0x562fc593d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:35.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.202+0000 7f94f5e00640 1 -- 172.21.15.42:0/1526354319 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc593fc10 msgr2=0x562fc593d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:35.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.202+0000 7f94f5e00640 1 --2- 172.21.15.42:0/1526354319 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc593fc10 0x562fc593d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.202+0000 7f94f5e00640 1 -- 172.21.15.42:0/1526354319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc5935350 msgr2=0x562fc593ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.202+0000 7f94f5e00640 1 --2- 172.21.15.42:0/1526354319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc5935350 0x562fc593ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.202+0000 7f94f5e00640 1 -- 172.21.15.42:0/1526354319 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fc594bcb0 con 0x562fc5934a30 2024-08-26T00:11:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.202+0000 7f94f5400640 1 --2- 172.21.15.42:0/1526354319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc5935350 0x562fc593ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:11:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.203+0000 7f94f5e00640 1 --2- 172.21.15.42:0/1526354319 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562fc5934a30 0x562fc593f6c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009900 tx=0x7f94e8005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a862f334cf10e496 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.203+0000 7f94d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:11:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.203+0000 7f94d7e00640 1 -- 172.21.15.42:0/1526354319 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e8035030 con 0x562fc5934a30 2024-08-26T00:11:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.203+0000 7f94d7e00640 1 -- 172.21.15.42:0/1526354319 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f94e80048c0 con 0x562fc5934a30 2024-08-26T00:11:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.203+0000 7f94ffc4e740 1 -- 172.21.15.42:0/1526354319 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94f000fe00 con 0x562fc5934a30 2024-08-26T00:11:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.203+0000 7f94d7e00640 1 -- 172.21.15.42:0/1526354319 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f94e8005d50 con 0x562fc5934a30 2024-08-26T00:11:35.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.203+0000 7f94ffc4e740 10 client.26018 fetch_fsmap learned FSMap version 31 2024-08-26T00:11:35.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.203+0000 7f94ffc4e740 1 -- 172.21.15.42:0/1526354319 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562fc594e540 con 0x562fc5934a30 2024-08-26T00:11:35.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.204+0000 7f94d7e00640 1 -- 172.21.15.42:0/1526354319 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94e80035f0 con 0x562fc5934a30 2024-08-26T00:11:35.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.204+0000 7f94d7e00640 1 -- 172.21.15.42:0/1526354319 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f94e80315b0 con 0x562fc5934a30 2024-08-26T00:11:35.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.204+0000 7f94ffc4e740 10 client.26018 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:11:35.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.204+0000 7f94ffc4e740 10 client.26018 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:11:35.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.204+0000 7f94ffc4e740 20 client.26018 populate_metadata read hostname 'smithi042' 2024-08-26T00:11:35.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.204+0000 7f94ffc4e740 1 --2- 172.21.15.42:0/1526354319 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x562fc594fa50 0x562fc5951eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:35.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.204+0000 7f94ffc4e740 4 client.26018 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:11:35.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.204+0000 7f94ffc4e740 1 -- 172.21.15.42:0/1526354319 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f94f000fe00 con 0x562fc594fa50 2024-08-26T00:11:35.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.204+0000 7f94f5400640 1 --2- 172.21.15.42:0/1526354319 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x562fc594fa50 0x562fc5951eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:35.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.205+0000 7f94f5400640 1 --2- 172.21.15.42:0/1526354319 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x562fc594fa50 0x562fc5951eb0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f06db3fe22d4ca2d server_cookie=66fd6357ef167153 in_seq=0 out_seq=0 2024-08-26T00:11:35.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.205+0000 7f94d7e00640 10 client.26018 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:11:35.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.205+0000 7f94d7e00640 1 -- 172.21.15.42:0/1526354319 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f94f000fe00 con 0x562fc594fa50 2024-08-26T00:11:35.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.205+0000 7f94d7e00640 10 client.26018 handle_command_reply: tid=0 2024-08-26T00:11:35.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.206+0000 7f94ffc4e740 1 client.26018 shutdown 2024-08-26T00:11:35.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.206+0000 7f94ffc4e740 1 -- 172.21.15.42:0/1526354319 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562fc5934a30 msgr2=0x562fc593f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:35.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.206+0000 7f94ffc4e740 1 --2- 172.21.15.42:0/1526354319 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562fc5934a30 0x562fc593f6c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009900 tx=0x7f94e8005270 comp rx=0 tx=0).stop 2024-08-26T00:11:35.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.206+0000 7f94ffc4e740 1 -- 172.21.15.42:0/1526354319 shutdown_connections 2024-08-26T00:11:35.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.206+0000 7f94ffc4e740 1 --2- 172.21.15.42:0/1526354319 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc593fc10 0x562fc593d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.206+0000 7f94ffc4e740 1 --2- 172.21.15.42:0/1526354319 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x562fc594fa50 0x562fc5951eb0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.206+0000 7f94ffc4e740 1 --2- 172.21.15.42:0/1526354319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc5935350 0x562fc593ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.206+0000 7f94ffc4e740 1 --2- 172.21.15.42:0/1526354319 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562fc5934a30 0x562fc593f6c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.206+0000 7f94d7e00640 0 client.26018 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:11:35.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.206+0000 7f94ffc4e740 1 -- 172.21.15.42:0/1526354319 >> 172.21.15.42:0/1526354319 conn(0x562fc5930fc0 msgr2=0x562fc5936ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:35.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.206+0000 7f94ffc4e740 1 -- 172.21.15.42:0/1526354319 shutdown_connections 2024-08-26T00:11:35.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.206+0000 7f94ffc4e740 1 -- 172.21.15.42:0/1526354319 wait complete. 2024-08-26T00:11:35.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.206+0000 7f94ffc4e740 20 client.26018 trim_cache size 0 max 16384 2024-08-26T00:11:35.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.220+0000 7f94ffc4e740 1 Processor -- start 2024-08-26T00:11:35.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.220+0000 7f94ffc4e740 1 -- start start 2024-08-26T00:11:35.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.221+0000 7f94ffc4e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc5934a30 0x562fc593c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:35.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.221+0000 7f94ffc4e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562fc5935350 0x562fc593b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:35.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.221+0000 7f94ffc4e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc593fc10 0x562fc593b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:35.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.221+0000 7f94ffc4e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f94d8010e20 con 0x562fc593fc10 2024-08-26T00:11:35.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.221+0000 7f94ffc4e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f94d800e630 con 0x562fc5935350 2024-08-26T00:11:35.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.221+0000 7f94ffc4e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f94d800c460 con 0x562fc5934a30 2024-08-26T00:11:35.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.221+0000 7f94f5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc5934a30 0x562fc593c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:35.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.221+0000 7f94f6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc593fc10 0x562fc593b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:35.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.221+0000 7f94f5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc5934a30 0x562fc593c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:55482/0 (socket says 172.21.15.42:55482) 2024-08-26T00:11:35.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.221+0000 7f94f5e00640 1 -- 172.21.15.42:0/3035040828 learned_addr learned my addr 172.21.15.42:0/3035040828 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:35.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.221+0000 7f94f5400640 1 --2- 172.21.15.42:0/3035040828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562fc5935350 0x562fc593b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:35.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.221+0000 7f94f5e00640 1 -- 172.21.15.42:0/3035040828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562fc5935350 msgr2=0x562fc593b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:35.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.221+0000 7f94f5e00640 1 --2- 172.21.15.42:0/3035040828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562fc5935350 0x562fc593b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.221+0000 7f94f5e00640 1 -- 172.21.15.42:0/3035040828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc593fc10 msgr2=0x562fc593b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:35.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.221+0000 7f94f5e00640 1 --2- 172.21.15.42:0/3035040828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc593fc10 0x562fc593b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.221+0000 7f94f5e00640 1 -- 172.21.15.42:0/3035040828 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fc5935180 con 0x562fc5934a30 2024-08-26T00:11:35.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.222+0000 7f94f5e00640 1 --2- 172.21.15.42:0/3035040828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc5934a30 0x562fc593c2d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f94e802a9a0 tx=0x7f94e802a480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d69dcac4c862d894 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:35.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.222+0000 7f94e2a00640 1 -- 172.21.15.42:0/3035040828 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e8035030 con 0x562fc5934a30 2024-08-26T00:11:35.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.222+0000 7f94e2a00640 1 -- 172.21.15.42:0/3035040828 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94e8004da0 con 0x562fc5934a30 2024-08-26T00:11:35.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.222+0000 7f94e2a00640 1 -- 172.21.15.42:0/3035040828 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e8003a10 con 0x562fc5934a30 2024-08-26T00:11:35.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.223+0000 7f94ffc4e740 1 -- 172.21.15.42:0/3035040828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc5934a30 msgr2=0x562fc593c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:35.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.223+0000 7f94ffc4e740 1 --2- 172.21.15.42:0/3035040828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc5934a30 0x562fc593c2d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f94e802a9a0 tx=0x7f94e802a480 comp rx=0 tx=0).stop 2024-08-26T00:11:35.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.223+0000 7f94ffc4e740 1 -- 172.21.15.42:0/3035040828 shutdown_connections 2024-08-26T00:11:35.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.223+0000 7f94ffc4e740 1 --2- 172.21.15.42:0/3035040828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc593fc10 0x562fc593b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.223+0000 7f94ffc4e740 1 --2- 172.21.15.42:0/3035040828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562fc5935350 0x562fc593b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.223+0000 7f94ffc4e740 1 --2- 172.21.15.42:0/3035040828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc5934a30 0x562fc593c2d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.223+0000 7f94ffc4e740 1 -- 172.21.15.42:0/3035040828 >> 172.21.15.42:0/3035040828 conn(0x562fc5930fc0 msgr2=0x562fc59313a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:35.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.223+0000 7f94ffc4e740 1 -- 172.21.15.42:0/3035040828 shutdown_connections 2024-08-26T00:11:35.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.223+0000 7f94ffc4e740 1 -- 172.21.15.42:0/3035040828 wait complete. 2024-08-26T00:11:35.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.223+0000 7f94ffc4e740 1 -- start start 2024-08-26T00:11:35.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.223+0000 7f94ffc4e740 1 Processor -- start 2024-08-26T00:11:35.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.224+0000 7f94ffc4e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc5934a30 0x562fc5940e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:35.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.224+0000 7f94ffc4e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562fc5935350 0x562fc5941350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:35.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.224+0000 7f94ffc4e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc593fc10 0x562fc5941890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:35.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.224+0000 7f94ffc4e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f94d800caf0 con 0x562fc593fc10 2024-08-26T00:11:35.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.224+0000 7f94ffc4e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f94d800df60 con 0x562fc5935350 2024-08-26T00:11:35.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.224+0000 7f94ffc4e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f94d800d1c0 con 0x562fc5934a30 2024-08-26T00:11:35.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.224+0000 7f94ffc4e740 10 client.0 _ll_register_callbacks cb 0x7f94f00093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:11:35.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.224+0000 7f94f5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc5934a30 0x562fc5940e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:35.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.224+0000 7f94f5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc5934a30 0x562fc5940e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:55494/0 (socket says 172.21.15.42:55494) 2024-08-26T00:11:35.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.224+0000 7f94f5e00640 1 -- 172.21.15.42:0/224551091 learned_addr learned my addr 172.21.15.42:0/224551091 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:35.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.224+0000 7f94f5400640 1 --2- 172.21.15.42:0/224551091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562fc5935350 0x562fc5941350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:35.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.224+0000 7f94f6800640 1 --2- 172.21.15.42:0/224551091 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc593fc10 0x562fc5941890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:35.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.225+0000 7f94f5e00640 1 -- 172.21.15.42:0/224551091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562fc5935350 msgr2=0x562fc5941350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:35.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.225+0000 7f94f5e00640 1 --2- 172.21.15.42:0/224551091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562fc5935350 0x562fc5941350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.225+0000 7f94f5e00640 1 -- 172.21.15.42:0/224551091 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc593fc10 msgr2=0x562fc5941890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:35.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.225+0000 7f94f5e00640 1 --2- 172.21.15.42:0/224551091 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc593fc10 0x562fc5941890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.225+0000 7f94f5e00640 1 -- 172.21.15.42:0/224551091 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fc59461d0 con 0x562fc5934a30 2024-08-26T00:11:35.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.225+0000 7f94f5400640 1 --2- 172.21.15.42:0/224551091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562fc5935350 0x562fc5941350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:11:35.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.225+0000 7f94f6800640 1 --2- 172.21.15.42:0/224551091 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc593fc10 0x562fc5941890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:11:35.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.225+0000 7f94f5e00640 1 --2- 172.21.15.42:0/224551091 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc5934a30 0x562fc5940e10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f94e8031900 tx=0x7f94e80038c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1b0745f6891e9af server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:35.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.225+0000 7f94d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:11:35.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.225+0000 7f94d7e00640 1 -- 172.21.15.42:0/224551091 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e8035040 con 0x562fc5934a30 2024-08-26T00:11:35.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.225+0000 7f94d7e00640 1 -- 172.21.15.42:0/224551091 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f94e8003cc0 con 0x562fc5934a30 2024-08-26T00:11:35.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.225+0000 7f94ffc4e740 1 -- 172.21.15.42:0/224551091 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94e8004da0 con 0x562fc5934a30 2024-08-26T00:11:35.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.226+0000 7f94d7e00640 1 -- 172.21.15.42:0/224551091 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f94e8068050 con 0x562fc5934a30 2024-08-26T00:11:35.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.226+0000 7f94ffc4e740 10 client.25993 fetch_fsmap learned FSMap version 31 2024-08-26T00:11:35.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.226+0000 7f94ffc4e740 1 -- 172.21.15.42:0/224551091 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562fc59baab0 con 0x562fc5934a30 2024-08-26T00:11:35.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.226+0000 7f94d7e00640 1 -- 172.21.15.42:0/224551091 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94e8004da0 con 0x562fc5934a30 2024-08-26T00:11:35.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.227+0000 7f94d7e00640 1 -- 172.21.15.42:0/224551091 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f94e805f070 con 0x562fc5934a30 2024-08-26T00:11:35.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.227+0000 7f94ffc4e740 10 client.25993 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:11:35.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.227+0000 7f94ffc4e740 10 client.25993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:11:35.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.227+0000 7f94ffc4e740 20 client.25993 populate_metadata read hostname 'smithi042' 2024-08-26T00:11:35.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.227+0000 7f94ffc4e740 1 --2- 172.21.15.42:0/224551091 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x562fc59baed0 0x562fc59bd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:35.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.227+0000 7f94ffc4e740 4 client.25993 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:11:35.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.227+0000 7f94ffc4e740 1 -- 172.21.15.42:0/224551091 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562fc58a84a0 con 0x562fc59baed0 2024-08-26T00:11:35.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.227+0000 7f94f5400640 1 --2- 172.21.15.42:0/224551091 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x562fc59baed0 0x562fc59bd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:35.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.227+0000 7f94f5400640 1 --2- 172.21.15.42:0/224551091 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x562fc59baed0 0x562fc59bd2f0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4066673b0496d53 server_cookie=8f0d598daeb1a9ae in_seq=0 out_seq=0 2024-08-26T00:11:35.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.227+0000 7f94d7e00640 10 client.25993 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:11:35.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.228+0000 7f94d7e00640 1 -- 172.21.15.42:0/224551091 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562fc58a84a0 con 0x562fc59baed0 2024-08-26T00:11:35.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.228+0000 7f94d7e00640 10 client.25993 handle_command_reply: tid=0 2024-08-26T00:11:35.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.228+0000 7f94ffc4e740 1 client.25993 shutdown 2024-08-26T00:11:35.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.228+0000 7f94ffc4e740 1 -- 172.21.15.42:0/224551091 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc5934a30 msgr2=0x562fc5940e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:35.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.228+0000 7f94ffc4e740 1 --2- 172.21.15.42:0/224551091 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc5934a30 0x562fc5940e10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f94e8031900 tx=0x7f94e80038c0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.228+0000 7f94ffc4e740 1 -- 172.21.15.42:0/224551091 shutdown_connections 2024-08-26T00:11:35.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.228+0000 7f94ffc4e740 1 --2- 172.21.15.42:0/224551091 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x562fc59baed0 0x562fc59bd2f0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.228+0000 7f94ffc4e740 1 --2- 172.21.15.42:0/224551091 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562fc593fc10 0x562fc5941890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.228+0000 7f94ffc4e740 1 --2- 172.21.15.42:0/224551091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562fc5935350 0x562fc5941350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.228+0000 7f94ffc4e740 1 --2- 172.21.15.42:0/224551091 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562fc5934a30 0x562fc5940e10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.228+0000 7f94d7e00640 0 client.25993 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:11:35.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.228+0000 7f94ffc4e740 1 -- 172.21.15.42:0/224551091 >> 172.21.15.42:0/224551091 conn(0x562fc5930fc0 msgr2=0x562fc593b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:35.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.228+0000 7f94ffc4e740 1 -- 172.21.15.42:0/224551091 shutdown_connections 2024-08-26T00:11:35.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.228+0000 7f94ffc4e740 1 -- 172.21.15.42:0/224551091 wait complete. 2024-08-26T00:11:35.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.228+0000 7f94ffc4e740 20 client.25993 trim_cache size 0 max 16384 2024-08-26T00:11:35.235 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:11:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.229+0000 7f94f7200640 1 -- 172.21.15.42:0/3282794955 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f94dc0a2c80 msgr2=0x7f94dc0a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.229+0000 7f94f7200640 1 --2- 172.21.15.42:0/3282794955 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f94dc0a2c80 0x7f94dc0a5140 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f94f0020000 tx=0x7f94f001a760 comp rx=0 tx=0).stop 2024-08-26T00:11:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.229+0000 7f94f7200640 1 -- 172.21.15.42:0/3282794955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94f8074c50 msgr2=0x7f94f81a4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.229+0000 7f94f7200640 1 --2- 172.21.15.42:0/3282794955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94f8074c50 0x7f94f81a4950 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f94e400b3f0 tx=0x7f94e400b8b0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.229+0000 7f94f7200640 1 -- 172.21.15.42:0/3282794955 shutdown_connections 2024-08-26T00:11:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.229+0000 7f94f7200640 1 --2- 172.21.15.42:0/3282794955 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f94dc0a2c80 0x7f94dc0a5140 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.229+0000 7f94f7200640 1 --2- 172.21.15.42:0/3282794955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94f8112780 0x7f94f819e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.229+0000 7f94f7200640 1 --2- 172.21.15.42:0/3282794955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94f8074c50 0x7f94f81a4950 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.229+0000 7f94f7200640 1 --2- 172.21.15.42:0/3282794955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94f8074330 0x7f94f81a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.229+0000 7f94f7200640 1 -- 172.21.15.42:0/3282794955 >> 172.21.15.42:0/3282794955 conn(0x7f94f80fd4b0 msgr2=0x7f94f80ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.229+0000 7f94f7200640 1 -- 172.21.15.42:0/3282794955 shutdown_connections 2024-08-26T00:11:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:35.229+0000 7f94f7200640 1 -- 172.21.15.42:0/3282794955 wait complete. 2024-08-26T00:11:36.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:36 smithi043 ceph-mon[22091]: pgmap v611: 97 pgs: 97 active+clean; 1.9 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 619 op/s 2024-08-26T00:11:36.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:36 smithi042 ceph-mon[17225]: pgmap v611: 97 pgs: 97 active+clean; 1.9 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 619 op/s 2024-08-26T00:11:36.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:36 smithi181 ceph-mon[22102]: pgmap v611: 97 pgs: 97 active+clean; 1.9 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 619 op/s 2024-08-26T00:11:37.244 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-26T00:11:37.245 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-26T00:11:37.676 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:11:38.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.272+0000 7f3fc0e00640 1 -- 172.21.15.42:0/836911785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fbc102ac0 msgr2=0x7f3fbc102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:38.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.272+0000 7f3fc0e00640 1 --2- 172.21.15.42:0/836911785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fbc102ac0 0x7f3fbc102ea0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4009be0 tx=0x7f3fb402a750 comp rx=0 tx=0).stop 2024-08-26T00:11:38.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.273+0000 7f3fc0e00640 1 -- 172.21.15.42:0/836911785 shutdown_connections 2024-08-26T00:11:38.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.273+0000 7f3fc0e00640 1 --2- 172.21.15.42:0/836911785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3fbc10bef0 0x7f3fbc10e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.273+0000 7f3fc0e00640 1 --2- 172.21.15.42:0/836911785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fbc1033e0 0x7f3fbc10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.273+0000 7f3fc0e00640 1 --2- 172.21.15.42:0/836911785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fbc102ac0 0x7f3fbc102ea0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.273+0000 7f3fc0e00640 1 -- 172.21.15.42:0/836911785 >> 172.21.15.42:0/836911785 conn(0x7f3fbc0fc520 msgr2=0x7f3fbc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:38.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.273+0000 7f3fc0e00640 1 -- 172.21.15.42:0/836911785 shutdown_connections 2024-08-26T00:11:38.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.273+0000 7f3fc0e00640 1 -- 172.21.15.42:0/836911785 wait complete. 2024-08-26T00:11:38.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.274+0000 7f3fc0e00640 1 Processor -- start 2024-08-26T00:11:38.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.274+0000 7f3fc0e00640 1 -- start start 2024-08-26T00:11:38.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.275+0000 7f3fc0e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fbc102ac0 0x7f3fbc19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:38.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.275+0000 7f3fc0e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fbc1033e0 0x7f3fbc10ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:38.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.275+0000 7f3fc0e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3fbc10bef0 0x7f3fbc10b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:38.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.275+0000 7f3fc0e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc111cf0 con 0x7f3fbc1033e0 2024-08-26T00:11:38.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.275+0000 7f3fc0e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc111b70 con 0x7f3fbc102ac0 2024-08-26T00:11:38.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.275+0000 7f3fc0e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc111e70 con 0x7f3fbc10bef0 2024-08-26T00:11:38.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.275+0000 7f3fb9e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fbc102ac0 0x7f3fbc19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:38.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.275+0000 7f3fba800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3fbc10bef0 0x7f3fbc10b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:38.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.275+0000 7f3fb9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fbc1033e0 0x7f3fbc10ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:38.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.276+0000 7f3fb9e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fbc102ac0 0x7f3fbc19ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:46530/0 (socket says 172.21.15.42:46530) 2024-08-26T00:11:38.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.276+0000 7f3fb9e00640 1 -- 172.21.15.42:0/3097819759 learned_addr learned my addr 172.21.15.42:0/3097819759 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:38.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.276+0000 7f3fb9400640 1 -- 172.21.15.42:0/3097819759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3fbc10bef0 msgr2=0x7f3fbc10b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:38.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.276+0000 7f3fb9400640 1 --2- 172.21.15.42:0/3097819759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3fbc10bef0 0x7f3fbc10b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.276+0000 7f3fb9400640 1 -- 172.21.15.42:0/3097819759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fbc102ac0 msgr2=0x7f3fbc19ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:38.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.276+0000 7f3fb9400640 1 --2- 172.21.15.42:0/3097819759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fbc102ac0 0x7f3fbc19ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.276+0000 7f3fb9400640 1 -- 172.21.15.42:0/3097819759 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fbc10b580 con 0x7f3fbc1033e0 2024-08-26T00:11:38.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.276+0000 7f3fba800640 1 --2- 172.21.15.42:0/3097819759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3fbc10bef0 0x7f3fbc10b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:11:38.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.276+0000 7f3fb9e00640 1 --2- 172.21.15.42:0/3097819759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fbc102ac0 0x7f3fbc19ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:11:38.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.277+0000 7f3fb9400640 1 --2- 172.21.15.42:0/3097819759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fbc1033e0 0x7f3fbc10ab00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800e7a0 tx=0x7f3fa800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:38.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.277+0000 7f3fb2a00640 1 -- 172.21.15.42:0/3097819759 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa800ccc0 con 0x7f3fbc1033e0 2024-08-26T00:11:38.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.277+0000 7f3fc0e00640 1 -- 172.21.15.42:0/3097819759 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fbc10b870 con 0x7f3fbc1033e0 2024-08-26T00:11:38.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.277+0000 7f3fb2a00640 1 -- 172.21.15.42:0/3097819759 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fa8009530 con 0x7f3fbc1033e0 2024-08-26T00:11:38.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.277+0000 7f3fb2a00640 1 -- 172.21.15.42:0/3097819759 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa8018880 con 0x7f3fbc1033e0 2024-08-26T00:11:38.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.278+0000 7f3fc0e00640 1 -- 172.21.15.42:0/3097819759 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fbc19ab80 con 0x7f3fbc1033e0 2024-08-26T00:11:38.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.283+0000 7f3fc3a19740 1 Processor -- start 2024-08-26T00:11:38.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.284+0000 7f3fc3a19740 1 -- start start 2024-08-26T00:11:38.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.284+0000 7f3fc3a19740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b885dd30 0x55d3b885e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:38.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.284+0000 7f3fb2a00640 1 -- 172.21.15.42:0/3097819759 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3fa8018a20 con 0x7f3fbc1033e0 2024-08-26T00:11:38.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.284+0000 7f3fba800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b885dd30 0x55d3b885e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:38.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.284+0000 7f3fba800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b885dd30 0x55d3b885e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:46546/0 (socket says 172.21.15.42:46546) 2024-08-26T00:11:38.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.284+0000 7f3fc3a19740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b885e650 0x55d3b88689d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:38.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.285+0000 7f3fc3a19740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3b8868f10 0x55d3b886b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:38.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.285+0000 7f3fc3a19740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d3b87c4e30 con 0x55d3b8868f10 2024-08-26T00:11:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.285+0000 7f3fc3a19740 1 -- 172.21.15.42:0/876676409 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d3b875c3c0 con 0x55d3b885dd30 2024-08-26T00:11:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.285+0000 7f3fba800640 1 -- 172.21.15.42:0/876676409 learned_addr learned my addr 172.21.15.42:0/876676409 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.285+0000 7f3fc3a19740 1 -- 172.21.15.42:0/876676409 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d3b87c0df0 con 0x55d3b885e650 2024-08-26T00:11:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.285+0000 7f3fb9400640 1 --2- 172.21.15.42:0/876676409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3b8868f10 0x55d3b886b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.286+0000 7f3fb9400640 1 -- 172.21.15.42:0/876676409 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b885e650 msgr2=0x55d3b88689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.285+0000 7f3fb9e00640 1 --2- 172.21.15.42:0/876676409 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b885e650 0x55d3b88689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.287+0000 7f3fb9400640 1 --2- 172.21.15.42:0/876676409 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b885e650 0x55d3b88689d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.287+0000 7f3fb9400640 1 -- 172.21.15.42:0/876676409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b885dd30 msgr2=0x55d3b885e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.287+0000 7f3fb9400640 1 --2- 172.21.15.42:0/876676409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b885dd30 0x55d3b885e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.287+0000 7f3fb9400640 1 -- 172.21.15.42:0/876676409 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3b85366a0 con 0x55d3b8868f10 2024-08-26T00:11:38.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.287+0000 7f3fb9e00640 1 --2- 172.21.15.42:0/876676409 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b885e650 0x55d3b88689d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:11:38.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.287+0000 7f3fba800640 1 --2- 172.21.15.42:0/876676409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b885dd30 0x55d3b885e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:11:38.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.288+0000 7f3fb2a00640 1 --2- 172.21.15.42:0/3097819759 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3fa00a2c40 0x7f3fa00a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:38.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.288+0000 7f3fb2a00640 1 -- 172.21.15.42:0/3097819759 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f3fa80cf420 con 0x7f3fbc1033e0 2024-08-26T00:11:38.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.288+0000 7f3fba800640 1 --2- 172.21.15.42:0/3097819759 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3fa00a2c40 0x7f3fa00a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:38.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.288+0000 7f3fb9400640 1 --2- 172.21.15.42:0/876676409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3b8868f10 0x55d3b886b300 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3fa80cceb0 tx=0x7f3fa80d7a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0582d3bf8c16cb server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.289+0000 7f3fa7400640 1 -- 172.21.15.42:0/876676409 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa8097ee0 con 0x55d3b8868f10 2024-08-26T00:11:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.289+0000 7f3fa7400640 1 -- 172.21.15.42:0/876676409 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fa809c340 con 0x55d3b8868f10 2024-08-26T00:11:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.289+0000 7f3fa7400640 1 -- 172.21.15.42:0/876676409 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa800ce60 con 0x55d3b8868f10 2024-08-26T00:11:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.289+0000 7f3fba800640 1 --2- 172.21.15.42:0/3097819759 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3fa00a2c40 0x7f3fa00a5100 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0096c0 tx=0x7f3fac009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.290+0000 7f3fc3a19740 1 -- 172.21.15.42:0/876676409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3b8868f10 msgr2=0x55d3b886b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.290+0000 7f3fc3a19740 1 --2- 172.21.15.42:0/876676409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3b8868f10 0x55d3b886b300 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3fa80cceb0 tx=0x7f3fa80d7a10 comp rx=0 tx=0).stop 2024-08-26T00:11:38.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.291+0000 7f3fc3a19740 1 -- 172.21.15.42:0/876676409 shutdown_connections 2024-08-26T00:11:38.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.291+0000 7f3fc3a19740 1 --2- 172.21.15.42:0/876676409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3b8868f10 0x55d3b886b300 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.291+0000 7f3fc3a19740 1 --2- 172.21.15.42:0/876676409 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b885e650 0x55d3b88689d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.291+0000 7f3fc3a19740 1 --2- 172.21.15.42:0/876676409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b885dd30 0x55d3b885e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.291+0000 7f3fc3a19740 1 -- 172.21.15.42:0/876676409 >> 172.21.15.42:0/876676409 conn(0x55d3b885a2c0 msgr2=0x55d3b885a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:38.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.291+0000 7f3fc3a19740 1 -- 172.21.15.42:0/876676409 shutdown_connections 2024-08-26T00:11:38.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.291+0000 7f3fc3a19740 1 -- 172.21.15.42:0/876676409 wait complete. 2024-08-26T00:11:38.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.292+0000 7f3fc3a19740 1 -- start start 2024-08-26T00:11:38.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.292+0000 7f3fc3a19740 1 Processor -- start 2024-08-26T00:11:38.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.293+0000 7f3fc3a19740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b885dd30 0x55d3b8865e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:38.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.293+0000 7f3fc3a19740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b885e650 0x55d3b8866370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:38.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.293+0000 7f3fc3a19740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3b8868f10 0x55d3b88668b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:38.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.293+0000 7f3fc3a19740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d3b886ba80 con 0x55d3b8868f10 2024-08-26T00:11:38.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.293+0000 7f3fc3a19740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d3b877fc30 con 0x55d3b885e650 2024-08-26T00:11:38.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.293+0000 7f3fc3a19740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d3b886bc00 con 0x55d3b885dd30 2024-08-26T00:11:38.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.293+0000 7f3fc3a19740 10 client.0 _ll_register_callbacks cb 0x55d3b84d3ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:11:38.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.294+0000 7f3fba800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3b8868f10 0x55d3b88668b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:38.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.294+0000 7f3fba800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3b8868f10 0x55d3b88668b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56424/0 (socket says 172.21.15.42:56424) 2024-08-26T00:11:38.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.294+0000 7f3fba800640 1 -- 172.21.15.42:0/1466262811 learned_addr learned my addr 172.21.15.42:0/1466262811 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:38.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.294+0000 7f3fb9400640 1 --2- 172.21.15.42:0/1466262811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b885e650 0x55d3b8866370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:38.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.294+0000 7f3fb9e00640 1 --2- 172.21.15.42:0/1466262811 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b885dd30 0x55d3b8865e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:38.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.295+0000 7f3fb9400640 1 -- 172.21.15.42:0/1466262811 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b885dd30 msgr2=0x55d3b8865e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:38.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.295+0000 7f3fb9400640 1 --2- 172.21.15.42:0/1466262811 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b885dd30 0x55d3b8865e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.295+0000 7f3fb9400640 1 -- 172.21.15.42:0/1466262811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3b8868f10 msgr2=0x55d3b88668b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:38.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.295+0000 7f3fb9400640 1 --2- 172.21.15.42:0/1466262811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3b8868f10 0x55d3b88668b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.295+0000 7f3fb9400640 1 -- 172.21.15.42:0/1466262811 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3b878bdd0 con 0x55d3b885e650 2024-08-26T00:11:38.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.295+0000 7f3fb9400640 1 --2- 172.21.15.42:0/1466262811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b885e650 0x55d3b8866370 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3fa809c4f0 tx=0x7f3fa80d2c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a684f70c2cf8f78 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:38.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.295+0000 7f3f9be00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:11:38.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.296+0000 7f3f9be00640 1 -- 172.21.15.42:0/1466262811 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa809b5a0 con 0x55d3b885e650 2024-08-26T00:11:38.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.296+0000 7f3f9be00640 1 -- 172.21.15.42:0/1466262811 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f3fa8010aa0 con 0x55d3b885e650 2024-08-26T00:11:38.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.296+0000 7f3fc3a19740 1 -- 172.21.15.42:0/1466262811 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fa809c340 con 0x55d3b885e650 2024-08-26T00:11:38.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.296+0000 7f3f9be00640 1 -- 172.21.15.42:0/1466262811 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3fa80b9050 con 0x55d3b885e650 2024-08-26T00:11:38.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.296+0000 7f3fc3a19740 10 client.26036 fetch_fsmap learned FSMap version 31 2024-08-26T00:11:38.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.296+0000 7f3fc3a19740 1 -- 172.21.15.42:0/1466262811 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d3b886ba80 con 0x55d3b885e650 2024-08-26T00:11:38.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.296+0000 7f3f9be00640 1 -- 172.21.15.42:0/1466262811 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fa809c340 con 0x55d3b885e650 2024-08-26T00:11:38.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.297+0000 7f3f9be00640 1 -- 172.21.15.42:0/1466262811 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f3fa809bf30 con 0x55d3b885e650 2024-08-26T00:11:38.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.297+0000 7f3fc3a19740 10 client.26036 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:11:38.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.297+0000 7f3fc3a19740 10 client.26036 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:11:38.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.297+0000 7f3fc3a19740 20 client.26036 populate_metadata read hostname 'smithi042' 2024-08-26T00:11:38.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.297+0000 7f3fc3a19740 1 --2- 172.21.15.42:0/1466262811 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d3b88787e0 0x55d3b887abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:38.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.297+0000 7f3fc3a19740 4 client.26036 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:11:38.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.297+0000 7f3fc3a19740 1 -- 172.21.15.42:0/1466262811 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3b87d23a0 con 0x55d3b88787e0 2024-08-26T00:11:38.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.297+0000 7f3fb9e00640 1 --2- 172.21.15.42:0/1466262811 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d3b88787e0 0x55d3b887abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:38.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.298+0000 7f3fb9e00640 1 --2- 172.21.15.42:0/1466262811 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d3b88787e0 0x55d3b887abd0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea64f7586bc58ba6 server_cookie=24c5ca6957c0e65e in_seq=0 out_seq=0 2024-08-26T00:11:38.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.298+0000 7f3f9be00640 10 client.26036 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:11:38.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.299+0000 7f3f9be00640 1 -- 172.21.15.42:0/1466262811 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d3b87d23a0 con 0x55d3b88787e0 2024-08-26T00:11:38.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.299+0000 7f3f9be00640 10 client.26036 handle_command_reply: tid=0 2024-08-26T00:11:38.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.299+0000 7f3fc3a19740 1 client.26036 shutdown 2024-08-26T00:11:38.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.299+0000 7f3fc3a19740 1 -- 172.21.15.42:0/1466262811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b885e650 msgr2=0x55d3b8866370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:38.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.299+0000 7f3fc3a19740 1 --2- 172.21.15.42:0/1466262811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b885e650 0x55d3b8866370 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3fa809c4f0 tx=0x7f3fa80d2c30 comp rx=0 tx=0).stop 2024-08-26T00:11:38.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.299+0000 7f3fc3a19740 1 -- 172.21.15.42:0/1466262811 shutdown_connections 2024-08-26T00:11:38.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.299+0000 7f3fc3a19740 1 --2- 172.21.15.42:0/1466262811 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d3b88787e0 0x55d3b887abd0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.300+0000 7f3fc3a19740 1 --2- 172.21.15.42:0/1466262811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3b8868f10 0x55d3b88668b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.300+0000 7f3fc3a19740 1 --2- 172.21.15.42:0/1466262811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b885e650 0x55d3b8866370 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.300+0000 7f3fc3a19740 1 --2- 172.21.15.42:0/1466262811 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b885dd30 0x55d3b8865e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.300+0000 7f3fc3a19740 1 -- 172.21.15.42:0/1466262811 >> 172.21.15.42:0/1466262811 conn(0x55d3b885a2c0 msgr2=0x55d3b885ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:38.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.300+0000 7f3f9be00640 0 client.26036 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:11:38.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.300+0000 7f3fc3a19740 1 -- 172.21.15.42:0/1466262811 shutdown_connections 2024-08-26T00:11:38.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.300+0000 7f3fc3a19740 1 -- 172.21.15.42:0/1466262811 wait complete. 2024-08-26T00:11:38.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.300+0000 7f3fc3a19740 20 client.26036 trim_cache size 0 max 16384 2024-08-26T00:11:38.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.329+0000 7f3fc3a19740 1 Processor -- start 2024-08-26T00:11:38.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.329+0000 7f3fc3a19740 1 -- start start 2024-08-26T00:11:38.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.330+0000 7f3fc3a19740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3b885dd30 0x55d3b8867c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:38.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.330+0000 7f3fc3a19740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b8868f10 0x55d3b88802c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:38.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.330+0000 7f3fc3a19740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b88681d0 0x55d3b8880800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:38.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.330+0000 7f3fc3a19740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc1bebe0 con 0x55d3b885dd30 2024-08-26T00:11:38.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.330+0000 7f3fc3a19740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc1bc3f0 con 0x55d3b88681d0 2024-08-26T00:11:38.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.330+0000 7f3fc3a19740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc1ba220 con 0x55d3b8868f10 2024-08-26T00:11:38.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.330+0000 7f3fb9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3b885dd30 0x55d3b8867c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:38.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.330+0000 7f3fba800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b88681d0 0x55d3b8880800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:38.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.330+0000 7f3fb9400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b8868f10 0x55d3b88802c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:38.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.330+0000 7f3fb9400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b8868f10 0x55d3b88802c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:55536/0 (socket says 172.21.15.42:55536) 2024-08-26T00:11:38.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.330+0000 7f3fb9400640 1 -- 172.21.15.42:0/466088713 learned_addr learned my addr 172.21.15.42:0/466088713 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:38.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.331+0000 7f3fb9400640 1 -- 172.21.15.42:0/466088713 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b88681d0 msgr2=0x55d3b8880800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:38.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.331+0000 7f3fb9400640 1 --2- 172.21.15.42:0/466088713 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b88681d0 0x55d3b8880800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.331+0000 7f3fb9400640 1 -- 172.21.15.42:0/466088713 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3b885dd30 msgr2=0x55d3b8867c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:38.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.331+0000 7f3fb9400640 1 --2- 172.21.15.42:0/466088713 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3b885dd30 0x55d3b8867c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.331+0000 7f3fb9400640 1 -- 172.21.15.42:0/466088713 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3b885af50 con 0x55d3b8868f10 2024-08-26T00:11:38.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.331+0000 7f3fb9400640 1 --2- 172.21.15.42:0/466088713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b8868f10 0x55d3b88802c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3fa809b940 tx=0x7f3fa809a150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ea8ccb59d8e6ad7 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:38.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.331+0000 7f3fa6a00640 1 -- 172.21.15.42:0/466088713 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa809b780 con 0x55d3b8868f10 2024-08-26T00:11:38.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.331+0000 7f3fa6a00640 1 -- 172.21.15.42:0/466088713 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fa809c340 con 0x55d3b8868f10 2024-08-26T00:11:38.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.332+0000 7f3fa6a00640 1 -- 172.21.15.42:0/466088713 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa809ba10 con 0x55d3b8868f10 2024-08-26T00:11:38.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.332+0000 7f3fc3a19740 1 -- 172.21.15.42:0/466088713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b8868f10 msgr2=0x55d3b88802c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:38.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.332+0000 7f3fc3a19740 1 --2- 172.21.15.42:0/466088713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b8868f10 0x55d3b88802c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3fa809b940 tx=0x7f3fa809a150 comp rx=0 tx=0).stop 2024-08-26T00:11:38.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.333+0000 7f3fc3a19740 1 -- 172.21.15.42:0/466088713 shutdown_connections 2024-08-26T00:11:38.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.333+0000 7f3fc3a19740 1 --2- 172.21.15.42:0/466088713 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b88681d0 0x55d3b8880800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.333+0000 7f3fc3a19740 1 --2- 172.21.15.42:0/466088713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b8868f10 0x55d3b88802c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.333+0000 7f3fc3a19740 1 --2- 172.21.15.42:0/466088713 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3b885dd30 0x55d3b8867c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.333+0000 7f3fc3a19740 1 -- 172.21.15.42:0/466088713 >> 172.21.15.42:0/466088713 conn(0x55d3b885a2c0 msgr2=0x55d3b8867580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:38.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.333+0000 7f3fc3a19740 1 -- 172.21.15.42:0/466088713 shutdown_connections 2024-08-26T00:11:38.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.333+0000 7f3fc3a19740 1 -- 172.21.15.42:0/466088713 wait complete. 2024-08-26T00:11:38.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.333+0000 7f3fc3a19740 1 -- start start 2024-08-26T00:11:38.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.334+0000 7f3fc3a19740 1 Processor -- start 2024-08-26T00:11:38.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.334+0000 7f3fc3a19740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b885dd30 0x55d3b8870e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:38.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.334+0000 7f3fc3a19740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b88681d0 0x55d3b88713c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:38.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.334+0000 7f3fc3a19740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3b8868f10 0x55d3b886de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:38.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.334+0000 7f3fc3a19740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc1ba8b0 con 0x55d3b8868f10 2024-08-26T00:11:38.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.334+0000 7f3fc3a19740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc1bbd20 con 0x55d3b885dd30 2024-08-26T00:11:38.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.334+0000 7f3fc3a19740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc1baf80 con 0x55d3b88681d0 2024-08-26T00:11:38.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.334+0000 7f3fc3a19740 10 client.0 _ll_register_callbacks cb 0x7f3fac009790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:11:38.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.335+0000 7f3fb9e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b885dd30 0x55d3b8870e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:38.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.335+0000 7f3fb9e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b885dd30 0x55d3b8870e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:46576/0 (socket says 172.21.15.42:46576) 2024-08-26T00:11:38.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.335+0000 7f3fb9e00640 1 -- 172.21.15.42:0/3439796693 learned_addr learned my addr 172.21.15.42:0/3439796693 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:38.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.335+0000 7f3fb9400640 1 --2- 172.21.15.42:0/3439796693 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b88681d0 0x55d3b88713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:38.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.335+0000 7f3fba800640 1 --2- 172.21.15.42:0/3439796693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3b8868f10 0x55d3b886de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:38.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.336+0000 7f3fb9400640 1 -- 172.21.15.42:0/3439796693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b885dd30 msgr2=0x55d3b8870e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:38.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.336+0000 7f3fb9400640 1 --2- 172.21.15.42:0/3439796693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b885dd30 0x55d3b8870e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.336+0000 7f3fb9400640 1 -- 172.21.15.42:0/3439796693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3b8868f10 msgr2=0x55d3b886de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:38.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.336+0000 7f3fb9400640 1 --2- 172.21.15.42:0/3439796693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3b8868f10 0x55d3b886de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.336+0000 7f3fb9400640 1 -- 172.21.15.42:0/3439796693 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3b886e390 con 0x55d3b88681d0 2024-08-26T00:11:38.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.336+0000 7f3fb9400640 1 --2- 172.21.15.42:0/3439796693 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b88681d0 0x55d3b88713c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3fa809b940 tx=0x7f3fa80ccf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3034f375080bf4c server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:38.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.336+0000 7f3f9be00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:11:38.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.337+0000 7f3f9be00640 1 -- 172.21.15.42:0/3439796693 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa800ce60 con 0x55d3b88681d0 2024-08-26T00:11:38.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.337+0000 7f3f9be00640 1 -- 172.21.15.42:0/3439796693 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f3fa8010aa0 con 0x55d3b88681d0 2024-08-26T00:11:38.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.337+0000 7f3fc3a19740 1 -- 172.21.15.42:0/3439796693 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fa809c340 con 0x55d3b88681d0 2024-08-26T00:11:38.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.338+0000 7f3f9be00640 1 -- 172.21.15.42:0/3439796693 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3fa809fff0 con 0x55d3b88681d0 2024-08-26T00:11:38.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.338+0000 7f3fc3a19740 10 client.26008 fetch_fsmap learned FSMap version 31 2024-08-26T00:11:38.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.338+0000 7f3fc3a19740 1 -- 172.21.15.42:0/3439796693 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d3b886e390 con 0x55d3b88681d0 2024-08-26T00:11:38.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.338+0000 7f3f9be00640 1 -- 172.21.15.42:0/3439796693 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fa809c340 con 0x55d3b88681d0 2024-08-26T00:11:38.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.339+0000 7f3f9be00640 1 -- 172.21.15.42:0/3439796693 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f3fa807aab0 con 0x55d3b88681d0 2024-08-26T00:11:38.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.339+0000 7f3fc3a19740 10 client.26008 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:11:38.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.339+0000 7f3fc3a19740 10 client.26008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:11:38.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.339+0000 7f3fc3a19740 20 client.26008 populate_metadata read hostname 'smithi042' 2024-08-26T00:11:38.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.339+0000 7f3fc3a19740 1 --2- 172.21.15.42:0/3439796693 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d3b88e3d10 0x55d3b88e6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:38.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.339+0000 7f3fc3a19740 4 client.26008 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-26T00:11:38.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.339+0000 7f3fc3a19740 1 -- 172.21.15.42:0/3439796693 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d3b87cc8b0 con 0x55d3b88e3d10 2024-08-26T00:11:38.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.340+0000 7f3fb9e00640 1 --2- 172.21.15.42:0/3439796693 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d3b88e3d10 0x55d3b88e6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:38.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.343+0000 7f3fb9e00640 1 --2- 172.21.15.42:0/3439796693 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d3b88e3d10 0x55d3b88e6130 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=210df0e9b04fc533 server_cookie=1d36e8188aa40033 in_seq=0 out_seq=0 2024-08-26T00:11:38.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.343+0000 7f3f9be00640 10 client.26008 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:11:38.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.345+0000 7f3f9be00640 1 -- 172.21.15.42:0/3439796693 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d3b87cc8b0 con 0x55d3b88e3d10 2024-08-26T00:11:38.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.345+0000 7f3f9be00640 10 client.26008 handle_command_reply: tid=0 2024-08-26T00:11:38.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.345+0000 7f3fc3a19740 1 client.26008 shutdown 2024-08-26T00:11:38.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.346+0000 7f3fc3a19740 1 -- 172.21.15.42:0/3439796693 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b88681d0 msgr2=0x55d3b88713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:38.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.346+0000 7f3fc3a19740 1 --2- 172.21.15.42:0/3439796693 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b88681d0 0x55d3b88713c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3fa809b940 tx=0x7f3fa80ccf60 comp rx=0 tx=0).stop 2024-08-26T00:11:38.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.346+0000 7f3fc3a19740 1 -- 172.21.15.42:0/3439796693 shutdown_connections 2024-08-26T00:11:38.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.346+0000 7f3fc3a19740 1 --2- 172.21.15.42:0/3439796693 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55d3b88e3d10 0x55d3b88e6130 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.346+0000 7f3fc3a19740 1 --2- 172.21.15.42:0/3439796693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d3b8868f10 0x55d3b886de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.346+0000 7f3fc3a19740 1 --2- 172.21.15.42:0/3439796693 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d3b88681d0 0x55d3b88713c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.346+0000 7f3f9be00640 0 client.26008 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:11:38.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.346+0000 7f3fc3a19740 1 --2- 172.21.15.42:0/3439796693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d3b885dd30 0x55d3b8870e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.346+0000 7f3fc3a19740 1 -- 172.21.15.42:0/3439796693 >> 172.21.15.42:0/3439796693 conn(0x55d3b885a2c0 msgr2=0x55d3b885f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:38.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.346+0000 7f3fc3a19740 1 -- 172.21.15.42:0/3439796693 shutdown_connections 2024-08-26T00:11:38.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.347+0000 7f3fc3a19740 1 -- 172.21.15.42:0/3439796693 wait complete. 2024-08-26T00:11:38.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.347+0000 7f3fc3a19740 20 client.26008 trim_cache size 0 max 16384 2024-08-26T00:11:38.349 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:11:38.349 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-08-26T00:11:38.349 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "cc1e2bc3-28e3-4c4a-aa70-dbb99bd8ddcf", 2024-08-26T00:11:38.349 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-08-26T00:11:38.349 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:11:38.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.348+0000 7f3fc0e00640 1 -- 172.21.15.42:0/3097819759 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3fa00a2c40 msgr2=0x7f3fa00a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:38.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.348+0000 7f3fc0e00640 1 --2- 172.21.15.42:0/3097819759 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3fa00a2c40 0x7f3fa00a5100 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0096c0 tx=0x7f3fac009260 comp rx=0 tx=0).stop 2024-08-26T00:11:38.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.348+0000 7f3fc0e00640 1 -- 172.21.15.42:0/3097819759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fbc1033e0 msgr2=0x7f3fbc10ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:38.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.348+0000 7f3fc0e00640 1 --2- 172.21.15.42:0/3097819759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fbc1033e0 0x7f3fbc10ab00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800e7a0 tx=0x7f3fa800ec60 comp rx=0 tx=0).stop 2024-08-26T00:11:38.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.349+0000 7f3fc0e00640 1 -- 172.21.15.42:0/3097819759 shutdown_connections 2024-08-26T00:11:38.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.349+0000 7f3fc0e00640 1 --2- 172.21.15.42:0/3097819759 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3fa00a2c40 0x7f3fa00a5100 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.349+0000 7f3fc0e00640 1 --2- 172.21.15.42:0/3097819759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3fbc10bef0 0x7f3fbc10b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.349+0000 7f3fc0e00640 1 --2- 172.21.15.42:0/3097819759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fbc1033e0 0x7f3fbc10ab00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.349+0000 7f3fc0e00640 1 --2- 172.21.15.42:0/3097819759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fbc102ac0 0x7f3fbc19ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:38.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.349+0000 7f3fc0e00640 1 -- 172.21.15.42:0/3097819759 >> 172.21.15.42:0/3097819759 conn(0x7f3fbc0fc520 msgr2=0x7f3fbc101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:38.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.349+0000 7f3fc0e00640 1 -- 172.21.15.42:0/3097819759 shutdown_connections 2024-08-26T00:11:38.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:38.349+0000 7f3fc0e00640 1 -- 172.21.15.42:0/3097819759 wait complete. 2024-08-26T00:11:38.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:38 smithi043 ceph-mon[22091]: pgmap v612: 97 pgs: 97 active+clean; 1.9 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 842 op/s 2024-08-26T00:11:38.772 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:38 smithi042 ceph-mon[17225]: pgmap v612: 97 pgs: 97 active+clean; 1.9 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 842 op/s 2024-08-26T00:11:38.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:38 smithi181 ceph-mon[22102]: pgmap v612: 97 pgs: 97 active+clean; 1.9 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 842 op/s 2024-08-26T00:11:39.211 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-26T00:11:39.715 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:11:39.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:39 smithi043 ceph-mon[22091]: scrub queued for path: / 2024-08-26T00:11:39.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:39 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:39.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:39 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:39.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:39 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:39.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:39 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:39.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:39 smithi181 ceph-mon[22102]: scrub queued for path: / 2024-08-26T00:11:39.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:39 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:39.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:39 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:39.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:39 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:39.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:39 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:39.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:39 smithi042 ceph-mon[17225]: scrub queued for path: / 2024-08-26T00:11:39.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:39 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:39.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:39 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:39.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:39 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:39.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:39 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:40.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.334+0000 7fcb1be00640 1 -- 172.21.15.42:0/1883534769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb1c10dfb0 msgr2=0x7fcb1c110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:40.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.334+0000 7fcb1be00640 1 --2- 172.21.15.42:0/1883534769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb1c10dfb0 0x7fcb1c110400 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcb14009ca0 tx=0x7fcb1402a950 comp rx=0 tx=0).stop 2024-08-26T00:11:40.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.335+0000 7fcb1be00640 1 -- 172.21.15.42:0/1883534769 shutdown_connections 2024-08-26T00:11:40.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.335+0000 7fcb1be00640 1 --2- 172.21.15.42:0/1883534769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb1c10dfb0 0x7fcb1c110400 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.335+0000 7fcb1be00640 1 --2- 172.21.15.42:0/1883534769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb1c074ce0 0x7fcb1c10da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.335+0000 7fcb1be00640 1 --2- 172.21.15.42:0/1883534769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb1c0743c0 0x7fcb1c0747a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.335+0000 7fcb1be00640 1 -- 172.21.15.42:0/1883534769 >> 172.21.15.42:0/1883534769 conn(0x7fcb1c0fd4b0 msgr2=0x7fcb1c0ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:40.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.335+0000 7fcb1be00640 1 -- 172.21.15.42:0/1883534769 shutdown_connections 2024-08-26T00:11:40.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.335+0000 7fcb1be00640 1 -- 172.21.15.42:0/1883534769 wait complete. 2024-08-26T00:11:40.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.337+0000 7fcb1be00640 1 Processor -- start 2024-08-26T00:11:40.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.337+0000 7fcb1be00640 1 -- start start 2024-08-26T00:11:40.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.338+0000 7fcb1be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb1c0743c0 0x7fcb1c19a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:40.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.338+0000 7fcb1be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb1c074ce0 0x7fcb1c19a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:40.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.338+0000 7fcb1be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb1c10dfb0 0x7fcb1c19ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:40.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.338+0000 7fcb1be00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c113d60 con 0x7fcb1c0743c0 2024-08-26T00:11:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.339+0000 7fcb1be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c113be0 con 0x7fcb1c10dfb0 2024-08-26T00:11:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.339+0000 7fcb1be00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c113ee0 con 0x7fcb1c074ce0 2024-08-26T00:11:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.339+0000 7fcb1a000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb1c074ce0 0x7fcb1c19a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.339+0000 7fcb1b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb1c10dfb0 0x7fcb1c19ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.339+0000 7fcb1b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb1c10dfb0 0x7fcb1c19ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:46588/0 (socket says 172.21.15.42:46588) 2024-08-26T00:11:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.339+0000 7fcb1b400640 1 -- 172.21.15.42:0/1265852927 learned_addr learned my addr 172.21.15.42:0/1265852927 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.339+0000 7fcb1aa00640 1 --2- 172.21.15.42:0/1265852927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb1c0743c0 0x7fcb1c19a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.340+0000 7fcb1b400640 1 -- 172.21.15.42:0/1265852927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb1c074ce0 msgr2=0x7fcb1c19a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.340+0000 7fcb1b400640 1 --2- 172.21.15.42:0/1265852927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb1c074ce0 0x7fcb1c19a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.340+0000 7fcb1b400640 1 -- 172.21.15.42:0/1265852927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb1c0743c0 msgr2=0x7fcb1c19a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:40.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.340+0000 7fcb1b400640 1 --2- 172.21.15.42:0/1265852927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb1c0743c0 0x7fcb1c19a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.340+0000 7fcb1b400640 1 -- 172.21.15.42:0/1265852927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb1c19f340 con 0x7fcb1c10dfb0 2024-08-26T00:11:40.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.340+0000 7fcb1b400640 1 --2- 172.21.15.42:0/1265852927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb1c10dfb0 0x7fcb1c19ec60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcb14004af0 tx=0x7fcb1402f5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:40.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.341+0000 7fcb13400640 1 -- 172.21.15.42:0/1265852927 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14034040 con 0x7fcb1c10dfb0 2024-08-26T00:11:40.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.341+0000 7fcb13400640 1 -- 172.21.15.42:0/1265852927 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb14030920 con 0x7fcb1c10dfb0 2024-08-26T00:11:40.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.341+0000 7fcb13400640 1 -- 172.21.15.42:0/1265852927 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb140047b0 con 0x7fcb1c10dfb0 2024-08-26T00:11:40.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.341+0000 7fcb1be00640 1 -- 172.21.15.42:0/1265852927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb1c19f5d0 con 0x7fcb1c10dfb0 2024-08-26T00:11:40.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.341+0000 7fcb1be00640 1 -- 172.21.15.42:0/1265852927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb1c19fa60 con 0x7fcb1c10dfb0 2024-08-26T00:11:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.345+0000 7fcb24858740 1 Processor -- start 2024-08-26T00:11:40.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.345+0000 7fcb13400640 1 -- 172.21.15.42:0/1265852927 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcb14037020 con 0x7fcb1c10dfb0 2024-08-26T00:11:40.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.346+0000 7fcb24858740 1 -- start start 2024-08-26T00:11:40.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.346+0000 7fcb24858740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7ae99bb40 0x55a7ae99bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:40.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.346+0000 7fcb24858740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7ae99c460 0x55a7ae9a67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:40.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.347+0000 7fcb1aa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7ae99c460 0x55a7ae9a67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:40.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.347+0000 7fcb24858740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae9a6d20 0x55a7ae9a9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:40.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.347+0000 7fcb24858740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a7ae901fc0 con 0x55a7ae99bb40 2024-08-26T00:11:40.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.347+0000 7fcb1aa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7ae99c460 0x55a7ae9a67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:55552/0 (socket says 172.21.15.42:55552) 2024-08-26T00:11:40.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.348+0000 7fcb1aa00640 1 -- 172.21.15.42:0/1057371513 learned_addr learned my addr 172.21.15.42:0/1057371513 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:40.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.348+0000 7fcb24858740 1 -- 172.21.15.42:0/1057371513 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a7ae899680 con 0x55a7ae9a6d20 2024-08-26T00:11:40.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.348+0000 7fcb1a000640 1 --2- 172.21.15.42:0/1057371513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7ae99bb40 0x55a7ae99bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:40.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.348+0000 7fcb24858740 1 -- 172.21.15.42:0/1057371513 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a7ae8fdf80 con 0x55a7ae99c460 2024-08-26T00:11:40.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.348+0000 7fcb13400640 1 --2- 172.21.15.42:0/1265852927 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcb000a2c00 0x7fcb000a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:40.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.348+0000 7fcb1a000640 1 --2- 172.21.15.42:0/1057371513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae9a6d20 0x55a7ae9a9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:40.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.348+0000 7fcb13400640 1 -- 172.21.15.42:0/1265852927 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fcb140efd80 con 0x7fcb1c10dfb0 2024-08-26T00:11:40.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.349+0000 7fcb1aa00640 1 -- 172.21.15.42:0/1057371513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae9a6d20 msgr2=0x55a7ae9a9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:40.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.349+0000 7fcb1aa00640 1 --2- 172.21.15.42:0/1057371513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae9a6d20 0x55a7ae9a9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.349+0000 7fcb1aa00640 1 -- 172.21.15.42:0/1057371513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7ae99bb40 msgr2=0x55a7ae99bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:40.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.349+0000 7fcb1aa00640 1 --2- 172.21.15.42:0/1057371513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7ae99bb40 0x55a7ae99bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.349+0000 7fcb1aa00640 1 -- 172.21.15.42:0/1057371513 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7ae8b52c0 con 0x55a7ae99c460 2024-08-26T00:11:40.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.349+0000 7fcb1aa00640 1 --2- 172.21.15.42:0/1057371513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7ae99c460 0x55a7ae9a67e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009850 tx=0x7fcb0c005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a9581a3b08fc8ec server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:40.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.350+0000 7fcb07e00640 1 -- 172.21.15.42:0/1057371513 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c004030 con 0x55a7ae99c460 2024-08-26T00:11:40.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.350+0000 7fcb07e00640 1 -- 172.21.15.42:0/1057371513 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb0c00bd80 con 0x55a7ae99c460 2024-08-26T00:11:40.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.350+0000 7fcb07e00640 1 -- 172.21.15.42:0/1057371513 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c003d80 con 0x55a7ae99c460 2024-08-26T00:11:40.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.350+0000 7fcb1b400640 1 --2- 172.21.15.42:0/1265852927 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcb000a2c00 0x7fcb000a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:40.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.351+0000 7fcb24858740 1 -- 172.21.15.42:0/1057371513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7ae99c460 msgr2=0x55a7ae9a67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:40.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.351+0000 7fcb24858740 1 --2- 172.21.15.42:0/1057371513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7ae99c460 0x55a7ae9a67e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009850 tx=0x7fcb0c005f90 comp rx=0 tx=0).stop 2024-08-26T00:11:40.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.351+0000 7fcb24858740 1 -- 172.21.15.42:0/1057371513 shutdown_connections 2024-08-26T00:11:40.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.351+0000 7fcb24858740 1 --2- 172.21.15.42:0/1057371513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae9a6d20 0x55a7ae9a9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.351+0000 7fcb24858740 1 --2- 172.21.15.42:0/1057371513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7ae99c460 0x55a7ae9a67e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.351+0000 7fcb24858740 1 --2- 172.21.15.42:0/1057371513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7ae99bb40 0x55a7ae99bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.351+0000 7fcb24858740 1 -- 172.21.15.42:0/1057371513 >> 172.21.15.42:0/1057371513 conn(0x55a7ae998080 msgr2=0x55a7ae998460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:40.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.351+0000 7fcb1b400640 1 --2- 172.21.15.42:0/1265852927 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcb000a2c00 0x7fcb000a50c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcb140b8f70 tx=0x7fcb1402a950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:40.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.351+0000 7fcb24858740 1 -- 172.21.15.42:0/1057371513 shutdown_connections 2024-08-26T00:11:40.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.352+0000 7fcb24858740 1 -- 172.21.15.42:0/1057371513 wait complete. 2024-08-26T00:11:40.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.352+0000 7fcb24858740 1 -- start start 2024-08-26T00:11:40.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.352+0000 7fcb24858740 1 Processor -- start 2024-08-26T00:11:40.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.353+0000 7fcb24858740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7ae99bb40 0x55a7ae9a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:40.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.353+0000 7fcb24858740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae99c460 0x55a7ae9a4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:40.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.353+0000 7fcb24858740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7ae9a6d20 0x55a7ae9a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:40.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.353+0000 7fcb24858740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a7ae9a98f0 con 0x55a7ae99bb40 2024-08-26T00:11:40.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.353+0000 7fcb24858740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a7ae8bce50 con 0x55a7ae99c460 2024-08-26T00:11:40.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.353+0000 7fcb24858740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a7ae9a9a70 con 0x55a7ae9a6d20 2024-08-26T00:11:40.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.353+0000 7fcb1aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae99c460 0x55a7ae9a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:40.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.354+0000 7fcb1aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae99c460 0x55a7ae9a4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:46608/0 (socket says 172.21.15.42:46608) 2024-08-26T00:11:40.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.354+0000 7fcb1aa00640 1 -- 172.21.15.42:0/963267153 learned_addr learned my addr 172.21.15.42:0/963267153 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:40.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.354+0000 7fcb1aa00640 1 -- 172.21.15.42:0/963267153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7ae9a6d20 msgr2=0x55a7ae9a46b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:11:40.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.354+0000 7fcb1aa00640 1 --2- 172.21.15.42:0/963267153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7ae9a6d20 0x55a7ae9a46b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.354+0000 7fcb1aa00640 1 -- 172.21.15.42:0/963267153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7ae99bb40 msgr2=0x55a7ae9a3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:40.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.354+0000 7fcb1aa00640 1 --2- 172.21.15.42:0/963267153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7ae99bb40 0x55a7ae9a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.354+0000 7fcb1aa00640 1 -- 172.21.15.42:0/963267153 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7ae6733c0 con 0x55a7ae99c460 2024-08-26T00:11:40.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.353+0000 7fcb24858740 10 client.0 _ll_register_callbacks cb 0x55a7ae8a7f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:11:40.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.355+0000 7fcb24858740 1 -- 172.21.15.42:0/963267153 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb0c00bd80 con 0x55a7ae99c460 2024-08-26T00:11:40.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.355+0000 7fcb1aa00640 1 --2- 172.21.15.42:0/963267153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae99c460 0x55a7ae9a4170 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c016010 tx=0x7fcb0c005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ce2025b8089e03a server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:40.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.355+0000 7fcb04c00640 10 client.26054 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:11:40.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.356+0000 7fcb04c00640 1 -- 172.21.15.42:0/963267153 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c003d70 con 0x55a7ae99c460 2024-08-26T00:11:40.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.356+0000 7fcb04c00640 1 -- 172.21.15.42:0/963267153 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fcb0c003f10 con 0x55a7ae99c460 2024-08-26T00:11:40.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.356+0000 7fcb04c00640 1 -- 172.21.15.42:0/963267153 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fcb0c004110 con 0x55a7ae99c460 2024-08-26T00:11:40.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.356+0000 7fcb24858740 10 client.26054 fetch_fsmap learned FSMap version 31 2024-08-26T00:11:40.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.356+0000 7fcb24858740 1 -- 172.21.15.42:0/963267153 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55a7ae9b55b0 con 0x55a7ae99c460 2024-08-26T00:11:40.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.357+0000 7fcb04c00640 1 -- 172.21.15.42:0/963267153 <== mon.2 v2:172.21.15.43:3300/0 4 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fcb0c0042b0 con 0x55a7ae99c460 2024-08-26T00:11:40.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.357+0000 7fcb24858740 10 client.26054 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:11:40.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.357+0000 7fcb24858740 10 client.26054 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:11:40.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.357+0000 7fcb24858740 20 client.26054 populate_metadata read hostname 'smithi042' 2024-08-26T00:11:40.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.357+0000 7fcb24858740 1 --2- 172.21.15.42:0/963267153 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55a7ae9b6d70 0x55a7ae9b9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:40.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.357+0000 7fcb24858740 4 client.26054 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:11:40.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.357+0000 7fcb24858740 1 -- 172.21.15.42:0/963267153 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7ae90f530 con 0x55a7ae9b6d70 2024-08-26T00:11:40.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.358+0000 7fcb1a000640 1 --2- 172.21.15.42:0/963267153 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55a7ae9b6d70 0x55a7ae9b9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:40.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.359+0000 7fcb1a000640 1 --2- 172.21.15.42:0/963267153 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55a7ae9b6d70 0x55a7ae9b9160 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c423a6a8f0c0fc2 server_cookie=76da336c0365a86 in_seq=0 out_seq=0 2024-08-26T00:11:40.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.359+0000 7fcb04c00640 10 client.26054 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:11:40.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.360+0000 7fcb04c00640 1 -- 172.21.15.42:0/963267153 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a7ae90f530 con 0x55a7ae9b6d70 2024-08-26T00:11:40.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.360+0000 7fcb04c00640 10 client.26054 handle_command_reply: tid=0 2024-08-26T00:11:40.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.360+0000 7fcb24858740 1 client.26054 shutdown 2024-08-26T00:11:40.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.360+0000 7fcb24858740 1 -- 172.21.15.42:0/963267153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae99c460 msgr2=0x55a7ae9a4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:40.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.360+0000 7fcb24858740 1 --2- 172.21.15.42:0/963267153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae99c460 0x55a7ae9a4170 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c016010 tx=0x7fcb0c005740 comp rx=0 tx=0).stop 2024-08-26T00:11:40.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.361+0000 7fcb24858740 1 -- 172.21.15.42:0/963267153 shutdown_connections 2024-08-26T00:11:40.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.361+0000 7fcb24858740 1 --2- 172.21.15.42:0/963267153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7ae9a6d20 0x55a7ae9a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.361+0000 7fcb24858740 1 --2- 172.21.15.42:0/963267153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae99c460 0x55a7ae9a4170 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.361+0000 7fcb24858740 1 --2- 172.21.15.42:0/963267153 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55a7ae9b6d70 0x55a7ae9b9160 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.361+0000 7fcb24858740 1 --2- 172.21.15.42:0/963267153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7ae99bb40 0x55a7ae9a3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.361+0000 7fcb24858740 1 -- 172.21.15.42:0/963267153 >> 172.21.15.42:0/963267153 conn(0x55a7ae998080 msgr2=0x55a7ae997240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:40.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.361+0000 7fcb04c00640 0 client.26054 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:11:40.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.362+0000 7fcb24858740 1 -- 172.21.15.42:0/963267153 shutdown_connections 2024-08-26T00:11:40.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.362+0000 7fcb24858740 1 -- 172.21.15.42:0/963267153 wait complete. 2024-08-26T00:11:40.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.363+0000 7fcb24858740 20 client.26054 trim_cache size 0 max 16384 2024-08-26T00:11:40.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.417+0000 7fcb24858740 1 Processor -- start 2024-08-26T00:11:40.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.418+0000 7fcb24858740 1 -- start start 2024-08-26T00:11:40.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.418+0000 7fcb24858740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7ae99bb40 0x55a7ae992fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:40.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.418+0000 7fcb24858740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae99c460 0x55a7ae9b2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:40.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.418+0000 7fcb24858740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7ae9a6d20 0x55a7ae9bbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:40.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.418+0000 7fcb24858740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c1ad960 con 0x55a7ae99bb40 2024-08-26T00:11:40.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.418+0000 7fcb24858740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c1ab170 con 0x55a7ae99c460 2024-08-26T00:11:40.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.418+0000 7fcb24858740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c1a8fa0 con 0x55a7ae9a6d20 2024-08-26T00:11:40.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.419+0000 7fcb1aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae99c460 0x55a7ae9b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:40.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.419+0000 7fcb1aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae99c460 0x55a7ae9b2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:46616/0 (socket says 172.21.15.42:46616) 2024-08-26T00:11:40.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.419+0000 7fcb1aa00640 1 -- 172.21.15.42:0/708367123 learned_addr learned my addr 172.21.15.42:0/708367123 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:40.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.419+0000 7fcb1a000640 1 --2- 172.21.15.42:0/708367123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7ae9a6d20 0x55a7ae9bbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:40.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.419+0000 7fcb1aa00640 1 -- 172.21.15.42:0/708367123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7ae9a6d20 msgr2=0x55a7ae9bbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:40.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.419+0000 7fcb1aa00640 1 --2- 172.21.15.42:0/708367123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7ae9a6d20 0x55a7ae9bbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.419+0000 7fcb1aa00640 1 -- 172.21.15.42:0/708367123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7ae99bb40 msgr2=0x55a7ae992fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:40.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.419+0000 7fcb1aa00640 1 --2- 172.21.15.42:0/708367123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7ae99bb40 0x55a7ae992fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.419+0000 7fcb1aa00640 1 -- 172.21.15.42:0/708367123 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7ae9a2be0 con 0x55a7ae99c460 2024-08-26T00:11:40.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.420+0000 7fcb1aa00640 1 --2- 172.21.15.42:0/708367123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae99c460 0x55a7ae9b2400 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c014c10 tx=0x7fcb0c02b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb0f2c5336150c3d server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:40.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.421+0000 7fcb07400640 1 -- 172.21.15.42:0/708367123 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c0037f0 con 0x55a7ae99c460 2024-08-26T00:11:40.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.421+0000 7fcb07400640 1 -- 172.21.15.42:0/708367123 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb0c00bd80 con 0x55a7ae99c460 2024-08-26T00:11:40.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.421+0000 7fcb07400640 1 -- 172.21.15.42:0/708367123 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c0326b0 con 0x55a7ae99c460 2024-08-26T00:11:40.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.422+0000 7fcb24858740 1 -- 172.21.15.42:0/708367123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae99c460 msgr2=0x55a7ae9b2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:40.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.422+0000 7fcb24858740 1 --2- 172.21.15.42:0/708367123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae99c460 0x55a7ae9b2400 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c014c10 tx=0x7fcb0c02b000 comp rx=0 tx=0).stop 2024-08-26T00:11:40.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.422+0000 7fcb24858740 1 -- 172.21.15.42:0/708367123 shutdown_connections 2024-08-26T00:11:40.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.422+0000 7fcb24858740 1 --2- 172.21.15.42:0/708367123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7ae9a6d20 0x55a7ae9bbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.422+0000 7fcb24858740 1 --2- 172.21.15.42:0/708367123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae99c460 0x55a7ae9b2400 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.422+0000 7fcb24858740 1 --2- 172.21.15.42:0/708367123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7ae99bb40 0x55a7ae992fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.422+0000 7fcb24858740 1 -- 172.21.15.42:0/708367123 >> 172.21.15.42:0/708367123 conn(0x55a7ae998080 msgr2=0x55a7ae9b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:40.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.423+0000 7fcb24858740 1 -- 172.21.15.42:0/708367123 shutdown_connections 2024-08-26T00:11:40.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.423+0000 7fcb24858740 1 -- 172.21.15.42:0/708367123 wait complete. 2024-08-26T00:11:40.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.423+0000 7fcb24858740 1 -- start start 2024-08-26T00:11:40.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.424+0000 7fcb24858740 1 Processor -- start 2024-08-26T00:11:40.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.424+0000 7fcb24858740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7ae99bb40 0x55a7ae9b9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:40.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.424+0000 7fcb24858740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae99c460 0x55a7ae9b9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:40.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.424+0000 7fcb24858740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7ae9a6d20 0x55a7aea1f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:40.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.424+0000 7fcb24858740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c1a9630 con 0x55a7ae99bb40 2024-08-26T00:11:40.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.424+0000 7fcb24858740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c1aaaa0 con 0x55a7ae99c460 2024-08-26T00:11:40.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.424+0000 7fcb24858740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c1a9d00 con 0x55a7ae9a6d20 2024-08-26T00:11:40.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.424+0000 7fcb24858740 10 client.0 _ll_register_callbacks cb 0x7fcb0800b690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:11:40.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.424+0000 7fcb1aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae99c460 0x55a7ae9b9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:40.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.424+0000 7fcb1aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae99c460 0x55a7ae9b9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:46622/0 (socket says 172.21.15.42:46622) 2024-08-26T00:11:40.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.424+0000 7fcb1aa00640 1 -- 172.21.15.42:0/743900060 learned_addr learned my addr 172.21.15.42:0/743900060 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:11:40.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.425+0000 7fcb1a000640 1 --2- 172.21.15.42:0/743900060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7ae99bb40 0x55a7ae9b9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:40.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.425+0000 7fcb1aa00640 1 -- 172.21.15.42:0/743900060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7ae9a6d20 msgr2=0x55a7aea1f6a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:11:40.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.425+0000 7fcb1aa00640 1 --2- 172.21.15.42:0/743900060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7ae9a6d20 0x55a7aea1f6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.425+0000 7fcb1aa00640 1 -- 172.21.15.42:0/743900060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7ae99bb40 msgr2=0x55a7ae9b9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:11:40.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.425+0000 7fcb1aa00640 1 --2- 172.21.15.42:0/743900060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7ae99bb40 0x55a7ae9b9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.425+0000 7fcb1aa00640 1 -- 172.21.15.42:0/743900060 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7aea30bf0 con 0x55a7ae99c460 2024-08-26T00:11:40.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.425+0000 7fcb1a000640 1 --2- 172.21.15.42:0/743900060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7ae99bb40 0x55a7ae9b9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:11:40.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.426+0000 7fcb1aa00640 1 --2- 172.21.15.42:0/743900060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae99c460 0x55a7ae9b9640 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009690 tx=0x7fcb0c0036b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb28ea4b89bc3016 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:11:40.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.426+0000 7fcb04c00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:11:40.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.426+0000 7fcb04c00640 1 -- 172.21.15.42:0/743900060 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c04d060 con 0x55a7ae99c460 2024-08-26T00:11:40.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.426+0000 7fcb04c00640 1 -- 172.21.15.42:0/743900060 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fcb0c003e80 con 0x55a7ae99c460 2024-08-26T00:11:40.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.427+0000 7fcb24858740 1 -- 172.21.15.42:0/743900060 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb0c00bd80 con 0x55a7ae99c460 2024-08-26T00:11:40.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.427+0000 7fcb04c00640 1 -- 172.21.15.42:0/743900060 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fcb0c0037f0 con 0x55a7ae99c460 2024-08-26T00:11:40.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.427+0000 7fcb24858740 10 client.26060 fetch_fsmap learned FSMap version 31 2024-08-26T00:11:40.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.427+0000 7fcb24858740 1 -- 172.21.15.42:0/743900060 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a7aea31e80 con 0x55a7ae99c460 2024-08-26T00:11:40.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.428+0000 7fcb04c00640 1 -- 172.21.15.42:0/743900060 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb0c00bd80 con 0x55a7ae99c460 2024-08-26T00:11:40.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.428+0000 7fcb04c00640 1 -- 172.21.15.42:0/743900060 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fcb0c03c470 con 0x55a7ae99c460 2024-08-26T00:11:40.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.428+0000 7fcb24858740 10 client.26060 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:11:40.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.428+0000 7fcb24858740 10 client.26060 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:11:40.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.428+0000 7fcb24858740 20 client.26060 populate_metadata read hostname 'smithi042' 2024-08-26T00:11:40.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.428+0000 7fcb24858740 1 --2- 172.21.15.42:0/743900060 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55a7aea32540 0x55a7aea349a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:11:40.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.428+0000 7fcb24858740 4 client.26060 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-26T00:11:40.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.428+0000 7fcb24858740 1 -- 172.21.15.42:0/743900060 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a7ae909a40 con 0x55a7aea32540 2024-08-26T00:11:40.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.429+0000 7fcb1a000640 1 --2- 172.21.15.42:0/743900060 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55a7aea32540 0x55a7aea349a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:11:40.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.429+0000 7fcb1a000640 1 --2- 172.21.15.42:0/743900060 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55a7aea32540 0x55a7aea349a0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=504d9a496c638eb7 server_cookie=f76aea0b3aaed68 in_seq=0 out_seq=0 2024-08-26T00:11:40.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.429+0000 7fcb04c00640 10 client.26060 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:11:40.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.430+0000 7fcb04c00640 1 -- 172.21.15.42:0/743900060 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+269 (crc 0 0 0) 0x55a7ae909a40 con 0x55a7aea32540 2024-08-26T00:11:40.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.430+0000 7fcb04c00640 10 client.26060 handle_command_reply: tid=0 2024-08-26T00:11:40.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.430+0000 7fcb24858740 1 client.26060 shutdown 2024-08-26T00:11:40.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.431+0000 7fcb24858740 1 -- 172.21.15.42:0/743900060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae99c460 msgr2=0x55a7ae9b9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:40.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.431+0000 7fcb24858740 1 --2- 172.21.15.42:0/743900060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae99c460 0x55a7ae9b9640 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009690 tx=0x7fcb0c0036b0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.431+0000 7fcb24858740 1 -- 172.21.15.42:0/743900060 shutdown_connections 2024-08-26T00:11:40.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.431+0000 7fcb24858740 1 --2- 172.21.15.42:0/743900060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7ae9a6d20 0x55a7aea1f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.431+0000 7fcb24858740 1 --2- 172.21.15.42:0/743900060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a7ae99c460 0x55a7ae9b9640 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.431+0000 7fcb24858740 1 --2- 172.21.15.42:0/743900060 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55a7aea32540 0x55a7aea349a0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.431+0000 7fcb24858740 1 --2- 172.21.15.42:0/743900060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a7ae99bb40 0x55a7ae9b9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.431+0000 7fcb24858740 1 -- 172.21.15.42:0/743900060 >> 172.21.15.42:0/743900060 conn(0x55a7ae998080 msgr2=0x55a7ae9b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:40.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.432+0000 7fcb04c00640 0 client.26060 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:11:40.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.432+0000 7fcb24858740 1 -- 172.21.15.42:0/743900060 shutdown_connections 2024-08-26T00:11:40.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.432+0000 7fcb24858740 1 -- 172.21.15.42:0/743900060 wait complete. 2024-08-26T00:11:40.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.432+0000 7fcb24858740 20 client.26060 trim_cache size 0 max 16384 2024-08-26T00:11:40.435 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:11:40.435 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "scrub active (11954 inodes in the stack)", 2024-08-26T00:11:40.435 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-08-26T00:11:40.435 INFO:teuthology.orchestra.run.smithi042.stdout: "cc1e2bc3-28e3-4c4a-aa70-dbb99bd8ddcf": { 2024-08-26T00:11:40.435 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-08-26T00:11:40.435 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "cc1e2bc3-28e3-4c4a-aa70-dbb99bd8ddcf", 2024-08-26T00:11:40.435 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,force" 2024-08-26T00:11:40.435 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:11:40.435 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:11:40.435 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:11:40.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.433+0000 7fcb1be00640 1 -- 172.21.15.42:0/1265852927 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcb000a2c00 msgr2=0x7fcb000a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:40.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.433+0000 7fcb1be00640 1 --2- 172.21.15.42:0/1265852927 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcb000a2c00 0x7fcb000a50c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcb140b8f70 tx=0x7fcb1402a950 comp rx=0 tx=0).stop 2024-08-26T00:11:40.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.433+0000 7fcb1be00640 1 -- 172.21.15.42:0/1265852927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb1c10dfb0 msgr2=0x7fcb1c19ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:11:40.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.433+0000 7fcb1be00640 1 --2- 172.21.15.42:0/1265852927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb1c10dfb0 0x7fcb1c19ec60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcb14004af0 tx=0x7fcb1402f5b0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.433+0000 7fcb1be00640 1 -- 172.21.15.42:0/1265852927 shutdown_connections 2024-08-26T00:11:40.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.433+0000 7fcb1be00640 1 --2- 172.21.15.42:0/1265852927 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcb000a2c00 0x7fcb000a50c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.433+0000 7fcb1be00640 1 --2- 172.21.15.42:0/1265852927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb1c10dfb0 0x7fcb1c19ec60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.433+0000 7fcb1be00640 1 --2- 172.21.15.42:0/1265852927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb1c074ce0 0x7fcb1c19a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.433+0000 7fcb1be00640 1 --2- 172.21.15.42:0/1265852927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb1c0743c0 0x7fcb1c19a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:11:40.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.433+0000 7fcb1be00640 1 -- 172.21.15.42:0/1265852927 >> 172.21.15.42:0/1265852927 conn(0x7fcb1c0fd4b0 msgr2=0x7fcb1c0fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:11:40.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.434+0000 7fcb1be00640 1 -- 172.21.15.42:0/1265852927 shutdown_connections 2024-08-26T00:11:40.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:11:40.434+0000 7fcb1be00640 1 -- 172.21.15.42:0/1265852927 wait complete. 2024-08-26T00:11:40.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:40 smithi043 ceph-mon[22091]: pgmap v613: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 1.08k op/s 2024-08-26T00:11:40.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:40 smithi042 ceph-mon[17225]: pgmap v613: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 1.08k op/s 2024-08-26T00:11:40.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:40 smithi181 ceph-mon[22102]: pgmap v613: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 1.08k op/s 2024-08-26T00:11:41.401 INFO:tasks.cephfs.filesystem:scrub status for tag:cc1e2bc3-28e3-4c4a-aa70-dbb99bd8ddcf - {'path': '/', 'tag': 'cc1e2bc3-28e3-4c4a-aa70-dbb99bd8ddcf', 'options': 'recursive,force'} 2024-08-26T00:11:42.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:42 smithi042 ceph-mon[17225]: pgmap v614: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 993 op/s 2024-08-26T00:11:42.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:42 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:42.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:42 smithi043 ceph-mon[22091]: pgmap v614: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 993 op/s 2024-08-26T00:11:42.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:42 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:42.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:42 smithi181 ceph-mon[22102]: pgmap v614: 97 pgs: 97 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 993 op/s 2024-08-26T00:11:42.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:42 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:43.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:43 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:43.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:43 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:43.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:43 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:43.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:43 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:43.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:43 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:43.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:43 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:43.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:43 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:43.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:43 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:43.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:43 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:43.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:43 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:43.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:43 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:43.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:43 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:43.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:43 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:43.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:43 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:43.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:43 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:43.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:43 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:43.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:43 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:43.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:43 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:43.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:43 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:43.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:43 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:43.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:43 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:43.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:43 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:43.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:43 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:43.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:43 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:44.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:44 smithi043 ceph-mon[22091]: pgmap v615: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 1.21k op/s 2024-08-26T00:11:44.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:44 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:11:44.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:44 smithi042 ceph-mon[17225]: pgmap v615: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 1.21k op/s 2024-08-26T00:11:44.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:44 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:11:44.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:44 smithi181 ceph-mon[22102]: pgmap v615: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 1.21k op/s 2024-08-26T00:11:44.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:44 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:11:46.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: pgmap v616: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 1.22k op/s 2024-08-26T00:11:46.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.762 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.763 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.764 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.765 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.766 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.767 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.768 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.769 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.770 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.771 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.772 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.773 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.774 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.775 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.776 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.777 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.778 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.779 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.779 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.779 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.779 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.779 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.779 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:11:46.779 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:46 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: pgmap v616: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 1.22k op/s 2024-08-26T00:11:46.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.786 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.787 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.789 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.792 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.795 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.800 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:11:46.803 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:46 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.803 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: pgmap v616: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 1.22k op/s 2024-08-26T00:11:46.804 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.804 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.804 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.804 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.804 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.804 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.804 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.804 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.804 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.804 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.804 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.804 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.804 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.804 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.805 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.806 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.807 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.808 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.811 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.812 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.813 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.814 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.815 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.816 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.817 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.818 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.819 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:46.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:11:46.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:46 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:48.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:48 smithi043 ceph-mon[22091]: pgmap v617: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 1.51k op/s 2024-08-26T00:11:48.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:48 smithi042 ceph-mon[17225]: pgmap v617: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 1.51k op/s 2024-08-26T00:11:48.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:48 smithi181 ceph-mon[22102]: pgmap v617: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.4 MiB/s wr, 1.51k op/s 2024-08-26T00:11:49.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:49 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:49.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:49 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:11:49.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:49 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:11:49.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:49 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:11:49.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:49 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:49.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:49 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:11:49.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:49 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:11:49.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:49 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:11:49.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:49 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:11:49.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:49 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:11:49.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:49 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:11:49.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:49 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:11:50.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:50 smithi043 ceph-mon[22091]: pgmap v618: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.6 MiB/s wr, 1.76k op/s 2024-08-26T00:11:50.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:50 smithi042 ceph-mon[17225]: pgmap v618: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.6 MiB/s wr, 1.76k op/s 2024-08-26T00:11:50.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:50 smithi181 ceph-mon[22102]: pgmap v618: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.6 MiB/s wr, 1.76k op/s 2024-08-26T00:11:52.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:52 smithi043 ceph-mon[22091]: pgmap v619: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.2 MiB/s wr, 1.55k op/s 2024-08-26T00:11:52.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:52 smithi042 ceph-mon[17225]: pgmap v619: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.2 MiB/s wr, 1.55k op/s 2024-08-26T00:11:52.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:52 smithi181 ceph-mon[22102]: pgmap v619: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.2 MiB/s wr, 1.55k op/s 2024-08-26T00:11:54.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:54 smithi043 ceph-mon[22091]: pgmap v620: 97 pgs: 97 active+clean; 1.8 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.9 MiB/s wr, 1.70k op/s 2024-08-26T00:11:54.785 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:54 smithi042 ceph-mon[17225]: pgmap v620: 97 pgs: 97 active+clean; 1.8 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.9 MiB/s wr, 1.70k op/s 2024-08-26T00:11:54.788 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:54 smithi181 ceph-mon[22102]: pgmap v620: 97 pgs: 97 active+clean; 1.8 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.9 MiB/s wr, 1.70k op/s 2024-08-26T00:11:56.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:56 smithi043 ceph-mon[22091]: pgmap v621: 97 pgs: 97 active+clean; 1.8 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.8 MiB/s wr, 1.47k op/s 2024-08-26T00:11:56.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:56 smithi042 ceph-mon[17225]: pgmap v621: 97 pgs: 97 active+clean; 1.8 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.8 MiB/s wr, 1.47k op/s 2024-08-26T00:11:56.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:56 smithi181 ceph-mon[22102]: pgmap v621: 97 pgs: 97 active+clean; 1.8 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.8 MiB/s wr, 1.47k op/s 2024-08-26T00:11:58.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:58 smithi043 ceph-mon[22091]: pgmap v622: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.7 MiB/s wr, 1.38k op/s 2024-08-26T00:11:58.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:58 smithi042 ceph-mon[17225]: pgmap v622: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.7 MiB/s wr, 1.38k op/s 2024-08-26T00:11:58.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:58 smithi181 ceph-mon[22102]: pgmap v622: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.7 MiB/s wr, 1.38k op/s 2024-08-26T00:11:59.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:59 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:11:59.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:11:59 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:11:59.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:59 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:11:59.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:11:59 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:11:59.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:59 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:11:59.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:11:59 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:12:00.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:00 smithi042 ceph-mon[17225]: pgmap v623: 97 pgs: 97 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 1.07k op/s 2024-08-26T00:12:00.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:00 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:12:00.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:00 smithi181 ceph-mon[22102]: pgmap v623: 97 pgs: 97 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 1.07k op/s 2024-08-26T00:12:00.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:00 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:12:01.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:00 smithi043 ceph-mon[22091]: pgmap v623: 97 pgs: 97 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 1.07k op/s 2024-08-26T00:12:01.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:00 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:12:02.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:02 smithi042 ceph-mon[17225]: pgmap v624: 97 pgs: 97 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 590 op/s 2024-08-26T00:12:02.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:02 smithi181 ceph-mon[22102]: pgmap v624: 97 pgs: 97 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 590 op/s 2024-08-26T00:12:03.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:02 smithi043 ceph-mon[22091]: pgmap v624: 97 pgs: 97 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 590 op/s 2024-08-26T00:12:04.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:04 smithi042 ceph-mon[17225]: pgmap v625: 97 pgs: 97 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 576 op/s 2024-08-26T00:12:04.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:04 smithi181 ceph-mon[22102]: pgmap v625: 97 pgs: 97 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 576 op/s 2024-08-26T00:12:05.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:04 smithi043 ceph-mon[22091]: pgmap v625: 97 pgs: 97 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 576 op/s 2024-08-26T00:12:06.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:06 smithi042 ceph-mon[17225]: pgmap v626: 97 pgs: 97 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 418 op/s 2024-08-26T00:12:06.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:06 smithi181 ceph-mon[22102]: pgmap v626: 97 pgs: 97 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 418 op/s 2024-08-26T00:12:07.012 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:06 smithi043 ceph-mon[22091]: pgmap v626: 97 pgs: 97 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 418 op/s 2024-08-26T00:12:08.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:08 smithi042 ceph-mon[17225]: pgmap v627: 97 pgs: 97 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 436 op/s 2024-08-26T00:12:08.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:08 smithi181 ceph-mon[22102]: pgmap v627: 97 pgs: 97 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 436 op/s 2024-08-26T00:12:09.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:08 smithi043 ceph-mon[22091]: pgmap v627: 97 pgs: 97 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 436 op/s 2024-08-26T00:12:10.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:10 smithi042 ceph-mon[17225]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 448 op/s 2024-08-26T00:12:10.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:10 smithi181 ceph-mon[22102]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 448 op/s 2024-08-26T00:12:11.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:10 smithi043 ceph-mon[22091]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 448 op/s 2024-08-26T00:12:11.402 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-26T00:12:11.882 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:12:12.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.506+0000 7fd24ce00640 1 -- 172.21.15.42:0/71877450 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24810d100 msgr2=0x7fd248114c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:12.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.506+0000 7fd24ce00640 1 --2- 172.21.15.42:0/71877450 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24810d100 0x7fd248114c80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd240009ca0 tx=0x7fd24002a8c0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.506+0000 7fd24ce00640 1 -- 172.21.15.42:0/71877450 shutdown_connections 2024-08-26T00:12:12.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.506+0000 7fd24ce00640 1 --2- 172.21.15.42:0/71877450 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24810d100 0x7fd248114c80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.506+0000 7fd24ce00640 1 --2- 172.21.15.42:0/71877450 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd2481089d0 0x7fd24810c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.506+0000 7fd24ce00640 1 --2- 172.21.15.42:0/71877450 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd248108020 0x7fd248108400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.506+0000 7fd24ce00640 1 -- 172.21.15.42:0/71877450 >> 172.21.15.42:0/71877450 conn(0x7fd248077790 msgr2=0x7fd248079bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:12.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.506+0000 7fd24ce00640 1 -- 172.21.15.42:0/71877450 shutdown_connections 2024-08-26T00:12:12.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.506+0000 7fd24ce00640 1 -- 172.21.15.42:0/71877450 wait complete. 2024-08-26T00:12:12.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.507+0000 7fd24ce00640 1 Processor -- start 2024-08-26T00:12:12.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.508+0000 7fd24ce00640 1 -- start start 2024-08-26T00:12:12.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.508+0000 7fd24ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd248108020 0x7fd24819e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:12.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.508+0000 7fd24ce00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2481089d0 0x7fd24819eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:12.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.508+0000 7fd24ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24810d100 0x7fd2481a2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:12.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.508+0000 7fd24ce00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd248118180 con 0x7fd248108020 2024-08-26T00:12:12.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.508+0000 7fd24ce00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd248118000 con 0x7fd24810d100 2024-08-26T00:12:12.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.508+0000 7fd24ce00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd248118300 con 0x7fd2481089d0 2024-08-26T00:12:12.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.508+0000 7fd247e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24810d100 0x7fd2481a2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:12.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.508+0000 7fd247400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd248108020 0x7fd24819e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:12.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.508+0000 7fd23fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2481089d0 0x7fd24819eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:12.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.508+0000 7fd247e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24810d100 0x7fd2481a2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:60488/0 (socket says 172.21.15.42:60488) 2024-08-26T00:12:12.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.508+0000 7fd247e00640 1 -- 172.21.15.42:0/21908786 learned_addr learned my addr 172.21.15.42:0/21908786 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:12.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.509+0000 7fd247e00640 1 -- 172.21.15.42:0/21908786 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2481089d0 msgr2=0x7fd24819eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:12.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.509+0000 7fd247e00640 1 --2- 172.21.15.42:0/21908786 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2481089d0 0x7fd24819eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.509+0000 7fd247e00640 1 -- 172.21.15.42:0/21908786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd248108020 msgr2=0x7fd24819e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:12.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.509+0000 7fd247e00640 1 --2- 172.21.15.42:0/21908786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd248108020 0x7fd24819e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.509+0000 7fd247e00640 1 -- 172.21.15.42:0/21908786 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2481a3590 con 0x7fd24810d100 2024-08-26T00:12:12.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.509+0000 7fd247e00640 1 --2- 172.21.15.42:0/21908786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24810d100 0x7fd2481a2eb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd240033040 tx=0x7fd240003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:12.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.509+0000 7fd244c00640 1 -- 172.21.15.42:0/21908786 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd240031650 con 0x7fd24810d100 2024-08-26T00:12:12.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.509+0000 7fd244c00640 1 -- 172.21.15.42:0/21908786 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2400317f0 con 0x7fd24810d100 2024-08-26T00:12:12.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.509+0000 7fd244c00640 1 -- 172.21.15.42:0/21908786 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24002fa40 con 0x7fd24810d100 2024-08-26T00:12:12.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.509+0000 7fd24ce00640 1 -- 172.21.15.42:0/21908786 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2481a3820 con 0x7fd24810d100 2024-08-26T00:12:12.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.510+0000 7fd24ce00640 1 -- 172.21.15.42:0/21908786 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2481ab160 con 0x7fd24810d100 2024-08-26T00:12:12.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.513+0000 7fd244c00640 1 -- 172.21.15.42:0/21908786 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd24002fc80 con 0x7fd24810d100 2024-08-26T00:12:12.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.513+0000 7fd25104c740 1 Processor -- start 2024-08-26T00:12:12.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.513+0000 7fd25104c740 1 -- start start 2024-08-26T00:12:12.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.513+0000 7fd25104c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5587ec5abb40 0x5587ec5abf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:12.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.513+0000 7fd25104c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5587ec5ac460 0x5587ec5b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:12.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.514+0000 7fd25104c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5b6d20 0x5587ec5b9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:12.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.514+0000 7fd25104c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5587ec511fc0 con 0x5587ec5abb40 2024-08-26T00:12:12.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.514+0000 7fd25104c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5587ec4a9680 con 0x5587ec5b6d20 2024-08-26T00:12:12.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.514+0000 7fd25104c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5587ec50df80 con 0x5587ec5ac460 2024-08-26T00:12:12.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.514+0000 7fd23fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5587ec5abb40 0x5587ec5abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:12.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.514+0000 7fd23fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5587ec5abb40 0x5587ec5abf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45598/0 (socket says 172.21.15.42:45598) 2024-08-26T00:12:12.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.514+0000 7fd23fe00640 1 -- 172.21.15.42:0/3005579757 learned_addr learned my addr 172.21.15.42:0/3005579757 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:12.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.514+0000 7fd23fe00640 1 --2- 172.21.15.42:0/3005579757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5b6d20 0x5587ec5b9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:12.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.515+0000 7fd247400640 1 --2- 172.21.15.42:0/3005579757 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5587ec5ac460 0x5587ec5b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:12.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.515+0000 7fd23fe00640 1 -- 172.21.15.42:0/3005579757 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5587ec5ac460 msgr2=0x5587ec5b67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:12.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.515+0000 7fd244c00640 1 --2- 172.21.15.42:0/21908786 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd22c0a2b80 0x7fd22c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:12.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.515+0000 7fd23fe00640 1 --2- 172.21.15.42:0/3005579757 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5587ec5ac460 0x5587ec5b67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.515+0000 7fd23fe00640 1 -- 172.21.15.42:0/3005579757 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5587ec5abb40 msgr2=0x5587ec5abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:12.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.515+0000 7fd23fe00640 1 --2- 172.21.15.42:0/3005579757 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5587ec5abb40 0x5587ec5abf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.515+0000 7fd23fe00640 1 -- 172.21.15.42:0/3005579757 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587ec4c52c0 con 0x5587ec5b6d20 2024-08-26T00:12:12.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.515+0000 7fd244c00640 1 -- 172.21.15.42:0/21908786 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fd2400f04a0 con 0x7fd24810d100 2024-08-26T00:12:12.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.515+0000 7fd23fe00640 1 --2- 172.21.15.42:0/3005579757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5b6d20 0x5587ec5b9110 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd2300126f0 tx=0x7fd230004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4a5d21912744cb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:12.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.516+0000 7fd247e00640 1 --2- 172.21.15.42:0/21908786 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd22c0a2b80 0x7fd22c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:12.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.516+0000 7fd23cc00640 1 -- 172.21.15.42:0/3005579757 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23000d740 con 0x5587ec5b6d20 2024-08-26T00:12:12.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.516+0000 7fd23cc00640 1 -- 172.21.15.42:0/3005579757 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd23000ddc0 con 0x5587ec5b6d20 2024-08-26T00:12:12.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.516+0000 7fd23cc00640 1 -- 172.21.15.42:0/3005579757 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23000fc80 con 0x5587ec5b6d20 2024-08-26T00:12:12.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.517+0000 7fd25104c740 1 -- 172.21.15.42:0/3005579757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5b6d20 msgr2=0x5587ec5b9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:12.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.517+0000 7fd247e00640 1 --2- 172.21.15.42:0/21908786 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd22c0a2b80 0x7fd22c0a5040 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd240006010 tx=0x7fd24002a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:12.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.517+0000 7fd25104c740 1 --2- 172.21.15.42:0/3005579757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5b6d20 0x5587ec5b9110 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd2300126f0 tx=0x7fd230004730 comp rx=0 tx=0).stop 2024-08-26T00:12:12.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.517+0000 7fd25104c740 1 -- 172.21.15.42:0/3005579757 shutdown_connections 2024-08-26T00:12:12.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.517+0000 7fd25104c740 1 --2- 172.21.15.42:0/3005579757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5b6d20 0x5587ec5b9110 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.517+0000 7fd25104c740 1 --2- 172.21.15.42:0/3005579757 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5587ec5ac460 0x5587ec5b67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.517+0000 7fd25104c740 1 --2- 172.21.15.42:0/3005579757 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5587ec5abb40 0x5587ec5abf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.517+0000 7fd25104c740 1 -- 172.21.15.42:0/3005579757 >> 172.21.15.42:0/3005579757 conn(0x5587ec5a8080 msgr2=0x5587ec5a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:12.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.517+0000 7fd25104c740 1 -- 172.21.15.42:0/3005579757 shutdown_connections 2024-08-26T00:12:12.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.517+0000 7fd25104c740 1 -- 172.21.15.42:0/3005579757 wait complete. 2024-08-26T00:12:12.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.518+0000 7fd25104c740 1 -- start start 2024-08-26T00:12:12.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.518+0000 7fd25104c740 1 Processor -- start 2024-08-26T00:12:12.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.519+0000 7fd25104c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5587ec5abb40 0x5587ec5b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:12.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.519+0000 7fd25104c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5ac460 0x5587ec5b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:12.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.519+0000 7fd25104c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5587ec5b6d20 0x5587ec5b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:12.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.519+0000 7fd25104c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5587ec5b98f0 con 0x5587ec5b6d20 2024-08-26T00:12:12.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.519+0000 7fd25104c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5587ec4cce50 con 0x5587ec5ac460 2024-08-26T00:12:12.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.519+0000 7fd25104c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5587ec5b9a70 con 0x5587ec5abb40 2024-08-26T00:12:12.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.519+0000 7fd25104c740 10 client.0 _ll_register_callbacks cb 0x5587ec4b7f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:12:12.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.519+0000 7fd247400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5ac460 0x5587ec5b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:12.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.519+0000 7fd247400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5ac460 0x5587ec5b41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:60506/0 (socket says 172.21.15.42:60506) 2024-08-26T00:12:12.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.519+0000 7fd247400640 1 -- 172.21.15.42:0/819517180 learned_addr learned my addr 172.21.15.42:0/819517180 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:12.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.520+0000 7fd23fe00640 1 --2- 172.21.15.42:0/819517180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5587ec5b6d20 0x5587ec5b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:12.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.520+0000 7fd23fe00640 1 --2- 172.21.15.42:0/819517180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5587ec5abb40 0x5587ec5b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:12.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.520+0000 7fd247400640 1 -- 172.21.15.42:0/819517180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5587ec5abb40 msgr2=0x5587ec5b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:12.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.520+0000 7fd247400640 1 --2- 172.21.15.42:0/819517180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5587ec5abb40 0x5587ec5b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.520+0000 7fd247400640 1 -- 172.21.15.42:0/819517180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5587ec5b6d20 msgr2=0x5587ec5b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:12.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.520+0000 7fd247400640 1 --2- 172.21.15.42:0/819517180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5587ec5b6d20 0x5587ec5b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.520+0000 7fd247400640 1 -- 172.21.15.42:0/819517180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587ec2833c0 con 0x5587ec5ac460 2024-08-26T00:12:12.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.520+0000 7fd23fe00640 1 --2- 172.21.15.42:0/819517180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5587ec5abb40 0x5587ec5b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:12:12.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.520+0000 7fd247400640 1 --2- 172.21.15.42:0/819517180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5ac460 0x5587ec5b41a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd2380126b0 tx=0x7fd238012b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c6df7e3fda5bfe8 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:12.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.520+0000 7fd235600640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:12:12.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.521+0000 7fd235600640 1 -- 172.21.15.42:0/819517180 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd238004020 con 0x5587ec5ac460 2024-08-26T00:12:12.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.521+0000 7fd235600640 1 -- 172.21.15.42:0/819517180 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fd2380041c0 con 0x5587ec5ac460 2024-08-26T00:12:12.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.521+0000 7fd25104c740 1 -- 172.21.15.42:0/819517180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd23000ddc0 con 0x5587ec5ac460 2024-08-26T00:12:12.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.521+0000 7fd235600640 1 -- 172.21.15.42:0/819517180 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd2380043c0 con 0x5587ec5ac460 2024-08-26T00:12:12.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.521+0000 7fd25104c740 10 client.26072 fetch_fsmap learned FSMap version 31 2024-08-26T00:12:12.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.521+0000 7fd25104c740 1 -- 172.21.15.42:0/819517180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5587ec5c56a0 con 0x5587ec5ac460 2024-08-26T00:12:12.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.521+0000 7fd235600640 1 -- 172.21.15.42:0/819517180 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd23000ddc0 con 0x5587ec5ac460 2024-08-26T00:12:12.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.522+0000 7fd235600640 1 -- 172.21.15.42:0/819517180 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fd23800f920 con 0x5587ec5ac460 2024-08-26T00:12:12.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.522+0000 7fd25104c740 10 client.26072 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:12:12.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.522+0000 7fd25104c740 10 client.26072 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:12:12.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.522+0000 7fd25104c740 20 client.26072 populate_metadata read hostname 'smithi042' 2024-08-26T00:12:12.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.522+0000 7fd25104c740 1 --2- 172.21.15.42:0/819517180 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5587ec5c6bb0 0x5587ec5c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:12.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.522+0000 7fd25104c740 4 client.26072 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:12:12.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.522+0000 7fd25104c740 1 -- 172.21.15.42:0/819517180 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587ec51f530 con 0x5587ec5c6bb0 2024-08-26T00:12:12.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.523+0000 7fd23fe00640 1 --2- 172.21.15.42:0/819517180 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5587ec5c6bb0 0x5587ec5c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:12.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.524+0000 7fd23fe00640 1 --2- 172.21.15.42:0/819517180 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5587ec5c6bb0 0x5587ec5c8fa0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4f52d2824fe428d server_cookie=6a27d31e908d5773 in_seq=0 out_seq=0 2024-08-26T00:12:12.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.524+0000 7fd235600640 10 client.26072 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:12:12.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.524+0000 7fd235600640 1 -- 172.21.15.42:0/819517180 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5587ec51f530 con 0x5587ec5c6bb0 2024-08-26T00:12:12.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.524+0000 7fd235600640 10 client.26072 handle_command_reply: tid=0 2024-08-26T00:12:12.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.524+0000 7fd25104c740 1 client.26072 shutdown 2024-08-26T00:12:12.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.525+0000 7fd25104c740 1 -- 172.21.15.42:0/819517180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5ac460 msgr2=0x5587ec5b41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:12.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.525+0000 7fd25104c740 1 --2- 172.21.15.42:0/819517180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5ac460 0x5587ec5b41a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd2380126b0 tx=0x7fd238012b70 comp rx=0 tx=0).stop 2024-08-26T00:12:12.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.525+0000 7fd25104c740 1 -- 172.21.15.42:0/819517180 shutdown_connections 2024-08-26T00:12:12.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.525+0000 7fd25104c740 1 --2- 172.21.15.42:0/819517180 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5587ec5c6bb0 0x5587ec5c8fa0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.525+0000 7fd25104c740 1 --2- 172.21.15.42:0/819517180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5587ec5b6d20 0x5587ec5b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.525+0000 7fd25104c740 1 --2- 172.21.15.42:0/819517180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5ac460 0x5587ec5b41a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.525+0000 7fd25104c740 1 --2- 172.21.15.42:0/819517180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5587ec5abb40 0x5587ec5b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.525+0000 7fd25104c740 1 -- 172.21.15.42:0/819517180 >> 172.21.15.42:0/819517180 conn(0x5587ec5a8080 msgr2=0x5587ec5ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:12.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.525+0000 7fd235600640 0 client.26072 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:12:12.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.525+0000 7fd25104c740 1 -- 172.21.15.42:0/819517180 shutdown_connections 2024-08-26T00:12:12.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.525+0000 7fd25104c740 1 -- 172.21.15.42:0/819517180 wait complete. 2024-08-26T00:12:12.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.525+0000 7fd25104c740 20 client.26072 trim_cache size 0 max 16384 2024-08-26T00:12:12.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.544+0000 7fd25104c740 1 Processor -- start 2024-08-26T00:12:12.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.545+0000 7fd25104c740 1 -- start start 2024-08-26T00:12:12.545 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:12 smithi042 ceph-mon[17225]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 356 op/s 2024-08-26T00:12:12.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.545+0000 7fd25104c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5587ec5abb40 0x5587ec5adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:12.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.545+0000 7fd25104c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5587ec5ac460 0x5587ec5ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:12.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.545+0000 7fd25104c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5b6d20 0x5587ec5cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:12.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.545+0000 7fd25104c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd2481b6110 con 0x5587ec5ac460 2024-08-26T00:12:12.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.545+0000 7fd25104c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd2481b3920 con 0x5587ec5b6d20 2024-08-26T00:12:12.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.545+0000 7fd25104c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd2481b1750 con 0x5587ec5abb40 2024-08-26T00:12:12.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.545+0000 7fd247400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5587ec5ac460 0x5587ec5ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:12.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.545+0000 7fd247400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5587ec5ac460 0x5587ec5ce890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45616/0 (socket says 172.21.15.42:45616) 2024-08-26T00:12:12.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.545+0000 7fd247400640 1 -- 172.21.15.42:0/1082729497 learned_addr learned my addr 172.21.15.42:0/1082729497 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:12.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.545+0000 7fd23fe00640 1 --2- 172.21.15.42:0/1082729497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5b6d20 0x5587ec5cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:12.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.546+0000 7fd23fe00640 1 --2- 172.21.15.42:0/1082729497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5587ec5abb40 0x5587ec5adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:12.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.546+0000 7fd247400640 1 -- 172.21.15.42:0/1082729497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5587ec5abb40 msgr2=0x5587ec5adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:12.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.546+0000 7fd247400640 1 --2- 172.21.15.42:0/1082729497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5587ec5abb40 0x5587ec5adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.546+0000 7fd247400640 1 -- 172.21.15.42:0/1082729497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5b6d20 msgr2=0x5587ec5cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:12.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.546+0000 7fd247400640 1 --2- 172.21.15.42:0/1082729497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5b6d20 0x5587ec5cedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.546+0000 7fd247400640 1 -- 172.21.15.42:0/1082729497 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587ec5a7eb0 con 0x5587ec5ac460 2024-08-26T00:12:12.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.546+0000 7fd247400640 1 --2- 172.21.15.42:0/1082729497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5587ec5ac460 0x5587ec5ce890 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd23800f7c0 tx=0x7fd238017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a66b4b2305389 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:12.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.547+0000 7fd237e00640 1 -- 172.21.15.42:0/1082729497 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23802c070 con 0x5587ec5ac460 2024-08-26T00:12:12.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.547+0000 7fd237e00640 1 -- 172.21.15.42:0/1082729497 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd238003b40 con 0x5587ec5ac460 2024-08-26T00:12:12.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.547+0000 7fd237e00640 1 -- 172.21.15.42:0/1082729497 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23801c6d0 con 0x5587ec5ac460 2024-08-26T00:12:12.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.548+0000 7fd25104c740 1 -- 172.21.15.42:0/1082729497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5587ec5ac460 msgr2=0x5587ec5ce890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:12.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.548+0000 7fd25104c740 1 --2- 172.21.15.42:0/1082729497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5587ec5ac460 0x5587ec5ce890 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd23800f7c0 tx=0x7fd238017000 comp rx=0 tx=0).stop 2024-08-26T00:12:12.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.548+0000 7fd25104c740 1 -- 172.21.15.42:0/1082729497 shutdown_connections 2024-08-26T00:12:12.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.548+0000 7fd25104c740 1 --2- 172.21.15.42:0/1082729497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5b6d20 0x5587ec5cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.548+0000 7fd25104c740 1 --2- 172.21.15.42:0/1082729497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5587ec5ac460 0x5587ec5ce890 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.548+0000 7fd25104c740 1 --2- 172.21.15.42:0/1082729497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5587ec5abb40 0x5587ec5adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.548+0000 7fd25104c740 1 -- 172.21.15.42:0/1082729497 >> 172.21.15.42:0/1082729497 conn(0x5587ec5a8080 msgr2=0x5587ec5ad5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:12.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.548+0000 7fd25104c740 1 -- 172.21.15.42:0/1082729497 shutdown_connections 2024-08-26T00:12:12.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.548+0000 7fd25104c740 1 -- 172.21.15.42:0/1082729497 wait complete. 2024-08-26T00:12:12.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.549+0000 7fd25104c740 1 -- start start 2024-08-26T00:12:12.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.549+0000 7fd25104c740 1 Processor -- start 2024-08-26T00:12:12.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.550+0000 7fd25104c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5abb40 0x5587ec5bf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:12.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.550+0000 7fd25104c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5587ec5ac460 0x5587ec5ba690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:12.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.550+0000 7fd25104c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5587ec5b6d20 0x5587ec5babd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:12.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.550+0000 7fd25104c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd2481b1de0 con 0x5587ec5b6d20 2024-08-26T00:12:12.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.550+0000 7fd25104c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd2481b3250 con 0x5587ec5abb40 2024-08-26T00:12:12.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.550+0000 7fd25104c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd2481b24b0 con 0x5587ec5ac460 2024-08-26T00:12:12.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.550+0000 7fd25104c740 10 client.0 _ll_register_callbacks cb 0x7fd238009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:12:12.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.550+0000 7fd23fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5abb40 0x5587ec5bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:12.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.550+0000 7fd23fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5abb40 0x5587ec5bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:60528/0 (socket says 172.21.15.42:60528) 2024-08-26T00:12:12.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.550+0000 7fd23fe00640 1 -- 172.21.15.42:0/3501049825 learned_addr learned my addr 172.21.15.42:0/3501049825 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:12.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.550+0000 7fd247400640 1 --2- 172.21.15.42:0/3501049825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5587ec5ac460 0x5587ec5ba690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:12.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.550+0000 7fd23fe00640 1 --2- 172.21.15.42:0/3501049825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5587ec5b6d20 0x5587ec5babd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:12.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.551+0000 7fd23fe00640 1 -- 172.21.15.42:0/3501049825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5587ec5ac460 msgr2=0x5587ec5ba690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:12.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.551+0000 7fd23fe00640 1 --2- 172.21.15.42:0/3501049825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5587ec5ac460 0x5587ec5ba690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.551+0000 7fd23fe00640 1 -- 172.21.15.42:0/3501049825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5587ec5b6d20 msgr2=0x5587ec5babd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:12.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.551+0000 7fd23fe00640 1 --2- 172.21.15.42:0/3501049825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5587ec5b6d20 0x5587ec5babd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.551+0000 7fd23fe00640 1 -- 172.21.15.42:0/3501049825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587ec5ab970 con 0x5587ec5abb40 2024-08-26T00:12:12.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.551+0000 7fd247400640 1 --2- 172.21.15.42:0/3501049825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5587ec5ac460 0x5587ec5ba690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:12:12.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.551+0000 7fd23fe00640 1 --2- 172.21.15.42:0/3501049825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5abb40 0x5587ec5bf360 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd230005d00 tx=0x7fd238009de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb34303b31c7e573 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:12.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.551+0000 7fd235600640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:12:12.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.551+0000 7fd235600640 1 -- 172.21.15.42:0/3501049825 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd230025030 con 0x5587ec5abb40 2024-08-26T00:12:12.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.551+0000 7fd235600640 1 -- 172.21.15.42:0/3501049825 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fd23000fb90 con 0x5587ec5abb40 2024-08-26T00:12:12.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.551+0000 7fd25104c740 1 -- 172.21.15.42:0/3501049825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd238003b40 con 0x5587ec5abb40 2024-08-26T00:12:12.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.552+0000 7fd235600640 1 -- 172.21.15.42:0/3501049825 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd230029040 con 0x5587ec5abb40 2024-08-26T00:12:12.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.552+0000 7fd25104c740 10 client.26078 fetch_fsmap learned FSMap version 31 2024-08-26T00:12:12.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.552+0000 7fd25104c740 1 -- 172.21.15.42:0/3501049825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5587ec6315b0 con 0x5587ec5abb40 2024-08-26T00:12:12.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.552+0000 7fd235600640 1 -- 172.21.15.42:0/3501049825 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd238003b40 con 0x5587ec5abb40 2024-08-26T00:12:12.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.552+0000 7fd235600640 1 -- 172.21.15.42:0/3501049825 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fd23001f530 con 0x5587ec5abb40 2024-08-26T00:12:12.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.552+0000 7fd25104c740 10 client.26078 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:12:12.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.552+0000 7fd25104c740 10 client.26078 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:12:12.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.552+0000 7fd25104c740 20 client.26078 populate_metadata read hostname 'smithi042' 2024-08-26T00:12:12.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.552+0000 7fd25104c740 1 --2- 172.21.15.42:0/3501049825 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5587ec631b00 0x5587ec633f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:12.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.552+0000 7fd25104c740 4 client.26078 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-26T00:12:12.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.552+0000 7fd25104c740 1 -- 172.21.15.42:0/3501049825 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5587ec519a40 con 0x5587ec631b00 2024-08-26T00:12:12.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.553+0000 7fd247400640 1 --2- 172.21.15.42:0/3501049825 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5587ec631b00 0x5587ec633f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:12.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.553+0000 7fd247400640 1 --2- 172.21.15.42:0/3501049825 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5587ec631b00 0x5587ec633f20 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b080592032b7e57c server_cookie=5a69559909416c90 in_seq=0 out_seq=0 2024-08-26T00:12:12.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.553+0000 7fd235600640 10 client.26078 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:12:12.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.553+0000 7fd235600640 1 -- 172.21.15.42:0/3501049825 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5587ec519a40 con 0x5587ec631b00 2024-08-26T00:12:12.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.554+0000 7fd235600640 10 client.26078 handle_command_reply: tid=0 2024-08-26T00:12:12.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.554+0000 7fd25104c740 1 client.26078 shutdown 2024-08-26T00:12:12.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.554+0000 7fd25104c740 1 -- 172.21.15.42:0/3501049825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5abb40 msgr2=0x5587ec5bf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:12.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.554+0000 7fd25104c740 1 --2- 172.21.15.42:0/3501049825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5abb40 0x5587ec5bf360 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd230005d00 tx=0x7fd238009de0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.554+0000 7fd25104c740 1 -- 172.21.15.42:0/3501049825 shutdown_connections 2024-08-26T00:12:12.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.554+0000 7fd25104c740 1 --2- 172.21.15.42:0/3501049825 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5587ec631b00 0x5587ec633f20 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.554+0000 7fd25104c740 1 --2- 172.21.15.42:0/3501049825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5587ec5b6d20 0x5587ec5babd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.554+0000 7fd25104c740 1 --2- 172.21.15.42:0/3501049825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5587ec5ac460 0x5587ec5ba690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.554+0000 7fd25104c740 1 --2- 172.21.15.42:0/3501049825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5587ec5abb40 0x5587ec5bf360 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.554+0000 7fd25104c740 1 -- 172.21.15.42:0/3501049825 >> 172.21.15.42:0/3501049825 conn(0x5587ec5a8080 msgr2=0x5587ec5b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:12.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.554+0000 7fd235600640 0 client.26078 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:12:12.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.554+0000 7fd25104c740 1 -- 172.21.15.42:0/3501049825 shutdown_connections 2024-08-26T00:12:12.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.554+0000 7fd25104c740 1 -- 172.21.15.42:0/3501049825 wait complete. 2024-08-26T00:12:12.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.555+0000 7fd25104c740 20 client.26078 trim_cache size 0 max 16384 2024-08-26T00:12:12.557 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:12:12.558 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-08-26T00:12:12.558 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {} 2024-08-26T00:12:12.558 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:12:12.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.555+0000 7fd24ce00640 1 -- 172.21.15.42:0/21908786 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd22c0a2b80 msgr2=0x7fd22c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:12.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.555+0000 7fd24ce00640 1 --2- 172.21.15.42:0/21908786 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd22c0a2b80 0x7fd22c0a5040 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd240006010 tx=0x7fd24002a8c0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.555+0000 7fd24ce00640 1 -- 172.21.15.42:0/21908786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24810d100 msgr2=0x7fd2481a2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:12.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.555+0000 7fd24ce00640 1 --2- 172.21.15.42:0/21908786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24810d100 0x7fd2481a2eb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd240033040 tx=0x7fd240003f10 comp rx=0 tx=0).stop 2024-08-26T00:12:12.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.555+0000 7fd24ce00640 1 -- 172.21.15.42:0/21908786 shutdown_connections 2024-08-26T00:12:12.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.555+0000 7fd24ce00640 1 --2- 172.21.15.42:0/21908786 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fd22c0a2b80 0x7fd22c0a5040 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.555+0000 7fd24ce00640 1 --2- 172.21.15.42:0/21908786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24810d100 0x7fd2481a2eb0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.555+0000 7fd24ce00640 1 --2- 172.21.15.42:0/21908786 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2481089d0 0x7fd24819eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.555+0000 7fd24ce00640 1 --2- 172.21.15.42:0/21908786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd248108020 0x7fd24819e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:12.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.555+0000 7fd24ce00640 1 -- 172.21.15.42:0/21908786 >> 172.21.15.42:0/21908786 conn(0x7fd248077790 msgr2=0x7fd2480789f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:12.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.556+0000 7fd24ce00640 1 -- 172.21.15.42:0/21908786 shutdown_connections 2024-08-26T00:12:12.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:12.556+0000 7fd24ce00640 1 -- 172.21.15.42:0/21908786 wait complete. 2024-08-26T00:12:12.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:12 smithi181 ceph-mon[22102]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 356 op/s 2024-08-26T00:12:13.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:12 smithi043 ceph-mon[22091]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 356 op/s 2024-08-26T00:12:13.695 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-26T00:12:13.695 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:12:14.162 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:12:14.712 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:14 smithi042 ceph-mon[17225]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 407 op/s 2024-08-26T00:12:14.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.838+0000 7fcbd5a00640 1 -- 172.21.15.42:0/928936568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbd0100e70 msgr2=0x7fcbd010db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:14.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.838+0000 7fcbd5a00640 1 --2- 172.21.15.42:0/928936568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbd0100e70 0x7fcbd010db30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc009900 tx=0x7fcbbc02a3f0 comp rx=0 tx=0).stop 2024-08-26T00:12:14.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.839+0000 7fcbd5a00640 1 -- 172.21.15.42:0/928936568 shutdown_connections 2024-08-26T00:12:14.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.839+0000 7fcbd5a00640 1 --2- 172.21.15.42:0/928936568 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbd010e070 0x7fcbd0110460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:14.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.839+0000 7fcbd5a00640 1 --2- 172.21.15.42:0/928936568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbd0100e70 0x7fcbd010db30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:14.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.839+0000 7fcbd5a00640 1 --2- 172.21.15.42:0/928936568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbd01004c0 0x7fcbd01008a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:14.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.839+0000 7fcbd5a00640 1 -- 172.21.15.42:0/928936568 >> 172.21.15.42:0/928936568 conn(0x7fcbd00fc3b0 msgr2=0x7fcbd00fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:14.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.839+0000 7fcbd5a00640 1 -- 172.21.15.42:0/928936568 shutdown_connections 2024-08-26T00:12:14.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.839+0000 7fcbd5a00640 1 -- 172.21.15.42:0/928936568 wait complete. 2024-08-26T00:12:14.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.840+0000 7fcbd5a00640 1 Processor -- start 2024-08-26T00:12:14.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.840+0000 7fcbd5a00640 1 -- start start 2024-08-26T00:12:14.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.840+0000 7fcbd5a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbd01004c0 0x7fcbd019a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:14.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.840+0000 7fcbd5a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbd0100e70 0x7fcbd019a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:14.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.840+0000 7fcbd5a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbd010e070 0x7fcbd019ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:14.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.840+0000 7fcbd5a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd0113d70 con 0x7fcbd01004c0 2024-08-26T00:12:14.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.840+0000 7fcbd5a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd0113bf0 con 0x7fcbd010e070 2024-08-26T00:12:14.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.840+0000 7fcbd5a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd0113ef0 con 0x7fcbd0100e70 2024-08-26T00:12:14.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.840+0000 7fcbcfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbd01004c0 0x7fcbd019a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:14.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.840+0000 7fcbd5000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbd010e070 0x7fcbd019ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:14.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.840+0000 7fcbcfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbd01004c0 0x7fcbd019a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36174/0 (socket says 172.21.15.42:36174) 2024-08-26T00:12:14.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.840+0000 7fcbcfe00640 1 -- 172.21.15.42:0/4292749386 learned_addr learned my addr 172.21.15.42:0/4292749386 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:14.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.841+0000 7fcbcf400640 1 --2- 172.21.15.42:0/4292749386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbd0100e70 0x7fcbd019a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:14.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.841+0000 7fcbd5000640 1 -- 172.21.15.42:0/4292749386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbd0100e70 msgr2=0x7fcbd019a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:14.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.841+0000 7fcbd5000640 1 --2- 172.21.15.42:0/4292749386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbd0100e70 0x7fcbd019a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:14.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.841+0000 7fcbd5000640 1 -- 172.21.15.42:0/4292749386 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbd01004c0 msgr2=0x7fcbd019a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:14.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.841+0000 7fcbd5000640 1 --2- 172.21.15.42:0/4292749386 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbd01004c0 0x7fcbd019a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:14.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.841+0000 7fcbd5000640 1 -- 172.21.15.42:0/4292749386 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd019f2c0 con 0x7fcbd010e070 2024-08-26T00:12:14.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.841+0000 7fcbcfe00640 1 --2- 172.21.15.42:0/4292749386 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbd01004c0 0x7fcbd019a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:12:14.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.841+0000 7fcbd5000640 1 --2- 172.21.15.42:0/4292749386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbd010e070 0x7fcbd019ebe0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcbd01026a0 tx=0x7fcbc800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:14.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.842+0000 7fcbccc00640 1 -- 172.21.15.42:0/4292749386 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8003b70 con 0x7fcbd010e070 2024-08-26T00:12:14.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.842+0000 7fcbccc00640 1 -- 172.21.15.42:0/4292749386 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbc800ce40 con 0x7fcbd010e070 2024-08-26T00:12:14.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.842+0000 7fcbccc00640 1 -- 172.21.15.42:0/4292749386 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8010830 con 0x7fcbd010e070 2024-08-26T00:12:14.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.842+0000 7fcbd5a00640 1 -- 172.21.15.42:0/4292749386 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd019f5b0 con 0x7fcbd010e070 2024-08-26T00:12:14.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.842+0000 7fcbd5a00640 1 -- 172.21.15.42:0/4292749386 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd01a6e90 con 0x7fcbd010e070 2024-08-26T00:12:14.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.843+0000 7fcbd5a00640 1 -- 172.21.15.42:0/4292749386 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbd01008a0 con 0x7fcbd010e070 2024-08-26T00:12:14.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.845+0000 7fcbccc00640 1 -- 172.21.15.42:0/4292749386 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcbc8004b40 con 0x7fcbd010e070 2024-08-26T00:12:14.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.846+0000 7fcbccc00640 1 --2- 172.21.15.42:0/4292749386 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcbb40a2b80 0x7fcbb40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:14.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.846+0000 7fcbccc00640 1 -- 172.21.15.42:0/4292749386 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fcbc80cf540 con 0x7fcbd010e070 2024-08-26T00:12:14.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.847+0000 7fcbcfe00640 1 --2- 172.21.15.42:0/4292749386 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcbb40a2b80 0x7fcbb40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:14.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.847+0000 7fcbcfe00640 1 --2- 172.21.15.42:0/4292749386 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcbb40a2b80 0x7fcbb40a5040 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0011550 tx=0x7fcbc0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:14.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:14.852+0000 7fcbccc00640 1 -- 172.21.15.42:0/4292749386 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fcbc809c460 con 0x7fcbd010e070 2024-08-26T00:12:15.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:14 smithi043 ceph-mon[22091]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 407 op/s 2024-08-26T00:12:15.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:14 smithi181 ceph-mon[22102]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 407 op/s 2024-08-26T00:12:15.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:15.088+0000 7fcbd5a00640 1 -- 172.21.15.42:0/4292749386 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcbd019b670 con 0x7fcbd010e070 2024-08-26T00:12:15.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:15.089+0000 7fcbccc00640 1 -- 172.21.15.42:0/4292749386 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11918 (secure 0 0 0) 0x7fcbd019b670 con 0x7fcbd010e070 2024-08-26T00:12:15.091 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:12:15.091 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":31,"btime":"2024-08-26T00:10:53:344411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3168581452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3168581452},{"type":"v1","addr":"172.21.15.42:6839","nonce":3168581452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/3533492491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":3533492491},{"type":"v1","addr":"172.21.15.42:6841","nonce":3533492491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-26T00:00:30.169633+0000","modified":"2024-08-26T00:10:53.123094+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24532,"mds_1":24527,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6839/2653014277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2653014277},{"type":"v1","addr":"172.21.15.43:6839","nonce":2653014277}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24532,"qdb_cluster":[24514,24527,24532]},"id":1}]} 2024-08-26T00:12:15.095 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 31 2024-08-26T00:12:15.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:15.091+0000 7fcbd5a00640 1 -- 172.21.15.42:0/4292749386 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcbb40a2b80 msgr2=0x7fcbb40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:15.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:15.091+0000 7fcbd5a00640 1 --2- 172.21.15.42:0/4292749386 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcbb40a2b80 0x7fcbb40a5040 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0011550 tx=0x7fcbc0005f90 comp rx=0 tx=0).stop 2024-08-26T00:12:15.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:15.091+0000 7fcbd5a00640 1 -- 172.21.15.42:0/4292749386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbd010e070 msgr2=0x7fcbd019ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:15.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:15.091+0000 7fcbd5a00640 1 --2- 172.21.15.42:0/4292749386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbd010e070 0x7fcbd019ebe0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcbd01026a0 tx=0x7fcbc800c6a0 comp rx=0 tx=0).stop 2024-08-26T00:12:15.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:15.091+0000 7fcbd5a00640 1 -- 172.21.15.42:0/4292749386 shutdown_connections 2024-08-26T00:12:15.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:15.091+0000 7fcbd5a00640 1 --2- 172.21.15.42:0/4292749386 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fcbb40a2b80 0x7fcbb40a5040 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:15.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:15.091+0000 7fcbd5a00640 1 --2- 172.21.15.42:0/4292749386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbd010e070 0x7fcbd019ebe0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:15.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:15.091+0000 7fcbd5a00640 1 --2- 172.21.15.42:0/4292749386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbd0100e70 0x7fcbd019a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:15.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:15.091+0000 7fcbd5a00640 1 --2- 172.21.15.42:0/4292749386 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbd01004c0 0x7fcbd019a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:15.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:15.091+0000 7fcbd5a00640 1 -- 172.21.15.42:0/4292749386 >> 172.21.15.42:0/4292749386 conn(0x7fcbd00fc3b0 msgr2=0x7fcbd00fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:15.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:15.092+0000 7fcbd5a00640 1 -- 172.21.15.42:0/4292749386 shutdown_connections 2024-08-26T00:12:15.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:15.092+0000 7fcbd5a00640 1 -- 172.21.15.42:0/4292749386 wait complete. 2024-08-26T00:12:15.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:15 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/4292749386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:12:15.859 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-26T00:12:16.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:15 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/4292749386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:12:16.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:15 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/4292749386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:12:16.258 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:12:16.744 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:16 smithi042 ceph-mon[17225]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 356 op/s 2024-08-26T00:12:16.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.747+0000 7f84db200640 1 -- 172.21.15.42:0/4169872852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84d4104760 msgr2=0x7f84d41087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:16.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.747+0000 7f84db200640 1 --2- 172.21.15.42:0/4169872852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84d4104760 0x7f84d41087b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f84c4009860 tx=0x7f84c402a340 comp rx=0 tx=0).stop 2024-08-26T00:12:16.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.747+0000 7f84db200640 1 -- 172.21.15.42:0/4169872852 shutdown_connections 2024-08-26T00:12:16.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.747+0000 7f84db200640 1 --2- 172.21.15.42:0/4169872852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84d4108ee0 0x7f84d4110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.747+0000 7f84db200640 1 --2- 172.21.15.42:0/4169872852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84d4104760 0x7f84d41087b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.747+0000 7f84db200640 1 --2- 172.21.15.42:0/4169872852 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84d4103db0 0x7f84d4104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.747+0000 7f84db200640 1 -- 172.21.15.42:0/4169872852 >> 172.21.15.42:0/4169872852 conn(0x7f84d40ff7f0 msgr2=0x7f84d4101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:16.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.747+0000 7f84db200640 1 -- 172.21.15.42:0/4169872852 shutdown_connections 2024-08-26T00:12:16.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.747+0000 7f84db200640 1 -- 172.21.15.42:0/4169872852 wait complete. 2024-08-26T00:12:16.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.748+0000 7f84db200640 1 Processor -- start 2024-08-26T00:12:16.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.748+0000 7f84db200640 1 -- start start 2024-08-26T00:12:16.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.748+0000 7f84db200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84d4103db0 0x7f84d419a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:16.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.748+0000 7f84db200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84d4104760 0x7f84d419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:16.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.748+0000 7f84db200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84d4108ee0 0x7f84d419ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:16.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.748+0000 7f84db200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f84d4113f40 con 0x7f84d4103db0 2024-08-26T00:12:16.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.748+0000 7f84db200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f84d4113dc0 con 0x7f84d4108ee0 2024-08-26T00:12:16.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.748+0000 7f84db200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f84d41140c0 con 0x7f84d4104760 2024-08-26T00:12:16.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.749+0000 7f84d3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84d4103db0 0x7f84d419a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:16.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.749+0000 7f84d3400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84d4104760 0x7f84d419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:16.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.749+0000 7f84d3400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84d4104760 0x7f84d419a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:49888/0 (socket says 172.21.15.42:49888) 2024-08-26T00:12:16.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.749+0000 7f84d3400640 1 -- 172.21.15.42:0/1103167236 learned_addr learned my addr 172.21.15.42:0/1103167236 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:16.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.749+0000 7f84d9200640 1 --2- 172.21.15.42:0/1103167236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84d4108ee0 0x7f84d419ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:16.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.749+0000 7f84d3e00640 1 -- 172.21.15.42:0/1103167236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84d4104760 msgr2=0x7f84d419a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:16.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.749+0000 7f84d3e00640 1 --2- 172.21.15.42:0/1103167236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84d4104760 0x7f84d419a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.749+0000 7f84d3e00640 1 -- 172.21.15.42:0/1103167236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84d4108ee0 msgr2=0x7f84d419ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:16.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.749+0000 7f84d3e00640 1 --2- 172.21.15.42:0/1103167236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84d4108ee0 0x7f84d419ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.749+0000 7f84d3e00640 1 -- 172.21.15.42:0/1103167236 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d419f3b0 con 0x7f84d4103db0 2024-08-26T00:12:16.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.749+0000 7f84d9200640 1 --2- 172.21.15.42:0/1103167236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84d4108ee0 0x7f84d419ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:12:16.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.749+0000 7f84d3400640 1 --2- 172.21.15.42:0/1103167236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84d4104760 0x7f84d419a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:12:16.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.749+0000 7f84d3e00640 1 --2- 172.21.15.42:0/1103167236 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84d4103db0 0x7f84d419a400 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f84cc00ef80 tx=0x7f84cc00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:16.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.750+0000 7f84d0c00640 1 -- 172.21.15.42:0/1103167236 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc003970 con 0x7f84d4103db0 2024-08-26T00:12:16.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.750+0000 7f84d0c00640 1 -- 172.21.15.42:0/1103167236 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84cc004020 con 0x7f84d4103db0 2024-08-26T00:12:16.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.750+0000 7f84db200640 1 -- 172.21.15.42:0/1103167236 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84d419f6a0 con 0x7f84d4103db0 2024-08-26T00:12:16.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.750+0000 7f84d0c00640 1 -- 172.21.15.42:0/1103167236 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc00ba10 con 0x7f84d4103db0 2024-08-26T00:12:16.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.750+0000 7f84db200640 1 -- 172.21.15.42:0/1103167236 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84d41a6f80 con 0x7f84d4103db0 2024-08-26T00:12:16.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.753+0000 7f84d0c00640 1 -- 172.21.15.42:0/1103167236 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f84cc01d060 con 0x7f84d4103db0 2024-08-26T00:12:16.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.753+0000 7f84dddda740 1 Processor -- start 2024-08-26T00:12:16.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.753+0000 7f84dddda740 1 -- start start 2024-08-26T00:12:16.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.754+0000 7f84dddda740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664b94740 0x55c664b94b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:16.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.754+0000 7f84dddda740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b95060 0x55c664ba7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:16.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.754+0000 7f84dddda740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c664ba8210 0x55c664baa600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:16.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.754+0000 7f84dddda740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c664afaf30 con 0x55c664b94740 2024-08-26T00:12:16.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.754+0000 7f84dddda740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c664a925a0 con 0x55c664ba8210 2024-08-26T00:12:16.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.754+0000 7f84dddda740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c664af6ef0 con 0x55c664b95060 2024-08-26T00:12:16.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.754+0000 7f84d3e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b95060 0x55c664ba7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:16.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.754+0000 7f84d3e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b95060 0x55c664ba7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:49904/0 (socket says 172.21.15.42:49904) 2024-08-26T00:12:16.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.754+0000 7f84d3e00640 1 -- 172.21.15.42:0/3106431167 learned_addr learned my addr 172.21.15.42:0/3106431167 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:16.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.754+0000 7f84d9200640 1 --2- 172.21.15.42:0/3106431167 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664b94740 0x55c664b94b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:16.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.754+0000 7f84d3400640 1 --2- 172.21.15.42:0/3106431167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c664ba8210 0x55c664baa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:16.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.754+0000 7f84d0c00640 1 --2- 172.21.15.42:0/1103167236 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f84b80a2c00 0x7f84b80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:16.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.755+0000 7f84d3e00640 1 -- 172.21.15.42:0/3106431167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c664ba8210 msgr2=0x55c664baa600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:16.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.755+0000 7f84d3e00640 1 --2- 172.21.15.42:0/3106431167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c664ba8210 0x55c664baa600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.755+0000 7f84d3e00640 1 -- 172.21.15.42:0/3106431167 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664b94740 msgr2=0x55c664b94b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:16.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.755+0000 7f84d0c00640 1 -- 172.21.15.42:0/1103167236 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f84cc01b070 con 0x7f84d4103db0 2024-08-26T00:12:16.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.755+0000 7f84d3e00640 1 --2- 172.21.15.42:0/3106431167 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664b94740 0x55c664b94b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.755+0000 7f84d3e00640 1 -- 172.21.15.42:0/3106431167 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c66486c3c0 con 0x55c664b95060 2024-08-26T00:12:16.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.755+0000 7f84d3400640 1 --2- 172.21.15.42:0/3106431167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c664ba8210 0x55c664baa600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:12:16.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.755+0000 7f84d9200640 1 --2- 172.21.15.42:0/3106431167 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664b94740 0x55c664b94b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:12:16.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.755+0000 7f84d3e00640 1 --2- 172.21.15.42:0/3106431167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b95060 0x55c664ba7cd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f84cc098020 tx=0x7f84cc004840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=477fe7e71ea58db6 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:16.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.755+0000 7f84d9200640 1 --2- 172.21.15.42:0/1103167236 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f84b80a2c00 0x7f84b80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:16.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.755+0000 7f84c9600640 1 -- 172.21.15.42:0/3106431167 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc01a030 con 0x55c664b95060 2024-08-26T00:12:16.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.755+0000 7f84c9600640 1 -- 172.21.15.42:0/3106431167 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84cc086070 con 0x55c664b95060 2024-08-26T00:12:16.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.755+0000 7f84c9600640 1 -- 172.21.15.42:0/3106431167 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc09fa00 con 0x55c664b95060 2024-08-26T00:12:16.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.756+0000 7f84dddda740 1 -- 172.21.15.42:0/3106431167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b95060 msgr2=0x55c664ba7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:16.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.756+0000 7f84d9200640 1 --2- 172.21.15.42:0/1103167236 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f84b80a2c00 0x7f84b80a50c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f84bc009e80 tx=0x7f84bc0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:16.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.756+0000 7f84dddda740 1 --2- 172.21.15.42:0/3106431167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b95060 0x55c664ba7cd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f84cc098020 tx=0x7f84cc004840 comp rx=0 tx=0).stop 2024-08-26T00:12:16.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.757+0000 7f84dddda740 1 -- 172.21.15.42:0/3106431167 shutdown_connections 2024-08-26T00:12:16.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.757+0000 7f84dddda740 1 --2- 172.21.15.42:0/3106431167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c664ba8210 0x55c664baa600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.757+0000 7f84dddda740 1 --2- 172.21.15.42:0/3106431167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b95060 0x55c664ba7cd0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.757+0000 7f84dddda740 1 --2- 172.21.15.42:0/3106431167 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664b94740 0x55c664b94b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.757+0000 7f84dddda740 1 -- 172.21.15.42:0/3106431167 >> 172.21.15.42:0/3106431167 conn(0x55c664b90db0 msgr2=0x55c664b91190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:16.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.757+0000 7f84dddda740 1 -- 172.21.15.42:0/3106431167 shutdown_connections 2024-08-26T00:12:16.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.757+0000 7f84dddda740 1 -- 172.21.15.42:0/3106431167 wait complete. 2024-08-26T00:12:16.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.757+0000 7f84dddda740 1 -- start start 2024-08-26T00:12:16.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.758+0000 7f84dddda740 1 Processor -- start 2024-08-26T00:12:16.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.758+0000 7f84dddda740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b94740 0x55c664ba51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:16.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.758+0000 7f84dddda740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664b95060 0x55c664ba56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:16.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.758+0000 7f84dddda740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c664ba8210 0x55c664ba5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:16.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.758+0000 7f84dddda740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c664baad20 con 0x55c664b95060 2024-08-26T00:12:16.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.758+0000 7f84dddda740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c664ab5de0 con 0x55c664ba8210 2024-08-26T00:12:16.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.758+0000 7f84dddda740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c664baaea0 con 0x55c664b94740 2024-08-26T00:12:16.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.758+0000 7f84dddda740 10 client.0 _ll_register_callbacks cb 0x55c664aa47b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:12:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.758+0000 7f84d3e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b94740 0x55c664ba51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.758+0000 7f84d3e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b94740 0x55c664ba51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:49920/0 (socket says 172.21.15.42:49920) 2024-08-26T00:12:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.758+0000 7f84d3e00640 1 -- 172.21.15.42:0/1699761222 learned_addr learned my addr 172.21.15.42:0/1699761222 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.758+0000 7f84d3400640 1 --2- 172.21.15.42:0/1699761222 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664b95060 0x55c664ba56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.759+0000 7f84d9200640 1 --2- 172.21.15.42:0/1699761222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c664ba8210 0x55c664ba5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.759+0000 7f84d3e00640 1 -- 172.21.15.42:0/1699761222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c664ba8210 msgr2=0x55c664ba5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.759+0000 7f84d3e00640 1 --2- 172.21.15.42:0/1699761222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c664ba8210 0x55c664ba5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.759+0000 7f84d3e00640 1 -- 172.21.15.42:0/1699761222 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664b95060 msgr2=0x55c664ba56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.759+0000 7f84d3e00640 1 --2- 172.21.15.42:0/1699761222 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664b95060 0x55c664ba56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.759+0000 7f84d3e00640 1 -- 172.21.15.42:0/1699761222 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c664bb4280 con 0x55c664b94740 2024-08-26T00:12:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.759+0000 7f84d3e00640 1 --2- 172.21.15.42:0/1699761222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b94740 0x55c664ba51b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f84cc0a3d90 tx=0x7f84cc0d22d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c28766f104d46cb1 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:16.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.759+0000 7f84c2000640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:12:16.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.759+0000 7f84c2000640 1 -- 172.21.15.42:0/1699761222 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc01a070 con 0x55c664b94740 2024-08-26T00:12:16.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.759+0000 7f84c2000640 1 -- 172.21.15.42:0/1699761222 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f84cc0041d0 con 0x55c664b94740 2024-08-26T00:12:16.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.759+0000 7f84dddda740 1 -- 172.21.15.42:0/1699761222 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84cc086070 con 0x55c664b94740 2024-08-26T00:12:16.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.760+0000 7f84c2000640 1 -- 172.21.15.42:0/1699761222 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f84cc0a42c0 con 0x55c664b94740 2024-08-26T00:12:16.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.760+0000 7f84dddda740 10 client.26056 fetch_fsmap learned FSMap version 31 2024-08-26T00:12:16.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.760+0000 7f84dddda740 1 -- 172.21.15.42:0/1699761222 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c664baad20 con 0x55c664b94740 2024-08-26T00:12:16.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.760+0000 7f84c2000640 1 -- 172.21.15.42:0/1699761222 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84cc086070 con 0x55c664b94740 2024-08-26T00:12:16.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.760+0000 7f84c2000640 1 -- 172.21.15.42:0/1699761222 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f84cc00b040 con 0x55c664b94740 2024-08-26T00:12:16.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.760+0000 7f84dddda740 10 client.26056 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:12:16.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.760+0000 7f84dddda740 10 client.26056 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-26T00:12:16.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.760+0000 7f84dddda740 20 client.26056 populate_metadata read hostname 'smithi042' 2024-08-26T00:12:16.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.760+0000 7f84dddda740 1 --2- 172.21.15.42:0/1699761222 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55c664bb7d70 0x55c664bba160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:16.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.760+0000 7f84dddda740 4 client.26056 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:12:16.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.760+0000 7f84dddda740 1 -- 172.21.15.42:0/1699761222 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c664b084a0 con 0x55c664bb7d70 2024-08-26T00:12:16.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.761+0000 7f84d3400640 1 --2- 172.21.15.42:0/1699761222 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55c664bb7d70 0x55c664bba160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:16.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.761+0000 7f84d3400640 1 --2- 172.21.15.42:0/1699761222 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55c664bb7d70 0x55c664bba160 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9c9ae647089f51b4 server_cookie=b4c3b060e3d565a6 in_seq=0 out_seq=0 2024-08-26T00:12:16.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.761+0000 7f84c2000640 10 client.26056 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:12:16.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.762+0000 7f84c2000640 1 -- 172.21.15.42:0/1699761222 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c664b084a0 con 0x55c664bb7d70 2024-08-26T00:12:16.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.762+0000 7f84c2000640 10 client.26056 handle_command_reply: tid=0 2024-08-26T00:12:16.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.762+0000 7f84dddda740 1 client.26056 shutdown 2024-08-26T00:12:16.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.762+0000 7f84dddda740 1 -- 172.21.15.42:0/1699761222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b94740 msgr2=0x55c664ba51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:16.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.762+0000 7f84dddda740 1 --2- 172.21.15.42:0/1699761222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b94740 0x55c664ba51b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f84cc0a3d90 tx=0x7f84cc0d22d0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.762+0000 7f84dddda740 1 -- 172.21.15.42:0/1699761222 shutdown_connections 2024-08-26T00:12:16.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.762+0000 7f84dddda740 1 --2- 172.21.15.42:0/1699761222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c664ba8210 0x55c664ba5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.762+0000 7f84dddda740 1 --2- 172.21.15.42:0/1699761222 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664b95060 0x55c664ba56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.762+0000 7f84dddda740 1 --2- 172.21.15.42:0/1699761222 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55c664bb7d70 0x55c664bba160 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.762+0000 7f84dddda740 1 --2- 172.21.15.42:0/1699761222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b94740 0x55c664ba51b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.762+0000 7f84dddda740 1 -- 172.21.15.42:0/1699761222 >> 172.21.15.42:0/1699761222 conn(0x55c664b90db0 msgr2=0x55c664b8ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:16.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.762+0000 7f84c2000640 0 client.26056 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:12:16.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.763+0000 7f84dddda740 1 -- 172.21.15.42:0/1699761222 shutdown_connections 2024-08-26T00:12:16.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.763+0000 7f84dddda740 1 -- 172.21.15.42:0/1699761222 wait complete. 2024-08-26T00:12:16.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.763+0000 7f84dddda740 20 client.26056 trim_cache size 0 max 16384 2024-08-26T00:12:16.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.778+0000 7f84dddda740 1 Processor -- start 2024-08-26T00:12:16.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.778+0000 7f84dddda740 1 -- start start 2024-08-26T00:12:16.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.779+0000 7f84dddda740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b94740 0x55c664ba7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:16.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.779+0000 7f84dddda740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664b95060 0x55c664bbf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:16.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.779+0000 7f84dddda740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c664ba8210 0x55c664bbfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:16.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.779+0000 7f84dddda740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f84d41adab0 con 0x55c664b95060 2024-08-26T00:12:16.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.779+0000 7f84dddda740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f84d41ab2c0 con 0x55c664ba8210 2024-08-26T00:12:16.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.779+0000 7f84dddda740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f84d41a90f0 con 0x55c664b94740 2024-08-26T00:12:16.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.779+0000 7f84d3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664b95060 0x55c664bbf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:16.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.779+0000 7f84d3e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b94740 0x55c664ba7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:16.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.779+0000 7f84d3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664b95060 0x55c664bbf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36230/0 (socket says 172.21.15.42:36230) 2024-08-26T00:12:16.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.779+0000 7f84d3e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b94740 0x55c664ba7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:49936/0 (socket says 172.21.15.42:49936) 2024-08-26T00:12:16.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.779+0000 7f84d3400640 1 -- 172.21.15.42:0/484169289 learned_addr learned my addr 172.21.15.42:0/484169289 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:16.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.779+0000 7f84d9200640 1 --2- 172.21.15.42:0/484169289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c664ba8210 0x55c664bbfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:16.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.779+0000 7f84d3400640 1 -- 172.21.15.42:0/484169289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b94740 msgr2=0x55c664ba7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:16.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.779+0000 7f84d3400640 1 --2- 172.21.15.42:0/484169289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b94740 0x55c664ba7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.779+0000 7f84d3400640 1 -- 172.21.15.42:0/484169289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c664ba8210 msgr2=0x55c664bbfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:16.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.779+0000 7f84d3400640 1 --2- 172.21.15.42:0/484169289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c664ba8210 0x55c664bbfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.779+0000 7f84d3400640 1 -- 172.21.15.42:0/484169289 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c664b95c50 con 0x55c664b95060 2024-08-26T00:12:16.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.779+0000 7f84d3e00640 1 --2- 172.21.15.42:0/484169289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b94740 0x55c664ba7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:12:16.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.779+0000 7f84d9200640 1 --2- 172.21.15.42:0/484169289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c664ba8210 0x55c664bbfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:12:16.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.780+0000 7f84d3400640 1 --2- 172.21.15.42:0/484169289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664b95060 0x55c664bbf7e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f84c4005e00 tx=0x7f84c40056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef28a07c6be1e0f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:16.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.780+0000 7f84c8c00640 1 -- 172.21.15.42:0/484169289 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c4037040 con 0x55c664b95060 2024-08-26T00:12:16.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.780+0000 7f84c8c00640 1 -- 172.21.15.42:0/484169289 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84c40035f0 con 0x55c664b95060 2024-08-26T00:12:16.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.780+0000 7f84c8c00640 1 -- 172.21.15.42:0/484169289 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c4043500 con 0x55c664b95060 2024-08-26T00:12:16.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.781+0000 7f84dddda740 1 -- 172.21.15.42:0/484169289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664b95060 msgr2=0x55c664bbf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:16.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.781+0000 7f84dddda740 1 --2- 172.21.15.42:0/484169289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664b95060 0x55c664bbf7e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f84c4005e00 tx=0x7f84c40056d0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.781+0000 7f84dddda740 1 -- 172.21.15.42:0/484169289 shutdown_connections 2024-08-26T00:12:16.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.781+0000 7f84dddda740 1 --2- 172.21.15.42:0/484169289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c664ba8210 0x55c664bbfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.781+0000 7f84dddda740 1 --2- 172.21.15.42:0/484169289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664b95060 0x55c664bbf7e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.781+0000 7f84dddda740 1 --2- 172.21.15.42:0/484169289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b94740 0x55c664ba7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.781+0000 7f84dddda740 1 -- 172.21.15.42:0/484169289 >> 172.21.15.42:0/484169289 conn(0x55c664b90db0 msgr2=0x55c664b96a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:16.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.781+0000 7f84dddda740 1 -- 172.21.15.42:0/484169289 shutdown_connections 2024-08-26T00:12:16.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.781+0000 7f84dddda740 1 -- 172.21.15.42:0/484169289 wait complete. 2024-08-26T00:12:16.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.782+0000 7f84dddda740 1 -- start start 2024-08-26T00:12:16.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.782+0000 7f84dddda740 1 Processor -- start 2024-08-26T00:12:16.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.782+0000 7f84dddda740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c664b94740 0x55c664babdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:16.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.782+0000 7f84dddda740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b95060 0x55c664bac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:16.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.782+0000 7f84dddda740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664ba8210 0x55c664bac830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:16.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.782+0000 7f84dddda740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f84d41a9780 con 0x55c664ba8210 2024-08-26T00:12:16.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.782+0000 7f84dddda740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f84d41aabf0 con 0x55c664b94740 2024-08-26T00:12:16.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.782+0000 7f84dddda740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f84d41a9e50 con 0x55c664b95060 2024-08-26T00:12:16.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.782+0000 7f84dddda740 10 client.0 _ll_register_callbacks cb 0x7f84bc0092a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:12:16.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.783+0000 7f84d9200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664ba8210 0x55c664bac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:16.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.783+0000 7f84d3400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b95060 0x55c664bac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:16.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.783+0000 7f84d3400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b95060 0x55c664bac2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:49942/0 (socket says 172.21.15.42:49942) 2024-08-26T00:12:16.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.783+0000 7f84d3400640 1 -- 172.21.15.42:0/119683420 learned_addr learned my addr 172.21.15.42:0/119683420 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:16.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.783+0000 7f84d9200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664ba8210 0x55c664bac830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36244/0 (socket says 172.21.15.42:36244) 2024-08-26T00:12:16.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.783+0000 7f84d3e00640 1 --2- 172.21.15.42:0/119683420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c664b94740 0x55c664babdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:16.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.783+0000 7f84d3400640 1 -- 172.21.15.42:0/119683420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c664b94740 msgr2=0x55c664babdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:16.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.783+0000 7f84d3400640 1 --2- 172.21.15.42:0/119683420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c664b94740 0x55c664babdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.783+0000 7f84d3400640 1 -- 172.21.15.42:0/119683420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664ba8210 msgr2=0x55c664bac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:16.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.783+0000 7f84d3400640 1 --2- 172.21.15.42:0/119683420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664ba8210 0x55c664bac830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.783+0000 7f84d3400640 1 -- 172.21.15.42:0/119683420 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c664c217b0 con 0x55c664b95060 2024-08-26T00:12:16.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.783+0000 7f84d3400640 1 --2- 172.21.15.42:0/119683420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b95060 0x55c664bac2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f84c402a930 tx=0x7f84c40043d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a99102c8386d5e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:16.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.783+0000 7f84c2000640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:12:16.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.784+0000 7f84c2000640 1 -- 172.21.15.42:0/119683420 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c4053070 con 0x55c664b95060 2024-08-26T00:12:16.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.784+0000 7f84c2000640 1 -- 172.21.15.42:0/119683420 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f84c4030750 con 0x55c664b95060 2024-08-26T00:12:16.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.784+0000 7f84dddda740 1 -- 172.21.15.42:0/119683420 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84c40035f0 con 0x55c664b95060 2024-08-26T00:12:16.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.784+0000 7f84c2000640 1 -- 172.21.15.42:0/119683420 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f84c405f050 con 0x55c664b95060 2024-08-26T00:12:16.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.784+0000 7f84dddda740 10 client.26062 fetch_fsmap learned FSMap version 31 2024-08-26T00:12:16.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.784+0000 7f84dddda740 1 -- 172.21.15.42:0/119683420 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c664c229b0 con 0x55c664b95060 2024-08-26T00:12:16.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.784+0000 7f84c2000640 1 -- 172.21.15.42:0/119683420 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84c40035f0 con 0x55c664b95060 2024-08-26T00:12:16.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.785+0000 7f84c2000640 1 -- 172.21.15.42:0/119683420 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f84c4032820 con 0x55c664b95060 2024-08-26T00:12:16.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.785+0000 7f84dddda740 10 client.26062 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:12:16.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.785+0000 7f84dddda740 10 client.26062 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-26T00:12:16.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.785+0000 7f84dddda740 20 client.26062 populate_metadata read hostname 'smithi042' 2024-08-26T00:12:16.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.785+0000 7f84dddda740 1 --2- 172.21.15.42:0/119683420 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55c664c230a0 0x55c664c254c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:16.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.785+0000 7f84dddda740 4 client.26062 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:12:16.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.785+0000 7f84dddda740 1 -- 172.21.15.42:0/119683420 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c664b029b0 con 0x55c664c230a0 2024-08-26T00:12:16.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.785+0000 7f84d3e00640 1 --2- 172.21.15.42:0/119683420 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55c664c230a0 0x55c664c254c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:16.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.785+0000 7f84d3e00640 1 --2- 172.21.15.42:0/119683420 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55c664c230a0 0x55c664c254c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=28fdaa70278b41b8 server_cookie=b52d89c3acabe5b1 in_seq=0 out_seq=0 2024-08-26T00:12:16.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.785+0000 7f84c2000640 10 client.26062 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:12:16.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.786+0000 7f84c2000640 1 -- 172.21.15.42:0/119683420 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c664b029b0 con 0x55c664c230a0 2024-08-26T00:12:16.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.786+0000 7f84c2000640 10 client.26062 handle_command_reply: tid=0 2024-08-26T00:12:16.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.786+0000 7f84dddda740 1 client.26062 shutdown 2024-08-26T00:12:16.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.786+0000 7f84dddda740 1 -- 172.21.15.42:0/119683420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b95060 msgr2=0x55c664bac2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:16.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.786+0000 7f84dddda740 1 --2- 172.21.15.42:0/119683420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b95060 0x55c664bac2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f84c402a930 tx=0x7f84c40043d0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.786+0000 7f84dddda740 1 -- 172.21.15.42:0/119683420 shutdown_connections 2024-08-26T00:12:16.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.786+0000 7f84dddda740 1 --2- 172.21.15.42:0/119683420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c664ba8210 0x55c664bac830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.786+0000 7f84dddda740 1 --2- 172.21.15.42:0/119683420 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x55c664c230a0 0x55c664c254c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.786+0000 7f84dddda740 1 --2- 172.21.15.42:0/119683420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c664b95060 0x55c664bac2f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.786+0000 7f84dddda740 1 --2- 172.21.15.42:0/119683420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c664b94740 0x55c664babdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.786+0000 7f84c2000640 0 client.26062 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:12:16.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.786+0000 7f84dddda740 1 -- 172.21.15.42:0/119683420 >> 172.21.15.42:0/119683420 conn(0x55c664b90db0 msgr2=0x55c664ba5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:16.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.786+0000 7f84dddda740 1 -- 172.21.15.42:0/119683420 shutdown_connections 2024-08-26T00:12:16.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.786+0000 7f84dddda740 1 -- 172.21.15.42:0/119683420 wait complete. 2024-08-26T00:12:16.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.786+0000 7f84dddda740 20 client.26062 trim_cache size 0 max 16384 2024-08-26T00:12:16.797 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:12:16.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.787+0000 7f84db200640 1 -- 172.21.15.42:0/1103167236 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f84b80a2c00 msgr2=0x7f84b80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:16.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.787+0000 7f84db200640 1 --2- 172.21.15.42:0/1103167236 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f84b80a2c00 0x7f84b80a50c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f84bc009e80 tx=0x7f84bc0046c0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.787+0000 7f84db200640 1 -- 172.21.15.42:0/1103167236 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84d4103db0 msgr2=0x7f84d419a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:16.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.787+0000 7f84db200640 1 --2- 172.21.15.42:0/1103167236 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84d4103db0 0x7f84d419a400 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f84cc00ef80 tx=0x7f84cc00c800 comp rx=0 tx=0).stop 2024-08-26T00:12:16.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.787+0000 7f84db200640 1 -- 172.21.15.42:0/1103167236 shutdown_connections 2024-08-26T00:12:16.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.787+0000 7f84db200640 1 --2- 172.21.15.42:0/1103167236 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f84b80a2c00 0x7f84b80a50c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.788+0000 7f84db200640 1 --2- 172.21.15.42:0/1103167236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84d4108ee0 0x7f84d419ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.788+0000 7f84db200640 1 --2- 172.21.15.42:0/1103167236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84d4104760 0x7f84d419a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.788+0000 7f84db200640 1 --2- 172.21.15.42:0/1103167236 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84d4103db0 0x7f84d419a400 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:16.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.788+0000 7f84db200640 1 -- 172.21.15.42:0/1103167236 >> 172.21.15.42:0/1103167236 conn(0x7f84d40ff7f0 msgr2=0x7f84d4100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:16.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.788+0000 7f84db200640 1 -- 172.21.15.42:0/1103167236 shutdown_connections 2024-08-26T00:12:16.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:16.788+0000 7f84db200640 1 -- 172.21.15.42:0/1103167236 wait complete. 2024-08-26T00:12:17.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:16 smithi043 ceph-mon[22091]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 356 op/s 2024-08-26T00:12:17.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:16 smithi181 ceph-mon[22102]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 356 op/s 2024-08-26T00:12:17.587 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-26T00:12:17.978 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:12:18.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.563+0000 7f9f52200640 1 -- 172.21.15.42:0/3765583470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f4c103b50 msgr2=0x7f9f4c103fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:18.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.563+0000 7f9f52200640 1 --2- 172.21.15.42:0/3765583470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f4c103b50 0x7f9f4c103fb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009900 tx=0x7f9f3402a3f0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.563+0000 7f9f52200640 1 -- 172.21.15.42:0/3765583470 shutdown_connections 2024-08-26T00:12:18.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.563+0000 7f9f52200640 1 --2- 172.21.15.42:0/3765583470 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f4c1044f0 0x7f9f4c1109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.563+0000 7f9f52200640 1 --2- 172.21.15.42:0/3765583470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f4c103b50 0x7f9f4c103fb0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.563+0000 7f9f52200640 1 --2- 172.21.15.42:0/3765583470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f4c109c00 0x7f9f4c109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.563+0000 7f9f52200640 1 -- 172.21.15.42:0/3765583470 >> 172.21.15.42:0/3765583470 conn(0x7f9f4c0ff830 msgr2=0x7f9f4c101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:18.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.563+0000 7f9f52200640 1 -- 172.21.15.42:0/3765583470 shutdown_connections 2024-08-26T00:12:18.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.563+0000 7f9f52200640 1 -- 172.21.15.42:0/3765583470 wait complete. 2024-08-26T00:12:18.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.564+0000 7f9f52200640 1 Processor -- start 2024-08-26T00:12:18.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.565+0000 7f9f52200640 1 -- start start 2024-08-26T00:12:18.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.565+0000 7f9f52200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f4c103b50 0x7f9f4c19a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:18.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.565+0000 7f9f52200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f4c1044f0 0x7f9f4c19a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:18.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.565+0000 7f9f52200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f4c109c00 0x7f9f4c19ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:18.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.565+0000 7f9f52200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c113f70 con 0x7f9f4c109c00 2024-08-26T00:12:18.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.565+0000 7f9f52200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c113df0 con 0x7f9f4c103b50 2024-08-26T00:12:18.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.565+0000 7f9f52200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c1140f0 con 0x7f9f4c1044f0 2024-08-26T00:12:18.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.565+0000 7f9f43e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f4c1044f0 0x7f9f4c19a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:18.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.565+0000 7f9f4be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f4c109c00 0x7f9f4c19ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:18.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.565+0000 7f9f43e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f4c1044f0 0x7f9f4c19a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:49966/0 (socket says 172.21.15.42:49966) 2024-08-26T00:12:18.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.565+0000 7f9f43e00640 1 -- 172.21.15.42:0/3415423703 learned_addr learned my addr 172.21.15.42:0/3415423703 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:18.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.565+0000 7f9f4b400640 1 --2- 172.21.15.42:0/3415423703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f4c103b50 0x7f9f4c19a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:18.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.566+0000 7f9f43e00640 1 -- 172.21.15.42:0/3415423703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f4c103b50 msgr2=0x7f9f4c19a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:18.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.566+0000 7f9f43e00640 1 --2- 172.21.15.42:0/3415423703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f4c103b50 0x7f9f4c19a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.566+0000 7f9f43e00640 1 -- 172.21.15.42:0/3415423703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f4c109c00 msgr2=0x7f9f4c19ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:18.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.566+0000 7f9f43e00640 1 --2- 172.21.15.42:0/3415423703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f4c109c00 0x7f9f4c19ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.566+0000 7f9f43e00640 1 -- 172.21.15.42:0/3415423703 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4c19f2f0 con 0x7f9f4c1044f0 2024-08-26T00:12:18.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.566+0000 7f9f4b400640 1 --2- 172.21.15.42:0/3415423703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f4c103b50 0x7f9f4c19a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:12:18.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.566+0000 7f9f43e00640 1 --2- 172.21.15.42:0/3415423703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f4c1044f0 0x7f9f4c19a880 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9f3402a9e0 tx=0x7f9f34003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:18.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.566+0000 7f9f48c00640 1 -- 172.21.15.42:0/3415423703 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3403f070 con 0x7f9f4c1044f0 2024-08-26T00:12:18.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.566+0000 7f9f48c00640 1 -- 172.21.15.42:0/3415423703 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f34031c30 con 0x7f9f4c1044f0 2024-08-26T00:12:18.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.566+0000 7f9f48c00640 1 -- 172.21.15.42:0/3415423703 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34035030 con 0x7f9f4c1044f0 2024-08-26T00:12:18.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.566+0000 7f9f52200640 1 -- 172.21.15.42:0/3415423703 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f4c19f580 con 0x7f9f4c1044f0 2024-08-26T00:12:18.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.567+0000 7f9f52200640 1 -- 172.21.15.42:0/3415423703 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f4c19fa10 con 0x7f9f4c1044f0 2024-08-26T00:12:18.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.571+0000 7f9f54c7e740 1 Processor -- start 2024-08-26T00:12:18.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.571+0000 7f9f48c00640 1 -- 172.21.15.42:0/3415423703 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9f34042070 con 0x7f9f4c1044f0 2024-08-26T00:12:18.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.571+0000 7f9f54c7e740 1 -- start start 2024-08-26T00:12:18.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.571+0000 7f9f54c7e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf195dc820 0x55cf195dcc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:18.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.571+0000 7f9f54c7e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dd140 0x55cf195e74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:18.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.571+0000 7f9f54c7e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195e7a00 0x55cf195e9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:18.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.571+0000 7f9f54c7e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cf19542f30 con 0x55cf195dc820 2024-08-26T00:12:18.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.571+0000 7f9f54c7e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55cf194da5a0 con 0x55cf195dd140 2024-08-26T00:12:18.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.571+0000 7f9f54c7e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55cf1953eef0 con 0x55cf195e7a00 2024-08-26T00:12:18.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.572+0000 7f9f4be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf195dc820 0x55cf195dcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:18.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.572+0000 7f9f4be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf195dc820 0x55cf195dcc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36274/0 (socket says 172.21.15.42:36274) 2024-08-26T00:12:18.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.572+0000 7f9f4be00640 1 -- 172.21.15.42:0/1299018866 learned_addr learned my addr 172.21.15.42:0/1299018866 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:18.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.572+0000 7f9f4b400640 1 --2- 172.21.15.42:0/1299018866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dd140 0x55cf195e74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:18.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.572+0000 7f9f43e00640 1 --2- 172.21.15.42:0/1299018866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195e7a00 0x55cf195e9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:18.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.572+0000 7f9f4be00640 1 -- 172.21.15.42:0/1299018866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195e7a00 msgr2=0x55cf195e9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:18.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.572+0000 7f9f4be00640 1 --2- 172.21.15.42:0/1299018866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195e7a00 0x55cf195e9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.572+0000 7f9f4be00640 1 -- 172.21.15.42:0/1299018866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dd140 msgr2=0x55cf195e74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:18.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.572+0000 7f9f4be00640 1 --2- 172.21.15.42:0/1299018866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dd140 0x55cf195e74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.572+0000 7f9f4be00640 1 -- 172.21.15.42:0/1299018866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf192b43c0 con 0x55cf195dc820 2024-08-26T00:12:18.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.573+0000 7f9f4be00640 1 --2- 172.21.15.42:0/1299018866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf195dc820 0x55cf195dcc00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9f44009fd0 tx=0x7f9f440118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba383d8d1bc3ff9c server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:18.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.573+0000 7f9f3be00640 1 -- 172.21.15.42:0/1299018866 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f44004d20 con 0x55cf195dc820 2024-08-26T00:12:18.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.573+0000 7f9f3be00640 1 -- 172.21.15.42:0/1299018866 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f44004050 con 0x55cf195dc820 2024-08-26T00:12:18.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.573+0000 7f9f3be00640 1 -- 172.21.15.42:0/1299018866 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f44005220 con 0x55cf195dc820 2024-08-26T00:12:18.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.573+0000 7f9f48c00640 1 --2- 172.21.15.42:0/3415423703 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9f300a2c00 0x7f9f300a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:18.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.573+0000 7f9f48c00640 1 -- 172.21.15.42:0/3415423703 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f9f340ef550 con 0x7f9f4c1044f0 2024-08-26T00:12:18.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.573+0000 7f9f4b400640 1 --2- 172.21.15.42:0/3415423703 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9f300a2c00 0x7f9f300a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:18.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.573+0000 7f9f54c7e740 1 -- 172.21.15.42:0/1299018866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf195dc820 msgr2=0x55cf195dcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:18.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.573+0000 7f9f54c7e740 1 --2- 172.21.15.42:0/1299018866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf195dc820 0x55cf195dcc00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9f44009fd0 tx=0x7f9f440118d0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.574+0000 7f9f54c7e740 1 -- 172.21.15.42:0/1299018866 shutdown_connections 2024-08-26T00:12:18.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.574+0000 7f9f54c7e740 1 --2- 172.21.15.42:0/1299018866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195e7a00 0x55cf195e9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.574+0000 7f9f54c7e740 1 --2- 172.21.15.42:0/1299018866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dd140 0x55cf195e74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.574+0000 7f9f54c7e740 1 --2- 172.21.15.42:0/1299018866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf195dc820 0x55cf195dcc00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.574+0000 7f9f54c7e740 1 -- 172.21.15.42:0/1299018866 >> 172.21.15.42:0/1299018866 conn(0x55cf195d8db0 msgr2=0x55cf195d9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:18.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.574+0000 7f9f54c7e740 1 -- 172.21.15.42:0/1299018866 shutdown_connections 2024-08-26T00:12:18.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.574+0000 7f9f54c7e740 1 -- 172.21.15.42:0/1299018866 wait complete. 2024-08-26T00:12:18.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.574+0000 7f9f4b400640 1 --2- 172.21.15.42:0/3415423703 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9f300a2c00 0x7f9f300a50c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x55cf195d9c10 tx=0x7f9f3c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:18.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.574+0000 7f9f54c7e740 1 -- start start 2024-08-26T00:12:18.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.575+0000 7f9f54c7e740 1 Processor -- start 2024-08-26T00:12:18.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.575+0000 7f9f54c7e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dc820 0x55cf195e4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:18.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.575+0000 7f9f54c7e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195dd140 0x55cf195e4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:18.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.575+0000 7f9f54c7e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf195e7a00 0x55cf195e52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:18.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.575+0000 7f9f54c7e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cf195ea5d0 con 0x55cf195e7a00 2024-08-26T00:12:18.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.575+0000 7f9f54c7e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55cf194fdde0 con 0x55cf195dc820 2024-08-26T00:12:18.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.575+0000 7f9f54c7e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55cf195ea750 con 0x55cf195dd140 2024-08-26T00:12:18.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.575+0000 7f9f54c7e740 10 client.0 _ll_register_callbacks cb 0x55cf194ec7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:12:18.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.575+0000 7f9f4b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dc820 0x55cf195e4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:18.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.575+0000 7f9f4be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf195e7a00 0x55cf195e52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:18.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.575+0000 7f9f4b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dc820 0x55cf195e4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:42704/0 (socket says 172.21.15.42:42704) 2024-08-26T00:12:18.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.575+0000 7f9f4b400640 1 -- 172.21.15.42:0/531984885 learned_addr learned my addr 172.21.15.42:0/531984885 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:18.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.575+0000 7f9f43e00640 1 --2- 172.21.15.42:0/531984885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195dd140 0x55cf195e4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:18.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.576+0000 7f9f4b400640 1 -- 172.21.15.42:0/531984885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195dd140 msgr2=0x55cf195e4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:18.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.576+0000 7f9f4b400640 1 --2- 172.21.15.42:0/531984885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195dd140 0x55cf195e4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.576+0000 7f9f4b400640 1 -- 172.21.15.42:0/531984885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf195e7a00 msgr2=0x55cf195e52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:18.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.576+0000 7f9f4b400640 1 --2- 172.21.15.42:0/531984885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf195e7a00 0x55cf195e52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.576+0000 7f9f4b400640 1 -- 172.21.15.42:0/531984885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf195f3a70 con 0x55cf195dc820 2024-08-26T00:12:18.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.576+0000 7f9f43e00640 1 --2- 172.21.15.42:0/531984885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195dd140 0x55cf195e4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:12:18.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.576+0000 7f9f4b400640 1 --2- 172.21.15.42:0/531984885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dc820 0x55cf195e4820 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009560 tx=0x7f9f3c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=917d108c8da10ee4 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:18.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.576+0000 7f9f38c00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:12:18.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.576+0000 7f9f38c00640 1 -- 172.21.15.42:0/531984885 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c02e060 con 0x55cf195dc820 2024-08-26T00:12:18.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.576+0000 7f9f54c7e740 1 -- 172.21.15.42:0/531984885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f44004050 con 0x55cf195dc820 2024-08-26T00:12:18.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.577+0000 7f9f38c00640 1 -- 172.21.15.42:0/531984885 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f9f3c018030 con 0x55cf195dc820 2024-08-26T00:12:18.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.577+0000 7f9f38c00640 1 -- 172.21.15.42:0/531984885 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9f3c004020 con 0x55cf195dc820 2024-08-26T00:12:18.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.577+0000 7f9f54c7e740 10 client.26111 fetch_fsmap learned FSMap version 31 2024-08-26T00:12:18.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.577+0000 7f9f54c7e740 1 -- 172.21.15.42:0/531984885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cf195f63d0 con 0x55cf195dc820 2024-08-26T00:12:18.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.577+0000 7f9f38c00640 1 -- 172.21.15.42:0/531984885 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f44004050 con 0x55cf195dc820 2024-08-26T00:12:18.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.577+0000 7f9f38c00640 1 -- 172.21.15.42:0/531984885 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f9f3c01e700 con 0x55cf195dc820 2024-08-26T00:12:18.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.577+0000 7f9f54c7e740 10 client.26111 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:12:18.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.577+0000 7f9f54c7e740 10 client.26111 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-26T00:12:18.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.577+0000 7f9f54c7e740 20 client.26111 populate_metadata read hostname 'smithi042' 2024-08-26T00:12:18.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.577+0000 7f9f54c7e740 1 --2- 172.21.15.42:0/531984885 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55cf195f77e0 0x55cf195f9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:18.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.577+0000 7f9f54c7e740 4 client.26111 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:12:18.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.577+0000 7f9f54c7e740 1 -- 172.21.15.42:0/531984885 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf195504a0 con 0x55cf195f77e0 2024-08-26T00:12:18.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.578+0000 7f9f43e00640 1 --2- 172.21.15.42:0/531984885 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55cf195f77e0 0x55cf195f9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:18.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.578+0000 7f9f43e00640 1 --2- 172.21.15.42:0/531984885 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55cf195f77e0 0x55cf195f9c50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8bd31f6df41ebac4 server_cookie=11e59f35acd8b9f9 in_seq=0 out_seq=0 2024-08-26T00:12:18.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.578+0000 7f9f38c00640 10 client.26111 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:12:18.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.579+0000 7f9f38c00640 1 -- 172.21.15.42:0/531984885 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cf195504a0 con 0x55cf195f77e0 2024-08-26T00:12:18.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.579+0000 7f9f38c00640 10 client.26111 handle_command_reply: tid=0 2024-08-26T00:12:18.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.579+0000 7f9f54c7e740 1 client.26111 shutdown 2024-08-26T00:12:18.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.579+0000 7f9f54c7e740 1 -- 172.21.15.42:0/531984885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dc820 msgr2=0x55cf195e4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:18.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.579+0000 7f9f54c7e740 1 --2- 172.21.15.42:0/531984885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dc820 0x55cf195e4820 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009560 tx=0x7f9f3c004730 comp rx=0 tx=0).stop 2024-08-26T00:12:18.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.579+0000 7f9f54c7e740 1 -- 172.21.15.42:0/531984885 shutdown_connections 2024-08-26T00:12:18.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.579+0000 7f9f54c7e740 1 --2- 172.21.15.42:0/531984885 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55cf195f77e0 0x55cf195f9c50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.579+0000 7f9f54c7e740 1 --2- 172.21.15.42:0/531984885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf195e7a00 0x55cf195e52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.579+0000 7f9f54c7e740 1 --2- 172.21.15.42:0/531984885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195dd140 0x55cf195e4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.579+0000 7f9f54c7e740 1 --2- 172.21.15.42:0/531984885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dc820 0x55cf195e4820 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.579+0000 7f9f38c00640 0 client.26111 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:12:18.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.579+0000 7f9f54c7e740 1 -- 172.21.15.42:0/531984885 >> 172.21.15.42:0/531984885 conn(0x55cf195d8db0 msgr2=0x55cf195d7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:18.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.579+0000 7f9f54c7e740 1 -- 172.21.15.42:0/531984885 shutdown_connections 2024-08-26T00:12:18.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.579+0000 7f9f54c7e740 1 -- 172.21.15.42:0/531984885 wait complete. 2024-08-26T00:12:18.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.580+0000 7f9f54c7e740 20 client.26111 trim_cache size 0 max 16384 2024-08-26T00:12:18.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.593+0000 7f9f54c7e740 1 Processor -- start 2024-08-26T00:12:18.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.594+0000 7f9f54c7e740 1 -- start start 2024-08-26T00:12:18.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.594+0000 7f9f54c7e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dc820 0x55cf195e3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:18.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.594+0000 7f9f54c7e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195dd140 0x55cf195ff520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:18.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.594+0000 7f9f54c7e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf195e7a00 0x55cf195ffa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:18.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.594+0000 7f9f54c7e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c1b1e90 con 0x55cf195e7a00 2024-08-26T00:12:18.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.594+0000 7f9f54c7e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c1af6a0 con 0x55cf195dc820 2024-08-26T00:12:18.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.594+0000 7f9f54c7e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c1ad4d0 con 0x55cf195dd140 2024-08-26T00:12:18.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.594+0000 7f9f4be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf195e7a00 0x55cf195ffa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:18.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.594+0000 7f9f4b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dc820 0x55cf195e3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:18.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.594+0000 7f9f43e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195dd140 0x55cf195ff520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:18.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.594+0000 7f9f4b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dc820 0x55cf195e3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:42714/0 (socket says 172.21.15.42:42714) 2024-08-26T00:12:18.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.594+0000 7f9f4b400640 1 -- 172.21.15.42:0/1310917466 learned_addr learned my addr 172.21.15.42:0/1310917466 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:18.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.595+0000 7f9f4b400640 1 -- 172.21.15.42:0/1310917466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195dd140 msgr2=0x55cf195ff520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:18.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.595+0000 7f9f4b400640 1 --2- 172.21.15.42:0/1310917466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195dd140 0x55cf195ff520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.595+0000 7f9f4b400640 1 -- 172.21.15.42:0/1310917466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf195e7a00 msgr2=0x55cf195ffa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:18.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.595+0000 7f9f4b400640 1 --2- 172.21.15.42:0/1310917466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf195e7a00 0x55cf195ffa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.595+0000 7f9f4b400640 1 -- 172.21.15.42:0/1310917466 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf195dcf70 con 0x55cf195dc820 2024-08-26T00:12:18.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.595+0000 7f9f43e00640 1 --2- 172.21.15.42:0/1310917466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195dd140 0x55cf195ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:12:18.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.595+0000 7f9f4b400640 1 --2- 172.21.15.42:0/1310917466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dc820 0x55cf195e3800 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c012f40 tx=0x7f9f3c0092a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=933fdb17bd94ff86 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:18.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.595+0000 7f9f3b400640 1 -- 172.21.15.42:0/1310917466 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c038070 con 0x55cf195dc820 2024-08-26T00:12:18.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.595+0000 7f9f3b400640 1 -- 172.21.15.42:0/1310917466 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f3c01ed60 con 0x55cf195dc820 2024-08-26T00:12:18.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.595+0000 7f9f3b400640 1 -- 172.21.15.42:0/1310917466 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c0047a0 con 0x55cf195dc820 2024-08-26T00:12:18.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.596+0000 7f9f54c7e740 1 -- 172.21.15.42:0/1310917466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dc820 msgr2=0x55cf195e3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:18.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.596+0000 7f9f54c7e740 1 --2- 172.21.15.42:0/1310917466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dc820 0x55cf195e3800 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c012f40 tx=0x7f9f3c0092a0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.596+0000 7f9f54c7e740 1 -- 172.21.15.42:0/1310917466 shutdown_connections 2024-08-26T00:12:18.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.596+0000 7f9f54c7e740 1 --2- 172.21.15.42:0/1310917466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf195e7a00 0x55cf195ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.596+0000 7f9f54c7e740 1 --2- 172.21.15.42:0/1310917466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195dd140 0x55cf195ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.596+0000 7f9f54c7e740 1 --2- 172.21.15.42:0/1310917466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dc820 0x55cf195e3800 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.596+0000 7f9f54c7e740 1 -- 172.21.15.42:0/1310917466 >> 172.21.15.42:0/1310917466 conn(0x55cf195d8db0 msgr2=0x55cf195e30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:18.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.596+0000 7f9f54c7e740 1 -- 172.21.15.42:0/1310917466 shutdown_connections 2024-08-26T00:12:18.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.596+0000 7f9f54c7e740 1 -- 172.21.15.42:0/1310917466 wait complete. 2024-08-26T00:12:18.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.597+0000 7f9f54c7e740 1 -- start start 2024-08-26T00:12:18.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.597+0000 7f9f54c7e740 1 Processor -- start 2024-08-26T00:12:18.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.597+0000 7f9f54c7e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dc820 0x55cf195efcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:18.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.597+0000 7f9f54c7e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195dd140 0x55cf195f01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:18.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.597+0000 7f9f54c7e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf195e7a00 0x55cf195e1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:18.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.597+0000 7f9f54c7e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c1adb60 con 0x55cf195e7a00 2024-08-26T00:12:18.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.597+0000 7f9f54c7e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c1aefd0 con 0x55cf195dc820 2024-08-26T00:12:18.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.597+0000 7f9f54c7e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c1ae230 con 0x55cf195dd140 2024-08-26T00:12:18.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.597+0000 7f9f54c7e740 10 client.0 _ll_register_callbacks cb 0x7f9f3c009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:12:18.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.598+0000 7f9f43e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195dd140 0x55cf195f01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:18.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.598+0000 7f9f43e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195dd140 0x55cf195f01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:50010/0 (socket says 172.21.15.42:50010) 2024-08-26T00:12:18.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.598+0000 7f9f43e00640 1 -- 172.21.15.42:0/3239498198 learned_addr learned my addr 172.21.15.42:0/3239498198 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:18.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.598+0000 7f9f4b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dc820 0x55cf195efcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:18.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.598+0000 7f9f4be00640 1 --2- 172.21.15.42:0/3239498198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf195e7a00 0x55cf195e1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:18.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.598+0000 7f9f43e00640 1 -- 172.21.15.42:0/3239498198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dc820 msgr2=0x55cf195efcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:18.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.598+0000 7f9f43e00640 1 --2- 172.21.15.42:0/3239498198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dc820 0x55cf195efcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.598+0000 7f9f43e00640 1 -- 172.21.15.42:0/3239498198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf195e7a00 msgr2=0x55cf195e1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:18.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.598+0000 7f9f43e00640 1 --2- 172.21.15.42:0/3239498198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf195e7a00 0x55cf195e1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.598+0000 7f9f43e00640 1 -- 172.21.15.42:0/3239498198 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf195e1a90 con 0x55cf195dd140 2024-08-26T00:12:18.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.598+0000 7f9f4b400640 1 --2- 172.21.15.42:0/3239498198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dc820 0x55cf195efcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:12:18.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.598+0000 7f9f43e00640 1 --2- 172.21.15.42:0/3239498198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195dd140 0x55cf195f01f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9f340b82c0 tx=0x7f9f340f5060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33bf10c23acf181a server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:18.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.598+0000 7f9f38c00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:12:18.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.598+0000 7f9f38c00640 1 -- 172.21.15.42:0/3239498198 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34049040 con 0x55cf195dd140 2024-08-26T00:12:18.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.599+0000 7f9f54c7e740 1 -- 172.21.15.42:0/3239498198 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f3c01ed60 con 0x55cf195dd140 2024-08-26T00:12:18.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.599+0000 7f9f38c00640 1 -- 172.21.15.42:0/3239498198 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f9f340b84d0 con 0x55cf195dd140 2024-08-26T00:12:18.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.599+0000 7f9f38c00640 1 -- 172.21.15.42:0/3239498198 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9f340bbc30 con 0x55cf195dd140 2024-08-26T00:12:18.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.599+0000 7f9f54c7e740 10 client.26080 fetch_fsmap learned FSMap version 31 2024-08-26T00:12:18.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.599+0000 7f9f54c7e740 1 -- 172.21.15.42:0/3239498198 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cf19662110 con 0x55cf195dd140 2024-08-26T00:12:18.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.599+0000 7f9f38c00640 1 -- 172.21.15.42:0/3239498198 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f3c01ed60 con 0x55cf195dd140 2024-08-26T00:12:18.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.599+0000 7f9f38c00640 1 -- 172.21.15.42:0/3239498198 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f9f340c4590 con 0x55cf195dd140 2024-08-26T00:12:18.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.599+0000 7f9f54c7e740 10 client.26080 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:12:18.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.599+0000 7f9f54c7e740 10 client.26080 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-26T00:12:18.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.599+0000 7f9f54c7e740 20 client.26080 populate_metadata read hostname 'smithi042' 2024-08-26T00:12:18.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.599+0000 7f9f54c7e740 1 --2- 172.21.15.42:0/3239498198 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55cf19662830 0x55cf19664c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:18.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.599+0000 7f9f54c7e740 4 client.26080 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:12:18.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.599+0000 7f9f54c7e740 1 -- 172.21.15.42:0/3239498198 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cf1954a9b0 con 0x55cf19662830 2024-08-26T00:12:18.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.600+0000 7f9f4b400640 1 --2- 172.21.15.42:0/3239498198 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55cf19662830 0x55cf19664c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:18.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.600+0000 7f9f4b400640 1 --2- 172.21.15.42:0/3239498198 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55cf19662830 0x55cf19664c50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b89f3fb75ba61c1c server_cookie=4fbc22a0521b7c48 in_seq=0 out_seq=0 2024-08-26T00:12:18.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.600+0000 7f9f38c00640 10 client.26080 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:12:18.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.600+0000 7f9f38c00640 1 -- 172.21.15.42:0/3239498198 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cf1954a9b0 con 0x55cf19662830 2024-08-26T00:12:18.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.600+0000 7f9f38c00640 10 client.26080 handle_command_reply: tid=0 2024-08-26T00:12:18.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.601+0000 7f9f54c7e740 1 client.26080 shutdown 2024-08-26T00:12:18.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.601+0000 7f9f54c7e740 1 -- 172.21.15.42:0/3239498198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195dd140 msgr2=0x55cf195f01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:18.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.601+0000 7f9f54c7e740 1 --2- 172.21.15.42:0/3239498198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195dd140 0x55cf195f01f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9f340b82c0 tx=0x7f9f340f5060 comp rx=0 tx=0).stop 2024-08-26T00:12:18.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.601+0000 7f9f54c7e740 1 -- 172.21.15.42:0/3239498198 shutdown_connections 2024-08-26T00:12:18.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.601+0000 7f9f54c7e740 1 --2- 172.21.15.42:0/3239498198 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x55cf19662830 0x55cf19664c50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.601+0000 7f9f54c7e740 1 --2- 172.21.15.42:0/3239498198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf195e7a00 0x55cf195e1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.601+0000 7f9f54c7e740 1 --2- 172.21.15.42:0/3239498198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cf195dd140 0x55cf195f01f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.601+0000 7f9f54c7e740 1 --2- 172.21.15.42:0/3239498198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf195dc820 0x55cf195efcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.601+0000 7f9f38c00640 0 client.26080 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:12:18.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.601+0000 7f9f54c7e740 1 -- 172.21.15.42:0/3239498198 >> 172.21.15.42:0/3239498198 conn(0x55cf195d8db0 msgr2=0x55cf195de270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:18.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.601+0000 7f9f54c7e740 1 -- 172.21.15.42:0/3239498198 shutdown_connections 2024-08-26T00:12:18.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.601+0000 7f9f54c7e740 1 -- 172.21.15.42:0/3239498198 wait complete. 2024-08-26T00:12:18.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.601+0000 7f9f54c7e740 20 client.26080 trim_cache size 0 max 16384 2024-08-26T00:12:18.607 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:12:18.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.602+0000 7f9f52200640 1 -- 172.21.15.42:0/3415423703 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9f300a2c00 msgr2=0x7f9f300a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:18.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.602+0000 7f9f52200640 1 --2- 172.21.15.42:0/3415423703 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9f300a2c00 0x7f9f300a50c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x55cf195d9c10 tx=0x7f9f3c005f90 comp rx=0 tx=0).stop 2024-08-26T00:12:18.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.602+0000 7f9f52200640 1 -- 172.21.15.42:0/3415423703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f4c1044f0 msgr2=0x7f9f4c19a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:18.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.602+0000 7f9f52200640 1 --2- 172.21.15.42:0/3415423703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f4c1044f0 0x7f9f4c19a880 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9f3402a9e0 tx=0x7f9f34003c10 comp rx=0 tx=0).stop 2024-08-26T00:12:18.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.602+0000 7f9f52200640 1 -- 172.21.15.42:0/3415423703 shutdown_connections 2024-08-26T00:12:18.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.602+0000 7f9f52200640 1 --2- 172.21.15.42:0/3415423703 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9f300a2c00 0x7f9f300a50c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.602+0000 7f9f52200640 1 --2- 172.21.15.42:0/3415423703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f4c109c00 0x7f9f4c19ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.602+0000 7f9f52200640 1 --2- 172.21.15.42:0/3415423703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f4c1044f0 0x7f9f4c19a880 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.602+0000 7f9f52200640 1 --2- 172.21.15.42:0/3415423703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f4c103b50 0x7f9f4c19a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:18.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.602+0000 7f9f52200640 1 -- 172.21.15.42:0/3415423703 >> 172.21.15.42:0/3415423703 conn(0x7f9f4c0ff830 msgr2=0x7f9f4c100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:18.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.602+0000 7f9f52200640 1 -- 172.21.15.42:0/3415423703 shutdown_connections 2024-08-26T00:12:18.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:18.602+0000 7f9f52200640 1 -- 172.21.15.42:0/3415423703 wait complete. 2024-08-26T00:12:18.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:18 smithi042 ceph-mon[17225]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 375 op/s 2024-08-26T00:12:18.812 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:18 smithi043 ceph-mon[22091]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 375 op/s 2024-08-26T00:12:19.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:18 smithi181 ceph-mon[22102]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 375 op/s 2024-08-26T00:12:19.471 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-26T00:12:19.906 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:12:20.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.489+0000 7f186ba00640 1 -- 172.21.15.42:0/1994975382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18641044f0 msgr2=0x7f18641109d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:20.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.489+0000 7f186ba00640 1 --2- 172.21.15.42:0/1994975382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18641044f0 0x7f18641109d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f185c009cd0 tx=0x7f185c02a8f0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.489+0000 7f186ba00640 1 -- 172.21.15.42:0/1994975382 shutdown_connections 2024-08-26T00:12:20.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.489+0000 7f186ba00640 1 --2- 172.21.15.42:0/1994975382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18641044f0 0x7f18641109d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.489+0000 7f186ba00640 1 --2- 172.21.15.42:0/1994975382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1864103b50 0x7f1864103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.489+0000 7f186ba00640 1 --2- 172.21.15.42:0/1994975382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1864109c00 0x7f1864109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.489+0000 7f186ba00640 1 -- 172.21.15.42:0/1994975382 >> 172.21.15.42:0/1994975382 conn(0x7f18640ff830 msgr2=0x7f1864101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:20.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.489+0000 7f186ba00640 1 -- 172.21.15.42:0/1994975382 shutdown_connections 2024-08-26T00:12:20.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.489+0000 7f186ba00640 1 -- 172.21.15.42:0/1994975382 wait complete. 2024-08-26T00:12:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.490+0000 7f186ba00640 1 Processor -- start 2024-08-26T00:12:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.490+0000 7f186ba00640 1 -- start start 2024-08-26T00:12:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.491+0000 7f186ba00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1864103b50 0x7f186419a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.491+0000 7f186ba00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18641044f0 0x7f186419a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.491+0000 7f186ba00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1864109c00 0x7f186419ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.491+0000 7f186ba00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1864113fb0 con 0x7f1864109c00 2024-08-26T00:12:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.491+0000 7f186ba00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1864113e30 con 0x7f18641044f0 2024-08-26T00:12:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.491+0000 7f186ba00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1864114130 con 0x7f1864103b50 2024-08-26T00:12:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.491+0000 7f1869000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1864103b50 0x7f186419a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.491+0000 7f1869000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1864103b50 0x7f186419a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:50024/0 (socket says 172.21.15.42:50024) 2024-08-26T00:12:20.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.491+0000 7f1869000640 1 -- 172.21.15.42:0/524106971 learned_addr learned my addr 172.21.15.42:0/524106971 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:20.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.491+0000 7f1863e00640 1 --2- 172.21.15.42:0/524106971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18641044f0 0x7f186419a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:20.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.491+0000 7f1869a00640 1 --2- 172.21.15.42:0/524106971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1864109c00 0x7f186419ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:20.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.492+0000 7f1869000640 1 -- 172.21.15.42:0/524106971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18641044f0 msgr2=0x7f186419a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:20.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.492+0000 7f1869000640 1 --2- 172.21.15.42:0/524106971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18641044f0 0x7f186419a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.492+0000 7f1869000640 1 -- 172.21.15.42:0/524106971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1864109c00 msgr2=0x7f186419ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:20.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.492+0000 7f1869000640 1 --2- 172.21.15.42:0/524106971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1864109c00 0x7f186419ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.492+0000 7f1869000640 1 -- 172.21.15.42:0/524106971 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f186419f340 con 0x7f1864103b50 2024-08-26T00:12:20.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.492+0000 7f1863e00640 1 --2- 172.21.15.42:0/524106971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18641044f0 0x7f186419a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:12:20.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.492+0000 7f1869000640 1 --2- 172.21.15.42:0/524106971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1864103b50 0x7f186419a390 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f185800e9f0 tx=0x7f185800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:20.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.492+0000 7f1861600640 1 -- 172.21.15.42:0/524106971 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185800cd80 con 0x7f1864103b50 2024-08-26T00:12:20.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.492+0000 7f1861600640 1 -- 172.21.15.42:0/524106971 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1858010910 con 0x7f1864103b50 2024-08-26T00:12:20.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.492+0000 7f1861600640 1 -- 172.21.15.42:0/524106971 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1858018990 con 0x7f1864103b50 2024-08-26T00:12:20.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.492+0000 7f186ba00640 1 -- 172.21.15.42:0/524106971 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f186419f630 con 0x7f1864103b50 2024-08-26T00:12:20.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.492+0000 7f186ba00640 1 -- 172.21.15.42:0/524106971 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18641a6f10 con 0x7f1864103b50 2024-08-26T00:12:20.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.495+0000 7f1861600640 1 -- 172.21.15.42:0/524106971 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1858010ac0 con 0x7f1864103b50 2024-08-26T00:12:20.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.495+0000 7f186e62a740 1 Processor -- start 2024-08-26T00:12:20.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.495+0000 7f186e62a740 1 -- start start 2024-08-26T00:12:20.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.496+0000 7f186e62a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859b9820 0x55af859b9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:20.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.496+0000 7f186e62a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55af859ba140 0x55af859c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:20.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.496+0000 7f186e62a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55af859c4a00 0x55af859c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:20.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.496+0000 7f186e62a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55af8591ff30 con 0x55af859b9820 2024-08-26T00:12:20.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.496+0000 7f186e62a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55af858b75a0 con 0x55af859c4a00 2024-08-26T00:12:20.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.496+0000 7f186e62a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55af8591bef0 con 0x55af859ba140 2024-08-26T00:12:20.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.496+0000 7f1869000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55af859ba140 0x55af859c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:20.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.496+0000 7f1869a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859b9820 0x55af859b9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:20.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.496+0000 7f1869a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859b9820 0x55af859b9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36322/0 (socket says 172.21.15.42:36322) 2024-08-26T00:12:20.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.496+0000 7f1869a00640 1 -- 172.21.15.42:0/227386945 learned_addr learned my addr 172.21.15.42:0/227386945 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:20.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.496+0000 7f1863e00640 1 --2- 172.21.15.42:0/227386945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55af859c4a00 0x55af859c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:20.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.497+0000 7f1869a00640 1 -- 172.21.15.42:0/227386945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55af859ba140 msgr2=0x55af859c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:20.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.497+0000 7f1869a00640 1 --2- 172.21.15.42:0/227386945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55af859ba140 0x55af859c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.497+0000 7f1869a00640 1 -- 172.21.15.42:0/227386945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55af859c4a00 msgr2=0x55af859c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:20.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.497+0000 7f1869a00640 1 --2- 172.21.15.42:0/227386945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55af859c4a00 0x55af859c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.497+0000 7f1869a00640 1 -- 172.21.15.42:0/227386945 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af856913c0 con 0x55af859b9820 2024-08-26T00:12:20.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.497+0000 7f1869a00640 1 --2- 172.21.15.42:0/227386945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859b9820 0x55af859b9c00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f185c009cd0 tx=0x7f185c005f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451e4f43fd540327 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:20.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.497+0000 7f1861600640 1 --2- 172.21.15.42:0/524106971 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f184c0a2c00 0x7f184c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:20.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.497+0000 7f1856000640 1 -- 172.21.15.42:0/227386945 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185c030760 con 0x55af859b9820 2024-08-26T00:12:20.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.498+0000 7f1856000640 1 -- 172.21.15.42:0/227386945 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f185c036030 con 0x55af859b9820 2024-08-26T00:12:20.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.498+0000 7f1856000640 1 -- 172.21.15.42:0/227386945 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185c0043a0 con 0x55af859b9820 2024-08-26T00:12:20.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.498+0000 7f1861600640 1 -- 172.21.15.42:0/524106971 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f18580cf250 con 0x7f1864103b50 2024-08-26T00:12:20.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.498+0000 7f1869000640 1 --2- 172.21.15.42:0/524106971 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f184c0a2c00 0x7f184c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:20.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.498+0000 7f186e62a740 1 -- 172.21.15.42:0/227386945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859b9820 msgr2=0x55af859b9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:20.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.498+0000 7f186e62a740 1 --2- 172.21.15.42:0/227386945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859b9820 0x55af859b9c00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f185c009cd0 tx=0x7f185c005f80 comp rx=0 tx=0).stop 2024-08-26T00:12:20.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.498+0000 7f1869000640 1 --2- 172.21.15.42:0/524106971 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f184c0a2c00 0x7f184c0a50c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f18580984f0 tx=0x7f18580d2c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:20.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.498+0000 7f186e62a740 1 -- 172.21.15.42:0/227386945 shutdown_connections 2024-08-26T00:12:20.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.498+0000 7f186e62a740 1 --2- 172.21.15.42:0/227386945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55af859c4a00 0x55af859c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.498+0000 7f186e62a740 1 --2- 172.21.15.42:0/227386945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55af859ba140 0x55af859c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.498+0000 7f186e62a740 1 --2- 172.21.15.42:0/227386945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859b9820 0x55af859b9c00 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.498+0000 7f186e62a740 1 -- 172.21.15.42:0/227386945 >> 172.21.15.42:0/227386945 conn(0x55af859b5db0 msgr2=0x55af859b6190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:20.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.499+0000 7f186e62a740 1 -- 172.21.15.42:0/227386945 shutdown_connections 2024-08-26T00:12:20.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.499+0000 7f186e62a740 1 -- 172.21.15.42:0/227386945 wait complete. 2024-08-26T00:12:20.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.499+0000 7f186e62a740 1 -- start start 2024-08-26T00:12:20.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.499+0000 7f186e62a740 1 Processor -- start 2024-08-26T00:12:20.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.500+0000 7f186e62a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859b9820 0x55af859c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:20.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.500+0000 7f186e62a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55af859ba140 0x55af859c1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:20.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.500+0000 7f186e62a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55af859c4a00 0x55af859c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:20.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.500+0000 7f186e62a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55af859c75d0 con 0x55af859b9820 2024-08-26T00:12:20.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.500+0000 7f186e62a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55af858dade0 con 0x55af859ba140 2024-08-26T00:12:20.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.500+0000 7f186e62a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55af859c7750 con 0x55af859c4a00 2024-08-26T00:12:20.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.500+0000 7f186e62a740 10 client.0 _ll_register_callbacks cb 0x55af858c97b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:12:20.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.500+0000 7f1869a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859b9820 0x55af859c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:20.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.500+0000 7f1863e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55af859ba140 0x55af859c1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:20.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.500+0000 7f1869a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859b9820 0x55af859c18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36330/0 (socket says 172.21.15.42:36330) 2024-08-26T00:12:20.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.500+0000 7f1869a00640 1 -- 172.21.15.42:0/2804693889 learned_addr learned my addr 172.21.15.42:0/2804693889 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:20.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.500+0000 7f1869a00640 1 --2- 172.21.15.42:0/2804693889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55af859c4a00 0x55af859c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:20.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.501+0000 7f1863e00640 1 -- 172.21.15.42:0/2804693889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55af859c4a00 msgr2=0x55af859c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:20.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.501+0000 7f1863e00640 1 --2- 172.21.15.42:0/2804693889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55af859c4a00 0x55af859c2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.501+0000 7f1863e00640 1 -- 172.21.15.42:0/2804693889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859b9820 msgr2=0x55af859c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:20.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.501+0000 7f1863e00640 1 --2- 172.21.15.42:0/2804693889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859b9820 0x55af859c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.501+0000 7f1863e00640 1 -- 172.21.15.42:0/2804693889 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af859d0a40 con 0x55af859ba140 2024-08-26T00:12:20.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.501+0000 7f1869a00640 1 --2- 172.21.15.42:0/2804693889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55af859c4a00 0x55af859c2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:12:20.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.501+0000 7f1863e00640 1 --2- 172.21.15.42:0/2804693889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55af859ba140 0x55af859c1e30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1850012cf0 tx=0x7f185000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aace0300cb1aa7a server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:20.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.501+0000 7f184aa00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:12:20.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.501+0000 7f184aa00640 1 -- 172.21.15.42:0/2804693889 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185000fe60 con 0x55af859ba140 2024-08-26T00:12:20.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.501+0000 7f186e62a740 1 -- 172.21.15.42:0/2804693889 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f185c036030 con 0x55af859ba140 2024-08-26T00:12:20.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.501+0000 7f184aa00640 1 -- 172.21.15.42:0/2804693889 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f1850012110 con 0x55af859ba140 2024-08-26T00:12:20.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.502+0000 7f184aa00640 1 -- 172.21.15.42:0/2804693889 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f1850004050 con 0x55af859ba140 2024-08-26T00:12:20.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.502+0000 7f186e62a740 10 client.26129 fetch_fsmap learned FSMap version 31 2024-08-26T00:12:20.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.502+0000 7f186e62a740 1 -- 172.21.15.42:0/2804693889 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55af859d3460 con 0x55af859ba140 2024-08-26T00:12:20.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.502+0000 7f184aa00640 1 -- 172.21.15.42:0/2804693889 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f185c036030 con 0x55af859ba140 2024-08-26T00:12:20.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.502+0000 7f184aa00640 1 -- 172.21.15.42:0/2804693889 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f1850010430 con 0x55af859ba140 2024-08-26T00:12:20.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.502+0000 7f186e62a740 10 client.26129 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:12:20.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.502+0000 7f186e62a740 10 client.26129 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:12:20.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.502+0000 7f186e62a740 20 client.26129 populate_metadata read hostname 'smithi042' 2024-08-26T00:12:20.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.502+0000 7f186e62a740 1 --2- 172.21.15.42:0/2804693889 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55af859d4870 0x55af859d6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:20.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.502+0000 7f186e62a740 4 client.26129 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:12:20.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.502+0000 7f186e62a740 1 -- 172.21.15.42:0/2804693889 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af8592d4a0 con 0x55af859d4870 2024-08-26T00:12:20.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.503+0000 7f1869a00640 1 --2- 172.21.15.42:0/2804693889 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55af859d4870 0x55af859d6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:20.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.503+0000 7f1869a00640 1 --2- 172.21.15.42:0/2804693889 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55af859d4870 0x55af859d6ca0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1f5df8fa27cc7e5 server_cookie=3eeb71452b06126e in_seq=0 out_seq=0 2024-08-26T00:12:20.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.503+0000 7f184aa00640 10 client.26129 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:12:20.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.505+0000 7f184aa00640 1 -- 172.21.15.42:0/2804693889 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55af8592d4a0 con 0x55af859d4870 2024-08-26T00:12:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.505+0000 7f184aa00640 10 client.26129 handle_command_reply: tid=0 2024-08-26T00:12:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.505+0000 7f186e62a740 1 client.26129 shutdown 2024-08-26T00:12:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.505+0000 7f186e62a740 1 -- 172.21.15.42:0/2804693889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55af859ba140 msgr2=0x55af859c1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.505+0000 7f186e62a740 1 --2- 172.21.15.42:0/2804693889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55af859ba140 0x55af859c1e30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1850012cf0 tx=0x7f185000f790 comp rx=0 tx=0).stop 2024-08-26T00:12:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.505+0000 7f186e62a740 1 -- 172.21.15.42:0/2804693889 shutdown_connections 2024-08-26T00:12:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.505+0000 7f186e62a740 1 --2- 172.21.15.42:0/2804693889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55af859c4a00 0x55af859c2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.505+0000 7f186e62a740 1 --2- 172.21.15.42:0/2804693889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55af859ba140 0x55af859c1e30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.505+0000 7f186e62a740 1 --2- 172.21.15.42:0/2804693889 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55af859d4870 0x55af859d6ca0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.505+0000 7f186e62a740 1 --2- 172.21.15.42:0/2804693889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859b9820 0x55af859c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.505+0000 7f184aa00640 0 client.26129 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:12:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.505+0000 7f186e62a740 1 -- 172.21.15.42:0/2804693889 >> 172.21.15.42:0/2804693889 conn(0x55af859b5db0 msgr2=0x55af859b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.505+0000 7f186e62a740 1 -- 172.21.15.42:0/2804693889 shutdown_connections 2024-08-26T00:12:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.505+0000 7f186e62a740 1 -- 172.21.15.42:0/2804693889 wait complete. 2024-08-26T00:12:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.506+0000 7f186e62a740 20 client.26129 trim_cache size 0 max 16384 2024-08-26T00:12:20.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.519+0000 7f186e62a740 1 Processor -- start 2024-08-26T00:12:20.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.520+0000 7f186e62a740 1 -- start start 2024-08-26T00:12:20.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.520+0000 7f186e62a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859b9820 0x55af859bc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:20.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.520+0000 7f186e62a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55af859ba140 0x55af859b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:20.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.520+0000 7f186e62a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55af859c4a00 0x55af859dc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:20.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.520+0000 7f186e62a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f18641b1eb0 con 0x55af859b9820 2024-08-26T00:12:20.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.520+0000 7f186e62a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f18641af6c0 con 0x55af859ba140 2024-08-26T00:12:20.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.520+0000 7f186e62a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f18641ad4f0 con 0x55af859c4a00 2024-08-26T00:12:20.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.520+0000 7f1869a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859b9820 0x55af859bc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:20.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.520+0000 7f1863e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55af859ba140 0x55af859b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:20.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.520+0000 7f1869a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859b9820 0x55af859bc280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36340/0 (socket says 172.21.15.42:36340) 2024-08-26T00:12:20.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.520+0000 7f1869a00640 1 -- 172.21.15.42:0/311546442 learned_addr learned my addr 172.21.15.42:0/311546442 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:20.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.520+0000 7f1869a00640 1 --2- 172.21.15.42:0/311546442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55af859c4a00 0x55af859dc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:20.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.521+0000 7f1863e00640 1 -- 172.21.15.42:0/311546442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55af859c4a00 msgr2=0x55af859dc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:20.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.521+0000 7f1863e00640 1 --2- 172.21.15.42:0/311546442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55af859c4a00 0x55af859dc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.521+0000 7f1863e00640 1 -- 172.21.15.42:0/311546442 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859b9820 msgr2=0x55af859bc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:20.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.521+0000 7f1863e00640 1 --2- 172.21.15.42:0/311546442 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859b9820 0x55af859bc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.521+0000 7f1863e00640 1 -- 172.21.15.42:0/311546442 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af859d7320 con 0x55af859ba140 2024-08-26T00:12:20.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.521+0000 7f1863e00640 1 --2- 172.21.15.42:0/311546442 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55af859ba140 0x55af859b4e50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1850010850 tx=0x7f1850005db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f71d645578ee917 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:20.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.521+0000 7f1855600640 1 -- 172.21.15.42:0/311546442 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18500121d0 con 0x55af859ba140 2024-08-26T00:12:20.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.521+0000 7f1855600640 1 -- 172.21.15.42:0/311546442 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1850010ac0 con 0x55af859ba140 2024-08-26T00:12:20.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.521+0000 7f1855600640 1 -- 172.21.15.42:0/311546442 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1850003850 con 0x55af859ba140 2024-08-26T00:12:20.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.522+0000 7f186e62a740 1 -- 172.21.15.42:0/311546442 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55af859ba140 msgr2=0x55af859b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:20.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.522+0000 7f186e62a740 1 --2- 172.21.15.42:0/311546442 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55af859ba140 0x55af859b4e50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1850010850 tx=0x7f1850005db0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.522+0000 7f186e62a740 1 -- 172.21.15.42:0/311546442 shutdown_connections 2024-08-26T00:12:20.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.522+0000 7f186e62a740 1 --2- 172.21.15.42:0/311546442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55af859c4a00 0x55af859dc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.522+0000 7f186e62a740 1 --2- 172.21.15.42:0/311546442 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55af859ba140 0x55af859b4e50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.522+0000 7f186e62a740 1 --2- 172.21.15.42:0/311546442 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859b9820 0x55af859bc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.522+0000 7f186e62a740 1 -- 172.21.15.42:0/311546442 >> 172.21.15.42:0/311546442 conn(0x55af859b5db0 msgr2=0x55af859b4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:20.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.522+0000 7f186e62a740 1 -- 172.21.15.42:0/311546442 shutdown_connections 2024-08-26T00:12:20.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.522+0000 7f186e62a740 1 -- 172.21.15.42:0/311546442 wait complete. 2024-08-26T00:12:20.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.522+0000 7f186e62a740 1 -- start start 2024-08-26T00:12:20.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.523+0000 7f186e62a740 1 Processor -- start 2024-08-26T00:12:20.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.523+0000 7f186e62a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55af859b9820 0x55af859be970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:20.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.523+0000 7f186e62a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55af859ba140 0x55af859beeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:20.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.523+0000 7f186e62a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859c4a00 0x55af859bf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:20.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.523+0000 7f186e62a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f18641adb80 con 0x55af859c4a00 2024-08-26T00:12:20.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.523+0000 7f186e62a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f18641aeff0 con 0x55af859b9820 2024-08-26T00:12:20.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.523+0000 7f186e62a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f18641ae250 con 0x55af859ba140 2024-08-26T00:12:20.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.523+0000 7f186e62a740 10 client.0 _ll_register_callbacks cb 0x7f1850009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:12:20.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.523+0000 7f1863e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55af859ba140 0x55af859beeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:20.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.523+0000 7f1863e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55af859ba140 0x55af859beeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:50056/0 (socket says 172.21.15.42:50056) 2024-08-26T00:12:20.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.523+0000 7f1863e00640 1 -- 172.21.15.42:0/852312596 learned_addr learned my addr 172.21.15.42:0/852312596 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:20.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.523+0000 7f1869a00640 1 --2- 172.21.15.42:0/852312596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55af859b9820 0x55af859be970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:20.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.524+0000 7f1869a00640 1 --2- 172.21.15.42:0/852312596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859c4a00 0x55af859bf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:20.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.524+0000 7f1863e00640 1 -- 172.21.15.42:0/852312596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55af859b9820 msgr2=0x55af859be970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:20.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.524+0000 7f1863e00640 1 --2- 172.21.15.42:0/852312596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55af859b9820 0x55af859be970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.524+0000 7f1863e00640 1 -- 172.21.15.42:0/852312596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859c4a00 msgr2=0x55af859bf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:20.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.524+0000 7f1863e00640 1 --2- 172.21.15.42:0/852312596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859c4a00 0x55af859bf3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.524+0000 7f1863e00640 1 -- 172.21.15.42:0/852312596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af85a3e600 con 0x55af859ba140 2024-08-26T00:12:20.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.524+0000 7f1863e00640 1 --2- 172.21.15.42:0/852312596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55af859ba140 0x55af859beeb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1850009710 tx=0x7f185000f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dfb4e3363a9a7da server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:20.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.524+0000 7f184aa00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:12:20.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.524+0000 7f184aa00640 1 -- 172.21.15.42:0/852312596 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1850010c70 con 0x55af859ba140 2024-08-26T00:12:20.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.525+0000 7f184aa00640 1 -- 172.21.15.42:0/852312596 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f18500035f0 con 0x55af859ba140 2024-08-26T00:12:20.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.525+0000 7f186e62a740 1 -- 172.21.15.42:0/852312596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1850010ac0 con 0x55af859ba140 2024-08-26T00:12:20.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.525+0000 7f184aa00640 1 -- 172.21.15.42:0/852312596 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f18500037f0 con 0x55af859ba140 2024-08-26T00:12:20.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.525+0000 7f186e62a740 10 client.26098 fetch_fsmap learned FSMap version 31 2024-08-26T00:12:20.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.525+0000 7f186e62a740 1 -- 172.21.15.42:0/852312596 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55af85a3f8e0 con 0x55af859ba140 2024-08-26T00:12:20.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.525+0000 7f184aa00640 1 -- 172.21.15.42:0/852312596 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1850010ac0 con 0x55af859ba140 2024-08-26T00:12:20.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.525+0000 7f184aa00640 1 -- 172.21.15.42:0/852312596 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f185001c990 con 0x55af859ba140 2024-08-26T00:12:20.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.526+0000 7f186e62a740 10 client.26098 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:12:20.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.526+0000 7f186e62a740 10 client.26098 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:12:20.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.526+0000 7f186e62a740 20 client.26098 populate_metadata read hostname 'smithi042' 2024-08-26T00:12:20.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.526+0000 7f186e62a740 1 --2- 172.21.15.42:0/852312596 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55af85a3ffe0 0x55af85a42400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:20.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.526+0000 7f186e62a740 4 client.26098 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:12:20.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.526+0000 7f186e62a740 1 -- 172.21.15.42:0/852312596 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55af859279b0 con 0x55af85a3ffe0 2024-08-26T00:12:20.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.526+0000 7f1869a00640 1 --2- 172.21.15.42:0/852312596 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55af85a3ffe0 0x55af85a42400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:20.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.526+0000 7f1869a00640 1 --2- 172.21.15.42:0/852312596 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55af85a3ffe0 0x55af85a42400 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9333bacc05b922b server_cookie=b8cefcff5750fa0 in_seq=0 out_seq=0 2024-08-26T00:12:20.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.526+0000 7f184aa00640 10 client.26098 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:12:20.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.527+0000 7f184aa00640 1 -- 172.21.15.42:0/852312596 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55af859279b0 con 0x55af85a3ffe0 2024-08-26T00:12:20.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.527+0000 7f184aa00640 10 client.26098 handle_command_reply: tid=0 2024-08-26T00:12:20.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.527+0000 7f186e62a740 1 client.26098 shutdown 2024-08-26T00:12:20.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.527+0000 7f186e62a740 1 -- 172.21.15.42:0/852312596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55af859ba140 msgr2=0x55af859beeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:20.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.527+0000 7f186e62a740 1 --2- 172.21.15.42:0/852312596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55af859ba140 0x55af859beeb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1850009710 tx=0x7f185000f790 comp rx=0 tx=0).stop 2024-08-26T00:12:20.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.527+0000 7f186e62a740 1 -- 172.21.15.42:0/852312596 shutdown_connections 2024-08-26T00:12:20.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.527+0000 7f186e62a740 1 --2- 172.21.15.42:0/852312596 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55af85a3ffe0 0x55af85a42400 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.527+0000 7f186e62a740 1 --2- 172.21.15.42:0/852312596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55af859c4a00 0x55af859bf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.527+0000 7f186e62a740 1 --2- 172.21.15.42:0/852312596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55af859ba140 0x55af859beeb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.527+0000 7f186e62a740 1 --2- 172.21.15.42:0/852312596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55af859b9820 0x55af859be970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.527+0000 7f186e62a740 1 -- 172.21.15.42:0/852312596 >> 172.21.15.42:0/852312596 conn(0x55af859b5db0 msgr2=0x55af859b4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:20.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.527+0000 7f184aa00640 0 client.26098 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:12:20.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.527+0000 7f186e62a740 1 -- 172.21.15.42:0/852312596 shutdown_connections 2024-08-26T00:12:20.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.527+0000 7f186e62a740 1 -- 172.21.15.42:0/852312596 wait complete. 2024-08-26T00:12:20.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.527+0000 7f186e62a740 20 client.26098 trim_cache size 0 max 16384 2024-08-26T00:12:20.533 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:12:20.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.528+0000 7f186ba00640 1 -- 172.21.15.42:0/524106971 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f184c0a2c00 msgr2=0x7f184c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:20.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.528+0000 7f186ba00640 1 --2- 172.21.15.42:0/524106971 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f184c0a2c00 0x7f184c0a50c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f18580984f0 tx=0x7f18580d2c90 comp rx=0 tx=0).stop 2024-08-26T00:12:20.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.528+0000 7f186ba00640 1 -- 172.21.15.42:0/524106971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1864103b50 msgr2=0x7f186419a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:20.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.528+0000 7f186ba00640 1 --2- 172.21.15.42:0/524106971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1864103b50 0x7f186419a390 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f185800e9f0 tx=0x7f185800eeb0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.528+0000 7f186ba00640 1 -- 172.21.15.42:0/524106971 shutdown_connections 2024-08-26T00:12:20.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.528+0000 7f186ba00640 1 --2- 172.21.15.42:0/524106971 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f184c0a2c00 0x7f184c0a50c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.528+0000 7f186ba00640 1 --2- 172.21.15.42:0/524106971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1864109c00 0x7f186419ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.528+0000 7f186ba00640 1 --2- 172.21.15.42:0/524106971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18641044f0 0x7f186419a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.528+0000 7f186ba00640 1 --2- 172.21.15.42:0/524106971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1864103b50 0x7f186419a390 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:20.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.528+0000 7f186ba00640 1 -- 172.21.15.42:0/524106971 >> 172.21.15.42:0/524106971 conn(0x7f18640ff830 msgr2=0x7f1864100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:20.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.528+0000 7f186ba00640 1 -- 172.21.15.42:0/524106971 shutdown_connections 2024-08-26T00:12:20.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:20.528+0000 7f186ba00640 1 -- 172.21.15.42:0/524106971 wait complete. 2024-08-26T00:12:20.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:20 smithi042 ceph-mon[17225]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 412 op/s 2024-08-26T00:12:20.836 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:20 smithi181 ceph-mon[22102]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 412 op/s 2024-08-26T00:12:21.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:20 smithi043 ceph-mon[22091]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 412 op/s 2024-08-26T00:12:22.341 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-26T00:12:22.342 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-26T00:12:22.741 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:12:22.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:22 smithi042 ceph-mon[17225]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 364 op/s 2024-08-26T00:12:23.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:22 smithi043 ceph-mon[22091]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 364 op/s 2024-08-26T00:12:23.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:22 smithi181 ceph-mon[22102]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 364 op/s 2024-08-26T00:12:23.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.410+0000 7fc82a600640 1 -- 172.21.15.42:0/3126614423 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8240764c0 msgr2=0x7fc8240768a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:23.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.410+0000 7fc82a600640 1 --2- 172.21.15.42:0/3126614423 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8240764c0 0x7fc8240768a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc814009900 tx=0x7fc81402a3f0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.410+0000 7fc82a600640 1 -- 172.21.15.42:0/3126614423 shutdown_connections 2024-08-26T00:12:23.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.410+0000 7fc82a600640 1 --2- 172.21.15.42:0/3126614423 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8241127d0 0x7fc824114bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.410+0000 7fc82a600640 1 --2- 172.21.15.42:0/3126614423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc824076de0 0x7fc824112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.410+0000 7fc82a600640 1 --2- 172.21.15.42:0/3126614423 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8240764c0 0x7fc8240768a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.410+0000 7fc82a600640 1 -- 172.21.15.42:0/3126614423 >> 172.21.15.42:0/3126614423 conn(0x7fc8240ff830 msgr2=0x7fc824101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:23.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.410+0000 7fc82a600640 1 -- 172.21.15.42:0/3126614423 shutdown_connections 2024-08-26T00:12:23.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.410+0000 7fc82a600640 1 -- 172.21.15.42:0/3126614423 wait complete. 2024-08-26T00:12:23.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.411+0000 7fc82a600640 1 Processor -- start 2024-08-26T00:12:23.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.411+0000 7fc82a600640 1 -- start start 2024-08-26T00:12:23.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.411+0000 7fc82a600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8240764c0 0x7fc8241a4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:23.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.411+0000 7fc82a600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc824076de0 0x7fc8241a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:23.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.411+0000 7fc82a600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8241127d0 0x7fc82419e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:23.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.411+0000 7fc82a600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc824118390 con 0x7fc8241127d0 2024-08-26T00:12:23.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.411+0000 7fc82a600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc824118210 con 0x7fc824076de0 2024-08-26T00:12:23.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.411+0000 7fc82a600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc824118510 con 0x7fc8240764c0 2024-08-26T00:12:23.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.411+0000 7fc823400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8240764c0 0x7fc8241a4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:23.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.412+0000 7fc823400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8240764c0 0x7fc8241a4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:50078/0 (socket says 172.21.15.42:50078) 2024-08-26T00:12:23.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.412+0000 7fc823400640 1 -- 172.21.15.42:0/2012022476 learned_addr learned my addr 172.21.15.42:0/2012022476 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:23.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.412+0000 7fc822a00640 1 --2- 172.21.15.42:0/2012022476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc824076de0 0x7fc8241a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:23.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.412+0000 7fc823e00640 1 --2- 172.21.15.42:0/2012022476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8241127d0 0x7fc82419e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:23.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.412+0000 7fc823400640 1 -- 172.21.15.42:0/2012022476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc824076de0 msgr2=0x7fc8241a4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:23.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.412+0000 7fc823400640 1 --2- 172.21.15.42:0/2012022476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc824076de0 0x7fc8241a4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.412+0000 7fc823400640 1 -- 172.21.15.42:0/2012022476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8241127d0 msgr2=0x7fc82419e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:23.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.412+0000 7fc823400640 1 --2- 172.21.15.42:0/2012022476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8241127d0 0x7fc82419e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.412+0000 7fc823400640 1 -- 172.21.15.42:0/2012022476 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc82419eeb0 con 0x7fc8240764c0 2024-08-26T00:12:23.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.412+0000 7fc823e00640 1 --2- 172.21.15.42:0/2012022476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8241127d0 0x7fc82419e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:12:23.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.412+0000 7fc823400640 1 --2- 172.21.15.42:0/2012022476 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8240764c0 0x7fc8241a4570 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc814004770 tx=0x7fc814003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:23.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.413+0000 7fc81be00640 1 -- 172.21.15.42:0/2012022476 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81403f070 con 0x7fc8240764c0 2024-08-26T00:12:23.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.413+0000 7fc81be00640 1 -- 172.21.15.42:0/2012022476 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc814031ca0 con 0x7fc8240764c0 2024-08-26T00:12:23.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.413+0000 7fc81be00640 1 -- 172.21.15.42:0/2012022476 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814035030 con 0x7fc8240764c0 2024-08-26T00:12:23.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.413+0000 7fc82a600640 1 -- 172.21.15.42:0/2012022476 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc82419f140 con 0x7fc8240764c0 2024-08-26T00:12:23.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.413+0000 7fc82a600640 1 -- 172.21.15.42:0/2012022476 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8241ab320 con 0x7fc8240764c0 2024-08-26T00:12:23.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.416+0000 7fc81be00640 1 -- 172.21.15.42:0/2012022476 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc814042070 con 0x7fc8240764c0 2024-08-26T00:12:23.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.416+0000 7fc82d038740 1 Processor -- start 2024-08-26T00:12:23.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.416+0000 7fc82d038740 1 -- start start 2024-08-26T00:12:23.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.417+0000 7fc82d038740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c45ed30 0x55c35c45f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:23.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.417+0000 7fc82d038740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c35c45f650 0x55c35c4699d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:23.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.417+0000 7fc82d038740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c35c469f10 0x55c35c46c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:23.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.417+0000 7fc82d038740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c35c3c5e30 con 0x55c35c45f650 2024-08-26T00:12:23.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.417+0000 7fc82d038740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c35c35d3c0 con 0x55c35c469f10 2024-08-26T00:12:23.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.417+0000 7fc82d038740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c35c3c1df0 con 0x55c35c45ed30 2024-08-26T00:12:23.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.417+0000 7fc823e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c45ed30 0x55c35c45f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:23.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.417+0000 7fc823e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c45ed30 0x55c35c45f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:50094/0 (socket says 172.21.15.42:50094) 2024-08-26T00:12:23.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.417+0000 7fc823e00640 1 -- 172.21.15.42:0/3632506602 learned_addr learned my addr 172.21.15.42:0/3632506602 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:23.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.417+0000 7fc823400640 1 --2- 172.21.15.42:0/3632506602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c35c45f650 0x55c35c4699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:23.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.417+0000 7fc822a00640 1 --2- 172.21.15.42:0/3632506602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c35c469f10 0x55c35c46c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:23.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.418+0000 7fc822a00640 1 -- 172.21.15.42:0/3632506602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c45ed30 msgr2=0x55c35c45f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:23.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.418+0000 7fc81be00640 1 --2- 172.21.15.42:0/2012022476 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc8080a2c00 0x7fc8080a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:23.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.418+0000 7fc822a00640 1 --2- 172.21.15.42:0/3632506602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c45ed30 0x55c35c45f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.418+0000 7fc822a00640 1 -- 172.21.15.42:0/3632506602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c35c45f650 msgr2=0x55c35c4699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:23.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.418+0000 7fc822a00640 1 --2- 172.21.15.42:0/3632506602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c35c45f650 0x55c35c4699d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.418+0000 7fc822a00640 1 -- 172.21.15.42:0/3632506602 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c35c1376a0 con 0x55c35c469f10 2024-08-26T00:12:23.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.418+0000 7fc823e00640 1 --2- 172.21.15.42:0/3632506602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c45ed30 0x55c35c45f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:12:23.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.418+0000 7fc81be00640 1 -- 172.21.15.42:0/2012022476 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fc8140ef310 con 0x7fc8240764c0 2024-08-26T00:12:23.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.418+0000 7fc823e00640 1 --2- 172.21.15.42:0/2012022476 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc8080a2c00 0x7fc8080a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:23.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.418+0000 7fc822a00640 1 --2- 172.21.15.42:0/3632506602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c35c469f10 0x55c35c46c300 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc810009bf0 tx=0x7fc810011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc4aa1e25e6d256d server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:23.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.419+0000 7fc823e00640 1 --2- 172.21.15.42:0/2012022476 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc8080a2c00 0x7fc8080a50c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc81c014d00 tx=0x7fc81c004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:23.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.419+0000 7fc818c00640 1 -- 172.21.15.42:0/3632506602 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810009da0 con 0x55c35c469f10 2024-08-26T00:12:23.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.419+0000 7fc818c00640 1 -- 172.21.15.42:0/3632506602 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc810005020 con 0x55c35c469f10 2024-08-26T00:12:23.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.419+0000 7fc818c00640 1 -- 172.21.15.42:0/3632506602 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810004c60 con 0x55c35c469f10 2024-08-26T00:12:23.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.419+0000 7fc82d038740 1 -- 172.21.15.42:0/3632506602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c35c469f10 msgr2=0x55c35c46c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:23.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.419+0000 7fc82d038740 1 --2- 172.21.15.42:0/3632506602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c35c469f10 0x55c35c46c300 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc810009bf0 tx=0x7fc810011810 comp rx=0 tx=0).stop 2024-08-26T00:12:23.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.420+0000 7fc82d038740 1 -- 172.21.15.42:0/3632506602 shutdown_connections 2024-08-26T00:12:23.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.420+0000 7fc82d038740 1 --2- 172.21.15.42:0/3632506602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c35c469f10 0x55c35c46c300 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.420+0000 7fc82d038740 1 --2- 172.21.15.42:0/3632506602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c35c45f650 0x55c35c4699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.420+0000 7fc82d038740 1 --2- 172.21.15.42:0/3632506602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c45ed30 0x55c35c45f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.420+0000 7fc82d038740 1 -- 172.21.15.42:0/3632506602 >> 172.21.15.42:0/3632506602 conn(0x55c35c45b2c0 msgr2=0x55c35c45b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:23.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.420+0000 7fc82d038740 1 -- 172.21.15.42:0/3632506602 shutdown_connections 2024-08-26T00:12:23.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.420+0000 7fc82d038740 1 -- 172.21.15.42:0/3632506602 wait complete. 2024-08-26T00:12:23.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.420+0000 7fc82d038740 1 -- start start 2024-08-26T00:12:23.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.421+0000 7fc82d038740 1 Processor -- start 2024-08-26T00:12:23.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.421+0000 7fc82d038740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c35c45ed30 0x55c35c466e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:23.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.421+0000 7fc82d038740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c35c45f650 0x55c35c467380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:23.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.421+0000 7fc82d038740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c469f10 0x55c35c4678c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:23.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.421+0000 7fc82d038740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c35c46cae0 con 0x55c35c45f650 2024-08-26T00:12:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.421+0000 7fc82d038740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c35c380c30 con 0x55c35c45ed30 2024-08-26T00:12:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.421+0000 7fc82d038740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c35c46cc60 con 0x55c35c469f10 2024-08-26T00:12:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.421+0000 7fc82d038740 10 client.0 _ll_register_callbacks cb 0x55c35c0d4ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:12:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.421+0000 7fc823e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c469f10 0x55c35c4678c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.421+0000 7fc823e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c469f10 0x55c35c4678c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:50104/0 (socket says 172.21.15.42:50104) 2024-08-26T00:12:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.421+0000 7fc823e00640 1 -- 172.21.15.42:0/194471996 learned_addr learned my addr 172.21.15.42:0/194471996 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.422+0000 7fc823400640 1 --2- 172.21.15.42:0/194471996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c35c45ed30 0x55c35c466e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.422+0000 7fc822a00640 1 --2- 172.21.15.42:0/194471996 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c35c45f650 0x55c35c467380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.422+0000 7fc823e00640 1 -- 172.21.15.42:0/194471996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c35c45ed30 msgr2=0x55c35c466e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.422+0000 7fc823e00640 1 --2- 172.21.15.42:0/194471996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c35c45ed30 0x55c35c466e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.422+0000 7fc823e00640 1 -- 172.21.15.42:0/194471996 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c35c45f650 msgr2=0x55c35c467380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.422+0000 7fc823e00640 1 --2- 172.21.15.42:0/194471996 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c35c45f650 0x55c35c467380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.422+0000 7fc823e00640 1 -- 172.21.15.42:0/194471996 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c35c38cdd0 con 0x55c35c469f10 2024-08-26T00:12:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.422+0000 7fc822a00640 1 --2- 172.21.15.42:0/194471996 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c35c45f650 0x55c35c467380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:12:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.422+0000 7fc823e00640 1 --2- 172.21.15.42:0/194471996 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c469f10 0x55c35c4678c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc81c014420 tx=0x7fc81c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd1bcf46651ed3a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.422+0000 7fc80d600640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:12:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.422+0000 7fc80d600640 1 -- 172.21.15.42:0/194471996 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c025070 con 0x55c35c469f10 2024-08-26T00:12:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.423+0000 7fc80d600640 1 -- 172.21.15.42:0/194471996 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fc81c021600 con 0x55c35c469f10 2024-08-26T00:12:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.423+0000 7fc82d038740 1 -- 172.21.15.42:0/194471996 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc810005020 con 0x55c35c469f10 2024-08-26T00:12:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.423+0000 7fc80d600640 1 -- 172.21.15.42:0/194471996 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc81c01a070 con 0x55c35c469f10 2024-08-26T00:12:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.423+0000 7fc82d038740 10 client.26110 fetch_fsmap learned FSMap version 31 2024-08-26T00:12:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.423+0000 7fc82d038740 1 -- 172.21.15.42:0/194471996 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c35c478780 con 0x55c35c469f10 2024-08-26T00:12:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.423+0000 7fc80d600640 1 -- 172.21.15.42:0/194471996 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc810005020 con 0x55c35c469f10 2024-08-26T00:12:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.423+0000 7fc80d600640 1 -- 172.21.15.42:0/194471996 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fc81c01da00 con 0x55c35c469f10 2024-08-26T00:12:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.423+0000 7fc82d038740 10 client.26110 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:12:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.423+0000 7fc82d038740 10 client.26110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:12:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.423+0000 7fc82d038740 20 client.26110 populate_metadata read hostname 'smithi042' 2024-08-26T00:12:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.423+0000 7fc82d038740 1 --2- 172.21.15.42:0/194471996 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c35c479c30 0x55c35c47c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.423+0000 7fc82d038740 4 client.26110 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:12:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.423+0000 7fc82d038740 1 -- 172.21.15.42:0/194471996 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c35c3d33a0 con 0x55c35c479c30 2024-08-26T00:12:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.424+0000 7fc823400640 1 --2- 172.21.15.42:0/194471996 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c35c479c30 0x55c35c47c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.424+0000 7fc823400640 1 --2- 172.21.15.42:0/194471996 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c35c479c30 0x55c35c47c0f0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=154aa30458fec44b server_cookie=625d24ad98b30fcb in_seq=0 out_seq=0 2024-08-26T00:12:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.424+0000 7fc80d600640 10 client.26110 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:12:23.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.426+0000 7fc80d600640 1 -- 172.21.15.42:0/194471996 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c35c3d33a0 con 0x55c35c479c30 2024-08-26T00:12:23.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.426+0000 7fc80d600640 10 client.26110 handle_command_reply: tid=0 2024-08-26T00:12:23.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.426+0000 7fc82d038740 1 client.26110 shutdown 2024-08-26T00:12:23.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.426+0000 7fc82d038740 1 -- 172.21.15.42:0/194471996 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c469f10 msgr2=0x55c35c4678c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:23.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.426+0000 7fc82d038740 1 --2- 172.21.15.42:0/194471996 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c469f10 0x55c35c4678c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc81c014420 tx=0x7fc81c004a40 comp rx=0 tx=0).stop 2024-08-26T00:12:23.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.426+0000 7fc82d038740 1 -- 172.21.15.42:0/194471996 shutdown_connections 2024-08-26T00:12:23.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.426+0000 7fc82d038740 1 --2- 172.21.15.42:0/194471996 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c469f10 0x55c35c4678c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.426+0000 7fc82d038740 1 --2- 172.21.15.42:0/194471996 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c35c479c30 0x55c35c47c0f0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.426+0000 7fc82d038740 1 --2- 172.21.15.42:0/194471996 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c35c45f650 0x55c35c467380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.426+0000 7fc82d038740 1 --2- 172.21.15.42:0/194471996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c35c45ed30 0x55c35c466e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.426+0000 7fc80d600640 0 client.26110 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:12:23.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.426+0000 7fc82d038740 1 -- 172.21.15.42:0/194471996 >> 172.21.15.42:0/194471996 conn(0x55c35c45b2c0 msgr2=0x55c35c460ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:23.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.426+0000 7fc82d038740 1 -- 172.21.15.42:0/194471996 shutdown_connections 2024-08-26T00:12:23.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.426+0000 7fc82d038740 1 -- 172.21.15.42:0/194471996 wait complete. 2024-08-26T00:12:23.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.427+0000 7fc82d038740 20 client.26110 trim_cache size 0 max 16384 2024-08-26T00:12:23.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.445+0000 7fc82d038740 1 Processor -- start 2024-08-26T00:12:23.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.445+0000 7fc82d038740 1 -- start start 2024-08-26T00:12:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.445+0000 7fc82d038740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c45ed30 0x55c35c45a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.445+0000 7fc82d038740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c35c45f650 0x55c35c4819c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.445+0000 7fc82d038740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c35c469f10 0x55c35c481f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.445+0000 7fc82d038740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc8241b62d0 con 0x55c35c469f10 2024-08-26T00:12:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.445+0000 7fc82d038740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc8241b3ae0 con 0x55c35c45f650 2024-08-26T00:12:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.445+0000 7fc82d038740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc8241b1910 con 0x55c35c45ed30 2024-08-26T00:12:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.446+0000 7fc823400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c45ed30 0x55c35c45a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.446+0000 7fc823e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c35c469f10 0x55c35c481f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.446+0000 7fc823400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c45ed30 0x55c35c45a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:50108/0 (socket says 172.21.15.42:50108) 2024-08-26T00:12:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.446+0000 7fc822a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c35c45f650 0x55c35c4819c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.446+0000 7fc823400640 1 -- 172.21.15.42:0/2947683354 learned_addr learned my addr 172.21.15.42:0/2947683354 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.446+0000 7fc823400640 1 -- 172.21.15.42:0/2947683354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c35c45f650 msgr2=0x55c35c4819c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.446+0000 7fc823400640 1 --2- 172.21.15.42:0/2947683354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c35c45f650 0x55c35c4819c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.446+0000 7fc823400640 1 -- 172.21.15.42:0/2947683354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c35c469f10 msgr2=0x55c35c481f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:23.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.446+0000 7fc823400640 1 --2- 172.21.15.42:0/2947683354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c35c469f10 0x55c35c481f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.446+0000 7fc823400640 1 -- 172.21.15.42:0/2947683354 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c35c45ad60 con 0x55c35c45ed30 2024-08-26T00:12:23.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.446+0000 7fc822a00640 1 --2- 172.21.15.42:0/2947683354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c35c45f650 0x55c35c4819c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:12:23.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.446+0000 7fc823400640 1 --2- 172.21.15.42:0/2947683354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c45ed30 0x55c35c45a310 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc8140f2fd0 tx=0x7fc8140f2d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfb62aa7c27fb21d server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:23.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.446+0000 7fc80fe00640 1 -- 172.21.15.42:0/2947683354 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814049040 con 0x55c35c45ed30 2024-08-26T00:12:23.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.446+0000 7fc80fe00640 1 -- 172.21.15.42:0/2947683354 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8140a6040 con 0x55c35c45ed30 2024-08-26T00:12:23.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.446+0000 7fc80fe00640 1 -- 172.21.15.42:0/2947683354 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8140bffa0 con 0x55c35c45ed30 2024-08-26T00:12:23.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.447+0000 7fc82d038740 1 -- 172.21.15.42:0/2947683354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c45ed30 msgr2=0x55c35c45a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:23.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.447+0000 7fc82d038740 1 --2- 172.21.15.42:0/2947683354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c45ed30 0x55c35c45a310 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc8140f2fd0 tx=0x7fc8140f2d50 comp rx=0 tx=0).stop 2024-08-26T00:12:23.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.447+0000 7fc82d038740 1 -- 172.21.15.42:0/2947683354 shutdown_connections 2024-08-26T00:12:23.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.447+0000 7fc82d038740 1 --2- 172.21.15.42:0/2947683354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c35c469f10 0x55c35c481f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.447+0000 7fc82d038740 1 --2- 172.21.15.42:0/2947683354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c35c45f650 0x55c35c4819c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.447+0000 7fc82d038740 1 --2- 172.21.15.42:0/2947683354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c45ed30 0x55c35c45a310 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.447+0000 7fc82d038740 1 -- 172.21.15.42:0/2947683354 >> 172.21.15.42:0/2947683354 conn(0x55c35c45b2c0 msgr2=0x55c35c459c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:23.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.447+0000 7fc82d038740 1 -- 172.21.15.42:0/2947683354 shutdown_connections 2024-08-26T00:12:23.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.447+0000 7fc82d038740 1 -- 172.21.15.42:0/2947683354 wait complete. 2024-08-26T00:12:23.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.448+0000 7fc82d038740 1 -- start start 2024-08-26T00:12:23.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.448+0000 7fc82d038740 1 Processor -- start 2024-08-26T00:12:23.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.448+0000 7fc82d038740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c45ed30 0x55c35c4723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:23.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.448+0000 7fc82d038740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c35c45f650 0x55c35c46e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:23.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.448+0000 7fc82d038740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c35c469f10 0x55c35c46ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:23.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.448+0000 7fc82d038740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc8241b1fa0 con 0x55c35c45f650 2024-08-26T00:12:23.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.449+0000 7fc82d038740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc8241b3410 con 0x55c35c469f10 2024-08-26T00:12:23.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.449+0000 7fc82d038740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc8241b2670 con 0x55c35c45ed30 2024-08-26T00:12:23.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.449+0000 7fc823400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c45ed30 0x55c35c4723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:23.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.449+0000 7fc82d038740 10 client.0 _ll_register_callbacks cb 0x7fc81c009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:12:23.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.449+0000 7fc823400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c45ed30 0x55c35c4723f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:50112/0 (socket says 172.21.15.42:50112) 2024-08-26T00:12:23.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.449+0000 7fc823400640 1 -- 172.21.15.42:0/2493851768 learned_addr learned my addr 172.21.15.42:0/2493851768 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:23.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.449+0000 7fc823e00640 1 --2- 172.21.15.42:0/2493851768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c35c469f10 0x55c35c46ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:23.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.449+0000 7fc822a00640 1 --2- 172.21.15.42:0/2493851768 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c35c45f650 0x55c35c46e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:23.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.449+0000 7fc823400640 1 -- 172.21.15.42:0/2493851768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c35c469f10 msgr2=0x55c35c46ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.449+0000 7fc823400640 1 --2- 172.21.15.42:0/2493851768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c35c469f10 0x55c35c46ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.449+0000 7fc823400640 1 -- 172.21.15.42:0/2493851768 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c35c45f650 msgr2=0x55c35c46e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.449+0000 7fc823400640 1 --2- 172.21.15.42:0/2493851768 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c35c45f650 0x55c35c46e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.449+0000 7fc823400640 1 -- 172.21.15.42:0/2493851768 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c35c46f2b0 con 0x55c35c45ed30 2024-08-26T00:12:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.449+0000 7fc822a00640 1 --2- 172.21.15.42:0/2493851768 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c35c45f650 0x55c35c46e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:12:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.449+0000 7fc823400640 1 --2- 172.21.15.42:0/2493851768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c45ed30 0x55c35c4723f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc814031550 tx=0x7fc8140ef640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31a20ef446858a server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.449+0000 7fc80d600640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:12:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.450+0000 7fc80d600640 1 -- 172.21.15.42:0/2493851768 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8140d9060 con 0x55c35c45ed30 2024-08-26T00:12:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.450+0000 7fc80d600640 1 -- 172.21.15.42:0/2493851768 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fc8140ecee0 con 0x55c35c45ed30 2024-08-26T00:12:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.450+0000 7fc82d038740 1 -- 172.21.15.42:0/2493851768 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8140a6040 con 0x55c35c45ed30 2024-08-26T00:12:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.450+0000 7fc80d600640 1 -- 172.21.15.42:0/2493851768 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc814049050 con 0x55c35c45ed30 2024-08-26T00:12:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.450+0000 7fc82d038740 10 client.26116 fetch_fsmap learned FSMap version 31 2024-08-26T00:12:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.450+0000 7fc82d038740 1 -- 172.21.15.42:0/2493851768 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c35c4e57e0 con 0x55c35c45ed30 2024-08-26T00:12:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.450+0000 7fc80d600640 1 -- 172.21.15.42:0/2493851768 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8140a6040 con 0x55c35c45ed30 2024-08-26T00:12:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.450+0000 7fc80d600640 1 -- 172.21.15.42:0/2493851768 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fc8140b8260 con 0x55c35c45ed30 2024-08-26T00:12:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.450+0000 7fc82d038740 10 client.26116 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:12:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.450+0000 7fc82d038740 10 client.26116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:12:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.450+0000 7fc82d038740 20 client.26116 populate_metadata read hostname 'smithi042' 2024-08-26T00:12:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.450+0000 7fc82d038740 1 --2- 172.21.15.42:0/2493851768 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c35c4e5e30 0x55c35c4e8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.450+0000 7fc82d038740 4 client.26116 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-26T00:12:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.450+0000 7fc82d038740 1 -- 172.21.15.42:0/2493851768 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c35c3cd8b0 con 0x55c35c4e5e30 2024-08-26T00:12:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.451+0000 7fc822a00640 1 --2- 172.21.15.42:0/2493851768 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c35c4e5e30 0x55c35c4e8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.451+0000 7fc822a00640 1 --2- 172.21.15.42:0/2493851768 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c35c4e5e30 0x55c35c4e8250 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0484f7475935dc8 server_cookie=f9bd5aab9625ca61 in_seq=0 out_seq=0 2024-08-26T00:12:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.451+0000 7fc80d600640 10 client.26116 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:12:23.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.465+0000 7fc80d600640 1 -- 172.21.15.42:0/2493851768 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c35c3cd8b0 con 0x55c35c4e5e30 2024-08-26T00:12:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.465+0000 7fc80d600640 10 client.26116 handle_command_reply: tid=0 2024-08-26T00:12:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.465+0000 7fc82d038740 1 client.26116 shutdown 2024-08-26T00:12:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.465+0000 7fc82d038740 1 -- 172.21.15.42:0/2493851768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c45ed30 msgr2=0x55c35c4723f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.465+0000 7fc82d038740 1 --2- 172.21.15.42:0/2493851768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c45ed30 0x55c35c4723f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc814031550 tx=0x7fc8140ef640 comp rx=0 tx=0).stop 2024-08-26T00:12:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.465+0000 7fc82d038740 1 -- 172.21.15.42:0/2493851768 shutdown_connections 2024-08-26T00:12:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.465+0000 7fc82d038740 1 --2- 172.21.15.42:0/2493851768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c35c469f10 0x55c35c46ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.465+0000 7fc82d038740 1 --2- 172.21.15.42:0/2493851768 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55c35c4e5e30 0x55c35c4e8250 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.465+0000 7fc82d038740 1 --2- 172.21.15.42:0/2493851768 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c35c45f650 0x55c35c46e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.465+0000 7fc82d038740 1 --2- 172.21.15.42:0/2493851768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c35c45ed30 0x55c35c4723f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.465+0000 7fc82d038740 1 -- 172.21.15.42:0/2493851768 >> 172.21.15.42:0/2493851768 conn(0x55c35c45b2c0 msgr2=0x55c35c460fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.465+0000 7fc80d600640 0 client.26116 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:12:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.465+0000 7fc82d038740 1 -- 172.21.15.42:0/2493851768 shutdown_connections 2024-08-26T00:12:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.465+0000 7fc82d038740 1 -- 172.21.15.42:0/2493851768 wait complete. 2024-08-26T00:12:23.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.465+0000 7fc82d038740 20 client.26116 trim_cache size 0 max 16384 2024-08-26T00:12:23.468 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:12:23.468 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-08-26T00:12:23.468 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "d69a1b69-c00b-4e11-89fb-9818f7314597", 2024-08-26T00:12:23.468 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-08-26T00:12:23.468 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:12:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.466+0000 7fc82a600640 1 -- 172.21.15.42:0/2012022476 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc8080a2c00 msgr2=0x7fc8080a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.466+0000 7fc82a600640 1 --2- 172.21.15.42:0/2012022476 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc8080a2c00 0x7fc8080a50c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc81c014d00 tx=0x7fc81c004ab0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.466+0000 7fc82a600640 1 -- 172.21.15.42:0/2012022476 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8240764c0 msgr2=0x7fc8241a4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.466+0000 7fc82a600640 1 --2- 172.21.15.42:0/2012022476 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8240764c0 0x7fc8241a4570 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc814004770 tx=0x7fc814003c10 comp rx=0 tx=0).stop 2024-08-26T00:12:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.466+0000 7fc82a600640 1 -- 172.21.15.42:0/2012022476 shutdown_connections 2024-08-26T00:12:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.466+0000 7fc82a600640 1 --2- 172.21.15.42:0/2012022476 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc8080a2c00 0x7fc8080a50c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.466+0000 7fc82a600640 1 --2- 172.21.15.42:0/2012022476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8241127d0 0x7fc82419e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.466+0000 7fc82a600640 1 --2- 172.21.15.42:0/2012022476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc824076de0 0x7fc8241a4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.466+0000 7fc82a600640 1 --2- 172.21.15.42:0/2012022476 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8240764c0 0x7fc8241a4570 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:23.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.466+0000 7fc82a600640 1 -- 172.21.15.42:0/2012022476 >> 172.21.15.42:0/2012022476 conn(0x7fc8240ff830 msgr2=0x7fc824101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:23.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.466+0000 7fc82a600640 1 -- 172.21.15.42:0/2012022476 shutdown_connections 2024-08-26T00:12:23.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:23.466+0000 7fc82a600640 1 -- 172.21.15.42:0/2012022476 wait complete. 2024-08-26T00:12:24.274 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-26T00:12:24.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:24 smithi042 ceph-mon[17225]: pgmap v635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 461 op/s 2024-08-26T00:12:24.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:24 smithi042 ceph-mon[17225]: scrub queued for path: / 2024-08-26T00:12:24.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:24 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:24.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:24 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:24.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:24 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:25.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:24 smithi043 ceph-mon[22091]: pgmap v635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 461 op/s 2024-08-26T00:12:25.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:24 smithi043 ceph-mon[22091]: scrub queued for path: / 2024-08-26T00:12:25.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:24 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:25.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:24 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:25.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:24 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:25.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:24 smithi181 ceph-mon[22102]: pgmap v635: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 461 op/s 2024-08-26T00:12:25.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:24 smithi181 ceph-mon[22102]: scrub queued for path: / 2024-08-26T00:12:25.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:24 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:25.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:24 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:25.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:24 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:25.039 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:12:25.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.802+0000 7fda67000640 1 -- 172.21.15.42:0/354693546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda600ffc00 msgr2=0x7fda600fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:25.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.802+0000 7fda67000640 1 --2- 172.21.15.42:0/354693546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda600ffc00 0x7fda600fffe0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009900 tx=0x7fda4c02a490 comp rx=0 tx=0).stop 2024-08-26T00:12:25.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.802+0000 7fda67000640 1 -- 172.21.15.42:0/354693546 shutdown_connections 2024-08-26T00:12:25.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.802+0000 7fda67000640 1 --2- 172.21.15.42:0/354693546 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda6010a090 0x7fda60110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.802+0000 7fda67000640 1 --2- 172.21.15.42:0/354693546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda60100520 0x7fda60109980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.802+0000 7fda67000640 1 --2- 172.21.15.42:0/354693546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda600ffc00 0x7fda600fffe0 secure :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009900 tx=0x7fda4c02a490 comp rx=0 tx=0).stop 2024-08-26T00:12:25.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.802+0000 7fda67000640 1 -- 172.21.15.42:0/354693546 >> 172.21.15.42:0/354693546 conn(0x7fda600fb830 msgr2=0x7fda600fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:25.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.805+0000 7fda67000640 1 -- 172.21.15.42:0/354693546 shutdown_connections 2024-08-26T00:12:25.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.805+0000 7fda67000640 1 -- 172.21.15.42:0/354693546 wait complete. 2024-08-26T00:12:25.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.807+0000 7fda67000640 1 Processor -- start 2024-08-26T00:12:25.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.810+0000 7fda67000640 1 -- start start 2024-08-26T00:12:25.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.811+0000 7fda67000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda60100520 0x7fda6019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:25.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.812+0000 7fda67000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda6010a090 0x7fda6019aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:25.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.813+0000 7fda67000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda6019ee70 0x7fda6019f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:25.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.813+0000 7fda67000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fda60113ef0 con 0x7fda60100520 2024-08-26T00:12:25.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.813+0000 7fda67000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fda60113d70 con 0x7fda6019ee70 2024-08-26T00:12:25.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.813+0000 7fda67000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fda60114070 con 0x7fda6010a090 2024-08-26T00:12:25.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.813+0000 7fda5f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda6010a090 0x7fda6019aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:25.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.813+0000 7fda5f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda6010a090 0x7fda6019aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:53538/0 (socket says 172.21.15.42:53538) 2024-08-26T00:12:25.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.813+0000 7fda5f400640 1 -- 172.21.15.42:0/1276932858 learned_addr learned my addr 172.21.15.42:0/1276932858 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:25.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.814+0000 7fda5f400640 1 -- 172.21.15.42:0/1276932858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda6019ee70 msgr2=0x7fda6019f320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-26T00:12:25.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.814+0000 7fda5f400640 1 --2- 172.21.15.42:0/1276932858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda6019ee70 0x7fda6019f320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.814+0000 7fda5f400640 1 -- 172.21.15.42:0/1276932858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda60100520 msgr2=0x7fda6019a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:25.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.814+0000 7fda5f400640 1 --2- 172.21.15.42:0/1276932858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda60100520 0x7fda6019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.814+0000 7fda5f400640 1 -- 172.21.15.42:0/1276932858 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6019f930 con 0x7fda6010a090 2024-08-26T00:12:25.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.822+0000 7fda5f400640 1 --2- 172.21.15.42:0/1276932858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda6010a090 0x7fda6019aae0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fda5000cab0 tx=0x7fda5000cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:25.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.825+0000 7fda5cc00640 1 -- 172.21.15.42:0/1276932858 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda50007d30 con 0x7fda6010a090 2024-08-26T00:12:25.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.825+0000 7fda5cc00640 1 -- 172.21.15.42:0/1276932858 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda500035f0 con 0x7fda6010a090 2024-08-26T00:12:25.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.825+0000 7fda67000640 1 -- 172.21.15.42:0/1276932858 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda6019fc20 con 0x7fda6010a090 2024-08-26T00:12:25.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.825+0000 7fda67000640 1 -- 172.21.15.42:0/1276932858 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda601a7400 con 0x7fda6010a090 2024-08-26T00:12:25.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.825+0000 7fda5cc00640 1 -- 172.21.15.42:0/1276932858 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5000f690 con 0x7fda6010a090 2024-08-26T00:12:25.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.830+0000 7fda69a71740 1 Processor -- start 2024-08-26T00:12:25.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.830+0000 7fda69a71740 1 -- start start 2024-08-26T00:12:25.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.830+0000 7fda69a71740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b0dabd2840 0x55b0dabd2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:25.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.830+0000 7fda69a71740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd3160 0x55b0dabdd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:25.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.830+0000 7fda69a71740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0dabeedc0 0x55b0dabf11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:25.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.830+0000 7fda69a71740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b0dab38fc0 con 0x55b0dabeedc0 2024-08-26T00:12:25.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.830+0000 7fda69a71740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b0daad0680 con 0x55b0dabd3160 2024-08-26T00:12:25.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.831+0000 7fda69a71740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b0dab34f80 con 0x55b0dabd2840 2024-08-26T00:12:25.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.831+0000 7fda5fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd3160 0x55b0dabdd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:25.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.831+0000 7fda5fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd3160 0x55b0dabdd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:42802/0 (socket says 172.21.15.42:42802) 2024-08-26T00:12:25.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.831+0000 7fda65000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b0dabd2840 0x55b0dabd2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:25.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.831+0000 7fda5fe00640 1 -- 172.21.15.42:0/3727266070 learned_addr learned my addr 172.21.15.42:0/3727266070 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:25.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.832+0000 7fda5fe00640 1 -- 172.21.15.42:0/3727266070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b0dabd2840 msgr2=0x55b0dabd2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:25.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.832+0000 7fda5fe00640 1 --2- 172.21.15.42:0/3727266070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b0dabd2840 0x55b0dabd2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.832+0000 7fda5fe00640 1 -- 172.21.15.42:0/3727266070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0dabeedc0 msgr2=0x55b0dabf11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:25.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.832+0000 7fda5fe00640 1 --2- 172.21.15.42:0/3727266070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0dabeedc0 0x55b0dabf11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.832+0000 7fda5fe00640 1 -- 172.21.15.42:0/3727266070 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0daaec2c0 con 0x55b0dabd3160 2024-08-26T00:12:25.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.832+0000 7fda5fe00640 1 --2- 172.21.15.42:0/3727266070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd3160 0x55b0dabdd600 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fda4c033000 tx=0x7fda4c005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72163f47dcd1e015 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:25.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.832+0000 7fda55600640 1 -- 172.21.15.42:0/3727266070 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c03e020 con 0x55b0dabd3160 2024-08-26T00:12:25.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.834+0000 7fda5cc00640 1 -- 172.21.15.42:0/1276932858 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fda50003f80 con 0x7fda6010a090 2024-08-26T00:12:25.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.835+0000 7fda55600640 1 -- 172.21.15.42:0/3727266070 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda4c005510 con 0x55b0dabd3160 2024-08-26T00:12:25.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.835+0000 7fda55600640 1 -- 172.21.15.42:0/3727266070 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c035040 con 0x55b0dabd3160 2024-08-26T00:12:25.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.836+0000 7fda69a71740 1 -- 172.21.15.42:0/3727266070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd3160 msgr2=0x55b0dabdd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:25.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.836+0000 7fda69a71740 1 --2- 172.21.15.42:0/3727266070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd3160 0x55b0dabdd600 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fda4c033000 tx=0x7fda4c005d50 comp rx=0 tx=0).stop 2024-08-26T00:12:25.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.837+0000 7fda5cc00640 1 --2- 172.21.15.42:0/1276932858 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fda440a2cd0 0x7fda440a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:25.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.837+0000 7fda5cc00640 1 -- 172.21.15.42:0/1276932858 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fda500d0f60 con 0x7fda6010a090 2024-08-26T00:12:25.839 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:25 smithi042 ceph-mon[17225]: pgmap v636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 441 op/s 2024-08-26T00:12:25.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.838+0000 7fda65000640 1 --2- 172.21.15.42:0/1276932858 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fda440a2cd0 0x7fda440a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:25.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.839+0000 7fda69a71740 1 -- 172.21.15.42:0/3727266070 shutdown_connections 2024-08-26T00:12:25.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.839+0000 7fda69a71740 1 --2- 172.21.15.42:0/3727266070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0dabeedc0 0x55b0dabf11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.839+0000 7fda69a71740 1 --2- 172.21.15.42:0/3727266070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd3160 0x55b0dabdd600 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.839+0000 7fda69a71740 1 --2- 172.21.15.42:0/3727266070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b0dabd2840 0x55b0dabd2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.839+0000 7fda69a71740 1 -- 172.21.15.42:0/3727266070 >> 172.21.15.42:0/3727266070 conn(0x55b0dabcee10 msgr2=0x55b0dabcf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:25.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.839+0000 7fda65000640 1 --2- 172.21.15.42:0/1276932858 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fda440a2cd0 0x7fda440a5190 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fda58005fd0 tx=0x7fda58009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:25.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.842+0000 7fda69a71740 1 -- 172.21.15.42:0/3727266070 shutdown_connections 2024-08-26T00:12:25.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.842+0000 7fda69a71740 1 -- 172.21.15.42:0/3727266070 wait complete. 2024-08-26T00:12:25.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.843+0000 7fda69a71740 1 -- start start 2024-08-26T00:12:25.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.843+0000 7fda69a71740 1 Processor -- start 2024-08-26T00:12:25.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.845+0000 7fda69a71740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd2840 0x55b0dabdaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:25.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.846+0000 7fda69a71740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b0dabd3160 0x55b0dabdb030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:25.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.846+0000 7fda69a71740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0dabdb570 0x55b0dabfac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:25.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.846+0000 7fda69a71740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b0dabf16f0 con 0x55b0dabdb570 2024-08-26T00:12:25.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.846+0000 7fda69a71740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b0daaf3e50 con 0x55b0dabd2840 2024-08-26T00:12:25.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.846+0000 7fda69a71740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b0dabf1870 con 0x55b0dabd3160 2024-08-26T00:12:25.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.846+0000 7fda69a71740 10 client.0 _ll_register_callbacks cb 0x55b0daadef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:12:25.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.846+0000 7fda5fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd2840 0x55b0dabdaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:25.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.847+0000 7fda5fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd2840 0x55b0dabdaaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:42806/0 (socket says 172.21.15.42:42806) 2024-08-26T00:12:25.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.847+0000 7fda5f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b0dabd3160 0x55b0dabdb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:25.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.847+0000 7fda5fe00640 1 -- 172.21.15.42:0/1469142305 learned_addr learned my addr 172.21.15.42:0/1469142305 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:25.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.847+0000 7fda5fe00640 1 -- 172.21.15.42:0/1469142305 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b0dabd3160 msgr2=0x55b0dabdb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:25.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.847+0000 7fda5fe00640 1 --2- 172.21.15.42:0/1469142305 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b0dabd3160 0x55b0dabdb030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.847+0000 7fda5fe00640 1 -- 172.21.15.42:0/1469142305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0dabdb570 msgr2=0x55b0dabfac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:25.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.847+0000 7fda5fe00640 1 --2- 172.21.15.42:0/1469142305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0dabdb570 0x55b0dabfac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.847+0000 7fda5fe00640 1 -- 172.21.15.42:0/1469142305 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0da8aa3c0 con 0x55b0dabd2840 2024-08-26T00:12:25.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.848+0000 7fda5fe00640 1 --2- 172.21.15.42:0/1469142305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd2840 0x55b0dabdaaf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0042f0 tx=0x7fda4c005900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac6401a181c0db34 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:25.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.848+0000 7fda4a000640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:12:25.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.848+0000 7fda4a000640 1 -- 172.21.15.42:0/1469142305 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c04b020 con 0x55b0dabd2840 2024-08-26T00:12:25.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.848+0000 7fda4a000640 1 -- 172.21.15.42:0/1469142305 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fda4c004f70 con 0x55b0dabd2840 2024-08-26T00:12:25.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.849+0000 7fda69a71740 1 -- 172.21.15.42:0/1469142305 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda4c005510 con 0x55b0dabd2840 2024-08-26T00:12:25.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.849+0000 7fda4a000640 1 -- 172.21.15.42:0/1469142305 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fda4c035070 con 0x55b0dabd2840 2024-08-26T00:12:25.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.850+0000 7fda69a71740 10 client.26162 fetch_fsmap learned FSMap version 31 2024-08-26T00:12:25.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.851+0000 7fda69a71740 1 -- 172.21.15.42:0/1469142305 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b0dabfd8d0 con 0x55b0dabd2840 2024-08-26T00:12:25.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.852+0000 7fda4a000640 1 -- 172.21.15.42:0/1469142305 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda4c005510 con 0x55b0dabd2840 2024-08-26T00:12:25.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.852+0000 7fda4a000640 1 -- 172.21.15.42:0/1469142305 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fda4c031540 con 0x55b0dabd2840 2024-08-26T00:12:25.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.853+0000 7fda69a71740 10 client.26162 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:12:25.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.853+0000 7fda69a71740 10 client.26162 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:12:25.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.853+0000 7fda69a71740 20 client.26162 populate_metadata read hostname 'smithi042' 2024-08-26T00:12:25.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.853+0000 7fda69a71740 1 --2- 172.21.15.42:0/1469142305 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55b0dabfec20 0x55b0dac01010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:25.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.853+0000 7fda69a71740 4 client.26162 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:12:25.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.853+0000 7fda69a71740 1 -- 172.21.15.42:0/1469142305 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0dab46530 con 0x55b0dabfec20 2024-08-26T00:12:25.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.855+0000 7fda5f400640 1 --2- 172.21.15.42:0/1469142305 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55b0dabfec20 0x55b0dac01010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:25.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.857+0000 7fda5f400640 1 --2- 172.21.15.42:0/1469142305 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55b0dabfec20 0x55b0dac01010 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50a31b26c60c2796 server_cookie=1bac2e039b51b732 in_seq=0 out_seq=0 2024-08-26T00:12:25.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.857+0000 7fda4a000640 10 client.26162 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:12:25.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.858+0000 7fda4a000640 1 -- 172.21.15.42:0/1469142305 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b0dab46530 con 0x55b0dabfec20 2024-08-26T00:12:25.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.858+0000 7fda4a000640 10 client.26162 handle_command_reply: tid=0 2024-08-26T00:12:25.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.858+0000 7fda69a71740 1 client.26162 shutdown 2024-08-26T00:12:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.859+0000 7fda69a71740 1 -- 172.21.15.42:0/1469142305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd2840 msgr2=0x55b0dabdaaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.859+0000 7fda69a71740 1 --2- 172.21.15.42:0/1469142305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd2840 0x55b0dabdaaf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0042f0 tx=0x7fda4c005900 comp rx=0 tx=0).stop 2024-08-26T00:12:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.859+0000 7fda69a71740 1 -- 172.21.15.42:0/1469142305 shutdown_connections 2024-08-26T00:12:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.859+0000 7fda69a71740 1 --2- 172.21.15.42:0/1469142305 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55b0dabfec20 0x55b0dac01010 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.859+0000 7fda69a71740 1 --2- 172.21.15.42:0/1469142305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0dabdb570 0x55b0dabfac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.859+0000 7fda69a71740 1 --2- 172.21.15.42:0/1469142305 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b0dabd3160 0x55b0dabdb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.859+0000 7fda69a71740 1 --2- 172.21.15.42:0/1469142305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd2840 0x55b0dabdaaf0 secure :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0042f0 tx=0x7fda4c005900 comp rx=0 tx=0).stop 2024-08-26T00:12:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.859+0000 7fda69a71740 1 -- 172.21.15.42:0/1469142305 >> 172.21.15.42:0/1469142305 conn(0x55b0dabcee10 msgr2=0x55b0dabd4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.859+0000 7fda4a000640 0 client.26162 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:12:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.859+0000 7fda69a71740 1 -- 172.21.15.42:0/1469142305 shutdown_connections 2024-08-26T00:12:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.859+0000 7fda69a71740 1 -- 172.21.15.42:0/1469142305 wait complete. 2024-08-26T00:12:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.859+0000 7fda69a71740 20 client.26162 trim_cache size 0 max 16384 2024-08-26T00:12:25.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.898+0000 7fda69a71740 1 Processor -- start 2024-08-26T00:12:25.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.898+0000 7fda69a71740 1 -- start start 2024-08-26T00:12:25.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.898+0000 7fda69a71740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd3160 0x55b0dabfa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:25.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.898+0000 7fda69a71740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b0dabdb570 0x55b0dabd9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:25.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.898+0000 7fda69a71740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0dac06610 0x55b0dac06a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:25.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.899+0000 7fda69a71740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fda40010f30 con 0x55b0dac06610 2024-08-26T00:12:25.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.899+0000 7fda69a71740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fda4000e740 con 0x55b0dabd3160 2024-08-26T00:12:25.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.899+0000 7fda69a71740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fda4000c570 con 0x55b0dabdb570 2024-08-26T00:12:25.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.899+0000 7fda5f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b0dabdb570 0x55b0dabd9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:25.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.899+0000 7fda5f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b0dabdb570 0x55b0dabd9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:53576/0 (socket says 172.21.15.42:53576) 2024-08-26T00:12:25.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.899+0000 7fda5f400640 1 -- 172.21.15.42:0/4021215006 learned_addr learned my addr 172.21.15.42:0/4021215006 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:25.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.899+0000 7fda5f400640 1 -- 172.21.15.42:0/4021215006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd3160 msgr2=0x55b0dabfa9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-26T00:12:25.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.899+0000 7fda5f400640 1 --2- 172.21.15.42:0/4021215006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd3160 0x55b0dabfa9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.899+0000 7fda5f400640 1 -- 172.21.15.42:0/4021215006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0dac06610 msgr2=0x55b0dac06a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-26T00:12:25.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.899+0000 7fda5f400640 1 --2- 172.21.15.42:0/4021215006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0dac06610 0x55b0dac06a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.900+0000 7fda5f400640 1 -- 172.21.15.42:0/4021215006 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0dabc9460 con 0x55b0dabdb570 2024-08-26T00:12:25.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.900+0000 7fda5f400640 1 --2- 172.21.15.42:0/4021215006 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b0dabdb570 0x55b0dabd9ad0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fda5009d4c0 tx=0x7fda500ce930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=552c216f33df16b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:25.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.900+0000 7fda54c00640 1 -- 172.21.15.42:0/4021215006 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda500bb070 con 0x55b0dabdb570 2024-08-26T00:12:25.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.901+0000 7fda54c00640 1 -- 172.21.15.42:0/4021215006 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda5009bac0 con 0x55b0dabdb570 2024-08-26T00:12:25.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.901+0000 7fda54c00640 1 -- 172.21.15.42:0/4021215006 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5001d040 con 0x55b0dabdb570 2024-08-26T00:12:25.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.902+0000 7fda69a71740 1 -- 172.21.15.42:0/4021215006 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b0dabdb570 msgr2=0x55b0dabd9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:25.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.902+0000 7fda69a71740 1 --2- 172.21.15.42:0/4021215006 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b0dabdb570 0x55b0dabd9ad0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fda5009d4c0 tx=0x7fda500ce930 comp rx=0 tx=0).stop 2024-08-26T00:12:25.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.902+0000 7fda69a71740 1 -- 172.21.15.42:0/4021215006 shutdown_connections 2024-08-26T00:12:25.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.902+0000 7fda69a71740 1 --2- 172.21.15.42:0/4021215006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0dac06610 0x55b0dac06a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.902+0000 7fda69a71740 1 --2- 172.21.15.42:0/4021215006 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b0dabdb570 0x55b0dabd9ad0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.902+0000 7fda69a71740 1 --2- 172.21.15.42:0/4021215006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd3160 0x55b0dabfa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.902+0000 7fda69a71740 1 -- 172.21.15.42:0/4021215006 >> 172.21.15.42:0/4021215006 conn(0x55b0dabcee10 msgr2=0x55b0dabd93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:25.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.902+0000 7fda69a71740 1 -- 172.21.15.42:0/4021215006 shutdown_connections 2024-08-26T00:12:25.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.903+0000 7fda69a71740 1 -- 172.21.15.42:0/4021215006 wait complete. 2024-08-26T00:12:25.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.903+0000 7fda69a71740 1 -- start start 2024-08-26T00:12:25.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.904+0000 7fda69a71740 1 Processor -- start 2024-08-26T00:12:25.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.904+0000 7fda69a71740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd3160 0x55b0dabf7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:25.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.904+0000 7fda69a71740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0dabdb570 0x55b0dabd77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:25.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.904+0000 7fda69a71740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b0dac06610 0x55b0dabd7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:25.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.906+0000 7fda5fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd3160 0x55b0dabf7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:25.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.906+0000 7fda5fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd3160 0x55b0dabf7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:42818/0 (socket says 172.21.15.42:42818) 2024-08-26T00:12:25.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.906+0000 7fda5fe00640 1 -- 172.21.15.42:0/288723428 learned_addr learned my addr 172.21.15.42:0/288723428 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:25.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.906+0000 7fda69a71740 1 -- 172.21.15.42:0/288723428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fda4000cc00 con 0x55b0dabdb570 2024-08-26T00:12:25.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.906+0000 7fda69a71740 1 -- 172.21.15.42:0/288723428 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fda4000e070 con 0x55b0dabd3160 2024-08-26T00:12:25.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.906+0000 7fda69a71740 1 -- 172.21.15.42:0/288723428 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fda4000d2d0 con 0x55b0dac06610 2024-08-26T00:12:25.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.906+0000 7fda69a71740 10 client.0 _ll_register_callbacks cb 0x7fda4c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:12:25.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.906+0000 7fda65000640 1 --2- 172.21.15.42:0/288723428 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b0dac06610 0x55b0dabd7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:25.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.906+0000 7fda5fe00640 1 -- 172.21.15.42:0/288723428 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b0dac06610 msgr2=0x55b0dabd7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:25.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.906+0000 7fda5fe00640 1 --2- 172.21.15.42:0/288723428 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b0dac06610 0x55b0dabd7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.907+0000 7fda5fe00640 1 -- 172.21.15.42:0/288723428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0dabdb570 msgr2=0x55b0dabd77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:25.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.907+0000 7fda5fe00640 1 --2- 172.21.15.42:0/288723428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0dabdb570 0x55b0dabd77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.907+0000 7fda5fe00640 1 -- 172.21.15.42:0/288723428 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0dabd6670 con 0x55b0dabd3160 2024-08-26T00:12:25.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.907+0000 7fda5fe00640 1 --2- 172.21.15.42:0/288723428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd3160 0x55b0dabf7270 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fda4c031ab0 tx=0x7fda4c005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e12853f938a46a11 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:25.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.907+0000 7fda4a000640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:12:25.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.907+0000 7fda4a000640 1 -- 172.21.15.42:0/288723428 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c05e060 con 0x55b0dabd3160 2024-08-26T00:12:25.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.907+0000 7fda4a000640 1 -- 172.21.15.42:0/288723428 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fda4c004d70 con 0x55b0dabd3160 2024-08-26T00:12:25.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.907+0000 7fda69a71740 1 -- 172.21.15.42:0/288723428 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda5009bac0 con 0x55b0dabd3160 2024-08-26T00:12:25.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.908+0000 7fda4a000640 1 -- 172.21.15.42:0/288723428 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fda4c04b070 con 0x55b0dabd3160 2024-08-26T00:12:25.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.908+0000 7fda69a71740 10 client.26165 fetch_fsmap learned FSMap version 31 2024-08-26T00:12:25.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.908+0000 7fda69a71740 1 -- 172.21.15.42:0/288723428 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b0dac69400 con 0x55b0dabd3160 2024-08-26T00:12:25.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.908+0000 7fda4a000640 1 -- 172.21.15.42:0/288723428 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda5009bac0 con 0x55b0dabd3160 2024-08-26T00:12:25.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.909+0000 7fda4a000640 1 -- 172.21.15.42:0/288723428 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fda4c063070 con 0x55b0dabd3160 2024-08-26T00:12:25.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.909+0000 7fda69a71740 10 client.26165 fetch_fsmap finished waiting for FSMap version 31 2024-08-26T00:12:25.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.909+0000 7fda69a71740 10 client.26165 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:12:25.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.909+0000 7fda69a71740 20 client.26165 populate_metadata read hostname 'smithi042' 2024-08-26T00:12:25.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.909+0000 7fda69a71740 1 --2- 172.21.15.42:0/288723428 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55b0dac69b40 0x55b0dac6bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:25.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.909+0000 7fda69a71740 4 client.26165 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-26T00:12:25.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.909+0000 7fda69a71740 1 -- 172.21.15.42:0/288723428 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b0dabdb3c0 con 0x55b0dac69b40 2024-08-26T00:12:25.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.909+0000 7fda5f400640 1 --2- 172.21.15.42:0/288723428 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55b0dac69b40 0x55b0dac6bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:25.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.910+0000 7fda5f400640 1 --2- 172.21.15.42:0/288723428 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55b0dac69b40 0x55b0dac6bf60 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=115e6c65d6c3daf4 server_cookie=4dfe5fd9b69557f8 in_seq=0 out_seq=0 2024-08-26T00:12:25.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.910+0000 7fda4a000640 10 client.26165 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:12:25.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.911+0000 7fda4a000640 1 -- 172.21.15.42:0/288723428 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+269 (crc 0 0 0) 0x55b0dabdb3c0 con 0x55b0dac69b40 2024-08-26T00:12:25.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.911+0000 7fda4a000640 10 client.26165 handle_command_reply: tid=0 2024-08-26T00:12:25.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.911+0000 7fda69a71740 1 client.26165 shutdown 2024-08-26T00:12:25.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.912+0000 7fda69a71740 1 -- 172.21.15.42:0/288723428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd3160 msgr2=0x55b0dabf7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:25.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.912+0000 7fda69a71740 1 --2- 172.21.15.42:0/288723428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd3160 0x55b0dabf7270 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fda4c031ab0 tx=0x7fda4c005a20 comp rx=0 tx=0).stop 2024-08-26T00:12:25.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.913+0000 7fda69a71740 1 -- 172.21.15.42:0/288723428 shutdown_connections 2024-08-26T00:12:25.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.913+0000 7fda69a71740 1 --2- 172.21.15.42:0/288723428 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b0dac06610 0x55b0dabd7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.913+0000 7fda69a71740 1 --2- 172.21.15.42:0/288723428 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x55b0dac69b40 0x55b0dac6bf60 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.913+0000 7fda69a71740 1 --2- 172.21.15.42:0/288723428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b0dabdb570 0x55b0dabd77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.913+0000 7fda69a71740 1 --2- 172.21.15.42:0/288723428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b0dabd3160 0x55b0dabf7270 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.913+0000 7fda69a71740 1 -- 172.21.15.42:0/288723428 >> 172.21.15.42:0/288723428 conn(0x55b0dabcee10 msgr2=0x55b0dabd93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:25.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.913+0000 7fda4a000640 0 client.26165 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:12:25.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.913+0000 7fda69a71740 1 -- 172.21.15.42:0/288723428 shutdown_connections 2024-08-26T00:12:25.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.913+0000 7fda69a71740 1 -- 172.21.15.42:0/288723428 wait complete. 2024-08-26T00:12:25.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.914+0000 7fda69a71740 20 client.26165 trim_cache size 0 max 16384 2024-08-26T00:12:25.919 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:12:25.919 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "scrub active (19894 inodes in the stack)", 2024-08-26T00:12:25.919 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-08-26T00:12:25.919 INFO:teuthology.orchestra.run.smithi042.stdout: "d69a1b69-c00b-4e11-89fb-9818f7314597": { 2024-08-26T00:12:25.919 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-08-26T00:12:25.920 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "d69a1b69-c00b-4e11-89fb-9818f7314597", 2024-08-26T00:12:25.920 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,force" 2024-08-26T00:12:25.920 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:12:25.920 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:12:25.920 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:12:25.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.915+0000 7fda67000640 1 -- 172.21.15.42:0/1276932858 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fda440a2cd0 msgr2=0x7fda440a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:25.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.915+0000 7fda67000640 1 --2- 172.21.15.42:0/1276932858 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fda440a2cd0 0x7fda440a5190 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fda58005fd0 tx=0x7fda58009500 comp rx=0 tx=0).stop 2024-08-26T00:12:25.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.915+0000 7fda67000640 1 -- 172.21.15.42:0/1276932858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda6010a090 msgr2=0x7fda6019aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:25.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.915+0000 7fda67000640 1 --2- 172.21.15.42:0/1276932858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda6010a090 0x7fda6019aae0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fda5000cab0 tx=0x7fda5000cf70 comp rx=0 tx=0).stop 2024-08-26T00:12:25.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.915+0000 7fda67000640 1 -- 172.21.15.42:0/1276932858 shutdown_connections 2024-08-26T00:12:25.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.915+0000 7fda67000640 1 --2- 172.21.15.42:0/1276932858 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fda440a2cd0 0x7fda440a5190 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.915+0000 7fda67000640 1 --2- 172.21.15.42:0/1276932858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda6019ee70 0x7fda6019f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.915+0000 7fda67000640 1 --2- 172.21.15.42:0/1276932858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda6010a090 0x7fda6019aae0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.915+0000 7fda67000640 1 --2- 172.21.15.42:0/1276932858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda60100520 0x7fda6019a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:25.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.915+0000 7fda67000640 1 -- 172.21.15.42:0/1276932858 >> 172.21.15.42:0/1276932858 conn(0x7fda600fb830 msgr2=0x7fda60107b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:25.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.916+0000 7fda67000640 1 -- 172.21.15.42:0/1276932858 shutdown_connections 2024-08-26T00:12:25.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:25.917+0000 7fda67000640 1 -- 172.21.15.42:0/1276932858 wait complete. 2024-08-26T00:12:26.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:25 smithi043 ceph-mon[22091]: pgmap v636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 441 op/s 2024-08-26T00:12:26.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:25 smithi181 ceph-mon[22102]: pgmap v636: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 441 op/s 2024-08-26T00:12:26.858 INFO:tasks.cephfs.filesystem:scrub status for tag:d69a1b69-c00b-4e11-89fb-9818f7314597 - {'path': '/', 'tag': 'd69a1b69-c00b-4e11-89fb-9818f7314597', 'options': 'recursive,force'} 2024-08-26T00:12:28.162 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:27 smithi042 ceph-mon[17225]: pgmap v637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 926 op/s 2024-08-26T00:12:28.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:27 smithi043 ceph-mon[22091]: pgmap v637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 926 op/s 2024-08-26T00:12:28.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:27 smithi181 ceph-mon[22102]: pgmap v637: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 926 op/s 2024-08-26T00:12:29.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:28 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:29.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:28 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:29.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:28 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:30.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:29 smithi043 ceph-mon[22091]: pgmap v638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 1.95k op/s 2024-08-26T00:12:30.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:29 smithi042 ceph-mon[17225]: pgmap v638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 1.95k op/s 2024-08-26T00:12:30.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:29 smithi181 ceph-mon[22102]: pgmap v638: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 1.95k op/s 2024-08-26T00:12:31.284 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:31.001+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027e0 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-23.jpg auth{0=1} v716 ap=1 s=25211 n(v0 rc2024-08-26T00:06:39.480758+0000 b25211 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ecf7e5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000027e0:[<0x1000000277c/picture-23.jpg v716>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3410>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1573>,<0x10000000005/tmp v159>,<0x100000001fb/client.0 v158>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v169>,<0x10000000001/sv_1 v190>,<0x10000000000/qa v175>,<0x1/volumes v186>]//[]","memoryvalue":"(3)0x100000027e0:[<0x1000000277c/picture-23.jpg v716>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:31.284 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:31.001+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002798 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-79.jpg auth{0=1} v730 ap=1 s=20176 n(v0 rc2024-08-26T00:06:39.065762+0000 b20176 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ec4246100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002798:[<0x1000000277c/picture-79.jpg v730>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3410>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1573>,<0x10000000005/tmp v159>,<0x100000001fb/client.0 v158>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v169>,<0x10000000001/sv_1 v190>,<0x10000000000/qa v175>,<0x1/volumes v186>]//[]","memoryvalue":"(3)0x10000002798:[<0x1000000277c/picture-79.jpg v730>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:31.284 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:31.002+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002781 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-14.xml auth{0=1} v922 ap=1 s=7775 n(v0 rc2024-08-26T00:06:38.925763+0000 b7775 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecbd26b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002781:[<0x1000000277c/article-14.xml v922>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3410>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1573>,<0x10000000005/tmp v159>,<0x100000001fb/client.0 v158>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v169>,<0x10000000001/sv_1 v190>,<0x10000000000/qa v175>,<0x1/volumes v186>]//[]","memoryvalue":"(3)0x10000002781:[<0x1000000277c/article-14.xml v922>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:31.285 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:31.002+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027c8 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-45.jpg auth{0=1} v618 ap=1 s=56359 n(v0 rc2024-08-26T00:06:39.304760+0000 b56359 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ec7c53080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000027c8:[<0x1000000277c/picture-45.jpg v618>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3410>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1573>,<0x10000000005/tmp v159>,<0x100000001fb/client.0 v158>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v169>,<0x10000000001/sv_1 v190>,<0x10000000000/qa v175>,<0x1/volumes v186>]//[]","memoryvalue":"(3)0x100000027c8:[<0x1000000277c/picture-45.jpg v618>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:31.285 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:31.002+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027cc [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-41.jpg auth{0=1} v762 ap=1 s=11354 n(v0 rc2024-08-26T00:06:39.335760+0000 b11354 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ecf2f7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000027cc:[<0x1000000277c/picture-41.jpg v762>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3410>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1573>,<0x10000000005/tmp v159>,<0x100000001fb/client.0 v158>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v169>,<0x10000000001/sv_1 v190>,<0x10000000000/qa v175>,<0x1/volumes v186>]//[]","memoryvalue":"(3)0x100000027cc:[<0x1000000277c/picture-41.jpg v762>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:31.285 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:31.003+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027b1 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-60.jpg auth{0=1} v720 ap=1 s=56206 n(v0 rc2024-08-26T00:06:39.206761+0000 b56206 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558eca695080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000027b1:[<0x1000000277c/picture-60.jpg v720>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3410>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1573>,<0x10000000005/tmp v159>,<0x100000001fb/client.0 v158>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v169>,<0x10000000001/sv_1 v190>,<0x10000000000/qa v175>,<0x1/volumes v186>]//[]","memoryvalue":"(3)0x100000027b1:[<0x1000000277c/picture-60.jpg v720>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:31.285 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:31.003+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027a9 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-66.jpg auth{0=1} v732 ap=1 s=41535 n(v0 rc2024-08-26T00:06:39.155761+0000 b41535 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ec8f18580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000027a9:[<0x1000000277c/picture-66.jpg v732>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3410>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1573>,<0x10000000005/tmp v159>,<0x100000001fb/client.0 v158>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v169>,<0x10000000001/sv_1 v190>,<0x10000000000/qa v175>,<0x1/volumes v186>]//[]","memoryvalue":"(3)0x100000027a9:[<0x1000000277c/picture-66.jpg v732>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:31.286 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:31.003+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002797 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-80.jpg auth{0=1} v660 ap=1 s=30226 n(v0 rc2024-08-26T00:06:39.062762+0000 b30226 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ecf985180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002797:[<0x1000000277c/picture-80.jpg v660>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3410>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1573>,<0x10000000005/tmp v159>,<0x100000001fb/client.0 v158>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v169>,<0x10000000001/sv_1 v190>,<0x10000000000/qa v175>,<0x1/volumes v186>]//[]","memoryvalue":"(3)0x10000002797:[<0x1000000277c/picture-80.jpg v660>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:31.286 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:31.003+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027e1 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-22.jpg auth{0=1} v728 ap=1 s=34826 n(v0 rc2024-08-26T00:06:39.487758+0000 b34826 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ecf2f9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000027e1:[<0x1000000277c/picture-22.jpg v728>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3410>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1573>,<0x10000000005/tmp v159>,<0x100000001fb/client.0 v158>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v169>,<0x10000000001/sv_1 v190>,<0x10000000000/qa v175>,<0x1/volumes v186>]//[]","memoryvalue":"(3)0x100000027e1:[<0x1000000277c/picture-22.jpg v728>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:31.286 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:31.004+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002786 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-11.xml auth{0=1} v924 ap=1 s=31497 n(v0 rc2024-08-26T00:06:38.937763+0000 b31497 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec5c63600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002786:[<0x1000000277c/article-11.xml v924>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3410>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1573>,<0x10000000005/tmp v159>,<0x100000001fb/client.0 v158>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v169>,<0x10000000001/sv_1 v190>,<0x10000000000/qa v175>,<0x1/volumes v186>]//[]","memoryvalue":"(3)0x10000002786:[<0x1000000277c/article-11.xml v924>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:31.286 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:31.005+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000277f [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-16.xml auth{0=1} v926 ap=1 s=25677 n(v0 rc2024-08-26T00:06:38.920763+0000 b25677 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecae34580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000277f:[<0x1000000277c/article-16.xml v926>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3410>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1573>,<0x10000000005/tmp v159>,<0x100000001fb/client.0 v158>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v169>,<0x10000000001/sv_1 v190>,<0x10000000000/qa v175>,<0x1/volumes v186>]//[]","memoryvalue":"(3)0x1000000277f:[<0x1000000277c/article-16.xml v926>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:31.286 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:31.005+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027ea [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-15.jpg auth{0=1} v928 ap=1 s=11110 n(v0 rc2024-08-26T00:06:39.567758+0000 b11110 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecf68c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000027ea:[<0x1000000277c/picture-15.jpg v928>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3410>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1573>,<0x10000000005/tmp v159>,<0x100000001fb/client.0 v158>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v169>,<0x10000000001/sv_1 v190>,<0x10000000000/qa v175>,<0x1/volumes v186>]//[]","memoryvalue":"(3)0x100000027ea:[<0x1000000277c/picture-15.jpg v928>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:31.286 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:31.005+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027b5 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-56.jpg auth{0=1} v790 ap=1 s=42147 n(v0 rc2024-08-26T00:06:39.224761+0000 b42147 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ecd530b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000027b5:[<0x1000000277c/picture-56.jpg v790>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3410>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1573>,<0x10000000005/tmp v159>,<0x100000001fb/client.0 v158>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v169>,<0x10000000001/sv_1 v190>,<0x10000000000/qa v175>,<0x1/volumes v186>]//[]","memoryvalue":"(3)0x100000027b5:[<0x1000000277c/picture-56.jpg v790>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:31.286 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:31.005+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027c6 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-47.jpg auth{0=1} v616 ap=1 s=17012 n(v0 rc2024-08-26T00:06:39.297760+0000 b17012 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ecf99db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000027c6:[<0x1000000277c/picture-47.jpg v616>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3410>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1573>,<0x10000000005/tmp v159>,<0x100000001fb/client.0 v158>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v169>,<0x10000000001/sv_1 v190>,<0x10000000000/qa v175>,<0x1/volumes v186>]//[]","memoryvalue":"(3)0x100000027c6:[<0x1000000277c/picture-47.jpg v616>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:31.286 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:31.006+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002787 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-10.xml auth{0=1} v930 ap=1 s=22347 n(v0 rc2024-08-26T00:06:38.946763+0000 b22347 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecd392580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002787:[<0x1000000277c/article-10.xml v930>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3410>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1573>,<0x10000000005/tmp v159>,<0x100000001fb/client.0 v158>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v169>,<0x10000000001/sv_1 v190>,<0x10000000000/qa v175>,<0x1/volumes v186>]//[]","memoryvalue":"(3)0x10000002787:[<0x1000000277c/article-10.xml v930>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:31.286 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:31.007+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027ed [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-12.jpg auth{0=1} v932 ap=1 s=21122 n(v0 rc2024-08-26T00:06:39.593757+0000 b21122 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec8b5b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000027ed:[<0x1000000277c/picture-12.jpg v932>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3410>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1573>,<0x10000000005/tmp v159>,<0x100000001fb/client.0 v158>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v169>,<0x10000000001/sv_1 v190>,<0x10000000000/qa v175>,<0x1/volumes v186>]//[]","memoryvalue":"(3)0x100000027ed:[<0x1000000277c/picture-12.jpg v932>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:31.286 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:31.007+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027c9 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-44.jpg auth{0=1} v760 ap=1 s=25925 n(v0 rc2024-08-26T00:06:39.307760+0000 b25925 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ecf68c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000027c9:[<0x1000000277c/picture-44.jpg v760>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3410>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1573>,<0x10000000005/tmp v159>,<0x100000001fb/client.0 v158>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v169>,<0x10000000001/sv_1 v190>,<0x10000000000/qa v175>,<0x1/volumes v186>]//[]","memoryvalue":"(3)0x100000027c9:[<0x1000000277c/picture-44.jpg v760>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:31.286 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:31.007+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002790 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-4.xml auth{0=1} v934 ap=1 s=17247 n(v0 rc2024-08-26T00:06:39.010762+0000 b17247 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec8b5ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002790:[<0x1000000277c/article-4.xml v934>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3410>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1573>,<0x10000000005/tmp v159>,<0x100000001fb/client.0 v158>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v169>,<0x10000000001/sv_1 v190>,<0x10000000000/qa v175>,<0x1/volumes v186>]//[]","memoryvalue":"(3)0x10000002790:[<0x1000000277c/article-4.xml v934>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:31.287 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:31.008+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027a3 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-72.jpg auth{0=1} v718 ap=1 s=47588 n(v0 rc2024-08-26T00:06:39.111761+0000 b47588 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ec5e60580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000027a3:[<0x1000000277c/picture-72.jpg v718>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3410>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1573>,<0x10000000005/tmp v159>,<0x100000001fb/client.0 v158>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v169>,<0x10000000001/sv_1 v190>,<0x10000000000/qa v175>,<0x1/volumes v186>]//[]","memoryvalue":"(3)0x100000027a3:[<0x1000000277c/picture-72.jpg v718>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:31.287 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:31.009+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027b2 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-59.jpg auth{0=1} v768 ap=1 s=53474 n(v0 rc2024-08-26T00:06:39.210761+0000 b53474 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ecf99e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000027b2:[<0x1000000277c/picture-59.jpg v768>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3410>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1573>,<0x10000000005/tmp v159>,<0x100000001fb/client.0 v158>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v169>,<0x10000000001/sv_1 v190>,<0x10000000000/qa v175>,<0x1/volumes v186>]//[]","memoryvalue":"(3)0x100000027b2:[<0x1000000277c/picture-59.jpg v768>,<0x20000000219/blog-271 v238426>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.265 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: pgmap v639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 2.19k op/s 2024-08-26T00:12:32.265 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.265 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000027e0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.265 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000002798 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-79.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.265 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000002781 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-14.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.265 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000027c8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000027cc (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000027b1 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-60.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000027a9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-66.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000002797 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-80.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000027e1 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000002786 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-11.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: Scrub error on inode 0x1000000277f (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-16.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000027ea (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000027b5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-56.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000027c6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000002787 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-10.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000027ed (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000027c9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000002790 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-4.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000027a3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-72.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000027b2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-59.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.269 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.269 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.269 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.269 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.269 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.269 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.269 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.269 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.269 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.269 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.269 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.269 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.269 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.269 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.270 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.270 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.270 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.270 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.270 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.270 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.270 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.270 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.270 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.270 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.270 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.270 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.270 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:32.271 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:31 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: pgmap v639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 2.19k op/s 2024-08-26T00:12:32.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000027e0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.288 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000002798 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-79.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.288 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000002781 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-14.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.288 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000027c8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.288 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000027cc (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.288 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.288 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.288 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000027b1 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-60.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000027a9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-66.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000002797 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-80.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000027e1 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000002786 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-11.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: Scrub error on inode 0x1000000277f (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-16.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000027ea (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000027b5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-56.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000027c6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000002787 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-10.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.289 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.290 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000027ed (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.290 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000027c9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.290 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000002790 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-4.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.290 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.290 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.290 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000027a3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-72.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.290 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000027b2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-59.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.290 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.290 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.290 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.290 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.290 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.290 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.290 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.291 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.291 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.291 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.291 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.291 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.291 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.291 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.291 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.291 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.291 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.291 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.291 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.291 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.291 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.292 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.293 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.293 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.293 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.293 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.293 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.293 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.293 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:32.293 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:31 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.293 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.293 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.293 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.293 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.293 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.296 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.296 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.296 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.296 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.296 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.296 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.296 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.296 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.296 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.296 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.296 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.296 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.296 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.297 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.297 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: pgmap v639: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 2.19k op/s 2024-08-26T00:12:32.297 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.297 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000027e0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.297 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000002798 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-79.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.297 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000002781 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-14.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.297 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000027c8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.297 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000027cc (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.297 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.297 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.297 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000027b1 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-60.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.297 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000027a9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-66.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.297 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000002797 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-80.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.297 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000027e1 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.298 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000002786 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-11.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.298 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.298 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.298 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: Scrub error on inode 0x1000000277f (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-16.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.298 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000027ea (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.298 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000027b5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-56.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.298 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000027c6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.298 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000002787 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-10.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.298 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.298 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.298 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000027ed (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.298 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000027c9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.298 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000002790 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-4.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000027a3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-72.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000027b2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-59.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:32.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.302 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.302 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.302 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.302 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:31 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.919 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.898+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ec2 [2,head] ~mds2/stray3/10000001ec2 auth{0=1} v1167 pv223800 ap=4 s=19899 n(v0 rc2024-08-26T00:06:15.276966+0000 b19899 1=1+0)->n(v0 rc2024-08-26T00:12:32.809838+0000 b19899 1=1+0) (ilink xlockdone x=1) (iversion lock w=1 last_client=25040) (iquiesce lock w=1 last_client=25040) caps={25040=pFc/Fc@3} | request=1 lock=4 importingcaps=0 caps=1 replicated=1 waiter=0 authpin=1 scrubqueue=0 0x558ec7d96100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ec2:[<0x10000001eb9/article-61.xml v576>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001ec2:[<0x10000001eb9/article-61.xml v1167>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.920 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.899+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001edc [2,head] ~mds2/stray4/10000001edc auth{0=1} v1163 pv224861 ap=4 s=19747 n(v0 rc2024-08-26T00:06:15.325966+0000 b19747 1=1+0)->n(v0 rc2024-08-26T00:12:32.825838+0000 b19747 1=1+0) (ilink xlockdone x=1) (iversion lock w=1 last_client=25040) (iquiesce lock w=1 last_client=25040) caps={25040=pFc/Fc@3} | request=1 lock=4 importingcaps=0 caps=1 replicated=1 waiter=0 authpin=1 scrubqueue=0 0x558ec5c18580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001edc:[<0x10000001eb9/article-45.xml v590>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001edc:[<0x10000001eb9/article-45.xml v1163>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.920 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.899+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ee0 [2,head] ~mds2/stray4/10000001ee0 auth{0=1} v1161 pv224859 ap=4 s=8119 n(v0 rc2024-08-26T00:06:15.332966+0000 b8119 1=1+0)->n(v0 rc2024-08-26T00:12:32.816838+0000 b8119 1=1+0) (ilink xlockdone x=1) (iversion lock w=1 last_client=25040) (iquiesce lock w=1 last_client=25040) caps={25040=pFc/Fc@3} | request=1 lock=4 importingcaps=0 caps=1 replicated=1 waiter=0 authpin=1 scrubqueue=0 0x558ec7f4e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ee0:[<0x10000001eb9/article-41.xml v546>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001ee0:[<0x10000001eb9/article-41.xml v1161>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.920 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.899+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f53 [2,head] ~mds2/stray4/10000001f53 auth{0=1} v1149 pv224863 ap=4 s=43597 n(v0 rc2024-08-26T00:06:15.994960+0000 b43597 1=1+0)->n(v0 rc2024-08-26T00:12:32.839838+0000 b43597 1=1+0) (ilink xlockdone x=1) (iversion lock w=1 last_client=25040) (iquiesce lock w=1 last_client=25040) caps={25040=pFc/Fc@3} | request=1 lock=4 importingcaps=0 caps=1 replicated=1 waiter=0 authpin=1 scrubqueue=0 0x558ec6a0eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f53:[<0x10000001eb9/picture-7.jpg v572>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f53:[<0x10000001eb9/picture-7.jpg v1149>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.920 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.900+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f4d [2,head] ~mds2/stray4/10000001f4d auth{0=1} v1151 pv224867 ap=4 s=17886 n(v0 rc2024-08-26T00:06:15.976960+0000 b17886 1=1+0)->n(v0 rc2024-08-26T00:12:32.850838+0000 b17886 1=1+0) (ilink xlockdone x=1) (iversion lock w=1 last_client=25040) (iquiesce lock w=1 last_client=25040) caps={25040=pFc/Fc@3} | request=1 lock=4 importingcaps=0 caps=1 replicated=1 waiter=0 authpin=1 scrubqueue=0 0x558ec72c5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f4d:[<0x10000001eb9/picture-9.jpg v624>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f4d:[<0x10000001eb9/picture-9.jpg v1151>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.920 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.901+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ece [2,head] ~mds2/stray4/10000003ece auth{0=1} v1137 pv224869 ap=4 s=3555 n(v0 rc2024-08-26T00:07:30.627321+0000 b3555 1=1+0)->n(v0 rc2024-08-26T00:12:32.855838+0000 b3555 1=1+0) (ilink xlockdone x=1) (iversion lock w=1 last_client=25040) (iquiesce lock w=1 last_client=25040) caps={25040=pFc/Fc@3} | request=1 lock=4 importingcaps=0 caps=1 replicated=1 waiter=0 authpin=1 scrubqueue=0 0x558eccf26b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ece:[<0x10000001eb9/comment-11.xml v1137>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ece:[<0x10000001eb9/comment-11.xml v1137>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.920 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.901+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ec2 [2,head] ~mds2/stray4/10000003ec2 auth{0=1} v1139 pv224871 ap=4 s=7465 n(v0 rc2024-08-26T00:07:30.470323+0000 b7465 1=1+0)->n(v0 rc2024-08-26T00:12:32.864838+0000 b7465 1=1+0) (ilink xlockdone x=1) (iversion lock w=1 last_client=25040) (iquiesce lock w=1 last_client=25040) caps={25040=pFc/Fc@3} | request=1 lock=4 importingcaps=0 caps=1 replicated=1 waiter=0 authpin=1 scrubqueue=0 0x558ece325180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ec2:[<0x10000001eb9/comment-20.xml v1139>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ec2:[<0x10000001eb9/comment-20.xml v1139>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.920 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.921 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.921 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.921 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.921 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.921 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.921 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.921 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.921 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.922 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.922 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.922 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.922 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.922 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.922 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.922 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.922 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.922 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.922 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.922 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.922 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.923 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.923 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.923 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.923 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.923 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.923 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.923 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.923 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.923 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.923 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.923 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.923 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.924 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.924 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.924 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.924 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:32.924 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:32.926 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.901+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003eb1 [2,head] ~mds2/stray4/10000003eb1 auth{0=1} v1152 pv224873 ap=4 s=10190 n(v0 rc2024-08-26T00:07:30.378323+0000 b10190 1=1+0)->n(v0 rc2024-08-26T00:12:32.870838+0000 b10190 1=1+0) (ilink xlockdone x=1) (iversion lock w=1 last_client=25040) (iquiesce lock w=1 last_client=25040) caps={25040=pFc/Fc@3} | request=1 lock=4 importingcaps=0 caps=1 replicated=1 waiter=0 authpin=1 scrubqueue=0 0x558ec534f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003eb1:[<0x10000001eb9/comment-37.xml v1152>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003eb1:[<0x10000001eb9/comment-37.xml v1152>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.926 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.902+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ef9 [2,head] ~mds2/stray4/10000001ef9 auth{0=1} v1159 pv224865 ap=4 s=18427 n(v0 rc2024-08-26T00:06:15.452965+0000 b18427 1=1+0)->n(v0 rc2024-08-26T00:12:32.845838+0000 b18427 1=1+0) (ilink xlockdone x=1) (iversion lock w=1 last_client=25040) (iquiesce lock w=1 last_client=25040) caps={25040=pFc/Fc@3} | request=1 lock=4 importingcaps=0 caps=1 replicated=1 waiter=0 authpin=1 scrubqueue=0 0x558ec7c83b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ef9:[<0x10000001eb9/article-31.xml v584>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001ef9:[<0x10000001eb9/article-31.xml v1159>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.926 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.902+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e8a [2,head] ~mds2/stray4/10000003e8a auth{0=1} v1160 pv224875 ap=4 s=9739 n(v0 rc2024-08-26T00:07:30.145325+0000 b9739 1=1+0)->n(v0 rc2024-08-26T00:12:32.876838+0000 b9739 1=1+0) (ilink xlockdone x=1) (iversion lock w=1 last_client=25040) (iquiesce lock w=1 last_client=25040) caps={25040=pFc/Fc@3} | request=1 lock=4 importingcaps=0 caps=1 replicated=1 waiter=0 authpin=1 scrubqueue=0 0x558ec2bb7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e8a:[<0x10000001eb9/comment-71.xml v1160>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e8a:[<0x10000001eb9/comment-71.xml v1160>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.926 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.903+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f4b [2,head] ~mds2/stray4/10000001f4b auth{0=1} v1172 pv224877 ap=4 s=55631 n(v0 rc2024-08-26T00:06:15.968961+0000 b55631 1=1+0)->n(v0 rc2024-08-26T00:12:32.883838+0000 b55631 1=1+0) (ilink xlockdone x=1) (iversion lock w=1 last_client=25040) (iquiesce lock w=1 last_client=25040) caps={25040=pFc/Fc@3} | request=1 lock=4 importingcaps=0 caps=1 replicated=1 waiter=0 authpin=1 scrubqueue=0 0x558ec2bb6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f4b:[<0x10000001eb9/picture-10.jpg v538>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f4b:[<0x10000001eb9/picture-10.jpg v1172>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.926 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.903+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f5c [2,head] ~mds2/stray4/10000001f5c auth{0=1} v1168 pv224879 ap=4 s=20945 n(v0 rc2024-08-26T00:06:16.015960+0000 b20945 1=1+0)->n(v0 rc2024-08-26T00:12:32.888838+0000 b20945 1=1+0) (ilink xlockdone x=1) (iversion lock w=1 last_client=25040) (iquiesce lock w=1 last_client=25040) caps={25040=pFc/Fc@3} | request=1 lock=4 importingcaps=0 caps=1 replicated=1 waiter=0 authpin=1 scrubqueue=0 0x558ec2bb6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f5c:[<0x10000001eb9/picture-1.jpg v644>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f5c:[<0x10000001eb9/picture-1.jpg v1168>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.926 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.904+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f56 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-6.jpg auth{0=1} v1170 ap=1 s=10202 n(v0 rc2024-08-26T00:06:16.000960+0000 b10202 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecddd0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f56:[<0x10000001eb9/picture-6.jpg v532>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f56:[<0x10000001eb9/picture-6.jpg v1170>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.926 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.905+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002667 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-65.xml auth{0=1} v1166 ap=1 s=14094 n(v0 rc2024-08-26T00:06:36.761782+0000 b14094 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecddd1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002667:[<0x10000001eb9/article-65.xml v1166>,<0x20000000219/blog-205 v227678>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x10000002667:[<0x10000001eb9/article-65.xml v1166>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.927 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.905+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f2c [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-9.xml auth{0=1} v1178 ap=1 s=7339 n(v0 rc2024-08-26T00:06:15.880961+0000 b7339 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecf772580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f2c:[<0x10000001eb9/article-9.xml v526>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f2c:[<0x10000001eb9/article-9.xml v1178>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.927 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.905+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ec6 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-16.xml auth{0=1} v1142 ap=4 s=10012 n(v0 rc2024-08-26T00:07:30.508322+0000 b10012 1=1+0) (ilink sync->lock g=0) (iquiesce lock w=1 last_client=25040) caps={25040=pFc/Fc@3} | request=1 lock=2 importingcaps=0 caps=1 replicated=1 waiter=1 authpin=1 scrubqueue=0 0x558ecf774100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ec6:[<0x10000001eb9/comment-16.xml v1142>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ec6:[<0x10000001eb9/comment-16.xml v1142>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.927 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.905+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027df [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-44.xml auth{0=1} v1164 ap=1 s=10248 n(v0 rc2024-08-26T00:06:39.479758+0000 b10248 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ece048100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000027df:[<0x10000001eb9/article-44.xml v1164>,<0x20000000219/blog-205 v227678>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x100000027df:[<0x10000001eb9/article-44.xml v1164>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.927 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.905+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e97 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-58.xml auth{0=1} v1158 ap=1 s=10191 n(v0 rc2024-08-26T00:07:30.231325+0000 b10191 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecddd0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e97:[<0x10000001eb9/comment-58.xml v1158>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e97:[<0x10000001eb9/comment-58.xml v1158>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.927 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.905+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ec0 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-62.xml auth{0=1} v1182 ap=1 s=27227 n(v0 rc2024-08-26T00:06:15.264967+0000 b27227 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecddd3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ec0:[<0x10000001eb9/article-62.xml v588>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001ec0:[<0x10000001eb9/article-62.xml v1182>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.927 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.908+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f0d [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-24.xml auth{0=1} v1180 ap=1 s=32311 n(v0 rc2024-08-26T00:06:15.805962+0000 b32311 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec20a6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f0d:[<0x10000001eb9/article-24.xml v524>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f0d:[<0x10000001eb9/article-24.xml v1180>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.927 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.909+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e9a [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-55.xml auth{0=1} v1156 ap=1 s=5480 n(v0 rc2024-08-26T00:07:30.250325+0000 b5480 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec20a6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e9a:[<0x10000001eb9/comment-55.xml v1156>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e9a:[<0x10000001eb9/comment-55.xml v1156>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.927 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.910+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003eac [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-41.xml auth{0=1} v1154 ap=1 s=9041 n(v0 rc2024-08-26T00:07:30.352324+0000 b9041 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecdec6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003eac:[<0x10000001eb9/comment-41.xml v1154>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003eac:[<0x10000001eb9/comment-41.xml v1154>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.927 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.910+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003832 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-67.xml auth{0=1} v1092 ap=1 s=16874 n(v0 rc2024-08-26T00:07:10.555492+0000 b16874 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecdec5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003832:[<0x10000001eb9/article-67.xml v1092>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3292>,<0x10000000201/src v1693>,<0x10000000006/blogbench-1.0 v1565>,<0x10000000005/tmp v151>,<0x100000001fb/client.0 v150>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v161>,<0x10000000001/sv_1 v182>,<0x10000000000/qa v167>,<0x1/volumes v178>]//[]","memoryvalue":"(3)0x10000003832:[<0x10000001eb9/article-67.xml v1092>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.927 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.911+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003eb4 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-34.xml auth{0=1} v1150 ap=1 s=8657 n(v0 rc2024-08-26T00:07:30.385323+0000 b8657 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec20a8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003eb4:[<0x10000001eb9/comment-34.xml v1150>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003eb4:[<0x10000001eb9/comment-34.xml v1150>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.927 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.911+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ebd [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-25.xml auth{0=1} v1148 ap=1 s=6336 n(v0 rc2024-08-26T00:07:30.432323+0000 b6336 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec20a7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ebd:[<0x10000001eb9/comment-25.xml v1148>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ebd:[<0x10000001eb9/comment-25.xml v1148>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.927 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.911+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e86 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-75.xml auth{0=1} v1162 ap=1 s=9278 n(v0 rc2024-08-26T00:07:30.124326+0000 b9278 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecdec5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e86:[<0x10000001eb9/comment-75.xml v1162>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e86:[<0x10000001eb9/comment-75.xml v1162>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.928 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.911+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f3c [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-3.xml auth{0=1} v1174 ap=1 s=25161 n(v0 rc2024-08-26T00:06:15.920961+0000 b25161 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecb227180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f3c:[<0x10000001eb9/article-3.xml v646>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f3c:[<0x10000001eb9/article-3.xml v1174>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.928 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.912+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f31 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-7.xml auth{0=1} v1176 ap=1 s=8919 n(v0 rc2024-08-26T00:06:15.889961+0000 b8919 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecb224b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f31:[<0x10000001eb9/article-7.xml v560>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f31:[<0x10000001eb9/article-7.xml v1176>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.928 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.913+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ebf [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-23.xml auth{0=1} v1144 ap=1 s=9560 n(v0 rc2024-08-26T00:07:30.449323+0000 b9560 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec5743b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ebf:[<0x10000001eb9/comment-23.xml v1144>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ebf:[<0x10000001eb9/comment-23.xml v1144>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.928 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.913+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ebe [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-24.xml auth{0=1} v1146 ap=1 s=9959 n(v0 rc2024-08-26T00:07:30.441323+0000 b9959 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec5742b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ebe:[<0x10000001eb9/comment-24.xml v1146>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ebe:[<0x10000001eb9/comment-24.xml v1146>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.928 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.913+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f2e [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-8.xml auth{0=1} v1160 ap=1 s=22778 n(v0 rc2024-08-26T00:06:15.883961+0000 b22778 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec4a50100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f2e:[<0x10000001eb9/article-8.xml v542>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f2e:[<0x10000001eb9/article-8.xml v1160>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.928 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.913+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ece [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-55.xml auth{0=1} v1172 ap=1 s=1752 n(v0 rc2024-08-26T00:06:15.288966+0000 b1752 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ed043c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ece:[<0x10000001eb9/article-55.xml v614>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001ece:[<0x10000001eb9/article-55.xml v1172>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.928 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.914+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ea5 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-47.xml auth{0=1} v1140 ap=1 s=10032 n(v0 rc2024-08-26T00:07:30.306324+0000 b10032 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecbe1c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ea5:[<0x10000001eb9/comment-47.xml v1140>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ea5:[<0x10000001eb9/comment-47.xml v1140>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.928 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.914+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e8b [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-70.xml auth{0=1} v1148 ap=1 s=4463 n(v0 rc2024-08-26T00:07:30.148325+0000 b4463 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec8076100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e8b:[<0x10000001eb9/comment-70.xml v1148>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e8b:[<0x10000001eb9/comment-70.xml v1148>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.928 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.915+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ef8 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-32.xml auth{0=1} v1168 ap=1 s=7634 n(v0 rc2024-08-26T00:06:15.439965+0000 b7634 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec2bad700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ef8:[<0x10000001eb9/article-32.xml v608>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001ef8:[<0x10000001eb9/article-32.xml v1168>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.928 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.915+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f50 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-8.jpg auth{0=1} v1154 ap=1 s=24601 n(v0 rc2024-08-26T00:06:15.985960+0000 b24601 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecd93cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f50:[<0x10000001eb9/picture-8.jpg v582>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f50:[<0x10000001eb9/picture-8.jpg v1154>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.928 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.915+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e8c [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-69.xml auth{0=1} v1146 ap=1 s=7173 n(v0 rc2024-08-26T00:07:30.150325+0000 b7173 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec2bad180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e8c:[<0x10000001eb9/comment-69.xml v1146>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e8c:[<0x10000001eb9/comment-69.xml v1146>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.928 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.915+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e87 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-74.xml auth{0=1} v1152 ap=1 s=6017 n(v0 rc2024-08-26T00:07:30.132326+0000 b6017 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec2babb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e87:[<0x10000001eb9/comment-74.xml v1152>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e87:[<0x10000001eb9/comment-74.xml v1152>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.929 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.918+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003eb2 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-36.xml auth{0=1} v1136 ap=1 s=3944 n(v0 rc2024-08-26T00:07:30.380323+0000 b3944 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec2bab600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003eb2:[<0x10000001eb9/comment-36.xml v1136>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003eb2:[<0x10000001eb9/comment-36.xml v1136>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.929 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.919+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ea6 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-46.xml auth{0=1} v1138 ap=1 s=7042 n(v0 rc2024-08-26T00:07:30.310324+0000 b7042 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec8075b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ea6:[<0x10000001eb9/comment-46.xml v1138>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ea6:[<0x10000001eb9/comment-46.xml v1138>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.929 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.919+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f16 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-21.xml auth{0=1} v1164 ap=1 s=30027 n(v0 rc2024-08-26T00:06:15.829962+0000 b30027 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec2bac680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f16:[<0x10000001eb9/article-21.xml v528>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f16:[<0x10000001eb9/article-21.xml v1164>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.929 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.919+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f23 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-13.xml auth{0=1} v1162 ap=1 s=25639 n(v0 rc2024-08-26T00:06:15.861961+0000 b25639 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec2bab080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f23:[<0x10000001eb9/article-13.xml v610>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f23:[<0x10000001eb9/article-13.xml v1162>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.929 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.920+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001efa [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-30.xml auth{0=1} v1166 ap=1 s=9639 n(v0 rc2024-08-26T00:06:15.484965+0000 b9639 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec2bac100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001efa:[<0x10000001eb9/article-30.xml v640>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001efa:[<0x10000001eb9/article-30.xml v1166>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:32.929 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.920+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ed7 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-50.xml auth{0=1} v1170 ap=1 s=19703 n(v0 rc2024-08-26T00:06:15.313966+0000 b19703 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec3e58c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ed7:[<0x10000001eb9/article-50.xml v634>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001ed7:[<0x10000001eb9/article-50.xml v1170>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:33.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:33.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:33.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:33.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:33.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:33.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:33.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:33.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:33.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.265 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:33.265 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.265 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:33.265 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.265 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:33.265 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.265 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:33.265 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.265 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:33.265 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:33.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:33.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:33.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:33.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:33.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:32 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:33.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:33.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:33.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:33.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:33.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:33.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:33.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:33.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:33.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:33.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:33.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:33.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:33.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:33.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:33.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:33.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:33.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:33.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:33.287 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:32 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:33.294 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.921+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f34 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-6.xml auth{0=1} v1158 ap=1 s=4947 n(v0 rc2024-08-26T00:06:15.897961+0000 b4947 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec3e56000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f34:[<0x10000001eb9/article-6.xml v556>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f34:[<0x10000001eb9/article-6.xml v1158>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.294 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.921+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f3e [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-2.xml auth{0=1} v1156 ap=1 s=1527 n(v0 rc2024-08-26T00:06:15.926961+0000 b1527 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec3e56580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f3e:[<0x10000001eb9/article-2.xml v562>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f3e:[<0x10000001eb9/article-2.xml v1156>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.295 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.921+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e89 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-72.xml auth{0=1} v1150 ap=1 s=8004 n(v0 rc2024-08-26T00:07:30.142325+0000 b8004 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec3e59700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e89:[<0x10000001eb9/comment-72.xml v1150>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e89:[<0x10000001eb9/comment-72.xml v1150>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.295 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.921+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ed7 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-4.xml auth{0=1} v1130 ap=1 s=5522 n(v0 rc2024-08-26T00:07:30.704321+0000 b5522 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec3e58680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ed7:[<0x10000001eb9/comment-4.xml v1130>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ed7:[<0x10000001eb9/comment-4.xml v1130>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.295 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.921+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e91 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-64.xml auth{0=1} v1142 ap=1 s=5890 n(v0 rc2024-08-26T00:07:30.201325+0000 b5890 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec2baab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e91:[<0x10000001eb9/comment-64.xml v1142>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e91:[<0x10000001eb9/comment-64.xml v1142>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.295 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.922+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ec9 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-14.xml auth{0=1} v1132 ap=1 s=8607 n(v0 rc2024-08-26T00:07:30.546322+0000 b8607 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec3e56b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ec9:[<0x10000001eb9/comment-14.xml v1132>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ec9:[<0x10000001eb9/comment-14.xml v1132>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.295 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.922+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e8e [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-67.xml auth{0=1} v1144 ap=1 s=9253 n(v0 rc2024-08-26T00:07:30.183325+0000 b9253 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec3e57600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e8e:[<0x10000001eb9/comment-67.xml v1144>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e8e:[<0x10000001eb9/comment-67.xml v1144>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.295 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.923+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ecc [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-56.xml auth{0=1} v1174 ap=1 s=13538 n(v0 rc2024-08-26T00:06:15.288966+0000 b13538 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec534e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ecc:[<0x10000001eb9/article-56.xml v544>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001ecc:[<0x10000001eb9/article-56.xml v1174>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.295 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.923+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003edb [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-2.xml auth{0=1} v1137 ap=1 s=10212 n(v0 rc2024-08-26T00:07:30.733320+0000 b10212 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec95b4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003edb:[<0x10000001eb9/comment-2.xml v1137>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003edb:[<0x10000001eb9/comment-2.xml v1137>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.295 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.924+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ec0 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-22.xml auth{0=1} v1147 ap=1 s=6399 n(v0 rc2024-08-26T00:07:30.461323+0000 b6399 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec8da1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ec0:[<0x10000001eb9/comment-22.xml v1147>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ec0:[<0x10000001eb9/comment-22.xml v1147>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.295 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.924+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ea8 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-44.xml auth{0=1} v1153 ap=1 s=9066 n(v0 rc2024-08-26T00:07:30.333324+0000 b9066 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558eca046580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ea8:[<0x10000001eb9/comment-44.xml v1153>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ea8:[<0x10000001eb9/comment-44.xml v1153>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.295 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.924+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ec3 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-19.xml auth{0=1} v1134 ap=1 s=9123 n(v0 rc2024-08-26T00:07:30.477323+0000 b9123 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec3e57b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ec3:[<0x10000001eb9/comment-19.xml v1134>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ec3:[<0x10000001eb9/comment-19.xml v1134>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.296 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.925+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ef7 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-33.xml auth{0=1} v1167 ap=1 s=2232 n(v0 rc2024-08-26T00:06:15.418965+0000 b2232 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec708c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ef7:[<0x10000001eb9/article-33.xml v514>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001ef7:[<0x10000001eb9/article-33.xml v1167>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.296 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.925+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f58 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-5.jpg auth{0=1} v1163 ap=1 s=17416 n(v0 rc2024-08-26T00:06:16.004960+0000 b17416 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ececcc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f58:[<0x10000001eb9/picture-5.jpg v648>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f58:[<0x10000001eb9/picture-5.jpg v1163>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.296 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.925+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ebb [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-27.xml auth{0=1} v1149 ap=1 s=8427 n(v0 rc2024-08-26T00:07:30.424323+0000 b8427 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec719b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ebb:[<0x10000001eb9/comment-27.xml v1149>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ebb:[<0x10000001eb9/comment-27.xml v1149>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.296 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.926+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e85 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-76.xml auth{0=1} v1161 ap=1 s=7724 n(v0 rc2024-08-26T00:07:30.112326+0000 b7724 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec92cc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e85:[<0x10000001eb9/comment-76.xml v1161>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e85:[<0x10000001eb9/comment-76.xml v1161>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.296 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.926+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eca [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-57.xml auth{0=1} v1175 ap=1 s=15872 n(v0 rc2024-08-26T00:06:15.287966+0000 b15872 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ece852680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eca:[<0x10000001eb9/article-57.xml v512>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001eca:[<0x10000001eb9/article-57.xml v1175>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.296 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.926+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ede [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-43.xml auth{0=1} v1169 ap=1 s=8161 n(v0 rc2024-08-26T00:06:15.326966+0000 b8161 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec964a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ede:[<0x10000001eb9/article-43.xml v552>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001ede:[<0x10000001eb9/article-43.xml v1169>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.296 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.927+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e8f [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-66.xml auth{0=1} v1159 ap=1 s=2264 n(v0 rc2024-08-26T00:07:30.191325+0000 b2264 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ed0356000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e8f:[<0x10000001eb9/comment-66.xml v1159>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e8f:[<0x10000001eb9/comment-66.xml v1159>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.296 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.928+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ed4 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-7.xml auth{0=1} v1139 ap=1 s=7552 n(v0 rc2024-08-26T00:07:30.671321+0000 b7552 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec7388580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ed4:[<0x10000001eb9/comment-7.xml v1139>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ed4:[<0x10000001eb9/comment-7.xml v1139>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.296 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.928+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ec8 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-58.xml auth{0=1} v1177 ap=1 s=3614 n(v0 rc2024-08-26T00:06:15.282966+0000 b3614 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ed0439700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ec8:[<0x10000001eb9/article-58.xml v520>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001ec8:[<0x10000001eb9/article-58.xml v1177>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.296 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.929+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ea0 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-52.xml auth{0=1} v1157 ap=1 s=7598 n(v0 rc2024-08-26T00:07:30.270324+0000 b7598 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecec83b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ea0:[<0x10000001eb9/comment-52.xml v1157>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ea0:[<0x10000001eb9/comment-52.xml v1157>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.296 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.930+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ea9 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-43.xml auth{0=1} v1151 ap=1 s=7461 n(v0 rc2024-08-26T00:07:30.341324+0000 b7461 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec5848c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ea9:[<0x10000001eb9/comment-43.xml v1151>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ea9:[<0x10000001eb9/comment-43.xml v1151>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.297 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.930+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ec5 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-17.xml auth{0=1} v1145 ap=1 s=2501 n(v0 rc2024-08-26T00:07:30.499322+0000 b2501 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec6b3b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ec5:[<0x10000001eb9/comment-17.xml v1145>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ec5:[<0x10000001eb9/comment-17.xml v1145>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.297 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.931+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001efc [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-28.xml auth{0=1} v1165 ap=1 s=11997 n(v0 rc2024-08-26T00:06:15.725963+0000 b11997 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec3972000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001efc:[<0x10000001eb9/article-28.xml v530>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001efc:[<0x10000001eb9/article-28.xml v1165>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.297 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.931+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ed0 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-9.xml auth{0=1} v1141 ap=1 s=5514 n(v0 rc2024-08-26T00:07:30.639321+0000 b5514 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec964c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ed0:[<0x10000001eb9/comment-9.xml v1141>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ed0:[<0x10000001eb9/comment-9.xml v1141>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.297 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.931+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ec8 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-15.xml auth{0=1} v1143 ap=1 s=7031 n(v0 rc2024-08-26T00:07:30.527322+0000 b7031 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558eccc16b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ec8:[<0x10000001eb9/comment-15.xml v1143>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ec8:[<0x10000001eb9/comment-15.xml v1143>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.297 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.931+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ed2 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-53.xml auth{0=1} v1173 ap=1 s=26472 n(v0 rc2024-08-26T00:06:15.301966+0000 b26472 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec7d90580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ed2:[<0x10000001eb9/article-53.xml v504>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001ed2:[<0x10000001eb9/article-53.xml v1173>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.297 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.931+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ed4 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-52.xml auth{0=1} v1171 ap=1 s=31122 n(v0 rc2024-08-26T00:06:15.307966+0000 b31122 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecc2d4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ed4:[<0x10000001eb9/article-52.xml v516>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001ed4:[<0x10000001eb9/article-52.xml v1171>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.297 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.931+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ea7 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-45.xml auth{0=1} v1155 ap=1 s=9342 n(v0 rc2024-08-26T00:07:30.314324+0000 b9342 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecf735180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ea7:[<0x10000001eb9/comment-45.xml v1155>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ea7:[<0x10000001eb9/comment-45.xml v1155>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.297 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.933+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f5a [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-3.jpg auth{0=1} v1179 ap=1 s=34612 n(v0 rc2024-08-26T00:06:16.011960+0000 b34612 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecd5f6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f5a:[<0x10000001eb9/picture-3.jpg v600>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f5a:[<0x10000001eb9/picture-3.jpg v1179>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.297 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.933+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e9f [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-53.xml auth{0=1} v1167 ap=1 s=3709 n(v0 rc2024-08-26T00:07:30.264324+0000 b3709 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecd5f6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e9f:[<0x10000001eb9/comment-53.xml v1167>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e9f:[<0x10000001eb9/comment-53.xml v1167>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.297 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.934+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ecf [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-10.xml auth{0=1} v1159 ap=1 s=5686 n(v0 rc2024-08-26T00:07:30.632321+0000 b5686 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecd5f6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ecf:[<0x10000001eb9/comment-10.xml v1159>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ecf:[<0x10000001eb9/comment-10.xml v1159>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.297 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.934+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e80 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-81.xml auth{0=1} v1177 ap=1 s=5534 n(v0 rc2024-08-26T00:07:30.081326+0000 b5534 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecf735700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e80:[<0x10000001eb9/comment-81.xml v1177>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e80:[<0x10000001eb9/comment-81.xml v1177>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.298 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.934+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ed5 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-6.xml auth{0=1} v1155 ap=1 s=6324 n(v0 rc2024-08-26T00:07:30.682321+0000 b6324 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecd5f7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ed5:[<0x10000001eb9/comment-6.xml v1155>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ed5:[<0x10000001eb9/comment-6.xml v1155>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.298 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.934+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f48 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-11.jpg auth{0=1} v1181 ap=1 s=21715 n(v0 rc2024-08-26T00:06:15.961961+0000 b21715 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecd5f7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f48:[<0x10000001eb9/picture-11.jpg v570>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f48:[<0x10000001eb9/picture-11.jpg v1181>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.298 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.934+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000025a9 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-70.jpg auth{0=1} v658 ap=1 s=53618 n(v0 rc2024-08-26T00:06:35.625791+0000 b53618 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecd5f7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000025a9:[<0x10000001eb9/picture-70.jpg v658>,<0x20000000219/blog-205 v227678>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x100000025a9:[<0x10000001eb9/picture-70.jpg v658>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.298 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.936+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003eb3 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-35.xml auth{0=1} v1163 ap=1 s=3555 n(v0 rc2024-08-26T00:07:30.383323+0000 b3555 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecd5f8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003eb3:[<0x10000001eb9/comment-35.xml v1163>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003eb3:[<0x10000001eb9/comment-35.xml v1163>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.298 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.936+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003eba [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-28.xml auth{0=1} v1161 ap=1 s=2598 n(v0 rc2024-08-26T00:07:30.419323+0000 b2598 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecd5f9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003eba:[<0x10000001eb9/comment-28.xml v1161>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003eba:[<0x10000001eb9/comment-28.xml v1161>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.298 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.937+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001efb [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-29.xml auth{0=1} v1185 ap=1 s=5656 n(v0 rc2024-08-26T00:06:15.504965+0000 b5656 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecc050000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001efb:[<0x10000001eb9/article-29.xml v522>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001efb:[<0x10000001eb9/article-29.xml v1185>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.298 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.938+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e94 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-61.xml auth{0=1} v1171 ap=1 s=7941 n(v0 rc2024-08-26T00:07:30.215325+0000 b7941 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecc051080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e94:[<0x10000001eb9/comment-61.xml v1171>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e94:[<0x10000001eb9/comment-61.xml v1171>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.298 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.938+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ec4 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-60.xml auth{0=1} v1187 ap=1 s=9623 n(v0 rc2024-08-26T00:06:15.276966+0000 b9623 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecc050580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ec4:[<0x10000001eb9/article-60.xml v632>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001ec4:[<0x10000001eb9/article-60.xml v1187>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.298 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.939+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e98 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-57.xml auth{0=1} v1169 ap=1 s=3456 n(v0 rc2024-08-26T00:07:30.234325+0000 b3456 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecd5f9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e98:[<0x10000001eb9/comment-57.xml v1169>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e98:[<0x10000001eb9/comment-57.xml v1169>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.298 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.939+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f13 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-22.xml auth{0=1} v1183 ap=1 s=17771 n(v0 rc2024-08-26T00:06:15.826962+0000 b17771 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecc051600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f13:[<0x10000001eb9/article-22.xml v564>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f13:[<0x10000001eb9/article-22.xml v1183>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.298 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.939+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e8d [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-68.xml auth{0=1} v1173 ap=1 s=7059 n(v0 rc2024-08-26T00:07:30.162325+0000 b7059 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecc052100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e8d:[<0x10000001eb9/comment-68.xml v1173>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e8d:[<0x10000001eb9/comment-68.xml v1173>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.299 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.940+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003eb0 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-38.xml auth{0=1} v1165 ap=1 s=2749 n(v0 rc2024-08-26T00:07:30.363324+0000 b2749 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecc051b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003eb0:[<0x10000001eb9/comment-38.xml v1165>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003eb0:[<0x10000001eb9/comment-38.xml v1165>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.299 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.940+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ed2 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-8.xml auth{0=1} v1157 ap=1 s=3245 n(v0 rc2024-08-26T00:07:30.645321+0000 b3245 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecc052c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ed2:[<0x10000001eb9/comment-8.xml v1157>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ed2:[<0x10000001eb9/comment-8.xml v1157>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.299 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.942+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f21 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-14.xml auth{0=1} v1172 ap=1 s=10546 n(v0 rc2024-08-26T00:06:15.856961+0000 b10546 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec1ad7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f21:[<0x10000001eb9/article-14.xml v568>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f21:[<0x10000001eb9/article-14.xml v1172>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.299 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.942+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e81 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-80.xml auth{0=1} v1175 ap=1 s=6936 n(v0 rc2024-08-26T00:07:30.086326+0000 b6936 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecc053180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e81:[<0x10000001eb9/comment-80.xml v1175>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e81:[<0x10000001eb9/comment-80.xml v1175>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.299 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.943+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e93 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-62.xml auth{0=1} v1160 ap=1 s=3854 n(v0 rc2024-08-26T00:07:30.211325+0000 b3854 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecc31e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e93:[<0x10000001eb9/comment-62.xml v1160>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e93:[<0x10000001eb9/comment-62.xml v1160>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.299 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.943+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001edb [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-46.xml auth{0=1} v1182 ap=1 s=32175 n(v0 rc2024-08-26T00:06:15.323966+0000 b32175 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecb73fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001edb:[<0x10000001eb9/article-46.xml v550>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001edb:[<0x10000001eb9/article-46.xml v1182>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.299 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.944+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f27 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-11.xml auth{0=1} v1170 ap=1 s=8686 n(v0 rc2024-08-26T00:06:15.870961+0000 b8686 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecfa2ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f27:[<0x10000001eb9/article-11.xml v604>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f27:[<0x10000001eb9/article-11.xml v1170>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.299 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.944+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e96 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-59.xml auth{0=1} v1158 ap=1 s=3857 n(v0 rc2024-08-26T00:07:30.227325+0000 b3857 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ececca580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e96:[<0x10000001eb9/comment-59.xml v1158>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e96:[<0x10000001eb9/comment-59.xml v1158>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.299 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.944+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eda [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-47.xml auth{0=1} v1184 ap=1 s=10339 n(v0 rc2024-08-26T00:06:15.318966+0000 b10339 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec7f4d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eda:[<0x10000001eb9/article-47.xml v518>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001eda:[<0x10000001eb9/article-47.xml v1184>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.299 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.945+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f1c [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-16.xml auth{0=1} v1174 ap=1 s=18853 n(v0 rc2024-08-26T00:06:15.848962+0000 b18853 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecfa2f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f1c:[<0x10000001eb9/article-16.xml v548>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f1c:[<0x10000001eb9/article-16.xml v1174>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.299 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.946+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ed0 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-54.xml auth{0=1} v1188 ap=1 s=32415 n(v0 rc2024-08-26T00:06:15.294966+0000 b32415 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec5c1a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ed0:[<0x10000001eb9/article-54.xml v578>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001ed0:[<0x10000001eb9/article-54.xml v1188>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.300 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.946+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f2a [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-10.xml auth{0=1} v1168 ap=1 s=5448 n(v0 rc2024-08-26T00:06:15.874961+0000 b5448 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec7c6b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f2a:[<0x10000001eb9/article-10.xml v540>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f2a:[<0x10000001eb9/article-10.xml v1168>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.300 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.946+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e84 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-77.xml auth{0=1} v1162 ap=1 s=10216 n(v0 rc2024-08-26T00:07:30.099326+0000 b10216 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec3052b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e84:[<0x10000001eb9/comment-77.xml v1162>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e84:[<0x10000001eb9/comment-77.xml v1162>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.300 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.947+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f01 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-26.xml auth{0=1} v1178 ap=1 s=11871 n(v0 rc2024-08-26T00:06:15.744962+0000 b11871 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec6b39b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f01:[<0x10000001eb9/article-26.xml v510>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f01:[<0x10000001eb9/article-26.xml v1178>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.300 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.947+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f46 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-12.jpg auth{0=1} v1164 ap=1 s=50350 n(v0 rc2024-08-26T00:06:15.951961+0000 b50350 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ececcb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f46:[<0x10000001eb9/picture-12.jpg v622>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f46:[<0x10000001eb9/picture-12.jpg v1164>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.300 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.947+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ea2 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-50.xml auth{0=1} v1156 ap=1 s=4390 n(v0 rc2024-08-26T00:07:30.283324+0000 b4390 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecdc23180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ea2:[<0x10000001eb9/comment-50.xml v1156>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ea2:[<0x10000001eb9/comment-50.xml v1156>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.300 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.950+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ea4 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-48.xml auth{0=1} v1154 ap=1 s=10058 n(v0 rc2024-08-26T00:07:30.300324+0000 b10058 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ece62c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ea4:[<0x10000001eb9/comment-48.xml v1154>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ea4:[<0x10000001eb9/comment-48.xml v1154>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.300 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.950+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ed9 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-48.xml auth{0=1} v1186 ap=1 s=13681 n(v0 rc2024-08-26T00:06:15.318966+0000 b13681 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec695e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ed9:[<0x10000001eb9/article-48.xml v636>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001ed9:[<0x10000001eb9/article-48.xml v1186>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.300 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.952+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f39 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-4.xml auth{0=1} v1166 ap=1 s=26447 n(v0 rc2024-08-26T00:06:15.913961+0000 b26447 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ece993180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f39:[<0x10000001eb9/article-4.xml v616>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f39:[<0x10000001eb9/article-4.xml v1166>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.300 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.953+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ee3 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-38.xml auth{0=1} v1180 ap=1 s=15957 n(v0 rc2024-08-26T00:06:15.356966+0000 b15957 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecbccb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ee3:[<0x10000001eb9/article-38.xml v574>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001ee3:[<0x10000001eb9/article-38.xml v1180>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.301 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.953+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f0b [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-25.xml auth{0=1} v1176 ap=1 s=31328 n(v0 rc2024-08-26T00:06:15.798962+0000 b31328 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ed0093080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f0b:[<0x10000001eb9/article-25.xml v558>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f0b:[<0x10000001eb9/article-25.xml v1176>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.301 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.953+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003eb7 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-31.xml auth{0=1} v1152 ap=1 s=7199 n(v0 rc2024-08-26T00:07:30.398323+0000 b7199 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec6d56680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003eb7:[<0x10000001eb9/comment-31.xml v1152>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003eb7:[<0x10000001eb9/comment-31.xml v1152>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.301 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.953+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000025aa [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-72.xml auth{0=1} v652 ap=1 s=32096 n(v0 rc2024-08-26T00:06:35.631791+0000 b32096 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec5744c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000025aa:[<0x10000001eb9/article-72.xml v652>,<0x20000000219/blog-205 v227678>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x100000025aa:[<0x10000001eb9/article-72.xml v652>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.301 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.953+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eea [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-35.xml auth{0=1} v1147 ap=1 s=25361 n(v0 rc2024-08-26T00:06:15.362966+0000 b25361 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec5745700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eea:[<0x10000001eb9/article-35.xml v508>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001eea:[<0x10000001eb9/article-35.xml v1147>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.301 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.957+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e88 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-73.xml auth{0=1} v1137 ap=1 s=7111 n(v0 rc2024-08-26T00:07:30.138325+0000 b7111 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecaff8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e88:[<0x10000001eb9/comment-73.xml v1137>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e88:[<0x10000001eb9/comment-73.xml v1137>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.301 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.957+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e95 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-60.xml auth{0=1} v1133 ap=1 s=9598 n(v0 rc2024-08-26T00:07:30.219325+0000 b9598 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec2cf8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e95:[<0x10000001eb9/comment-60.xml v1133>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e95:[<0x10000001eb9/comment-60.xml v1133>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.301 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.957+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003edd [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-1.xml auth{0=1} v1121 ap=1 s=2205 n(v0 rc2024-08-26T00:07:30.738320+0000 b2205 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec2cfb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003edd:[<0x10000001eb9/comment-1.xml v1121>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003edd:[<0x10000001eb9/comment-1.xml v1121>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.301 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.957+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ee1 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-40.xml auth{0=1} v1149 ap=1 s=19539 n(v0 rc2024-08-26T00:06:15.332966+0000 b19539 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec2cf8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ee1:[<0x10000001eb9/article-40.xml v500>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001ee1:[<0x10000001eb9/article-40.xml v1149>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.301 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.957+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e83 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-78.xml auth{0=1} v1139 ap=1 s=7737 n(v0 rc2024-08-26T00:07:30.096326+0000 b7737 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec2cfac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e83:[<0x10000001eb9/comment-78.xml v1139>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e83:[<0x10000001eb9/comment-78.xml v1139>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.301 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.957+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000327a [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-82.xml auth{0=1} v672 ap=1 s=13561 n(v0 rc2024-08-26T00:07:01.499569+0000 b13561 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec2cfa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000327a:[<0x10000001eb9/article-82.xml v672>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3041>,<0x10000000201/src v1679>,<0x10000000006/blogbench-1.0 v1550>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v135>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v145>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v151>,<0x1/volumes v158>]//[]","memoryvalue":"(3)0x1000000327a:[<0x10000001eb9/article-82.xml v672>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.301 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.959+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003eb5 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-33.xml auth{0=1} v1125 ap=1 s=9124 n(v0 rc2024-08-26T00:07:30.390323+0000 b9124 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec5f49600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003eb5:[<0x10000001eb9/comment-33.xml v1125>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003eb5:[<0x10000001eb9/comment-33.xml v1125>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.301 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.959+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f1f [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-15.xml auth{0=1} v1143 ap=1 s=2861 n(v0 rc2024-08-26T00:06:15.851962+0000 b2861 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec5f4a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f1f:[<0x10000001eb9/article-15.xml v628>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f1f:[<0x10000001eb9/article-15.xml v1143>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.302 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.960+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e82 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-79.xml auth{0=1} v1141 ap=1 s=6405 n(v0 rc2024-08-26T00:07:30.090326+0000 b6405 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec5f49b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e82:[<0x10000001eb9/comment-79.xml v1141>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e82:[<0x10000001eb9/comment-79.xml v1141>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.302 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.961+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003eae [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-40.xml auth{0=1} v1129 ap=1 s=6894 n(v0 rc2024-08-26T00:07:30.357324+0000 b6894 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec5f49080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003eae:[<0x10000001eb9/comment-40.xml v1129>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003eae:[<0x10000001eb9/comment-40.xml v1129>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.302 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.961+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003eaf [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-39.xml auth{0=1} v1127 ap=1 s=5705 n(v0 rc2024-08-26T00:07:30.360324+0000 b5705 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec6378b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003eaf:[<0x10000001eb9/comment-39.xml v1127>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003eaf:[<0x10000001eb9/comment-39.xml v1127>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.302 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.961+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003eb6 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-32.xml auth{0=1} v1123 ap=1 s=3663 n(v0 rc2024-08-26T00:07:30.392323+0000 b3663 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec1dc0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003eb6:[<0x10000001eb9/comment-32.xml v1123>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003eb6:[<0x10000001eb9/comment-32.xml v1123>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.302 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.962+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e92 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-63.xml auth{0=1} v1135 ap=1 s=6521 n(v0 rc2024-08-26T00:07:30.209325+0000 b6521 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec1dc3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e92:[<0x10000001eb9/comment-63.xml v1135>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e92:[<0x10000001eb9/comment-63.xml v1135>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.302 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.962+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001edf [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-42.xml auth{0=1} v1151 ap=1 s=16277 n(v0 rc2024-08-26T00:06:15.332966+0000 b16277 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec1dc0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001edf:[<0x10000001eb9/article-42.xml v594>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001edf:[<0x10000001eb9/article-42.xml v1151>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.302 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.962+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e9c [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-54.xml auth{0=1} v1131 ap=1 s=6081 n(v0 rc2024-08-26T00:07:30.255324+0000 b6081 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec1dc2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e9c:[<0x10000001eb9/comment-54.xml v1131>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e9c:[<0x10000001eb9/comment-54.xml v1131>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.302 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.962+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ebc [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-64.xml auth{0=1} v1156 ap=1 s=6535 n(v0 rc2024-08-26T00:06:15.258967+0000 b6535 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec7d97700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ebc:[<0x10000001eb9/article-64.xml v502>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001ebc:[<0x10000001eb9/article-64.xml v1156>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.302 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.962+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f18 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-19.xml auth{0=1} v1145 ap=1 s=25697 n(v0 rc2024-08-26T00:06:15.834962+0000 b25697 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec6378580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f18:[<0x10000001eb9/article-19.xml v602>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f18:[<0x10000001eb9/article-19.xml v1145>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.302 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.963+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003eca [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-13.xml auth{0=1} v1122 ap=1 s=9768 n(v0 rc2024-08-26T00:07:30.551322+0000 b9768 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558eca047600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003eca:[<0x10000001eb9/comment-13.xml v1122>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003eca:[<0x10000001eb9/comment-13.xml v1122>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.302 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.965+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ee7 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-37.xml auth{0=1} v1150 ap=1 s=9751 n(v0 rc2024-08-26T00:06:15.361966+0000 b9751 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec5846b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ee7:[<0x10000001eb9/article-37.xml v554>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001ee7:[<0x10000001eb9/article-37.xml v1150>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.303 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.965+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ec1 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-21.xml auth{0=1} v1126 ap=1 s=7719 n(v0 rc2024-08-26T00:07:30.465323+0000 b7719 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558eceff2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ec1:[<0x10000001eb9/comment-21.xml v1126>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ec1:[<0x10000001eb9/comment-21.xml v1126>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.303 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.965+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ebc [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-26.xml auth{0=1} v1128 ap=1 s=3231 n(v0 rc2024-08-26T00:07:30.428323+0000 b3231 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec7f4c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ebc:[<0x10000001eb9/comment-26.xml v1128>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ebc:[<0x10000001eb9/comment-26.xml v1128>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.303 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.965+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ee8 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-36.xml auth{0=1} v1148 ap=1 s=8282 n(v0 rc2024-08-26T00:06:15.362966+0000 b8282 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558eca157700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ee8:[<0x10000001eb9/article-36.xml v536>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001ee8:[<0x10000001eb9/article-36.xml v1148>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.303 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.966+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ee2 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-39.xml auth{0=1} v1152 ap=1 s=4986 n(v0 rc2024-08-26T00:06:15.338966+0000 b4986 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec7389600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ee2:[<0x10000001eb9/article-39.xml v638>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001ee2:[<0x10000001eb9/article-39.xml v1152>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.303 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.967+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003eb8 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-30.xml auth{0=1} v1130 ap=1 s=4160 n(v0 rc2024-08-26T00:07:30.400323+0000 b4160 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec51e5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003eb8:[<0x10000001eb9/comment-30.xml v1130>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003eb8:[<0x10000001eb9/comment-30.xml v1130>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.303 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.967+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f41 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-1.xml auth{0=1} v1140 ap=1 s=21888 n(v0 rc2024-08-26T00:06:15.936961+0000 b21888 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecf425080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f41:[<0x10000001eb9/article-1.xml v618>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f41:[<0x10000001eb9/article-1.xml v1140>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.303 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.968+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f25 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-12.xml auth{0=1} v1142 ap=1 s=10925 n(v0 rc2024-08-26T00:06:15.863961+0000 b10925 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec964d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f25:[<0x10000001eb9/article-12.xml v612>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f25:[<0x10000001eb9/article-12.xml v1142>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.303 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.968+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ed9 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-3.xml auth{0=1} v1118 ap=1 s=3968 n(v0 rc2024-08-26T00:07:30.723320+0000 b3968 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec5c19080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ed9:[<0x10000001eb9/comment-3.xml v1118>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ed9:[<0x10000001eb9/comment-3.xml v1118>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.303 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.969+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003eab [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-42.xml auth{0=1} v1132 ap=1 s=8873 n(v0 rc2024-08-26T00:07:30.347324+0000 b8873 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec5847600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003eab:[<0x10000001eb9/comment-42.xml v1132>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003eab:[<0x10000001eb9/comment-42.xml v1132>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.303 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.970+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ec4 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-18.xml auth{0=1} v1124 ap=1 s=9287 n(v0 rc2024-08-26T00:07:30.482323+0000 b9287 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558eccc16000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ec4:[<0x10000001eb9/comment-18.xml v1124>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ec4:[<0x10000001eb9/comment-18.xml v1124>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.303 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.970+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ecd [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-12.xml auth{0=1} v1120 ap=1 s=9669 n(v0 rc2024-08-26T00:07:30.621321+0000 b9669 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558eccc17600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ecd:[<0x10000001eb9/comment-12.xml v1120>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ecd:[<0x10000001eb9/comment-12.xml v1120>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.304 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.970+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ea3 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-49.xml auth{0=1} v1134 ap=1 s=9914 n(v0 rc2024-08-26T00:07:30.291324+0000 b9914 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec8ecf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ea3:[<0x10000001eb9/comment-49.xml v1134>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ea3:[<0x10000001eb9/comment-49.xml v1134>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.304 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.970+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003e90 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-65.xml auth{0=1} v1138 ap=1 s=9013 n(v0 rc2024-08-26T00:07:30.196325+0000 b9013 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec72c6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003e90:[<0x10000001eb9/comment-65.xml v1138>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003e90:[<0x10000001eb9/comment-65.xml v1138>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.304 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.972+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f1a [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-17.xml auth{0=1} v1144 ap=1 s=13090 n(v0 rc2024-08-26T00:06:15.840962+0000 b13090 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ececcbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f1a:[<0x10000001eb9/article-17.xml v642>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f1a:[<0x10000001eb9/article-17.xml v1144>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.304 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.973+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ebe [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-63.xml auth{0=1} v1154 ap=1 s=27143 n(v0 rc2024-08-26T00:06:15.264967+0000 b27143 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec7c6a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ebe:[<0x10000001eb9/article-63.xml v534>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001ebe:[<0x10000001eb9/article-63.xml v1154>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.304 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.973+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ea1 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-51.xml auth{0=1} v1136 ap=1 s=8891 n(v0 rc2024-08-26T00:07:30.273324+0000 b8891 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec95b5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ea1:[<0x10000001eb9/comment-51.xml v1136>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ea1:[<0x10000001eb9/comment-51.xml v1136>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.304 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:32.976+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f10 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-23.xml auth{0=1} v1146 ap=1 s=25585 n(v0 rc2024-08-26T00:06:15.815962+0000 b25585 1=1+0) caps={25040=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec8da2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f10:[<0x10000001eb9/article-23.xml v626>,<0x20000000219/blog-205 v227037>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1661>,<0x10000000006/blogbench-1.0 v1532>,<0x10000000005/tmp v129>,<0x100000001fb/client.0 v126>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v139>,<0x10000000001/sv_1 v158>,<0x10000000000/qa v143>,<0x1/volumes v149>]//[]","memoryvalue":"(3)0x10000001f10:[<0x10000001eb9/article-23.xml v1146>,<0x20000000219/blog-205 v232493>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.304 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.029+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f11 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-18.xml auth{0=1} v577 ap=1 s=23912 n(v0 rc2024-08-26T00:07:31.214316+0000 b23912 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecf432000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f11:[<0x10000003ee4/article-18.xml v577>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f11:[<0x10000003ee4/article-18.xml v577>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.304 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.030+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f05 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-27.xml auth{0=1} v595 ap=1 s=13248 n(v0 rc2024-08-26T00:07:31.139317+0000 b13248 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecf432b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f05:[<0x10000003ee4/article-27.xml v595>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f05:[<0x10000003ee4/article-27.xml v595>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.305 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.030+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003eec [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-51.xml auth{0=1} v639 ap=1 s=15484 n(v0 rc2024-08-26T00:07:30.951319+0000 b15484 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecf432580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003eec:[<0x10000003ee4/article-51.xml v639>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003eec:[<0x10000003ee4/article-51.xml v639>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.305 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.031+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f24 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/picture-2.jpg auth{0=1} v541 ap=1 s=58654 n(v0 rc2024-08-26T00:07:31.306316+0000 b58654 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecf433080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f24:[<0x10000003ee4/picture-2.jpg v541>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f24:[<0x10000003ee4/picture-2.jpg v541>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.305 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.031+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f0d [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-20.xml auth{0=1} v581 ap=1 s=24787 n(v0 rc2024-08-26T00:07:31.202316+0000 b24787 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecf433600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f0d:[<0x10000003ee4/article-20.xml v581>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f0d:[<0x10000003ee4/article-20.xml v581>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.305 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.031+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ef6 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-41.xml auth{0=1} v619 ap=1 s=17983 n(v0 rc2024-08-26T00:07:31.033318+0000 b17983 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecf433b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ef6:[<0x10000003ee4/article-41.xml v619>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ef6:[<0x10000003ee4/article-41.xml v619>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.305 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.032+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f00 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-31.xml auth{0=1} v603 ap=1 s=23149 n(v0 rc2024-08-26T00:07:31.093317+0000 b23149 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecf434680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f00:[<0x10000003ee4/article-31.xml v603>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f00:[<0x10000003ee4/article-31.xml v603>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.305 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.032+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ef2 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-45.xml auth{0=1} v627 ap=1 s=30466 n(v0 rc2024-08-26T00:07:31.011318+0000 b30466 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecf434100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ef2:[<0x10000003ee4/article-45.xml v627>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ef2:[<0x10000003ee4/article-45.xml v627>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.305 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.033+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f09 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-24.xml auth{0=1} v589 ap=1 s=15400 n(v0 rc2024-08-26T00:07:31.178317+0000 b15400 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec8642000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f09:[<0x10000003ee4/article-24.xml v589>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f09:[<0x10000003ee4/article-24.xml v589>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.305 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.033+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f1a [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-9.xml auth{0=1} v561 ap=1 s=10604 n(v0 rc2024-08-26T00:07:31.260316+0000 b10604 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecf435180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f1a:[<0x10000003ee4/article-9.xml v561>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f1a:[<0x10000003ee4/article-9.xml v561>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.306 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.034+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f20 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-3.xml auth{0=1} v549 ap=1 s=6251 n(v0 rc2024-08-26T00:07:31.293316+0000 b6251 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec8642b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f20:[<0x10000003ee4/article-3.xml v549>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f20:[<0x10000003ee4/article-3.xml v549>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.306 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.034+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ee8 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-55.xml auth{0=1} v647 ap=1 s=32225 n(v0 rc2024-08-26T00:07:30.932319+0000 b32225 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec8643600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ee8:[<0x10000003ee4/article-55.xml v647>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ee8:[<0x10000003ee4/article-55.xml v647>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.310 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.037+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f1c [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-7.xml auth{0=1} v557 ap=1 s=24665 n(v0 rc2024-08-26T00:07:31.273316+0000 b24665 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec8643080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f1c:[<0x10000003ee4/article-7.xml v557>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f1c:[<0x10000003ee4/article-7.xml v557>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.311 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.037+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ef3 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-44.xml auth{0=1} v625 ap=1 s=15949 n(v0 rc2024-08-26T00:07:31.020318+0000 b15949 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecf435700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ef3:[<0x10000003ee4/article-44.xml v625>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ef3:[<0x10000003ee4/article-44.xml v625>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.311 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.037+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003efe [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-33.xml auth{0=1} v605 ap=1 s=13755 n(v0 rc2024-08-26T00:07:31.071318+0000 b13755 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecb97db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003efe:[<0x10000003ee4/article-33.xml v605>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003efe:[<0x10000003ee4/article-33.xml v605>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.311 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.038+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ef4 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-43.xml auth{0=1} v623 ap=1 s=6805 n(v0 rc2024-08-26T00:07:31.026318+0000 b6805 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecb97d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ef4:[<0x10000003ee4/article-43.xml v623>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ef4:[<0x10000003ee4/article-43.xml v623>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.311 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.038+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ee7 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-56.xml auth{0=1} v649 ap=1 s=26824 n(v0 rc2024-08-26T00:07:30.921319+0000 b26824 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecb97d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ee7:[<0x10000003ee4/article-56.xml v649>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ee7:[<0x10000003ee4/article-56.xml v649>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.312 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.039+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f21 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-2.xml auth{0=1} v547 ap=1 s=30646 n(v0 rc2024-08-26T00:07:31.296316+0000 b30646 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecb97cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f21:[<0x10000003ee4/article-2.xml v547>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f21:[<0x10000003ee4/article-2.xml v547>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.312 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.039+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f25 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/picture-1.jpg auth{0=1} v539 ap=1 s=23430 n(v0 rc2024-08-26T00:07:31.317315+0000 b23430 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecf434c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f25:[<0x10000003ee4/picture-1.jpg v539>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f25:[<0x10000003ee4/picture-1.jpg v539>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.312 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.039+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f1d [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-6.xml auth{0=1} v555 ap=1 s=18453 n(v0 rc2024-08-26T00:07:31.276316+0000 b18453 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecb97c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f1d:[<0x10000003ee4/article-6.xml v555>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f1d:[<0x10000003ee4/article-6.xml v555>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.312 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.039+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003eed [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-50.xml auth{0=1} v637 ap=1 s=29581 n(v0 rc2024-08-26T00:07:30.970318+0000 b29581 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecb97c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003eed:[<0x10000003ee4/article-50.xml v637>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003eed:[<0x10000003ee4/article-50.xml v637>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.312 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.040+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ee6 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-57.xml auth{0=1} v651 ap=1 s=21012 n(v0 rc2024-08-26T00:07:30.911319+0000 b21012 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecb97e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ee6:[<0x10000003ee4/article-57.xml v651>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ee6:[<0x10000003ee4/article-57.xml v651>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.313 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.040+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f02 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-30.xml auth{0=1} v601 ap=1 s=12654 n(v0 rc2024-08-26T00:07:31.102317+0000 b12654 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec8645180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f02:[<0x10000003ee4/article-30.xml v601>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f02:[<0x10000003ee4/article-30.xml v601>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.313 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.040+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ee5 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-58.xml auth{0=1} v653 ap=1 s=5372 n(v0 rc2024-08-26T00:07:30.906319+0000 b5372 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecb97e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ee5:[<0x10000003ee4/article-58.xml v653>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ee5:[<0x10000003ee4/article-58.xml v653>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.313 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.041+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f0c [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-21.xml auth{0=1} v583 ap=1 s=27919 n(v0 rc2024-08-26T00:07:31.195316+0000 b27919 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec8644c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f0c:[<0x10000003ee4/article-21.xml v583>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f0c:[<0x10000003ee4/article-21.xml v583>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.313 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.041+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f16 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-13.xml auth{0=1} v569 ap=1 s=10509 n(v0 rc2024-08-26T00:07:31.232316+0000 b10509 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec8645700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f16:[<0x10000003ee4/article-13.xml v569>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f16:[<0x10000003ee4/article-13.xml v569>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.314 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.042+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f1b [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-8.xml auth{0=1} v559 ap=1 s=22318 n(v0 rc2024-08-26T00:07:31.266316+0000 b22318 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec8643b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f1b:[<0x10000003ee4/article-8.xml v559>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f1b:[<0x10000003ee4/article-8.xml v559>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.314 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.042+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003eea [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-53.xml auth{0=1} v643 ap=1 s=20356 n(v0 rc2024-08-26T00:07:30.938319+0000 b20356 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecb97ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003eea:[<0x10000003ee4/article-53.xml v643>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003eea:[<0x10000003ee4/article-53.xml v643>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.314 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.042+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003eeb [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-52.xml auth{0=1} v641 ap=1 s=14505 n(v0 rc2024-08-26T00:07:30.945319+0000 b14505 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecb97f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003eeb:[<0x10000003ee4/article-52.xml v641>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003eeb:[<0x10000003ee4/article-52.xml v641>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.315 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.042+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f23 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/picture-3.jpg auth{0=1} v543 ap=1 s=53912 n(v0 rc2024-08-26T00:07:31.304316+0000 b53912 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558eceac4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f23:[<0x10000003ee4/picture-3.jpg v543>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f23:[<0x10000003ee4/picture-3.jpg v543>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.315 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.042+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f04 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-28.xml auth{0=1} v597 ap=1 s=4390 n(v0 rc2024-08-26T00:07:31.122317+0000 b4390 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecb97f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f04:[<0x10000003ee4/article-28.xml v597>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f04:[<0x10000003ee4/article-28.xml v597>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.315 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.042+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f1e [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-5.xml auth{0=1} v553 ap=1 s=14852 n(v0 rc2024-08-26T00:07:31.280316+0000 b14852 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558eceac4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f1e:[<0x10000003ee4/article-5.xml v553>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f1e:[<0x10000003ee4/article-5.xml v553>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.315 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.044+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f03 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-29.xml auth{0=1} v599 ap=1 s=10475 n(v0 rc2024-08-26T00:07:31.114317+0000 b10475 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558eceac5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f03:[<0x10000003ee4/article-29.xml v599>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f03:[<0x10000003ee4/article-29.xml v599>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.315 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.044+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f15 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-14.xml auth{0=1} v571 ap=1 s=32193 n(v0 rc2024-08-26T00:07:31.228316+0000 b32193 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558eceac6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f15:[<0x10000003ee4/article-14.xml v571>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f15:[<0x10000003ee4/article-14.xml v571>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.316 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.044+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f0b [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-22.xml auth{0=1} v585 ap=1 s=29089 n(v0 rc2024-08-26T00:07:31.192317+0000 b29089 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558eceac5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f0b:[<0x10000003ee4/article-22.xml v585>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f0b:[<0x10000003ee4/article-22.xml v585>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.316 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.046+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f13 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-16.xml auth{0=1} v575 ap=1 s=19257 n(v0 rc2024-08-26T00:07:31.222316+0000 b19257 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558eceac7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f13:[<0x10000003ee4/article-16.xml v575>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f13:[<0x10000003ee4/article-16.xml v575>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.316 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.046+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f18 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-11.xml auth{0=1} v565 ap=1 s=8798 n(v0 rc2024-08-26T00:07:31.252316+0000 b8798 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558eceac7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f18:[<0x10000003ee4/article-11.xml v565>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f18:[<0x10000003ee4/article-11.xml v565>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.316 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.047+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003eee [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-49.xml auth{0=1} v635 ap=1 s=13655 n(v0 rc2024-08-26T00:07:30.979318+0000 b13655 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558eceac5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003eee:[<0x10000003ee4/article-49.xml v635>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003eee:[<0x10000003ee4/article-49.xml v635>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.316 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.047+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ef1 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-46.xml auth{0=1} v629 ap=1 s=20259 n(v0 rc2024-08-26T00:07:30.999318+0000 b20259 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558eceac6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ef1:[<0x10000003ee4/article-46.xml v629>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ef1:[<0x10000003ee4/article-46.xml v629>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.317 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.047+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ef0 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-47.xml auth{0=1} v631 ap=1 s=26953 n(v0 rc2024-08-26T00:07:30.992318+0000 b26953 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558eceac6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ef0:[<0x10000003ee4/article-47.xml v631>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ef0:[<0x10000003ee4/article-47.xml v631>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.317 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.048+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003eef [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-48.xml auth{0=1} v633 ap=1 s=27153 n(v0 rc2024-08-26T00:07:30.984318+0000 b27153 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecba37080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003eef:[<0x10000003ee4/article-48.xml v633>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003eef:[<0x10000003ee4/article-48.xml v633>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.317 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.048+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003efc [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-35.xml auth{0=1} v607 ap=1 s=26665 n(v0 rc2024-08-26T00:07:31.063318+0000 b26665 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecba38680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003efc:[<0x10000003ee4/article-35.xml v607>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003efc:[<0x10000003ee4/article-35.xml v607>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.317 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.049+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f1f [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-4.xml auth{0=1} v551 ap=1 s=26576 n(v0 rc2024-08-26T00:07:31.287316+0000 b26576 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecba37600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f1f:[<0x10000003ee4/article-4.xml v551>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f1f:[<0x10000003ee4/article-4.xml v551>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.317 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.049+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f10 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-19.xml auth{0=1} v579 ap=1 s=8812 n(v0 rc2024-08-26T00:07:31.208316+0000 b8812 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecba39700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f10:[<0x10000003ee4/article-19.xml v579>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f10:[<0x10000003ee4/article-19.xml v579>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.318 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.049+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f08 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-25.xml auth{0=1} v591 ap=1 s=15502 n(v0 rc2024-08-26T00:07:31.174317+0000 b15502 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecba37b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f08:[<0x10000003ee4/article-25.xml v591>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f08:[<0x10000003ee4/article-25.xml v591>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.318 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.050+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ef9 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-38.xml auth{0=1} v613 ap=1 s=29504 n(v0 rc2024-08-26T00:07:31.048318+0000 b29504 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecba38100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ef9:[<0x10000003ee4/article-38.xml v613>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ef9:[<0x10000003ee4/article-38.xml v613>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.318 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.050+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f19 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-10.xml auth{0=1} v563 ap=1 s=31448 n(v0 rc2024-08-26T00:07:31.257316+0000 b31448 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecba36b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f19:[<0x10000003ee4/article-10.xml v563>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f19:[<0x10000003ee4/article-10.xml v563>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.318 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.050+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ef7 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-40.xml auth{0=1} v617 ap=1 s=30450 n(v0 rc2024-08-26T00:07:31.038318+0000 b30450 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecba38c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ef7:[<0x10000003ee4/article-40.xml v617>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ef7:[<0x10000003ee4/article-40.xml v617>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.318 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.050+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ef5 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-42.xml auth{0=1} v621 ap=1 s=22936 n(v0 rc2024-08-26T00:07:31.029318+0000 b22936 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ece4c9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ef5:[<0x10000003ee4/article-42.xml v621>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ef5:[<0x10000003ee4/article-42.xml v621>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.319 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.050+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f07 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-26.xml auth{0=1} v593 ap=1 s=2026 n(v0 rc2024-08-26T00:07:31.171317+0000 b2026 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecba36580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f07:[<0x10000003ee4/article-26.xml v593>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f07:[<0x10000003ee4/article-26.xml v593>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.319 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.051+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f14 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-15.xml auth{0=1} v573 ap=1 s=8195 n(v0 rc2024-08-26T00:07:31.225316+0000 b8195 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecba39180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f14:[<0x10000003ee4/article-15.xml v573>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f14:[<0x10000003ee4/article-15.xml v573>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.319 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.051+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003efb [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-36.xml auth{0=1} v609 ap=1 s=18740 n(v0 rc2024-08-26T00:07:31.057318+0000 b18740 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ece4ca100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003efb:[<0x10000003ee4/article-36.xml v609>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003efb:[<0x10000003ee4/article-36.xml v609>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.319 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.052+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003efa [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-37.xml auth{0=1} v611 ap=1 s=28263 n(v0 rc2024-08-26T00:07:31.054318+0000 b28263 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ece4c9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003efa:[<0x10000003ee4/article-37.xml v611>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003efa:[<0x10000003ee4/article-37.xml v611>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.320 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.052+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f22 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-1.xml auth{0=1} v545 ap=1 s=31049 n(v0 rc2024-08-26T00:07:31.300316+0000 b31049 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ece4cac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f22:[<0x10000003ee4/article-1.xml v545>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f22:[<0x10000003ee4/article-1.xml v545>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.320 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.053+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ef8 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-39.xml auth{0=1} v615 ap=1 s=13652 n(v0 rc2024-08-26T00:07:31.045318+0000 b13652 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ece4c9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ef8:[<0x10000003ee4/article-39.xml v615>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ef8:[<0x10000003ee4/article-39.xml v615>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.320 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.053+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ee9 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-54.xml auth{0=1} v645 ap=1 s=14531 n(v0 rc2024-08-26T00:07:30.936319+0000 b14531 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecba36000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ee9:[<0x10000003ee4/article-54.xml v645>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003ee9:[<0x10000003ee4/article-54.xml v645>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.320 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.053+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f0a [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-23.xml auth{0=1} v587 ap=1 s=26027 n(v0 rc2024-08-26T00:07:31.189317+0000 b26027 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ece4cb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f0a:[<0x10000003ee4/article-23.xml v587>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f0a:[<0x10000003ee4/article-23.xml v587>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:33.320 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.053+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003f17 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-12.xml auth{0=1} v567 ap=1 s=10733 n(v0 rc2024-08-26T00:07:31.239316+0000 b10733 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ece4ca680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003f17:[<0x10000003ee4/article-12.xml v567>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3401>,<0x10000000201/src v1699>,<0x10000000006/blogbench-1.0 v1571>,<0x10000000005/tmp v157>,<0x100000001fb/client.0 v156>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v167>,<0x10000000001/sv_1 v188>,<0x10000000000/qa v173>,<0x1/volumes v184>]//[]","memoryvalue":"(3)0x10000003f17:[<0x10000003ee4/article-12.xml v567>,<0x20000000219/blog-364 v222962>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1701>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.248 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: pgmap v640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 2.69k op/s 2024-08-26T00:12:34.248 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:34.249 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.249 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:34.249 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.249 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:34.249 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001ec2 (~mds2/stray3/10000001ec2) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.249 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001edc (~mds2/stray4/10000001edc) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.249 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001ee0 (~mds2/stray4/10000001ee0) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.249 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f53 (~mds2/stray4/10000001f53) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.249 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.249 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:34.249 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f4d (~mds2/stray4/10000001f4d) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.250 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ece (~mds2/stray4/10000003ece) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.250 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ec2 (~mds2/stray4/10000003ec2) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.250 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003eb1 (~mds2/stray4/10000003eb1) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.250 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001ef9 (~mds2/stray4/10000001ef9) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.250 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e8a (~mds2/stray4/10000003e8a) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.250 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.250 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:34.250 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f4b (~mds2/stray4/10000001f4b) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.250 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f5c (~mds2/stray4/10000001f5c) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.250 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f56 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.250 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000002667 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-65.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.251 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f2c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-9.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.251 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ec6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-16.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.251 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000027df (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-44.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.251 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e97 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-58.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.251 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001ec0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-62.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.251 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.251 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:34.251 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f0d (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-24.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.251 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e9a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-55.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.251 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003eac (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-41.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.251 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003832 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-67.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.251 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003eb4 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-34.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.251 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ebd (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-25.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.252 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e86 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-75.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.252 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f3c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-3.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.252 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.252 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:34.252 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f31 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-7.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.252 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ebf (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-23.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.252 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ebe (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-24.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.252 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f2e (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-8.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.252 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001ece (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-55.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.252 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ea5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-47.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.252 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e8b (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-70.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.252 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001ef8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-32.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.253 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f50 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.253 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e8c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-69.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.253 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e87 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-74.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.253 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003eb2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-36.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.253 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ea6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-46.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.253 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f16 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-21.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.253 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f23 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-13.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.253 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001efa (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-30.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.253 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001ed7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-50.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.253 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f34 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-6.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.253 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f3e (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-2.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.253 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e89 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-72.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.253 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ed7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-4.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.253 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e91 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-64.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.254 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.254 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:34.254 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ec9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-14.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.254 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.254 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:34.254 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e8e (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-67.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.254 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001ecc (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-56.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.254 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003edb (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-2.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.254 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ec0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-22.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.254 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ea8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-44.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.254 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ec3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-19.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.254 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001ef7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-33.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.254 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f58 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.254 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ebb (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-27.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.255 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e85 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-76.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.255 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001eca (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-57.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.255 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001ede (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-43.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.255 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e8f (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-66.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.255 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ed4 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-7.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.255 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001ec8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-58.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.255 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ea0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-52.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.255 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ea9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-43.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.255 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ec5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-17.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.255 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001efc (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-28.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.255 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ed0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-9.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.255 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ec8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-15.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.255 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001ed2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-53.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.255 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001ed4 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-52.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.256 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ea7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-45.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.256 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.256 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:34.256 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f5a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.256 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e9f (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-53.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.256 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ecf (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-10.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.256 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e80 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-81.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.256 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ed5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-6.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.257 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f48 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.258 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000025a9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-70.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.258 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003eb3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-35.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.258 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003eba (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-28.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.258 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001efb (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-29.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.258 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e94 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-61.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.258 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001ec4 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-60.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.258 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e98 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-57.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.258 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f13 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-22.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.258 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e8d (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-68.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.258 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003eb0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-38.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.259 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ed2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-8.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.259 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f21 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-14.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.259 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e81 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-80.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.259 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e93 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-62.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.259 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001edb (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-46.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.259 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f27 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-11.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.259 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e96 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-59.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.259 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001eda (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-47.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.259 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f1c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-16.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.259 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001ed0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-54.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.259 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f2a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-10.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.259 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e84 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-77.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.260 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f01 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-26.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.260 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f46 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.260 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ea2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-50.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.260 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ea4 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-48.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.260 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001ed9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-48.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.260 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.260 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:34.260 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f39 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-4.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.260 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001ee3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-38.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.260 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f0b (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-25.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.260 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003eb7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-31.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.261 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000025aa (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-72.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.261 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001eea (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-35.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.261 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.261 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:34.261 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e88 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-73.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.261 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e95 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-60.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.261 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003edd (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-1.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.261 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001ee1 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-40.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.261 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e83 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-78.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.261 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x1000000327a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-82.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.262 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003eb5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-33.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.262 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f1f (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-15.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.262 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e82 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-79.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.262 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003eae (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-40.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.262 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003eaf (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-39.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.262 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003eb6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-32.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.262 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e92 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-63.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.263 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001edf (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-42.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.263 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e9c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-54.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.263 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001ebc (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-64.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.263 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f18 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-19.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.263 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003eca (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-13.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.263 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001ee7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-37.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.263 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ec1 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-21.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.263 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ebc (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-26.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.263 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001ee8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-36.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.263 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001ee2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-39.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.263 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003eb8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-30.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.263 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f41 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-1.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.263 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f25 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-12.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.264 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ed9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-3.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.264 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003eab (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-42.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.264 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ec4 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-18.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.264 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ecd (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-12.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.264 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ea3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-49.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.264 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003e90 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-65.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.264 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f1a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-17.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.264 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001ebe (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-63.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.264 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ea1 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-51.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.264 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000001f10 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-23.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.264 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.264 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:34.264 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f11 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-18.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.265 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.265 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:34.265 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f05 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-27.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.265 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003eec (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-51.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.265 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f24 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.265 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f0d (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-20.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.265 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ef6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-41.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.265 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f00 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-31.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.265 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ef2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-45.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.265 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f09 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-24.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.265 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f1a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-9.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.266 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f20 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-3.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.266 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ee8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-55.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.266 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f1c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-7.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.266 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ef3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-44.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.266 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003efe (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-33.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.266 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ef4 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-43.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.266 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ee7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-56.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.266 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f21 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-2.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.266 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f25 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.266 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f1d (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-6.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.266 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003eed (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-50.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.266 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ee6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-57.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.266 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f02 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-30.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.267 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ee5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-58.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.267 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f0c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-21.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.267 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f16 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-13.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.267 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f1b (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-8.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.267 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003eea (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-53.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.267 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003eeb (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-52.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.267 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f23 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.267 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f04 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-28.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.267 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f1e (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-5.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.267 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f03 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-29.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.267 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f15 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-14.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.267 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f0b (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-22.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.267 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f13 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-16.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.267 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f18 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-11.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.268 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003eee (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-49.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.268 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ef1 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-46.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.268 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ef0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-47.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.268 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003eef (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-48.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.268 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003efc (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-35.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.268 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f1f (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-4.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.268 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f10 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-19.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.268 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f08 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-25.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.268 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ef9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-38.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.268 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f19 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-10.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.269 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ef7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-40.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.269 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ef5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-42.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.269 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f07 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-26.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.269 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f14 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-15.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.269 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003efb (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-36.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.269 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003efa (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-37.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.269 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f22 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-1.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.269 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ef8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-39.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.269 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003ee9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-54.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.269 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f0a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-23.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.269 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003f17 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-12.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.269 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.269 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:33 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:34.271 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: pgmap v640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 2.69k op/s 2024-08-26T00:12:34.271 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:34.272 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.272 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:34.272 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.272 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:34.272 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001ec2 (~mds2/stray3/10000001ec2) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.272 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001edc (~mds2/stray4/10000001edc) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.272 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001ee0 (~mds2/stray4/10000001ee0) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.272 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f53 (~mds2/stray4/10000001f53) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.272 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.272 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:34.272 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f4d (~mds2/stray4/10000001f4d) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.272 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ece (~mds2/stray4/10000003ece) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.272 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ec2 (~mds2/stray4/10000003ec2) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.273 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003eb1 (~mds2/stray4/10000003eb1) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.273 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001ef9 (~mds2/stray4/10000001ef9) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.273 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e8a (~mds2/stray4/10000003e8a) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.273 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.273 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:34.273 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f4b (~mds2/stray4/10000001f4b) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.273 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f5c (~mds2/stray4/10000001f5c) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.273 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f56 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.273 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000002667 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-65.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.273 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f2c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-9.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.273 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ec6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-16.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.273 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000027df (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-44.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.273 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e97 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-58.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.273 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001ec0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-62.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.274 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.274 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:34.274 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f0d (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-24.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.274 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e9a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-55.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.274 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003eac (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-41.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.274 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003832 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-67.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.274 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003eb4 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-34.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.274 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ebd (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-25.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.274 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e86 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-75.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.274 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f3c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-3.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.274 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.274 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:34.274 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f31 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-7.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.275 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ebf (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-23.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.275 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ebe (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-24.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.275 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f2e (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-8.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.275 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001ece (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-55.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.275 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ea5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-47.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.275 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e8b (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-70.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.275 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001ef8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-32.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.275 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f50 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.275 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e8c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-69.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.275 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e87 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-74.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.275 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003eb2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-36.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.276 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ea6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-46.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.276 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f16 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-21.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.276 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f23 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-13.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.276 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001efa (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-30.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.276 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001ed7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-50.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.276 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f34 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-6.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.276 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f3e (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-2.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.276 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e89 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-72.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.276 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ed7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-4.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.276 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e91 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-64.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.276 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.276 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:34.276 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ec9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-14.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.277 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.277 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:34.277 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e8e (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-67.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.277 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001ecc (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-56.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.277 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003edb (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-2.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.277 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ec0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-22.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.277 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ea8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-44.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.277 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ec3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-19.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.277 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001ef7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-33.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.277 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f58 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.277 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ebb (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-27.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.277 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e85 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-76.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.277 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001eca (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-57.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.277 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001ede (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-43.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.278 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e8f (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-66.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.278 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ed4 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-7.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.278 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001ec8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-58.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.278 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ea0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-52.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.278 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ea9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-43.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.278 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ec5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-17.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.278 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001efc (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-28.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.278 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ed0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-9.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.278 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ec8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-15.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.278 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001ed2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-53.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.278 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001ed4 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-52.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.278 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ea7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-45.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.278 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.278 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:34.279 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f5a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.279 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e9f (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-53.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.279 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ecf (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-10.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.279 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e80 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-81.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.279 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ed5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-6.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.279 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f48 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.279 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000025a9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-70.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.279 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003eb3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-35.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.279 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003eba (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-28.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.279 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001efb (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-29.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.279 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e94 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-61.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.279 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001ec4 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-60.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.279 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e98 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-57.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.280 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f13 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-22.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.280 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e8d (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-68.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.280 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003eb0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-38.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.280 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ed2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-8.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.280 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f21 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-14.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.280 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e81 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-80.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.280 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e93 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-62.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.280 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001edb (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-46.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.280 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f27 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-11.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.280 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e96 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-59.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.280 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001eda (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-47.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.280 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f1c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-16.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.280 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001ed0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-54.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.280 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f2a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-10.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.281 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e84 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-77.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.281 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f01 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-26.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.281 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f46 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.281 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ea2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-50.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.281 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ea4 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-48.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.281 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001ed9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-48.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.281 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.281 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:34.281 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f39 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-4.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.281 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001ee3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-38.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.281 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f0b (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-25.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.281 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003eb7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-31.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.281 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000025aa (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-72.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.282 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001eea (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-35.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.282 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.282 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:34.282 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e88 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-73.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.282 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e95 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-60.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.282 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003edd (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-1.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.282 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001ee1 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-40.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.282 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e83 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-78.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.282 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x1000000327a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-82.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.282 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003eb5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-33.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.282 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f1f (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-15.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.283 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e82 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-79.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.283 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003eae (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-40.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.283 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003eaf (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-39.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.283 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003eb6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-32.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.283 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e92 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-63.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.283 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001edf (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-42.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.283 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e9c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-54.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.283 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001ebc (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-64.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.283 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f18 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-19.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.283 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003eca (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-13.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.283 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001ee7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-37.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.283 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ec1 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-21.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.284 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ebc (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-26.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.284 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001ee8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-36.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.284 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001ee2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-39.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.284 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003eb8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-30.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.284 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f41 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-1.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.284 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f25 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-12.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.284 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ed9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-3.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.284 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003eab (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-42.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.284 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ec4 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-18.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.284 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ecd (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-12.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.285 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ea3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-49.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.285 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003e90 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-65.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.285 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f1a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-17.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.285 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001ebe (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-63.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.285 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ea1 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-51.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.285 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000001f10 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-23.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.285 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.285 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:34.285 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f11 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-18.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.285 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.286 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:34.286 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f05 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-27.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.286 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003eec (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-51.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.286 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f24 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.286 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f0d (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-20.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.286 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ef6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-41.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.286 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f00 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-31.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.286 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ef2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-45.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.286 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f09 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-24.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.286 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f1a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-9.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.286 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f20 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-3.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.286 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ee8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-55.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.287 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f1c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-7.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.287 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ef3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-44.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.287 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003efe (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-33.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.287 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ef4 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-43.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.287 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ee7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-56.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.287 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f21 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-2.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.287 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f25 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.287 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f1d (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-6.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.287 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003eed (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-50.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.287 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ee6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-57.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.287 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f02 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-30.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.288 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ee5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-58.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.288 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f0c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-21.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.288 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f16 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-13.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.288 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f1b (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-8.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.288 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003eea (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-53.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.288 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003eeb (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-52.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.288 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f23 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.288 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f04 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-28.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.288 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f1e (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-5.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.288 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f03 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-29.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.288 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f15 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-14.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.288 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f0b (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-22.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.289 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f13 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-16.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.289 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f18 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-11.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.289 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003eee (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-49.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.289 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ef1 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-46.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.289 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ef0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-47.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.289 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003eef (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-48.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.289 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003efc (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-35.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.289 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f1f (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-4.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.289 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f10 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-19.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.289 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f08 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-25.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.289 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ef9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-38.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.290 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f19 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-10.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.290 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ef7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-40.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.290 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ef5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-42.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.290 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f07 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-26.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.290 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f14 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-15.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.290 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003efb (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-36.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.290 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003efa (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-37.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.290 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f22 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-1.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.290 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ef8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-39.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.290 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003ee9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-54.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.290 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f0a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-23.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.290 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003f17 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-12.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.291 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.291 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:33 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:34.292 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.804+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000225c [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-45.jpg auth{0=1} v530 ap=1 s=55342 n(v0 rc2024-08-26T00:04:45.999736+0000 b55342 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ecbd15080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000225c:[<0x20000002216/picture-45.jpg v530>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1534>,<0x10000000005/tmp v131>,<0x100000001fb/client.0 v129>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v141>,<0x10000000001/sv_1 v160>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x2000000225c:[<0x20000002216/picture-45.jpg v530>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.292 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.805+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000228b [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-23.jpg auth{0=1} v558 ap=1 s=61748 n(v0 rc2024-08-26T00:04:46.171734+0000 b61748 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ecbd14b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000228b:[<0x20000002216/picture-23.jpg v558>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1534>,<0x10000000005/tmp v131>,<0x100000001fb/client.0 v129>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v141>,<0x10000000001/sv_1 v160>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x2000000228b:[<0x20000002216/picture-23.jpg v558>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.292 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.805+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002268 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-41.jpg auth{0=1} v556 ap=1 s=60035 n(v0 rc2024-08-26T00:04:46.051735+0000 b60035 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ecbd15600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002268:[<0x20000002216/picture-41.jpg v556>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1534>,<0x10000000005/tmp v131>,<0x100000001fb/client.0 v129>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v141>,<0x10000000001/sv_1 v160>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x20000002268:[<0x20000002216/picture-41.jpg v556>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.292 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.806+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000222d [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-59.jpg auth{0=1} v604 ap=1 s=44767 n(v0 rc2024-08-26T00:04:45.812737+0000 b44767 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ecd0bd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000222d:[<0x20000002216/picture-59.jpg v604>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1534>,<0x10000000005/tmp v131>,<0x100000001fb/client.0 v129>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v141>,<0x10000000001/sv_1 v160>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x2000000222d:[<0x20000002216/picture-59.jpg v604>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.292 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.807+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002222 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/article-4.xml auth{0=1} v1724 ap=1 s=12022 n(v0 rc2024-08-26T00:04:45.775737+0000 b12022 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ecd0bd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002222:[<0x20000002216/article-4.xml v1724>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1534>,<0x10000000005/tmp v131>,<0x100000001fb/client.0 v129>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v141>,<0x10000000001/sv_1 v160>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x20000002222:[<0x20000002216/article-4.xml v1724>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.293 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: pgmap v640: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 2.69k op/s 2024-08-26T00:12:34.293 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:34.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:34.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:34.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001ec2 (~mds2/stray3/10000001ec2) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001edc (~mds2/stray4/10000001edc) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001ee0 (~mds2/stray4/10000001ee0) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f53 (~mds2/stray4/10000001f53) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:34.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f4d (~mds2/stray4/10000001f4d) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ece (~mds2/stray4/10000003ece) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ec2 (~mds2/stray4/10000003ec2) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.294 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003eb1 (~mds2/stray4/10000003eb1) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001ef9 (~mds2/stray4/10000001ef9) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e8a (~mds2/stray4/10000003e8a) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:34.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f4b (~mds2/stray4/10000001f4b) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f5c (~mds2/stray4/10000001f5c) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f56 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000002667 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-65.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f2c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-9.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ec6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-16.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.295 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000027df (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-44.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.296 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.809+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000225e [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-44.jpg auth{0=1} v554 ap=1 s=39702 n(v0 rc2024-08-26T00:04:46.018735+0000 b39702 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ecd0bc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000225e:[<0x20000002216/picture-44.jpg v554>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1534>,<0x10000000005/tmp v131>,<0x100000001fb/client.0 v129>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v141>,<0x10000000001/sv_1 v160>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x2000000225e:[<0x20000002216/picture-44.jpg v554>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.296 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.809+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000022b0 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-12.jpg auth{0=1} v606 ap=1 s=64614 n(v0 rc2024-08-26T00:04:46.274733+0000 b64614 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ecd0bbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000022b0:[<0x20000002216/picture-12.jpg v606>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1534>,<0x10000000005/tmp v131>,<0x100000001fb/client.0 v129>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v141>,<0x10000000001/sv_1 v160>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x200000022b0:[<0x20000002216/picture-12.jpg v606>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.296 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.809+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002256 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-47.jpg auth{0=1} v576 ap=1 s=25790 n(v0 rc2024-08-26T00:04:45.972736+0000 b25790 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ecd0bb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002256:[<0x20000002216/picture-47.jpg v576>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1534>,<0x10000000005/tmp v131>,<0x100000001fb/client.0 v129>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v141>,<0x10000000001/sv_1 v160>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x20000002256:[<0x20000002216/picture-47.jpg v576>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.296 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.811+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x30000000640 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/article-54.xml auth{0=1} v626 ap=1 s=13663 n(v0 rc2024-08-26T00:05:10.743522+0000 b13663 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ecd0ba000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x30000000640:[<0x20000002216/article-54.xml v626>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1534>,<0x10000000005/tmp v131>,<0x100000001fb/client.0 v129>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v141>,<0x10000000001/sv_1 v160>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x30000000640:[<0x20000002216/article-54.xml v626>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.296 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.811+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002238 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-56.jpg auth{0=1} v538 ap=1 s=21351 n(v0 rc2024-08-26T00:04:45.860737+0000 b21351 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ecd0bab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002238:[<0x20000002216/picture-56.jpg v538>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1534>,<0x10000000005/tmp v131>,<0x100000001fb/client.0 v129>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v141>,<0x10000000001/sv_1 v160>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x20000002238:[<0x20000002216/picture-56.jpg v538>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.296 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.817+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000022a6 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-15.jpg auth{0=1} v586 ap=1 s=35263 n(v0 rc2024-08-26T00:04:46.251733+0000 b35263 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ecd0ba580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000022a6:[<0x20000002216/picture-15.jpg v586>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1534>,<0x10000000005/tmp v131>,<0x100000001fb/client.0 v129>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v141>,<0x10000000001/sv_1 v160>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x200000022a6:[<0x20000002216/picture-15.jpg v586>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.296 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:33.818+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000228f [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-22.jpg auth{0=1} v598 ap=1 s=37523 n(v0 rc2024-08-26T00:04:46.179734+0000 b37523 1=1+0) | replicated=1 authpin=1 scrubqueue=0 0x558ecbd16680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000228f:[<0x20000002216/picture-22.jpg v598>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1534>,<0x10000000005/tmp v131>,<0x100000001fb/client.0 v129>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v141>,<0x10000000001/sv_1 v160>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x2000000228f:[<0x20000002216/picture-22.jpg v598>,<0x20000000219/blog-55 v216364>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.298 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e97 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-58.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.298 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001ec0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-62.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.298 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.298 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:34.298 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f0d (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-24.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.298 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e9a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-55.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.298 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003eac (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-41.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003832 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-67.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003eb4 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-34.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ebd (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-25.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e86 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-75.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f3c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-3.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:34.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f31 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-7.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ebf (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-23.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ebe (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-24.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f2e (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-8.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001ece (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-55.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.299 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ea5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-47.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e8b (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-70.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001ef8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-32.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f50 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e8c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-69.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e87 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-74.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003eb2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-36.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ea6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-46.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f16 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-21.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f23 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-13.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001efa (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-30.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001ed7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-50.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.300 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f34 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-6.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f3e (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-2.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e89 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-72.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ed7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-4.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e91 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-64.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:34.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ec9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-14.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:34.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e8e (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-67.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001ecc (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-56.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.302 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003edb (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-2.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.302 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ec0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-22.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.302 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ea8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-44.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.302 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ec3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-19.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.302 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001ef7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-33.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.302 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f58 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.302 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ebb (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-27.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.302 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e85 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-76.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.302 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001eca (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-57.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.302 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001ede (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-43.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.302 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e8f (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-66.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.302 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ed4 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-7.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.302 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001ec8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-58.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.303 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ea0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-52.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.303 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ea9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-43.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.303 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ec5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-17.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.303 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001efc (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-28.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.303 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ed0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-9.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.303 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ec8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-15.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.303 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001ed2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-53.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.303 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001ed4 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-52.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.303 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ea7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-45.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.303 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.303 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:34.303 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f5a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.303 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e9f (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-53.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.303 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ecf (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-10.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.304 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e80 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-81.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.304 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ed5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-6.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.304 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f48 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.304 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000025a9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-70.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.304 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003eb3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-35.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.304 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003eba (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-28.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.304 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001efb (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-29.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.304 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e94 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-61.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.304 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001ec4 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-60.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.304 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e98 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-57.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.304 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f13 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-22.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.304 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e8d (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-68.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.304 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003eb0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-38.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.304 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ed2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-8.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.305 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f21 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-14.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.305 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e81 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-80.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.305 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e93 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-62.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.305 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001edb (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-46.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.305 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f27 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-11.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.305 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e96 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-59.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.305 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001eda (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-47.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.305 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f1c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-16.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.305 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001ed0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-54.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.305 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f2a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-10.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.305 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e84 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-77.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.305 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f01 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-26.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.305 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f46 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.306 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ea2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-50.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.306 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ea4 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-48.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.306 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001ed9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-48.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.306 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.306 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:34.306 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f39 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-4.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.306 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001ee3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-38.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.306 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f0b (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-25.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.306 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003eb7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-31.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.306 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000025aa (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-72.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.306 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001eea (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-35.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.306 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.306 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:34.307 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e88 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-73.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.307 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e95 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-60.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.307 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003edd (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-1.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.307 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001ee1 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-40.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.307 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e83 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-78.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.307 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x1000000327a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-82.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.307 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003eb5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-33.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.307 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f1f (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-15.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.307 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e82 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-79.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.307 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003eae (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-40.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.307 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003eaf (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-39.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.307 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003eb6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-32.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.307 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e92 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-63.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.307 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001edf (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-42.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.308 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e9c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-54.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.308 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001ebc (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-64.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.308 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f18 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-19.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.308 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003eca (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-13.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.308 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001ee7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-37.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.308 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ec1 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-21.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.308 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ebc (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-26.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.308 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001ee8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-36.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.308 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001ee2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-39.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.308 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003eb8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-30.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.308 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f41 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-1.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.308 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f25 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-12.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.308 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ed9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-3.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.309 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003eab (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-42.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.309 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ec4 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-18.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.309 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ecd (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-12.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.309 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ea3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-49.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.309 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003e90 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-65.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.309 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f1a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-17.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.309 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001ebe (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-63.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.309 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ea1 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-51.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.309 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000001f10 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-23.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.309 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.309 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:34.309 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f11 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-18.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.309 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.309 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:34.310 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f05 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-27.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.310 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003eec (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-51.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.310 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f24 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.310 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f0d (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-20.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.310 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ef6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-41.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.310 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f00 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-31.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.310 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ef2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-45.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.310 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f09 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-24.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.310 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f1a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-9.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.310 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f20 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-3.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.310 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ee8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-55.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.310 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f1c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-7.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.310 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ef3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-44.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.311 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003efe (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-33.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.311 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ef4 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-43.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.311 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ee7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-56.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.311 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f21 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-2.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.311 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f25 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.311 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f1d (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-6.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.311 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003eed (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-50.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.311 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ee6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-57.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.311 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f02 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-30.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.311 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ee5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-58.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.311 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f0c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-21.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.311 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f16 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-13.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.311 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f1b (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-8.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.311 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003eea (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-53.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.312 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003eeb (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-52.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.312 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f23 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.312 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f04 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-28.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.312 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f1e (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-5.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.312 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f03 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-29.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.312 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f15 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-14.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.312 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f0b (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-22.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.312 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f13 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-16.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.312 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f18 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-11.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.312 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003eee (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-49.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.312 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ef1 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-46.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.313 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ef0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-47.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.313 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003eef (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-48.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.313 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003efc (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-35.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.313 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f1f (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-4.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.313 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f10 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-19.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.313 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f08 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-25.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.313 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ef9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-38.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.313 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f19 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-10.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.313 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ef7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-40.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.313 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ef5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-42.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.313 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f07 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-26.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.313 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f14 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-15.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.313 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003efb (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-36.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.313 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003efa (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-37.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.314 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f22 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-1.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.314 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ef8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-39.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.314 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003ee9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-54.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.314 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f0a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-23.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.314 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003f17 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-12.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:34.314 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:34.314 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:33 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:34.784 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.516+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000351c [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-43.xml auth{0=1} v756 ap=1 s=25695 n(v0 rc2024-08-26T00:07:04.531543+0000 b25695 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558eced4c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000351c:[<0x100000034f1/article-43.xml v756>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3041>,<0x10000000201/src v1679>,<0x10000000006/blogbench-1.0 v1550>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v135>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v145>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v151>,<0x1/volumes v158>]//[]","memoryvalue":"(3)0x1000000351c:[<0x100000034f1/article-43.xml v756>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.784 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.518+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000353d [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-33.xml auth{0=1} v754 ap=1 s=16328 n(v0 rc2024-08-26T00:07:04.688542+0000 b16328 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec255d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000353d:[<0x100000034f1/article-33.xml v754>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3041>,<0x10000000201/src v1679>,<0x10000000006/blogbench-1.0 v1550>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v135>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v145>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v151>,<0x1/volumes v158>]//[]","memoryvalue":"(3)0x1000000353d:[<0x100000034f1/article-33.xml v754>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.784 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.518+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003629 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-5.jpg auth{0=1} v742 ap=1 s=52828 n(v0 rc2024-08-26T00:07:05.680533+0000 b52828 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec8bd2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003629:[<0x100000034f1/picture-5.jpg v742>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3067>,<0x10000000201/src v1681>,<0x10000000006/blogbench-1.0 v1553>,<0x10000000005/tmp v139>,<0x100000001fb/client.0 v137>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v147>,<0x10000000001/sv_1 v168>,<0x10000000000/qa v153>,<0x1/volumes v164>]//[]","memoryvalue":"(3)0x10000003629:[<0x100000034f1/picture-5.jpg v742>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.784 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.518+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003596 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-58.jpg auth{0=1} v750 ap=1 s=47258 n(v0 rc2024-08-26T00:07:05.082538+0000 b47258 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecf43d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003596:[<0x100000034f1/picture-58.jpg v750>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3041>,<0x10000000201/src v1679>,<0x10000000006/blogbench-1.0 v1550>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v135>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v145>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v151>,<0x1/volumes v158>]//[]","memoryvalue":"(3)0x10000003596:[<0x100000034f1/picture-58.jpg v750>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.785 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.518+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000034f9 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-57.xml auth{0=1} v762 ap=1 s=6028 n(v0 rc2024-08-26T00:07:04.402544+0000 b6028 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecd51eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000034f9:[<0x100000034f1/article-57.xml v762>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3041>,<0x10000000201/src v1679>,<0x10000000006/blogbench-1.0 v1550>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v135>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v145>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v151>,<0x1/volumes v158>]//[]","memoryvalue":"(3)0x100000034f9:[<0x100000034f1/article-57.xml v762>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.785 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.518+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035a7 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-50.jpg auth{0=1} v746 ap=1 s=47791 n(v0 rc2024-08-26T00:07:05.146538+0000 b47791 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec4db1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035a7:[<0x100000034f1/picture-50.jpg v746>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3041>,<0x10000000201/src v1679>,<0x10000000006/blogbench-1.0 v1550>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v135>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v145>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v151>,<0x1/volumes v158>]//[]","memoryvalue":"(3)0x100000035a7:[<0x100000034f1/picture-50.jpg v746>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.785 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.518+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000034f7 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-58.xml auth{0=1} v764 ap=1 s=12960 n(v0 rc2024-08-26T00:07:04.359545+0000 b12960 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec7dd8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000034f7:[<0x100000034f1/article-58.xml v764>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3041>,<0x10000000201/src v1679>,<0x10000000006/blogbench-1.0 v1550>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v135>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v145>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v151>,<0x1/volumes v158>]//[]","memoryvalue":"(3)0x100000034f7:[<0x100000034f1/article-58.xml v764>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.785 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.519+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003502 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-53.xml auth{0=1} v760 ap=1 s=22956 n(v0 rc2024-08-26T00:07:04.434544+0000 b22956 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecd532c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003502:[<0x100000034f1/article-53.xml v760>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3041>,<0x10000000201/src v1679>,<0x10000000006/blogbench-1.0 v1550>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v135>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v145>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v151>,<0x1/volumes v158>]//[]","memoryvalue":"(3)0x10000003502:[<0x100000034f1/article-53.xml v760>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.785 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.520+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003550 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-28.xml auth{0=1} v752 ap=1 s=31849 n(v0 rc2024-08-26T00:07:04.769541+0000 b31849 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec8b5a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003550:[<0x100000034f1/article-28.xml v752>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3041>,<0x10000000201/src v1679>,<0x10000000006/blogbench-1.0 v1550>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v135>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v145>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v151>,<0x1/volumes v158>]//[]","memoryvalue":"(3)0x10000003550:[<0x100000034f1/article-28.xml v752>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.787 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.520+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035b2 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-46.jpg auth{0=1} v744 ap=1 s=53248 n(v0 rc2024-08-26T00:07:05.213537+0000 b53248 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecd39f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035b2:[<0x100000034f1/picture-46.jpg v744>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3041>,<0x10000000201/src v1679>,<0x10000000006/blogbench-1.0 v1550>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v135>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v145>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v151>,<0x1/volumes v158>]//[]","memoryvalue":"(3)0x100000035b2:[<0x100000034f1/picture-46.jpg v744>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.787 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.520+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003504 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-52.xml auth{0=1} v758 ap=1 s=26058 n(v0 rc2024-08-26T00:07:04.442544+0000 b26058 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecf7e5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003504:[<0x100000034f1/article-52.xml v758>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3041>,<0x10000000201/src v1679>,<0x10000000006/blogbench-1.0 v1550>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v135>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v145>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v151>,<0x1/volumes v158>]//[]","memoryvalue":"(3)0x10000003504:[<0x100000034f1/article-52.xml v758>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.787 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.520+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035a3 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-51.jpg auth{0=1} v748 ap=1 s=59466 n(v0 rc2024-08-26T00:07:05.129538+0000 b59466 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec822f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035a3:[<0x100000034f1/picture-51.jpg v748>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3041>,<0x10000000201/src v1679>,<0x10000000006/blogbench-1.0 v1550>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v135>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v145>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v151>,<0x1/volumes v158>]//[]","memoryvalue":"(3)0x100000035a3:[<0x100000034f1/picture-51.jpg v748>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.787 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.529+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035fd [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-21.jpg auth{0=1} v756 ap=1 s=34750 n(v0 rc2024-08-26T00:07:05.482535+0000 b34750 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecf5e6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035fd:[<0x100000034f1/picture-21.jpg v756>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3067>,<0x10000000201/src v1681>,<0x10000000006/blogbench-1.0 v1553>,<0x10000000005/tmp v139>,<0x100000001fb/client.0 v137>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v147>,<0x10000000001/sv_1 v168>,<0x10000000000/qa v153>,<0x1/volumes v164>]//[]","memoryvalue":"(3)0x100000035fd:[<0x100000034f1/picture-21.jpg v756>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.787 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.531+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035e6 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-30.jpg auth{0=1} v758 ap=1 s=33702 n(v0 rc2024-08-26T00:07:05.372536+0000 b33702 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecf905180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035e6:[<0x100000034f1/picture-30.jpg v758>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3041>,<0x10000000201/src v1679>,<0x10000000006/blogbench-1.0 v1550>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v135>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v145>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v151>,<0x1/volumes v158>]//[]","memoryvalue":"(3)0x100000035e6:[<0x100000034f1/picture-30.jpg v758>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.788 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.531+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003529 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-40.xml auth{0=1} v770 ap=1 s=29055 n(v0 rc2024-08-26T00:07:04.572543+0000 b29055 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecc5b0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003529:[<0x100000034f1/article-40.xml v770>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3041>,<0x10000000201/src v1679>,<0x10000000006/blogbench-1.0 v1550>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v135>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v145>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v151>,<0x1/volumes v158>]//[]","memoryvalue":"(3)0x10000003529:[<0x100000034f1/article-40.xml v770>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.788 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.533+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000357a [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-15.xml auth{0=1} v766 ap=1 s=16100 n(v0 rc2024-08-26T00:07:04.949539+0000 b16100 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ed027d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000357a:[<0x100000034f1/article-15.xml v766>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3041>,<0x10000000201/src v1679>,<0x10000000006/blogbench-1.0 v1550>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v135>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v145>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v151>,<0x1/volumes v158>]//[]","memoryvalue":"(3)0x1000000357a:[<0x100000034f1/article-15.xml v766>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.788 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.533+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035bc [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-43.jpg auth{0=1} v764 ap=1 s=46347 n(v0 rc2024-08-26T00:07:05.243537+0000 b46347 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecb0b6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035bc:[<0x100000034f1/picture-43.jpg v764>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3041>,<0x10000000201/src v1679>,<0x10000000006/blogbench-1.0 v1550>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v135>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v145>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v151>,<0x1/volumes v158>]//[]","memoryvalue":"(3)0x100000035bc:[<0x100000034f1/picture-43.jpg v764>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.788 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.533+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035d0 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-36.jpg auth{0=1} v760 ap=1 s=26304 n(v0 rc2024-08-26T00:07:05.302536+0000 b26304 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec7e40c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035d0:[<0x100000034f1/picture-36.jpg v760>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3041>,<0x10000000201/src v1679>,<0x10000000006/blogbench-1.0 v1550>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v135>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v145>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v151>,<0x1/volumes v158>]//[]","memoryvalue":"(3)0x100000035d0:[<0x100000034f1/picture-36.jpg v760>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.788 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.533+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003573 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-19.xml auth{0=1} v768 ap=1 s=21893 n(v0 rc2024-08-26T00:07:04.925540+0000 b21893 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ed0254c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003573:[<0x100000034f1/article-19.xml v768>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3041>,<0x10000000201/src v1679>,<0x10000000006/blogbench-1.0 v1550>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v135>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v145>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v151>,<0x1/volumes v158>]//[]","memoryvalue":"(3)0x10000003573:[<0x100000034f1/article-19.xml v768>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.788 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.533+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035ff [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-20.jpg auth{0=1} v754 ap=1 s=35945 n(v0 rc2024-08-26T00:07:05.494535+0000 b35945 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec29d0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035ff:[<0x100000034f1/picture-20.jpg v754>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3067>,<0x10000000201/src v1681>,<0x10000000006/blogbench-1.0 v1553>,<0x10000000005/tmp v139>,<0x100000001fb/client.0 v137>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v147>,<0x10000000001/sv_1 v168>,<0x10000000000/qa v153>,<0x1/volumes v164>]//[]","memoryvalue":"(3)0x100000035ff:[<0x100000034f1/picture-20.jpg v754>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.788 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.535+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035c9 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-38.jpg auth{0=1} v762 ap=1 s=49002 n(v0 rc2024-08-26T00:07:05.281537+0000 b49002 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec72e2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035c9:[<0x100000034f1/picture-38.jpg v762>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3041>,<0x10000000201/src v1679>,<0x10000000006/blogbench-1.0 v1550>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v135>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v145>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v151>,<0x1/volumes v158>]//[]","memoryvalue":"(3)0x100000035c9:[<0x100000034f1/picture-38.jpg v762>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.788 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.535+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003521 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-42.xml auth{0=1} v772 ap=1 s=10867 n(v0 rc2024-08-26T00:07:04.542543+0000 b10867 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecf5e5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003521:[<0x100000034f1/article-42.xml v772>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3041>,<0x10000000201/src v1679>,<0x10000000006/blogbench-1.0 v1550>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v135>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v145>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v151>,<0x1/volumes v158>]//[]","memoryvalue":"(3)0x10000003521:[<0x100000034f1/article-42.xml v772>,<0x20000000219/blog-318 v224816>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.788 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.641+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000028b9 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-64.jpg auth{0=1} v992 ap=1 s=65181 n(v0 rc2024-08-26T00:06:41.019745+0000 b65181 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecfac4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000028b9:[<0x100000027fd/picture-64.jpg v992>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x100000028b9:[<0x100000027fd/picture-64.jpg v992>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.788 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.641+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003711 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-80.xml auth{0=1} v955 ap=1 s=4944 n(v0 rc2024-08-26T00:07:07.181521+0000 b4944 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecfac4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003711:[<0x100000027fd/article-80.xml v955>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3292>,<0x10000000201/src v1693>,<0x10000000006/blogbench-1.0 v1565>,<0x10000000005/tmp v151>,<0x100000001fb/client.0 v150>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v161>,<0x10000000001/sv_1 v182>,<0x10000000000/qa v167>,<0x1/volumes v178>]//[]","memoryvalue":"(3)0x10000003711:[<0x100000027fd/article-80.xml v955>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.789 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.642+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002901 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-10.jpg auth{0=1} v974 ap=1 s=59098 n(v0 rc2024-08-26T00:06:41.410742+0000 b59098 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecfac5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002901:[<0x100000027fd/picture-10.jpg v974>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x10000002901:[<0x100000027fd/picture-10.jpg v974>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.789 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.642+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000290a [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-1.jpg auth{0=1} v972 ap=1 s=9550 n(v0 rc2024-08-26T00:06:42.259734+0000 b9550 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecfac6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000290a:[<0x100000027fd/picture-1.jpg v972>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x1000000290a:[<0x100000027fd/picture-1.jpg v972>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.789 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.642+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002868 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-9.xml auth{0=1} v1000 ap=1 s=26209 n(v0 rc2024-08-26T00:06:40.661748+0000 b26209 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecfac6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002868:[<0x100000027fd/article-9.xml v1000>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x10000002868:[<0x100000027fd/article-9.xml v1000>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.789 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.642+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002821 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-44.xml auth{0=1} v1004 ap=1 s=3326 n(v0 rc2024-08-26T00:06:40.447750+0000 b3326 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecfac6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002821:[<0x100000027fd/article-44.xml v1004>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x10000002821:[<0x100000027fd/article-44.xml v1004>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.789 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.643+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000280b [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-65.xml auth{0=1} v1008 ap=1 s=17405 n(v0 rc2024-08-26T00:06:40.276751+0000 b17405 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecfac7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000280b:[<0x100000027fd/article-65.xml v1008>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x1000000280b:[<0x100000027fd/article-65.xml v1008>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.789 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.643+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000280e [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-62.xml auth{0=1} v1006 ap=1 s=20320 n(v0 rc2024-08-26T00:06:40.287751+0000 b20320 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecfca6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000280e:[<0x100000027fd/article-62.xml v1006>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x1000000280e:[<0x100000027fd/article-62.xml v1006>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.789 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.643+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002809 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-67.xml auth{0=1} v1010 ap=1 s=18710 n(v0 rc2024-08-26T00:06:40.256752+0000 b18710 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecc1d4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002809:[<0x100000027fd/article-67.xml v1010>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x10000002809:[<0x100000027fd/article-67.xml v1010>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.789 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.643+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002848 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-24.xml auth{0=1} v1002 ap=1 s=14199 n(v0 rc2024-08-26T00:06:40.575749+0000 b14199 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec2248680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002848:[<0x100000027fd/article-24.xml v1002>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x10000002848:[<0x100000027fd/article-24.xml v1002>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.789 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.643+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000028ea [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-28.jpg auth{0=1} v980 ap=1 s=53384 n(v0 rc2024-08-26T00:06:41.277743+0000 b53384 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558eca20eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000028ea:[<0x100000027fd/picture-28.jpg v980>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x100000028ea:[<0x100000027fd/picture-28.jpg v980>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.789 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.644+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000028f8 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-17.jpg auth{0=1} v976 ap=1 s=46707 n(v0 rc2024-08-26T00:06:41.361742+0000 b46707 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecb0b7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000028f8:[<0x100000027fd/picture-17.jpg v976>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x100000028f8:[<0x100000027fd/picture-17.jpg v976>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.790 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.645+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002879 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-3.xml auth{0=1} v996 ap=1 s=13810 n(v0 rc2024-08-26T00:06:40.746747+0000 b13810 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec29b7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002879:[<0x100000027fd/article-3.xml v996>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x10000002879:[<0x100000027fd/article-3.xml v996>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.790 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.645+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000028de [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-37.jpg auth{0=1} v984 ap=1 s=48109 n(v0 rc2024-08-26T00:06:41.192744+0000 b48109 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ece1a6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000028de:[<0x100000027fd/picture-37.jpg v984>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x100000028de:[<0x100000027fd/picture-37.jpg v984>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.790 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.645+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000028ef [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-24.jpg auth{0=1} v978 ap=1 s=20431 n(v0 rc2024-08-26T00:06:41.303743+0000 b20431 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ed021f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000028ef:[<0x100000027fd/picture-24.jpg v978>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x100000028ef:[<0x100000027fd/picture-24.jpg v978>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.790 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.645+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000028e3 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-33.jpg auth{0=1} v982 ap=1 s=54822 n(v0 rc2024-08-26T00:06:41.231743+0000 b54822 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ecb0b4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000028e3:[<0x100000027fd/picture-33.jpg v982>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x100000028e3:[<0x100000027fd/picture-33.jpg v982>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.790 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.645+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000028c5 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-57.jpg auth{0=1} v990 ap=1 s=25497 n(v0 rc2024-08-26T00:06:41.056745+0000 b25497 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ece926580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000028c5:[<0x100000027fd/picture-57.jpg v990>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x100000028c5:[<0x100000027fd/picture-57.jpg v990>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.790 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.646+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000028d7 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-42.jpg auth{0=1} v988 ap=1 s=38027 n(v0 rc2024-08-26T00:06:41.162744+0000 b38027 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558eced4e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000028d7:[<0x100000027fd/picture-42.jpg v988>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x100000028d7:[<0x100000027fd/picture-42.jpg v988>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.790 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.646+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000286d [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-7.xml auth{0=1} v998 ap=1 s=19951 n(v0 rc2024-08-26T00:06:40.689748+0000 b19951 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ec4d95600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000286d:[<0x100000027fd/article-7.xml v998>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x1000000286d:[<0x100000027fd/article-7.xml v998>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.790 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.646+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000028a1 [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-68.jpg auth{0=1} v994 ap=1 s=22422 n(v0 rc2024-08-26T00:06:40.923746+0000 b22422 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ed027f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000028a1:[<0x100000027fd/picture-68.jpg v994>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x100000028a1:[<0x100000027fd/picture-68.jpg v994>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:34.790 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:12:34.646+0000 7f8fc1f35640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000028db [2,head] /volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-39.jpg auth{0=1} v986 ap=1 s=29034 n(v0 rc2024-08-26T00:06:41.182744+0000 b29034 1=1+0) caps={25040=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x558ed021e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000028db:[<0x100000027fd/picture-39.jpg v986>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3031>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1548>,<0x10000000005/tmp v133>,<0x100000001fb/client.0 v131>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v143>,<0x10000000001/sv_1 v163>,<0x10000000000/qa v147>,<0x1/volumes v153>]//[]","memoryvalue":"(3)0x100000028db:[<0x100000027fd/picture-39.jpg v986>,<0x20000000219/blog-274 v227034>,<0x10000000208/blogtest_in v3414>,<0x10000000201/src v1703>,<0x10000000006/blogbench-1.0 v1528>,<0x10000000005/tmp v137>,<0x100000001fb/client.0 v38>,<0x100000001fa/269f5507-8998-422b-97df-9053d1be8750 v157>,<0x10000000001/sv_1 v71>,<0x10000000000/qa v151>,<0x1/volumes v57>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-26T00:12:35.114 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x2000000225c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.115 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x2000000228b (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.115 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x20000002268 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.115 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x2000000222d (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-59.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.115 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x20000002222 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/article-4.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.115 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x2000000225e (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.115 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x200000022b0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.116 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x20000002256 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.116 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x30000000640 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/article-54.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.116 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x20000002238 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-56.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.116 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x200000022a6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.116 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x2000000228f (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.116 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.116 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:35.116 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x1000000351c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-43.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.116 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.116 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:35.116 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x1000000353d (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-33.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.116 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003629 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.116 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003596 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-58.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.116 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000034f9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-57.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.117 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000035a7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-50.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.117 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000034f7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-58.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.117 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.117 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:35.117 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003502 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-53.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.117 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003550 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-28.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.117 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000035b2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-46.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.117 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003504 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-52.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.117 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000035a3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-51.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.117 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.117 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:35.118 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000035fd (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.118 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.118 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:35.118 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000035e6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-30.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.118 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003529 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-40.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.118 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.118 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:35.118 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x1000000357a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-15.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.118 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000035bc (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-43.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.118 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000035d0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-36.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.119 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003573 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-19.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.119 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000035ff (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.119 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.119 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:35.119 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000035c9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-38.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.119 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003521 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-42.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.119 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.119 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:35.119 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000028b9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-64.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.119 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000003711 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-80.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.119 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000002901 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.120 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x1000000290a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.120 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000002868 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-9.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.120 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000002821 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-44.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.120 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.120 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:35.120 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x1000000280b (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-65.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.120 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x1000000280e (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-62.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.120 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000002809 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-67.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.120 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000002848 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-24.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.120 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000028ea (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.120 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.120 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:35.120 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000028f8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.120 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x10000002879 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-3.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.121 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000028de (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.121 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000028ef (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.121 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000028e3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.121 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000028c5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-57.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.121 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.121 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: scrub summary: active paths [/] 2024-08-26T00:12:35.121 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000028d7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.121 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x1000000286d (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-7.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.121 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000028a1 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-68.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.121 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: Scrub error on inode 0x100000028db (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.121 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:34 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x2000000225c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x2000000228b (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x20000002268 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x2000000222d (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-59.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x20000002222 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/article-4.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x2000000225e (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x200000022b0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x20000002256 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x30000000640 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/article-54.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x20000002238 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-56.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x200000022a6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x2000000228f (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:35.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x1000000351c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-43.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:35.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x1000000353d (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-33.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003629 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003596 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-58.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000034f9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-57.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000035a7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-50.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000034f7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-58.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.262 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:35.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003502 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-53.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003550 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-28.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000035b2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-46.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003504 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-52.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000035a3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-51.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:35.263 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000035fd (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:35.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000035e6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-30.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003529 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-40.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:35.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x1000000357a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-15.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.265 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000035bc (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-43.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.265 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000035d0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-36.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.265 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003573 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-19.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.265 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000035ff (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:35.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000035c9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-38.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003521 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-42.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:35.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000028b9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-64.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000003711 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-80.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000002901 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x1000000290a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.266 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000002868 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-9.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000002821 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-44.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:35.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x1000000280b (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-65.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x1000000280e (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-62.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000002809 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-67.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000002848 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-24.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000028ea (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:35.267 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000028f8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x10000002879 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-3.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000028de (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000028ef (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000028e3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000028c5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-57.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: scrub summary: active paths [/] 2024-08-26T00:12:35.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000028d7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x1000000286d (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-7.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000028a1 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-68.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: Scrub error on inode 0x100000028db (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.268 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:34 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x2000000225c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x2000000228b (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x20000002268 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x2000000222d (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-59.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x20000002222 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/article-4.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x2000000225e (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x200000022b0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x20000002256 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x30000000640 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/article-54.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x20000002238 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-56.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x200000022a6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x2000000228f (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:35.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x1000000351c (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-43.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:35.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x1000000353d (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-33.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003629 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003596 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-58.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000034f9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-57.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000035a7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-50.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000034f7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-58.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:35.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003502 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-53.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003550 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-28.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000035b2 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-46.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003504 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-52.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000035a3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-51.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:35.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000035fd (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:35.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000035e6 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-30.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003529 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-40.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.288 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:35.288 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x1000000357a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-15.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.288 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000035bc (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-43.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.288 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000035d0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-36.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.288 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003573 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-19.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.288 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000035ff (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.288 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.288 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:35.288 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000035c9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-38.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.288 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003521 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-42.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.289 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.289 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:35.289 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000028b9 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-64.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.289 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000003711 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-80.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.289 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000002901 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.289 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x1000000290a (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.289 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000002868 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-9.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.289 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000002821 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-44.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.289 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.289 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:35.289 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x1000000280b (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-65.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.289 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x1000000280e (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-62.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.289 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000002809 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-67.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.290 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000002848 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-24.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.290 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000028ea (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.290 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.290 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:35.290 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000028f8 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.290 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x10000002879 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-3.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.290 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000028de (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.290 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000028ef (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.290 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000028e3 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.290 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000028c5 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-57.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.290 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:35.290 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: scrub summary: active paths [/] 2024-08-26T00:12:35.290 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000028d7 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.290 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x1000000286d (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-7.xml) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.291 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000028a1 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-68.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.291 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: Scrub error on inode 0x100000028db (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:12:35.291 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:34 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:36.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:35 smithi043 ceph-mon[22091]: pgmap v641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.5 MiB/s wr, 2.73k op/s 2024-08-26T00:12:36.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:35 smithi043 ceph-mon[22091]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:36.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-a[17221]: 2024-08-26T00:12:35.856+0000 7f1a88c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-08-26T00:12:36.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:35 smithi042 ceph-mon[17225]: pgmap v641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.5 MiB/s wr, 2.73k op/s 2024-08-26T00:12:36.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:35 smithi042 ceph-mon[17225]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:36.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:35 smithi181 ceph-mon[22102]: pgmap v641: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.5 MiB/s wr, 2.73k op/s 2024-08-26T00:12:36.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:35 smithi181 ceph-mon[22102]: scrub summary: idle+waiting paths [/] 2024-08-26T00:12:37.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:36 smithi043 ceph-mon[22091]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-08-26T00:12:37.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:36 smithi043 ceph-mon[22091]: mds.? [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] up:active 2024-08-26T00:12:37.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:36 smithi043 ceph-mon[22091]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:12:37.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:36 smithi042 ceph-mon[17225]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-08-26T00:12:37.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:36 smithi042 ceph-mon[17225]: mds.? [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] up:active 2024-08-26T00:12:37.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:36 smithi042 ceph-mon[17225]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:12:37.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:36 smithi181 ceph-mon[22102]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-08-26T00:12:37.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:36 smithi181 ceph-mon[22102]: mds.? [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] up:active 2024-08-26T00:12:37.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:36 smithi181 ceph-mon[22102]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-26T00:12:38.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:37 smithi043 ceph-mon[22091]: pgmap v642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 3.05k op/s 2024-08-26T00:12:38.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:37 smithi042 ceph-mon[17225]: pgmap v642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 3.05k op/s 2024-08-26T00:12:38.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:37 smithi181 ceph-mon[22102]: pgmap v642: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 3.05k op/s 2024-08-26T00:12:40.186 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:39 smithi042 ceph-mon[17225]: pgmap v643: 97 pgs: 97 active+clean; 1.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 2.82k op/s 2024-08-26T00:12:40.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:39 smithi043 ceph-mon[22091]: pgmap v643: 97 pgs: 97 active+clean; 1.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 2.82k op/s 2024-08-26T00:12:40.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:39 smithi181 ceph-mon[22102]: pgmap v643: 97 pgs: 97 active+clean; 1.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 2.82k op/s 2024-08-26T00:12:42.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:41 smithi042 ceph-mon[17225]: pgmap v644: 97 pgs: 97 active+clean; 1.4 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.7 MiB/s wr, 1.78k op/s 2024-08-26T00:12:42.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:41 smithi043 ceph-mon[22091]: pgmap v644: 97 pgs: 97 active+clean; 1.4 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.7 MiB/s wr, 1.78k op/s 2024-08-26T00:12:42.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:41 smithi181 ceph-mon[22102]: pgmap v644: 97 pgs: 97 active+clean; 1.4 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.7 MiB/s wr, 1.78k op/s 2024-08-26T00:12:44.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:44 smithi042 ceph-mon[17225]: pgmap v645: 97 pgs: 97 active+clean; 1.4 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.7 MiB/s wr, 1.53k op/s 2024-08-26T00:12:44.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:44 smithi043 ceph-mon[22091]: pgmap v645: 97 pgs: 97 active+clean; 1.4 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.7 MiB/s wr, 1.53k op/s 2024-08-26T00:12:44.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:44 smithi181 ceph-mon[22102]: pgmap v645: 97 pgs: 97 active+clean; 1.4 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.7 MiB/s wr, 1.53k op/s 2024-08-26T00:12:45.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:45 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:12:45.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:45 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:12:45.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:45 smithi042 ceph-mon[17225]: scrub summary: idle 2024-08-26T00:12:45.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:45 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:12:45.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:45 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:12:45.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:45 smithi043 ceph-mon[22091]: scrub summary: idle 2024-08-26T00:12:45.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:45 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:12:45.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:45 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:12:45.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:45 smithi181 ceph-mon[22102]: scrub summary: idle 2024-08-26T00:12:46.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:46 smithi043 ceph-mon[22091]: pgmap v646: 97 pgs: 97 active+clean; 1.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 1.03k op/s 2024-08-26T00:12:46.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:46 smithi042 ceph-mon[17225]: pgmap v646: 97 pgs: 97 active+clean; 1.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 1.03k op/s 2024-08-26T00:12:46.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:46 smithi181 ceph-mon[22102]: pgmap v646: 97 pgs: 97 active+clean; 1.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 1.03k op/s 2024-08-26T00:12:48.336 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:48 smithi042 ceph-mon[17225]: pgmap v647: 97 pgs: 97 active+clean; 1.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 1.00k op/s 2024-08-26T00:12:48.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:48 smithi043 ceph-mon[22091]: pgmap v647: 97 pgs: 97 active+clean; 1.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 1.00k op/s 2024-08-26T00:12:48.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:48 smithi181 ceph-mon[22102]: pgmap v647: 97 pgs: 97 active+clean; 1.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 1.00k op/s 2024-08-26T00:12:50.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:50 smithi181 ceph-mon[22102]: pgmap v648: 97 pgs: 97 active+clean; 1.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 742 op/s 2024-08-26T00:12:50.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:50 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:12:50.381 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:50 smithi042 ceph-mon[17225]: pgmap v648: 97 pgs: 97 active+clean; 1.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 742 op/s 2024-08-26T00:12:50.381 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:50 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:12:50.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:50 smithi043 ceph-mon[22091]: pgmap v648: 97 pgs: 97 active+clean; 1.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 742 op/s 2024-08-26T00:12:50.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:50 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:12:52.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:51 smithi043 ceph-mon[22091]: pgmap v649: 97 pgs: 97 active+clean; 1.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 493 op/s 2024-08-26T00:12:52.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:51 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:12:52.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:52 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:12:52.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:52 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:12:52.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:52 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:12:52.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:52 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:12:52.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:52 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:12:52.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:51 smithi042 ceph-mon[17225]: pgmap v649: 97 pgs: 97 active+clean; 1.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 493 op/s 2024-08-26T00:12:52.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:51 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:12:52.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:51 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:12:52.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:51 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:12:52.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:51 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:12:52.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:51 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:12:52.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:51 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:12:52.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:51 smithi181 ceph-mon[22102]: pgmap v649: 97 pgs: 97 active+clean; 1.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 493 op/s 2024-08-26T00:12:52.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:51 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:12:52.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:51 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:12:52.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:51 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:12:52.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:51 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:12:52.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:51 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:12:52.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:51 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:12:53.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:52 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:12:53.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:52 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:12:53.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:53 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:12:53.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:52 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:12:53.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:52 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:12:53.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:52 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:12:53.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:52 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:12:53.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:53 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:12:53.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:53 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:12:54.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:54 smithi043 ceph-mon[22091]: pgmap v650: 97 pgs: 97 active+clean; 1.4 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 545 op/s 2024-08-26T00:12:54.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:54 smithi042 ceph-mon[17225]: pgmap v650: 97 pgs: 97 active+clean; 1.4 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 545 op/s 2024-08-26T00:12:54.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:54 smithi181 ceph-mon[22102]: pgmap v650: 97 pgs: 97 active+clean; 1.4 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 545 op/s 2024-08-26T00:12:56.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:56 smithi043 ceph-mon[22091]: pgmap v651: 97 pgs: 97 active+clean; 1.4 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 491 op/s 2024-08-26T00:12:56.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:56 smithi042 ceph-mon[17225]: pgmap v651: 97 pgs: 97 active+clean; 1.4 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 491 op/s 2024-08-26T00:12:56.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:56 smithi181 ceph-mon[22102]: pgmap v651: 97 pgs: 97 active+clean; 1.4 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 491 op/s 2024-08-26T00:12:56.860 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-26T00:12:57.307 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:12:57.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.973+0000 7fc9e1e00640 1 -- 172.21.15.42:0/1033211114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9dc1033e0 msgr2=0x7fc9dc10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:57.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.973+0000 7fc9e1e00640 1 --2- 172.21.15.42:0/1033211114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9dc1033e0 0x7fc9dc10b8d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8009860 tx=0x7fc9c802a3d0 comp rx=0 tx=0).stop 2024-08-26T00:12:57.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.974+0000 7fc9e1e00640 1 -- 172.21.15.42:0/1033211114 shutdown_connections 2024-08-26T00:12:57.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.974+0000 7fc9e1e00640 1 --2- 172.21.15.42:0/1033211114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9dc10bef0 0x7fc9dc10e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:57.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.974+0000 7fc9e1e00640 1 --2- 172.21.15.42:0/1033211114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9dc1033e0 0x7fc9dc10b8d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:57.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.974+0000 7fc9e1e00640 1 --2- 172.21.15.42:0/1033211114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9dc102ac0 0x7fc9dc102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:57.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.974+0000 7fc9e1e00640 1 -- 172.21.15.42:0/1033211114 >> 172.21.15.42:0/1033211114 conn(0x7fc9dc0fc520 msgr2=0x7fc9dc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:57.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.974+0000 7fc9e1e00640 1 -- 172.21.15.42:0/1033211114 shutdown_connections 2024-08-26T00:12:57.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.974+0000 7fc9e1e00640 1 -- 172.21.15.42:0/1033211114 wait complete. 2024-08-26T00:12:57.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.974+0000 7fc9e1e00640 1 Processor -- start 2024-08-26T00:12:57.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.975+0000 7fc9e1e00640 1 -- start start 2024-08-26T00:12:57.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.975+0000 7fc9e1e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9dc102ac0 0x7fc9dc198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:57.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.975+0000 7fc9e1e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9dc1033e0 0x7fc9dc1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:57.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.975+0000 7fc9e1e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9dc10bef0 0x7fc9dc19cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:57.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.975+0000 7fc9e1e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc111d40 con 0x7fc9dc1033e0 2024-08-26T00:12:57.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.975+0000 7fc9e1e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc111bc0 con 0x7fc9dc10bef0 2024-08-26T00:12:57.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.975+0000 7fc9e1e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc111ec0 con 0x7fc9dc102ac0 2024-08-26T00:12:57.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.975+0000 7fc9daa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9dc102ac0 0x7fc9dc198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:57.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.975+0000 7fc9db400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9dc10bef0 0x7fc9dc19cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:57.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.975+0000 7fc9daa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9dc102ac0 0x7fc9dc198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:39478/0 (socket says 172.21.15.42:39478) 2024-08-26T00:12:57.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.975+0000 7fc9da000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9dc1033e0 0x7fc9dc1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:57.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.975+0000 7fc9daa00640 1 -- 172.21.15.42:0/2433970823 learned_addr learned my addr 172.21.15.42:0/2433970823 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:57.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.975+0000 7fc9db400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9dc10bef0 0x7fc9dc19cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:38508/0 (socket says 172.21.15.42:38508) 2024-08-26T00:12:57.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.976+0000 7fc9daa00640 1 -- 172.21.15.42:0/2433970823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9dc10bef0 msgr2=0x7fc9dc19cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:57.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.976+0000 7fc9daa00640 1 --2- 172.21.15.42:0/2433970823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9dc10bef0 0x7fc9dc19cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:57.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.976+0000 7fc9daa00640 1 -- 172.21.15.42:0/2433970823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9dc1033e0 msgr2=0x7fc9dc1987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:57.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.976+0000 7fc9daa00640 1 --2- 172.21.15.42:0/2433970823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9dc1033e0 0x7fc9dc1987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:57.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.976+0000 7fc9daa00640 1 -- 172.21.15.42:0/2433970823 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9dc19d190 con 0x7fc9dc102ac0 2024-08-26T00:12:57.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.976+0000 7fc9da000640 1 --2- 172.21.15.42:0/2433970823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9dc1033e0 0x7fc9dc1987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:12:57.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.976+0000 7fc9daa00640 1 --2- 172.21.15.42:0/2433970823 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9dc102ac0 0x7fc9dc198280 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00e9c0 tx=0x7fc9cc00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:57.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.977+0000 7fc9e0a00640 1 -- 172.21.15.42:0/2433970823 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc00cde0 con 0x7fc9dc102ac0 2024-08-26T00:12:57.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.977+0000 7fc9e1e00640 1 -- 172.21.15.42:0/2433970823 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9dc19d480 con 0x7fc9dc102ac0 2024-08-26T00:12:57.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.977+0000 7fc9e0a00640 1 -- 172.21.15.42:0/2433970823 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9cc0035f0 con 0x7fc9dc102ac0 2024-08-26T00:12:57.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.977+0000 7fc9e0a00640 1 -- 172.21.15.42:0/2433970823 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc010650 con 0x7fc9dc102ac0 2024-08-26T00:12:57.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.977+0000 7fc9e1e00640 1 -- 172.21.15.42:0/2433970823 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9dc1a4d60 con 0x7fc9dc102ac0 2024-08-26T00:12:57.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.981+0000 7fc9e4870740 1 Processor -- start 2024-08-26T00:12:57.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.981+0000 7fc9e4870740 1 -- start start 2024-08-26T00:12:57.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.982+0000 7fc9e0a00640 1 -- 172.21.15.42:0/2433970823 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc9cc0037a0 con 0x7fc9dc102ac0 2024-08-26T00:12:57.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.982+0000 7fc9e4870740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647762e4860 0x5647762e4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:57.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.982+0000 7fc9e4870740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647762e5180 0x5647762f39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:57.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.982+0000 7fc9e4870740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762f3f30 0x5647762f6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:57.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.982+0000 7fc9e4870740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56477624afc0 con 0x5647762e5180 2024-08-26T00:12:57.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.982+0000 7fc9e4870740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5647761e2680 con 0x5647762e4860 2024-08-26T00:12:57.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.982+0000 7fc9e4870740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564776246f80 con 0x5647762f3f30 2024-08-26T00:12:57.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.982+0000 7fc9db400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647762e4860 0x5647762e4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:57.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.982+0000 7fc9db400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647762e4860 0x5647762e4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:38524/0 (socket says 172.21.15.42:38524) 2024-08-26T00:12:57.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.982+0000 7fc9db400640 1 -- 172.21.15.42:0/1680862187 learned_addr learned my addr 172.21.15.42:0/1680862187 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:57.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.982+0000 7fc9daa00640 1 --2- 172.21.15.42:0/1680862187 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647762e5180 0x5647762f39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:57.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.982+0000 7fc9da000640 1 --2- 172.21.15.42:0/1680862187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762f3f30 0x5647762f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:57.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.983+0000 7fc9db400640 1 -- 172.21.15.42:0/1680862187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762f3f30 msgr2=0x5647762f6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:57.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.983+0000 7fc9db400640 1 --2- 172.21.15.42:0/1680862187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762f3f30 0x5647762f6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:57.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.983+0000 7fc9db400640 1 -- 172.21.15.42:0/1680862187 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647762e5180 msgr2=0x5647762f39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:57.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.983+0000 7fc9db400640 1 --2- 172.21.15.42:0/1680862187 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647762e5180 0x5647762f39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:57.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.983+0000 7fc9db400640 1 -- 172.21.15.42:0/1680862187 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647761fe2c0 con 0x5647762e4860 2024-08-26T00:12:57.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.983+0000 7fc9daa00640 1 --2- 172.21.15.42:0/1680862187 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647762e5180 0x5647762f39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:12:57.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.983+0000 7fc9db400640 1 --2- 172.21.15.42:0/1680862187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647762e4860 0x5647762e4c40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009f50 tx=0x7fc9d40118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=379c1fa2f7524a75 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:57.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.983+0000 7fc9c7e00640 1 -- 172.21.15.42:0/1680862187 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4004b20 con 0x5647762e4860 2024-08-26T00:12:57.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.984+0000 7fc9c7e00640 1 -- 172.21.15.42:0/1680862187 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9d4003e50 con 0x5647762e4860 2024-08-26T00:12:57.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.984+0000 7fc9c7e00640 1 -- 172.21.15.42:0/1680862187 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d400f540 con 0x5647762e4860 2024-08-26T00:12:57.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.984+0000 7fc9e0a00640 1 --2- 172.21.15.42:0/2433970823 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc9c00a2c00 0x7fc9c00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:57.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.984+0000 7fc9e0a00640 1 -- 172.21.15.42:0/2433970823 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fc9cc0cf2e0 con 0x7fc9dc102ac0 2024-08-26T00:12:57.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.984+0000 7fc9e4870740 1 -- 172.21.15.42:0/1680862187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647762e4860 msgr2=0x5647762e4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:57.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.984+0000 7fc9e4870740 1 --2- 172.21.15.42:0/1680862187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647762e4860 0x5647762e4c40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009f50 tx=0x7fc9d40118d0 comp rx=0 tx=0).stop 2024-08-26T00:12:57.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.984+0000 7fc9daa00640 1 --2- 172.21.15.42:0/2433970823 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc9c00a2c00 0x7fc9c00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:57.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.985+0000 7fc9e4870740 1 -- 172.21.15.42:0/1680862187 shutdown_connections 2024-08-26T00:12:57.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.985+0000 7fc9e4870740 1 --2- 172.21.15.42:0/1680862187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762f3f30 0x5647762f6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:57.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.985+0000 7fc9e4870740 1 --2- 172.21.15.42:0/1680862187 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647762e5180 0x5647762f39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:57.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.985+0000 7fc9e4870740 1 --2- 172.21.15.42:0/1680862187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647762e4860 0x5647762e4c40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:57.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.985+0000 7fc9e4870740 1 -- 172.21.15.42:0/1680862187 >> 172.21.15.42:0/1680862187 conn(0x5647762e0ed0 msgr2=0x5647762e12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:57.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.985+0000 7fc9e4870740 1 -- 172.21.15.42:0/1680862187 shutdown_connections 2024-08-26T00:12:57.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.985+0000 7fc9e4870740 1 -- 172.21.15.42:0/1680862187 wait complete. 2024-08-26T00:12:57.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.985+0000 7fc9daa00640 1 --2- 172.21.15.42:0/2433970823 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc9c00a2c00 0x7fc9c00a50c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0a4280 tx=0x7fc9cc0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:57.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.985+0000 7fc9e4870740 1 -- start start 2024-08-26T00:12:57.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.986+0000 7fc9e4870740 1 Processor -- start 2024-08-26T00:12:57.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.986+0000 7fc9e4870740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762e4860 0x5647762f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:57.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.986+0000 7fc9e4870740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647762e5180 0x5647762f1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:57.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.986+0000 7fc9e4870740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647762f3f30 0x5647762f1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:57.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.986+0000 7fc9e4870740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5647762f6aa0 con 0x5647762f3f30 2024-08-26T00:12:57.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.986+0000 7fc9e4870740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564776205e50 con 0x5647762e5180 2024-08-26T00:12:57.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.986+0000 7fc9e4870740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5647762f6c20 con 0x5647762e4860 2024-08-26T00:12:57.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.986+0000 7fc9e4870740 10 client.0 _ll_register_callbacks cb 0x5647761f0f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:12:57.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.986+0000 7fc9db400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762e4860 0x5647762f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:57.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.987+0000 7fc9db400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762e4860 0x5647762f0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:39496/0 (socket says 172.21.15.42:39496) 2024-08-26T00:12:57.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.987+0000 7fc9db400640 1 -- 172.21.15.42:0/3903115901 learned_addr learned my addr 172.21.15.42:0/3903115901 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:57.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.987+0000 7fc9da000640 1 --2- 172.21.15.42:0/3903115901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647762e5180 0x5647762f1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:57.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.987+0000 7fc9db400640 1 --2- 172.21.15.42:0/3903115901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647762f3f30 0x5647762f1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:57.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.987+0000 7fc9da000640 1 -- 172.21.15.42:0/3903115901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762e4860 msgr2=0x5647762f0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:57.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.987+0000 7fc9da000640 1 --2- 172.21.15.42:0/3903115901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762e4860 0x5647762f0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:57.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.987+0000 7fc9da000640 1 -- 172.21.15.42:0/3903115901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647762f3f30 msgr2=0x5647762f1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:57.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.987+0000 7fc9da000640 1 --2- 172.21.15.42:0/3903115901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647762f3f30 0x5647762f1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:57.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.987+0000 7fc9da000640 1 -- 172.21.15.42:0/3903115901 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564775fbc3c0 con 0x5647762e5180 2024-08-26T00:12:57.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.987+0000 7fc9da000640 1 --2- 172.21.15.42:0/3903115901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647762e5180 0x5647762f1410 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8000c00 tx=0x7fc9c8005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55fdc0cc3503bf6b server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:57.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.987+0000 7fc9c4c00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:12:57.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.988+0000 7fc9c4c00640 1 -- 172.21.15.42:0/3903115901 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8030e60 con 0x5647762e5180 2024-08-26T00:12:57.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.988+0000 7fc9c4c00640 1 -- 172.21.15.42:0/3903115901 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fc9c80055f0 con 0x5647762e5180 2024-08-26T00:12:57.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.988+0000 7fc9e4870740 1 -- 172.21.15.42:0/3903115901 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9d4003e50 con 0x5647762e5180 2024-08-26T00:12:57.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.988+0000 7fc9c4c00640 1 -- 172.21.15.42:0/3903115901 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc9c8009450 con 0x5647762e5180 2024-08-26T00:12:57.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.988+0000 7fc9e4870740 10 client.26177 fetch_fsmap learned FSMap version 32 2024-08-26T00:12:57.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.988+0000 7fc9e4870740 1 -- 172.21.15.42:0/3903115901 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564776302830 con 0x5647762e5180 2024-08-26T00:12:57.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.988+0000 7fc9c4c00640 1 -- 172.21.15.42:0/3903115901 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9d4003e50 con 0x5647762e5180 2024-08-26T00:12:57.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.989+0000 7fc9c4c00640 1 -- 172.21.15.42:0/3903115901 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7fc9c8004ce0 con 0x5647762e5180 2024-08-26T00:12:57.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.989+0000 7fc9e4870740 10 client.26177 fetch_fsmap finished waiting for FSMap version 32 2024-08-26T00:12:57.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.989+0000 7fc9e4870740 10 client.26177 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:12:57.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.989+0000 7fc9e4870740 20 client.26177 populate_metadata read hostname 'smithi042' 2024-08-26T00:12:57.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.989+0000 7fc9e4870740 1 --2- 172.21.15.42:0/3903115901 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x564776303d90 0x564776306180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:57.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.989+0000 7fc9e4870740 4 client.26177 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:12:57.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.989+0000 7fc9e4870740 1 -- 172.21.15.42:0/3903115901 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564776258530 con 0x564776303d90 2024-08-26T00:12:57.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.989+0000 7fc9db400640 1 --2- 172.21.15.42:0/3903115901 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x564776303d90 0x564776306180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:57.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.990+0000 7fc9db400640 1 --2- 172.21.15.42:0/3903115901 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x564776303d90 0x564776306180 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a1305ca4577af07 server_cookie=d5ddedece2ea795f in_seq=0 out_seq=0 2024-08-26T00:12:57.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.990+0000 7fc9c4c00640 10 client.26177 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:12:57.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.991+0000 7fc9c4c00640 1 -- 172.21.15.42:0/3903115901 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564776258530 con 0x564776303d90 2024-08-26T00:12:57.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.991+0000 7fc9c4c00640 10 client.26177 handle_command_reply: tid=0 2024-08-26T00:12:57.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.991+0000 7fc9e4870740 1 client.26177 shutdown 2024-08-26T00:12:57.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.991+0000 7fc9e4870740 1 -- 172.21.15.42:0/3903115901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647762e5180 msgr2=0x5647762f1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:57.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.991+0000 7fc9e4870740 1 --2- 172.21.15.42:0/3903115901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647762e5180 0x5647762f1410 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8000c00 tx=0x7fc9c8005270 comp rx=0 tx=0).stop 2024-08-26T00:12:57.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.991+0000 7fc9e4870740 1 -- 172.21.15.42:0/3903115901 shutdown_connections 2024-08-26T00:12:57.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.991+0000 7fc9e4870740 1 --2- 172.21.15.42:0/3903115901 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x564776303d90 0x564776306180 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:57.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.991+0000 7fc9e4870740 1 --2- 172.21.15.42:0/3903115901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647762f3f30 0x5647762f1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:57.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.991+0000 7fc9e4870740 1 --2- 172.21.15.42:0/3903115901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647762e5180 0x5647762f1410 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:57.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.991+0000 7fc9e4870740 1 --2- 172.21.15.42:0/3903115901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762e4860 0x5647762f0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:57.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.991+0000 7fc9e4870740 1 -- 172.21.15.42:0/3903115901 >> 172.21.15.42:0/3903115901 conn(0x5647762e0ed0 msgr2=0x5647762e0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:57.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.991+0000 7fc9c4c00640 0 client.26177 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:12:57.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.991+0000 7fc9e4870740 1 -- 172.21.15.42:0/3903115901 shutdown_connections 2024-08-26T00:12:57.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.991+0000 7fc9e4870740 1 -- 172.21.15.42:0/3903115901 wait complete. 2024-08-26T00:12:57.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:57.991+0000 7fc9e4870740 20 client.26177 trim_cache size 0 max 16384 2024-08-26T00:12:58.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.011+0000 7fc9e4870740 1 Processor -- start 2024-08-26T00:12:58.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.011+0000 7fc9e4870740 1 -- start start 2024-08-26T00:12:58.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.012+0000 7fc9e4870740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647762e4860 0x5647762f17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:58.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.012+0000 7fc9e4870740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762e5180 0x56477630ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:58.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.012+0000 7fc9e4870740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647762f3f30 0x56477630bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:58.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.012+0000 7fc9e4870740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc1adbe0 con 0x5647762e4860 2024-08-26T00:12:58.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.012+0000 7fc9e4870740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc1ab3f0 con 0x5647762f3f30 2024-08-26T00:12:58.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.012+0000 7fc9e4870740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc1a9220 con 0x5647762e5180 2024-08-26T00:12:58.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.012+0000 7fc9db400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647762e4860 0x5647762f17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:58.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.012+0000 7fc9db400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647762e4860 0x5647762f17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57816/0 (socket says 172.21.15.42:57816) 2024-08-26T00:12:58.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.012+0000 7fc9db400640 1 -- 172.21.15.42:0/3447962347 learned_addr learned my addr 172.21.15.42:0/3447962347 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:58.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.012+0000 7fc9da000640 1 --2- 172.21.15.42:0/3447962347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762e5180 0x56477630ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:58.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.012+0000 7fc9db400640 1 --2- 172.21.15.42:0/3447962347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647762f3f30 0x56477630bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:58.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.012+0000 7fc9da000640 1 -- 172.21.15.42:0/3447962347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647762f3f30 msgr2=0x56477630bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:58.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.012+0000 7fc9da000640 1 --2- 172.21.15.42:0/3447962347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647762f3f30 0x56477630bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:58.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.012+0000 7fc9da000640 1 -- 172.21.15.42:0/3447962347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647762e4860 msgr2=0x5647762f17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:58.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.012+0000 7fc9da000640 1 --2- 172.21.15.42:0/3447962347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647762e4860 0x5647762f17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:58.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.012+0000 7fc9da000640 1 -- 172.21.15.42:0/3447962347 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647762e4fb0 con 0x5647762e5180 2024-08-26T00:12:58.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.013+0000 7fc9da000640 1 --2- 172.21.15.42:0/3447962347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762e5180 0x56477630ba30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8003640 tx=0x7fc9c8005ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfa56b992be3cab5 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:58.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.013+0000 7fc9c7400640 1 -- 172.21.15.42:0/3447962347 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c80055f0 con 0x5647762e5180 2024-08-26T00:12:58.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.013+0000 7fc9c7400640 1 -- 172.21.15.42:0/3447962347 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9c80307b0 con 0x5647762e5180 2024-08-26T00:12:58.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.013+0000 7fc9c7400640 1 -- 172.21.15.42:0/3447962347 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c80046c0 con 0x5647762e5180 2024-08-26T00:12:58.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.014+0000 7fc9e4870740 1 -- 172.21.15.42:0/3447962347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762e5180 msgr2=0x56477630ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:58.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.014+0000 7fc9e4870740 1 --2- 172.21.15.42:0/3447962347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762e5180 0x56477630ba30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8003640 tx=0x7fc9c8005ab0 comp rx=0 tx=0).stop 2024-08-26T00:12:58.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.014+0000 7fc9e4870740 1 -- 172.21.15.42:0/3447962347 shutdown_connections 2024-08-26T00:12:58.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.014+0000 7fc9e4870740 1 --2- 172.21.15.42:0/3447962347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647762f3f30 0x56477630bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:58.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.014+0000 7fc9e4870740 1 --2- 172.21.15.42:0/3447962347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762e5180 0x56477630ba30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:58.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.014+0000 7fc9e4870740 1 --2- 172.21.15.42:0/3447962347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647762e4860 0x5647762f17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:58.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.014+0000 7fc9e4870740 1 -- 172.21.15.42:0/3447962347 >> 172.21.15.42:0/3447962347 conn(0x5647762e0ed0 msgr2=0x5647762e0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:58.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.014+0000 7fc9e4870740 1 -- 172.21.15.42:0/3447962347 shutdown_connections 2024-08-26T00:12:58.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.014+0000 7fc9e4870740 1 -- 172.21.15.42:0/3447962347 wait complete. 2024-08-26T00:12:58.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.014+0000 7fc9e4870740 1 -- start start 2024-08-26T00:12:58.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.015+0000 7fc9e4870740 1 Processor -- start 2024-08-26T00:12:58.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.015+0000 7fc9e4870740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647762e4860 0x5647762fc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:58.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.015+0000 7fc9e4870740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762e5180 0x5647762fc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:58.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.015+0000 7fc9e4870740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647762f3f30 0x5647762f75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:58.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.015+0000 7fc9e4870740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc1a98b0 con 0x5647762e4860 2024-08-26T00:12:58.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.015+0000 7fc9e4870740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc1aad20 con 0x5647762f3f30 2024-08-26T00:12:58.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.015+0000 7fc9e4870740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc1a9f80 con 0x5647762e5180 2024-08-26T00:12:58.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.015+0000 7fc9e4870740 10 client.0 _ll_register_callbacks cb 0x7fc9cc005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:12:58.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.015+0000 7fc9da000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762e5180 0x5647762fc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:58.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.015+0000 7fc9da000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762e5180 0x5647762fc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:39514/0 (socket says 172.21.15.42:39514) 2024-08-26T00:12:58.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.015+0000 7fc9da000640 1 -- 172.21.15.42:0/3313145185 learned_addr learned my addr 172.21.15.42:0/3313145185 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:58.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.015+0000 7fc9db400640 1 --2- 172.21.15.42:0/3313145185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647762e4860 0x5647762fc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:58.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.016+0000 7fc9db400640 1 --2- 172.21.15.42:0/3313145185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647762f3f30 0x5647762f75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:58.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.016+0000 7fc9da000640 1 -- 172.21.15.42:0/3313145185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647762f3f30 msgr2=0x5647762f75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:58.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.016+0000 7fc9da000640 1 --2- 172.21.15.42:0/3313145185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647762f3f30 0x5647762f75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:58.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.016+0000 7fc9da000640 1 -- 172.21.15.42:0/3313145185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647762e4860 msgr2=0x5647762fc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:12:58.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.016+0000 7fc9da000640 1 --2- 172.21.15.42:0/3313145185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647762e4860 0x5647762fc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:58.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.016+0000 7fc9da000640 1 -- 172.21.15.42:0/3313145185 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647762f7df0 con 0x5647762e5180 2024-08-26T00:12:58.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.016+0000 7fc9da000640 1 --2- 172.21.15.42:0/3313145185 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762e5180 0x5647762fc720 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8003830 tx=0x7fc9c8003ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d20bed9f520eb68d server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:58.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.016+0000 7fc9c4c00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:12:58.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.016+0000 7fc9c4c00640 1 -- 172.21.15.42:0/3313145185 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8030e60 con 0x5647762e5180 2024-08-26T00:12:58.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.016+0000 7fc9c4c00640 1 -- 172.21.15.42:0/3313145185 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fc9c8043070 con 0x5647762e5180 2024-08-26T00:12:58.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.016+0000 7fc9e4870740 1 -- 172.21.15.42:0/3313145185 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9c80307b0 con 0x5647762e5180 2024-08-26T00:12:58.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.017+0000 7fc9c4c00640 1 -- 172.21.15.42:0/3313145185 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc9c80055f0 con 0x5647762e5180 2024-08-26T00:12:58.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.017+0000 7fc9e4870740 10 client.26149 fetch_fsmap learned FSMap version 32 2024-08-26T00:12:58.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.017+0000 7fc9e4870740 1 -- 172.21.15.42:0/3313145185 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56477636e5f0 con 0x5647762e5180 2024-08-26T00:12:58.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.017+0000 7fc9c4c00640 1 -- 172.21.15.42:0/3313145185 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9c80307b0 con 0x5647762e5180 2024-08-26T00:12:58.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.017+0000 7fc9c4c00640 1 -- 172.21.15.42:0/3313145185 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7fc9c8064020 con 0x5647762e5180 2024-08-26T00:12:58.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.017+0000 7fc9e4870740 10 client.26149 fetch_fsmap finished waiting for FSMap version 32 2024-08-26T00:12:58.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.017+0000 7fc9e4870740 10 client.26149 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:12:58.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.017+0000 7fc9e4870740 20 client.26149 populate_metadata read hostname 'smithi042' 2024-08-26T00:12:58.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.017+0000 7fc9e4870740 1 --2- 172.21.15.42:0/3313145185 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x56477636eca0 0x5647763710c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:58.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.017+0000 7fc9e4870740 4 client.26149 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-26T00:12:58.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.017+0000 7fc9e4870740 1 -- 172.21.15.42:0/3313145185 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564776252a40 con 0x56477636eca0 2024-08-26T00:12:58.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.018+0000 7fc9db400640 1 --2- 172.21.15.42:0/3313145185 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x56477636eca0 0x5647763710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:58.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.019+0000 7fc9c4c00640 10 client.26149 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:12:58.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.019+0000 7fc9db400640 1 --2- 172.21.15.42:0/3313145185 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x56477636eca0 0x5647763710c0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb7e699742968e57 server_cookie=1e94a0aee530609b in_seq=0 out_seq=0 2024-08-26T00:12:58.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.019+0000 7fc9c4c00640 1 -- 172.21.15.42:0/3313145185 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564776252a40 con 0x56477636eca0 2024-08-26T00:12:58.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.019+0000 7fc9c4c00640 10 client.26149 handle_command_reply: tid=0 2024-08-26T00:12:58.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.019+0000 7fc9e4870740 1 client.26149 shutdown 2024-08-26T00:12:58.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.019+0000 7fc9e4870740 1 -- 172.21.15.42:0/3313145185 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762e5180 msgr2=0x5647762fc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:58.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.019+0000 7fc9e4870740 1 --2- 172.21.15.42:0/3313145185 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762e5180 0x5647762fc720 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8003830 tx=0x7fc9c8003ac0 comp rx=0 tx=0).stop 2024-08-26T00:12:58.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.019+0000 7fc9e4870740 1 -- 172.21.15.42:0/3313145185 shutdown_connections 2024-08-26T00:12:58.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.019+0000 7fc9e4870740 1 --2- 172.21.15.42:0/3313145185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647762f3f30 0x5647762f75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:58.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.019+0000 7fc9e4870740 1 --2- 172.21.15.42:0/3313145185 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647762e5180 0x5647762fc720 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:58.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.019+0000 7fc9e4870740 1 --2- 172.21.15.42:0/3313145185 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x56477636eca0 0x5647763710c0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:58.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.019+0000 7fc9e4870740 1 --2- 172.21.15.42:0/3313145185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5647762e4860 0x5647762fc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:58.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.019+0000 7fc9c4c00640 0 client.26149 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:12:58.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.019+0000 7fc9e4870740 1 -- 172.21.15.42:0/3313145185 >> 172.21.15.42:0/3313145185 conn(0x5647762e0ed0 msgr2=0x5647762e6300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:58.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.019+0000 7fc9e4870740 1 -- 172.21.15.42:0/3313145185 shutdown_connections 2024-08-26T00:12:58.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.019+0000 7fc9e4870740 1 -- 172.21.15.42:0/3313145185 wait complete. 2024-08-26T00:12:58.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.020+0000 7fc9e4870740 20 client.26149 trim_cache size 0 max 16384 2024-08-26T00:12:58.025 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:12:58.025 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-08-26T00:12:58.025 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {} 2024-08-26T00:12:58.025 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:12:58.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.020+0000 7fc9e1e00640 1 -- 172.21.15.42:0/2433970823 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc9c00a2c00 msgr2=0x7fc9c00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:58.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.020+0000 7fc9e1e00640 1 --2- 172.21.15.42:0/2433970823 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc9c00a2c00 0x7fc9c00a50c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0a4280 tx=0x7fc9cc0046c0 comp rx=0 tx=0).stop 2024-08-26T00:12:58.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.020+0000 7fc9e1e00640 1 -- 172.21.15.42:0/2433970823 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9dc102ac0 msgr2=0x7fc9dc198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:58.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.020+0000 7fc9e1e00640 1 --2- 172.21.15.42:0/2433970823 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9dc102ac0 0x7fc9dc198280 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00e9c0 tx=0x7fc9cc00ee80 comp rx=0 tx=0).stop 2024-08-26T00:12:58.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.020+0000 7fc9e1e00640 1 -- 172.21.15.42:0/2433970823 shutdown_connections 2024-08-26T00:12:58.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.020+0000 7fc9e1e00640 1 --2- 172.21.15.42:0/2433970823 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc9c00a2c00 0x7fc9c00a50c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:58.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.020+0000 7fc9e1e00640 1 --2- 172.21.15.42:0/2433970823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9dc10bef0 0x7fc9dc19cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:58.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.020+0000 7fc9e1e00640 1 --2- 172.21.15.42:0/2433970823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9dc1033e0 0x7fc9dc1987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:58.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.020+0000 7fc9e1e00640 1 --2- 172.21.15.42:0/2433970823 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9dc102ac0 0x7fc9dc198280 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:58.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.020+0000 7fc9e1e00640 1 -- 172.21.15.42:0/2433970823 >> 172.21.15.42:0/2433970823 conn(0x7fc9dc0fc520 msgr2=0x7fc9dc0fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:58.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.020+0000 7fc9e1e00640 1 -- 172.21.15.42:0/2433970823 shutdown_connections 2024-08-26T00:12:58.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:58.021+0000 7fc9e1e00640 1 -- 172.21.15.42:0/2433970823 wait complete. 2024-08-26T00:12:58.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:12:58 smithi043 ceph-mon[22091]: pgmap v652: 97 pgs: 97 active+clean; 1.3 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 517 op/s 2024-08-26T00:12:58.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:12:58 smithi181 ceph-mon[22102]: pgmap v652: 97 pgs: 97 active+clean; 1.3 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 517 op/s 2024-08-26T00:12:58.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:12:58 smithi042 ceph-mon[17225]: pgmap v652: 97 pgs: 97 active+clean; 1.3 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 517 op/s 2024-08-26T00:12:58.914 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-26T00:12:58.915 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:12:59.333 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:12:59.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.942+0000 7f855a000640 1 -- 172.21.15.42:0/259189668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8554105cd0 msgr2=0x7f8554106160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:59.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.942+0000 7f855a000640 1 --2- 172.21.15.42:0/259189668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8554105cd0 0x7f8554106160 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f854c009be0 tx=0x7f854c02a740 comp rx=0 tx=0).stop 2024-08-26T00:12:59.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.942+0000 7f855a000640 1 -- 172.21.15.42:0/259189668 shutdown_connections 2024-08-26T00:12:59.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.942+0000 7f855a000640 1 --2- 172.21.15.42:0/259189668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8554105cd0 0x7f8554106160 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:59.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.942+0000 7f855a000640 1 --2- 172.21.15.42:0/259189668 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85541011e0 0x7f85541056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:59.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.942+0000 7f855a000640 1 --2- 172.21.15.42:0/259189668 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85541008c0 0x7f8554100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:59.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.942+0000 7f855a000640 1 -- 172.21.15.42:0/259189668 >> 172.21.15.42:0/259189668 conn(0x7f85540fc530 msgr2=0x7f85540fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:12:59.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.942+0000 7f855a000640 1 -- 172.21.15.42:0/259189668 shutdown_connections 2024-08-26T00:12:59.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.942+0000 7f855a000640 1 -- 172.21.15.42:0/259189668 wait complete. 2024-08-26T00:12:59.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.944+0000 7f855a000640 1 Processor -- start 2024-08-26T00:12:59.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.944+0000 7f855a000640 1 -- start start 2024-08-26T00:12:59.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.944+0000 7f855a000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85541008c0 0x7f85541a4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:59.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.944+0000 7f855a000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85541011e0 0x7f85541a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:59.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.944+0000 7f855a000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8554105cd0 0x7f855419e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:59.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.944+0000 7f855a000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f85541182f0 con 0x7f85541008c0 2024-08-26T00:12:59.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.944+0000 7f855a000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8554118170 con 0x7f8554105cd0 2024-08-26T00:12:59.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.944+0000 7f855a000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8554118470 con 0x7f85541011e0 2024-08-26T00:12:59.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.945+0000 7f8553e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8554105cd0 0x7f855419e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:59.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.945+0000 7f8552a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85541011e0 0x7f85541a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:59.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.945+0000 7f8553e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8554105cd0 0x7f855419e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:38568/0 (socket says 172.21.15.42:38568) 2024-08-26T00:12:59.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.945+0000 7f8553e00640 1 -- 172.21.15.42:0/43570701 learned_addr learned my addr 172.21.15.42:0/43570701 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:12:59.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.945+0000 7f8552a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85541011e0 0x7f85541a4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:39538/0 (socket says 172.21.15.42:39538) 2024-08-26T00:12:59.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.945+0000 7f8553e00640 1 -- 172.21.15.42:0/43570701 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85541011e0 msgr2=0x7f85541a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:12:59.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.945+0000 7f8553e00640 1 --2- 172.21.15.42:0/43570701 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85541011e0 0x7f85541a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:59.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.945+0000 7f8553e00640 1 -- 172.21.15.42:0/43570701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85541008c0 msgr2=0x7f85541a4590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-26T00:12:59.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.946+0000 7f8553e00640 1 --2- 172.21.15.42:0/43570701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85541008c0 0x7f85541a4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:12:59.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.946+0000 7f8553e00640 1 -- 172.21.15.42:0/43570701 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855419eed0 con 0x7f8554105cd0 2024-08-26T00:12:59.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.946+0000 7f8552a00640 1 --2- 172.21.15.42:0/43570701 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85541011e0 0x7f85541a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:12:59.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.947+0000 7f8553e00640 1 --2- 172.21.15.42:0/43570701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8554105cd0 0x7f855419e660 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f854c031040 tx=0x7f854c030940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:59.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.948+0000 7f854be00640 1 -- 172.21.15.42:0/43570701 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c040020 con 0x7f8554105cd0 2024-08-26T00:12:59.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.948+0000 7f854be00640 1 -- 172.21.15.42:0/43570701 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f854c031920 con 0x7f8554105cd0 2024-08-26T00:12:59.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.948+0000 7f855a000640 1 -- 172.21.15.42:0/43570701 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f855419f160 con 0x7f8554105cd0 2024-08-26T00:12:59.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.949+0000 7f854be00640 1 -- 172.21.15.42:0/43570701 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c036040 con 0x7f8554105cd0 2024-08-26T00:12:59.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.949+0000 7f855a000640 1 -- 172.21.15.42:0/43570701 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85541ab340 con 0x7f8554105cd0 2024-08-26T00:12:59.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.950+0000 7f855a000640 1 -- 172.21.15.42:0/43570701 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f855406ae10 con 0x7f8554105cd0 2024-08-26T00:12:59.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.954+0000 7f854be00640 1 -- 172.21.15.42:0/43570701 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f854c043020 con 0x7f8554105cd0 2024-08-26T00:12:59.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.956+0000 7f854be00640 1 --2- 172.21.15.42:0/43570701 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f85380a2cc0 0x7f85380a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:12:59.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.956+0000 7f854be00640 1 -- 172.21.15.42:0/43570701 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f854c0efe20 con 0x7f8554105cd0 2024-08-26T00:12:59.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.957+0000 7f8553400640 1 --2- 172.21.15.42:0/43570701 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f85380a2cc0 0x7f85380a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:12:59.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.959+0000 7f8553400640 1 --2- 172.21.15.42:0/43570701 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f85380a2cc0 0x7f85380a5180 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8544005fd0 tx=0x7f8544005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:12:59.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:12:59.964+0000 7f854be00640 1 -- 172.21.15.42:0/43570701 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f854c04a020 con 0x7f8554105cd0 2024-08-26T00:13:00.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:00.231+0000 7f855a000640 1 -- 172.21.15.42:0/43570701 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85541ab510 con 0x7f8554105cd0 2024-08-26T00:13:00.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:00.232+0000 7f854be00640 1 -- 172.21.15.42:0/43570701 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11919 (secure 0 0 0) 0x7f854c0b8030 con 0x7f8554105cd0 2024-08-26T00:13:00.234 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:13:00.234 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":32,"btime":"2024-08-26T00:12:35:857942+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3168581452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3168581452},{"type":"v1","addr":"172.21.15.42:6839","nonce":3168581452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/3533492491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":3533492491},{"type":"v1","addr":"172.21.15.42:6841","nonce":3533492491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-26T00:00:30.169633+0000","modified":"2024-08-26T00:12:35.440797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24532,"mds_1":24527,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":189,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6839/2653014277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2653014277},{"type":"v1","addr":"172.21.15.43:6839","nonce":2653014277}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24532,"qdb_cluster":[24532,24527,24514]},"id":1}]} 2024-08-26T00:13:00.234 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 32 2024-08-26T00:13:00.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:00.234+0000 7f855a000640 1 -- 172.21.15.42:0/43570701 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f85380a2cc0 msgr2=0x7f85380a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:00.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:00.234+0000 7f855a000640 1 --2- 172.21.15.42:0/43570701 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f85380a2cc0 0x7f85380a5180 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8544005fd0 tx=0x7f8544005850 comp rx=0 tx=0).stop 2024-08-26T00:13:00.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:00.234+0000 7f855a000640 1 -- 172.21.15.42:0/43570701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8554105cd0 msgr2=0x7f855419e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:00.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:00.234+0000 7f855a000640 1 --2- 172.21.15.42:0/43570701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8554105cd0 0x7f855419e660 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f854c031040 tx=0x7f854c030940 comp rx=0 tx=0).stop 2024-08-26T00:13:00.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:00.234+0000 7f855a000640 1 -- 172.21.15.42:0/43570701 shutdown_connections 2024-08-26T00:13:00.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:00.234+0000 7f855a000640 1 --2- 172.21.15.42:0/43570701 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f85380a2cc0 0x7f85380a5180 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:00.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:00.234+0000 7f855a000640 1 --2- 172.21.15.42:0/43570701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8554105cd0 0x7f855419e660 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:00.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:00.234+0000 7f855a000640 1 --2- 172.21.15.42:0/43570701 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85541011e0 0x7f85541a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:00.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:00.234+0000 7f855a000640 1 --2- 172.21.15.42:0/43570701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85541008c0 0x7f85541a4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:00.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:00.235+0000 7f855a000640 1 -- 172.21.15.42:0/43570701 >> 172.21.15.42:0/43570701 conn(0x7f85540fc530 msgr2=0x7f855410f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:13:00.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:00.235+0000 7f855a000640 1 -- 172.21.15.42:0/43570701 shutdown_connections 2024-08-26T00:13:00.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:00.235+0000 7f855a000640 1 -- 172.21.15.42:0/43570701 wait complete. 2024-08-26T00:13:00.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:00 smithi043 ceph-mon[22091]: pgmap v653: 97 pgs: 97 active+clean; 1.3 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 470 op/s 2024-08-26T00:13:00.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:00 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/43570701' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:13:00.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:00 smithi042 ceph-mon[17225]: pgmap v653: 97 pgs: 97 active+clean; 1.3 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 470 op/s 2024-08-26T00:13:00.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:00 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/43570701' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:13:00.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:00 smithi181 ceph-mon[22102]: pgmap v653: 97 pgs: 97 active+clean; 1.3 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 470 op/s 2024-08-26T00:13:00.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:00 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/43570701' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:13:01.237 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-26T00:13:01.631 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:13:02.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.487+0000 7f3e3fe00640 1 -- 172.21.15.42:0/1464004409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e40101760 msgr2=0x7f3e40101bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:02.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.487+0000 7f3e3fe00640 1 --2- 172.21.15.42:0/1464004409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e40101760 0x7f3e40101bc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c009900 tx=0x7f3e2c02a410 comp rx=0 tx=0).stop 2024-08-26T00:13:02.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.487+0000 7f3e3fe00640 1 -- 172.21.15.42:0/1464004409 shutdown_connections 2024-08-26T00:13:02.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.487+0000 7f3e3fe00640 1 --2- 172.21.15.42:0/1464004409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e40102100 0x7f3e4010e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.487+0000 7f3e3fe00640 1 --2- 172.21.15.42:0/1464004409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e40101760 0x7f3e40101bc0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.487+0000 7f3e3fe00640 1 --2- 172.21.15.42:0/1464004409 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e40107760 0x7f3e40107b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.487+0000 7f3e3fe00640 1 -- 172.21.15.42:0/1464004409 >> 172.21.15.42:0/1464004409 conn(0x7f3e400fd4e0 msgr2=0x7f3e400ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:13:02.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.487+0000 7f3e3fe00640 1 -- 172.21.15.42:0/1464004409 shutdown_connections 2024-08-26T00:13:02.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.487+0000 7f3e3fe00640 1 -- 172.21.15.42:0/1464004409 wait complete. 2024-08-26T00:13:02.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.488+0000 7f3e3fe00640 1 Processor -- start 2024-08-26T00:13:02.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.488+0000 7f3e3fe00640 1 -- start start 2024-08-26T00:13:02.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.489+0000 7f3e3fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e40101760 0x7f3e40074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:02.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.489+0000 7f3e3fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e40102100 0x7f3e400747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:02.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.489+0000 7f3e3fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e40107760 0x7f3e40074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:02.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.489+0000 7f3e3fe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3e40111bb0 con 0x7f3e40107760 2024-08-26T00:13:02.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.489+0000 7f3e3fe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3e40111a30 con 0x7f3e40101760 2024-08-26T00:13:02.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.489+0000 7f3e3fe00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3e40111d30 con 0x7f3e40102100 2024-08-26T00:13:02.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.489+0000 7f3e3ea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e40101760 0x7f3e40074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:02.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.489+0000 7f3e3ea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e40101760 0x7f3e40074290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:38586/0 (socket says 172.21.15.42:38586) 2024-08-26T00:13:02.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.489+0000 7f3e3f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e40107760 0x7f3e40074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:02.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.489+0000 7f3e3ea00640 1 -- 172.21.15.42:0/4059985861 learned_addr learned my addr 172.21.15.42:0/4059985861 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:13:02.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.489+0000 7f3e3e000640 1 --2- 172.21.15.42:0/4059985861 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e40102100 0x7f3e400747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:02.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.490+0000 7f3e3ea00640 1 -- 172.21.15.42:0/4059985861 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e40102100 msgr2=0x7f3e400747d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:02.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.490+0000 7f3e3ea00640 1 --2- 172.21.15.42:0/4059985861 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e40102100 0x7f3e400747d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.490+0000 7f3e3ea00640 1 -- 172.21.15.42:0/4059985861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e40107760 msgr2=0x7f3e40074d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:02.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.490+0000 7f3e3ea00640 1 --2- 172.21.15.42:0/4059985861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e40107760 0x7f3e40074d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.490+0000 7f3e3ea00640 1 -- 172.21.15.42:0/4059985861 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e401aaa40 con 0x7f3e40101760 2024-08-26T00:13:02.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.490+0000 7f3e3e000640 1 --2- 172.21.15.42:0/4059985861 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e40102100 0x7f3e400747d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:13:02.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.490+0000 7f3e3ea00640 1 --2- 172.21.15.42:0/4059985861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e40101760 0x7f3e40074290 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000e9f0 tx=0x7f3e3000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:13:02.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.493+0000 7f3e37400640 1 -- 172.21.15.42:0/4059985861 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3000cd80 con 0x7f3e40101760 2024-08-26T00:13:02.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.493+0000 7f3e37400640 1 -- 172.21.15.42:0/4059985861 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e30005500 con 0x7f3e40101760 2024-08-26T00:13:02.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.493+0000 7f3e37400640 1 -- 172.21.15.42:0/4059985861 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e30010690 con 0x7f3e40101760 2024-08-26T00:13:02.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.493+0000 7f3e3fe00640 1 -- 172.21.15.42:0/4059985861 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e401aac70 con 0x7f3e40101760 2024-08-26T00:13:02.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.493+0000 7f3e3fe00640 1 -- 172.21.15.42:0/4059985861 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e401ab130 con 0x7f3e40101760 2024-08-26T00:13:02.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.497+0000 7f3e37400640 1 -- 172.21.15.42:0/4059985861 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3e30004f60 con 0x7f3e40101760 2024-08-26T00:13:02.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.498+0000 7f3e4868b740 1 Processor -- start 2024-08-26T00:13:02.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.498+0000 7f3e4868b740 1 -- start start 2024-08-26T00:13:02.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.498+0000 7f3e4868b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027fef5a30 0x56027fef5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:02.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.498+0000 7f3e4868b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027fef6350 0x56027ff006d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:02.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.498+0000 7f3e4868b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027ff00c10 0x56027ff03000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:02.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.498+0000 7f3e4868b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56027fe5bf30 con 0x56027fef5a30 2024-08-26T00:13:02.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.498+0000 7f3e4868b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56027fdf35a0 con 0x56027ff00c10 2024-08-26T00:13:02.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.498+0000 7f3e4868b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56027fe57ef0 con 0x56027fef6350 2024-08-26T00:13:02.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.498+0000 7f3e3ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027fef6350 0x56027ff006d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:02.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.498+0000 7f3e3ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027fef6350 0x56027ff006d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:39576/0 (socket says 172.21.15.42:39576) 2024-08-26T00:13:02.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.498+0000 7f3e3ea00640 1 -- 172.21.15.42:0/4215191385 learned_addr learned my addr 172.21.15.42:0/4215191385 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:13:02.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.499+0000 7f3e3f400640 1 --2- 172.21.15.42:0/4215191385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027fef5a30 0x56027fef5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:02.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.499+0000 7f3e3e000640 1 --2- 172.21.15.42:0/4215191385 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027ff00c10 0x56027ff03000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:02.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.499+0000 7f3e3f400640 1 -- 172.21.15.42:0/4215191385 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027fef6350 msgr2=0x56027ff006d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:02.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.499+0000 7f3e3f400640 1 --2- 172.21.15.42:0/4215191385 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027fef6350 0x56027ff006d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.499+0000 7f3e3f400640 1 -- 172.21.15.42:0/4215191385 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027ff00c10 msgr2=0x56027ff03000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:02.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.499+0000 7f3e3f400640 1 --2- 172.21.15.42:0/4215191385 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027ff00c10 0x56027ff03000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.499+0000 7f3e3f400640 1 -- 172.21.15.42:0/4215191385 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56027fbcd3c0 con 0x56027fef5a30 2024-08-26T00:13:02.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.499+0000 7f3e3ea00640 1 --2- 172.21.15.42:0/4215191385 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027fef6350 0x56027ff006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:13:02.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.499+0000 7f3e37400640 1 --2- 172.21.15.42:0/4059985861 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3e240a2c00 0x7f3e240a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:02.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.499+0000 7f3e37400640 1 -- 172.21.15.42:0/4059985861 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f3e300cf4d0 con 0x7f3e40101760 2024-08-26T00:13:02.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.500+0000 7f3e3f400640 1 --2- 172.21.15.42:0/4215191385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027fef5a30 0x56027fef5e10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3e38009f50 tx=0x7f3e38003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8daf12878b5409b server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:13:02.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.500+0000 7f3e3ea00640 1 --2- 172.21.15.42:0/4059985861 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3e240a2c00 0x7f3e240a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:02.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.500+0000 7f3e2be00640 1 -- 172.21.15.42:0/4215191385 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e38011440 con 0x56027fef5a30 2024-08-26T00:13:02.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.500+0000 7f3e2be00640 1 -- 172.21.15.42:0/4215191385 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e38015030 con 0x56027fef5a30 2024-08-26T00:13:02.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.500+0000 7f3e2be00640 1 -- 172.21.15.42:0/4215191385 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e380109a0 con 0x56027fef5a30 2024-08-26T00:13:02.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.501+0000 7f3e4868b740 1 -- 172.21.15.42:0/4215191385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027fef5a30 msgr2=0x56027fef5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:02.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.501+0000 7f3e4868b740 1 --2- 172.21.15.42:0/4215191385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027fef5a30 0x56027fef5e10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3e38009f50 tx=0x7f3e38003e00 comp rx=0 tx=0).stop 2024-08-26T00:13:02.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.501+0000 7f3e3ea00640 1 --2- 172.21.15.42:0/4059985861 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3e240a2c00 0x7f3e240a50c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3e300986c0 tx=0x7f3e300d2f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:13:02.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.501+0000 7f3e4868b740 1 -- 172.21.15.42:0/4215191385 shutdown_connections 2024-08-26T00:13:02.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.501+0000 7f3e4868b740 1 --2- 172.21.15.42:0/4215191385 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027ff00c10 0x56027ff03000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.501+0000 7f3e4868b740 1 --2- 172.21.15.42:0/4215191385 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027fef6350 0x56027ff006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.501+0000 7f3e4868b740 1 --2- 172.21.15.42:0/4215191385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027fef5a30 0x56027fef5e10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.501+0000 7f3e4868b740 1 -- 172.21.15.42:0/4215191385 >> 172.21.15.42:0/4215191385 conn(0x56027fef1fc0 msgr2=0x56027fef23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:13:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.501+0000 7f3e4868b740 1 -- 172.21.15.42:0/4215191385 shutdown_connections 2024-08-26T00:13:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.501+0000 7f3e4868b740 1 -- 172.21.15.42:0/4215191385 wait complete. 2024-08-26T00:13:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.501+0000 7f3e4868b740 1 -- start start 2024-08-26T00:13:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.502+0000 7f3e4868b740 1 Processor -- start 2024-08-26T00:13:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.502+0000 7f3e4868b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027fef5a30 0x56027fefda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.502+0000 7f3e4868b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027fef6350 0x56027fefdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.502+0000 7f3e4868b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027ff00c10 0x56027fefe4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.502+0000 7f3e4868b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56027ff03830 con 0x56027fef5a30 2024-08-26T00:13:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.502+0000 7f3e4868b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56027fe16de0 con 0x56027fef6350 2024-08-26T00:13:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.502+0000 7f3e4868b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56027ff039b0 con 0x56027ff00c10 2024-08-26T00:13:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.502+0000 7f3e4868b740 10 client.0 _ll_register_callbacks cb 0x56027fe057b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:13:02.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.503+0000 7f3e3e000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027fef6350 0x56027fefdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:02.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.503+0000 7f3e3f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027fef5a30 0x56027fefda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:02.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.503+0000 7f3e3e000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027fef6350 0x56027fefdf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:38610/0 (socket says 172.21.15.42:38610) 2024-08-26T00:13:02.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.503+0000 7f3e3e000640 1 -- 172.21.15.42:0/617221363 learned_addr learned my addr 172.21.15.42:0/617221363 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:13:02.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.503+0000 7f3e3f400640 1 --2- 172.21.15.42:0/617221363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027ff00c10 0x56027fefe4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:02.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.503+0000 7f3e3e000640 1 -- 172.21.15.42:0/617221363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027ff00c10 msgr2=0x56027fefe4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:02.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.503+0000 7f3e3e000640 1 --2- 172.21.15.42:0/617221363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027ff00c10 0x56027fefe4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.503+0000 7f3e3e000640 1 -- 172.21.15.42:0/617221363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027fef5a30 msgr2=0x56027fefda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:02.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.503+0000 7f3e3e000640 1 --2- 172.21.15.42:0/617221363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027fef5a30 0x56027fefda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.503+0000 7f3e3e000640 1 -- 172.21.15.42:0/617221363 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56027ff0ccd0 con 0x56027fef6350 2024-08-26T00:13:02.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.503+0000 7f3e3f400640 1 --2- 172.21.15.42:0/617221363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027ff00c10 0x56027fefe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-26T00:13:02.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.503+0000 7f3e3e000640 1 --2- 172.21.15.42:0/617221363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027fef6350 0x56027fefdf70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c009230 tx=0x7f3e2c005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b41f270b01feb021 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:13:02.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.503+0000 7f3e28c00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:13:02.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.504+0000 7f3e28c00640 1 -- 172.21.15.42:0/617221363 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c035040 con 0x56027fef6350 2024-08-26T00:13:02.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.504+0000 7f3e28c00640 1 -- 172.21.15.42:0/617221363 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f3e2c0048c0 con 0x56027fef6350 2024-08-26T00:13:02.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.504+0000 7f3e4868b740 1 -- 172.21.15.42:0/617221363 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e38015030 con 0x56027fef6350 2024-08-26T00:13:02.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.504+0000 7f3e28c00640 1 -- 172.21.15.42:0/617221363 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3e2c004ac0 con 0x56027fef6350 2024-08-26T00:13:02.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.504+0000 7f3e4868b740 10 client.26201 fetch_fsmap learned FSMap version 32 2024-08-26T00:13:02.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.504+0000 7f3e4868b740 1 -- 172.21.15.42:0/617221363 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56027ff0f5d0 con 0x56027fef6350 2024-08-26T00:13:02.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.504+0000 7f3e28c00640 1 -- 172.21.15.42:0/617221363 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e38015030 con 0x56027fef6350 2024-08-26T00:13:02.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.504+0000 7f3e28c00640 1 -- 172.21.15.42:0/617221363 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f3e2c031540 con 0x56027fef6350 2024-08-26T00:13:02.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.505+0000 7f3e4868b740 10 client.26201 fetch_fsmap finished waiting for FSMap version 32 2024-08-26T00:13:02.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.505+0000 7f3e4868b740 10 client.26201 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-26T00:13:02.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.505+0000 7f3e4868b740 20 client.26201 populate_metadata read hostname 'smithi042' 2024-08-26T00:13:02.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.505+0000 7f3e4868b740 1 --2- 172.21.15.42:0/617221363 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x56027ff10a90 0x56027ff12ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:02.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.505+0000 7f3e4868b740 4 client.26201 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:13:02.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.505+0000 7f3e4868b740 1 -- 172.21.15.42:0/617221363 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56027fe694a0 con 0x56027ff10a90 2024-08-26T00:13:02.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.505+0000 7f3e3f400640 1 --2- 172.21.15.42:0/617221363 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x56027ff10a90 0x56027ff12ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:02.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.505+0000 7f3e3f400640 1 --2- 172.21.15.42:0/617221363 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x56027ff10a90 0x56027ff12ea0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=91b1afed8a65c424 server_cookie=b30a4d9d06b48b39 in_seq=0 out_seq=0 2024-08-26T00:13:02.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.505+0000 7f3e28c00640 10 client.26201 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:13:02.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.506+0000 7f3e28c00640 1 -- 172.21.15.42:0/617221363 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56027fe694a0 con 0x56027ff10a90 2024-08-26T00:13:02.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.506+0000 7f3e28c00640 10 client.26201 handle_command_reply: tid=0 2024-08-26T00:13:02.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.506+0000 7f3e4868b740 1 client.26201 shutdown 2024-08-26T00:13:02.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.506+0000 7f3e4868b740 1 -- 172.21.15.42:0/617221363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027fef6350 msgr2=0x56027fefdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:02.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.506+0000 7f3e4868b740 1 --2- 172.21.15.42:0/617221363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027fef6350 0x56027fefdf70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c009230 tx=0x7f3e2c005270 comp rx=0 tx=0).stop 2024-08-26T00:13:02.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.506+0000 7f3e4868b740 1 -- 172.21.15.42:0/617221363 shutdown_connections 2024-08-26T00:13:02.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.506+0000 7f3e4868b740 1 --2- 172.21.15.42:0/617221363 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x56027ff10a90 0x56027ff12ea0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.507+0000 7f3e4868b740 1 --2- 172.21.15.42:0/617221363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027ff00c10 0x56027fefe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.507+0000 7f3e4868b740 1 --2- 172.21.15.42:0/617221363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027fef6350 0x56027fefdf70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.507+0000 7f3e4868b740 1 --2- 172.21.15.42:0/617221363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027fef5a30 0x56027fefda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.507+0000 7f3e28c00640 0 client.26201 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:13:02.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.507+0000 7f3e4868b740 1 -- 172.21.15.42:0/617221363 >> 172.21.15.42:0/617221363 conn(0x56027fef1fc0 msgr2=0x56027fef7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:13:02.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.507+0000 7f3e4868b740 1 -- 172.21.15.42:0/617221363 shutdown_connections 2024-08-26T00:13:02.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.507+0000 7f3e4868b740 1 -- 172.21.15.42:0/617221363 wait complete. 2024-08-26T00:13:02.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.507+0000 7f3e4868b740 20 client.26201 trim_cache size 0 max 16384 2024-08-26T00:13:02.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.521+0000 7f3e4868b740 1 Processor -- start 2024-08-26T00:13:02.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.521+0000 7f3e4868b740 1 -- start start 2024-08-26T00:13:02.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.521+0000 7f3e4868b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027fef5a30 0x56027fef8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:02.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.521+0000 7f3e4868b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027fef6350 0x56027fefc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:02.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.521+0000 7f3e4868b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027ff00c10 0x56027ff187b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:02.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.521+0000 7f3e4868b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3e401b60e0 con 0x56027fef5a30 2024-08-26T00:13:02.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.521+0000 7f3e4868b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3e401b38f0 con 0x56027ff00c10 2024-08-26T00:13:02.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.521+0000 7f3e4868b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3e401b1720 con 0x56027fef6350 2024-08-26T00:13:02.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.521+0000 7f3e3f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027fef5a30 0x56027fef8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:02.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.521+0000 7f3e3f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027fef5a30 0x56027fef8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57894/0 (socket says 172.21.15.42:57894) 2024-08-26T00:13:02.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.521+0000 7f3e3f400640 1 -- 172.21.15.42:0/738867348 learned_addr learned my addr 172.21.15.42:0/738867348 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:13:02.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.521+0000 7f3e3e000640 1 --2- 172.21.15.42:0/738867348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027fef6350 0x56027fefc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:02.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.521+0000 7f3e3f400640 1 --2- 172.21.15.42:0/738867348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027ff00c10 0x56027ff187b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:02.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.522+0000 7f3e3e000640 1 -- 172.21.15.42:0/738867348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027ff00c10 msgr2=0x56027ff187b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:02.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.522+0000 7f3e3e000640 1 --2- 172.21.15.42:0/738867348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027ff00c10 0x56027ff187b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.522+0000 7f3e3e000640 1 -- 172.21.15.42:0/738867348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027fef5a30 msgr2=0x56027fef8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:02.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.522+0000 7f3e3e000640 1 --2- 172.21.15.42:0/738867348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027fef5a30 0x56027fef8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.522+0000 7f3e3e000640 1 -- 172.21.15.42:0/738867348 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56027fef3070 con 0x56027fef6350 2024-08-26T00:13:02.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.522+0000 7f3e3e000640 1 --2- 172.21.15.42:0/738867348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027fef6350 0x56027fefc300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c02a930 tx=0x7f3e2c02a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7563bf9479e01f15 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:13:02.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.522+0000 7f3e2b400640 1 -- 172.21.15.42:0/738867348 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c035050 con 0x56027fef6350 2024-08-26T00:13:02.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.522+0000 7f3e2b400640 1 -- 172.21.15.42:0/738867348 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e2c040070 con 0x56027fef6350 2024-08-26T00:13:02.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.522+0000 7f3e2b400640 1 -- 172.21.15.42:0/738867348 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c0046c0 con 0x56027fef6350 2024-08-26T00:13:02.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.523+0000 7f3e4868b740 1 -- 172.21.15.42:0/738867348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027fef6350 msgr2=0x56027fefc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:02.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.523+0000 7f3e4868b740 1 --2- 172.21.15.42:0/738867348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027fef6350 0x56027fefc300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c02a930 tx=0x7f3e2c02a410 comp rx=0 tx=0).stop 2024-08-26T00:13:02.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.523+0000 7f3e4868b740 1 -- 172.21.15.42:0/738867348 shutdown_connections 2024-08-26T00:13:02.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.523+0000 7f3e4868b740 1 --2- 172.21.15.42:0/738867348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027ff00c10 0x56027ff187b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.523+0000 7f3e4868b740 1 --2- 172.21.15.42:0/738867348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027fef6350 0x56027fefc300 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.523+0000 7f3e4868b740 1 --2- 172.21.15.42:0/738867348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027fef5a30 0x56027fef8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.523+0000 7f3e4868b740 1 -- 172.21.15.42:0/738867348 >> 172.21.15.42:0/738867348 conn(0x56027fef1fc0 msgr2=0x56027feff9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:13:02.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.523+0000 7f3e4868b740 1 -- 172.21.15.42:0/738867348 shutdown_connections 2024-08-26T00:13:02.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.523+0000 7f3e4868b740 1 -- 172.21.15.42:0/738867348 wait complete. 2024-08-26T00:13:02.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.523+0000 7f3e4868b740 1 -- start start 2024-08-26T00:13:02.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.524+0000 7f3e4868b740 1 Processor -- start 2024-08-26T00:13:02.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.524+0000 7f3e4868b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027fef5a30 0x56027ff04b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:02.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.524+0000 7f3e4868b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027fef6350 0x56027ff05060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:02.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.524+0000 7f3e4868b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027ff00c10 0x56027ff055a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:02.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.524+0000 7f3e4868b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3e401b1db0 con 0x56027ff00c10 2024-08-26T00:13:02.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.524+0000 7f3e4868b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3e401b3220 con 0x56027fef6350 2024-08-26T00:13:02.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.524+0000 7f3e4868b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3e401b2480 con 0x56027fef5a30 2024-08-26T00:13:02.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.524+0000 7f3e4868b740 10 client.0 _ll_register_callbacks cb 0x7f3e2c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:13:02.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.524+0000 7f3e3f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027fef5a30 0x56027ff04b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:02.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.524+0000 7f3e3e000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027fef6350 0x56027ff05060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:02.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.524+0000 7f3e3e000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027fef6350 0x56027ff05060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:38632/0 (socket says 172.21.15.42:38632) 2024-08-26T00:13:02.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.524+0000 7f3e3e000640 1 -- 172.21.15.42:0/2123596156 learned_addr learned my addr 172.21.15.42:0/2123596156 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:13:02.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.524+0000 7f3e3f400640 1 --2- 172.21.15.42:0/2123596156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027ff00c10 0x56027ff055a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:02.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.525+0000 7f3e3e000640 1 -- 172.21.15.42:0/2123596156 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027fef5a30 msgr2=0x56027ff04b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:02.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.525+0000 7f3e3e000640 1 --2- 172.21.15.42:0/2123596156 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027fef5a30 0x56027ff04b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.525+0000 7f3e3e000640 1 -- 172.21.15.42:0/2123596156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027ff00c10 msgr2=0x56027ff055a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:02.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.525+0000 7f3e3e000640 1 --2- 172.21.15.42:0/2123596156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027ff00c10 0x56027ff055a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.525+0000 7f3e3e000640 1 -- 172.21.15.42:0/2123596156 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56027fef1df0 con 0x56027fef6350 2024-08-26T00:13:02.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.525+0000 7f3e3e000640 1 --2- 172.21.15.42:0/2123596156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027fef6350 0x56027ff05060 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c031990 tx=0x7f3e2c0048f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2525f2d5286e1d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:13:02.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.525+0000 7f3e28c00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:13:02.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.525+0000 7f3e28c00640 1 -- 172.21.15.42:0/2123596156 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c035040 con 0x56027fef6350 2024-08-26T00:13:02.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.525+0000 7f3e28c00640 1 -- 172.21.15.42:0/2123596156 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f3e2c031d80 con 0x56027fef6350 2024-08-26T00:13:02.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.525+0000 7f3e4868b740 1 -- 172.21.15.42:0/2123596156 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e2c040070 con 0x56027fef6350 2024-08-26T00:13:02.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.526+0000 7f3e28c00640 1 -- 172.21.15.42:0/2123596156 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3e2c06a050 con 0x56027fef6350 2024-08-26T00:13:02.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.526+0000 7f3e4868b740 10 client.26207 fetch_fsmap learned FSMap version 32 2024-08-26T00:13:02.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.526+0000 7f3e4868b740 1 -- 172.21.15.42:0/2123596156 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56027fef5860 con 0x56027fef6350 2024-08-26T00:13:02.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.526+0000 7f3e28c00640 1 -- 172.21.15.42:0/2123596156 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e2c040070 con 0x56027fef6350 2024-08-26T00:13:02.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.526+0000 7f3e28c00640 1 -- 172.21.15.42:0/2123596156 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f3e2c061070 con 0x56027fef6350 2024-08-26T00:13:02.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.526+0000 7f3e4868b740 10 client.26207 fetch_fsmap finished waiting for FSMap version 32 2024-08-26T00:13:02.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.526+0000 7f3e4868b740 10 client.26207 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-26T00:13:02.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.526+0000 7f3e4868b740 20 client.26207 populate_metadata read hostname 'smithi042' 2024-08-26T00:13:02.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.526+0000 7f3e4868b740 1 --2- 172.21.15.42:0/2123596156 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x56027ff7bd50 0x56027ff7e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:02.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.526+0000 7f3e4868b740 4 client.26207 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:13:02.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.526+0000 7f3e4868b740 1 -- 172.21.15.42:0/2123596156 --> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56027fe639b0 con 0x56027ff7bd50 2024-08-26T00:13:02.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.527+0000 7f3e3f400640 1 --2- 172.21.15.42:0/2123596156 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x56027ff7bd50 0x56027ff7e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:02.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.527+0000 7f3e3f400640 1 --2- 172.21.15.42:0/2123596156 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x56027ff7bd50 0x56027ff7e170 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4053c985f858d9ab server_cookie=d5439e2c3f7fe99c in_seq=0 out_seq=0 2024-08-26T00:13:02.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.527+0000 7f3e28c00640 10 client.26207 ms_handle_connect on v2:172.21.15.181:6836/3332104552 2024-08-26T00:13:02.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.529+0000 7f3e28c00640 1 -- 172.21.15.42:0/2123596156 <== mds.2 v2:172.21.15.181:6836/3332104552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+67520 (crc 0 0 0) 0x56027fe639b0 con 0x56027ff7bd50 2024-08-26T00:13:02.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.529+0000 7f3e28c00640 10 client.26207 handle_command_reply: tid=0 2024-08-26T00:13:02.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.529+0000 7f3e4868b740 1 client.26207 shutdown 2024-08-26T00:13:02.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.529+0000 7f3e4868b740 1 -- 172.21.15.42:0/2123596156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027fef6350 msgr2=0x56027ff05060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:02.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.529+0000 7f3e4868b740 1 --2- 172.21.15.42:0/2123596156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027fef6350 0x56027ff05060 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c031990 tx=0x7f3e2c0048f0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.529+0000 7f3e4868b740 1 -- 172.21.15.42:0/2123596156 shutdown_connections 2024-08-26T00:13:02.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.529+0000 7f3e4868b740 1 --2- 172.21.15.42:0/2123596156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027ff00c10 0x56027ff055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.529+0000 7f3e4868b740 1 --2- 172.21.15.42:0/2123596156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027fef6350 0x56027ff05060 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.529+0000 7f3e4868b740 1 --2- 172.21.15.42:0/2123596156 >> [v2:172.21.15.181:6836/3332104552,v1:172.21.15.181:6837/3332104552] conn(0x56027ff7bd50 0x56027ff7e170 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.529+0000 7f3e4868b740 1 --2- 172.21.15.42:0/2123596156 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56027fef5a30 0x56027ff04b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.529+0000 7f3e4868b740 1 -- 172.21.15.42:0/2123596156 >> 172.21.15.42:0/2123596156 conn(0x56027fef1fc0 msgr2=0x56027fef0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:13:02.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.529+0000 7f3e28c00640 0 client.26207 ms_handle_reset on v2:172.21.15.181:6836/3332104552 2024-08-26T00:13:02.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.529+0000 7f3e4868b740 1 -- 172.21.15.42:0/2123596156 shutdown_connections 2024-08-26T00:13:02.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.529+0000 7f3e4868b740 1 -- 172.21.15.42:0/2123596156 wait complete. 2024-08-26T00:13:02.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.530+0000 7f3e4868b740 20 client.26207 trim_cache size 0 max 16384 2024-08-26T00:13:02.533 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-08-26T00:13:02.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.534 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.534 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 587140, 2024-08-26T00:13:02.534 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643815, 2024-08-26T00:13:02.534 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-45.xml" 2024-08-26T00:13:02.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.534 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.534 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 25584189, 2024-08-26T00:13:02.534 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511641405, 2024-08-26T00:13:02.534 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-33.xml" 2024-08-26T00:13:02.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.535 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.535 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 27571746, 2024-08-26T00:13:02.535 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643906, 2024-08-26T00:13:02.535 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-30.xml" 2024-08-26T00:13:02.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.535 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.535 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 47230986, 2024-08-26T00:13:02.535 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635648, 2024-08-26T00:13:02.535 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-62.xml" 2024-08-26T00:13:02.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.536 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.536 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 55421467, 2024-08-26T00:13:02.536 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643897, 2024-08-26T00:13:02.536 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-38.xml" 2024-08-26T00:13:02.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.536 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.536 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 59237164, 2024-08-26T00:13:02.536 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 2199023264395, 2024-08-26T00:13:02.536 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-23.jpg" 2024-08-26T00:13:02.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.536 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.537 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 62546291, 2024-08-26T00:13:02.537 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643824, 2024-08-26T00:13:02.537 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-38.xml" 2024-08-26T00:13:02.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.537 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.537 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 84878492, 2024-08-26T00:13:02.537 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 2199023264399, 2024-08-26T00:13:02.537 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-22.jpg" 2024-08-26T00:13:02.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.537 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.537 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 124185723, 2024-08-26T00:13:02.537 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637985, 2024-08-26T00:13:02.538 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-22.jpg" 2024-08-26T00:13:02.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.538 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.538 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 139014626, 2024-08-26T00:13:02.538 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643878, 2024-08-26T00:13:02.538 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-57.xml" 2024-08-26T00:13:02.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.538 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.538 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 164980889, 2024-08-26T00:13:02.538 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511638235, 2024-08-26T00:13:02.539 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-39.jpg" 2024-08-26T00:13:02.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.539 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.539 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 165619480, 2024-08-26T00:13:02.539 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635745, 2024-08-26T00:13:02.539 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-14.xml" 2024-08-26T00:13:02.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.539 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.539 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 173097492, 2024-08-26T00:13:02.539 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637894, 2024-08-26T00:13:02.539 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-11.xml" 2024-08-26T00:13:02.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.540 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.540 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 197381015, 2024-08-26T00:13:02.540 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 2199023264348, 2024-08-26T00:13:02.540 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-45.jpg" 2024-08-26T00:13:02.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.540 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.540 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 209673805, 2024-08-26T00:13:02.540 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635728, 2024-08-26T00:13:02.540 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-23.xml" 2024-08-26T00:13:02.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.541 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.541 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 218277181, 2024-08-26T00:13:02.541 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635678, 2024-08-26T00:13:02.541 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-43.xml" 2024-08-26T00:13:02.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.541 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.541 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 227137805, 2024-08-26T00:13:02.541 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635740, 2024-08-26T00:13:02.541 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-16.xml" 2024-08-26T00:13:02.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.542 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.542 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.542 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 228131804, 2024-08-26T00:13:02.542 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635769, 2024-08-26T00:13:02.542 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-4.xml" 2024-08-26T00:13:02.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.542 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.542 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.542 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 254808795, 2024-08-26T00:13:02.542 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511641494, 2024-08-26T00:13:02.542 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-58.jpg" 2024-08-26T00:13:02.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.543 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.543 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.543 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 294107102, 2024-08-26T00:13:02.543 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511641552, 2024-08-26T00:13:02.543 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-36.jpg" 2024-08-26T00:13:02.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.543 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.543 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.543 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 294584253, 2024-08-26T00:13:02.543 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643829, 2024-08-26T00:13:02.543 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-33.xml" 2024-08-26T00:13:02.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.543 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.544 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.544 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 319277585, 2024-08-26T00:13:02.544 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643867, 2024-08-26T00:13:02.544 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-2.xml" 2024-08-26T00:13:02.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.544 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.544 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.544 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 323637930, 2024-08-26T00:13:02.544 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637889, 2024-08-26T00:13:02.544 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-14.xml" 2024-08-26T00:13:02.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.544 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.544 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.545 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 325379777, 2024-08-26T00:13:02.545 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643811, 2024-08-26T00:13:02.545 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-49.xml" 2024-08-26T00:13:02.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.545 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.545 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 326626340, 2024-08-26T00:13:02.545 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511641346, 2024-08-26T00:13:02.545 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-53.xml" 2024-08-26T00:13:02.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.545 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.545 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 353708785, 2024-08-26T00:13:02.545 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635656, 2024-08-26T00:13:02.546 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-58.xml" 2024-08-26T00:13:02.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.546 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.546 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 378560013, 2024-08-26T00:13:02.546 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643850, 2024-08-26T00:13:02.546 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-13.xml" 2024-08-26T00:13:02.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.546 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.546 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 385018348, 2024-08-26T00:13:02.546 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643799, 2024-08-26T00:13:02.546 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-58.xml" 2024-08-26T00:13:02.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.547 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.547 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 398519179, 2024-08-26T00:13:02.547 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643823, 2024-08-26T00:13:02.547 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-39.xml" 2024-08-26T00:13:02.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.547 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.547 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 438428428, 2024-08-26T00:13:02.547 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643777, 2024-08-26T00:13:02.547 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-80.xml" 2024-08-26T00:13:02.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.548 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.548 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 450936238, 2024-08-26T00:13:02.548 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637418, 2024-08-26T00:13:02.548 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-72.xml" 2024-08-26T00:13:02.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.548 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.548 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 460419647, 2024-08-26T00:13:02.548 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643869, 2024-08-26T00:13:02.548 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-1.xml" 2024-08-26T00:13:02.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.549 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.549 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 473992423, 2024-08-26T00:13:02.549 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643916, 2024-08-26T00:13:02.549 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-21.xml" 2024-08-26T00:13:02.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.549 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.549 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 478271053, 2024-08-26T00:13:02.549 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637887, 2024-08-26T00:13:02.550 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-16.xml" 2024-08-26T00:13:02.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.550 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.550 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 494233093, 2024-08-26T00:13:02.550 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511641372, 2024-08-26T00:13:02.550 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-43.xml" 2024-08-26T00:13:02.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.550 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.550 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 498645752, 2024-08-26T00:13:02.551 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511638137, 2024-08-26T00:13:02.551 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-3.xml" 2024-08-26T00:13:02.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.551 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.551 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 513299146, 2024-08-26T00:13:02.551 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643930, 2024-08-26T00:13:02.551 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-9.xml" 2024-08-26T00:13:02.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.551 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.551 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 518192081, 2024-08-26T00:13:02.551 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643786, 2024-08-26T00:13:02.552 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "~mds2/stray4/10000003e8a" 2024-08-26T00:13:02.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.552 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.552 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 525951209, 2024-08-26T00:13:02.552 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511638201, 2024-08-26T00:13:02.552 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-64.jpg" 2024-08-26T00:13:02.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.552 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.552 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 562158984, 2024-08-26T00:13:02.552 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643939, 2024-08-26T00:13:02.552 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/picture-3.jpg" 2024-08-26T00:13:02.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.553 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.553 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 566331327, 2024-08-26T00:13:02.553 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635705, 2024-08-26T00:13:02.553 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "~mds2/stray4/10000001ef9" 2024-08-26T00:13:02.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.553 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.553 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 633189744, 2024-08-26T00:13:02.553 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511638125, 2024-08-26T00:13:02.553 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-7.xml" 2024-08-26T00:13:02.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.554 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.554 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.554 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 646767605, 2024-08-26T00:13:02.554 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 2199023264290, 2024-08-26T00:13:02.554 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/article-4.xml" 2024-08-26T00:13:02.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.554 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.554 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.554 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 665878067, 2024-08-26T00:13:02.554 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643835, 2024-08-26T00:13:02.554 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-27.xml" 2024-08-26T00:13:02.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.554 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.555 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.555 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 675423389, 2024-08-26T00:13:02.555 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643899, 2024-08-26T00:13:02.555 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-36.xml" 2024-08-26T00:13:02.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.555 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.555 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 687424284, 2024-08-26T00:13:02.555 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635751, 2024-08-26T00:13:02.555 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-11.xml" 2024-08-26T00:13:02.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.555 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.555 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 705546393, 2024-08-26T00:13:02.556 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643848, 2024-08-26T00:13:02.556 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-15.xml" 2024-08-26T00:13:02.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.556 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.556 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.556 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 707079394, 2024-08-26T00:13:02.556 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637938, 2024-08-26T00:13:02.556 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-59.jpg" 2024-08-26T00:13:02.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.557 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.557 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.557 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 736238819, 2024-08-26T00:13:02.557 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511638255, 2024-08-26T00:13:02.557 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-24.jpg" 2024-08-26T00:13:02.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.557 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.557 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.557 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 745087159, 2024-08-26T00:13:02.557 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635668, 2024-08-26T00:13:02.557 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-52.xml" 2024-08-26T00:13:02.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.557 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.557 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.558 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 767176776, 2024-08-26T00:13:02.558 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643808, 2024-08-26T00:13:02.558 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-52.xml" 2024-08-26T00:13:02.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.558 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.558 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.558 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 770028637, 2024-08-26T00:13:02.558 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643935, 2024-08-26T00:13:02.558 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-4.xml" 2024-08-26T00:13:02.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.558 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.558 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.558 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 776064280, 2024-08-26T00:13:02.558 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643817, 2024-08-26T00:13:02.559 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-43.xml" 2024-08-26T00:13:02.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.559 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.559 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.559 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 782053598, 2024-08-26T00:13:02.559 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511638049, 2024-08-26T00:13:02.559 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-44.xml" 2024-08-26T00:13:02.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.559 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.559 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.559 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 796325261, 2024-08-26T00:13:02.559 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643832, 2024-08-26T00:13:02.559 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-30.xml" 2024-08-26T00:13:02.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.560 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.560 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 817491805, 2024-08-26T00:13:02.560 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635774, 2024-08-26T00:13:02.560 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-2.xml" 2024-08-26T00:13:02.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.560 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.560 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 827363241, 2024-08-26T00:13:02.560 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643914, 2024-08-26T00:13:02.560 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-23.xml" 2024-08-26T00:13:02.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.561 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.561 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 843274991, 2024-08-26T00:13:02.561 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643856, 2024-08-26T00:13:02.561 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-9.xml" 2024-08-26T00:13:02.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.561 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.561 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 850754733, 2024-08-26T00:13:02.561 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637937, 2024-08-26T00:13:02.561 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-60.jpg" 2024-08-26T00:13:02.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.561 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.561 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 855908111, 2024-08-26T00:13:02.562 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643886, 2024-08-26T00:13:02.562 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-49.xml" 2024-08-26T00:13:02.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.562 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.562 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.562 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 860241440, 2024-08-26T00:13:02.562 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635792, 2024-08-26T00:13:02.562 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-8.jpg" 2024-08-26T00:13:02.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.562 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.562 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.562 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 860428227, 2024-08-26T00:13:02.562 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643783, 2024-08-26T00:13:02.563 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-74.xml" 2024-08-26T00:13:02.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.563 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.563 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 866582611, 2024-08-26T00:13:02.563 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643912, 2024-08-26T00:13:02.563 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-25.xml" 2024-08-26T00:13:02.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.563 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.563 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 869328671, 2024-08-26T00:13:02.563 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643809, 2024-08-26T00:13:02.563 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-51.xml" 2024-08-26T00:13:02.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.564 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.564 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 895732724, 2024-08-26T00:13:02.564 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635784, 2024-08-26T00:13:02.564 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-11.jpg" 2024-08-26T00:13:02.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.564 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.564 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 898560239, 2024-08-26T00:13:02.564 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643802, 2024-08-26T00:13:02.564 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-55.xml" 2024-08-26T00:13:02.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.565 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.565 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 898915543, 2024-08-26T00:13:02.565 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643881, 2024-08-26T00:13:02.565 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-54.xml" 2024-08-26T00:13:02.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.565 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.565 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.565 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 906693167, 2024-08-26T00:13:02.565 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643893, 2024-08-26T00:13:02.565 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-42.xml" 2024-08-26T00:13:02.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.565 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.565 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.565 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 907012746, 2024-08-26T00:13:02.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.530+0000 7f3e3fe00640 1 -- 172.21.15.42:0/4059985861 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3e240a2c00 msgr2=0x7f3e240a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:02.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.530+0000 7f3e3fe00640 1 --2- 172.21.15.42:0/4059985861 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3e240a2c00 0x7f3e240a50c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3e300986c0 tx=0x7f3e300d2f10 comp rx=0 tx=0).stop 2024-08-26T00:13:02.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.530+0000 7f3e3fe00640 1 -- 172.21.15.42:0/4059985861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e40101760 msgr2=0x7f3e40074290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:02.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.530+0000 7f3e3fe00640 1 --2- 172.21.15.42:0/4059985861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e40101760 0x7f3e40074290 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000e9f0 tx=0x7f3e3000edf0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.530+0000 7f3e3fe00640 1 -- 172.21.15.42:0/4059985861 shutdown_connections 2024-08-26T00:13:02.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.530+0000 7f3e3fe00640 1 --2- 172.21.15.42:0/4059985861 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f3e240a2c00 0x7f3e240a50c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.530+0000 7f3e3fe00640 1 --2- 172.21.15.42:0/4059985861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e40107760 0x7f3e40074d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.530+0000 7f3e3fe00640 1 --2- 172.21.15.42:0/4059985861 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e40102100 0x7f3e400747d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.530+0000 7f3e3fe00640 1 --2- 172.21.15.42:0/4059985861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e40101760 0x7f3e40074290 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:02.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.530+0000 7f3e3fe00640 1 -- 172.21.15.42:0/4059985861 >> 172.21.15.42:0/4059985861 conn(0x7f3e400fd4e0 msgr2=0x7f3e400fdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:13:02.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.531+0000 7f3e3fe00640 1 -- 172.21.15.42:0/4059985861 shutdown_connections 2024-08-26T00:13:02.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:02.531+0000 7f3e3fe00640 1 -- 172.21.15.42:0/4059985861 wait complete. 2024-08-26T00:13:02.567 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643793, 2024-08-26T00:13:02.568 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-64.xml" 2024-08-26T00:13:02.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.568 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.568 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 913091667, 2024-08-26T00:13:02.568 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635764, 2024-08-26T00:13:02.568 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-6.xml" 2024-08-26T00:13:02.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.568 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.568 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 913245908, 2024-08-26T00:13:02.568 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511641337, 2024-08-26T00:13:02.569 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-57.xml" 2024-08-26T00:13:02.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.569 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.569 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 944197526, 2024-08-26T00:13:02.569 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511641599, 2024-08-26T00:13:02.569 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-20.jpg" 2024-08-26T00:13:02.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.569 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.569 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 950417518, 2024-08-26T00:13:02.569 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643883, 2024-08-26T00:13:02.569 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-52.xml" 2024-08-26T00:13:02.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.570 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.570 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.570 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 954418126, 2024-08-26T00:13:02.570 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511641424, 2024-08-26T00:13:02.570 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-28.xml" 2024-08-26T00:13:02.570 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.570 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.570 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.570 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 970993204, 2024-08-26T00:13:02.570 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643936, 2024-08-26T00:13:02.570 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-3.xml" 2024-08-26T00:13:02.570 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.571 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.571 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.571 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 982620757, 2024-08-26T00:13:02.571 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643940, 2024-08-26T00:13:02.571 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/picture-2.jpg" 2024-08-26T00:13:02.571 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.571 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.571 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.571 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 986091435, 2024-08-26T00:13:02.571 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635723, 2024-08-26T00:13:02.571 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-25.xml" 2024-08-26T00:13:02.571 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.571 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.571 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.572 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 998452246, 2024-08-26T00:13:02.572 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511641532, 2024-08-26T00:13:02.572 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-43.jpg" 2024-08-26T00:13:02.572 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.572 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.572 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.572 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1009908553, 2024-08-26T00:13:02.572 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635749, 2024-08-26T00:13:02.572 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-12.xml" 2024-08-26T00:13:02.572 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.572 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.572 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.572 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1012878225, 2024-08-26T00:13:02.573 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635690, 2024-08-26T00:13:02.573 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-35.xml" 2024-08-26T00:13:02.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.573 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.573 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.573 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1030505630, 2024-08-26T00:13:02.573 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635682, 2024-08-26T00:13:02.573 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-39.xml" 2024-08-26T00:13:02.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.573 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.573 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.573 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1040926562, 2024-08-26T00:13:02.573 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643882, 2024-08-26T00:13:02.574 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-53.xml" 2024-08-26T00:13:02.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.574 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.574 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.574 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1050980045, 2024-08-26T00:13:02.574 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643827, 2024-08-26T00:13:02.574 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-35.xml" 2024-08-26T00:13:02.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.574 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.574 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.574 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1086743690, 2024-08-26T00:13:02.574 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635708, 2024-08-26T00:13:02.574 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-28.xml" 2024-08-26T00:13:02.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.575 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.575 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1087515906, 2024-08-26T00:13:02.575 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643784, 2024-08-26T00:13:02.575 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-73.xml" 2024-08-26T00:13:02.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.575 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.575 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1122532454, 2024-08-26T00:13:02.575 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643865, 2024-08-26T00:13:02.575 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-3.xml" 2024-08-26T00:13:02.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.576 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.576 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1144443479, 2024-08-26T00:13:02.576 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643846, 2024-08-26T00:13:02.576 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-16.xml" 2024-08-26T00:13:02.576 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.576 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.576 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.576 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1163981518, 2024-08-26T00:13:02.576 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 2199023264301, 2024-08-26T00:13:02.576 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-59.jpg" 2024-08-26T00:13:02.576 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.576 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.576 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.577 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1204539671, 2024-08-26T00:13:02.577 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643822, 2024-08-26T00:13:02.577 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-40.xml" 2024-08-26T00:13:02.577 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.577 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.577 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.577 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1237081193, 2024-08-26T00:13:02.577 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637994, 2024-08-26T00:13:02.577 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-15.jpg" 2024-08-26T00:13:02.577 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.577 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.577 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.577 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1264351822, 2024-08-26T00:13:02.577 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511638264, 2024-08-26T00:13:02.578 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-17.jpg" 2024-08-26T00:13:02.578 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.578 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.578 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.578 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1268246906, 2024-08-26T00:13:02.578 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511641459, 2024-08-26T00:13:02.578 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-19.xml" 2024-08-26T00:13:02.578 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.578 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.578 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.578 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1298716177, 2024-08-26T00:13:02.578 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635688, 2024-08-26T00:13:02.578 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-36.xml" 2024-08-26T00:13:02.579 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.579 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.579 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.579 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1308101015, 2024-08-26T00:13:02.579 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643796, 2024-08-26T00:13:02.579 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-61.xml" 2024-08-26T00:13:02.579 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.579 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.579 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.580 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1309087182, 2024-08-26T00:13:02.580 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643929, 2024-08-26T00:13:02.580 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-10.xml" 2024-08-26T00:13:02.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.580 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.580 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1353344460, 2024-08-26T00:13:02.580 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643909, 2024-08-26T00:13:02.580 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-27.xml" 2024-08-26T00:13:02.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.580 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.580 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1359558472, 2024-08-26T00:13:02.580 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637997, 2024-08-26T00:13:02.581 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-12.jpg" 2024-08-26T00:13:02.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.581 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.581 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1377396789, 2024-08-26T00:13:02.581 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511641335, 2024-08-26T00:13:02.581 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-58.xml" 2024-08-26T00:13:02.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.581 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.581 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1385739741, 2024-08-26T00:13:02.582 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643836, 2024-08-26T00:13:02.582 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-26.xml" 2024-08-26T00:13:02.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.582 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.582 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1401998011, 2024-08-26T00:13:02.582 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 2199023264432, 2024-08-26T00:13:02.582 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-12.jpg" 2024-08-26T00:13:02.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.582 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.582 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1417387490, 2024-08-26T00:13:02.583 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637958, 2024-08-26T00:13:02.583 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-47.jpg" 2024-08-26T00:13:02.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.583 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.583 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.583 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1434059282, 2024-08-26T00:13:02.583 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635713, 2024-08-26T00:13:02.583 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-26.xml" 2024-08-26T00:13:02.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.583 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.583 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.583 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1436250541, 2024-08-26T00:13:02.583 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643907, 2024-08-26T00:13:02.584 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-29.xml" 2024-08-26T00:13:02.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.584 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.584 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1442338251, 2024-08-26T00:13:02.584 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643863, 2024-08-26T00:13:02.584 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-4.xml" 2024-08-26T00:13:02.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.584 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.584 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1457867750, 2024-08-26T00:13:02.584 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635756, 2024-08-26T00:13:02.584 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-9.xml" 2024-08-26T00:13:02.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.585 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.585 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1474683099, 2024-08-26T00:13:02.585 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635754, 2024-08-26T00:13:02.585 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-10.xml" 2024-08-26T00:13:02.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.585 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.585 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1495938407, 2024-08-26T00:13:02.585 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635734, 2024-08-26T00:13:02.585 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-21.xml" 2024-08-26T00:13:02.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.586 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.586 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1511420106, 2024-08-26T00:13:02.586 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635662, 2024-08-26T00:13:02.586 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-55.xml" 2024-08-26T00:13:02.586 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.586 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.586 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.586 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1546866194, 2024-08-26T00:13:02.586 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643902, 2024-08-26T00:13:02.586 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-33.xml" 2024-08-26T00:13:02.586 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.586 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.586 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.587 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1547201019, 2024-08-26T00:13:02.587 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635706, 2024-08-26T00:13:02.587 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-30.xml" 2024-08-26T00:13:02.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.587 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.587 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1551349358, 2024-08-26T00:13:02.587 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643791, 2024-08-26T00:13:02.587 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-66.xml" 2024-08-26T00:13:02.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.587 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.587 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1574387982, 2024-08-26T00:13:02.588 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635658, 2024-08-26T00:13:02.588 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-57.xml" 2024-08-26T00:13:02.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.588 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.588 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1603768275, 2024-08-26T00:13:02.588 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635707, 2024-08-26T00:13:02.588 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-29.xml" 2024-08-26T00:13:02.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.588 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.588 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1607567984, 2024-08-26T00:13:02.588 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637960, 2024-08-26T00:13:02.589 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-45.jpg" 2024-08-26T00:13:02.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.589 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.589 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.589 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1640751620, 2024-08-26T00:13:02.589 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511641641, 2024-08-26T00:13:02.589 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-5.jpg" 2024-08-26T00:13:02.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.589 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.589 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.589 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1653256861, 2024-08-26T00:13:02.589 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511638231, 2024-08-26T00:13:02.589 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-42.jpg" 2024-08-26T00:13:02.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.590 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.590 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1655681653, 2024-08-26T00:13:02.590 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635804, 2024-08-26T00:13:02.590 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "~mds2/stray4/10000001f5c" 2024-08-26T00:13:02.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.590 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.590 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1664583342, 2024-08-26T00:13:02.590 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643888, 2024-08-26T00:13:02.590 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-47.xml" 2024-08-26T00:13:02.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.591 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.591 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1670890983, 2024-08-26T00:13:02.591 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643825, 2024-08-26T00:13:02.591 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "~mds2/stray4/10000003eb1" 2024-08-26T00:13:02.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.591 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.591 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1676667503, 2024-08-26T00:13:02.591 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643898, 2024-08-26T00:13:02.591 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-37.xml" 2024-08-26T00:13:02.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.591 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.592 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1711765030, 2024-08-26T00:13:02.592 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635650, 2024-08-26T00:13:02.592 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "~mds2/stray3/10000001ec2" 2024-08-26T00:13:02.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.592 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.592 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1714369502, 2024-08-26T00:13:02.592 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643931, 2024-08-26T00:13:02.592 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-8.xml" 2024-08-26T00:13:02.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.592 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.592 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1716620682, 2024-08-26T00:13:02.592 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635747, 2024-08-26T00:13:02.593 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-13.xml" 2024-08-26T00:13:02.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.593 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.593 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1738910285, 2024-08-26T00:13:02.593 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643795, 2024-08-26T00:13:02.593 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-62.xml" 2024-08-26T00:13:02.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.593 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.593 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1751731338, 2024-08-26T00:13:02.593 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 2199023264350, 2024-08-26T00:13:02.593 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-44.jpg" 2024-08-26T00:13:02.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.594 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.594 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.594 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1757025776, 2024-08-26T00:13:02.594 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643861, 2024-08-26T00:13:02.594 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-6.xml" 2024-08-26T00:13:02.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.594 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.594 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.594 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1778370207, 2024-08-26T00:13:02.594 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637941, 2024-08-26T00:13:02.594 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-56.jpg" 2024-08-26T00:13:02.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.595 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.595 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.595 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1792336963, 2024-08-26T00:13:02.595 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511641873, 2024-08-26T00:13:02.595 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-80.xml" 2024-08-26T00:13:02.595 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.595 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.595 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.595 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1810844620, 2024-08-26T00:13:02.595 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643911, 2024-08-26T00:13:02.595 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-26.xml" 2024-08-26T00:13:02.595 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.595 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.596 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.596 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1811701347, 2024-08-26T00:13:02.596 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643927, 2024-08-26T00:13:02.596 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-12.xml" 2024-08-26T00:13:02.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.596 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.596 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1826940463, 2024-08-26T00:13:02.596 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635758, 2024-08-26T00:13:02.596 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-8.xml" 2024-08-26T00:13:02.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.596 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.596 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1839005741, 2024-08-26T00:13:02.597 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635736, 2024-08-26T00:13:02.597 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-19.xml" 2024-08-26T00:13:02.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.597 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.597 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1850544249, 2024-08-26T00:13:02.597 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643845, 2024-08-26T00:13:02.597 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-17.xml" 2024-08-26T00:13:02.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.597 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.597 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1851131672, 2024-08-26T00:13:02.597 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635731, 2024-08-26T00:13:02.597 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-22.xml" 2024-08-26T00:13:02.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.598 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.598 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.598 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1856555950, 2024-08-26T00:13:02.598 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643900, 2024-08-26T00:13:02.598 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-35.xml" 2024-08-26T00:13:02.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.598 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.598 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.598 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1908151086, 2024-08-26T00:13:02.598 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635704, 2024-08-26T00:13:02.598 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-32.xml" 2024-08-26T00:13:02.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.599 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.599 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.599 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1946889694, 2024-08-26T00:13:02.599 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643913, 2024-08-26T00:13:02.599 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-24.xml" 2024-08-26T00:13:02.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.599 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.599 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.599 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1977295995, 2024-08-26T00:13:02.599 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643776, 2024-08-26T00:13:02.599 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-81.xml" 2024-08-26T00:13:02.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.599 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.600 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.600 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1992184797, 2024-08-26T00:13:02.600 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643938, 2024-08-26T00:13:02.600 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-1.xml" 2024-08-26T00:13:02.600 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.600 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.600 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.600 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 1992724604, 2024-08-26T00:13:02.600 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511638243, 2024-08-26T00:13:02.600 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-33.jpg" 2024-08-26T00:13:02.600 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.600 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.600 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.600 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2008101862, 2024-08-26T00:13:02.601 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635671, 2024-08-26T00:13:02.601 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-50.xml" 2024-08-26T00:13:02.601 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.601 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.601 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.601 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2016702805, 2024-08-26T00:13:02.601 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643840, 2024-08-26T00:13:02.601 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-22.xml" 2024-08-26T00:13:02.601 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.601 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.601 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.601 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2058080803, 2024-08-26T00:13:02.601 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643842, 2024-08-26T00:13:02.602 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "~mds2/stray4/10000003ec2" 2024-08-26T00:13:02.602 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.602 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.602 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.602 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2060877549, 2024-08-26T00:13:02.602 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643778, 2024-08-26T00:13:02.602 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-79.xml" 2024-08-26T00:13:02.602 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.602 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.602 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.602 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2067356200, 2024-08-26T00:13:02.602 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637929, 2024-08-26T00:13:02.602 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-66.jpg" 2024-08-26T00:13:02.603 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.603 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.603 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.603 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2071886921, 2024-08-26T00:13:02.603 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643798, 2024-08-26T00:13:02.603 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-59.xml" 2024-08-26T00:13:02.603 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.603 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.603 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.603 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2076753996, 2024-08-26T00:13:02.603 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643826, 2024-08-26T00:13:02.603 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-36.xml" 2024-08-26T00:13:02.603 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.604 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.604 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.604 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2083817995, 2024-08-26T00:13:02.604 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511638213, 2024-08-26T00:13:02.604 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-57.jpg" 2024-08-26T00:13:02.604 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.604 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.604 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.604 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2096065877, 2024-08-26T00:13:02.604 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511641385, 2024-08-26T00:13:02.604 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-40.xml" 2024-08-26T00:13:02.604 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.604 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.605 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.605 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2098712750, 2024-08-26T00:13:02.605 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643797, 2024-08-26T00:13:02.605 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-60.xml" 2024-08-26T00:13:02.605 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.605 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.605 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.605 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2119169807, 2024-08-26T00:13:02.605 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635761, 2024-08-26T00:13:02.605 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-7.xml" 2024-08-26T00:13:02.605 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.605 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.605 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.605 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2125739463, 2024-08-26T00:13:02.606 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511638282, 2024-08-26T00:13:02.606 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-1.jpg" 2024-08-26T00:13:02.606 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.606 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.606 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.606 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2138100367, 2024-08-26T00:13:02.606 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635680, 2024-08-26T00:13:02.606 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "~mds2/stray4/10000001ee0" 2024-08-26T00:13:02.606 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.606 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.606 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.606 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2145536449, 2024-08-26T00:13:02.606 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637904, 2024-08-26T00:13:02.607 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-4.xml" 2024-08-26T00:13:02.607 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.607 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.607 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.607 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2153137542, 2024-08-26T00:13:02.607 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635674, 2024-08-26T00:13:02.607 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-47.xml" 2024-08-26T00:13:02.607 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.607 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.607 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.607 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2163355045, 2024-08-26T00:13:02.607 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643838, 2024-08-26T00:13:02.607 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-24.xml" 2024-08-26T00:13:02.608 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.608 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.608 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.608 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2195351817, 2024-08-26T00:13:02.608 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643843, 2024-08-26T00:13:02.608 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-19.xml" 2024-08-26T00:13:02.608 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.608 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.608 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.608 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2212626954, 2024-08-26T00:13:02.608 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635798, 2024-08-26T00:13:02.608 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-6.jpg" 2024-08-26T00:13:02.608 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.609 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.609 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.609 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2222233499, 2024-08-26T00:13:02.609 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635683, 2024-08-26T00:13:02.609 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-38.xml" 2024-08-26T00:13:02.609 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.609 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.609 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.609 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2226224671, 2024-08-26T00:13:02.609 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637964, 2024-08-26T00:13:02.609 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-41.jpg" 2024-08-26T00:13:02.609 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.609 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.609 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.610 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2232521319, 2024-08-26T00:13:02.610 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643923, 2024-08-26T00:13:02.610 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-16.xml" 2024-08-26T00:13:02.610 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.610 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.610 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.610 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2253683857, 2024-08-26T00:13:02.610 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635772, 2024-08-26T00:13:02.610 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-3.xml" 2024-08-26T00:13:02.610 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.610 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.610 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.610 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2253951216, 2024-08-26T00:13:02.611 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643926, 2024-08-26T00:13:02.611 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-13.xml" 2024-08-26T00:13:02.611 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.611 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.611 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.611 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2278447602, 2024-08-26T00:13:02.611 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511638088, 2024-08-26T00:13:02.611 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-24.xml" 2024-08-26T00:13:02.611 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.611 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.611 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.611 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2285031267, 2024-08-26T00:13:02.611 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511641597, 2024-08-26T00:13:02.611 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-21.jpg" 2024-08-26T00:13:02.612 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.612 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.612 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.612 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2302802698, 2024-08-26T00:13:02.612 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643790, 2024-08-26T00:13:02.612 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-67.xml" 2024-08-26T00:13:02.612 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.612 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.612 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.612 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2321282494, 2024-08-26T00:13:02.612 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637983, 2024-08-26T00:13:02.612 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-44.xml" 2024-08-26T00:13:02.612 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.613 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.613 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.613 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2322420151, 2024-08-26T00:13:02.613 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643885, 2024-08-26T00:13:02.613 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-50.xml" 2024-08-26T00:13:02.613 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.613 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.613 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.613 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2342650020, 2024-08-26T00:13:02.613 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643917, 2024-08-26T00:13:02.613 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-20.xml" 2024-08-26T00:13:02.613 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.613 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.613 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.614 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2355584751, 2024-08-26T00:13:02.614 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643891, 2024-08-26T00:13:02.614 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-44.xml" 2024-08-26T00:13:02.614 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.614 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.614 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.614 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2358599099, 2024-08-26T00:13:02.614 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643800, 2024-08-26T00:13:02.614 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-57.xml" 2024-08-26T00:13:02.614 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.614 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.614 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.614 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2395679443, 2024-08-26T00:13:02.615 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635681, 2024-08-26T00:13:02.615 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-40.xml" 2024-08-26T00:13:02.615 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.615 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.615 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.615 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2399362362, 2024-08-26T00:13:02.615 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643924, 2024-08-26T00:13:02.615 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-15.xml" 2024-08-26T00:13:02.615 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.615 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.615 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.615 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2401267735, 2024-08-26T00:13:02.615 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643887, 2024-08-26T00:13:02.616 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-48.xml" 2024-08-26T00:13:02.616 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.616 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.616 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.616 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2406010209, 2024-08-26T00:13:02.616 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635646, 2024-08-26T00:13:02.616 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-63.xml" 2024-08-26T00:13:02.616 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.616 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.616 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.616 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2418452016, 2024-08-26T00:13:02.616 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635673, 2024-08-26T00:13:02.616 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-48.xml" 2024-08-26T00:13:02.617 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.617 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.617 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.617 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2444423302, 2024-08-26T00:13:02.617 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635644, 2024-08-26T00:13:02.617 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-64.xml" 2024-08-26T00:13:02.617 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.617 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.617 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.617 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2473890170, 2024-08-26T00:13:02.617 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635782, 2024-08-26T00:13:02.617 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-12.jpg" 2024-08-26T00:13:02.618 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.618 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.618 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.618 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2491539810, 2024-08-26T00:13:02.618 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 3298534884928, 2024-08-26T00:13:02.618 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/article-54.xml" 2024-08-26T00:13:02.618 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.618 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.618 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.618 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2547146754, 2024-08-26T00:13:02.618 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643780, 2024-08-26T00:13:02.618 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-77.xml" 2024-08-26T00:13:02.618 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.619 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.619 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.619 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2561872124, 2024-08-26T00:13:02.619 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635743, 2024-08-26T00:13:02.619 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-15.xml" 2024-08-26T00:13:02.619 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.619 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.619 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.619 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2631272483, 2024-08-26T00:13:02.619 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637607, 2024-08-26T00:13:02.619 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-65.xml" 2024-08-26T00:13:02.619 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.619 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.620 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.620 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2638115297, 2024-08-26T00:13:02.620 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635802, 2024-08-26T00:13:02.620 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-3.jpg" 2024-08-26T00:13:02.620 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.620 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.620 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.620 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2651733806, 2024-08-26T00:13:02.620 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635795, 2024-08-26T00:13:02.620 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "~mds2/stray4/10000001f53" 2024-08-26T00:13:02.620 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.620 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.620 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.621 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2658079761, 2024-08-26T00:13:02.621 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643781, 2024-08-26T00:13:02.621 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-76.xml" 2024-08-26T00:13:02.621 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.621 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.621 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.621 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2660891116, 2024-08-26T00:13:02.621 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643853, 2024-08-26T00:13:02.621 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-12.xml" 2024-08-26T00:13:02.621 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.621 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.621 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.622 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2671680714, 2024-08-26T00:13:02.622 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643839, 2024-08-26T00:13:02.622 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-23.xml" 2024-08-26T00:13:02.622 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.622 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.622 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.622 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2683534848, 2024-08-26T00:13:02.622 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643819, 2024-08-26T00:13:02.622 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-42.xml" 2024-08-26T00:13:02.622 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.622 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.622 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.622 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2731228730, 2024-08-26T00:13:02.623 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511641545, 2024-08-26T00:13:02.623 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-38.jpg" 2024-08-26T00:13:02.623 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.623 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.623 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.623 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2754920229, 2024-08-26T00:13:02.623 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643814, 2024-08-26T00:13:02.623 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-46.xml" 2024-08-26T00:13:02.623 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.623 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.623 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.623 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2764712829, 2024-08-26T00:13:02.623 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643894, 2024-08-26T00:13:02.624 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-41.xml" 2024-08-26T00:13:02.624 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.624 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.624 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.624 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2767599540, 2024-08-26T00:13:02.624 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643877, 2024-08-26T00:13:02.624 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-58.xml" 2024-08-26T00:13:02.624 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.624 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.624 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.624 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2781738825, 2024-08-26T00:13:02.624 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643779, 2024-08-26T00:13:02.624 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-78.xml" 2024-08-26T00:13:02.625 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.625 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.625 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.625 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2790831583, 2024-08-26T00:13:02.625 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635787, 2024-08-26T00:13:02.625 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "~mds2/stray4/10000001f4b" 2024-08-26T00:13:02.625 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.625 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.625 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.625 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2801681175, 2024-08-26T00:13:02.625 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643792, 2024-08-26T00:13:02.625 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-65.xml" 2024-08-26T00:13:02.625 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.626 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.626 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.626 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2835062275, 2024-08-26T00:13:02.626 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643860, 2024-08-26T00:13:02.626 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-7.xml" 2024-08-26T00:13:02.626 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.626 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.626 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.626 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2835418371, 2024-08-26T00:13:02.626 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511641377, 2024-08-26T00:13:02.626 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-42.xml" 2024-08-26T00:13:02.626 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.626 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.627 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.627 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2837708385, 2024-08-26T00:13:02.627 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637911, 2024-08-26T00:13:02.627 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-80.jpg" 2024-08-26T00:13:02.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.627 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.627 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.627 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2864736946, 2024-08-26T00:13:02.627 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643810, 2024-08-26T00:13:02.627 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-50.xml" 2024-08-26T00:13:02.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.627 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.627 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.628 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2904596845, 2024-08-26T00:13:02.628 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511638030, 2024-08-26T00:13:02.628 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-62.xml" 2024-08-26T00:13:02.628 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.628 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.628 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.628 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2924964657, 2024-08-26T00:13:02.628 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635687, 2024-08-26T00:13:02.628 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-37.xml" 2024-08-26T00:13:02.628 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.628 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.628 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.628 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2947718411, 2024-08-26T00:13:02.629 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635676, 2024-08-26T00:13:02.629 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "~mds2/stray4/10000001edc" 2024-08-26T00:13:02.629 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.629 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.629 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.629 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2982721160, 2024-08-26T00:13:02.629 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643794, 2024-08-26T00:13:02.629 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-63.xml" 2024-08-26T00:13:02.629 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.629 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.629 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.629 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2983549565, 2024-08-26T00:13:02.629 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511641522, 2024-08-26T00:13:02.630 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-46.jpg" 2024-08-26T00:13:02.630 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.630 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.630 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.630 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2984402264, 2024-08-26T00:13:02.630 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637961, 2024-08-26T00:13:02.630 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-44.jpg" 2024-08-26T00:13:02.630 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.630 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.630 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.630 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 2994631024, 2024-08-26T00:13:02.630 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511641466, 2024-08-26T00:13:02.631 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-15.xml" 2024-08-26T00:13:02.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.632 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.632 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.632 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3002952167, 2024-08-26T00:13:02.632 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643831, 2024-08-26T00:13:02.632 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-31.xml" 2024-08-26T00:13:02.632 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.632 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.632 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.632 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3012349100, 2024-08-26T00:13:02.632 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635800, 2024-08-26T00:13:02.632 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-5.jpg" 2024-08-26T00:13:02.632 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.632 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.633 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.633 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3016514507, 2024-08-26T00:13:02.633 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643879, 2024-08-26T00:13:02.633 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-56.xml" 2024-08-26T00:13:02.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.633 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.633 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.633 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3036436623, 2024-08-26T00:13:02.633 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637417, 2024-08-26T00:13:02.633 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-70.jpg" 2024-08-26T00:13:02.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.633 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.634 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.634 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3040040424, 2024-08-26T00:13:02.634 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643937, 2024-08-26T00:13:02.634 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-2.xml" 2024-08-26T00:13:02.634 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.634 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.634 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.634 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3042133069, 2024-08-26T00:13:02.634 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511638238, 2024-08-26T00:13:02.634 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-37.jpg" 2024-08-26T00:13:02.634 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.634 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.635 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.635 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3045625822, 2024-08-26T00:13:02.635 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643788, 2024-08-26T00:13:02.635 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-69.xml" 2024-08-26T00:13:02.635 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.635 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.635 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.635 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3087048479, 2024-08-26T00:13:02.635 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643933, 2024-08-26T00:13:02.635 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-6.xml" 2024-08-26T00:13:02.635 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.635 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.635 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.636 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3089143784, 2024-08-26T00:13:02.636 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635738, 2024-08-26T00:13:02.636 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-17.xml" 2024-08-26T00:13:02.636 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.636 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.636 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.636 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3097023503, 2024-08-26T00:13:02.636 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635679, 2024-08-26T00:13:02.636 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-42.xml" 2024-08-26T00:13:02.636 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.636 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.636 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.636 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3099585317, 2024-08-26T00:13:02.637 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643816, 2024-08-26T00:13:02.637 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-44.xml" 2024-08-26T00:13:02.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.637 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.637 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.637 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3141826582, 2024-08-26T00:13:02.637 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511638250, 2024-08-26T00:13:02.637 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-28.jpg" 2024-08-26T00:13:02.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.637 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.637 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.637 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3148911180, 2024-08-26T00:13:02.638 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 2199023264312, 2024-08-26T00:13:02.638 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-56.jpg" 2024-08-26T00:13:02.638 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.638 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.638 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.638 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3151081442, 2024-08-26T00:13:02.638 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635703, 2024-08-26T00:13:02.638 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-33.xml" 2024-08-26T00:13:02.638 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.638 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.638 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.638 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3160467507, 2024-08-26T00:13:02.638 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643908, 2024-08-26T00:13:02.639 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-28.xml" 2024-08-26T00:13:02.639 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.639 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.639 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.639 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3177408734, 2024-08-26T00:13:02.639 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 2199023264342, 2024-08-26T00:13:02.639 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-47.jpg" 2024-08-26T00:13:02.639 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.639 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.639 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.639 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3180476607, 2024-08-26T00:13:02.639 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643830, 2024-08-26T00:13:02.639 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-32.xml" 2024-08-26T00:13:02.640 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.640 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.640 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.640 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3184702383, 2024-08-26T00:13:02.640 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643820, 2024-08-26T00:13:02.640 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-41.xml" 2024-08-26T00:13:02.640 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.640 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.640 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.640 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3194905884, 2024-08-26T00:13:02.640 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643880, 2024-08-26T00:13:02.640 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-55.xml" 2024-08-26T00:13:02.640 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.640 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.641 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.641 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3225195848, 2024-08-26T00:13:02.641 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643941, 2024-08-26T00:13:02.641 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/picture-1.jpg" 2024-08-26T00:13:02.641 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.641 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.641 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.641 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3251512910, 2024-08-26T00:13:02.641 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643925, 2024-08-26T00:13:02.641 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-14.xml" 2024-08-26T00:13:02.641 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.641 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.641 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.642 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3290450584, 2024-08-26T00:13:02.642 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511638177, 2024-08-26T00:13:02.642 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-68.jpg" 2024-08-26T00:13:02.642 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.642 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.642 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.642 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3303663708, 2024-08-26T00:13:02.642 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643895, 2024-08-26T00:13:02.642 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-40.xml" 2024-08-26T00:13:02.642 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.642 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.642 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.642 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3321726922, 2024-08-26T00:13:02.643 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643928, 2024-08-26T00:13:02.643 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-11.xml" 2024-08-26T00:13:02.643 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.643 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.643 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.643 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3344916332, 2024-08-26T00:13:02.643 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635652, 2024-08-26T00:13:02.643 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-60.xml" 2024-08-26T00:13:02.643 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.643 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.643 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.643 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3345859498, 2024-08-26T00:13:02.643 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643849, 2024-08-26T00:13:02.643 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-14.xml" 2024-08-26T00:13:02.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.644 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.644 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.644 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3349744374, 2024-08-26T00:13:02.644 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511641507, 2024-08-26T00:13:02.644 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-51.jpg" 2024-08-26T00:13:02.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.644 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.644 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.644 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3353937035, 2024-08-26T00:13:02.644 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635725, 2024-08-26T00:13:02.644 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-24.xml" 2024-08-26T00:13:02.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.645 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.645 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.645 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3357430781, 2024-08-26T00:13:02.645 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643915, 2024-08-26T00:13:02.645 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-22.xml" 2024-08-26T00:13:02.645 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.645 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.645 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.645 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3371598368, 2024-08-26T00:13:02.645 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643932, 2024-08-26T00:13:02.645 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-7.xml" 2024-08-26T00:13:02.645 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.645 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.645 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.646 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3380361309, 2024-08-26T00:13:02.646 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643844, 2024-08-26T00:13:02.646 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-18.xml" 2024-08-26T00:13:02.646 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.646 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.646 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.646 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3383402078, 2024-08-26T00:13:02.646 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643884, 2024-08-26T00:13:02.646 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-51.xml" 2024-08-26T00:13:02.646 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.646 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.646 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.646 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3432714762, 2024-08-26T00:13:02.647 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511638120, 2024-08-26T00:13:02.647 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-9.xml" 2024-08-26T00:13:02.647 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.647 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.647 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.647 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3446564351, 2024-08-26T00:13:02.647 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635664, 2024-08-26T00:13:02.647 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-54.xml" 2024-08-26T00:13:02.647 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.647 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.647 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.647 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3448874522, 2024-08-26T00:13:02.648 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635777, 2024-08-26T00:13:02.648 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-1.xml" 2024-08-26T00:13:02.648 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.648 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.648 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.648 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3472838081, 2024-08-26T00:13:02.648 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511642162, 2024-08-26T00:13:02.648 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-67.xml" 2024-08-26T00:13:02.648 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.648 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.648 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.648 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3482923596, 2024-08-26T00:13:02.648 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511638027, 2024-08-26T00:13:02.648 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-65.xml" 2024-08-26T00:13:02.648 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.648 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.649 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.649 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3507792369, 2024-08-26T00:13:02.649 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643834, 2024-08-26T00:13:02.649 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-28.xml" 2024-08-26T00:13:02.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.649 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.649 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.649 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3523529694, 2024-08-26T00:13:02.649 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643904, 2024-08-26T00:13:02.649 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-31.xml" 2024-08-26T00:13:02.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.649 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.649 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.649 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3564762255, 2024-08-26T00:13:02.650 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 2199023264360, 2024-08-26T00:13:02.650 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-41.jpg" 2024-08-26T00:13:02.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.650 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.650 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.650 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3582515565, 2024-08-26T00:13:02.650 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643785, 2024-08-26T00:13:02.650 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-72.xml" 2024-08-26T00:13:02.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.650 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.650 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.650 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3583297555, 2024-08-26T00:13:02.651 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643890, 2024-08-26T00:13:02.651 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-45.xml" 2024-08-26T00:13:02.651 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.651 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.651 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.651 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3597241603, 2024-08-26T00:13:02.651 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643804, 2024-08-26T00:13:02.651 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-54.xml" 2024-08-26T00:13:02.651 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.651 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.651 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.651 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3621116835, 2024-08-26T00:13:02.651 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635666, 2024-08-26T00:13:02.652 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-53.xml" 2024-08-26T00:13:02.652 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.652 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.652 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.652 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3625191214, 2024-08-26T00:13:02.652 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635660, 2024-08-26T00:13:02.652 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-56.xml" 2024-08-26T00:13:02.652 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.652 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.652 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.652 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3653331392, 2024-08-26T00:13:02.652 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643855, 2024-08-26T00:13:02.652 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-10.xml" 2024-08-26T00:13:02.652 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.653 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.653 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.653 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3655005680, 2024-08-26T00:13:02.653 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511638025, 2024-08-26T00:13:02.653 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-67.xml" 2024-08-26T00:13:02.653 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.653 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.653 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.653 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3697487645, 2024-08-26T00:13:02.653 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643841, 2024-08-26T00:13:02.653 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-21.xml" 2024-08-26T00:13:02.653 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.654 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.654 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.654 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3762229530, 2024-08-26T00:13:02.654 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643812, 2024-08-26T00:13:02.654 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-48.xml" 2024-08-26T00:13:02.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.654 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.654 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.654 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3801930764, 2024-08-26T00:13:02.654 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637895, 2024-08-26T00:13:02.654 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-10.xml" 2024-08-26T00:13:02.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.654 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.655 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.655 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3854788016, 2024-08-26T00:13:02.655 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643813, 2024-08-26T00:13:02.655 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-47.xml" 2024-08-26T00:13:02.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.655 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.655 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.655 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3865128295, 2024-08-26T00:13:02.655 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635675, 2024-08-26T00:13:02.655 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-46.xml" 2024-08-26T00:13:02.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.655 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.655 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.656 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3925984267, 2024-08-26T00:13:02.656 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643789, 2024-08-26T00:13:02.656 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-68.xml" 2024-08-26T00:13:02.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.656 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.656 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.656 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3949370720, 2024-08-26T00:13:02.656 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637923, 2024-08-26T00:13:02.656 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-72.jpg" 2024-08-26T00:13:02.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.656 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.656 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.656 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3959392221, 2024-08-26T00:13:02.657 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643892, 2024-08-26T00:13:02.657 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-43.xml" 2024-08-26T00:13:02.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.657 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.657 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.657 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3970215084, 2024-08-26T00:13:02.657 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511635789, 2024-08-26T00:13:02.657 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "~mds2/stray4/10000001f4d" 2024-08-26T00:13:02.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.657 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.657 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.657 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3971588146, 2024-08-26T00:13:02.657 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643920, 2024-08-26T00:13:02.657 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-19.xml" 2024-08-26T00:13:02.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.658 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.658 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.658 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3975615161, 2024-08-26T00:13:02.658 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643782, 2024-08-26T00:13:02.658 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-75.xml" 2024-08-26T00:13:02.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.658 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.658 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.658 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3976705448, 2024-08-26T00:13:02.658 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511638273, 2024-08-26T00:13:02.658 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-10.jpg" 2024-08-26T00:13:02.659 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.659 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.659 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.659 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3991487858, 2024-08-26T00:13:02.659 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511641348, 2024-08-26T00:13:02.659 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-52.xml" 2024-08-26T00:13:02.659 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.659 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.659 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.659 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4005208489, 2024-08-26T00:13:02.659 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643854, 2024-08-26T00:13:02.659 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "~mds2/stray4/10000003ece" 2024-08-26T00:13:02.659 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.660 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.660 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4040498257, 2024-08-26T00:13:02.660 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637984, 2024-08-26T00:13:02.660 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-23.jpg" 2024-08-26T00:13:02.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.660 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.660 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4081626124, 2024-08-26T00:13:02.660 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511641511, 2024-08-26T00:13:02.660 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-50.jpg" 2024-08-26T00:13:02.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.660 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.661 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4083140440, 2024-08-26T00:13:02.661 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643896, 2024-08-26T00:13:02.661 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-39.xml" 2024-08-26T00:13:02.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.661 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.661 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4086414621, 2024-08-26T00:13:02.661 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643837, 2024-08-26T00:13:02.661 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-25.xml" 2024-08-26T00:13:02.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.661 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.661 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4093611953, 2024-08-26T00:13:02.662 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643858, 2024-08-26T00:13:02.662 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-8.xml" 2024-08-26T00:13:02.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.662 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.662 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.662 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4093690960, 2024-08-26T00:13:02.662 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643889, 2024-08-26T00:13:02.662 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-46.xml" 2024-08-26T00:13:02.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.662 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.662 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.662 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4113762324, 2024-08-26T00:13:02.663 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643807, 2024-08-26T00:13:02.663 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-53.xml" 2024-08-26T00:13:02.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.663 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.663 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.663 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4116143591, 2024-08-26T00:13:02.663 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643828, 2024-08-26T00:13:02.663 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-34.xml" 2024-08-26T00:13:02.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.663 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.663 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.663 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4165180246, 2024-08-26T00:13:02.663 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 2199023264422, 2024-08-26T00:13:02.664 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-15.jpg" 2024-08-26T00:13:02.664 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.664 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.664 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.664 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4171755734, 2024-08-26T00:13:02.664 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643934, 2024-08-26T00:13:02.664 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-5.xml" 2024-08-26T00:13:02.664 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.664 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.664 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.664 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4200636642, 2024-08-26T00:13:02.664 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643921, 2024-08-26T00:13:02.664 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-18.xml" 2024-08-26T00:13:02.665 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.665 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.665 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.665 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4213861800, 2024-08-26T00:13:02.665 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511641574, 2024-08-26T00:13:02.665 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-30.jpg" 2024-08-26T00:13:02.665 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.665 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.665 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.665 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4252299098, 2024-08-26T00:13:02.665 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511640698, 2024-08-26T00:13:02.665 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-82.xml" 2024-08-26T00:13:02.665 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.666 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.666 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.666 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4263128795, 2024-08-26T00:13:02.666 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511637912, 2024-08-26T00:13:02.666 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-79.jpg" 2024-08-26T00:13:02.666 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:13:02.666 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:13:02.666 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-08-26T00:13:02.666 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4279143785, 2024-08-26T00:13:02.666 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511643787, 2024-08-26T00:13:02.666 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-70.xml" 2024-08-26T00:13:02.666 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:13:02.666 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-08-26T00:13:02.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:02 smithi043 ceph-mon[22091]: pgmap v654: 97 pgs: 97 active+clean; 1.3 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 379 op/s 2024-08-26T00:13:02.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:02 smithi042 ceph-mon[17225]: pgmap v654: 97 pgs: 97 active+clean; 1.3 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 379 op/s 2024-08-26T00:13:02.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:02 smithi181 ceph-mon[22102]: pgmap v654: 97 pgs: 97 active+clean; 1.3 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 379 op/s 2024-08-26T00:13:03.644 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-26T00:13:04.104 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:13:04.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:04 smithi042 ceph-mon[17225]: pgmap v655: 97 pgs: 97 active+clean; 1.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 413 op/s 2024-08-26T00:13:04.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.653+0000 7f9731400640 1 -- 172.21.15.42:0/799543602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f972c101760 msgr2=0x7f972c101bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:04.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.653+0000 7f9731400640 1 --2- 172.21.15.42:0/799543602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f972c101760 0x7f972c101bc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9718009900 tx=0x7f971802a3f0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.653+0000 7f9731400640 1 -- 172.21.15.42:0/799543602 shutdown_connections 2024-08-26T00:13:04.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.653+0000 7f9731400640 1 --2- 172.21.15.42:0/799543602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f972c102100 0x7f972c10e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.653+0000 7f9731400640 1 --2- 172.21.15.42:0/799543602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f972c101760 0x7f972c101bc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.653+0000 7f9731400640 1 --2- 172.21.15.42:0/799543602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f972c107760 0x7f972c107b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.653+0000 7f9731400640 1 -- 172.21.15.42:0/799543602 >> 172.21.15.42:0/799543602 conn(0x7f972c0fd4e0 msgr2=0x7f972c0ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:13:04.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.653+0000 7f9731400640 1 -- 172.21.15.42:0/799543602 shutdown_connections 2024-08-26T00:13:04.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.654+0000 7f9731400640 1 -- 172.21.15.42:0/799543602 wait complete. 2024-08-26T00:13:04.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.655+0000 7f9731400640 1 Processor -- start 2024-08-26T00:13:04.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.655+0000 7f9731400640 1 -- start start 2024-08-26T00:13:04.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.655+0000 7f9731400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f972c101760 0x7f972c19a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:04.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.655+0000 7f9731400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f972c102100 0x7f972c19a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:04.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.655+0000 7f9731400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f972c107760 0x7f972c19eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:04.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.655+0000 7f9731400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f972c111b70 con 0x7f972c102100 2024-08-26T00:13:04.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.655+0000 7f9731400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f972c1119f0 con 0x7f972c101760 2024-08-26T00:13:04.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.655+0000 7f9731400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f972c111cf0 con 0x7f972c107760 2024-08-26T00:13:04.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.656+0000 7f972be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f972c101760 0x7f972c19a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:04.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.656+0000 7f972be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f972c101760 0x7f972c19a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:38644/0 (socket says 172.21.15.42:38644) 2024-08-26T00:13:04.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.656+0000 7f972be00640 1 -- 172.21.15.42:0/3096959608 learned_addr learned my addr 172.21.15.42:0/3096959608 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:13:04.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.656+0000 7f972b400640 1 --2- 172.21.15.42:0/3096959608 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f972c102100 0x7f972c19a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:04.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.656+0000 7f9730a00640 1 --2- 172.21.15.42:0/3096959608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f972c107760 0x7f972c19eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:04.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.656+0000 7f972be00640 1 -- 172.21.15.42:0/3096959608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f972c107760 msgr2=0x7f972c19eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:04.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.656+0000 7f972be00640 1 --2- 172.21.15.42:0/3096959608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f972c107760 0x7f972c19eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.656+0000 7f972be00640 1 -- 172.21.15.42:0/3096959608 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f972c102100 msgr2=0x7f972c19a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:04.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.656+0000 7f972be00640 1 --2- 172.21.15.42:0/3096959608 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f972c102100 0x7f972c19a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.656+0000 7f972be00640 1 -- 172.21.15.42:0/3096959608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f972c19f210 con 0x7f972c101760 2024-08-26T00:13:04.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.656+0000 7f972be00640 1 --2- 172.21.15.42:0/3096959608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f972c101760 0x7f972c19a260 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f971c00e9f0 tx=0x7f971c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:13:04.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.657+0000 7f9728c00640 1 -- 172.21.15.42:0/3096959608 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c00cd80 con 0x7f972c101760 2024-08-26T00:13:04.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.657+0000 7f9728c00640 1 -- 172.21.15.42:0/3096959608 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f971c010910 con 0x7f972c101760 2024-08-26T00:13:04.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.657+0000 7f9731400640 1 -- 172.21.15.42:0/3096959608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f972c19f500 con 0x7f972c101760 2024-08-26T00:13:04.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.657+0000 7f9728c00640 1 -- 172.21.15.42:0/3096959608 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c018990 con 0x7f972c101760 2024-08-26T00:13:04.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.657+0000 7f9731400640 1 -- 172.21.15.42:0/3096959608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f972c1a6de0 con 0x7f972c101760 2024-08-26T00:13:04.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.660+0000 7f97353c2740 1 Processor -- start 2024-08-26T00:13:04.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.660+0000 7f97353c2740 1 -- start start 2024-08-26T00:13:04.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.660+0000 7f9728c00640 1 -- 172.21.15.42:0/3096959608 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f971c010ac0 con 0x7f972c101760 2024-08-26T00:13:04.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.660+0000 7f97353c2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c8f36ba30 0x562c8f36be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:04.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.660+0000 7f97353c2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f36c350 0x562c8f3766d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:04.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.660+0000 7f97353c2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c8f376c10 0x562c8f379000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:04.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.660+0000 7f97353c2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562c8f2d1f30 con 0x562c8f36ba30 2024-08-26T00:13:04.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.660+0000 7f97353c2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562c8f2695a0 con 0x562c8f36c350 2024-08-26T00:13:04.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.660+0000 7f97353c2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562c8f2cdef0 con 0x562c8f376c10 2024-08-26T00:13:04.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.661+0000 7f972be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f36c350 0x562c8f3766d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:04.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.661+0000 7f972be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f36c350 0x562c8f3766d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:38660/0 (socket says 172.21.15.42:38660) 2024-08-26T00:13:04.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.661+0000 7f972be00640 1 -- 172.21.15.42:0/675921137 learned_addr learned my addr 172.21.15.42:0/675921137 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:13:04.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.661+0000 7f972b400640 1 --2- 172.21.15.42:0/675921137 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c8f376c10 0x562c8f379000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:04.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.661+0000 7f9730a00640 1 --2- 172.21.15.42:0/675921137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c8f36ba30 0x562c8f36be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:04.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.661+0000 7f972be00640 1 -- 172.21.15.42:0/675921137 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c8f376c10 msgr2=0x562c8f379000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:04.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.661+0000 7f972be00640 1 --2- 172.21.15.42:0/675921137 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c8f376c10 0x562c8f379000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.661+0000 7f972be00640 1 -- 172.21.15.42:0/675921137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c8f36ba30 msgr2=0x562c8f36be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:04.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.661+0000 7f972be00640 1 --2- 172.21.15.42:0/675921137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c8f36ba30 0x562c8f36be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.661+0000 7f972be00640 1 -- 172.21.15.42:0/675921137 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c8f0433c0 con 0x562c8f36c350 2024-08-26T00:13:04.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.661+0000 7f972b400640 1 --2- 172.21.15.42:0/675921137 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c8f376c10 0x562c8f379000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:13:04.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.662+0000 7f972be00640 1 --2- 172.21.15.42:0/675921137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f36c350 0x562c8f3766d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f971c0d74b0 tx=0x7f971c0d7970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=616b0d74f0d62d58 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:13:04.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.662+0000 7f9721200640 1 -- 172.21.15.42:0/675921137 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c0e2070 con 0x562c8f36c350 2024-08-26T00:13:04.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.662+0000 7f9721200640 1 -- 172.21.15.42:0/675921137 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f971c0cfb20 con 0x562c8f36c350 2024-08-26T00:13:04.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.662+0000 7f9721200640 1 -- 172.21.15.42:0/675921137 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c0ddb30 con 0x562c8f36c350 2024-08-26T00:13:04.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.662+0000 7f9728c00640 1 --2- 172.21.15.42:0/3096959608 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f97100a2c00 0x7f97100a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:04.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.662+0000 7f9728c00640 1 -- 172.21.15.42:0/3096959608 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f971c0cf250 con 0x7f972c101760 2024-08-26T00:13:04.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.662+0000 7f9730a00640 1 --2- 172.21.15.42:0/3096959608 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f97100a2c00 0x7f97100a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:04.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.663+0000 7f97353c2740 1 -- 172.21.15.42:0/675921137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f36c350 msgr2=0x562c8f3766d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:04.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.663+0000 7f97353c2740 1 --2- 172.21.15.42:0/675921137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f36c350 0x562c8f3766d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f971c0d74b0 tx=0x7f971c0d7970 comp rx=0 tx=0).stop 2024-08-26T00:13:04.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.663+0000 7f97353c2740 1 -- 172.21.15.42:0/675921137 shutdown_connections 2024-08-26T00:13:04.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.663+0000 7f97353c2740 1 --2- 172.21.15.42:0/675921137 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c8f376c10 0x562c8f379000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.663+0000 7f97353c2740 1 --2- 172.21.15.42:0/675921137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f36c350 0x562c8f3766d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.663+0000 7f97353c2740 1 --2- 172.21.15.42:0/675921137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c8f36ba30 0x562c8f36be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.663+0000 7f97353c2740 1 -- 172.21.15.42:0/675921137 >> 172.21.15.42:0/675921137 conn(0x562c8f367fc0 msgr2=0x562c8f3683a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:13:04.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.663+0000 7f9730a00640 1 --2- 172.21.15.42:0/3096959608 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f97100a2c00 0x7f97100a50c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9724005fd0 tx=0x7f97240096a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:13:04.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.663+0000 7f97353c2740 1 -- 172.21.15.42:0/675921137 shutdown_connections 2024-08-26T00:13:04.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.663+0000 7f97353c2740 1 -- 172.21.15.42:0/675921137 wait complete. 2024-08-26T00:13:04.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.664+0000 7f97353c2740 1 -- start start 2024-08-26T00:13:04.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.664+0000 7f97353c2740 1 Processor -- start 2024-08-26T00:13:04.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.665+0000 7f97353c2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c8f36ba30 0x562c8f373ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:04.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.665+0000 7f97353c2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c8f36c350 0x562c8f373ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:04.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.665+0000 7f97353c2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f376c10 0x562c8f374530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:04.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.665+0000 7f97353c2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562c8f3797e0 con 0x562c8f36ba30 2024-08-26T00:13:04.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.665+0000 7f97353c2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562c8f28cde0 con 0x562c8f376c10 2024-08-26T00:13:04.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.665+0000 7f97353c2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562c8f379960 con 0x562c8f36c350 2024-08-26T00:13:04.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.665+0000 7f97353c2740 10 client.0 _ll_register_callbacks cb 0x562c8f27b7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:13:04.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.665+0000 7f9730a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f376c10 0x562c8f374530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:04.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.665+0000 7f972b400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c8f36c350 0x562c8f373ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:04.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.665+0000 7f9730a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f376c10 0x562c8f374530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:38668/0 (socket says 172.21.15.42:38668) 2024-08-26T00:13:04.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.665+0000 7f9730a00640 1 -- 172.21.15.42:0/932822843 learned_addr learned my addr 172.21.15.42:0/932822843 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:13:04.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.665+0000 7f972be00640 1 --2- 172.21.15.42:0/932822843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c8f36ba30 0x562c8f373ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:04.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.665+0000 7f9730a00640 1 -- 172.21.15.42:0/932822843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c8f36c350 msgr2=0x562c8f373ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:04.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.665+0000 7f9730a00640 1 --2- 172.21.15.42:0/932822843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c8f36c350 0x562c8f373ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.665+0000 7f9730a00640 1 -- 172.21.15.42:0/932822843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c8f36ba30 msgr2=0x562c8f373ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:04.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.665+0000 7f9730a00640 1 --2- 172.21.15.42:0/932822843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c8f36ba30 0x562c8f373ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.665+0000 7f9730a00640 1 -- 172.21.15.42:0/932822843 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c8f382c80 con 0x562c8f376c10 2024-08-26T00:13:04.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.666+0000 7f972be00640 1 --2- 172.21.15.42:0/932822843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c8f36ba30 0x562c8f373ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:13:04.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.666+0000 7f9730a00640 1 --2- 172.21.15.42:0/932822843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f376c10 0x562c8f374530 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f972401f430 tx=0x7f9724004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73289bf3118c2b9c server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:13:04.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.666+0000 7f9715600640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:13:04.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.666+0000 7f9715600640 1 -- 172.21.15.42:0/932822843 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9724011710 con 0x562c8f376c10 2024-08-26T00:13:04.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.666+0000 7f97353c2740 1 -- 172.21.15.42:0/932822843 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f971c0cfb20 con 0x562c8f376c10 2024-08-26T00:13:04.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.666+0000 7f9715600640 1 -- 172.21.15.42:0/932822843 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f97240118b0 con 0x562c8f376c10 2024-08-26T00:13:04.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.666+0000 7f9715600640 1 -- 172.21.15.42:0/932822843 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9724011ab0 con 0x562c8f376c10 2024-08-26T00:13:04.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.666+0000 7f97353c2740 10 client.26219 fetch_fsmap learned FSMap version 32 2024-08-26T00:13:04.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.666+0000 7f97353c2740 1 -- 172.21.15.42:0/932822843 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x562c8f385660 con 0x562c8f376c10 2024-08-26T00:13:04.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.667+0000 7f9715600640 1 -- 172.21.15.42:0/932822843 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f971c0cfb20 con 0x562c8f376c10 2024-08-26T00:13:04.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.667+0000 7f9715600640 1 -- 172.21.15.42:0/932822843 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f9724026070 con 0x562c8f376c10 2024-08-26T00:13:04.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.667+0000 7f97353c2740 10 client.26219 fetch_fsmap finished waiting for FSMap version 32 2024-08-26T00:13:04.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.667+0000 7f97353c2740 10 client.26219 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-26T00:13:04.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.667+0000 7f97353c2740 20 client.26219 populate_metadata read hostname 'smithi042' 2024-08-26T00:13:04.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.667+0000 7f97353c2740 1 --2- 172.21.15.42:0/932822843 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562c8f386a70 0x562c8f388ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:04.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.667+0000 7f97353c2740 4 client.26219 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:13:04.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.667+0000 7f97353c2740 1 -- 172.21.15.42:0/932822843 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c8f2df4a0 con 0x562c8f386a70 2024-08-26T00:13:04.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.667+0000 7f972be00640 1 --2- 172.21.15.42:0/932822843 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562c8f386a70 0x562c8f388ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:04.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.668+0000 7f972be00640 1 --2- 172.21.15.42:0/932822843 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562c8f386a70 0x562c8f388ea0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b345c93a08279dd8 server_cookie=6c278e5b01496e7d in_seq=0 out_seq=0 2024-08-26T00:13:04.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.668+0000 7f9715600640 10 client.26219 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:13:04.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.669+0000 7f9715600640 1 -- 172.21.15.42:0/932822843 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562c8f2df4a0 con 0x562c8f386a70 2024-08-26T00:13:04.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.669+0000 7f9715600640 10 client.26219 handle_command_reply: tid=0 2024-08-26T00:13:04.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.669+0000 7f97353c2740 1 client.26219 shutdown 2024-08-26T00:13:04.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.669+0000 7f97353c2740 1 -- 172.21.15.42:0/932822843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f376c10 msgr2=0x562c8f374530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:04.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.669+0000 7f97353c2740 1 --2- 172.21.15.42:0/932822843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f376c10 0x562c8f374530 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f972401f430 tx=0x7f9724004ab0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.669+0000 7f97353c2740 1 -- 172.21.15.42:0/932822843 shutdown_connections 2024-08-26T00:13:04.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.669+0000 7f97353c2740 1 --2- 172.21.15.42:0/932822843 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562c8f386a70 0x562c8f388ea0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.669+0000 7f97353c2740 1 --2- 172.21.15.42:0/932822843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f376c10 0x562c8f374530 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.669+0000 7f97353c2740 1 --2- 172.21.15.42:0/932822843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c8f36c350 0x562c8f373ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.669+0000 7f9715600640 0 client.26219 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:13:04.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.669+0000 7f97353c2740 1 --2- 172.21.15.42:0/932822843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c8f36ba30 0x562c8f373ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.669+0000 7f97353c2740 1 -- 172.21.15.42:0/932822843 >> 172.21.15.42:0/932822843 conn(0x562c8f367fc0 msgr2=0x562c8f36dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:13:04.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.669+0000 7f97353c2740 1 -- 172.21.15.42:0/932822843 shutdown_connections 2024-08-26T00:13:04.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.669+0000 7f97353c2740 1 -- 172.21.15.42:0/932822843 wait complete. 2024-08-26T00:13:04.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.669+0000 7f97353c2740 20 client.26219 trim_cache size 0 max 16384 2024-08-26T00:13:04.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.685+0000 7f97353c2740 1 Processor -- start 2024-08-26T00:13:04.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.685+0000 7f97353c2740 1 -- start start 2024-08-26T00:13:04.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.686+0000 7f97353c2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c8f36ba30 0x562c8f373390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:04.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.686+0000 7f97353c2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f36c350 0x562c8f38e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:04.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.686+0000 7f97353c2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c8f376c10 0x562c8f38ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:04.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.686+0000 7f97353c2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f972c1b1de0 con 0x562c8f376c10 2024-08-26T00:13:04.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.686+0000 7f97353c2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f972c1af5f0 con 0x562c8f36c350 2024-08-26T00:13:04.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.686+0000 7f97353c2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f972c1ad420 con 0x562c8f36ba30 2024-08-26T00:13:04.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.686+0000 7f972b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f36c350 0x562c8f38e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:04.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.686+0000 7f972be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c8f36ba30 0x562c8f373390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:04.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.686+0000 7f972be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c8f36ba30 0x562c8f373390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:39638/0 (socket says 172.21.15.42:39638) 2024-08-26T00:13:04.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.686+0000 7f972be00640 1 -- 172.21.15.42:0/2223620525 learned_addr learned my addr 172.21.15.42:0/2223620525 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:13:04.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.686+0000 7f972b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f36c350 0x562c8f38e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:38678/0 (socket says 172.21.15.42:38678) 2024-08-26T00:13:04.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.686+0000 7f9730a00640 1 --2- 172.21.15.42:0/2223620525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c8f376c10 0x562c8f38ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:04.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.686+0000 7f972be00640 1 -- 172.21.15.42:0/2223620525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f36c350 msgr2=0x562c8f38e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:04.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.686+0000 7f972be00640 1 --2- 172.21.15.42:0/2223620525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f36c350 0x562c8f38e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.686+0000 7f972be00640 1 -- 172.21.15.42:0/2223620525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c8f376c10 msgr2=0x562c8f38ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:04.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.686+0000 7f972be00640 1 --2- 172.21.15.42:0/2223620525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c8f376c10 0x562c8f38ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.686+0000 7f972be00640 1 -- 172.21.15.42:0/2223620525 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c8f369130 con 0x562c8f36ba30 2024-08-26T00:13:04.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.687+0000 7f972be00640 1 --2- 172.21.15.42:0/2223620525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c8f36ba30 0x562c8f373390 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f971c0984f0 tx=0x7f971c0d1580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2298e2253beaf47b server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:13:04.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.687+0000 7f9717e00640 1 -- 172.21.15.42:0/2223620525 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c09b8f0 con 0x562c8f36ba30 2024-08-26T00:13:04.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.687+0000 7f9717e00640 1 -- 172.21.15.42:0/2223620525 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f971c09bb20 con 0x562c8f36ba30 2024-08-26T00:13:04.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.687+0000 7f9717e00640 1 -- 172.21.15.42:0/2223620525 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c09b480 con 0x562c8f36ba30 2024-08-26T00:13:04.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.688+0000 7f97353c2740 1 -- 172.21.15.42:0/2223620525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c8f36ba30 msgr2=0x562c8f373390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:04.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.688+0000 7f97353c2740 1 --2- 172.21.15.42:0/2223620525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c8f36ba30 0x562c8f373390 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f971c0984f0 tx=0x7f971c0d1580 comp rx=0 tx=0).stop 2024-08-26T00:13:04.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.688+0000 7f97353c2740 1 -- 172.21.15.42:0/2223620525 shutdown_connections 2024-08-26T00:13:04.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.688+0000 7f97353c2740 1 --2- 172.21.15.42:0/2223620525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c8f376c10 0x562c8f38ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.688+0000 7f97353c2740 1 --2- 172.21.15.42:0/2223620525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f36c350 0x562c8f38e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.688+0000 7f97353c2740 1 --2- 172.21.15.42:0/2223620525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c8f36ba30 0x562c8f373390 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.688+0000 7f97353c2740 1 -- 172.21.15.42:0/2223620525 >> 172.21.15.42:0/2223620525 conn(0x562c8f367fc0 msgr2=0x562c8f375a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:13:04.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.688+0000 7f97353c2740 1 -- 172.21.15.42:0/2223620525 shutdown_connections 2024-08-26T00:13:04.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.688+0000 7f97353c2740 1 -- 172.21.15.42:0/2223620525 wait complete. 2024-08-26T00:13:04.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.688+0000 7f97353c2740 1 -- start start 2024-08-26T00:13:04.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.688+0000 7f97353c2740 1 Processor -- start 2024-08-26T00:13:04.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.689+0000 7f97353c2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c8f36ba30 0x562c8f37a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:04.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.689+0000 7f97353c2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f36c350 0x562c8f37a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:04.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.689+0000 7f97353c2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c8f376c10 0x562c8f3ef730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:04.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.689+0000 7f97353c2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f972c1adab0 con 0x562c8f36ba30 2024-08-26T00:13:04.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.689+0000 7f97353c2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f972c1aef20 con 0x562c8f36c350 2024-08-26T00:13:04.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.689+0000 7f97353c2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f972c1ae180 con 0x562c8f376c10 2024-08-26T00:13:04.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.689+0000 7f97353c2740 10 client.0 _ll_register_callbacks cb 0x7f9724009240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:13:04.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.689+0000 7f972b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f36c350 0x562c8f37a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:04.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.689+0000 7f972b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f36c350 0x562c8f37a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:38686/0 (socket says 172.21.15.42:38686) 2024-08-26T00:13:04.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.689+0000 7f972b400640 1 -- 172.21.15.42:0/3695611694 learned_addr learned my addr 172.21.15.42:0/3695611694 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:13:04.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.689+0000 7f972be00640 1 --2- 172.21.15.42:0/3695611694 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c8f36ba30 0x562c8f37a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:04.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.689+0000 7f9730a00640 1 --2- 172.21.15.42:0/3695611694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c8f376c10 0x562c8f3ef730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:04.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.690+0000 7f972b400640 1 -- 172.21.15.42:0/3695611694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c8f376c10 msgr2=0x562c8f3ef730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:04.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.690+0000 7f972b400640 1 --2- 172.21.15.42:0/3695611694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c8f376c10 0x562c8f3ef730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.690+0000 7f972b400640 1 -- 172.21.15.42:0/3695611694 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c8f36ba30 msgr2=0x562c8f37a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:04.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.690+0000 7f972b400640 1 --2- 172.21.15.42:0/3695611694 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c8f36ba30 0x562c8f37a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.690+0000 7f972b400640 1 -- 172.21.15.42:0/3695611694 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c8f3efc70 con 0x562c8f36c350 2024-08-26T00:13:04.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.690+0000 7f972be00640 1 --2- 172.21.15.42:0/3695611694 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c8f36ba30 0x562c8f37a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:13:04.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.690+0000 7f972b400640 1 --2- 172.21.15.42:0/3695611694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f36c350 0x562c8f37a6d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9718033000 tx=0x7f9718005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b104fee4b9e35e51 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:13:04.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.690+0000 7f9715600640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:13:04.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.690+0000 7f9715600640 1 -- 172.21.15.42:0/3695611694 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9718035040 con 0x562c8f36c350 2024-08-26T00:13:04.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.690+0000 7f97353c2740 1 -- 172.21.15.42:0/3695611694 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f971c09bb20 con 0x562c8f36c350 2024-08-26T00:13:04.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.690+0000 7f9715600640 1 -- 172.21.15.42:0/3695611694 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f97180055a0 con 0x562c8f36c350 2024-08-26T00:13:04.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.691+0000 7f9715600640 1 -- 172.21.15.42:0/3695611694 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f97180046c0 con 0x562c8f36c350 2024-08-26T00:13:04.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.691+0000 7f97353c2740 10 client.26225 fetch_fsmap learned FSMap version 32 2024-08-26T00:13:04.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.691+0000 7f97353c2740 1 -- 172.21.15.42:0/3695611694 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x562c8f3f0f90 con 0x562c8f36c350 2024-08-26T00:13:04.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.691+0000 7f9715600640 1 -- 172.21.15.42:0/3695611694 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f971c09bb20 con 0x562c8f36c350 2024-08-26T00:13:04.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.691+0000 7f9715600640 1 -- 172.21.15.42:0/3695611694 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f9718003c30 con 0x562c8f36c350 2024-08-26T00:13:04.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.691+0000 7f97353c2740 10 client.26225 fetch_fsmap finished waiting for FSMap version 32 2024-08-26T00:13:04.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.691+0000 7f97353c2740 10 client.26225 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-26T00:13:04.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.691+0000 7f97353c2740 20 client.26225 populate_metadata read hostname 'smithi042' 2024-08-26T00:13:04.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.691+0000 7f97353c2740 1 --2- 172.21.15.42:0/3695611694 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562c8f3f1770 0x562c8f3f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:04.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.691+0000 7f97353c2740 4 client.26225 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:13:04.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.691+0000 7f97353c2740 1 -- 172.21.15.42:0/3695611694 --> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562c8f2d99b0 con 0x562c8f3f1770 2024-08-26T00:13:04.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.692+0000 7f972be00640 1 --2- 172.21.15.42:0/3695611694 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562c8f3f1770 0x562c8f3f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:04.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.692+0000 7f972be00640 1 --2- 172.21.15.42:0/3695611694 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562c8f3f1770 0x562c8f3f3b90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8ed7891995780bef server_cookie=e7bddc9b24c8d5a6 in_seq=0 out_seq=0 2024-08-26T00:13:04.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.692+0000 7f9715600640 10 client.26225 ms_handle_connect on v2:172.21.15.43:6838/2653014277 2024-08-26T00:13:04.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.693+0000 7f9715600640 1 -- 172.21.15.42:0/3695611694 <== mds.1 v2:172.21.15.43:6838/2653014277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562c8f2d99b0 con 0x562c8f3f1770 2024-08-26T00:13:04.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.693+0000 7f9715600640 10 client.26225 handle_command_reply: tid=0 2024-08-26T00:13:04.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.693+0000 7f97353c2740 1 client.26225 shutdown 2024-08-26T00:13:04.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.693+0000 7f97353c2740 1 -- 172.21.15.42:0/3695611694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f36c350 msgr2=0x562c8f37a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:04.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.693+0000 7f97353c2740 1 --2- 172.21.15.42:0/3695611694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f36c350 0x562c8f37a6d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9718033000 tx=0x7f9718005270 comp rx=0 tx=0).stop 2024-08-26T00:13:04.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.693+0000 7f97353c2740 1 -- 172.21.15.42:0/3695611694 shutdown_connections 2024-08-26T00:13:04.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.693+0000 7f97353c2740 1 --2- 172.21.15.42:0/3695611694 >> [v2:172.21.15.43:6838/2653014277,v1:172.21.15.43:6839/2653014277] conn(0x562c8f3f1770 0x562c8f3f3b90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.693+0000 7f97353c2740 1 --2- 172.21.15.42:0/3695611694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c8f376c10 0x562c8f3ef730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.693+0000 7f97353c2740 1 --2- 172.21.15.42:0/3695611694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c8f36c350 0x562c8f37a6d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.693+0000 7f9715600640 0 client.26225 ms_handle_reset on v2:172.21.15.43:6838/2653014277 2024-08-26T00:13:04.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.693+0000 7f97353c2740 1 --2- 172.21.15.42:0/3695611694 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c8f36ba30 0x562c8f37a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.693+0000 7f97353c2740 1 -- 172.21.15.42:0/3695611694 >> 172.21.15.42:0/3695611694 conn(0x562c8f367fc0 msgr2=0x562c8f36d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:13:04.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.694+0000 7f97353c2740 1 -- 172.21.15.42:0/3695611694 shutdown_connections 2024-08-26T00:13:04.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.694+0000 7f97353c2740 1 -- 172.21.15.42:0/3695611694 wait complete. 2024-08-26T00:13:04.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.694+0000 7f97353c2740 20 client.26225 trim_cache size 0 max 16384 2024-08-26T00:13:04.698 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:13:04.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.694+0000 7f9731400640 1 -- 172.21.15.42:0/3096959608 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f97100a2c00 msgr2=0x7f97100a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:04.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.694+0000 7f9731400640 1 --2- 172.21.15.42:0/3096959608 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f97100a2c00 0x7f97100a50c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9724005fd0 tx=0x7f97240096a0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.694+0000 7f9731400640 1 -- 172.21.15.42:0/3096959608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f972c101760 msgr2=0x7f972c19a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:04.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.694+0000 7f9731400640 1 --2- 172.21.15.42:0/3096959608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f972c101760 0x7f972c19a260 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f971c00e9f0 tx=0x7f971c00eeb0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.695+0000 7f9731400640 1 -- 172.21.15.42:0/3096959608 shutdown_connections 2024-08-26T00:13:04.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.695+0000 7f9731400640 1 --2- 172.21.15.42:0/3096959608 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f97100a2c00 0x7f97100a50c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.695+0000 7f9731400640 1 --2- 172.21.15.42:0/3096959608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f972c107760 0x7f972c19eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.695+0000 7f9731400640 1 --2- 172.21.15.42:0/3096959608 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f972c102100 0x7f972c19a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.695+0000 7f9731400640 1 --2- 172.21.15.42:0/3096959608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f972c101760 0x7f972c19a260 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:04.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.695+0000 7f9731400640 1 -- 172.21.15.42:0/3096959608 >> 172.21.15.42:0/3096959608 conn(0x7f972c0fd4e0 msgr2=0x7f972c10cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:13:04.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.695+0000 7f9731400640 1 -- 172.21.15.42:0/3096959608 shutdown_connections 2024-08-26T00:13:04.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:04.695+0000 7f9731400640 1 -- 172.21.15.42:0/3096959608 wait complete. 2024-08-26T00:13:04.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:04 smithi043 ceph-mon[22091]: pgmap v655: 97 pgs: 97 active+clean; 1.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 413 op/s 2024-08-26T00:13:04.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:04 smithi181 ceph-mon[22102]: pgmap v655: 97 pgs: 97 active+clean; 1.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 413 op/s 2024-08-26T00:13:05.791 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-26T00:13:06.257 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:13:06.681 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:06 smithi042 ceph-mon[17225]: pgmap v656: 97 pgs: 97 active+clean; 1.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 358 op/s 2024-08-26T00:13:06.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:06 smithi043 ceph-mon[22091]: pgmap v656: 97 pgs: 97 active+clean; 1.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 358 op/s 2024-08-26T00:13:06.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:06 smithi181 ceph-mon[22102]: pgmap v656: 97 pgs: 97 active+clean; 1.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 358 op/s 2024-08-26T00:13:06.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.803+0000 7f662f800640 1 -- 172.21.15.42:0/4210870990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6628104760 msgr2=0x7f66281087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:06.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.803+0000 7f662f800640 1 --2- 172.21.15.42:0/4210870990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6628104760 0x7f66281087b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6614009900 tx=0x7f661402a3f0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.803+0000 7f662f800640 1 -- 172.21.15.42:0/4210870990 shutdown_connections 2024-08-26T00:13:06.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.803+0000 7f662f800640 1 --2- 172.21.15.42:0/4210870990 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6628108ee0 0x7f6628110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.803+0000 7f662f800640 1 --2- 172.21.15.42:0/4210870990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6628104760 0x7f66281087b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.803+0000 7f662f800640 1 --2- 172.21.15.42:0/4210870990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6628103db0 0x7f6628104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.803+0000 7f662f800640 1 -- 172.21.15.42:0/4210870990 >> 172.21.15.42:0/4210870990 conn(0x7f66280ff7f0 msgr2=0x7f6628101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:13:06.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.803+0000 7f662f800640 1 -- 172.21.15.42:0/4210870990 shutdown_connections 2024-08-26T00:13:06.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.803+0000 7f662f800640 1 -- 172.21.15.42:0/4210870990 wait complete. 2024-08-26T00:13:06.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.804+0000 7f662f800640 1 Processor -- start 2024-08-26T00:13:06.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.804+0000 7f662f800640 1 -- start start 2024-08-26T00:13:06.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.805+0000 7f662f800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6628103db0 0x7f662819a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:06.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.805+0000 7f662f800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6628104760 0x7f662819a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:06.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.805+0000 7f662f800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6628108ee0 0x7f662819ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:06.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.805+0000 7f662f800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6628113f40 con 0x7f6628103db0 2024-08-26T00:13:06.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.805+0000 7f662f800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6628113dc0 con 0x7f6628104760 2024-08-26T00:13:06.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.805+0000 7f662f800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f66281140c0 con 0x7f6628108ee0 2024-08-26T00:13:06.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.805+0000 7f6627e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6628104760 0x7f662819a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:06.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.805+0000 7f662ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6628103db0 0x7f662819a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:06.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.805+0000 7f6627e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6628104760 0x7f662819a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:52116/0 (socket says 172.21.15.42:52116) 2024-08-26T00:13:06.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.805+0000 7f6627e00640 1 -- 172.21.15.42:0/3146245615 learned_addr learned my addr 172.21.15.42:0/3146245615 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:13:06.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.805+0000 7f662d800640 1 --2- 172.21.15.42:0/3146245615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6628108ee0 0x7f662819ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:06.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.806+0000 7f6627e00640 1 -- 172.21.15.42:0/3146245615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6628108ee0 msgr2=0x7f662819ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:06.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.806+0000 7f6627e00640 1 --2- 172.21.15.42:0/3146245615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6628108ee0 0x7f662819ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.806+0000 7f6627e00640 1 -- 172.21.15.42:0/3146245615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6628103db0 msgr2=0x7f662819a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:06.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.806+0000 7f6627e00640 1 --2- 172.21.15.42:0/3146245615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6628103db0 0x7f662819a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.806+0000 7f6627e00640 1 -- 172.21.15.42:0/3146245615 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f662819f370 con 0x7f6628104760 2024-08-26T00:13:06.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.806+0000 7f662ce00640 1 --2- 172.21.15.42:0/3146245615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6628103db0 0x7f662819a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:13:06.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.806+0000 7f6627e00640 1 --2- 172.21.15.42:0/3146245615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6628104760 0x7f662819a900 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6614006010 tx=0x7f66140042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:13:06.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.806+0000 7f6625600640 1 -- 172.21.15.42:0/3146245615 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661403f030 con 0x7f6628104760 2024-08-26T00:13:06.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.806+0000 7f6625600640 1 -- 172.21.15.42:0/3146245615 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6614003ce0 con 0x7f6628104760 2024-08-26T00:13:06.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.806+0000 7f6625600640 1 -- 172.21.15.42:0/3146245615 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6614035070 con 0x7f6628104760 2024-08-26T00:13:06.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.806+0000 7f662f800640 1 -- 172.21.15.42:0/3146245615 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f662819f600 con 0x7f6628104760 2024-08-26T00:13:06.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.806+0000 7f662f800640 1 -- 172.21.15.42:0/3146245615 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66281a6f40 con 0x7f6628104760 2024-08-26T00:13:06.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.810+0000 7f66322b9740 1 Processor -- start 2024-08-26T00:13:06.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.810+0000 7f66322b9740 1 -- start start 2024-08-26T00:13:06.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.810+0000 7f6625600640 1 -- 172.21.15.42:0/3146245615 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6614042030 con 0x7f6628104760 2024-08-26T00:13:06.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.810+0000 7f66322b9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390e1820 0x5654390e1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:06.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.810+0000 7f66322b9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654390e2140 0x5654390ec4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:06.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.810+0000 7f66322b9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390eca00 0x5654390eedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:06.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.810+0000 7f66322b9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x565439047f30 con 0x5654390e2140 2024-08-26T00:13:06.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.810+0000 7f66322b9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x565438fdf5a0 con 0x5654390eca00 2024-08-26T00:13:06.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.810+0000 7f66322b9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x565439043ef0 con 0x5654390e1820 2024-08-26T00:13:06.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.810+0000 7f662d800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390e1820 0x5654390e1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:06.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.810+0000 7f662d800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390e1820 0x5654390e1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:58850/0 (socket says 172.21.15.42:58850) 2024-08-26T00:13:06.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.810+0000 7f662d800640 1 -- 172.21.15.42:0/3377981858 learned_addr learned my addr 172.21.15.42:0/3377981858 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:13:06.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.810+0000 7f6627e00640 1 --2- 172.21.15.42:0/3377981858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390eca00 0x5654390eedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:06.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.810+0000 7f662ce00640 1 --2- 172.21.15.42:0/3377981858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654390e2140 0x5654390ec4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:06.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.811+0000 7f662d800640 1 -- 172.21.15.42:0/3377981858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390eca00 msgr2=0x5654390eedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:06.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.811+0000 7f662d800640 1 --2- 172.21.15.42:0/3377981858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390eca00 0x5654390eedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.811+0000 7f662d800640 1 -- 172.21.15.42:0/3377981858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654390e2140 msgr2=0x5654390ec4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:06.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.811+0000 7f662d800640 1 --2- 172.21.15.42:0/3377981858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654390e2140 0x5654390ec4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.811+0000 7f662d800640 1 -- 172.21.15.42:0/3377981858 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565438db93c0 con 0x5654390e1820 2024-08-26T00:13:06.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.811+0000 7f662d800640 1 --2- 172.21.15.42:0/3377981858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390e1820 0x5654390e1c00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6620009f70 tx=0x7f6620010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88785d2d0a7b4d89 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:13:06.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.811+0000 7f661a000640 1 -- 172.21.15.42:0/3377981858 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6620016070 con 0x5654390e1820 2024-08-26T00:13:06.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.811+0000 7f661a000640 1 -- 172.21.15.42:0/3377981858 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6620004d20 con 0x5654390e1820 2024-08-26T00:13:06.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.811+0000 7f661a000640 1 -- 172.21.15.42:0/3377981858 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6620012850 con 0x5654390e1820 2024-08-26T00:13:06.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.812+0000 7f6625600640 1 --2- 172.21.15.42:0/3146245615 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f66100a2c00 0x7f66100a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:06.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.812+0000 7f6625600640 1 -- 172.21.15.42:0/3146245615 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f66140ef530 con 0x7f6628104760 2024-08-26T00:13:06.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.812+0000 7f662ce00640 1 --2- 172.21.15.42:0/3146245615 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f66100a2c00 0x7f66100a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:06.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.812+0000 7f66322b9740 1 -- 172.21.15.42:0/3377981858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390e1820 msgr2=0x5654390e1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:06.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.812+0000 7f66322b9740 1 --2- 172.21.15.42:0/3377981858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390e1820 0x5654390e1c00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6620009f70 tx=0x7f6620010800 comp rx=0 tx=0).stop 2024-08-26T00:13:06.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.812+0000 7f66322b9740 1 -- 172.21.15.42:0/3377981858 shutdown_connections 2024-08-26T00:13:06.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.812+0000 7f66322b9740 1 --2- 172.21.15.42:0/3377981858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390eca00 0x5654390eedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.812+0000 7f66322b9740 1 --2- 172.21.15.42:0/3377981858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654390e2140 0x5654390ec4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.812+0000 7f66322b9740 1 --2- 172.21.15.42:0/3377981858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390e1820 0x5654390e1c00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.812+0000 7f66322b9740 1 -- 172.21.15.42:0/3377981858 >> 172.21.15.42:0/3377981858 conn(0x5654390dddb0 msgr2=0x5654390de190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:13:06.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.813+0000 7f66322b9740 1 -- 172.21.15.42:0/3377981858 shutdown_connections 2024-08-26T00:13:06.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.813+0000 7f66322b9740 1 -- 172.21.15.42:0/3377981858 wait complete. 2024-08-26T00:13:06.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.813+0000 7f662ce00640 1 --2- 172.21.15.42:0/3146245615 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f66100a2c00 0x7f66100a50c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x5654390dec10 tx=0x7f661c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:13:06.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.813+0000 7f66322b9740 1 -- start start 2024-08-26T00:13:06.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.814+0000 7f66322b9740 1 Processor -- start 2024-08-26T00:13:06.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.814+0000 7f66322b9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390e1820 0x5654390e9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:06.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.814+0000 7f66322b9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390e2140 0x5654390e9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:06.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.814+0000 7f66322b9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654390eca00 0x5654390ea2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:06.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.814+0000 7f66322b9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5654390ef5d0 con 0x5654390eca00 2024-08-26T00:13:06.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.814+0000 7f66322b9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x565439002de0 con 0x5654390e2140 2024-08-26T00:13:06.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.814+0000 7f66322b9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5654390ef750 con 0x5654390e1820 2024-08-26T00:13:06.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.814+0000 7f66322b9740 10 client.0 _ll_register_callbacks cb 0x565438ff17b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:13:06.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.814+0000 7f662ce00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390e1820 0x5654390e9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:06.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.814+0000 7f6627e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390e2140 0x5654390e9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:06.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.814+0000 7f6627e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390e2140 0x5654390e9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:52136/0 (socket says 172.21.15.42:52136) 2024-08-26T00:13:06.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.814+0000 7f662ce00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390e1820 0x5654390e9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:58862/0 (socket says 172.21.15.42:58862) 2024-08-26T00:13:06.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.815+0000 7f6627e00640 1 -- 172.21.15.42:0/2492467646 learned_addr learned my addr 172.21.15.42:0/2492467646 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:13:06.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.815+0000 7f662d800640 1 --2- 172.21.15.42:0/2492467646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654390eca00 0x5654390ea2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:06.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.815+0000 7f6627e00640 1 -- 172.21.15.42:0/2492467646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390e1820 msgr2=0x5654390e9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:06.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.815+0000 7f6627e00640 1 --2- 172.21.15.42:0/2492467646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390e1820 0x5654390e9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.815+0000 7f6627e00640 1 -- 172.21.15.42:0/2492467646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654390eca00 msgr2=0x5654390ea2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:06.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.815+0000 7f6627e00640 1 --2- 172.21.15.42:0/2492467646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654390eca00 0x5654390ea2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.815+0000 7f6627e00640 1 -- 172.21.15.42:0/2492467646 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654390f8a70 con 0x5654390e2140 2024-08-26T00:13:06.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.815+0000 7f6627e00640 1 --2- 172.21.15.42:0/2492467646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390e2140 0x5654390e9db0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f66140c4550 tx=0x7f6614005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7138010e62f877d server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:13:06.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.815+0000 7f660ea00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-08-26T00:13:06.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.815+0000 7f660ea00640 1 -- 172.21.15.42:0/2492467646 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6614049070 con 0x5654390e2140 2024-08-26T00:13:06.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.816+0000 7f660ea00640 1 -- 172.21.15.42:0/2492467646 <== mon.2 v2:172.21.15.43:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f66140c45f0 con 0x5654390e2140 2024-08-26T00:13:06.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.816+0000 7f66322b9740 1 -- 172.21.15.42:0/2492467646 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6620004d20 con 0x5654390e2140 2024-08-26T00:13:06.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.816+0000 7f660ea00640 1 -- 172.21.15.42:0/2492467646 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f66140b8160 con 0x5654390e2140 2024-08-26T00:13:06.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.816+0000 7f66322b9740 10 client.26237 fetch_fsmap learned FSMap version 32 2024-08-26T00:13:06.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.816+0000 7f66322b9740 1 -- 172.21.15.42:0/2492467646 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5654390fb360 con 0x5654390e2140 2024-08-26T00:13:06.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.816+0000 7f660ea00640 1 -- 172.21.15.42:0/2492467646 <== mon.2 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6620004d20 con 0x5654390e2140 2024-08-26T00:13:06.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.816+0000 7f660ea00640 1 -- 172.21.15.42:0/2492467646 <== mon.2 v2:172.21.15.43:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f661403bbb0 con 0x5654390e2140 2024-08-26T00:13:06.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.816+0000 7f66322b9740 10 client.26237 fetch_fsmap finished waiting for FSMap version 32 2024-08-26T00:13:06.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.816+0000 7f66322b9740 10 client.26237 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:13:06.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.816+0000 7f66322b9740 20 client.26237 populate_metadata read hostname 'smithi042' 2024-08-26T00:13:06.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.816+0000 7f66322b9740 1 --2- 172.21.15.42:0/2492467646 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5654390fc7c0 0x5654390fec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:06.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.816+0000 7f66322b9740 4 client.26237 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-26T00:13:06.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.816+0000 7f66322b9740 1 -- 172.21.15.42:0/2492467646 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654390554a0 con 0x5654390fc7c0 2024-08-26T00:13:06.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.817+0000 7f662ce00640 1 --2- 172.21.15.42:0/2492467646 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5654390fc7c0 0x5654390fec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:06.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.817+0000 7f662ce00640 1 --2- 172.21.15.42:0/2492467646 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5654390fc7c0 0x5654390fec20 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c8431ca83b2bb97 server_cookie=c81f91020057d1b in_seq=0 out_seq=0 2024-08-26T00:13:06.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.817+0000 7f660ea00640 10 client.26237 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:13:06.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.818+0000 7f660ea00640 1 -- 172.21.15.42:0/2492467646 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5654390554a0 con 0x5654390fc7c0 2024-08-26T00:13:06.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.818+0000 7f660ea00640 10 client.26237 handle_command_reply: tid=0 2024-08-26T00:13:06.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.818+0000 7f66322b9740 1 client.26237 shutdown 2024-08-26T00:13:06.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.818+0000 7f66322b9740 1 -- 172.21.15.42:0/2492467646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390e2140 msgr2=0x5654390e9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:06.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.818+0000 7f66322b9740 1 --2- 172.21.15.42:0/2492467646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390e2140 0x5654390e9db0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f66140c4550 tx=0x7f6614005bd0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.818+0000 7f66322b9740 1 -- 172.21.15.42:0/2492467646 shutdown_connections 2024-08-26T00:13:06.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.818+0000 7f66322b9740 1 --2- 172.21.15.42:0/2492467646 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5654390fc7c0 0x5654390fec20 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.818+0000 7f66322b9740 1 --2- 172.21.15.42:0/2492467646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654390eca00 0x5654390ea2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.818+0000 7f66322b9740 1 --2- 172.21.15.42:0/2492467646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390e2140 0x5654390e9db0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.818+0000 7f660ea00640 0 client.26237 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:13:06.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.818+0000 7f66322b9740 1 --2- 172.21.15.42:0/2492467646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390e1820 0x5654390e9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.818+0000 7f66322b9740 1 -- 172.21.15.42:0/2492467646 >> 172.21.15.42:0/2492467646 conn(0x5654390dddb0 msgr2=0x5654390dcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:13:06.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.819+0000 7f66322b9740 1 -- 172.21.15.42:0/2492467646 shutdown_connections 2024-08-26T00:13:06.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.819+0000 7f66322b9740 1 -- 172.21.15.42:0/2492467646 wait complete. 2024-08-26T00:13:06.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.819+0000 7f66322b9740 20 client.26237 trim_cache size 0 max 16384 2024-08-26T00:13:06.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.833+0000 7f66322b9740 1 Processor -- start 2024-08-26T00:13:06.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.833+0000 7f66322b9740 1 -- start start 2024-08-26T00:13:06.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.834+0000 7f66322b9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390e1820 0x5654390e4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:06.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.834+0000 7f66322b9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390e2140 0x5654390dce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:06.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.834+0000 7f66322b9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654390eca00 0x5654391044f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:06.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.834+0000 7f66322b9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f66281b1e90 con 0x5654390eca00 2024-08-26T00:13:06.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.834+0000 7f66322b9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f66281af6a0 con 0x5654390e1820 2024-08-26T00:13:06.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.834+0000 7f66322b9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f66281ad4d0 con 0x5654390e2140 2024-08-26T00:13:06.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.834+0000 7f662ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390e1820 0x5654390e4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:06.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.834+0000 7f662ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390e1820 0x5654390e4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:52148/0 (socket says 172.21.15.42:52148) 2024-08-26T00:13:06.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.834+0000 7f662ce00640 1 -- 172.21.15.42:0/392762068 learned_addr learned my addr 172.21.15.42:0/392762068 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:13:06.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.834+0000 7f6627e00640 1 --2- 172.21.15.42:0/392762068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390e2140 0x5654390dce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:06.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.834+0000 7f662d800640 1 --2- 172.21.15.42:0/392762068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654390eca00 0x5654391044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:06.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.834+0000 7f662ce00640 1 -- 172.21.15.42:0/392762068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390e2140 msgr2=0x5654390dce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:06.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.834+0000 7f662ce00640 1 --2- 172.21.15.42:0/392762068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390e2140 0x5654390dce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.834+0000 7f662ce00640 1 -- 172.21.15.42:0/392762068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654390eca00 msgr2=0x5654391044f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:06.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.834+0000 7f662ce00640 1 --2- 172.21.15.42:0/392762068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654390eca00 0x5654391044f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.834+0000 7f662ce00640 1 -- 172.21.15.42:0/392762068 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654390ddbe0 con 0x5654390e1820 2024-08-26T00:13:06.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.834+0000 7f6627e00640 1 --2- 172.21.15.42:0/392762068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390e2140 0x5654390dce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:13:06.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.835+0000 7f662ce00640 1 --2- 172.21.15.42:0/392762068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390e1820 0x5654390e4280 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f661c012d70 tx=0x7f661c01a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=484034b7bd8a7440 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:13:06.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.835+0000 7f6619600640 1 -- 172.21.15.42:0/392762068 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c003d90 con 0x5654390e1820 2024-08-26T00:13:06.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.835+0000 7f6619600640 1 -- 172.21.15.42:0/392762068 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f661c02b950 con 0x5654390e1820 2024-08-26T00:13:06.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.835+0000 7f6619600640 1 -- 172.21.15.42:0/392762068 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c01fc10 con 0x5654390e1820 2024-08-26T00:13:06.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.836+0000 7f66322b9740 1 -- 172.21.15.42:0/392762068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390e1820 msgr2=0x5654390e4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:06.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.836+0000 7f66322b9740 1 --2- 172.21.15.42:0/392762068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390e1820 0x5654390e4280 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f661c012d70 tx=0x7f661c01a000 comp rx=0 tx=0).stop 2024-08-26T00:13:06.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.836+0000 7f66322b9740 1 -- 172.21.15.42:0/392762068 shutdown_connections 2024-08-26T00:13:06.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.836+0000 7f66322b9740 1 --2- 172.21.15.42:0/392762068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654390eca00 0x5654391044f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.836+0000 7f66322b9740 1 --2- 172.21.15.42:0/392762068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390e2140 0x5654390dce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.836+0000 7f66322b9740 1 --2- 172.21.15.42:0/392762068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390e1820 0x5654390e4280 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.836+0000 7f66322b9740 1 -- 172.21.15.42:0/392762068 >> 172.21.15.42:0/392762068 conn(0x5654390dddb0 msgr2=0x5654390dc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:13:06.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.836+0000 7f66322b9740 1 -- 172.21.15.42:0/392762068 shutdown_connections 2024-08-26T00:13:06.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.836+0000 7f66322b9740 1 -- 172.21.15.42:0/392762068 wait complete. 2024-08-26T00:13:06.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.836+0000 7f66322b9740 1 -- start start 2024-08-26T00:13:06.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.837+0000 7f66322b9740 1 Processor -- start 2024-08-26T00:13:06.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.837+0000 7f66322b9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654390e1820 0x5654390f5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:06.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.837+0000 7f66322b9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390e2140 0x5654390e6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:06.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.837+0000 7f66322b9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390eca00 0x5654390e69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:06.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.837+0000 7f66322b9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f66281adb60 con 0x5654390e1820 2024-08-26T00:13:06.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.837+0000 7f66322b9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f66281aefd0 con 0x5654390e2140 2024-08-26T00:13:06.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.837+0000 7f66322b9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f66281ae230 con 0x5654390eca00 2024-08-26T00:13:06.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.837+0000 7f66322b9740 10 client.0 _ll_register_callbacks cb 0x7f6614005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-26T00:13:06.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.837+0000 7f6627e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390e2140 0x5654390e6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:06.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.837+0000 7f662ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654390e1820 0x5654390f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:06.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.837+0000 7f662d800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390eca00 0x5654390e69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:06.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.838+0000 7f6627e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390e2140 0x5654390e6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:52156/0 (socket says 172.21.15.42:52156) 2024-08-26T00:13:06.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.838+0000 7f6627e00640 1 -- 172.21.15.42:0/866500252 learned_addr learned my addr 172.21.15.42:0/866500252 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:13:06.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.838+0000 7f662d800640 1 -- 172.21.15.42:0/866500252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390e2140 msgr2=0x5654390e6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:06.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.838+0000 7f662d800640 1 --2- 172.21.15.42:0/866500252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390e2140 0x5654390e6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.838+0000 7f662d800640 1 -- 172.21.15.42:0/866500252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654390e1820 msgr2=0x5654390f5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-26T00:13:06.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.838+0000 7f662d800640 1 --2- 172.21.15.42:0/866500252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654390e1820 0x5654390f5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.838+0000 7f662d800640 1 -- 172.21.15.42:0/866500252 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654390e7040 con 0x5654390eca00 2024-08-26T00:13:06.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.838+0000 7f6627e00640 1 --2- 172.21.15.42:0/866500252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390e2140 0x5654390e6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:13:06.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.838+0000 7f662d800640 1 --2- 172.21.15.42:0/866500252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390eca00 0x5654390e69a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6620011010 tx=0x7f6620004ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f07906fb7191fcc server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:13:06.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.838+0000 7f660ea00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-08-26T00:13:06.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.839+0000 7f660ea00640 1 -- 172.21.15.42:0/866500252 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662002a060 con 0x5654390eca00 2024-08-26T00:13:06.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.839+0000 7f660ea00640 1 -- 172.21.15.42:0/866500252 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f6620012760 con 0x5654390eca00 2024-08-26T00:13:06.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.839+0000 7f66322b9740 1 -- 172.21.15.42:0/866500252 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f661c02b950 con 0x5654390eca00 2024-08-26T00:13:06.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.839+0000 7f660ea00640 1 -- 172.21.15.42:0/866500252 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6620016070 con 0x5654390eca00 2024-08-26T00:13:06.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.839+0000 7f66322b9740 10 client.26206 fetch_fsmap learned FSMap version 32 2024-08-26T00:13:06.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.839+0000 7f66322b9740 1 -- 172.21.15.42:0/866500252 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x565439167350 con 0x5654390eca00 2024-08-26T00:13:06.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.839+0000 7f660ea00640 1 -- 172.21.15.42:0/866500252 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f661c02b950 con 0x5654390eca00 2024-08-26T00:13:06.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.839+0000 7f660ea00640 1 -- 172.21.15.42:0/866500252 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f662002f070 con 0x5654390eca00 2024-08-26T00:13:06.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.839+0000 7f66322b9740 10 client.26206 fetch_fsmap finished waiting for FSMap version 32 2024-08-26T00:13:06.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.839+0000 7f66322b9740 10 client.26206 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-26T00:13:06.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.839+0000 7f66322b9740 20 client.26206 populate_metadata read hostname 'smithi042' 2024-08-26T00:13:06.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.839+0000 7f66322b9740 1 --2- 172.21.15.42:0/866500252 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5654390fc7c0 0x5654391697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:13:06.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.839+0000 7f66322b9740 4 client.26206 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-26T00:13:06.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.839+0000 7f66322b9740 1 -- 172.21.15.42:0/866500252 --> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56543904f9b0 con 0x5654390fc7c0 2024-08-26T00:13:06.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.840+0000 7f662ce00640 1 --2- 172.21.15.42:0/866500252 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5654390fc7c0 0x5654391697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:13:06.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.840+0000 7f662ce00640 1 --2- 172.21.15.42:0/866500252 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5654390fc7c0 0x5654391697f0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b53a11f019f9c675 server_cookie=17ddade0d60ec02c in_seq=0 out_seq=0 2024-08-26T00:13:06.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.840+0000 7f660ea00640 10 client.26206 ms_handle_connect on v2:172.21.15.181:6838/351429985 2024-08-26T00:13:06.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.843+0000 7f660ea00640 1 -- 172.21.15.42:0/866500252 <== mds.0 v2:172.21.15.181:6838/351429985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56543904f9b0 con 0x5654390fc7c0 2024-08-26T00:13:06.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.843+0000 7f660ea00640 10 client.26206 handle_command_reply: tid=0 2024-08-26T00:13:06.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.843+0000 7f66322b9740 1 client.26206 shutdown 2024-08-26T00:13:06.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.844+0000 7f66322b9740 1 -- 172.21.15.42:0/866500252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390eca00 msgr2=0x5654390e69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:06.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.844+0000 7f66322b9740 1 --2- 172.21.15.42:0/866500252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390eca00 0x5654390e69a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6620011010 tx=0x7f6620004ca0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.848 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-08-26T00:13:06.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.845+0000 7f66322b9740 1 -- 172.21.15.42:0/866500252 shutdown_connections 2024-08-26T00:13:06.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.845+0000 7f66322b9740 1 --2- 172.21.15.42:0/866500252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654390eca00 0x5654390e69a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.845+0000 7f66322b9740 1 --2- 172.21.15.42:0/866500252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654390e2140 0x5654390e6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.845+0000 7f66322b9740 1 --2- 172.21.15.42:0/866500252 >> [v2:172.21.15.181:6838/351429985,v1:172.21.15.181:6839/351429985] conn(0x5654390fc7c0 0x5654391697f0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.845+0000 7f66322b9740 1 --2- 172.21.15.42:0/866500252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5654390e1820 0x5654390f5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.845+0000 7f66322b9740 1 -- 172.21.15.42:0/866500252 >> 172.21.15.42:0/866500252 conn(0x5654390dddb0 msgr2=0x5654390dcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:13:06.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.845+0000 7f660ea00640 0 client.26206 ms_handle_reset on v2:172.21.15.181:6838/351429985 2024-08-26T00:13:06.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.846+0000 7f66322b9740 1 -- 172.21.15.42:0/866500252 shutdown_connections 2024-08-26T00:13:06.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.846+0000 7f66322b9740 1 -- 172.21.15.42:0/866500252 wait complete. 2024-08-26T00:13:06.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.846+0000 7f66322b9740 20 client.26206 trim_cache size 0 max 16384 2024-08-26T00:13:06.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.848+0000 7f662f800640 1 -- 172.21.15.42:0/3146245615 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f66100a2c00 msgr2=0x7f66100a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:06.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.848+0000 7f662f800640 1 --2- 172.21.15.42:0/3146245615 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f66100a2c00 0x7f66100a50c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x5654390dec10 tx=0x7f661c005f90 comp rx=0 tx=0).stop 2024-08-26T00:13:06.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.848+0000 7f662f800640 1 -- 172.21.15.42:0/3146245615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6628104760 msgr2=0x7f662819a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:13:06.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.848+0000 7f662f800640 1 --2- 172.21.15.42:0/3146245615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6628104760 0x7f662819a900 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6614006010 tx=0x7f66140042f0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.848+0000 7f662f800640 1 -- 172.21.15.42:0/3146245615 shutdown_connections 2024-08-26T00:13:06.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.848+0000 7f662f800640 1 --2- 172.21.15.42:0/3146245615 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f66100a2c00 0x7f66100a50c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.848+0000 7f662f800640 1 --2- 172.21.15.42:0/3146245615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6628108ee0 0x7f662819ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.848+0000 7f662f800640 1 --2- 172.21.15.42:0/3146245615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6628104760 0x7f662819a900 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.848+0000 7f662f800640 1 --2- 172.21.15.42:0/3146245615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6628103db0 0x7f662819a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:13:06.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.848+0000 7f662f800640 1 -- 172.21.15.42:0/3146245615 >> 172.21.15.42:0/3146245615 conn(0x7f66280ff7f0 msgr2=0x7f6628100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:13:06.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.848+0000 7f662f800640 1 -- 172.21.15.42:0/3146245615 shutdown_connections 2024-08-26T00:13:06.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:13:06.849+0000 7f662f800640 1 -- 172.21.15.42:0/3146245615 wait complete. 2024-08-26T00:13:07.728 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 587140, 'ino': 1099511643815, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 25584189, 'ino': 1099511641405, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-33.xml'}, {'damage_type': 'backtrace', 'id': 27571746, 'ino': 1099511643906, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-30.xml'}, {'damage_type': 'backtrace', 'id': 47230986, 'ino': 1099511635648, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-62.xml'}, {'damage_type': 'backtrace', 'id': 55421467, 'ino': 1099511643897, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-38.xml'}, {'damage_type': 'backtrace', 'id': 59237164, 'ino': 2199023264395, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 62546291, 'ino': 1099511643824, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-38.xml'}, {'damage_type': 'backtrace', 'id': 84878492, 'ino': 2199023264399, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 124185723, 'ino': 1099511637985, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 139014626, 'ino': 1099511643878, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-57.xml'}, {'damage_type': 'backtrace', 'id': 164980889, 'ino': 1099511638235, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 165619480, 'ino': 1099511635745, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-14.xml'}, {'damage_type': 'backtrace', 'id': 173097492, 'ino': 1099511637894, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-11.xml'}, {'damage_type': 'backtrace', 'id': 197381015, 'ino': 2199023264348, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 209673805, 'ino': 1099511635728, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-23.xml'}, {'damage_type': 'backtrace', 'id': 218277181, 'ino': 1099511635678, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-43.xml'}, {'damage_type': 'backtrace', 'id': 227137805, 'ino': 1099511635740, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-16.xml'}, {'damage_type': 'backtrace', 'id': 228131804, 'ino': 1099511635769, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-4.xml'}, {'damage_type': 'backtrace', 'id': 254808795, 'ino': 1099511641494, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 294107102, 'ino': 1099511641552, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 294584253, 'ino': 1099511643829, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-33.xml'}, {'damage_type': 'backtrace', 'id': 319277585, 'ino': 1099511643867, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-2.xml'}, {'damage_type': 'backtrace', 'id': 323637930, 'ino': 1099511637889, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-14.xml'}, {'damage_type': 'backtrace', 'id': 325379777, 'ino': 1099511643811, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 326626340, 'ino': 1099511641346, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-53.xml'}, {'damage_type': 'backtrace', 'id': 353708785, 'ino': 1099511635656, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-58.xml'}, {'damage_type': 'backtrace', 'id': 378560013, 'ino': 1099511643850, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-13.xml'}, {'damage_type': 'backtrace', 'id': 385018348, 'ino': 1099511643799, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-58.xml'}, {'damage_type': 'backtrace', 'id': 398519179, 'ino': 1099511643823, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-39.xml'}, {'damage_type': 'backtrace', 'id': 438428428, 'ino': 1099511643777, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-80.xml'}, {'damage_type': 'backtrace', 'id': 450936238, 'ino': 1099511637418, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-72.xml'}, {'damage_type': 'backtrace', 'id': 460419647, 'ino': 1099511643869, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-1.xml'}, {'damage_type': 'backtrace', 'id': 473992423, 'ino': 1099511643916, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-21.xml'}, {'damage_type': 'backtrace', 'id': 478271053, 'ino': 1099511637887, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-16.xml'}, {'damage_type': 'backtrace', 'id': 494233093, 'ino': 1099511641372, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-43.xml'}, {'damage_type': 'backtrace', 'id': 498645752, 'ino': 1099511638137, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-3.xml'}, {'damage_type': 'backtrace', 'id': 513299146, 'ino': 1099511643930, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-9.xml'}, {'damage_type': 'backtrace', 'id': 518192081, 'ino': 1099511643786, 'path': '~mds2/stray4/10000003e8a'}, {'damage_type': 'backtrace', 'id': 525951209, 'ino': 1099511638201, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-64.jpg'}, {'damage_type': 'backtrace', 'id': 562158984, 'ino': 1099511643939, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 566331327, 'ino': 1099511635705, 'path': '~mds2/stray4/10000001ef9'}, {'damage_type': 'backtrace', 'id': 633189744, 'ino': 1099511638125, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-7.xml'}, {'damage_type': 'backtrace', 'id': 646767605, 'ino': 2199023264290, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/article-4.xml'}, {'damage_type': 'backtrace', 'id': 665878067, 'ino': 1099511643835, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-27.xml'}, {'damage_type': 'backtrace', 'id': 675423389, 'ino': 1099511643899, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-36.xml'}, {'damage_type': 'backtrace', 'id': 687424284, 'ino': 1099511635751, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-11.xml'}, {'damage_type': 'backtrace', 'id': 705546393, 'ino': 1099511643848, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-15.xml'}, {'damage_type': 'backtrace', 'id': 707079394, 'ino': 1099511637938, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 736238819, 'ino': 1099511638255, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 745087159, 'ino': 1099511635668, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-52.xml'}, {'damage_type': 'backtrace', 'id': 767176776, 'ino': 1099511643808, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-52.xml'}, {'damage_type': 'backtrace', 'id': 770028637, 'ino': 1099511643935, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-4.xml'}, {'damage_type': 'backtrace', 'id': 776064280, 'ino': 1099511643817, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 782053598, 'ino': 1099511638049, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-44.xml'}, {'damage_type': 'backtrace', 'id': 796325261, 'ino': 1099511643832, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 817491805, 'ino': 1099511635774, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-2.xml'}, {'damage_type': 'backtrace', 'id': 827363241, 'ino': 1099511643914, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-23.xml'}, {'damage_type': 'backtrace', 'id': 843274991, 'ino': 1099511643856, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-9.xml'}, {'damage_type': 'backtrace', 'id': 850754733, 'ino': 1099511637937, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 855908111, 'ino': 1099511643886, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-49.xml'}, {'damage_type': 'backtrace', 'id': 860241440, 'ino': 1099511635792, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 860428227, 'ino': 1099511643783, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-74.xml'}, {'damage_type': 'backtrace', 'id': 866582611, 'ino': 1099511643912, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-25.xml'}, {'damage_type': 'backtrace', 'id': 869328671, 'ino': 1099511643809, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 895732724, 'ino': 1099511635784, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 898560239, 'ino': 1099511643802, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-55.xml'}, {'damage_type': 'backtrace', 'id': 898915543, 'ino': 1099511643881, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-54.xml'}, {'damage_type': 'backtrace', 'id': 906693167, 'ino': 1099511643893, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-42.xml'}, {'damage_type': 'backtrace', 'id': 907012746, 'ino': 1099511643793, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-64.xml'}, {'damage_type': 'backtrace', 'id': 913091667, 'ino': 1099511635764, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-6.xml'}, {'damage_type': 'backtrace', 'id': 913245908, 'ino': 1099511641337, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-57.xml'}, {'damage_type': 'backtrace', 'id': 944197526, 'ino': 1099511641599, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 950417518, 'ino': 1099511643883, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-52.xml'}, {'damage_type': 'backtrace', 'id': 954418126, 'ino': 1099511641424, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-28.xml'}, {'damage_type': 'backtrace', 'id': 970993204, 'ino': 1099511643936, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-3.xml'}, {'damage_type': 'backtrace', 'id': 982620757, 'ino': 1099511643940, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 986091435, 'ino': 1099511635723, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-25.xml'}, {'damage_type': 'backtrace', 'id': 998452246, 'ino': 1099511641532, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 1009908553, 'ino': 1099511635749, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-12.xml'}, {'damage_type': 'backtrace', 'id': 1012878225, 'ino': 1099511635690, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-35.xml'}, {'damage_type': 'backtrace', 'id': 1030505630, 'ino': 1099511635682, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-39.xml'}, {'damage_type': 'backtrace', 'id': 1040926562, 'ino': 1099511643882, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-53.xml'}, {'damage_type': 'backtrace', 'id': 1050980045, 'ino': 1099511643827, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-35.xml'}, {'damage_type': 'backtrace', 'id': 1086743690, 'ino': 1099511635708, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-28.xml'}, {'damage_type': 'backtrace', 'id': 1087515906, 'ino': 1099511643784, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-73.xml'}, {'damage_type': 'backtrace', 'id': 1122532454, 'ino': 1099511643865, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-3.xml'}, {'damage_type': 'backtrace', 'id': 1144443479, 'ino': 1099511643846, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-16.xml'}, {'damage_type': 'backtrace', 'id': 1163981518, 'ino': 2199023264301, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 1204539671, 'ino': 1099511643822, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-40.xml'}, {'damage_type': 'backtrace', 'id': 1237081193, 'ino': 1099511637994, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 1264351822, 'ino': 1099511638264, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 1268246906, 'ino': 1099511641459, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-19.xml'}, {'damage_type': 'backtrace', 'id': 1298716177, 'ino': 1099511635688, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-36.xml'}, {'damage_type': 'backtrace', 'id': 1308101015, 'ino': 1099511643796, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-61.xml'}, {'damage_type': 'backtrace', 'id': 1309087182, 'ino': 1099511643929, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-10.xml'}, {'damage_type': 'backtrace', 'id': 1353344460, 'ino': 1099511643909, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-27.xml'}, {'damage_type': 'backtrace', 'id': 1359558472, 'ino': 1099511637997, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 1377396789, 'ino': 1099511641335, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-58.xml'}, {'damage_type': 'backtrace', 'id': 1385739741, 'ino': 1099511643836, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-26.xml'}, {'damage_type': 'backtrace', 'id': 1401998011, 'ino': 2199023264432, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 1417387490, 'ino': 1099511637958, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 1434059282, 'ino': 1099511635713, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-26.xml'}, {'damage_type': 'backtrace', 'id': 1436250541, 'ino': 1099511643907, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-29.xml'}, {'damage_type': 'backtrace', 'id': 1442338251, 'ino': 1099511643863, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-4.xml'}, {'damage_type': 'backtrace', 'id': 1457867750, 'ino': 1099511635756, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-9.xml'}, {'damage_type': 'backtrace', 'id': 1474683099, 'ino': 1099511635754, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-10.xml'}, {'damage_type': 'backtrace', 'id': 1495938407, 'ino': 1099511635734, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-21.xml'}, {'damage_type': 'backtrace', 'id': 1511420106, 'ino': 1099511635662, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-55.xml'}, {'damage_type': 'backtrace', 'id': 1546866194, 'ino': 1099511643902, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-33.xml'}, {'damage_type': 'backtrace', 'id': 1547201019, 'ino': 1099511635706, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-30.xml'}, {'damage_type': 'backtrace', 'id': 1551349358, 'ino': 1099511643791, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-66.xml'}, {'damage_type': 'backtrace', 'id': 1574387982, 'ino': 1099511635658, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-57.xml'}, {'damage_type': 'backtrace', 'id': 1603768275, 'ino': 1099511635707, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-29.xml'}, {'damage_type': 'backtrace', 'id': 1607567984, 'ino': 1099511637960, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 1640751620, 'ino': 1099511641641, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 1653256861, 'ino': 1099511638231, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 1655681653, 'ino': 1099511635804, 'path': '~mds2/stray4/10000001f5c'}, {'damage_type': 'backtrace', 'id': 1664583342, 'ino': 1099511643888, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-47.xml'}, {'damage_type': 'backtrace', 'id': 1670890983, 'ino': 1099511643825, 'path': '~mds2/stray4/10000003eb1'}, {'damage_type': 'backtrace', 'id': 1676667503, 'ino': 1099511643898, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-37.xml'}, {'damage_type': 'backtrace', 'id': 1711765030, 'ino': 1099511635650, 'path': '~mds2/stray3/10000001ec2'}, {'damage_type': 'backtrace', 'id': 1714369502, 'ino': 1099511643931, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-8.xml'}, {'damage_type': 'backtrace', 'id': 1716620682, 'ino': 1099511635747, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-13.xml'}, {'damage_type': 'backtrace', 'id': 1738910285, 'ino': 1099511643795, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-62.xml'}, {'damage_type': 'backtrace', 'id': 1751731338, 'ino': 2199023264350, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 1757025776, 'ino': 1099511643861, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-6.xml'}, {'damage_type': 'backtrace', 'id': 1778370207, 'ino': 1099511637941, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 1792336963, 'ino': 1099511641873, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-80.xml'}, {'damage_type': 'backtrace', 'id': 1810844620, 'ino': 1099511643911, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-26.xml'}, {'damage_type': 'backtrace', 'id': 1811701347, 'ino': 1099511643927, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-12.xml'}, {'damage_type': 'backtrace', 'id': 1826940463, 'ino': 1099511635758, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-8.xml'}, {'damage_type': 'backtrace', 'id': 1839005741, 'ino': 1099511635736, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-19.xml'}, {'damage_type': 'backtrace', 'id': 1850544249, 'ino': 1099511643845, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-17.xml'}, {'damage_type': 'backtrace', 'id': 1851131672, 'ino': 1099511635731, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-22.xml'}, {'damage_type': 'backtrace', 'id': 1856555950, 'ino': 1099511643900, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-35.xml'}, {'damage_type': 'backtrace', 'id': 1908151086, 'ino': 1099511635704, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-32.xml'}, {'damage_type': 'backtrace', 'id': 1946889694, 'ino': 1099511643913, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-24.xml'}, {'damage_type': 'backtrace', 'id': 1977295995, 'ino': 1099511643776, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-81.xml'}, {'damage_type': 'backtrace', 'id': 1992184797, 'ino': 1099511643938, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-1.xml'}, {'damage_type': 'backtrace', 'id': 1992724604, 'ino': 1099511638243, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 2008101862, 'ino': 1099511635671, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-50.xml'}, {'damage_type': 'backtrace', 'id': 2016702805, 'ino': 1099511643840, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-22.xml'}, {'damage_type': 'backtrace', 'id': 2058080803, 'ino': 1099511643842, 'path': '~mds2/stray4/10000003ec2'}, {'damage_type': 'backtrace', 'id': 2060877549, 'ino': 1099511643778, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-79.xml'}, {'damage_type': 'backtrace', 'id': 2067356200, 'ino': 1099511637929, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-66.jpg'}, {'damage_type': 'backtrace', 'id': 2071886921, 'ino': 1099511643798, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-59.xml'}, {'damage_type': 'backtrace', 'id': 2076753996, 'ino': 1099511643826, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-36.xml'}, {'damage_type': 'backtrace', 'id': 2083817995, 'ino': 1099511638213, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 2096065877, 'ino': 1099511641385, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-40.xml'}, {'damage_type': 'backtrace', 'id': 2098712750, 'ino': 1099511643797, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-60.xml'}, {'damage_type': 'backtrace', 'id': 2119169807, 'ino': 1099511635761, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-7.xml'}, {'damage_type': 'backtrace', 'id': 2125739463, 'ino': 1099511638282, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 2138100367, 'ino': 1099511635680, 'path': '~mds2/stray4/10000001ee0'}, {'damage_type': 'backtrace', 'id': 2145536449, 'ino': 1099511637904, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-4.xml'}, {'damage_type': 'backtrace', 'id': 2153137542, 'ino': 1099511635674, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-47.xml'}, {'damage_type': 'backtrace', 'id': 2163355045, 'ino': 1099511643838, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-24.xml'}, {'damage_type': 'backtrace', 'id': 2195351817, 'ino': 1099511643843, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-19.xml'}, {'damage_type': 'backtrace', 'id': 2212626954, 'ino': 1099511635798, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 2222233499, 'ino': 1099511635683, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-38.xml'}, {'damage_type': 'backtrace', 'id': 2226224671, 'ino': 1099511637964, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 2232521319, 'ino': 1099511643923, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-16.xml'}, {'damage_type': 'backtrace', 'id': 2253683857, 'ino': 1099511635772, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-3.xml'}, {'damage_type': 'backtrace', 'id': 2253951216, 'ino': 1099511643926, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-13.xml'}, {'damage_type': 'backtrace', 'id': 2278447602, 'ino': 1099511638088, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-24.xml'}, {'damage_type': 'backtrace', 'id': 2285031267, 'ino': 1099511641597, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 2302802698, 'ino': 1099511643790, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-67.xml'}, {'damage_type': 'backtrace', 'id': 2321282494, 'ino': 1099511637983, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-44.xml'}, {'damage_type': 'backtrace', 'id': 2322420151, 'ino': 1099511643885, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-50.xml'}, {'damage_type': 'backtrace', 'id': 2342650020, 'ino': 1099511643917, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-20.xml'}, {'damage_type': 'backtrace', 'id': 2355584751, 'ino': 1099511643891, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-44.xml'}, {'damage_type': 'backtrace', 'id': 2358599099, 'ino': 1099511643800, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-57.xml'}, {'damage_type': 'backtrace', 'id': 2395679443, 'ino': 1099511635681, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-40.xml'}, {'damage_type': 'backtrace', 'id': 2399362362, 'ino': 1099511643924, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-15.xml'}, {'damage_type': 'backtrace', 'id': 2401267735, 'ino': 1099511643887, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-48.xml'}, {'damage_type': 'backtrace', 'id': 2406010209, 'ino': 1099511635646, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-63.xml'}, {'damage_type': 'backtrace', 'id': 2418452016, 'ino': 1099511635673, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-48.xml'}, {'damage_type': 'backtrace', 'id': 2444423302, 'ino': 1099511635644, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-64.xml'}, {'damage_type': 'backtrace', 'id': 2473890170, 'ino': 1099511635782, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 2491539810, 'ino': 3298534884928, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/article-54.xml'}, {'damage_type': 'backtrace', 'id': 2547146754, 'ino': 1099511643780, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-77.xml'}, {'damage_type': 'backtrace', 'id': 2561872124, 'ino': 1099511635743, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-15.xml'}, {'damage_type': 'backtrace', 'id': 2631272483, 'ino': 1099511637607, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-65.xml'}, {'damage_type': 'backtrace', 'id': 2638115297, 'ino': 1099511635802, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 2651733806, 'ino': 1099511635795, 'path': '~mds2/stray4/10000001f53'}, {'damage_type': 'backtrace', 'id': 2658079761, 'ino': 1099511643781, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-76.xml'}, {'damage_type': 'backtrace', 'id': 2660891116, 'ino': 1099511643853, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-12.xml'}, {'damage_type': 'backtrace', 'id': 2671680714, 'ino': 1099511643839, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-23.xml'}, {'damage_type': 'backtrace', 'id': 2683534848, 'ino': 1099511643819, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 2731228730, 'ino': 1099511641545, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 2754920229, 'ino': 1099511643814, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-46.xml'}, {'damage_type': 'backtrace', 'id': 2764712829, 'ino': 1099511643894, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-41.xml'}, {'damage_type': 'backtrace', 'id': 2767599540, 'ino': 1099511643877, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-58.xml'}, {'damage_type': 'backtrace', 'id': 2781738825, 'ino': 1099511643779, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-78.xml'}, {'damage_type': 'backtrace', 'id': 2790831583, 'ino': 1099511635787, 'path': '~mds2/stray4/10000001f4b'}, {'damage_type': 'backtrace', 'id': 2801681175, 'ino': 1099511643792, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 2835062275, 'ino': 1099511643860, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-7.xml'}, {'damage_type': 'backtrace', 'id': 2835418371, 'ino': 1099511641377, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-42.xml'}, {'damage_type': 'backtrace', 'id': 2837708385, 'ino': 1099511637911, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-80.jpg'}, {'damage_type': 'backtrace', 'id': 2864736946, 'ino': 1099511643810, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-50.xml'}, {'damage_type': 'backtrace', 'id': 2904596845, 'ino': 1099511638030, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-62.xml'}, {'damage_type': 'backtrace', 'id': 2924964657, 'ino': 1099511635687, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-37.xml'}, {'damage_type': 'backtrace', 'id': 2947718411, 'ino': 1099511635676, 'path': '~mds2/stray4/10000001edc'}, {'damage_type': 'backtrace', 'id': 2982721160, 'ino': 1099511643794, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-63.xml'}, {'damage_type': 'backtrace', 'id': 2983549565, 'ino': 1099511641522, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 2984402264, 'ino': 1099511637961, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 2994631024, 'ino': 1099511641466, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-15.xml'}, {'damage_type': 'backtrace', 'id': 3002952167, 'ino': 1099511643831, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-31.xml'}, {'damage_type': 'backtrace', 'id': 3012349100, 'ino': 1099511635800, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 3016514507, 'ino': 1099511643879, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-56.xml'}, {'damage_type': 'backtrace', 'id': 3036436623, 'ino': 1099511637417, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/picture-70.jpg'}, {'damage_type': 'backtrace', 'id': 3040040424, 'ino': 1099511643937, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-2.xml'}, {'damage_type': 'backtrace', 'id': 3042133069, 'ino': 1099511638238, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 3045625822, 'ino': 1099511643788, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-69.xml'}, {'damage_type': 'backtrace', 'id': 3087048479, 'ino': 1099511643933, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-6.xml'}, {'damage_type': 'backtrace', 'id': 3089143784, 'ino': 1099511635738, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-17.xml'}, {'damage_type': 'backtrace', 'id': 3097023503, 'ino': 1099511635679, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-42.xml'}, {'damage_type': 'backtrace', 'id': 3099585317, 'ino': 1099511643816, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 3141826582, 'ino': 1099511638250, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 3148911180, 'ino': 2199023264312, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 3151081442, 'ino': 1099511635703, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-33.xml'}, {'damage_type': 'backtrace', 'id': 3160467507, 'ino': 1099511643908, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-28.xml'}, {'damage_type': 'backtrace', 'id': 3177408734, 'ino': 2199023264342, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 3180476607, 'ino': 1099511643830, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-32.xml'}, {'damage_type': 'backtrace', 'id': 3184702383, 'ino': 1099511643820, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 3194905884, 'ino': 1099511643880, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-55.xml'}, {'damage_type': 'backtrace', 'id': 3225195848, 'ino': 1099511643941, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 3251512910, 'ino': 1099511643925, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-14.xml'}, {'damage_type': 'backtrace', 'id': 3290450584, 'ino': 1099511638177, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-68.jpg'}, {'damage_type': 'backtrace', 'id': 3303663708, 'ino': 1099511643895, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-40.xml'}, {'damage_type': 'backtrace', 'id': 3321726922, 'ino': 1099511643928, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-11.xml'}, {'damage_type': 'backtrace', 'id': 3344916332, 'ino': 1099511635652, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-60.xml'}, {'damage_type': 'backtrace', 'id': 3345859498, 'ino': 1099511643849, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-14.xml'}, {'damage_type': 'backtrace', 'id': 3349744374, 'ino': 1099511641507, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 3353937035, 'ino': 1099511635725, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-24.xml'}, {'damage_type': 'backtrace', 'id': 3357430781, 'ino': 1099511643915, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-22.xml'}, {'damage_type': 'backtrace', 'id': 3371598368, 'ino': 1099511643932, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-7.xml'}, {'damage_type': 'backtrace', 'id': 3380361309, 'ino': 1099511643844, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-18.xml'}, {'damage_type': 'backtrace', 'id': 3383402078, 'ino': 1099511643884, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-51.xml'}, {'damage_type': 'backtrace', 'id': 3432714762, 'ino': 1099511638120, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-9.xml'}, {'damage_type': 'backtrace', 'id': 3446564351, 'ino': 1099511635664, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-54.xml'}, {'damage_type': 'backtrace', 'id': 3448874522, 'ino': 1099511635777, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-1.xml'}, {'damage_type': 'backtrace', 'id': 3472838081, 'ino': 1099511642162, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-67.xml'}, {'damage_type': 'backtrace', 'id': 3482923596, 'ino': 1099511638027, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-65.xml'}, {'damage_type': 'backtrace', 'id': 3507792369, 'ino': 1099511643834, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-28.xml'}, {'damage_type': 'backtrace', 'id': 3523529694, 'ino': 1099511643904, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-31.xml'}, {'damage_type': 'backtrace', 'id': 3564762255, 'ino': 2199023264360, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 3582515565, 'ino': 1099511643785, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-72.xml'}, {'damage_type': 'backtrace', 'id': 3583297555, 'ino': 1099511643890, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-45.xml'}, {'damage_type': 'backtrace', 'id': 3597241603, 'ino': 1099511643804, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-54.xml'}, {'damage_type': 'backtrace', 'id': 3621116835, 'ino': 1099511635666, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-53.xml'}, {'damage_type': 'backtrace', 'id': 3625191214, 'ino': 1099511635660, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-56.xml'}, {'damage_type': 'backtrace', 'id': 3653331392, 'ino': 1099511643855, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-10.xml'}, {'damage_type': 'backtrace', 'id': 3655005680, 'ino': 1099511638025, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/article-67.xml'}, {'damage_type': 'backtrace', 'id': 3697487645, 'ino': 1099511643841, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-21.xml'}, {'damage_type': 'backtrace', 'id': 3762229530, 'ino': 1099511643812, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-48.xml'}, {'damage_type': 'backtrace', 'id': 3801930764, 'ino': 1099511637895, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/article-10.xml'}, {'damage_type': 'backtrace', 'id': 3854788016, 'ino': 1099511643813, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-47.xml'}, {'damage_type': 'backtrace', 'id': 3865128295, 'ino': 1099511635675, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-46.xml'}, {'damage_type': 'backtrace', 'id': 3925984267, 'ino': 1099511643789, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-68.xml'}, {'damage_type': 'backtrace', 'id': 3949370720, 'ino': 1099511637923, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-72.jpg'}, {'damage_type': 'backtrace', 'id': 3959392221, 'ino': 1099511643892, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-43.xml'}, {'damage_type': 'backtrace', 'id': 3970215084, 'ino': 1099511635789, 'path': '~mds2/stray4/10000001f4d'}, {'damage_type': 'backtrace', 'id': 3971588146, 'ino': 1099511643920, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-19.xml'}, {'damage_type': 'backtrace', 'id': 3975615161, 'ino': 1099511643782, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-75.xml'}, {'damage_type': 'backtrace', 'id': 3976705448, 'ino': 1099511638273, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-274/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 3991487858, 'ino': 1099511641348, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/article-52.xml'}, {'damage_type': 'backtrace', 'id': 4005208489, 'ino': 1099511643854, 'path': '~mds2/stray4/10000003ece'}, {'damage_type': 'backtrace', 'id': 4040498257, 'ino': 1099511637984, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 4081626124, 'ino': 1099511641511, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 4083140440, 'ino': 1099511643896, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-39.xml'}, {'damage_type': 'backtrace', 'id': 4086414621, 'ino': 1099511643837, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-25.xml'}, {'damage_type': 'backtrace', 'id': 4093611953, 'ino': 1099511643858, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-8.xml'}, {'damage_type': 'backtrace', 'id': 4093690960, 'ino': 1099511643889, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-46.xml'}, {'damage_type': 'backtrace', 'id': 4113762324, 'ino': 1099511643807, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-53.xml'}, {'damage_type': 'backtrace', 'id': 4116143591, 'ino': 1099511643828, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-34.xml'}, {'damage_type': 'backtrace', 'id': 4165180246, 'ino': 2199023264422, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-55/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 4171755734, 'ino': 1099511643934, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-5.xml'}, {'damage_type': 'backtrace', 'id': 4200636642, 'ino': 1099511643921, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-364/article-18.xml'}, {'damage_type': 'backtrace', 'id': 4213861800, 'ino': 1099511641574, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-318/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 4252299098, 'ino': 1099511640698, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/article-82.xml'}, {'damage_type': 'backtrace', 'id': 4263128795, 'ino': 1099511637912, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-79.jpg'}, {'damage_type': 'backtrace', 'id': 4279143785, 'ino': 1099511643787, 'path': '/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-205/comment-70.xml'}] 2024-08-26T00:13:07.728 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_f273685f88d22802ccbd8a96b393734630028a13/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_f273685f88d22802ccbd8a96b393734630028a13/qa/tasks/fwd_scrub.py", line 48, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph_f273685f88d22802ccbd8a96b393734630028a13/qa/tasks/fwd_scrub.py", line 70, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph_f273685f88d22802ccbd8a96b393734630028a13/qa/tasks/fwd_scrub.py", line 81, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-08-26T00:13:08.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:08 smithi043 ceph-mon[22091]: pgmap v657: 97 pgs: 97 active+clean; 1.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 398 op/s 2024-08-26T00:13:08.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:08 smithi042 ceph-mon[17225]: pgmap v657: 97 pgs: 97 active+clean; 1.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 398 op/s 2024-08-26T00:13:08.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:08 smithi181 ceph-mon[22102]: pgmap v657: 97 pgs: 97 active+clean; 1.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 398 op/s 2024-08-26T00:13:10.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:10 smithi043 ceph-mon[22091]: pgmap v658: 97 pgs: 97 active+clean; 1.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 396 op/s 2024-08-26T00:13:10.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:10 smithi042 ceph-mon[17225]: pgmap v658: 97 pgs: 97 active+clean; 1.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 396 op/s 2024-08-26T00:13:10.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:10 smithi181 ceph-mon[22102]: pgmap v658: 97 pgs: 97 active+clean; 1.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 396 op/s 2024-08-26T00:13:12.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:12 smithi043 ceph-mon[22091]: pgmap v659: 97 pgs: 97 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 343 op/s 2024-08-26T00:13:12.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:12 smithi042 ceph-mon[17225]: pgmap v659: 97 pgs: 97 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 343 op/s 2024-08-26T00:13:12.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:12 smithi181 ceph-mon[22102]: pgmap v659: 97 pgs: 97 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 343 op/s 2024-08-26T00:13:14.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:14 smithi043 ceph-mon[22091]: pgmap v660: 97 pgs: 97 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 395 op/s 2024-08-26T00:13:14.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:14 smithi042 ceph-mon[17225]: pgmap v660: 97 pgs: 97 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 395 op/s 2024-08-26T00:13:14.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:14 smithi181 ceph-mon[22102]: pgmap v660: 97 pgs: 97 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 395 op/s 2024-08-26T00:13:16.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:16 smithi042 ceph-mon[17225]: pgmap v661: 97 pgs: 97 active+clean; 1.2 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 355 op/s 2024-08-26T00:13:16.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:16 smithi181 ceph-mon[22102]: pgmap v661: 97 pgs: 97 active+clean; 1.2 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 355 op/s 2024-08-26T00:13:17.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:16 smithi043 ceph-mon[22091]: pgmap v661: 97 pgs: 97 active+clean; 1.2 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 355 op/s 2024-08-26T00:13:18.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:18 smithi042 ceph-mon[17225]: pgmap v662: 97 pgs: 97 active+clean; 1.2 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 388 op/s 2024-08-26T00:13:18.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:18 smithi181 ceph-mon[22102]: pgmap v662: 97 pgs: 97 active+clean; 1.2 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 388 op/s 2024-08-26T00:13:18.812 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:18 smithi043 ceph-mon[22091]: pgmap v662: 97 pgs: 97 active+clean; 1.2 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 388 op/s 2024-08-26T00:13:20.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:20 smithi042 ceph-mon[17225]: pgmap v663: 97 pgs: 97 active+clean; 1.2 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 389 op/s 2024-08-26T00:13:20.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:20 smithi181 ceph-mon[22102]: pgmap v663: 97 pgs: 97 active+clean; 1.2 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 389 op/s 2024-08-26T00:13:21.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:20 smithi043 ceph-mon[22091]: pgmap v663: 97 pgs: 97 active+clean; 1.2 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 389 op/s 2024-08-26T00:13:22.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:22 smithi042 ceph-mon[17225]: pgmap v664: 97 pgs: 97 active+clean; 1.2 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 348 op/s 2024-08-26T00:13:22.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:22 smithi181 ceph-mon[22102]: pgmap v664: 97 pgs: 97 active+clean; 1.2 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 348 op/s 2024-08-26T00:13:23.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:22 smithi043 ceph-mon[22091]: pgmap v664: 97 pgs: 97 active+clean; 1.2 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 348 op/s 2024-08-26T00:13:24.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:24 smithi042 ceph-mon[17225]: pgmap v665: 97 pgs: 97 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 398 op/s 2024-08-26T00:13:24.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:24 smithi181 ceph-mon[22102]: pgmap v665: 97 pgs: 97 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 398 op/s 2024-08-26T00:13:25.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:24 smithi043 ceph-mon[22091]: pgmap v665: 97 pgs: 97 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 398 op/s 2024-08-26T00:13:26.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:26 smithi042 ceph-mon[17225]: pgmap v666: 97 pgs: 97 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 347 op/s 2024-08-26T00:13:26.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:26 smithi181 ceph-mon[22102]: pgmap v666: 97 pgs: 97 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 347 op/s 2024-08-26T00:13:27.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:26 smithi043 ceph-mon[22091]: pgmap v666: 97 pgs: 97 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 347 op/s 2024-08-26T00:13:28.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:28 smithi042 ceph-mon[17225]: pgmap v667: 97 pgs: 97 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 390 op/s 2024-08-26T00:13:28.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:28 smithi181 ceph-mon[22102]: pgmap v667: 97 pgs: 97 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 390 op/s 2024-08-26T00:13:29.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:28 smithi043 ceph-mon[22091]: pgmap v667: 97 pgs: 97 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 390 op/s 2024-08-26T00:13:30.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:30 smithi042 ceph-mon[17225]: pgmap v668: 97 pgs: 97 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 432 op/s 2024-08-26T00:13:30.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:30 smithi181 ceph-mon[22102]: pgmap v668: 97 pgs: 97 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 432 op/s 2024-08-26T00:13:31.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:30 smithi043 ceph-mon[22091]: pgmap v668: 97 pgs: 97 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 432 op/s 2024-08-26T00:13:33.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:32 smithi043 ceph-mon[22091]: pgmap v669: 97 pgs: 97 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 405 op/s 2024-08-26T00:13:33.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:32 smithi042 ceph-mon[17225]: pgmap v669: 97 pgs: 97 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 405 op/s 2024-08-26T00:13:33.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:32 smithi181 ceph-mon[22102]: pgmap v669: 97 pgs: 97 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 405 op/s 2024-08-26T00:13:35.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:34 smithi043 ceph-mon[22091]: pgmap v670: 97 pgs: 97 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 485 op/s 2024-08-26T00:13:35.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:34 smithi042 ceph-mon[17225]: pgmap v670: 97 pgs: 97 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 485 op/s 2024-08-26T00:13:35.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:34 smithi181 ceph-mon[22102]: pgmap v670: 97 pgs: 97 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 485 op/s 2024-08-26T00:13:37.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:36 smithi043 ceph-mon[22091]: pgmap v671: 97 pgs: 97 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 441 op/s 2024-08-26T00:13:37.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:36 smithi042 ceph-mon[17225]: pgmap v671: 97 pgs: 97 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 441 op/s 2024-08-26T00:13:37.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:36 smithi181 ceph-mon[22102]: pgmap v671: 97 pgs: 97 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 441 op/s 2024-08-26T00:13:39.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:38 smithi043 ceph-mon[22091]: pgmap v672: 97 pgs: 97 active+clean; 1.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 510 op/s 2024-08-26T00:13:39.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:38 smithi042 ceph-mon[17225]: pgmap v672: 97 pgs: 97 active+clean; 1.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 510 op/s 2024-08-26T00:13:39.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:38 smithi181 ceph-mon[22102]: pgmap v672: 97 pgs: 97 active+clean; 1.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 510 op/s 2024-08-26T00:13:41.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:40 smithi043 ceph-mon[22091]: pgmap v673: 97 pgs: 97 active+clean; 1.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 568 op/s 2024-08-26T00:13:41.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:40 smithi042 ceph-mon[17225]: pgmap v673: 97 pgs: 97 active+clean; 1.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 568 op/s 2024-08-26T00:13:41.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:40 smithi181 ceph-mon[22102]: pgmap v673: 97 pgs: 97 active+clean; 1.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 568 op/s 2024-08-26T00:13:43.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:42 smithi043 ceph-mon[22091]: pgmap v674: 97 pgs: 97 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 534 op/s 2024-08-26T00:13:43.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:42 smithi042 ceph-mon[17225]: pgmap v674: 97 pgs: 97 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 534 op/s 2024-08-26T00:13:43.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:42 smithi181 ceph-mon[22102]: pgmap v674: 97 pgs: 97 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 534 op/s 2024-08-26T00:13:45.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:44 smithi043 ceph-mon[22091]: pgmap v675: 97 pgs: 97 active+clean; 1016 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 628 op/s 2024-08-26T00:13:45.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:44 smithi042 ceph-mon[17225]: pgmap v675: 97 pgs: 97 active+clean; 1016 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 628 op/s 2024-08-26T00:13:45.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:44 smithi181 ceph-mon[22102]: pgmap v675: 97 pgs: 97 active+clean; 1016 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 628 op/s 2024-08-26T00:13:47.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:46 smithi043 ceph-mon[22091]: pgmap v676: 97 pgs: 97 active+clean; 1010 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 571 op/s 2024-08-26T00:13:47.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:46 smithi042 ceph-mon[17225]: pgmap v676: 97 pgs: 97 active+clean; 1010 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 571 op/s 2024-08-26T00:13:47.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:46 smithi181 ceph-mon[22102]: pgmap v676: 97 pgs: 97 active+clean; 1010 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 571 op/s 2024-08-26T00:13:49.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:48 smithi043 ceph-mon[22091]: pgmap v677: 97 pgs: 97 active+clean; 993 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 615 op/s 2024-08-26T00:13:49.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:48 smithi042 ceph-mon[17225]: pgmap v677: 97 pgs: 97 active+clean; 993 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 615 op/s 2024-08-26T00:13:49.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:48 smithi181 ceph-mon[22102]: pgmap v677: 97 pgs: 97 active+clean; 993 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 615 op/s 2024-08-26T00:13:50.835 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:50 smithi181 ceph-mon[22102]: pgmap v678: 97 pgs: 97 active+clean; 979 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 599 op/s 2024-08-26T00:13:51.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:50 smithi043 ceph-mon[22091]: pgmap v678: 97 pgs: 97 active+clean; 979 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 599 op/s 2024-08-26T00:13:51.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:50 smithi042 ceph-mon[17225]: pgmap v678: 97 pgs: 97 active+clean; 979 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 599 op/s 2024-08-26T00:13:53.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:52 smithi043 ceph-mon[22091]: pgmap v679: 97 pgs: 97 active+clean; 971 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 507 op/s 2024-08-26T00:13:53.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:52 smithi042 ceph-mon[17225]: pgmap v679: 97 pgs: 97 active+clean; 971 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 507 op/s 2024-08-26T00:13:53.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:52 smithi181 ceph-mon[22102]: pgmap v679: 97 pgs: 97 active+clean; 971 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 507 op/s 2024-08-26T00:13:54.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:53 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:13:54.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:53 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:13:54.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:53 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:13:54.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:53 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:13:54.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:53 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:13:54.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:53 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:13:54.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:53 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:13:54.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:53 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:13:54.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:53 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:13:55.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:54 smithi043 ceph-mon[22091]: pgmap v680: 97 pgs: 97 active+clean; 958 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 533 op/s 2024-08-26T00:13:55.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:54 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:13:55.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:54 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:13:55.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:54 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:13:55.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:54 smithi042 ceph-mon[17225]: pgmap v680: 97 pgs: 97 active+clean; 958 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 533 op/s 2024-08-26T00:13:55.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:54 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:13:55.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:54 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:13:55.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:54 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:13:55.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:54 smithi181 ceph-mon[22102]: pgmap v680: 97 pgs: 97 active+clean; 958 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 533 op/s 2024-08-26T00:13:55.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:54 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:13:55.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:54 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:13:55.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:54 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:13:57.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:56 smithi043 ceph-mon[22091]: pgmap v681: 97 pgs: 97 active+clean; 946 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 431 op/s 2024-08-26T00:13:57.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:56 smithi042 ceph-mon[17225]: pgmap v681: 97 pgs: 97 active+clean; 946 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 431 op/s 2024-08-26T00:13:57.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:56 smithi181 ceph-mon[22102]: pgmap v681: 97 pgs: 97 active+clean; 946 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 431 op/s 2024-08-26T00:13:58.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:57 smithi043 ceph-mon[22091]: pgmap v682: 97 pgs: 97 active+clean; 920 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 451 op/s 2024-08-26T00:13:58.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:57 smithi042 ceph-mon[17225]: pgmap v682: 97 pgs: 97 active+clean; 920 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 451 op/s 2024-08-26T00:13:58.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:57 smithi181 ceph-mon[22102]: pgmap v682: 97 pgs: 97 active+clean; 920 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 451 op/s 2024-08-26T00:14:00.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:13:59 smithi043 ceph-mon[22091]: pgmap v683: 97 pgs: 97 active+clean; 903 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 444 op/s 2024-08-26T00:14:00.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:13:59 smithi042 ceph-mon[17225]: pgmap v683: 97 pgs: 97 active+clean; 903 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 444 op/s 2024-08-26T00:14:00.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:13:59 smithi181 ceph-mon[22102]: pgmap v683: 97 pgs: 97 active+clean; 903 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 444 op/s 2024-08-26T00:14:02.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:01 smithi043 ceph-mon[22091]: pgmap v684: 97 pgs: 97 active+clean; 899 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 387 op/s 2024-08-26T00:14:02.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:01 smithi042 ceph-mon[17225]: pgmap v684: 97 pgs: 97 active+clean; 899 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 387 op/s 2024-08-26T00:14:02.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:01 smithi181 ceph-mon[22102]: pgmap v684: 97 pgs: 97 active+clean; 899 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 387 op/s 2024-08-26T00:14:04.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:03 smithi043 ceph-mon[22091]: pgmap v685: 97 pgs: 97 active+clean; 884 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 410 op/s 2024-08-26T00:14:04.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:03 smithi042 ceph-mon[17225]: pgmap v685: 97 pgs: 97 active+clean; 884 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 410 op/s 2024-08-26T00:14:04.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:03 smithi181 ceph-mon[22102]: pgmap v685: 97 pgs: 97 active+clean; 884 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 410 op/s 2024-08-26T00:14:06.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:05 smithi043 ceph-mon[22091]: pgmap v686: 97 pgs: 97 active+clean; 879 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 337 op/s 2024-08-26T00:14:06.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:05 smithi042 ceph-mon[17225]: pgmap v686: 97 pgs: 97 active+clean; 879 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 337 op/s 2024-08-26T00:14:06.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:05 smithi181 ceph-mon[22102]: pgmap v686: 97 pgs: 97 active+clean; 879 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 337 op/s 2024-08-26T00:14:08.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:07 smithi043 ceph-mon[22091]: pgmap v687: 97 pgs: 97 active+clean; 870 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 348 op/s 2024-08-26T00:14:08.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:07 smithi042 ceph-mon[17225]: pgmap v687: 97 pgs: 97 active+clean; 870 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 348 op/s 2024-08-26T00:14:08.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:07 smithi181 ceph-mon[22102]: pgmap v687: 97 pgs: 97 active+clean; 870 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 348 op/s 2024-08-26T00:14:10.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:09 smithi043 ceph-mon[22091]: pgmap v688: 97 pgs: 97 active+clean; 854 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 331 op/s 2024-08-26T00:14:10.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:09 smithi181 ceph-mon[22102]: pgmap v688: 97 pgs: 97 active+clean; 854 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 331 op/s 2024-08-26T00:14:10.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:09 smithi042 ceph-mon[17225]: pgmap v688: 97 pgs: 97 active+clean; 854 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 331 op/s 2024-08-26T00:14:12.164 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:11 smithi042 ceph-mon[17225]: pgmap v689: 97 pgs: 97 active+clean; 845 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 277 op/s 2024-08-26T00:14:12.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:11 smithi043 ceph-mon[22091]: pgmap v689: 97 pgs: 97 active+clean; 845 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 277 op/s 2024-08-26T00:14:12.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:11 smithi181 ceph-mon[22102]: pgmap v689: 97 pgs: 97 active+clean; 845 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 277 op/s 2024-08-26T00:14:14.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:13 smithi043 ceph-mon[22091]: pgmap v690: 97 pgs: 97 active+clean; 823 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 308 op/s 2024-08-26T00:14:14.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:13 smithi042 ceph-mon[17225]: pgmap v690: 97 pgs: 97 active+clean; 823 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 308 op/s 2024-08-26T00:14:14.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:13 smithi181 ceph-mon[22102]: pgmap v690: 97 pgs: 97 active+clean; 823 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 308 op/s 2024-08-26T00:14:16.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:15 smithi043 ceph-mon[22091]: pgmap v691: 97 pgs: 97 active+clean; 814 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 262 op/s 2024-08-26T00:14:16.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:15 smithi042 ceph-mon[17225]: pgmap v691: 97 pgs: 97 active+clean; 814 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 262 op/s 2024-08-26T00:14:16.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:15 smithi181 ceph-mon[22102]: pgmap v691: 97 pgs: 97 active+clean; 814 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 262 op/s 2024-08-26T00:14:18.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:17 smithi043 ceph-mon[22091]: pgmap v692: 97 pgs: 97 active+clean; 804 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 280 op/s 2024-08-26T00:14:18.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:17 smithi042 ceph-mon[17225]: pgmap v692: 97 pgs: 97 active+clean; 804 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 280 op/s 2024-08-26T00:14:18.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:17 smithi181 ceph-mon[22102]: pgmap v692: 97 pgs: 97 active+clean; 804 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 280 op/s 2024-08-26T00:14:20.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:19 smithi043 ceph-mon[22091]: pgmap v693: 97 pgs: 97 active+clean; 796 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 279 op/s 2024-08-26T00:14:20.271 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:19 smithi042 ceph-mon[17225]: pgmap v693: 97 pgs: 97 active+clean; 796 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 279 op/s 2024-08-26T00:14:20.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:19 smithi181 ceph-mon[22102]: pgmap v693: 97 pgs: 97 active+clean; 796 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 279 op/s 2024-08-26T00:14:22.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:21 smithi043 ceph-mon[22091]: pgmap v694: 97 pgs: 97 active+clean; 796 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 245 op/s 2024-08-26T00:14:22.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:21 smithi042 ceph-mon[17225]: pgmap v694: 97 pgs: 97 active+clean; 796 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 245 op/s 2024-08-26T00:14:22.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:21 smithi181 ceph-mon[22102]: pgmap v694: 97 pgs: 97 active+clean; 796 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 245 op/s 2024-08-26T00:14:24.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:23 smithi043 ceph-mon[22091]: pgmap v695: 97 pgs: 97 active+clean; 783 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 280 op/s 2024-08-26T00:14:24.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:23 smithi042 ceph-mon[17225]: pgmap v695: 97 pgs: 97 active+clean; 783 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 280 op/s 2024-08-26T00:14:24.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:23 smithi181 ceph-mon[22102]: pgmap v695: 97 pgs: 97 active+clean; 783 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 280 op/s 2024-08-26T00:14:26.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:25 smithi043 ceph-mon[22091]: pgmap v696: 97 pgs: 97 active+clean; 778 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 788 KiB/s wr, 243 op/s 2024-08-26T00:14:26.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:25 smithi042 ceph-mon[17225]: pgmap v696: 97 pgs: 97 active+clean; 778 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 788 KiB/s wr, 243 op/s 2024-08-26T00:14:26.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:25 smithi181 ceph-mon[22102]: pgmap v696: 97 pgs: 97 active+clean; 778 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 788 KiB/s wr, 243 op/s 2024-08-26T00:14:28.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:27 smithi043 ceph-mon[22091]: pgmap v697: 97 pgs: 97 active+clean; 771 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 274 op/s 2024-08-26T00:14:28.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:27 smithi042 ceph-mon[17225]: pgmap v697: 97 pgs: 97 active+clean; 771 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 274 op/s 2024-08-26T00:14:28.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:27 smithi181 ceph-mon[22102]: pgmap v697: 97 pgs: 97 active+clean; 771 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 274 op/s 2024-08-26T00:14:30.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:29 smithi043 ceph-mon[22091]: pgmap v698: 97 pgs: 97 active+clean; 749 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 278 op/s 2024-08-26T00:14:30.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:29 smithi042 ceph-mon[17225]: pgmap v698: 97 pgs: 97 active+clean; 749 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 278 op/s 2024-08-26T00:14:30.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:29 smithi181 ceph-mon[22102]: pgmap v698: 97 pgs: 97 active+clean; 749 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 278 op/s 2024-08-26T00:14:32.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:31 smithi043 ceph-mon[22091]: pgmap v699: 97 pgs: 97 active+clean; 738 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 254 op/s 2024-08-26T00:14:32.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:31 smithi042 ceph-mon[17225]: pgmap v699: 97 pgs: 97 active+clean; 738 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 254 op/s 2024-08-26T00:14:32.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:31 smithi181 ceph-mon[22102]: pgmap v699: 97 pgs: 97 active+clean; 738 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 254 op/s 2024-08-26T00:14:34.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:33 smithi043 ceph-mon[22091]: pgmap v700: 97 pgs: 97 active+clean; 718 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 845 KiB/s wr, 290 op/s 2024-08-26T00:14:34.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:33 smithi042 ceph-mon[17225]: pgmap v700: 97 pgs: 97 active+clean; 718 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 845 KiB/s wr, 290 op/s 2024-08-26T00:14:34.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:33 smithi181 ceph-mon[22102]: pgmap v700: 97 pgs: 97 active+clean; 718 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 845 KiB/s wr, 290 op/s 2024-08-26T00:14:36.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:35 smithi043 ceph-mon[22091]: pgmap v701: 97 pgs: 97 active+clean; 717 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 257 op/s 2024-08-26T00:14:36.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:35 smithi042 ceph-mon[17225]: pgmap v701: 97 pgs: 97 active+clean; 717 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 257 op/s 2024-08-26T00:14:36.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:35 smithi181 ceph-mon[22102]: pgmap v701: 97 pgs: 97 active+clean; 717 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 257 op/s 2024-08-26T00:14:38.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:37 smithi043 ceph-mon[22091]: pgmap v702: 97 pgs: 97 active+clean; 707 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 284 op/s 2024-08-26T00:14:38.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:37 smithi042 ceph-mon[17225]: pgmap v702: 97 pgs: 97 active+clean; 707 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 284 op/s 2024-08-26T00:14:38.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:37 smithi181 ceph-mon[22102]: pgmap v702: 97 pgs: 97 active+clean; 707 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 284 op/s 2024-08-26T00:14:40.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:39 smithi043 ceph-mon[22091]: pgmap v703: 97 pgs: 97 active+clean; 696 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 300 op/s 2024-08-26T00:14:40.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:39 smithi042 ceph-mon[17225]: pgmap v703: 97 pgs: 97 active+clean; 696 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 300 op/s 2024-08-26T00:14:40.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:39 smithi181 ceph-mon[22102]: pgmap v703: 97 pgs: 97 active+clean; 696 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 300 op/s 2024-08-26T00:14:42.264 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:41 smithi043 ceph-mon[22091]: pgmap v704: 97 pgs: 97 active+clean; 689 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 282 op/s 2024-08-26T00:14:42.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:41 smithi042 ceph-mon[17225]: pgmap v704: 97 pgs: 97 active+clean; 689 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 282 op/s 2024-08-26T00:14:42.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:41 smithi181 ceph-mon[22102]: pgmap v704: 97 pgs: 97 active+clean; 689 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 282 op/s 2024-08-26T00:14:43.331 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2024-08-26T00:14:43.332 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-26T00:14:44.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:44 smithi043 ceph-mon[22091]: pgmap v705: 97 pgs: 97 active+clean; 671 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 1.0 MiB/s wr, 332 op/s 2024-08-26T00:14:44.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:44 smithi042 ceph-mon[17225]: pgmap v705: 97 pgs: 97 active+clean; 671 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 1.0 MiB/s wr, 332 op/s 2024-08-26T00:14:44.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:44 smithi181 ceph-mon[22102]: pgmap v705: 97 pgs: 97 active+clean; 671 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 1.0 MiB/s wr, 332 op/s 2024-08-26T00:14:44.556 DEBUG:teuthology.parallel:result is None 2024-08-26T00:14:44.556 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-08-26T00:14:44.620 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-08-26T00:14:44.621 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-08-26T00:14:44.631 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-08-26T00:14:44.631 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_4d4c5e30374204f3b32f867e61bb4e1a3880f672/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_f273685f88d22802ccbd8a96b393734630028a13/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph_f273685f88d22802ccbd8a96b393734630028a13/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-08-26T00:14:44.632 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-08-26T00:14:44.640 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-26T00:14:44.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.798+0000 7f5143e00640 1 -- 172.21.15.42:0/2247291930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f513c104cc0 msgr2=0x7f513c105140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:44.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.798+0000 7f5143e00640 1 --2- 172.21.15.42:0/2247291930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f513c104cc0 0x7f513c105140 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5128009900 tx=0x7f512802a3f0 comp rx=0 tx=0).stop 2024-08-26T00:14:44.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.798+0000 7f5143e00640 1 -- 172.21.15.42:0/2247291930 shutdown_connections 2024-08-26T00:14:44.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.798+0000 7f5143e00640 1 --2- 172.21.15.42:0/2247291930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f513c105680 0x7f513c10bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:44.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.798+0000 7f5143e00640 1 --2- 172.21.15.42:0/2247291930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f513c104cc0 0x7f513c105140 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:44.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.798+0000 7f5143e00640 1 --2- 172.21.15.42:0/2247291930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f513c103ad0 0x7f513c103ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:44.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.798+0000 7f5143e00640 1 -- 172.21.15.42:0/2247291930 >> 172.21.15.42:0/2247291930 conn(0x7f513c0ff250 msgr2=0x7f513c101670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:14:44.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.798+0000 7f5143e00640 1 -- 172.21.15.42:0/2247291930 shutdown_connections 2024-08-26T00:14:44.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.798+0000 7f5143e00640 1 -- 172.21.15.42:0/2247291930 wait complete. 2024-08-26T00:14:44.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.799+0000 7f5143e00640 1 Processor -- start 2024-08-26T00:14:44.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.799+0000 7f5143e00640 1 -- start start 2024-08-26T00:14:44.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.799+0000 7f5143e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f513c103ad0 0x7f513c199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:14:44.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.799+0000 7f5143e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f513c104cc0 0x7f513c19a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:14:44.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.799+0000 7f5143e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f513c105680 0x7f513c1a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:14:44.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.799+0000 7f5143e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f513c10f7a0 con 0x7f513c103ad0 2024-08-26T00:14:44.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.799+0000 7f5143e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f513c10f620 con 0x7f513c104cc0 2024-08-26T00:14:44.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.799+0000 7f5143e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f513c10f920 con 0x7f513c105680 2024-08-26T00:14:44.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.800+0000 7f5141400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f513c103ad0 0x7f513c199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:14:44.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.800+0000 7f5141400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f513c103ad0 0x7f513c199dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36484/0 (socket says 172.21.15.42:36484) 2024-08-26T00:14:44.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.800+0000 7f5141400640 1 -- 172.21.15.42:0/3317241202 learned_addr learned my addr 172.21.15.42:0/3317241202 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:14:44.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.800+0000 7f5140a00640 1 --2- 172.21.15.42:0/3317241202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f513c104cc0 0x7f513c19a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:14:44.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.800+0000 7f5141e00640 1 --2- 172.21.15.42:0/3317241202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f513c105680 0x7f513c1a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:14:44.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.800+0000 7f5141400640 1 -- 172.21.15.42:0/3317241202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f513c105680 msgr2=0x7f513c1a1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:44.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.800+0000 7f5141400640 1 --2- 172.21.15.42:0/3317241202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f513c105680 0x7f513c1a1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:44.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.800+0000 7f5141400640 1 -- 172.21.15.42:0/3317241202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f513c104cc0 msgr2=0x7f513c19a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:44.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.800+0000 7f5141400640 1 --2- 172.21.15.42:0/3317241202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f513c104cc0 0x7f513c19a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:44.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.800+0000 7f5141400640 1 -- 172.21.15.42:0/3317241202 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513c1a19e0 con 0x7f513c103ad0 2024-08-26T00:14:44.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.800+0000 7f5141400640 1 --2- 172.21.15.42:0/3317241202 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f513c103ad0 0x7f513c199dc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f513000d950 tx=0x7f513000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:14:44.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.801+0000 7f513a000640 1 -- 172.21.15.42:0/3317241202 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5130017020 con 0x7f513c103ad0 2024-08-26T00:14:44.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.801+0000 7f5143e00640 1 -- 172.21.15.42:0/3317241202 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f513c1a1cd0 con 0x7f513c103ad0 2024-08-26T00:14:44.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.801+0000 7f513a000640 1 -- 172.21.15.42:0/3317241202 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5130009c30 con 0x7f513c103ad0 2024-08-26T00:14:44.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.801+0000 7f513a000640 1 -- 172.21.15.42:0/3317241202 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513000f6b0 con 0x7f513c103ad0 2024-08-26T00:14:44.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.801+0000 7f5143e00640 1 -- 172.21.15.42:0/3317241202 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f513c1a2190 con 0x7f513c103ad0 2024-08-26T00:14:44.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.802+0000 7f5143e00640 1 -- 172.21.15.42:0/3317241202 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f513c10ae70 con 0x7f513c103ad0 2024-08-26T00:14:44.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.804+0000 7f513a000640 1 -- 172.21.15.42:0/3317241202 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f513001a020 con 0x7f513c103ad0 2024-08-26T00:14:44.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.805+0000 7f513a000640 1 --2- 172.21.15.42:0/3317241202 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f51240a2c10 0x7f51240a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:14:44.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.805+0000 7f513a000640 1 -- 172.21.15.42:0/3317241202 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f51300cef30 con 0x7f513c103ad0 2024-08-26T00:14:44.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.805+0000 7f5140a00640 1 --2- 172.21.15.42:0/3317241202 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f51240a2c10 0x7f51240a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:14:44.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.806+0000 7f5140a00640 1 --2- 172.21.15.42:0/3317241202 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f51240a2c10 0x7f51240a50d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5128031440 tx=0x7f51280315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:14:44.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.810+0000 7f513a000640 1 -- 172.21.15.42:0/3317241202 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5130021020 con 0x7f513c103ad0 2024-08-26T00:14:44.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.996+0000 7f5143e00640 1 -- 172.21.15.42:0/3317241202 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f513c062c60 con 0x7f513c103ad0 2024-08-26T00:14:45.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:44.998+0000 7f513a000640 1 -- 172.21.15.42:0/3317241202 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22625 (secure 0 0 0) 0x7f513009be50 con 0x7f513c103ad0 2024-08-26T00:14:45.001 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:14:45.002 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":80,"fsid":"f89d317a-633c-11ef-bcd2-c7b262605968","created":"2024-08-25T23:52:39.598509+0000","modified":"2024-08-26T00:01:33.588911+0000","last_up_change":"2024-08-25T23:59:35.047575+0000","last_in_change":"2024-08-25T23:59:12.796940+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-25T23:55:51.022219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-26T00:00:25.606536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-26T00:00:28.322822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"980d8635-bca1-4c5a-b78e-4b44f9315d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6803","nonce":2657450248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6805","nonce":2657450248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6809","nonce":2657450248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6807","nonce":2657450248}]},"public_addr":"172.21.15.42:6803/2657450248","cluster_addr":"172.21.15.42:6805/2657450248","heartbeat_back_addr":"172.21.15.42:6809/2657450248","heartbeat_front_addr":"172.21.15.42:6807/2657450248","state":["exists","up"]},{"osd":1,"uuid":"e5f8dc3b-876a-4bdd-b6b0-b0d99d098d95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6801","nonce":2396081001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6803","nonce":2396081001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6807","nonce":2396081001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6805","nonce":2396081001}]},"public_addr":"172.21.15.43:6801/2396081001","cluster_addr":"172.21.15.43:6803/2396081001","heartbeat_back_addr":"172.21.15.43:6807/2396081001","heartbeat_front_addr":"172.21.15.43:6805/2396081001","state":["exists","up"]},{"osd":2,"uuid":"06eb25af-8e3d-4f90-bc24-28a9bc224c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6801","nonce":189987070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6803","nonce":189987070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6807","nonce":189987070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6805","nonce":189987070}]},"public_addr":"172.21.15.181:6801/189987070","cluster_addr":"172.21.15.181:6803/189987070","heartbeat_back_addr":"172.21.15.181:6807/189987070","heartbeat_front_addr":"172.21.15.181:6805/189987070","state":["exists","up"]},{"osd":3,"uuid":"c78dbc49-b5c7-4f82-be36-c76a89496520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6811","nonce":251017896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6813","nonce":251017896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6817","nonce":251017896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6815","nonce":251017896}]},"public_addr":"172.21.15.42:6811/251017896","cluster_addr":"172.21.15.42:6813/251017896","heartbeat_back_addr":"172.21.15.42:6817/251017896","heartbeat_front_addr":"172.21.15.42:6815/251017896","state":["exists","up"]},{"osd":4,"uuid":"ba633f66-25af-492f-bbf2-76032a4cd3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6809","nonce":1315420796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6811","nonce":1315420796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6815","nonce":1315420796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6813","nonce":1315420796}]},"public_addr":"172.21.15.43:6809/1315420796","cluster_addr":"172.21.15.43:6811/1315420796","heartbeat_back_addr":"172.21.15.43:6815/1315420796","heartbeat_front_addr":"172.21.15.43:6813/1315420796","state":["exists","up"]},{"osd":5,"uuid":"04e47ad9-21ba-43da-9793-d5cf83150dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6809","nonce":246971403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6811","nonce":246971403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6815","nonce":246971403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6813","nonce":246971403}]},"public_addr":"172.21.15.181:6809/246971403","cluster_addr":"172.21.15.181:6811/246971403","heartbeat_back_addr":"172.21.15.181:6815/246971403","heartbeat_front_addr":"172.21.15.181:6813/246971403","state":["exists","up"]},{"osd":6,"uuid":"f48161cd-bc44-4d99-8248-1bb845111129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6819","nonce":2910656480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6821","nonce":2910656480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6825","nonce":2910656480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6823","nonce":2910656480}]},"public_addr":"172.21.15.42:6819/2910656480","cluster_addr":"172.21.15.42:6821/2910656480","heartbeat_back_addr":"172.21.15.42:6825/2910656480","heartbeat_front_addr":"172.21.15.42:6823/2910656480","state":["exists","up"]},{"osd":7,"uuid":"65470b06-b14d-4d8e-9bcb-e6927c37fda5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6817","nonce":624542778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6819","nonce":624542778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6823","nonce":624542778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6821","nonce":624542778}]},"public_addr":"172.21.15.43:6817/624542778","cluster_addr":"172.21.15.43:6819/624542778","heartbeat_back_addr":"172.21.15.43:6823/624542778","heartbeat_front_addr":"172.21.15.43:6821/624542778","state":["exists","up"]},{"osd":8,"uuid":"1f4c9152-4b7c-415f-9cb9-d1e926fad5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6817","nonce":728226568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6819","nonce":728226568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6823","nonce":728226568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6821","nonce":728226568}]},"public_addr":"172.21.15.181:6817/728226568","cluster_addr":"172.21.15.181:6819/728226568","heartbeat_back_addr":"172.21.15.181:6823/728226568","heartbeat_front_addr":"172.21.15.181:6821/728226568","state":["exists","up"]},{"osd":9,"uuid":"fb387fbe-19b4-4a3e-8e40-81bd1363b55c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6827","nonce":1052069444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6829","nonce":1052069444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6833","nonce":1052069444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6831","nonce":1052069444}]},"public_addr":"172.21.15.42:6827/1052069444","cluster_addr":"172.21.15.42:6829/1052069444","heartbeat_back_addr":"172.21.15.42:6833/1052069444","heartbeat_front_addr":"172.21.15.42:6831/1052069444","state":["exists","up"]},{"osd":10,"uuid":"fe5bbeec-2341-4ea9-97ab-cc45d738d741","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6825","nonce":3417487386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6827","nonce":3417487386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6831","nonce":3417487386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6829","nonce":3417487386}]},"public_addr":"172.21.15.43:6825/3417487386","cluster_addr":"172.21.15.43:6827/3417487386","heartbeat_back_addr":"172.21.15.43:6831/3417487386","heartbeat_front_addr":"172.21.15.43:6829/3417487386","state":["exists","up"]},{"osd":11,"uuid":"cee07741-3ab7-481e-8477-54319f4f178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6825","nonce":3817502913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6827","nonce":3817502913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6831","nonce":3817502913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6829","nonce":3817502913}]},"public_addr":"172.21.15.181:6825/3817502913","cluster_addr":"172.21.15.181:6827/3817502913","heartbeat_back_addr":"172.21.15.181:6831/3817502913","heartbeat_front_addr":"172.21.15.181:6829/3817502913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:00.603592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:24.637326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:47.587859+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:14.978783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:39.025819+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:01.965471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:29.753475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:54.162377+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:17.970871+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:46.175576+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:10.590220+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:33.216701+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/3711239085":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6801/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2983166615":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/2974122891":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2980210051":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/4227793902":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6801/1517739376":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6800/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/1775009918":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6800/1517739376":"2024-08-26T23:53:05.122858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-26T00:14:45.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.000+0000 7f5143e00640 1 -- 172.21.15.42:0/3317241202 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f51240a2c10 msgr2=0x7f51240a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:45.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.000+0000 7f5143e00640 1 --2- 172.21.15.42:0/3317241202 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f51240a2c10 0x7f51240a50d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5128031440 tx=0x7f51280315b0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.000+0000 7f5143e00640 1 -- 172.21.15.42:0/3317241202 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f513c103ad0 msgr2=0x7f513c199dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:45.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.000+0000 7f5143e00640 1 --2- 172.21.15.42:0/3317241202 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f513c103ad0 0x7f513c199dc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f513000d950 tx=0x7f513000de10 comp rx=0 tx=0).stop 2024-08-26T00:14:45.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.000+0000 7f5143e00640 1 -- 172.21.15.42:0/3317241202 shutdown_connections 2024-08-26T00:14:45.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.000+0000 7f5143e00640 1 --2- 172.21.15.42:0/3317241202 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f51240a2c10 0x7f51240a50d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.000+0000 7f5143e00640 1 --2- 172.21.15.42:0/3317241202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f513c105680 0x7f513c1a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.000+0000 7f5143e00640 1 --2- 172.21.15.42:0/3317241202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f513c104cc0 0x7f513c19a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.000+0000 7f5143e00640 1 --2- 172.21.15.42:0/3317241202 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f513c103ad0 0x7f513c199dc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.000+0000 7f5143e00640 1 -- 172.21.15.42:0/3317241202 >> 172.21.15.42:0/3317241202 conn(0x7f513c0ff250 msgr2=0x7f513c108040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:14:45.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.000+0000 7f5143e00640 1 -- 172.21.15.42:0/3317241202 shutdown_connections 2024-08-26T00:14:45.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.000+0000 7f5143e00640 1 -- 172.21.15.42:0/3317241202 wait complete. 2024-08-26T00:14:45.018 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-25T23:55:51.022219+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-26T00:00:25.606536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-26T00:00:28.322822+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-26T00:14:45.019 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-26T00:14:45.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.181+0000 7f8c6d200640 1 -- 172.21.15.42:0/2848303651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c68105680 msgr2=0x7f8c6810bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:45.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.181+0000 7f8c6d200640 1 --2- 172.21.15.42:0/2848303651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c68105680 0x7f8c6810bf10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009900 tx=0x7f8c6002a3f0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.181+0000 7f8c6d200640 1 -- 172.21.15.42:0/2848303651 shutdown_connections 2024-08-26T00:14:45.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.181+0000 7f8c6d200640 1 --2- 172.21.15.42:0/2848303651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c68105680 0x7f8c6810bf10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.181+0000 7f8c6d200640 1 --2- 172.21.15.42:0/2848303651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c68104cc0 0x7f8c68105140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.181+0000 7f8c6d200640 1 --2- 172.21.15.42:0/2848303651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c68103ad0 0x7f8c68103ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.181+0000 7f8c6d200640 1 -- 172.21.15.42:0/2848303651 >> 172.21.15.42:0/2848303651 conn(0x7f8c680ff210 msgr2=0x7f8c68101670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:14:45.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.181+0000 7f8c6d200640 1 -- 172.21.15.42:0/2848303651 shutdown_connections 2024-08-26T00:14:45.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.181+0000 7f8c6d200640 1 -- 172.21.15.42:0/2848303651 wait complete. 2024-08-26T00:14:45.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.182+0000 7f8c6d200640 1 Processor -- start 2024-08-26T00:14:45.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.182+0000 7f8c6d200640 1 -- start start 2024-08-26T00:14:45.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.182+0000 7f8c6d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c68103ad0 0x7f8c68199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:14:45.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.182+0000 7f8c6d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c68104cc0 0x7f8c6819a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:14:45.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.182+0000 7f8c6d200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c68105680 0x7f8c681a1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:14:45.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.182+0000 7f8c6d200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6810f780 con 0x7f8c68103ad0 2024-08-26T00:14:45.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.182+0000 7f8c6d200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6810f600 con 0x7f8c68104cc0 2024-08-26T00:14:45.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.182+0000 7f8c6d200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6810f900 con 0x7f8c68105680 2024-08-26T00:14:45.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.183+0000 7f8c65e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c68103ad0 0x7f8c68199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:14:45.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.183+0000 7f8c65e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c68103ad0 0x7f8c68199dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44664/0 (socket says 172.21.15.42:44664) 2024-08-26T00:14:45.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.183+0000 7f8c65e00640 1 -- 172.21.15.42:0/3937323910 learned_addr learned my addr 172.21.15.42:0/3937323910 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:14:45.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.183+0000 7f8c57e00640 1 --2- 172.21.15.42:0/3937323910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c68104cc0 0x7f8c6819a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:14:45.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.183+0000 7f8c66800640 1 --2- 172.21.15.42:0/3937323910 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c68105680 0x7f8c681a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:14:45.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.183+0000 7f8c65e00640 1 -- 172.21.15.42:0/3937323910 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c68105680 msgr2=0x7f8c681a1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:45.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.183+0000 7f8c65e00640 1 --2- 172.21.15.42:0/3937323910 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c68105680 0x7f8c681a1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.183+0000 7f8c65e00640 1 -- 172.21.15.42:0/3937323910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c68104cc0 msgr2=0x7f8c6819a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:45.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.183+0000 7f8c65e00640 1 --2- 172.21.15.42:0/3937323910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c68104cc0 0x7f8c6819a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.183+0000 7f8c65e00640 1 -- 172.21.15.42:0/3937323910 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c681a19d0 con 0x7f8c68103ad0 2024-08-26T00:14:45.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.183+0000 7f8c66800640 1 --2- 172.21.15.42:0/3937323910 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c68105680 0x7f8c681a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-26T00:14:45.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.183+0000 7f8c65e00640 1 --2- 172.21.15.42:0/3937323910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c68103ad0 0x7f8c68199dc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800ebc0 tx=0x7f8c5800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:14:45.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.184+0000 7f8c5f400640 1 -- 172.21.15.42:0/3937323910 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58003b70 con 0x7f8c68103ad0 2024-08-26T00:14:45.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.184+0000 7f8c5f400640 1 -- 172.21.15.42:0/3937323910 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c58003d10 con 0x7f8c68103ad0 2024-08-26T00:14:45.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.184+0000 7f8c6d200640 1 -- 172.21.15.42:0/3937323910 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c681a1cc0 con 0x7f8c68103ad0 2024-08-26T00:14:45.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.184+0000 7f8c5f400640 1 -- 172.21.15.42:0/3937323910 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58019980 con 0x7f8c68103ad0 2024-08-26T00:14:45.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.184+0000 7f8c6d200640 1 -- 172.21.15.42:0/3937323910 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c681a21c0 con 0x7f8c68103ad0 2024-08-26T00:14:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.185+0000 7f8c6d200640 1 -- 172.21.15.42:0/3937323910 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c6810adf0 con 0x7f8c68103ad0 2024-08-26T00:14:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.187+0000 7f8c5f400640 1 -- 172.21.15.42:0/3937323910 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8c58019b20 con 0x7f8c68103ad0 2024-08-26T00:14:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.188+0000 7f8c5f400640 1 --2- 172.21.15.42:0/3937323910 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f8c480a2b90 0x7f8c480a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:14:45.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.188+0000 7f8c5f400640 1 -- 172.21.15.42:0/3937323910 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f8c580cf9d0 con 0x7f8c68103ad0 2024-08-26T00:14:45.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.188+0000 7f8c57e00640 1 --2- 172.21.15.42:0/3937323910 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f8c480a2b90 0x7f8c480a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:14:45.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.189+0000 7f8c57e00640 1 --2- 172.21.15.42:0/3937323910 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f8c480a2b90 0x7f8c480a5050 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8c50005d00 tx=0x7f8c5000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:14:45.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.192+0000 7f8c5f400640 1 -- 172.21.15.42:0/3937323910 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f8c5809c8f0 con 0x7f8c68103ad0 2024-08-26T00:14:45.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:45 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/3317241202' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:14:45.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.378+0000 7f8c6d200640 1 -- 172.21.15.42:0/3937323910 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8c6802d6a0 con 0x7f8c68103ad0 2024-08-26T00:14:45.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.379+0000 7f8c5f400640 1 -- 172.21.15.42:0/3937323910 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) ==== 93+0+10 (secure 0 0 0) 0x7f8c6802d6a0 con 0x7f8c68103ad0 2024-08-26T00:14:45.381 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-08-26T00:14:45.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.381+0000 7f8c6d200640 1 -- 172.21.15.42:0/3937323910 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f8c480a2b90 msgr2=0x7f8c480a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:45.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.381+0000 7f8c6d200640 1 --2- 172.21.15.42:0/3937323910 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f8c480a2b90 0x7f8c480a5050 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8c50005d00 tx=0x7f8c5000b410 comp rx=0 tx=0).stop 2024-08-26T00:14:45.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.381+0000 7f8c6d200640 1 -- 172.21.15.42:0/3937323910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c68103ad0 msgr2=0x7f8c68199dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:45.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.381+0000 7f8c6d200640 1 --2- 172.21.15.42:0/3937323910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c68103ad0 0x7f8c68199dc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800ebc0 tx=0x7f8c5800c6a0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.381+0000 7f8c6d200640 1 -- 172.21.15.42:0/3937323910 shutdown_connections 2024-08-26T00:14:45.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.381+0000 7f8c6d200640 1 --2- 172.21.15.42:0/3937323910 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f8c480a2b90 0x7f8c480a5050 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.381+0000 7f8c6d200640 1 --2- 172.21.15.42:0/3937323910 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c68105680 0x7f8c681a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.381+0000 7f8c6d200640 1 --2- 172.21.15.42:0/3937323910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c68104cc0 0x7f8c6819a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.381+0000 7f8c6d200640 1 --2- 172.21.15.42:0/3937323910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c68103ad0 0x7f8c68199dc0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.381+0000 7f8c6d200640 1 -- 172.21.15.42:0/3937323910 >> 172.21.15.42:0/3937323910 conn(0x7f8c680ff210 msgr2=0x7f8c68107fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:14:45.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.382+0000 7f8c6d200640 1 -- 172.21.15.42:0/3937323910 shutdown_connections 2024-08-26T00:14:45.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.382+0000 7f8c6d200640 1 -- 172.21.15.42:0/3937323910 wait complete. 2024-08-26T00:14:45.403 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-26T00:14:45.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:45 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/3317241202' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:14:45.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:45 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/3317241202' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:14:45.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.564+0000 7f176be00640 1 -- 172.21.15.42:0/2153110036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1764105670 msgr2=0x7f176410bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:45.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.564+0000 7f176be00640 1 --2- 172.21.15.42:0/2153110036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1764105670 0x7f176410bf00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f175c009ca0 tx=0x7f175c02a8c0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.564+0000 7f176be00640 1 -- 172.21.15.42:0/2153110036 shutdown_connections 2024-08-26T00:14:45.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.564+0000 7f176be00640 1 --2- 172.21.15.42:0/2153110036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1764105670 0x7f176410bf00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.564+0000 7f176be00640 1 --2- 172.21.15.42:0/2153110036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1764104cb0 0x7f1764105130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.564+0000 7f176be00640 1 --2- 172.21.15.42:0/2153110036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1764103ac0 0x7f1764103ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.564+0000 7f176be00640 1 -- 172.21.15.42:0/2153110036 >> 172.21.15.42:0/2153110036 conn(0x7f17640ff240 msgr2=0x7f1764101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:14:45.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.564+0000 7f176be00640 1 -- 172.21.15.42:0/2153110036 shutdown_connections 2024-08-26T00:14:45.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.564+0000 7f176be00640 1 -- 172.21.15.42:0/2153110036 wait complete. 2024-08-26T00:14:45.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.565+0000 7f176be00640 1 Processor -- start 2024-08-26T00:14:45.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.565+0000 7f176be00640 1 -- start start 2024-08-26T00:14:45.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.565+0000 7f176be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1764103ac0 0x7f1764199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:14:45.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.565+0000 7f176be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1764104cb0 0x7f176419a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:14:45.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.565+0000 7f176be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1764105670 0x7f17641a1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:14:45.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.565+0000 7f176be00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f176410f790 con 0x7f1764104cb0 2024-08-26T00:14:45.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.565+0000 7f176be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f176410f610 con 0x7f1764103ac0 2024-08-26T00:14:45.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.565+0000 7f176be00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f176410f910 con 0x7f1764105670 2024-08-26T00:14:45.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.565+0000 7f1768a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1764104cb0 0x7f176419a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:14:45.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.565+0000 7f1768a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1764104cb0 0x7f176419a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44684/0 (socket says 172.21.15.42:44684) 2024-08-26T00:14:45.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.565+0000 7f1768a00640 1 -- 172.21.15.42:0/2542410908 learned_addr learned my addr 172.21.15.42:0/2542410908 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:14:45.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.565+0000 7f1769400640 1 --2- 172.21.15.42:0/2542410908 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1764103ac0 0x7f1764199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:14:45.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.565+0000 7f1769e00640 1 --2- 172.21.15.42:0/2542410908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1764105670 0x7f17641a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:14:45.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.566+0000 7f1768a00640 1 -- 172.21.15.42:0/2542410908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1764105670 msgr2=0x7f17641a1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:45.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.566+0000 7f1768a00640 1 --2- 172.21.15.42:0/2542410908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1764105670 0x7f17641a1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.566+0000 7f1768a00640 1 -- 172.21.15.42:0/2542410908 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1764103ac0 msgr2=0x7f1764199db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:45.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.566+0000 7f1768a00640 1 --2- 172.21.15.42:0/2542410908 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1764103ac0 0x7f1764199db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.566+0000 7f1768a00640 1 -- 172.21.15.42:0/2542410908 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17641a19c0 con 0x7f1764104cb0 2024-08-26T00:14:45.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.566+0000 7f1768a00640 1 --2- 172.21.15.42:0/2542410908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1764104cb0 0x7f176419a2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f175000e9f0 tx=0x7f175000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:14:45.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.566+0000 7f1762000640 1 -- 172.21.15.42:0/2542410908 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f175000cd80 con 0x7f1764104cb0 2024-08-26T00:14:45.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.566+0000 7f1762000640 1 -- 172.21.15.42:0/2542410908 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1750005500 con 0x7f1764104cb0 2024-08-26T00:14:45.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.566+0000 7f1762000640 1 -- 172.21.15.42:0/2542410908 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1750010690 con 0x7f1764104cb0 2024-08-26T00:14:45.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.566+0000 7f176be00640 1 -- 172.21.15.42:0/2542410908 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17641a1cb0 con 0x7f1764104cb0 2024-08-26T00:14:45.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.567+0000 7f176be00640 1 -- 172.21.15.42:0/2542410908 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17641a21b0 con 0x7f1764104cb0 2024-08-26T00:14:45.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.568+0000 7f176be00640 1 -- 172.21.15.42:0/2542410908 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f176410ade0 con 0x7f1764104cb0 2024-08-26T00:14:45.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.570+0000 7f1762000640 1 -- 172.21.15.42:0/2542410908 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f17500046c0 con 0x7f1764104cb0 2024-08-26T00:14:45.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.572+0000 7f1762000640 1 --2- 172.21.15.42:0/2542410908 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f174c0a2c10 0x7f174c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:14:45.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.572+0000 7f1762000640 1 -- 172.21.15.42:0/2542410908 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f17500cf490 con 0x7f1764104cb0 2024-08-26T00:14:45.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.572+0000 7f1769400640 1 --2- 172.21.15.42:0/2542410908 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f174c0a2c10 0x7f174c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:14:45.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.573+0000 7f1769400640 1 --2- 172.21.15.42:0/2542410908 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f174c0a2c10 0x7f174c0a50d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f176419b280 tx=0x7f1758005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:14:45.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.576+0000 7f1762000640 1 -- 172.21.15.42:0/2542410908 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f175009c3b0 con 0x7f1764104cb0 2024-08-26T00:14:45.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.765+0000 7f176be00640 1 -- 172.21.15.42:0/2542410908 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1764062c30 con 0x7f1764104cb0 2024-08-26T00:14:45.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.765+0000 7f1762000640 1 -- 172.21.15.42:0/2542410908 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) ==== 104+0+11 (secure 0 0 0) 0x7f1750086020 con 0x7f1764104cb0 2024-08-26T00:14:45.767 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-08-26T00:14:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.767+0000 7f176be00640 1 -- 172.21.15.42:0/2542410908 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f174c0a2c10 msgr2=0x7f174c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.767+0000 7f176be00640 1 --2- 172.21.15.42:0/2542410908 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f174c0a2c10 0x7f174c0a50d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f176419b280 tx=0x7f1758005f90 comp rx=0 tx=0).stop 2024-08-26T00:14:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.767+0000 7f176be00640 1 -- 172.21.15.42:0/2542410908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1764104cb0 msgr2=0x7f176419a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.767+0000 7f176be00640 1 --2- 172.21.15.42:0/2542410908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1764104cb0 0x7f176419a2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f175000e9f0 tx=0x7f175000edf0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.767+0000 7f176be00640 1 -- 172.21.15.42:0/2542410908 shutdown_connections 2024-08-26T00:14:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.767+0000 7f176be00640 1 --2- 172.21.15.42:0/2542410908 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f174c0a2c10 0x7f174c0a50d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.767+0000 7f176be00640 1 --2- 172.21.15.42:0/2542410908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1764105670 0x7f17641a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.767+0000 7f176be00640 1 --2- 172.21.15.42:0/2542410908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1764104cb0 0x7f176419a2f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.767+0000 7f176be00640 1 --2- 172.21.15.42:0/2542410908 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1764103ac0 0x7f1764199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.767+0000 7f176be00640 1 -- 172.21.15.42:0/2542410908 >> 172.21.15.42:0/2542410908 conn(0x7f17640ff240 msgr2=0x7f1764107fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:14:45.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.768+0000 7f176be00640 1 -- 172.21.15.42:0/2542410908 shutdown_connections 2024-08-26T00:14:45.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.768+0000 7f176be00640 1 -- 172.21.15.42:0/2542410908 wait complete. 2024-08-26T00:14:45.785 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-26T00:14:45.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.946+0000 7ff7e4c00640 1 -- 172.21.15.42:0/254141361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7e0103ad0 msgr2=0x7ff7e0103ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:45.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.946+0000 7ff7e4c00640 1 --2- 172.21.15.42:0/254141361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7e0103ad0 0x7ff7e0103ed0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0009900 tx=0x7ff7d002a3f0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.947+0000 7ff7e4c00640 1 -- 172.21.15.42:0/254141361 shutdown_connections 2024-08-26T00:14:45.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.947+0000 7ff7e4c00640 1 --2- 172.21.15.42:0/254141361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7e0105680 0x7ff7e010bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.947+0000 7ff7e4c00640 1 --2- 172.21.15.42:0/254141361 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7e0104cc0 0x7ff7e0105140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.947+0000 7ff7e4c00640 1 --2- 172.21.15.42:0/254141361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7e0103ad0 0x7ff7e0103ed0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.947+0000 7ff7e4c00640 1 -- 172.21.15.42:0/254141361 >> 172.21.15.42:0/254141361 conn(0x7ff7e00ff210 msgr2=0x7ff7e0101670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:14:45.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.947+0000 7ff7e4c00640 1 -- 172.21.15.42:0/254141361 shutdown_connections 2024-08-26T00:14:45.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.947+0000 7ff7e4c00640 1 -- 172.21.15.42:0/254141361 wait complete. 2024-08-26T00:14:45.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.947+0000 7ff7e4c00640 1 Processor -- start 2024-08-26T00:14:45.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.948+0000 7ff7e4c00640 1 -- start start 2024-08-26T00:14:45.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.948+0000 7ff7e4c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7e0103ad0 0x7ff7e0199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:14:45.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.948+0000 7ff7e4c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7e0104cc0 0x7ff7e019a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:14:45.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.948+0000 7ff7e4c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7e0105680 0x7ff7e01a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:14:45.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.948+0000 7ff7e4c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e010f750 con 0x7ff7e0104cc0 2024-08-26T00:14:45.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.948+0000 7ff7e4c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e010f5d0 con 0x7ff7e0103ad0 2024-08-26T00:14:45.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.948+0000 7ff7e4c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e010f8d0 con 0x7ff7e0105680 2024-08-26T00:14:45.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.948+0000 7ff7dd400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7e0104cc0 0x7ff7e019a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:14:45.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.948+0000 7ff7dd400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7e0104cc0 0x7ff7e019a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44696/0 (socket says 172.21.15.42:44696) 2024-08-26T00:14:45.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.948+0000 7ff7dd400640 1 -- 172.21.15.42:0/3018150899 learned_addr learned my addr 172.21.15.42:0/3018150899 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:14:45.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.948+0000 7ff7de800640 1 --2- 172.21.15.42:0/3018150899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7e0105680 0x7ff7e01a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:14:45.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.948+0000 7ff7dde00640 1 --2- 172.21.15.42:0/3018150899 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7e0103ad0 0x7ff7e0199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:14:45.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.949+0000 7ff7dd400640 1 -- 172.21.15.42:0/3018150899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7e0105680 msgr2=0x7ff7e01a1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.949+0000 7ff7dd400640 1 --2- 172.21.15.42:0/3018150899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7e0105680 0x7ff7e01a1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.949+0000 7ff7dd400640 1 -- 172.21.15.42:0/3018150899 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7e0103ad0 msgr2=0x7ff7e0199e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.949+0000 7ff7dd400640 1 --2- 172.21.15.42:0/3018150899 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7e0103ad0 0x7ff7e0199e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.949+0000 7ff7dd400640 1 -- 172.21.15.42:0/3018150899 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7e01a1ab0 con 0x7ff7e0104cc0 2024-08-26T00:14:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.949+0000 7ff7dd400640 1 --2- 172.21.15.42:0/3018150899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7e0104cc0 0x7ff7e019a3d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc00e9f0 tx=0x7ff7cc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:14:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.949+0000 7ff7d6a00640 1 -- 172.21.15.42:0/3018150899 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc00ccc0 con 0x7ff7e0104cc0 2024-08-26T00:14:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.949+0000 7ff7e4c00640 1 -- 172.21.15.42:0/3018150899 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7e01a1da0 con 0x7ff7e0104cc0 2024-08-26T00:14:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.949+0000 7ff7d6a00640 1 -- 172.21.15.42:0/3018150899 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7cc00ce60 con 0x7ff7e0104cc0 2024-08-26T00:14:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.949+0000 7ff7d6a00640 1 -- 172.21.15.42:0/3018150899 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc010690 con 0x7ff7e0104cc0 2024-08-26T00:14:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.949+0000 7ff7e4c00640 1 -- 172.21.15.42:0/3018150899 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7e01a2260 con 0x7ff7e0104cc0 2024-08-26T00:14:45.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.950+0000 7ff7e4c00640 1 -- 172.21.15.42:0/3018150899 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7e010afa0 con 0x7ff7e0104cc0 2024-08-26T00:14:45.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.954+0000 7ff7d6a00640 1 -- 172.21.15.42:0/3018150899 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff7cc0046c0 con 0x7ff7e0104cc0 2024-08-26T00:14:45.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.955+0000 7ff7d6a00640 1 --2- 172.21.15.42:0/3018150899 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff7c40a2b90 0x7ff7c40a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:14:45.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.955+0000 7ff7d6a00640 1 -- 172.21.15.42:0/3018150899 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7ff7cc0cf600 con 0x7ff7e0104cc0 2024-08-26T00:14:45.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.955+0000 7ff7dde00640 1 --2- 172.21.15.42:0/3018150899 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff7c40a2b90 0x7ff7c40a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:14:45.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.956+0000 7ff7dde00640 1 --2- 172.21.15.42:0/3018150899 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff7c40a2b90 0x7ff7c40a5050 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0005ab0 tx=0x7ff7d0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:14:45.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:45.957+0000 7ff7d6a00640 1 -- 172.21.15.42:0/3018150899 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff7cc053df0 con 0x7ff7e0104cc0 2024-08-26T00:14:46.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.146+0000 7ff7e4c00640 1 -- 172.21.15.42:0/3018150899 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff7e002d8a0 con 0x7ff7e0104cc0 2024-08-26T00:14:46.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.146+0000 7ff7d6a00640 1 -- 172.21.15.42:0/3018150899 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) ==== 100+0+11 (secure 0 0 0) 0x7ff7cc09c520 con 0x7ff7e0104cc0 2024-08-26T00:14:46.147 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-08-26T00:14:46.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.148+0000 7ff7e4c00640 1 -- 172.21.15.42:0/3018150899 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff7c40a2b90 msgr2=0x7ff7c40a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:46.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.148+0000 7ff7e4c00640 1 --2- 172.21.15.42:0/3018150899 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff7c40a2b90 0x7ff7c40a5050 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0005ab0 tx=0x7ff7d0000bc0 comp rx=0 tx=0).stop 2024-08-26T00:14:46.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.148+0000 7ff7e4c00640 1 -- 172.21.15.42:0/3018150899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7e0104cc0 msgr2=0x7ff7e019a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:46.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.148+0000 7ff7e4c00640 1 --2- 172.21.15.42:0/3018150899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7e0104cc0 0x7ff7e019a3d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc00e9f0 tx=0x7ff7cc00edf0 comp rx=0 tx=0).stop 2024-08-26T00:14:46.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.149+0000 7ff7e4c00640 1 -- 172.21.15.42:0/3018150899 shutdown_connections 2024-08-26T00:14:46.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.149+0000 7ff7e4c00640 1 --2- 172.21.15.42:0/3018150899 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7ff7c40a2b90 0x7ff7c40a5050 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:46.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.149+0000 7ff7e4c00640 1 --2- 172.21.15.42:0/3018150899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7e0105680 0x7ff7e01a1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:46.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.149+0000 7ff7e4c00640 1 --2- 172.21.15.42:0/3018150899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7e0104cc0 0x7ff7e019a3d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:46.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.149+0000 7ff7e4c00640 1 --2- 172.21.15.42:0/3018150899 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7e0103ad0 0x7ff7e0199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:46.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.149+0000 7ff7e4c00640 1 -- 172.21.15.42:0/3018150899 >> 172.21.15.42:0/3018150899 conn(0x7ff7e00ff210 msgr2=0x7ff7e0108170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:14:46.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.149+0000 7ff7e4c00640 1 -- 172.21.15.42:0/3018150899 shutdown_connections 2024-08-26T00:14:46.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.149+0000 7ff7e4c00640 1 -- 172.21.15.42:0/3018150899 wait complete. 2024-08-26T00:14:46.166 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-08-26T00:14:46.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.324+0000 7fc32a200640 1 -- 172.21.15.42:0/3338594311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc324105680 msgr2=0x7fc32410bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:46.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.324+0000 7fc32a200640 1 --2- 172.21.15.42:0/3338594311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc324105680 0x7fc32410bf10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc31c009ca0 tx=0x7fc31c02a8c0 comp rx=0 tx=0).stop 2024-08-26T00:14:46.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.324+0000 7fc32a200640 1 -- 172.21.15.42:0/3338594311 shutdown_connections 2024-08-26T00:14:46.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.324+0000 7fc32a200640 1 --2- 172.21.15.42:0/3338594311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc324105680 0x7fc32410bf10 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:46.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.324+0000 7fc32a200640 1 --2- 172.21.15.42:0/3338594311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc324104cc0 0x7fc324105140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:46.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.324+0000 7fc32a200640 1 --2- 172.21.15.42:0/3338594311 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc324103ad0 0x7fc324103ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:46.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.324+0000 7fc32a200640 1 -- 172.21.15.42:0/3338594311 >> 172.21.15.42:0/3338594311 conn(0x7fc3240ff250 msgr2=0x7fc324101670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:14:46.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.324+0000 7fc32a200640 1 -- 172.21.15.42:0/3338594311 shutdown_connections 2024-08-26T00:14:46.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.324+0000 7fc32a200640 1 -- 172.21.15.42:0/3338594311 wait complete. 2024-08-26T00:14:46.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.325+0000 7fc32a200640 1 Processor -- start 2024-08-26T00:14:46.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.325+0000 7fc32a200640 1 -- start start 2024-08-26T00:14:46.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.326+0000 7fc32a200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc324103ad0 0x7fc324199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:14:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.326+0000 7fc32a200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc324104cc0 0x7fc32419a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:14:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.326+0000 7fc32a200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc324105680 0x7fc3241a1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:14:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.326+0000 7fc32a200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc32410f7a0 con 0x7fc324104cc0 2024-08-26T00:14:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.326+0000 7fc32a200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc32410f620 con 0x7fc324105680 2024-08-26T00:14:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.326+0000 7fc32a200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc32410f920 con 0x7fc324103ad0 2024-08-26T00:14:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.326+0000 7fc322a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc324104cc0 0x7fc32419a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:14:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.326+0000 7fc322a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc324104cc0 0x7fc32419a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44710/0 (socket says 172.21.15.42:44710) 2024-08-26T00:14:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.326+0000 7fc322a00640 1 -- 172.21.15.42:0/41314756 learned_addr learned my addr 172.21.15.42:0/41314756 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:14:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.326+0000 7fc323400640 1 --2- 172.21.15.42:0/41314756 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc324103ad0 0x7fc324199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:14:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.326+0000 7fc323e00640 1 --2- 172.21.15.42:0/41314756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc324105680 0x7fc3241a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:14:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.326+0000 7fc322a00640 1 -- 172.21.15.42:0/41314756 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc324103ad0 msgr2=0x7fc324199dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.326+0000 7fc322a00640 1 --2- 172.21.15.42:0/41314756 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc324103ad0 0x7fc324199dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.326+0000 7fc322a00640 1 -- 172.21.15.42:0/41314756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc324105680 msgr2=0x7fc3241a1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.326+0000 7fc322a00640 1 --2- 172.21.15.42:0/41314756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc324105680 0x7fc3241a1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.326+0000 7fc322a00640 1 -- 172.21.15.42:0/41314756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3241a19d0 con 0x7fc324104cc0 2024-08-26T00:14:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.326+0000 7fc323400640 1 --2- 172.21.15.42:0/41314756 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc324103ad0 0x7fc324199dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:14:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.327+0000 7fc322a00640 1 --2- 172.21.15.42:0/41314756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc324104cc0 0x7fc32419a300 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc31000e9f0 tx=0x7fc31000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:14:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.327+0000 7fc31be00640 1 -- 172.21.15.42:0/41314756 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31000cd80 con 0x7fc324104cc0 2024-08-26T00:14:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.327+0000 7fc32a200640 1 -- 172.21.15.42:0/41314756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3241a1cc0 con 0x7fc324104cc0 2024-08-26T00:14:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.327+0000 7fc31be00640 1 -- 172.21.15.42:0/41314756 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc310010910 con 0x7fc324104cc0 2024-08-26T00:14:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.327+0000 7fc31be00640 1 -- 172.21.15.42:0/41314756 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3100188f0 con 0x7fc324104cc0 2024-08-26T00:14:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.327+0000 7fc32a200640 1 -- 172.21.15.42:0/41314756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3241a21c0 con 0x7fc324104cc0 2024-08-26T00:14:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.328+0000 7fc32a200640 1 -- 172.21.15.42:0/41314756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc32410adf0 con 0x7fc324104cc0 2024-08-26T00:14:46.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.330+0000 7fc31be00640 1 -- 172.21.15.42:0/41314756 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc310010ac0 con 0x7fc324104cc0 2024-08-26T00:14:46.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.332+0000 7fc31be00640 1 --2- 172.21.15.42:0/41314756 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc3080a2b90 0x7fc3080a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:14:46.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.333+0000 7fc31be00640 1 -- 172.21.15.42:0/41314756 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fc3100cf550 con 0x7fc324104cc0 2024-08-26T00:14:46.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.333+0000 7fc323400640 1 --2- 172.21.15.42:0/41314756 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc3080a2b90 0x7fc3080a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:14:46.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.333+0000 7fc323400640 1 --2- 172.21.15.42:0/41314756 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc3080a2b90 0x7fc3080a5050 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc32419b290 tx=0x7fc314005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:14:46.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.336+0000 7fc31be00640 1 -- 172.21.15.42:0/41314756 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fc31009c470 con 0x7fc324104cc0 2024-08-26T00:14:46.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:46 smithi043 ceph-mon[22091]: pgmap v706: 97 pgs: 97 active+clean; 659 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 312 op/s 2024-08-26T00:14:46.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:46 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/3937323910' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-26T00:14:46.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:46 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/2542410908' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-08-26T00:14:46.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:46 smithi042 ceph-mon[17225]: pgmap v706: 97 pgs: 97 active+clean; 659 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 312 op/s 2024-08-26T00:14:46.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:46 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/3937323910' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-26T00:14:46.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:46 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2542410908' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-08-26T00:14:46.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:46 smithi181 ceph-mon[22102]: pgmap v706: 97 pgs: 97 active+clean; 659 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 312 op/s 2024-08-26T00:14:46.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:46 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/3937323910' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-26T00:14:46.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:46 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/2542410908' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-08-26T00:14:46.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.574+0000 7fc32a200640 1 -- 172.21.15.42:0/41314756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fc324062c30 con 0x7fc324104cc0 2024-08-26T00:14:46.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.585+0000 7fc31be00640 1 -- 172.21.15.42:0/41314756 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+740365 (secure 0 0 0) 0x7fc31009bd70 con 0x7fc324104cc0 2024-08-26T00:14:46.598 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:14:46.598 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:14:46.598 INFO:teuthology.orchestra.run.smithi042.stdout: "epoch": 18, 2024-08-26T00:14:46.598 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.598 INFO:teuthology.orchestra.run.smithi042.stdout: "active_gid": 14150, 2024-08-26T00:14:46.599 INFO:teuthology.orchestra.run.smithi042.stdout: "active_name": "x", 2024-08-26T00:14:46.599 INFO:teuthology.orchestra.run.smithi042.stdout: "active_addrs": { 2024-08-26T00:14:46.599 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-08-26T00:14:46.599 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.599 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-08-26T00:14:46.599 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6800", 2024-08-26T00:14:46.599 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 22448279 2024-08-26T00:14:46.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.599 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.599 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-08-26T00:14:46.599 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6801", 2024-08-26T00:14:46.599 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 22448279 2024-08-26T00:14:46.599 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.600 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-08-26T00:14:46.600 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.600 INFO:teuthology.orchestra.run.smithi042.stdout: "active_addr": "172.21.15.42:6801/22448279", 2024-08-26T00:14:46.600 INFO:teuthology.orchestra.run.smithi042.stdout: "active_change": "2024-08-25T23:53:32.406312+0000", 2024-08-26T00:14:46.600 INFO:teuthology.orchestra.run.smithi042.stdout: "active_mgr_features": 4540701547738038271, 2024-08-26T00:14:46.600 INFO:teuthology.orchestra.run.smithi042.stdout: "available": true, 2024-08-26T00:14:46.600 INFO:teuthology.orchestra.run.smithi042.stdout: "standbys": [ 2024-08-26T00:14:46.600 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.600 INFO:teuthology.orchestra.run.smithi042.stdout: "gid": 24109, 2024-08-26T00:14:46.600 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "z", 2024-08-26T00:14:46.600 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_features": 4540701547738038271, 2024-08-26T00:14:46.600 INFO:teuthology.orchestra.run.smithi042.stdout: "available_modules": [ 2024-08-26T00:14:46.601 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.601 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "alerts", 2024-08-26T00:14:46.601 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.601 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.601 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.601 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-08-26T00:14:46.601 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-08-26T00:14:46.601 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:46.601 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.601 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.601 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-08-26T00:14:46.602 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.602 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.602 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.602 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How frequently to reexamine health status", 2024-08-26T00:14:46.602 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.602 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.602 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.602 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.602 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.602 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.602 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.602 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.603 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.603 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.603 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.603 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.603 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.603 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.603 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.603 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.603 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.603 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.603 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.603 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.603 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.603 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.604 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.604 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.604 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.604 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.604 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.604 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.604 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.604 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.604 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.604 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.604 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.604 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.604 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.605 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.605 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.605 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.605 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.605 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.605 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.605 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.605 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.605 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.605 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.605 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.606 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.606 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.606 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.606 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.606 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.606 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.606 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.606 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.606 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.606 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.606 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.606 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.607 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.607 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.607 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.607 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.607 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.607 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.607 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.607 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.607 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.608 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.608 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.608 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.608 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.608 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.608 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.608 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.609 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_destination": { 2024-08-26T00:14:46.609 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_destination", 2024-08-26T00:14:46.609 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.609 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.609 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.609 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.609 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.609 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.609 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.609 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Email address to send alerts to", 2024-08-26T00:14:46.609 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.609 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.609 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.610 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.610 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_from_name": { 2024-08-26T00:14:46.610 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_from_name", 2024-08-26T00:14:46.610 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.610 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.610 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.610 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "Ceph", 2024-08-26T00:14:46.610 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.610 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.610 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.611 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Email From: name", 2024-08-26T00:14:46.611 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.611 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.611 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.611 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.611 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_host": { 2024-08-26T00:14:46.611 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_host", 2024-08-26T00:14:46.611 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.611 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.611 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.611 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.611 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.611 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.612 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.612 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP server", 2024-08-26T00:14:46.612 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.612 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.612 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.612 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.612 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_password": { 2024-08-26T00:14:46.613 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_password", 2024-08-26T00:14:46.613 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.613 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.613 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.613 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.613 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.613 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.613 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.613 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Password to authenticate with", 2024-08-26T00:14:46.613 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.613 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.613 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.613 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.614 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_port": { 2024-08-26T00:14:46.614 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_port", 2024-08-26T00:14:46.614 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.614 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.614 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.614 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "465", 2024-08-26T00:14:46.614 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.614 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.614 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.614 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP port", 2024-08-26T00:14:46.614 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.614 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.614 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.614 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.615 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_sender": { 2024-08-26T00:14:46.615 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_sender", 2024-08-26T00:14:46.615 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.615 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.615 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.615 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.615 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.615 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.615 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.615 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP envelope sender", 2024-08-26T00:14:46.615 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.615 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.616 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.616 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.616 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_ssl": { 2024-08-26T00:14:46.616 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_ssl", 2024-08-26T00:14:46.616 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.616 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.616 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.616 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.616 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.616 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.616 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.616 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-26T00:14:46.617 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.617 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.617 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.617 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.617 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_user": { 2024-08-26T00:14:46.617 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_user", 2024-08-26T00:14:46.617 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.617 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.617 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.617 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.617 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.617 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.618 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.618 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "User to authenticate as", 2024-08-26T00:14:46.618 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.618 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.618 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.618 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.618 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.618 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.619 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.619 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "balancer", 2024-08-26T00:14:46.619 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.619 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.619 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.619 INFO:teuthology.orchestra.run.smithi042.stdout: "active": { 2024-08-26T00:14:46.619 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "active", 2024-08-26T00:14:46.619 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.619 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.619 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.619 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.619 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.619 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.620 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.620 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "automatically balance PGs across cluster", 2024-08-26T00:14:46.620 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.620 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.620 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.620 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.620 INFO:teuthology.orchestra.run.smithi042.stdout: "begin_time": { 2024-08-26T00:14:46.620 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "begin_time", 2024-08-26T00:14:46.620 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.620 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.620 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.621 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0000", 2024-08-26T00:14:46.621 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.621 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.621 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.621 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "beginning time of day to automatically balance", 2024-08-26T00:14:46.621 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-26T00:14:46.621 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.621 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.621 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.621 INFO:teuthology.orchestra.run.smithi042.stdout: "begin_weekday": { 2024-08-26T00:14:46.621 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "begin_weekday", 2024-08-26T00:14:46.621 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-08-26T00:14:46.621 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.622 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.622 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-08-26T00:14:46.622 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0", 2024-08-26T00:14:46.622 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "6", 2024-08-26T00:14:46.622 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.623 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-26T00:14:46.623 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-26T00:14:46.627 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.627 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.627 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_max_iterations": { 2024-08-26T00:14:46.627 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_max_iterations", 2024-08-26T00:14:46.628 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-08-26T00:14:46.628 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.628 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.628 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "25", 2024-08-26T00:14:46.628 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-08-26T00:14:46.628 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "250", 2024-08-26T00:14:46.629 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.629 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-26T00:14:46.629 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.629 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.629 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.629 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.630 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_metrics": { 2024-08-26T00:14:46.630 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_metrics", 2024-08-26T00:14:46.630 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.630 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.630 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.630 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "pgs,objects,bytes", 2024-08-26T00:14:46.630 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.630 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.630 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.630 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-26T00:14:46.630 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-26T00:14:46.630 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.631 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.631 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_step": { 2024-08-26T00:14:46.631 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_step", 2024-08-26T00:14:46.631 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-08-26T00:14:46.631 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.631 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.631 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0.5", 2024-08-26T00:14:46.631 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0.001", 2024-08-26T00:14:46.631 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "0.999", 2024-08-26T00:14:46.631 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.631 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "aggressiveness of optimization", 2024-08-26T00:14:46.631 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-26T00:14:46.631 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: "end_time": { 2024-08-26T00:14:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "end_time", 2024-08-26T00:14:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "2359", 2024-08-26T00:14:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "ending time of day to automatically balance", 2024-08-26T00:14:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-26T00:14:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: "end_weekday": { 2024-08-26T00:14:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "end_weekday", 2024-08-26T00:14:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-08-26T00:14:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-08-26T00:14:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0", 2024-08-26T00:14:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "6", 2024-08-26T00:14:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-26T00:14:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-26T00:14:46.634 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.634 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.634 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.634 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.634 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.634 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.634 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.634 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.634 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.634 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.634 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.634 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.634 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.635 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.635 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.635 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.635 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.635 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.635 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.635 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.635 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.635 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.635 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.635 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.635 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.635 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.636 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.636 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.636 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.636 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.636 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.636 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.636 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.636 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.636 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.636 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.637 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.637 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.637 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.637 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.637 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.637 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.637 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.637 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.637 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.637 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.637 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.638 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.638 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.638 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.638 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.638 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.638 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.638 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.638 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.638 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.638 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.638 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.638 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.639 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.639 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.639 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.639 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.639 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.639 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.639 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.639 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.640 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.640 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.640 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.640 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.640 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.640 INFO:teuthology.orchestra.run.smithi042.stdout: "min_score": { 2024-08-26T00:14:46.641 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "min_score", 2024-08-26T00:14:46.641 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-08-26T00:14:46.641 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.641 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.641 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-08-26T00:14:46.641 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.641 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.641 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.642 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-26T00:14:46.642 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.642 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.642 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.642 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.642 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": { 2024-08-26T00:14:46.642 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mode", 2024-08-26T00:14:46.642 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.642 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.642 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.642 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "upmap", 2024-08-26T00:14:46.643 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.643 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.643 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.643 INFO:teuthology.orchestra.run.smithi042.stdout: "crush-compat", 2024-08-26T00:14:46.643 INFO:teuthology.orchestra.run.smithi042.stdout: "none", 2024-08-26T00:14:46.643 INFO:teuthology.orchestra.run.smithi042.stdout: "read", 2024-08-26T00:14:46.643 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap", 2024-08-26T00:14:46.643 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap-read" 2024-08-26T00:14:46.643 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.643 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Balancer mode", 2024-08-26T00:14:46.644 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.644 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.644 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.644 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_ids": { 2024-08-26T00:14:46.644 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pool_ids", 2024-08-26T00:14:46.644 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.644 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.644 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.644 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.644 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.645 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.645 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.645 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-26T00:14:46.645 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.645 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.645 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.645 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.645 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-08-26T00:14:46.645 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-08-26T00:14:46.646 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:46.646 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.646 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.646 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-08-26T00:14:46.646 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.646 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.646 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.646 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-26T00:14:46.646 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.646 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.647 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.647 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.647 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap_max_deviation": { 2024-08-26T00:14:46.647 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "upmap_max_deviation", 2024-08-26T00:14:46.647 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.647 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.647 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.648 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-08-26T00:14:46.648 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-08-26T00:14:46.648 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.648 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.648 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-26T00:14:46.648 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-26T00:14:46.648 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.648 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.648 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.648 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap_max_optimizations": { 2024-08-26T00:14:46.648 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "upmap_max_optimizations", 2024-08-26T00:14:46.648 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-08-26T00:14:46.649 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.649 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.649 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:46.649 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.649 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.649 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.649 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-26T00:14:46.649 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.650 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.650 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.650 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.650 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.650 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.650 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cephadm", 2024-08-26T00:14:46.651 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.651 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.651 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.651 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_down_multiplier": { 2024-08-26T00:14:46.651 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_down_multiplier", 2024-08-26T00:14:46.651 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-08-26T00:14:46.651 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.651 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.651 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3.0", 2024-08-26T00:14:46.651 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.651 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.651 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.652 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-26T00:14:46.652 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.652 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.652 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.652 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.652 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_refresh_rate": { 2024-08-26T00:14:46.652 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_refresh_rate", 2024-08-26T00:14:46.652 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:46.652 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.652 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.652 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "20", 2024-08-26T00:14:46.652 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.652 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.653 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.653 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-26T00:14:46.653 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.653 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.653 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.653 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.653 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_starting_port": { 2024-08-26T00:14:46.653 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_starting_port", 2024-08-26T00:14:46.653 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.653 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.653 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.653 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "4721", 2024-08-26T00:14:46.654 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.654 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.654 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.654 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-26T00:14:46.654 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.654 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.654 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.654 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_ptrace": { 2024-08-26T00:14:46.654 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_ptrace", 2024-08-26T00:14:46.655 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.655 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.655 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.655 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.655 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.655 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.655 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.655 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-26T00:14:46.655 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-26T00:14:46.655 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.655 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.655 INFO:teuthology.orchestra.run.smithi042.stdout: "autotune_interval": { 2024-08-26T00:14:46.656 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "autotune_interval", 2024-08-26T00:14:46.656 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:46.656 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.656 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.656 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-08-26T00:14:46.656 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.656 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.656 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.656 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-26T00:14:46.656 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.656 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.656 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.657 INFO:teuthology.orchestra.run.smithi042.stdout: "autotune_memory_target_ratio": { 2024-08-26T00:14:46.657 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "autotune_memory_target_ratio", 2024-08-26T00:14:46.657 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-08-26T00:14:46.657 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.657 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.657 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0.7", 2024-08-26T00:14:46.657 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.657 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.657 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.658 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-26T00:14:46.658 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.658 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.658 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.658 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm_log_destination": { 2024-08-26T00:14:46.658 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cephadm_log_destination", 2024-08-26T00:14:46.658 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.658 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.658 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.658 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.658 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.659 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.659 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.659 INFO:teuthology.orchestra.run.smithi042.stdout: "file", 2024-08-26T00:14:46.659 INFO:teuthology.orchestra.run.smithi042.stdout: "file,syslog", 2024-08-26T00:14:46.659 INFO:teuthology.orchestra.run.smithi042.stdout: "syslog" 2024-08-26T00:14:46.659 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.659 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-26T00:14:46.659 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.659 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.659 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.659 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.659 INFO:teuthology.orchestra.run.smithi042.stdout: "cgroups_split": { 2024-08-26T00:14:46.659 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cgroups_split", 2024-08-26T00:14:46.659 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.660 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.660 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.660 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.660 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.660 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.660 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.660 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-26T00:14:46.660 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.660 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.660 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.660 INFO:teuthology.orchestra.run.smithi042.stdout: "config_checks_enabled": { 2024-08-26T00:14:46.660 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_checks_enabled", 2024-08-26T00:14:46.661 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.661 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.661 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.661 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.661 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.661 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.661 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.661 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-26T00:14:46.661 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.661 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.661 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.661 INFO:teuthology.orchestra.run.smithi042.stdout: "config_dashboard": { 2024-08-26T00:14:46.661 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_dashboard", 2024-08-26T00:14:46.662 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.662 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.662 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.662 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.662 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.662 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.662 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.662 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-26T00:14:46.662 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.662 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.662 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.662 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_alertmanager": { 2024-08-26T00:14:46.663 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_alertmanager", 2024-08-26T00:14:46.663 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.663 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.663 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.663 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-08-26T00:14:46.663 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.663 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.663 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.663 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-08-26T00:14:46.663 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.663 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.663 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.664 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_base": { 2024-08-26T00:14:46.664 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_base", 2024-08-26T00:14:46.664 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.664 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.664 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.664 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-26T00:14:46.664 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.664 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.664 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.664 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Container image name, without the tag", 2024-08-26T00:14:46.664 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.664 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.664 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.664 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.665 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_elasticsearch": { 2024-08-26T00:14:46.665 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_elasticsearch", 2024-08-26T00:14:46.665 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.665 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.665 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.665 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-26T00:14:46.665 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.665 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.665 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.665 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "elasticsearch container image", 2024-08-26T00:14:46.665 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.665 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.665 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.666 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.666 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_grafana": { 2024-08-26T00:14:46.666 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_grafana", 2024-08-26T00:14:46.666 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.666 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.666 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.666 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-08-26T00:14:46.666 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.666 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.666 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.666 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-08-26T00:14:46.666 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.666 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.666 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.667 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_haproxy": { 2024-08-26T00:14:46.667 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_haproxy", 2024-08-26T00:14:46.667 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.667 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.667 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.667 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-26T00:14:46.667 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.667 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.667 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.667 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "HAproxy container image", 2024-08-26T00:14:46.668 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.668 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.668 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.668 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.668 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_agent": { 2024-08-26T00:14:46.668 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_agent", 2024-08-26T00:14:46.668 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.668 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.668 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.668 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-26T00:14:46.668 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.668 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.668 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.669 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger agent container image", 2024-08-26T00:14:46.669 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.669 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.669 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.669 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.669 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_collector": { 2024-08-26T00:14:46.669 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_collector", 2024-08-26T00:14:46.669 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.669 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.670 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.670 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-26T00:14:46.670 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.670 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.670 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.670 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger collector container image", 2024-08-26T00:14:46.670 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.670 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.670 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.670 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.670 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_query": { 2024-08-26T00:14:46.670 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_query", 2024-08-26T00:14:46.671 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.671 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.671 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.671 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-26T00:14:46.671 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.671 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.671 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.671 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger query container image", 2024-08-26T00:14:46.671 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.671 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.672 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.672 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.672 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_keepalived": { 2024-08-26T00:14:46.672 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_keepalived", 2024-08-26T00:14:46.672 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.672 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.672 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.672 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-26T00:14:46.672 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.673 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.673 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.673 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Keepalived container image", 2024-08-26T00:14:46.673 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.673 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.673 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.674 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.674 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_loki": { 2024-08-26T00:14:46.674 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_loki", 2024-08-26T00:14:46.674 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.674 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.674 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.675 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-26T00:14:46.675 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.675 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.675 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.675 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Loki container image", 2024-08-26T00:14:46.675 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.676 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.676 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.676 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.676 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_node_exporter": { 2024-08-26T00:14:46.676 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_node_exporter", 2024-08-26T00:14:46.676 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.677 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.677 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.677 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-08-26T00:14:46.677 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.677 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.677 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.678 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-08-26T00:14:46.678 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.678 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.678 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.678 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.679 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_nvmeof": { 2024-08-26T00:14:46.679 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_nvmeof", 2024-08-26T00:14:46.679 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.679 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.679 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.679 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-08-26T00:14:46.680 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.680 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.680 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.680 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Nvme-of container image", 2024-08-26T00:14:46.680 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.680 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.681 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.681 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.681 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_prometheus": { 2024-08-26T00:14:46.681 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_prometheus", 2024-08-26T00:14:46.681 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.682 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.682 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.682 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-08-26T00:14:46.682 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.682 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.682 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.683 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-08-26T00:14:46.683 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.683 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.683 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.683 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.684 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_promtail": { 2024-08-26T00:14:46.684 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_promtail", 2024-08-26T00:14:46.684 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.684 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.684 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.684 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-26T00:14:46.684 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.685 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.685 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.685 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Promtail container image", 2024-08-26T00:14:46.685 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.685 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.685 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.686 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.686 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_samba": { 2024-08-26T00:14:46.686 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_samba", 2024-08-26T00:14:46.686 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.686 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.686 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.687 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-26T00:14:46.687 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.687 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.687 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.687 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Samba/SMB container image", 2024-08-26T00:14:46.688 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.688 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.688 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.689 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_snmp_gateway": { 2024-08-26T00:14:46.689 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_snmp_gateway", 2024-08-26T00:14:46.689 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.689 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.690 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.690 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-26T00:14:46.690 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.690 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.690 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.690 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SNMP Gateway container image", 2024-08-26T00:14:46.691 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.691 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.691 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.691 INFO:teuthology.orchestra.run.smithi042.stdout: "container_init": { 2024-08-26T00:14:46.691 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_init", 2024-08-26T00:14:46.692 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.692 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.692 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.692 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.692 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.693 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.693 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.693 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Run podman/docker with `--init`", 2024-08-26T00:14:46.693 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.693 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.694 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.694 INFO:teuthology.orchestra.run.smithi042.stdout: "daemon_cache_timeout": { 2024-08-26T00:14:46.694 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "daemon_cache_timeout", 2024-08-26T00:14:46.694 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:46.695 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.695 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.695 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-08-26T00:14:46.695 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.695 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.695 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.695 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-26T00:14:46.695 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.695 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.695 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.695 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.695 INFO:teuthology.orchestra.run.smithi042.stdout: "default_cephadm_command_timeout": { 2024-08-26T00:14:46.696 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "default_cephadm_command_timeout", 2024-08-26T00:14:46.696 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.696 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.696 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.696 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "900", 2024-08-26T00:14:46.696 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.696 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.696 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.696 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-26T00:14:46.696 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.696 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.696 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.696 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.697 INFO:teuthology.orchestra.run.smithi042.stdout: "default_registry": { 2024-08-26T00:14:46.697 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "default_registry", 2024-08-26T00:14:46.697 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.697 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.697 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.697 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io", 2024-08-26T00:14:46.697 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.697 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.697 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.697 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-26T00:14:46.697 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.697 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.697 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.698 INFO:teuthology.orchestra.run.smithi042.stdout: "device_cache_timeout": { 2024-08-26T00:14:46.698 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_cache_timeout", 2024-08-26T00:14:46.698 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:46.698 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.698 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.698 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1800", 2024-08-26T00:14:46.698 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.698 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.698 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.698 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache device inventory", 2024-08-26T00:14:46.698 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.698 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.698 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.699 INFO:teuthology.orchestra.run.smithi042.stdout: "device_enhanced_scan": { 2024-08-26T00:14:46.699 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_enhanced_scan", 2024-08-26T00:14:46.699 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.699 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.699 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.699 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.699 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.699 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.699 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.699 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-26T00:14:46.699 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.700 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.700 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.700 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.700 INFO:teuthology.orchestra.run.smithi042.stdout: "facts_cache_timeout": { 2024-08-26T00:14:46.700 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "facts_cache_timeout", 2024-08-26T00:14:46.700 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:46.700 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.700 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.700 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-08-26T00:14:46.700 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.700 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.700 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.700 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache host facts data", 2024-08-26T00:14:46.701 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.701 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.701 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.701 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.701 INFO:teuthology.orchestra.run.smithi042.stdout: "grafana_dashboards_path": { 2024-08-26T00:14:46.701 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "grafana_dashboards_path", 2024-08-26T00:14:46.701 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.701 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.701 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.701 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-26T00:14:46.701 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.701 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.701 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.701 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-26T00:14:46.702 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.702 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.702 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.702 INFO:teuthology.orchestra.run.smithi042.stdout: "host_check_interval": { 2024-08-26T00:14:46.702 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "host_check_interval", 2024-08-26T00:14:46.702 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:46.702 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.702 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.702 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-08-26T00:14:46.702 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.702 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.702 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.703 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to perform a host check", 2024-08-26T00:14:46.703 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.703 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.703 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.703 INFO:teuthology.orchestra.run.smithi042.stdout: "hw_monitoring": { 2024-08-26T00:14:46.703 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "hw_monitoring", 2024-08-26T00:14:46.703 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.703 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.703 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.703 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.703 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.703 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.704 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.704 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-26T00:14:46.704 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.704 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.704 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.704 INFO:teuthology.orchestra.run.smithi042.stdout: "inventory_list_all": { 2024-08-26T00:14:46.704 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "inventory_list_all", 2024-08-26T00:14:46.704 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.704 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.704 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.704 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.704 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.705 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.705 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.705 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-26T00:14:46.705 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.705 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.705 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.705 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.705 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.705 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.705 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.705 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.705 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.705 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.706 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.706 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.706 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.706 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.706 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.706 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.706 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.706 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.706 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.706 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.706 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.706 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.706 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.707 INFO:teuthology.orchestra.run.smithi042.stdout: "log_refresh_metadata": { 2024-08-26T00:14:46.707 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_refresh_metadata", 2024-08-26T00:14:46.707 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.707 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.707 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.707 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.707 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.707 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.707 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.707 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-26T00:14:46.707 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.708 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.708 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.708 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.708 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.708 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.708 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.708 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.708 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.708 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.708 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.708 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.708 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-26T00:14:46.709 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.709 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.709 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.709 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.709 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.709 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.709 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.709 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.709 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.709 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.709 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.709 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.710 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.710 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.710 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.710 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.710 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.710 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.710 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.710 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.710 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.710 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.710 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.710 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.711 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.711 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.711 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.711 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.711 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.711 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.711 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.711 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.711 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.711 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.711 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.711 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.711 INFO:teuthology.orchestra.run.smithi042.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-26T00:14:46.712 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-26T00:14:46.712 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.712 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.712 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.712 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.712 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.712 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.712 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.712 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-26T00:14:46.712 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.712 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.712 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.712 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.713 INFO:teuthology.orchestra.run.smithi042.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-26T00:14:46.713 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-26T00:14:46.713 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.713 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.713 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.713 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "*", 2024-08-26T00:14:46.713 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.713 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.713 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.713 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-26T00:14:46.713 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.713 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.713 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.714 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.714 INFO:teuthology.orchestra.run.smithi042.stdout: "max_count_per_host": { 2024-08-26T00:14:46.714 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_count_per_host", 2024-08-26T00:14:46.714 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.714 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.714 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.714 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:46.714 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.714 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.714 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.714 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "max number of daemons per service per host", 2024-08-26T00:14:46.714 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.715 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.715 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.715 INFO:teuthology.orchestra.run.smithi042.stdout: "max_osd_draining_count": { 2024-08-26T00:14:46.715 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_osd_draining_count", 2024-08-26T00:14:46.715 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.715 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.715 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.715 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:46.715 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.715 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.715 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.715 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-26T00:14:46.715 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.716 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.716 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.716 INFO:teuthology.orchestra.run.smithi042.stdout: "migration_current": { 2024-08-26T00:14:46.716 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "migration_current", 2024-08-26T00:14:46.716 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.716 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.716 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.716 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.716 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.716 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.716 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.716 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "internal - do not modify", 2024-08-26T00:14:46.716 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.717 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.717 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.717 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": { 2024-08-26T00:14:46.717 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mode", 2024-08-26T00:14:46.717 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.717 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.717 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.717 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "root", 2024-08-26T00:14:46.717 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.717 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.717 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.717 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm-package", 2024-08-26T00:14:46.717 INFO:teuthology.orchestra.run.smithi042.stdout: "root" 2024-08-26T00:14:46.718 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.718 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "mode for remote execution of cephadm", 2024-08-26T00:14:46.718 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.718 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.718 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.718 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.718 INFO:teuthology.orchestra.run.smithi042.stdout: "oob_default_addr": { 2024-08-26T00:14:46.718 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "oob_default_addr", 2024-08-26T00:14:46.718 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.718 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.718 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.718 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "169.254.1.1", 2024-08-26T00:14:46.718 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.719 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.719 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.719 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-26T00:14:46.719 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.719 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.719 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.719 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.719 INFO:teuthology.orchestra.run.smithi042.stdout: "prometheus_alerts_path": { 2024-08-26T00:14:46.719 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prometheus_alerts_path", 2024-08-26T00:14:46.719 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.719 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.719 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.719 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-26T00:14:46.719 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.720 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.720 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.720 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-26T00:14:46.720 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.720 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.720 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.720 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_insecure": { 2024-08-26T00:14:46.720 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_insecure", 2024-08-26T00:14:46.720 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.720 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.720 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.721 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.721 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.721 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.721 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.721 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-26T00:14:46.721 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.721 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.721 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.721 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_password": { 2024-08-26T00:14:46.721 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_password", 2024-08-26T00:14:46.721 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.721 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.722 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.722 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.722 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.722 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.722 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.722 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-26T00:14:46.722 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.722 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.722 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.722 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_url": { 2024-08-26T00:14:46.722 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_url", 2024-08-26T00:14:46.722 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.723 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.723 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.723 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.723 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.723 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.723 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.723 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-26T00:14:46.723 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.723 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.723 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.723 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_username": { 2024-08-26T00:14:46.723 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_username", 2024-08-26T00:14:46.724 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.724 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.724 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.724 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.724 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.724 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.724 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.724 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-26T00:14:46.724 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.724 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.724 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.724 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.724 INFO:teuthology.orchestra.run.smithi042.stdout: "secure_monitoring_stack": { 2024-08-26T00:14:46.725 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "secure_monitoring_stack", 2024-08-26T00:14:46.725 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.725 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.725 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.725 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.725 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.725 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.725 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.725 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-26T00:14:46.725 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.725 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.725 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.726 INFO:teuthology.orchestra.run.smithi042.stdout: "service_discovery_port": { 2024-08-26T00:14:46.726 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "service_discovery_port", 2024-08-26T00:14:46.726 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.726 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.726 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.726 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8765", 2024-08-26T00:14:46.726 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.726 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.726 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.726 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "cephadm service discovery port", 2024-08-26T00:14:46.726 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.726 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.726 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.727 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.727 INFO:teuthology.orchestra.run.smithi042.stdout: "ssh_config_file": { 2024-08-26T00:14:46.727 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssh_config_file", 2024-08-26T00:14:46.727 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.727 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.727 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.727 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.727 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.727 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.727 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.727 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-26T00:14:46.727 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.727 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.728 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.728 INFO:teuthology.orchestra.run.smithi042.stdout: "use_agent": { 2024-08-26T00:14:46.728 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "use_agent", 2024-08-26T00:14:46.728 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.728 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.728 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.728 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.728 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.728 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.728 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.728 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-26T00:14:46.729 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.729 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.729 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.729 INFO:teuthology.orchestra.run.smithi042.stdout: "use_repo_digest": { 2024-08-26T00:14:46.729 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "use_repo_digest", 2024-08-26T00:14:46.729 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.729 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.729 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.729 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.729 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.729 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.729 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.730 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-26T00:14:46.730 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.730 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.730 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.730 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.730 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_failed_host_check": { 2024-08-26T00:14:46.730 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_failed_host_check", 2024-08-26T00:14:46.730 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.730 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.730 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.730 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.730 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.731 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.731 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.731 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if the host check fails", 2024-08-26T00:14:46.731 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.731 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.731 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.731 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.731 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_stray_daemons": { 2024-08-26T00:14:46.731 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_stray_daemons", 2024-08-26T00:14:46.731 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.731 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.731 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.731 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.732 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.732 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.732 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.732 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-26T00:14:46.732 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.732 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.732 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.732 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.732 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_stray_hosts": { 2024-08-26T00:14:46.732 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_stray_hosts", 2024-08-26T00:14:46.732 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.732 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.732 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.732 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.733 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.733 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.733 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.733 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-26T00:14:46.733 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.733 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.733 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.733 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.733 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.733 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.733 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.733 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crash", 2024-08-26T00:14:46.733 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.734 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.734 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.734 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.734 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.734 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.734 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.734 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.734 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.734 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.734 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.734 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.734 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.734 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.735 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.735 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.735 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.735 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.735 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.735 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.735 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.735 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.735 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.735 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.735 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.735 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.736 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.736 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.736 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.736 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.736 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.736 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.736 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.736 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.736 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.736 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.736 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.736 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.736 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.737 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.737 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.737 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.737 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.737 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.737 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.737 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.737 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.737 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.737 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.737 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.737 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.738 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.738 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.738 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.738 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.738 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.738 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.738 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.738 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.738 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.738 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.738 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.738 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.739 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.739 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.739 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.739 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.739 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.739 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.739 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.739 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.739 INFO:teuthology.orchestra.run.smithi042.stdout: "retain_interval": { 2024-08-26T00:14:46.739 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "retain_interval", 2024-08-26T00:14:46.739 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:46.739 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.740 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.740 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "31536000", 2024-08-26T00:14:46.740 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.740 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.740 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.740 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-26T00:14:46.740 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.740 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.740 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.740 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_recent_interval": { 2024-08-26T00:14:46.740 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_recent_interval", 2024-08-26T00:14:46.740 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:46.740 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.741 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.741 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1209600", 2024-08-26T00:14:46.741 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.741 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.741 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.741 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-26T00:14:46.741 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.741 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.741 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.741 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.741 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.742 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "dashboard", 2024-08-26T00:14:46.742 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.742 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.742 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.742 INFO:teuthology.orchestra.run.smithi042.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-26T00:14:46.742 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-26T00:14:46.742 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.742 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.742 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.742 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:46.742 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.742 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.742 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.743 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.743 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.743 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.743 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.743 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.743 INFO:teuthology.orchestra.run.smithi042.stdout: "ALERTMANAGER_API_HOST": { 2024-08-26T00:14:46.743 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-26T00:14:46.743 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.743 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.743 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.743 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.743 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.743 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.744 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.744 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.744 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.744 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.744 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.744 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.744 INFO:teuthology.orchestra.run.smithi042.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-26T00:14:46.744 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-26T00:14:46.744 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.744 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.744 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.744 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.744 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.745 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.745 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.745 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.745 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.745 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.745 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.745 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.745 INFO:teuthology.orchestra.run.smithi042.stdout: "AUDIT_API_ENABLED": { 2024-08-26T00:14:46.745 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "AUDIT_API_ENABLED", 2024-08-26T00:14:46.745 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.745 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.745 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.745 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.746 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.746 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.746 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.746 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.746 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.746 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.746 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.746 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.746 INFO:teuthology.orchestra.run.smithi042.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-26T00:14:46.746 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-26T00:14:46.746 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.746 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.746 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.747 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.747 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.747 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.747 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.747 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.747 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.747 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.747 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.747 INFO:teuthology.orchestra.run.smithi042.stdout: "ENABLE_BROWSABLE_API": { 2024-08-26T00:14:46.747 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-26T00:14:46.747 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.747 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.748 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.748 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.748 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.748 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.748 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.748 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.748 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.748 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.748 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.748 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-26T00:14:46.748 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-26T00:14:46.749 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.749 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.749 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.749 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.749 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.749 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.749 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.749 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.749 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.749 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.749 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.749 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.750 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-26T00:14:46.750 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-26T00:14:46.750 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.750 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.750 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.750 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.750 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.750 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.750 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.750 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.750 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.750 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.750 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.751 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-26T00:14:46.751 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-26T00:14:46.751 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.751 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.751 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.751 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.751 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.751 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.751 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.751 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.751 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.751 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.751 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.752 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-26T00:14:46.752 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-26T00:14:46.752 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.752 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.752 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.752 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.752 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.752 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.752 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.752 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.752 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.752 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.753 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.753 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-26T00:14:46.753 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-26T00:14:46.753 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.753 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.753 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.753 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.753 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.753 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.753 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.753 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.753 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.754 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.754 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.754 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.754 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-26T00:14:46.754 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-26T00:14:46.754 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.754 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.754 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.754 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.754 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.754 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.754 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.754 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.755 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.755 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.755 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.755 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.755 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-26T00:14:46.755 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-26T00:14:46.755 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.755 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.755 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.755 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.755 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.755 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.755 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.755 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.756 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.756 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.756 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.756 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.756 INFO:teuthology.orchestra.run.smithi042.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-26T00:14:46.756 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-26T00:14:46.756 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.756 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.756 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.756 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.756 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.756 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.756 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.756 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.757 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.757 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.757 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.757 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.757 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_PASSWORD": { 2024-08-26T00:14:46.757 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-26T00:14:46.757 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.757 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.757 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.757 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-08-26T00:14:46.757 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.757 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.757 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.757 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.758 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.758 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.758 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.758 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-26T00:14:46.758 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-26T00:14:46.758 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.758 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.758 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.758 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.758 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.758 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.758 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.759 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.759 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.759 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.759 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.759 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.759 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_URL": { 2024-08-26T00:14:46.759 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_URL", 2024-08-26T00:14:46.759 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.759 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.759 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.759 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.759 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.759 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.759 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.760 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.760 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.760 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.760 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.760 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_USERNAME": { 2024-08-26T00:14:46.760 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-26T00:14:46.760 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.760 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.760 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.760 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-08-26T00:14:46.760 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.760 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.760 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.761 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.761 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.761 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.761 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.761 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.761 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-26T00:14:46.761 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-26T00:14:46.761 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.761 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.761 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.761 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.761 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.761 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.761 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.762 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.762 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.762 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.762 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.762 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.762 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-26T00:14:46.762 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-26T00:14:46.762 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.762 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.762 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.762 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.762 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.763 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.763 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.763 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.763 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.763 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.763 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.763 INFO:teuthology.orchestra.run.smithi042.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-26T00:14:46.763 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-26T00:14:46.763 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.763 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.763 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.763 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.764 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.764 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.764 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.764 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.764 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.764 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.764 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.764 INFO:teuthology.orchestra.run.smithi042.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-26T00:14:46.764 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-26T00:14:46.764 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.764 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.764 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.764 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.765 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.765 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.765 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.765 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.765 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.765 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.765 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.765 INFO:teuthology.orchestra.run.smithi042.stdout: "PROMETHEUS_API_HOST": { 2024-08-26T00:14:46.765 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-26T00:14:46.765 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.765 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.765 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.766 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.766 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.766 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.766 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.766 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.766 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.766 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.766 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.766 INFO:teuthology.orchestra.run.smithi042.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-26T00:14:46.766 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-26T00:14:46.766 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.766 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.767 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.767 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.767 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.767 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.767 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.767 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.767 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.767 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.767 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.767 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-26T00:14:46.767 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-26T00:14:46.767 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.767 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.768 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.768 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.768 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.768 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.768 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.768 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.768 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.768 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.768 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.768 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.768 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-26T00:14:46.768 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-26T00:14:46.768 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.769 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.769 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.769 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.769 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.769 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.769 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.769 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.769 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.769 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.769 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.769 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.769 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-26T00:14:46.769 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-26T00:14:46.769 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.770 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.770 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.770 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.770 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.770 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.770 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.770 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.770 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.770 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.770 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.770 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.770 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-26T00:14:46.770 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-26T00:14:46.771 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.771 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.771 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.771 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.771 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.771 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.771 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.771 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.771 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.771 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.771 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.771 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.771 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-26T00:14:46.771 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-26T00:14:46.772 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.772 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.772 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.772 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.772 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.772 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.772 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.772 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.772 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.772 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.772 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.772 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.772 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-26T00:14:46.772 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-26T00:14:46.773 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.773 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.773 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.773 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.773 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.773 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.773 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.773 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.773 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.773 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.773 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.773 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.773 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-26T00:14:46.773 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-26T00:14:46.774 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.774 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.774 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.774 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.774 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.774 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.774 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.774 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.774 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.774 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.774 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.774 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.774 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_ENABLED": { 2024-08-26T00:14:46.774 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-26T00:14:46.775 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.775 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.775 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.775 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.775 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.775 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.775 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.775 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.775 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.775 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.775 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.775 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.776 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-26T00:14:46.776 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-26T00:14:46.776 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.776 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.776 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.776 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-26T00:14:46.776 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.776 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.776 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.776 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.776 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.776 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.776 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.777 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.777 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-26T00:14:46.777 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-26T00:14:46.777 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.777 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.777 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.777 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:46.777 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.777 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.777 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.777 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.777 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.777 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.778 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.778 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.778 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-26T00:14:46.778 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-26T00:14:46.778 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.778 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.778 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.778 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8", 2024-08-26T00:14:46.778 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.778 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.778 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.778 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.778 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.779 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.779 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.779 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.779 INFO:teuthology.orchestra.run.smithi042.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-26T00:14:46.779 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-26T00:14:46.779 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.779 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.779 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.779 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "45", 2024-08-26T00:14:46.779 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.779 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.779 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.779 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.779 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.780 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.780 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.780 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.780 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_ACCESS_KEY": { 2024-08-26T00:14:46.780 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-26T00:14:46.780 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.780 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.780 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.780 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.780 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.780 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.780 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.780 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.781 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.781 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.781 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.781 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.781 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-26T00:14:46.781 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-26T00:14:46.781 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.781 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.781 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.781 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-08-26T00:14:46.781 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.781 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.781 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.781 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.782 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.782 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.782 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.782 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.782 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_SECRET_KEY": { 2024-08-26T00:14:46.782 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-26T00:14:46.782 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.782 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.782 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.782 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.782 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.782 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.782 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.783 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.783 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.783 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.783 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.783 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.783 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_SSL_VERIFY": { 2024-08-26T00:14:46.783 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-26T00:14:46.783 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.783 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.783 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.783 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.783 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.783 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.784 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.784 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.784 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.784 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.784 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.784 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.784 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-26T00:14:46.784 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-26T00:14:46.784 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.784 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.784 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.784 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-08-26T00:14:46.784 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.784 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.785 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.785 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.785 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.785 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.785 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.785 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.785 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-26T00:14:46.785 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-26T00:14:46.785 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.785 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.785 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.785 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:46.785 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.785 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.786 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.786 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.786 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.786 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.786 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.786 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.786 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-26T00:14:46.786 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-26T00:14:46.786 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.786 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.786 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.786 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-08-26T00:14:46.786 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.787 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.787 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.787 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.787 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.787 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.787 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.787 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.787 INFO:teuthology.orchestra.run.smithi042.stdout: "cross_origin_url": { 2024-08-26T00:14:46.787 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cross_origin_url", 2024-08-26T00:14:46.787 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.787 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.787 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.787 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.787 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.788 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.788 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.788 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.788 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.788 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.788 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.788 INFO:teuthology.orchestra.run.smithi042.stdout: "crt_file": { 2024-08-26T00:14:46.788 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crt_file", 2024-08-26T00:14:46.788 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.788 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.788 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.788 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.788 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.789 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.789 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.789 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.789 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.789 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.789 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.789 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.789 INFO:teuthology.orchestra.run.smithi042.stdout: "debug": { 2024-08-26T00:14:46.789 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "debug", 2024-08-26T00:14:46.789 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.789 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.790 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.790 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.790 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.790 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.790 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.790 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable/disable debug options", 2024-08-26T00:14:46.790 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.790 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.790 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.790 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.790 INFO:teuthology.orchestra.run.smithi042.stdout: "jwt_token_ttl": { 2024-08-26T00:14:46.790 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "jwt_token_ttl", 2024-08-26T00:14:46.790 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.791 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.791 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.791 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "28800", 2024-08-26T00:14:46.791 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.791 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.791 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.791 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.791 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.791 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.791 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.791 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.791 INFO:teuthology.orchestra.run.smithi042.stdout: "key_file": { 2024-08-26T00:14:46.791 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "key_file", 2024-08-26T00:14:46.791 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.792 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.792 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.792 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.792 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.792 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.792 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.792 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.792 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.792 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.792 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.792 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.792 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.792 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.793 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.793 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.793 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.793 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.793 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.793 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.793 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.793 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.793 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.793 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.793 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.793 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.793 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.794 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.794 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.794 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.794 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.794 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.794 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.794 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.794 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.794 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.794 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.794 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.794 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.794 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.795 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.795 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.795 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.795 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.795 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.795 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.795 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.795 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.795 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.795 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.795 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.795 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.795 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.795 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.796 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.796 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.796 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.796 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.796 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.796 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.796 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.796 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.796 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.796 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.796 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.796 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.796 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.797 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.797 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.797 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.797 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.797 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.797 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.797 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.797 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.797 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.797 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.797 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.797 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.797 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.797 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.798 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.798 INFO:teuthology.orchestra.run.smithi042.stdout: "motd": { 2024-08-26T00:14:46.798 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "motd", 2024-08-26T00:14:46.798 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.798 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.798 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.798 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.798 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.798 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.798 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.798 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "The message of the day", 2024-08-26T00:14:46.798 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.798 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.799 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.799 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.799 INFO:teuthology.orchestra.run.smithi042.stdout: "redirect_resolve_ip_addr": { 2024-08-26T00:14:46.799 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "redirect_resolve_ip_addr", 2024-08-26T00:14:46.799 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.799 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.799 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.799 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.799 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.799 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.799 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.799 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.799 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.800 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.800 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.800 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.800 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-08-26T00:14:46.800 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-08-26T00:14:46.800 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.800 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.800 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.800 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "::", 2024-08-26T00:14:46.800 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.800 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.800 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.800 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.800 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.801 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.801 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.801 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.801 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-08-26T00:14:46.801 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-08-26T00:14:46.801 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.801 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.801 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.801 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8080", 2024-08-26T00:14:46.801 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.801 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.801 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.801 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.801 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.802 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.802 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.802 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.802 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl": { 2024-08-26T00:14:46.802 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl", 2024-08-26T00:14:46.802 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.802 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.802 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.802 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.802 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.802 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.802 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.802 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.802 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.803 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.803 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.803 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.803 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl_server_port": { 2024-08-26T00:14:46.803 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl_server_port", 2024-08-26T00:14:46.803 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.803 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.803 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.803 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8443", 2024-08-26T00:14:46.803 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.803 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.803 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.803 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.803 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.804 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.804 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.804 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.804 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_behaviour": { 2024-08-26T00:14:46.804 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_behaviour", 2024-08-26T00:14:46.804 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.804 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.804 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.804 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "redirect", 2024-08-26T00:14:46.804 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.804 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.804 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.805 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.805 INFO:teuthology.orchestra.run.smithi042.stdout: "redirect" 2024-08-26T00:14:46.805 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.805 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.805 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.805 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.805 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.805 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.805 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_error_status_code": { 2024-08-26T00:14:46.805 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_error_status_code", 2024-08-26T00:14:46.805 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.805 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.805 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.806 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "500", 2024-08-26T00:14:46.806 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "400", 2024-08-26T00:14:46.806 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "599", 2024-08-26T00:14:46.806 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.806 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.806 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.806 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.806 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.806 INFO:teuthology.orchestra.run.smithi042.stdout: "url_prefix": { 2024-08-26T00:14:46.806 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "url_prefix", 2024-08-26T00:14:46.806 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.806 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.807 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.807 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.807 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.807 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.807 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.807 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.807 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.807 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.807 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.807 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.807 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.807 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.807 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.808 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "devicehealth", 2024-08-26T00:14:46.808 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.808 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.808 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.808 INFO:teuthology.orchestra.run.smithi042.stdout: "enable_monitoring": { 2024-08-26T00:14:46.808 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enable_monitoring", 2024-08-26T00:14:46.808 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.808 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.808 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.808 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.808 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.808 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.808 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.808 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "monitor device health metrics", 2024-08-26T00:14:46.809 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.809 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.809 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.809 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.809 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.809 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.809 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.809 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.809 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.809 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.809 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.809 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.809 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.810 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.810 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.810 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.810 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.810 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.810 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.810 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.810 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.810 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.810 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.810 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.810 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.810 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.811 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.811 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.811 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.811 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.811 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.811 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.811 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.811 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.811 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.811 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.811 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.811 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.811 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.812 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.812 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.812 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.812 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.812 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.812 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.812 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.812 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.812 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.812 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.812 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.812 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.812 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.812 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.813 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.813 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.813 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.813 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.813 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.813 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.813 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.813 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.813 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.813 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.813 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.813 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.813 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.813 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.814 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.814 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.814 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.814 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.814 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.814 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.814 INFO:teuthology.orchestra.run.smithi042.stdout: "mark_out_threshold": { 2024-08-26T00:14:46.814 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mark_out_threshold", 2024-08-26T00:14:46.814 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:46.814 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.814 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.814 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "2419200", 2024-08-26T00:14:46.814 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.814 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.815 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.815 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-26T00:14:46.815 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.815 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.815 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.815 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": { 2024-08-26T00:14:46.815 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pool_name", 2024-08-26T00:14:46.815 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.815 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.815 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.815 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "device_health_metrics", 2024-08-26T00:14:46.815 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.816 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.816 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.816 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-26T00:14:46.816 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.816 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.816 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.816 INFO:teuthology.orchestra.run.smithi042.stdout: "retention_period": { 2024-08-26T00:14:46.816 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "retention_period", 2024-08-26T00:14:46.816 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:46.816 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.816 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.816 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15552000", 2024-08-26T00:14:46.816 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.817 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.817 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.817 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long to retain device health metrics", 2024-08-26T00:14:46.817 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.817 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.817 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.817 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.817 INFO:teuthology.orchestra.run.smithi042.stdout: "scrape_frequency": { 2024-08-26T00:14:46.817 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "scrape_frequency", 2024-08-26T00:14:46.817 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:46.817 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.817 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.817 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "86400", 2024-08-26T00:14:46.817 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.818 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.818 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.818 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-26T00:14:46.818 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.818 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.818 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.818 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.818 INFO:teuthology.orchestra.run.smithi042.stdout: "self_heal": { 2024-08-26T00:14:46.818 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "self_heal", 2024-08-26T00:14:46.818 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.818 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.819 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.819 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.819 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.819 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.819 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.819 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-26T00:14:46.819 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.819 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.819 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.819 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.819 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-08-26T00:14:46.819 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-08-26T00:14:46.819 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:46.820 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.820 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.820 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-08-26T00:14:46.820 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.820 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.820 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.820 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to wake up and check device health", 2024-08-26T00:14:46.820 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.820 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.820 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.820 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_threshold": { 2024-08-26T00:14:46.820 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_threshold", 2024-08-26T00:14:46.820 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:46.821 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.821 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.821 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "7257600", 2024-08-26T00:14:46.821 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.821 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.821 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.821 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-26T00:14:46.821 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.821 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.821 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.821 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.821 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.821 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.822 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.822 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "diskprediction_local", 2024-08-26T00:14:46.822 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.822 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.822 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.822 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.822 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.822 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.822 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.822 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.822 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.822 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.822 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.823 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.823 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.823 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.823 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.823 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.823 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.823 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.823 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.823 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.823 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.823 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.823 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.823 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.824 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.824 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.824 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.824 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.824 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.824 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.824 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.824 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.824 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.824 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.824 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.824 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.824 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.825 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.825 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.825 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.825 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.825 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.825 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.825 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.825 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.825 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.825 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.825 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.825 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.825 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.825 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.826 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.826 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.826 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.826 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.826 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.826 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.826 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.826 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.826 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.826 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.826 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.826 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.826 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.827 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.827 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.827 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.827 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.827 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.827 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.827 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.827 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.827 INFO:teuthology.orchestra.run.smithi042.stdout: "predict_interval": { 2024-08-26T00:14:46.827 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "predict_interval", 2024-08-26T00:14:46.827 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.827 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.827 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.827 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "86400", 2024-08-26T00:14:46.828 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.828 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.828 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.828 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.828 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.828 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.828 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.828 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.828 INFO:teuthology.orchestra.run.smithi042.stdout: "predictor_model": { 2024-08-26T00:14:46.828 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "predictor_model", 2024-08-26T00:14:46.828 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.829 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.829 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.829 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "prophetstor", 2024-08-26T00:14:46.829 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.829 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.829 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.829 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.829 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.829 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.829 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.829 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.829 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-08-26T00:14:46.829 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-08-26T00:14:46.829 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.830 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.830 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.830 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-08-26T00:14:46.830 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.830 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.830 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.830 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.830 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.830 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.830 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.830 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.830 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.830 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.831 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.831 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "influx", 2024-08-26T00:14:46.831 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": false, 2024-08-26T00:14:46.831 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "influxdb python module not found", 2024-08-26T00:14:46.831 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.831 INFO:teuthology.orchestra.run.smithi042.stdout: "batch_size": { 2024-08-26T00:14:46.831 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "batch_size", 2024-08-26T00:14:46.831 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.831 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.831 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.831 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5000", 2024-08-26T00:14:46.831 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.831 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.832 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.832 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-26T00:14:46.832 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.832 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.832 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.832 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.832 INFO:teuthology.orchestra.run.smithi042.stdout: "database": { 2024-08-26T00:14:46.832 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "database", 2024-08-26T00:14:46.832 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.832 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.832 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.832 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "ceph", 2024-08-26T00:14:46.833 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.833 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.833 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.833 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-26T00:14:46.833 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.834 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.834 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.834 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.834 INFO:teuthology.orchestra.run.smithi042.stdout: "hostname": { 2024-08-26T00:14:46.834 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "hostname", 2024-08-26T00:14:46.834 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.835 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.835 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.835 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.835 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.835 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.835 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.836 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB server hostname", 2024-08-26T00:14:46.836 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.836 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.836 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.836 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.836 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-08-26T00:14:46.836 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-08-26T00:14:46.836 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:46.836 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.836 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.836 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "30", 2024-08-26T00:14:46.836 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "5", 2024-08-26T00:14:46.837 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.837 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.837 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-26T00:14:46.837 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.837 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.837 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.837 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.837 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.837 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.837 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.837 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.837 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.837 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.838 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.838 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.838 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.838 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.838 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.838 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.838 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.838 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.838 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.838 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.838 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.838 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.838 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.839 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.839 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.839 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.839 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.839 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.839 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.839 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.839 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.839 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.839 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.839 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.839 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.839 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.840 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.840 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.840 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.840 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.840 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.840 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.840 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.840 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.840 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.840 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.840 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.840 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.840 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.840 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.841 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.841 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.841 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.841 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.841 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.841 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.841 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.841 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.841 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.841 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.841 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.841 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.841 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.842 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.842 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.842 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.842 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.842 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.842 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.842 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.842 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.842 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.842 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.842 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.842 INFO:teuthology.orchestra.run.smithi042.stdout: "password": { 2024-08-26T00:14:46.842 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "password", 2024-08-26T00:14:46.842 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.843 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.843 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.843 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.843 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.843 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.843 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.843 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "password of InfluxDB server user", 2024-08-26T00:14:46.843 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.843 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.843 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.843 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.843 INFO:teuthology.orchestra.run.smithi042.stdout: "port": { 2024-08-26T00:14:46.843 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "port", 2024-08-26T00:14:46.844 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.844 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.844 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.844 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8086", 2024-08-26T00:14:46.844 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.844 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.844 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.844 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB server port", 2024-08-26T00:14:46.844 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.844 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.844 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.844 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.844 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl": { 2024-08-26T00:14:46.844 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl", 2024-08-26T00:14:46.845 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.845 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.845 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.845 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "false", 2024-08-26T00:14:46.845 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.845 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.845 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.845 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-26T00:14:46.845 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.845 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.845 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.845 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.845 INFO:teuthology.orchestra.run.smithi042.stdout: "threads": { 2024-08-26T00:14:46.846 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "threads", 2024-08-26T00:14:46.846 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.846 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.846 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.846 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-08-26T00:14:46.846 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-08-26T00:14:46.846 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "32", 2024-08-26T00:14:46.846 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.846 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-26T00:14:46.846 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.846 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.846 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.846 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.847 INFO:teuthology.orchestra.run.smithi042.stdout: "username": { 2024-08-26T00:14:46.847 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "username", 2024-08-26T00:14:46.847 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.847 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.847 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.847 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.847 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.847 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.847 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.847 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "username of InfluxDB server user", 2024-08-26T00:14:46.847 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.847 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.847 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.847 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.848 INFO:teuthology.orchestra.run.smithi042.stdout: "verify_ssl": { 2024-08-26T00:14:46.848 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "verify_ssl", 2024-08-26T00:14:46.848 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.848 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.848 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.848 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "true", 2024-08-26T00:14:46.848 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.848 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.848 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.848 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-26T00:14:46.848 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.848 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.849 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.849 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.849 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.849 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.849 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.849 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "insights", 2024-08-26T00:14:46.849 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.849 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.849 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.849 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.849 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.849 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.849 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.850 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.850 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.850 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.850 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.850 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.850 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.850 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.850 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.850 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.850 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.850 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.850 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.850 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.851 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.851 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.851 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.851 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.851 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.851 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.851 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.851 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.851 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.851 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.851 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.851 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.851 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.851 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.852 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.852 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.852 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.852 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.852 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.852 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.852 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.852 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.852 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.852 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.852 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.852 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.852 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.853 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.853 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.853 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.853 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.853 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.853 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.853 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.853 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.853 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.853 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.853 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.853 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.853 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.854 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.854 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.854 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.854 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.854 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.854 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.854 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.854 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.854 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.854 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.854 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.854 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.854 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.855 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.855 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.855 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.855 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "iostat", 2024-08-26T00:14:46.855 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.855 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.855 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.855 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.855 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.855 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.855 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.855 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.855 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.855 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.856 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.856 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.856 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.856 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.856 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.856 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.856 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.856 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.856 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.856 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.856 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.856 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.856 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.857 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.857 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.857 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.857 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.857 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.857 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.857 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.857 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.857 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.857 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.857 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.857 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.857 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.857 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.858 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.858 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.858 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.858 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.858 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.858 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.858 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.858 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.858 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.858 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.858 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.858 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.858 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.859 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.859 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.859 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.859 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.859 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.859 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.859 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.859 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.859 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.859 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.859 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.859 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.859 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.859 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.860 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.860 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.860 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.860 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.860 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.860 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.860 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.860 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.860 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.860 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.860 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.860 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.860 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "k8sevents", 2024-08-26T00:14:46.861 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.861 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.861 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.861 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_event_retention_days": { 2024-08-26T00:14:46.861 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ceph_event_retention_days", 2024-08-26T00:14:46.861 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.861 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.861 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.861 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "7", 2024-08-26T00:14:46.861 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.861 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.861 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.861 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-26T00:14:46.861 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.862 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.862 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.862 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.862 INFO:teuthology.orchestra.run.smithi042.stdout: "config_check_secs": { 2024-08-26T00:14:46.862 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_check_secs", 2024-08-26T00:14:46.862 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.862 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.862 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.862 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:46.862 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "10", 2024-08-26T00:14:46.862 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.862 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.863 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-26T00:14:46.863 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.863 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.863 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.863 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.863 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.863 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.863 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.863 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.863 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.863 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.863 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.863 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.864 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.864 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.864 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.864 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.864 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.864 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.864 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.864 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.864 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.864 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.864 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.864 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.864 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.864 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.865 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.865 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.865 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.865 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.865 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.865 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.865 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.865 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.865 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.865 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.865 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.865 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.865 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.866 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.866 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.866 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.866 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.866 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.866 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.866 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.866 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.866 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.866 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.866 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.866 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.866 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.866 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.867 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.867 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.867 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.867 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.867 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.867 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.867 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.867 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.867 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.867 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.867 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.867 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.867 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.868 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.868 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.868 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.868 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.868 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.868 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.868 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.868 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.868 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.868 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.868 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.868 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "localpool", 2024-08-26T00:14:46.868 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.868 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.869 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.869 INFO:teuthology.orchestra.run.smithi042.stdout: "failure_domain": { 2024-08-26T00:14:46.869 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "failure_domain", 2024-08-26T00:14:46.869 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.869 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.869 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.869 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "host", 2024-08-26T00:14:46.869 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.869 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.869 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.869 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "failure domain for any created local pool", 2024-08-26T00:14:46.869 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-26T00:14:46.869 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.870 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.870 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.870 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.870 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.870 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.870 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.870 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.870 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.870 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.870 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.870 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.870 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.870 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.870 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.871 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.871 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.871 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.871 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.871 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.871 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.871 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.871 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.871 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.871 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.871 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.871 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.871 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.872 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.872 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.872 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.872 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.872 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.872 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.872 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.872 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.872 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.872 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.872 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.872 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.872 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.872 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.873 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.873 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.873 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.873 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.873 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.873 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.873 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.873 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.873 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.873 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.873 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.873 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.873 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.873 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.874 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.874 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.874 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.874 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.874 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.874 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.874 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.874 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.874 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.874 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.874 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.874 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.875 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.875 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.875 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.875 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.875 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.875 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": { 2024-08-26T00:14:46.875 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "min_size", 2024-08-26T00:14:46.875 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.875 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.875 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.875 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.875 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.875 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.875 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.876 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default min_size for any created local pool", 2024-08-26T00:14:46.876 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-26T00:14:46.876 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.876 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.876 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.876 INFO:teuthology.orchestra.run.smithi042.stdout: "num_rep": { 2024-08-26T00:14:46.876 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "num_rep", 2024-08-26T00:14:46.876 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.876 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.876 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.876 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3", 2024-08-26T00:14:46.876 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.876 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.877 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.877 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default replica count for any created local pool", 2024-08-26T00:14:46.877 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.877 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.877 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.877 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.877 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": { 2024-08-26T00:14:46.877 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pg_num", 2024-08-26T00:14:46.877 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.877 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.877 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.877 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "128", 2024-08-26T00:14:46.877 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.878 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.878 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.878 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default pg_num for any created local pool", 2024-08-26T00:14:46.878 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.878 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.878 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.878 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.878 INFO:teuthology.orchestra.run.smithi042.stdout: "prefix": { 2024-08-26T00:14:46.878 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prefix", 2024-08-26T00:14:46.878 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.878 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.878 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.878 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.879 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.879 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.879 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.879 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "name prefix for any created local pool", 2024-08-26T00:14:46.879 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.879 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.879 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.879 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.879 INFO:teuthology.orchestra.run.smithi042.stdout: "subtree": { 2024-08-26T00:14:46.879 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "subtree", 2024-08-26T00:14:46.879 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.879 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.879 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.880 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "rack", 2024-08-26T00:14:46.880 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.880 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.880 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.880 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-26T00:14:46.880 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-26T00:14:46.880 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.880 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.880 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.880 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.880 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.880 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.880 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mds_autoscaler", 2024-08-26T00:14:46.881 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.881 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.881 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.881 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.881 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.881 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.881 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.881 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.881 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.881 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.881 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.881 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.881 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.881 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.882 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.882 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.882 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.882 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.882 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.882 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.882 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.882 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.882 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.882 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.882 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.882 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.882 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.883 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.883 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.883 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.883 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.883 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.883 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.883 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.883 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.883 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.883 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.883 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.883 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.883 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.884 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.884 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.884 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.884 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.884 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.884 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.884 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.884 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.884 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.884 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.884 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.884 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.884 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.884 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.885 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.885 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.885 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.885 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.885 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.885 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.885 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.885 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.885 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.885 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.885 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.885 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.885 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.886 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.886 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.886 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.886 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.886 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.886 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.886 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.886 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.886 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.886 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mirroring", 2024-08-26T00:14:46.886 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.886 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.886 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.887 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.887 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.887 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.887 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.887 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.887 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.887 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.887 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.887 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.887 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.887 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.887 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.887 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.887 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.888 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.888 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.888 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.888 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.888 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.888 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.888 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.888 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.888 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.888 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.888 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.888 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.888 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.889 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.889 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.889 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.889 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.889 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.889 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.889 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.889 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.889 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.889 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.889 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.889 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.889 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.889 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.890 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.890 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.890 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.890 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.890 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.890 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.890 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.890 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.890 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.890 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.890 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.890 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.890 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.890 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.891 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.891 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.891 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.891 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.891 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.891 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.891 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.891 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.891 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.891 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.891 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.891 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.892 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.892 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.892 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.892 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.892 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.892 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.892 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "nfs", 2024-08-26T00:14:46.892 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.892 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.892 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.892 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.892 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.892 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.893 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.893 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.893 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.893 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.893 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.893 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.893 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.893 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.893 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.893 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.893 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.893 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.893 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.894 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.894 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.894 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.894 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.894 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.894 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.894 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.894 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.894 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.894 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.894 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.894 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.894 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.895 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.895 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.895 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.895 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.895 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.895 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.895 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.895 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.895 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.895 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.895 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.895 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.895 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.895 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.896 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.896 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.896 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.896 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.896 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.896 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.896 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.896 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.896 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.896 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.896 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.896 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.896 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.897 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.897 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.897 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.897 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.897 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.897 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.897 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.897 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.897 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.897 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.897 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.897 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.897 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.897 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.898 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.898 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.898 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.898 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "orchestrator", 2024-08-26T00:14:46.898 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.898 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.898 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.898 INFO:teuthology.orchestra.run.smithi042.stdout: "fail_fs": { 2024-08-26T00:14:46.898 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "fail_fs", 2024-08-26T00:14:46.898 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.898 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.898 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.898 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.899 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.899 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.899 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.899 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-26T00:14:46.899 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.899 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.899 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.899 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.899 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.899 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.899 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.899 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.899 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.899 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.900 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.900 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.900 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.900 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.900 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.900 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.900 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.900 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.900 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.900 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.900 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.900 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.900 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.900 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.901 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.901 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.901 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.901 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.901 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.901 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.901 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.901 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.901 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.901 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.901 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.901 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.901 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.902 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.902 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.902 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.902 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.902 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.902 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.902 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.902 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.902 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.902 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.902 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.902 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.902 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.902 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.903 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.903 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.903 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.903 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.903 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.903 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.903 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.903 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.903 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.903 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.903 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.903 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.903 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.903 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.904 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.904 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.904 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.904 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.904 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.904 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.904 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.904 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.904 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.904 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator": { 2024-08-26T00:14:46.904 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "orchestrator", 2024-08-26T00:14:46.904 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.904 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.904 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.905 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.905 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.905 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.905 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.905 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm", 2024-08-26T00:14:46.905 INFO:teuthology.orchestra.run.smithi042.stdout: "rook", 2024-08-26T00:14:46.905 INFO:teuthology.orchestra.run.smithi042.stdout: "test_orchestrator" 2024-08-26T00:14:46.905 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.905 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Orchestrator backend", 2024-08-26T00:14:46.905 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.905 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.905 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.905 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.905 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.906 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.906 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.906 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "osd_perf_query", 2024-08-26T00:14:46.906 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.906 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.906 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.906 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.906 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.906 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.906 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.906 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.907 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.907 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.907 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.907 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.907 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.907 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.907 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.907 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.907 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.907 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.907 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.907 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.907 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.907 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.908 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.908 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.908 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.908 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.908 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.908 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.908 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.908 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.908 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.908 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.908 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.908 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.908 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.908 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.909 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.909 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.909 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.909 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.909 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.909 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.909 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.909 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.909 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.909 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.909 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.909 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.909 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.910 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.910 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.910 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.910 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.910 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.910 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.910 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.910 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.910 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.910 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.910 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.910 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.910 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.911 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.911 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.911 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.911 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.911 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.911 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.911 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.911 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.911 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.911 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.911 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.911 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.911 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.911 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.912 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "osd_support", 2024-08-26T00:14:46.912 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.912 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.912 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.912 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.912 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.912 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.912 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.912 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.912 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.912 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.912 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.912 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.913 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.913 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.913 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.913 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.913 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.913 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.913 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.913 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.913 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.913 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.913 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.913 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.913 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.914 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.914 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.914 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.914 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.914 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.914 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.914 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.914 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.914 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.914 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.914 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.914 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.914 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.914 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.915 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.915 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.915 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.915 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.915 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.915 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.915 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.915 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.915 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.915 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.915 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.915 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.915 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.916 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.916 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.916 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.916 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.916 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.916 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.916 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.916 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.916 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.916 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.916 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.916 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.916 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.916 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.917 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.917 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.917 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.917 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.917 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.917 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.917 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.917 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.917 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.917 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.917 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pg_autoscaler", 2024-08-26T00:14:46.917 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.917 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.918 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.918 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.918 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.918 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.918 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.918 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.918 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.918 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.918 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.918 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.918 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.918 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.918 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.919 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.919 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.919 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.919 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.919 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.919 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.919 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.919 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.919 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.919 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.919 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.919 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.919 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.919 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.920 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.920 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.920 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.920 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.920 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.920 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.920 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.920 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.920 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.920 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.920 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.920 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.921 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.921 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.921 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.921 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.921 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.921 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.921 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.921 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.921 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.921 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.921 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.921 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.921 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.922 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.922 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.922 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.922 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.922 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.922 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.922 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.922 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.922 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.922 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.922 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.922 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.922 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.923 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.923 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.923 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.923 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.923 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.923 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.923 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-08-26T00:14:46.923 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-08-26T00:14:46.923 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:46.923 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.923 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.923 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-08-26T00:14:46.923 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.923 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.924 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.924 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.924 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.924 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.924 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.924 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.924 INFO:teuthology.orchestra.run.smithi042.stdout: "threshold": { 2024-08-26T00:14:46.924 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "threshold", 2024-08-26T00:14:46.924 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-08-26T00:14:46.924 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.924 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.924 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3.0", 2024-08-26T00:14:46.924 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1.0", 2024-08-26T00:14:46.925 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.925 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.925 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "scaling threshold", 2024-08-26T00:14:46.925 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-26T00:14:46.925 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.925 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.925 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.925 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.925 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.925 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.925 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "progress", 2024-08-26T00:14:46.925 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.925 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.926 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.926 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_pg_recovery_event": { 2024-08-26T00:14:46.926 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_pg_recovery_event", 2024-08-26T00:14:46.926 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.926 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.926 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.926 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.926 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.926 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.926 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.926 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-26T00:14:46.926 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.926 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.927 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.927 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.927 INFO:teuthology.orchestra.run.smithi042.stdout: "enabled": { 2024-08-26T00:14:46.927 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enabled", 2024-08-26T00:14:46.927 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.927 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.927 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.927 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.927 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.927 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.927 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.927 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.927 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.927 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.928 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.928 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.928 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.928 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.928 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.928 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.928 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.928 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.928 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.928 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.928 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.928 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.928 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.929 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.929 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.929 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.929 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.929 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.929 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.929 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.929 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.929 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.929 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.929 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.929 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.929 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.930 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.930 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.930 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.930 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.930 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.930 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.930 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.930 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.930 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.930 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.930 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.930 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.930 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.931 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.931 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.931 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.931 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.931 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.931 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.931 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.931 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.931 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.931 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.931 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.931 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.931 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.931 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.932 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.932 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.932 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.932 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.932 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.932 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.932 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.932 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.932 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.932 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.932 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.932 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.932 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.933 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.933 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.933 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.933 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.933 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.933 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.933 INFO:teuthology.orchestra.run.smithi042.stdout: "max_completed_events": { 2024-08-26T00:14:46.933 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_completed_events", 2024-08-26T00:14:46.933 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.933 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.933 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.933 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "50", 2024-08-26T00:14:46.933 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.933 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.934 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.934 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "number of past completed events to remember", 2024-08-26T00:14:46.934 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.934 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.934 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.934 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.934 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-08-26T00:14:46.934 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-08-26T00:14:46.934 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:46.934 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.934 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.934 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-08-26T00:14:46.934 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.935 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.935 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.935 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long the module is going to sleep", 2024-08-26T00:14:46.935 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.935 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.935 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.935 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.935 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.935 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.935 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.935 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prometheus", 2024-08-26T00:14:46.935 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.936 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.936 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.936 INFO:teuthology.orchestra.run.smithi042.stdout: "cache": { 2024-08-26T00:14:46.936 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cache", 2024-08-26T00:14:46.936 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.936 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.936 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.936 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.936 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.936 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.936 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.936 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.936 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.937 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.937 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.937 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.937 INFO:teuthology.orchestra.run.smithi042.stdout: "exclude_perf_counters": { 2024-08-26T00:14:46.937 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "exclude_perf_counters", 2024-08-26T00:14:46.937 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.937 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.937 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.937 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.937 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.937 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.937 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.937 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-26T00:14:46.938 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-26T00:14:46.938 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.938 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.938 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.938 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.938 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.938 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.938 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.938 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.938 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.938 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.938 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.938 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.939 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.939 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.939 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.939 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.939 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.939 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.939 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.939 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.939 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.939 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.939 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.939 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.939 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.940 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.940 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.940 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.940 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.940 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.940 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.940 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.940 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.940 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.940 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.940 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.940 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.941 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.941 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.941 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.941 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.941 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.941 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.941 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.941 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.941 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.941 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.941 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.941 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.942 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.942 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.942 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.942 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.942 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.942 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.942 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.942 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.942 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.942 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.942 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.942 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.943 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.943 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.943 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.943 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.943 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.943 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.943 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.943 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.943 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.943 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.943 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.943 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.944 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_stats_pools": { 2024-08-26T00:14:46.944 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_stats_pools", 2024-08-26T00:14:46.944 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.944 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.944 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.944 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.944 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.944 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.944 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.944 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.944 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.944 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.944 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.945 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.945 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-26T00:14:46.945 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-26T00:14:46.945 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.945 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.945 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.945 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "300", 2024-08-26T00:14:46.945 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.945 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.945 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.945 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.945 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.945 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.946 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.946 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.946 INFO:teuthology.orchestra.run.smithi042.stdout: "scrape_interval": { 2024-08-26T00:14:46.946 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "scrape_interval", 2024-08-26T00:14:46.946 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-08-26T00:14:46.946 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.946 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.947 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15.0", 2024-08-26T00:14:46.947 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.947 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.947 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.947 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.947 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.948 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.948 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.948 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.948 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-08-26T00:14:46.948 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-08-26T00:14:46.948 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.949 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.949 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.949 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "::", 2024-08-26T00:14:46.949 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.949 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.949 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.949 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-26T00:14:46.949 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.949 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.949 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.950 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.950 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-08-26T00:14:46.950 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-08-26T00:14:46.950 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.950 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.951 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.951 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "9283", 2024-08-26T00:14:46.951 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.951 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.951 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.951 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-26T00:14:46.951 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.951 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.951 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.951 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.951 INFO:teuthology.orchestra.run.smithi042.stdout: "stale_cache_strategy": { 2024-08-26T00:14:46.951 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "stale_cache_strategy", 2024-08-26T00:14:46.952 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.952 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.952 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.952 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "log", 2024-08-26T00:14:46.952 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.952 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.952 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.952 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.952 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.952 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.952 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.952 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.952 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_behaviour": { 2024-08-26T00:14:46.953 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_behaviour", 2024-08-26T00:14:46.953 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.953 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.953 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.953 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "default", 2024-08-26T00:14:46.953 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.953 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.953 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.953 INFO:teuthology.orchestra.run.smithi042.stdout: "default", 2024-08-26T00:14:46.953 INFO:teuthology.orchestra.run.smithi042.stdout: "error" 2024-08-26T00:14:46.953 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.953 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.953 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.954 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.954 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.954 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.954 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_error_status_code": { 2024-08-26T00:14:46.954 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_error_status_code", 2024-08-26T00:14:46.954 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.954 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.954 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.954 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "500", 2024-08-26T00:14:46.954 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "400", 2024-08-26T00:14:46.954 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "599", 2024-08-26T00:14:46.954 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.954 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.954 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.955 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.955 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.955 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.955 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.955 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.955 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.955 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_support", 2024-08-26T00:14:46.955 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.955 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.955 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.955 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.955 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.955 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.955 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.956 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.956 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.956 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.956 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.956 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.956 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.956 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.956 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.956 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.956 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.956 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.956 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.956 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.956 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.957 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.957 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.957 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.957 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.957 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.957 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.957 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.957 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.957 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.957 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.957 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.957 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.957 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.957 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.958 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.958 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.958 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.958 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.958 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.958 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.958 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.958 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.958 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.958 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.958 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.958 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.958 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.959 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.959 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.959 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.959 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.959 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.959 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.959 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.959 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.959 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.959 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.959 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.959 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.959 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.959 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.960 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.960 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.960 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.960 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.960 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.960 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.960 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.960 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.960 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.960 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.960 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.960 INFO:teuthology.orchestra.run.smithi042.stdout: "max_concurrent_snap_create": { 2024-08-26T00:14:46.960 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_concurrent_snap_create", 2024-08-26T00:14:46.960 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.961 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.961 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.961 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:46.961 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.961 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.961 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.961 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.961 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.961 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.961 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.961 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.961 INFO:teuthology.orchestra.run.smithi042.stdout: "mirror_snapshot_schedule": { 2024-08-26T00:14:46.961 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mirror_snapshot_schedule", 2024-08-26T00:14:46.961 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.962 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.962 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.962 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.962 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.962 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.962 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.962 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.962 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.962 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.962 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.962 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.962 INFO:teuthology.orchestra.run.smithi042.stdout: "trash_purge_schedule": { 2024-08-26T00:14:46.962 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "trash_purge_schedule", 2024-08-26T00:14:46.962 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.963 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.963 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.963 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.963 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.963 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.963 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.963 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.963 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.963 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.963 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.963 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.963 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.963 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.963 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.964 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "restful", 2024-08-26T00:14:46.964 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.964 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.964 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.964 INFO:teuthology.orchestra.run.smithi042.stdout: "enable_auth": { 2024-08-26T00:14:46.964 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enable_auth", 2024-08-26T00:14:46.964 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.964 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.964 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.964 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.964 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.964 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.964 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.964 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.964 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.965 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.965 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.965 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.965 INFO:teuthology.orchestra.run.smithi042.stdout: "key_file": { 2024-08-26T00:14:46.965 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "key_file", 2024-08-26T00:14:46.965 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.965 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.965 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.965 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.965 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.965 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.965 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.965 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.965 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.966 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.966 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.966 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.966 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.966 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.966 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.966 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.966 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.966 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.967 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.967 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.967 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.967 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.967 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.967 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.967 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.967 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.967 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.967 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.967 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.967 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.967 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.967 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.968 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.968 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.968 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.968 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.968 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.968 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.968 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.968 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.968 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.968 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.968 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.968 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.968 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.968 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.969 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.969 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.969 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.969 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.969 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.969 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.969 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.969 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.969 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.969 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.969 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.969 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.969 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.970 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.970 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.970 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.970 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.970 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.970 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.970 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.970 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.970 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.970 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.970 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.970 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.970 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.970 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.971 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.971 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.971 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.971 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.971 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.971 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.971 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.971 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.971 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.971 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-08-26T00:14:46.971 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-08-26T00:14:46.971 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.971 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.972 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.972 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.972 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.972 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.972 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.972 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.972 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.972 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.972 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.972 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.972 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-08-26T00:14:46.972 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-08-26T00:14:46.972 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.972 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.973 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.973 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.973 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.973 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.973 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.973 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.973 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.973 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.973 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.973 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.973 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.973 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.973 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.973 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rgw", 2024-08-26T00:14:46.973 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.974 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.974 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.974 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.974 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.974 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.974 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.974 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.974 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.974 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.974 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.974 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.974 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.974 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.975 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.975 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.975 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.975 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.975 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.975 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.975 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.975 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.975 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.975 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.975 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.975 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.975 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.975 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.976 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.976 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.976 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.976 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.976 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.976 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.976 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.976 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.976 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.976 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.976 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.976 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.976 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.976 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.977 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.977 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.977 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.977 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.977 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.977 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.977 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.977 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.977 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.977 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.977 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.977 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.977 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.977 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.978 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.978 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.978 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.978 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.978 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.978 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.978 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.978 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.978 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.978 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.978 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.978 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.978 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.978 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.979 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.979 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.979 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.979 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.979 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.979 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.979 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rook", 2024-08-26T00:14:46.979 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.979 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.979 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.979 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.979 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.979 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.979 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.980 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.980 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.980 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.980 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.980 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.980 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.980 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.980 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.980 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.980 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.980 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.980 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.980 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.981 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.981 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.981 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.981 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.981 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.981 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.981 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.981 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.981 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.981 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.981 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.981 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.981 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.982 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.982 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.982 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.982 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.982 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.982 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.982 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.982 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.982 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.982 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.982 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.982 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.982 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.982 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.983 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.983 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.983 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.983 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.983 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.983 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.983 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.983 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.983 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.983 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.983 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.983 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.983 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.983 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.984 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.984 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.984 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.984 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.984 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.984 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.984 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.984 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.984 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.984 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.984 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.984 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.984 INFO:teuthology.orchestra.run.smithi042.stdout: "storage_class": { 2024-08-26T00:14:46.984 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "storage_class", 2024-08-26T00:14:46.985 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.985 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.985 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.985 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "local", 2024-08-26T00:14:46.985 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.985 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.985 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.985 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-26T00:14:46.985 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.985 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.985 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.985 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.985 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:46.986 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.986 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:46.986 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "selftest", 2024-08-26T00:14:46.986 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:46.986 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:46.986 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:46.986 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:46.986 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:46.986 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.986 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.986 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.986 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.986 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.986 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.987 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.987 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.987 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.987 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.987 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.987 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.987 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.987 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.987 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.987 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.987 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.987 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.987 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.987 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:46.988 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:46.988 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.988 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.988 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.988 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.988 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.988 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.988 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.988 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.988 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.988 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.988 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.988 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.988 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:46.989 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:46.989 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.989 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.989 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.989 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:46.989 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.989 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.989 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:46.989 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:46.989 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:46.989 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:46.989 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:46.989 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:46.989 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:46.990 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:46.990 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.990 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.990 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.990 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.990 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.990 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:46.990 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:46.990 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.990 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.990 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:46.990 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:46.990 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.991 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.991 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.991 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.991 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.991 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.991 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.991 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.991 INFO:teuthology.orchestra.run.smithi042.stdout: "roption1": { 2024-08-26T00:14:46.991 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "roption1", 2024-08-26T00:14:46.991 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.991 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.991 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.991 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.991 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.992 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.992 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.992 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.992 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.992 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.992 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.992 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.992 INFO:teuthology.orchestra.run.smithi042.stdout: "roption2": { 2024-08-26T00:14:46.992 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "roption2", 2024-08-26T00:14:46.992 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.992 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.992 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.992 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "xyz", 2024-08-26T00:14:46.992 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.993 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.993 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.993 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.993 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.993 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.993 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.993 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.993 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption1": { 2024-08-26T00:14:46.993 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption1", 2024-08-26T00:14:46.993 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.993 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.993 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.993 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.993 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.993 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.994 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.994 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.994 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.994 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.994 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.994 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.994 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption2": { 2024-08-26T00:14:46.994 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption2", 2024-08-26T00:14:46.994 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.994 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.994 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.994 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.995 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.995 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.995 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.995 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.995 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.995 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.995 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.995 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.995 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption3": { 2024-08-26T00:14:46.995 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption3", 2024-08-26T00:14:46.995 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-08-26T00:14:46.995 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.995 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.995 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.996 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.996 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.996 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.996 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.996 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.996 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.996 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.996 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.996 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption4": { 2024-08-26T00:14:46.996 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption4", 2024-08-26T00:14:46.996 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:46.996 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.996 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.996 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.997 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.997 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.997 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.997 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.997 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.997 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.997 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.997 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.997 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption5": { 2024-08-26T00:14:46.997 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption5", 2024-08-26T00:14:46.997 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.997 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.997 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.997 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:46.998 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.998 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.998 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.998 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.998 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.998 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.998 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.998 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.998 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption6": { 2024-08-26T00:14:46.998 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption6", 2024-08-26T00:14:46.998 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:46.998 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.998 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:46.999 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:46.999 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:46.999 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:46.999 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:46.999 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:46.999 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:46.999 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:46.999 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:46.999 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:46.999 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption7": { 2024-08-26T00:14:46.999 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption7", 2024-08-26T00:14:46.999 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:46.999 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:46.999 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.000 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.000 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-08-26T00:14:47.000 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "42", 2024-08-26T00:14:47.000 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.000 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.000 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.000 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.000 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.000 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.000 INFO:teuthology.orchestra.run.smithi042.stdout: "testkey": { 2024-08-26T00:14:47.000 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testkey", 2024-08-26T00:14:47.000 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.000 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.000 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.001 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.001 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.001 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.001 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.001 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.001 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.001 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.001 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.001 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.001 INFO:teuthology.orchestra.run.smithi042.stdout: "testlkey": { 2024-08-26T00:14:47.001 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testlkey", 2024-08-26T00:14:47.001 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.001 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.001 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.002 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.002 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.002 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.002 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.002 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.002 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.002 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.002 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.002 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.002 INFO:teuthology.orchestra.run.smithi042.stdout: "testnewline": { 2024-08-26T00:14:47.002 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testnewline", 2024-08-26T00:14:47.002 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.002 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.002 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.003 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.003 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.003 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.003 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.003 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.003 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.003 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.003 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.003 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.003 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.003 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.003 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.003 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snap_schedule", 2024-08-26T00:14:47.003 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.004 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.004 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.004 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_m_granularity": { 2024-08-26T00:14:47.004 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_m_granularity", 2024-08-26T00:14:47.004 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.004 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.004 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.004 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.004 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.004 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.004 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.004 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow minute scheduled snapshots", 2024-08-26T00:14:47.004 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.004 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.005 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.005 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.005 INFO:teuthology.orchestra.run.smithi042.stdout: "dump_on_update": { 2024-08-26T00:14:47.005 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "dump_on_update", 2024-08-26T00:14:47.005 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.005 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.005 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.005 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.005 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.005 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.005 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.005 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "dump database to debug log on update", 2024-08-26T00:14:47.005 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.005 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.006 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.006 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.006 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.006 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.006 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.006 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.006 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.006 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.006 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.006 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.006 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.006 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.006 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.006 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.007 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.007 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.007 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.007 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.007 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.007 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.007 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.007 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.007 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.007 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.007 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.007 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.007 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.007 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.008 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.008 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.008 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.008 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.008 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.008 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.008 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.008 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.008 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.008 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.008 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.008 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.008 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.009 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.009 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.009 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.009 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.009 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.009 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.009 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.009 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.009 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.009 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.009 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.009 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.009 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.009 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.010 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.010 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.010 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.010 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.010 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.010 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.010 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.010 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.010 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.010 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.010 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.010 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.010 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.011 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.011 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.011 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.011 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.011 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.011 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.011 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.011 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "stats", 2024-08-26T00:14:47.011 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.011 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.011 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.011 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.011 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.011 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.012 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.012 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.012 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.012 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.012 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.012 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.012 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.012 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.012 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.012 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.012 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.012 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.012 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.012 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.013 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.013 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.013 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.013 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.013 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.013 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.013 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.013 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.013 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.013 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.013 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.013 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.013 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.014 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.014 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.014 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.014 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.014 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.014 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.014 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.014 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.014 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.014 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.014 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.014 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.014 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.015 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.015 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.015 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.015 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.015 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.015 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.015 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.015 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.015 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.015 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.015 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.015 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.015 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.015 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.016 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.016 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.016 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.016 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.016 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.016 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.016 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.016 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.016 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.016 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.016 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.016 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.016 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.016 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.017 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.017 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.017 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "status", 2024-08-26T00:14:47.017 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.017 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.017 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.017 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.017 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.017 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.017 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.017 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.017 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.017 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.017 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.017 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.018 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.018 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.018 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.018 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.018 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.018 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.018 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.018 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.018 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.018 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.018 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.018 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.018 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.018 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.019 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.019 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.019 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.019 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.019 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.019 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.019 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.019 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.019 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.019 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.019 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.019 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.019 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.019 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.020 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.020 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.020 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.020 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.020 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.020 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.020 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.020 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.020 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.020 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.020 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.020 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.020 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.020 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.021 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.021 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.021 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.021 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.021 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.021 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.021 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.021 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.021 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.021 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.021 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.021 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.021 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.021 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.022 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.022 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.022 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.022 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.022 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.022 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.022 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.022 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.022 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "telegraf", 2024-08-26T00:14:47.022 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.022 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.022 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.022 INFO:teuthology.orchestra.run.smithi042.stdout: "address": { 2024-08-26T00:14:47.022 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "address", 2024-08-26T00:14:47.023 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.023 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.023 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.023 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-26T00:14:47.023 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.023 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.023 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.023 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.023 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.023 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.023 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.023 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.024 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-08-26T00:14:47.024 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-08-26T00:14:47.024 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.024 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.024 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.024 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15", 2024-08-26T00:14:47.024 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.024 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.024 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.024 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.024 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.024 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.024 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.025 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.025 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.025 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.025 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.025 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.025 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.025 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.025 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.025 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.025 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.025 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.025 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.025 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.025 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.026 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.026 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.026 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.026 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.026 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.026 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.026 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.026 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.026 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.026 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.026 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.026 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.026 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.026 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.027 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.027 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.027 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.027 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.027 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.027 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.027 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.027 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.027 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.027 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.027 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.027 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.027 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.028 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.028 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.028 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.028 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.028 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.028 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.028 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.028 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.028 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.028 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.028 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.028 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.028 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.028 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.028 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.029 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.029 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.029 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.029 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.029 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.029 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.029 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.029 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.029 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.029 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.029 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.029 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.029 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.029 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.030 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.030 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.030 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.030 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.030 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "telemetry", 2024-08-26T00:14:47.030 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.030 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.030 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.030 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_basic": { 2024-08-26T00:14:47.030 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_basic", 2024-08-26T00:14:47.030 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.030 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.030 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.031 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.031 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.031 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.031 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.034 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-26T00:14:47.035 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.035 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.035 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.035 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_crash": { 2024-08-26T00:14:47.035 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_crash", 2024-08-26T00:14:47.035 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.035 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.035 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.035 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.035 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.035 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.035 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.036 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-26T00:14:47.036 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.036 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.036 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.036 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.036 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_device": { 2024-08-26T00:14:47.036 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_device", 2024-08-26T00:14:47.036 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.036 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.036 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.036 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.036 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.036 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.036 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.037 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-26T00:14:47.037 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.037 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.037 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.037 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.037 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_ident": { 2024-08-26T00:14:47.037 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_ident", 2024-08-26T00:14:47.037 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.037 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.037 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.037 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.037 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.037 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.037 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.038 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-26T00:14:47.038 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.038 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.038 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.038 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.038 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_perf": { 2024-08-26T00:14:47.038 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_perf", 2024-08-26T00:14:47.038 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.038 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.038 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.038 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.038 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.038 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.039 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.039 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-26T00:14:47.039 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.039 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.039 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.039 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.039 INFO:teuthology.orchestra.run.smithi042.stdout: "contact": { 2024-08-26T00:14:47.039 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "contact", 2024-08-26T00:14:47.039 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.039 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.039 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.039 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.039 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.039 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.039 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.040 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.040 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.040 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.040 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.040 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.040 INFO:teuthology.orchestra.run.smithi042.stdout: "description": { 2024-08-26T00:14:47.040 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "description", 2024-08-26T00:14:47.040 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.040 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.040 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.040 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.040 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.040 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.041 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.041 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.041 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.041 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.041 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.041 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.041 INFO:teuthology.orchestra.run.smithi042.stdout: "device_url": { 2024-08-26T00:14:47.041 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_url", 2024-08-26T00:14:47.041 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.041 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.041 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.041 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-26T00:14:47.041 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.042 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.042 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.042 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.042 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.042 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.042 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.042 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.042 INFO:teuthology.orchestra.run.smithi042.stdout: "enabled": { 2024-08-26T00:14:47.042 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enabled", 2024-08-26T00:14:47.042 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.042 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.042 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.042 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.043 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.043 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.043 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.043 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.043 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.043 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.043 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.043 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.043 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-08-26T00:14:47.043 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-08-26T00:14:47.043 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.043 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.043 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.044 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "24", 2024-08-26T00:14:47.044 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "8", 2024-08-26T00:14:47.044 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.044 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.044 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.044 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.044 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.044 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.044 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.044 INFO:teuthology.orchestra.run.smithi042.stdout: "last_opt_revision": { 2024-08-26T00:14:47.044 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "last_opt_revision", 2024-08-26T00:14:47.044 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.044 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.044 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.045 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1", 2024-08-26T00:14:47.045 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.045 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.045 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.045 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.045 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.045 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.045 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.045 INFO:teuthology.orchestra.run.smithi042.stdout: "leaderboard": { 2024-08-26T00:14:47.045 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "leaderboard", 2024-08-26T00:14:47.045 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.045 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.045 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.046 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.046 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.046 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.046 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.046 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.046 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.046 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.046 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.046 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.046 INFO:teuthology.orchestra.run.smithi042.stdout: "leaderboard_description": { 2024-08-26T00:14:47.046 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "leaderboard_description", 2024-08-26T00:14:47.046 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.047 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.047 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.047 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.047 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.047 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.047 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.047 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.047 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.047 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.047 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.047 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.047 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.047 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.047 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.048 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.048 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.048 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.048 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.048 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.048 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.048 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.048 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.048 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.048 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.048 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.048 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.048 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.048 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.049 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.049 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.049 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.049 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.049 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.049 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.049 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.049 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.049 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.049 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.049 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.049 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.049 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.050 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.050 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.050 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.050 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.050 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.050 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.050 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.050 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.050 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.050 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.050 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.050 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.050 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.051 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.051 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.051 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.051 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.051 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.051 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.051 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.051 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.051 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.051 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.051 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.051 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.051 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.051 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.052 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.052 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.052 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.052 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.052 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.052 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.052 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.052 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.052 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.052 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.052 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.052 INFO:teuthology.orchestra.run.smithi042.stdout: "organization": { 2024-08-26T00:14:47.052 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "organization", 2024-08-26T00:14:47.053 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.053 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.053 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.053 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.053 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.053 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.053 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.053 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.053 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.053 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.053 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.053 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.053 INFO:teuthology.orchestra.run.smithi042.stdout: "proxy": { 2024-08-26T00:14:47.053 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "proxy", 2024-08-26T00:14:47.053 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.054 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.054 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.054 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.054 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.054 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.054 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.054 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.054 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.054 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.054 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.054 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.054 INFO:teuthology.orchestra.run.smithi042.stdout: "url": { 2024-08-26T00:14:47.054 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "url", 2024-08-26T00:14:47.055 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.055 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.055 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.055 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-26T00:14:47.055 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.055 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.055 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.055 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.055 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.055 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.055 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.055 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.055 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.056 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.056 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.056 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "test_orchestrator", 2024-08-26T00:14:47.056 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.056 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.056 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.056 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.056 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.056 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.056 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.056 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.056 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.056 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.056 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.057 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.057 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.057 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.057 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.057 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.057 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.057 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.057 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.057 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.057 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.057 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.057 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.057 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.057 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.058 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.058 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.058 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.058 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.058 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.058 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.058 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.058 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.058 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.058 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.058 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.058 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.058 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.058 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.059 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.059 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.059 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.059 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.059 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.059 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.059 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.059 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.059 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.059 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.059 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.059 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.059 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.060 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.060 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.060 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.060 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.060 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.060 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.060 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.060 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.060 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.060 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.060 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.060 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.060 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.060 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.061 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.061 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.061 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.061 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.061 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.061 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.061 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.061 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.061 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.061 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.061 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "volumes", 2024-08-26T00:14:47.061 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.061 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.061 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.062 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.062 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.062 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.062 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.062 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.062 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.062 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.062 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.062 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.062 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.062 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.062 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.062 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.062 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.063 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.063 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.063 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.063 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.063 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.063 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.063 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.063 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.063 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.063 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.063 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.063 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.063 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.063 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.064 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.064 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.064 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.064 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.064 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.064 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.064 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.064 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.064 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.064 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.064 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.064 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.064 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.064 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.065 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.065 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.065 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.065 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.065 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.065 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.065 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.065 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.065 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.065 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.065 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.065 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.065 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.065 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.066 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.066 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.066 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.066 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.066 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.066 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.066 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.066 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.066 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.066 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.066 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.066 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.066 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.066 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.067 INFO:teuthology.orchestra.run.smithi042.stdout: "max_concurrent_clones": { 2024-08-26T00:14:47.067 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_concurrent_clones", 2024-08-26T00:14:47.067 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.067 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.067 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.067 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "4", 2024-08-26T00:14:47.067 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.067 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.067 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.067 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-26T00:14:47.067 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.067 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.067 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.067 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.068 INFO:teuthology.orchestra.run.smithi042.stdout: "periodic_async_work": { 2024-08-26T00:14:47.068 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "periodic_async_work", 2024-08-26T00:14:47.068 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.068 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.068 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.068 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.068 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.068 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.068 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.068 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Periodically check for async work", 2024-08-26T00:14:47.068 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.068 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.068 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.069 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.069 INFO:teuthology.orchestra.run.smithi042.stdout: "snapshot_clone_delay": { 2024-08-26T00:14:47.069 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snapshot_clone_delay", 2024-08-26T00:14:47.069 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.069 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.069 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.069 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-08-26T00:14:47.069 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.069 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.069 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.069 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-26T00:14:47.069 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.069 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.069 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.070 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.070 INFO:teuthology.orchestra.run.smithi042.stdout: "snapshot_clone_no_wait": { 2024-08-26T00:14:47.070 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snapshot_clone_no_wait", 2024-08-26T00:14:47.070 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.070 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.070 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.070 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.070 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.070 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.070 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.070 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-26T00:14:47.070 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.070 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.070 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.071 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.071 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.071 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.071 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.071 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix", 2024-08-26T00:14:47.071 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.071 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.071 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.071 INFO:teuthology.orchestra.run.smithi042.stdout: "discovery_interval": { 2024-08-26T00:14:47.071 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "discovery_interval", 2024-08-26T00:14:47.071 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-08-26T00:14:47.071 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.071 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.072 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "100", 2024-08-26T00:14:47.072 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.072 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.072 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.072 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.072 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.072 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.072 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.072 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.072 INFO:teuthology.orchestra.run.smithi042.stdout: "identifier": { 2024-08-26T00:14:47.072 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "identifier", 2024-08-26T00:14:47.072 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.072 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.072 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.073 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.073 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.073 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.073 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.073 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.073 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.073 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.073 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.073 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.073 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-08-26T00:14:47.073 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-08-26T00:14:47.073 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.073 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.073 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.074 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-08-26T00:14:47.074 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.074 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.074 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.074 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.074 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.074 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.074 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.074 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.074 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.074 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.074 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.074 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.075 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.075 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.075 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.075 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.075 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.075 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.075 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.075 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.075 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.075 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.075 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.075 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.075 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.075 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.076 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.076 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.076 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.076 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.076 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.076 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.076 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.076 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.076 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.076 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.076 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.076 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.076 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.077 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.077 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.077 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.077 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.077 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.077 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.077 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.077 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.077 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.077 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.077 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.077 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.077 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.077 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.078 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.078 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.078 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.078 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.078 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.078 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.078 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.078 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.078 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.078 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.078 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.078 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.078 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.078 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.079 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.079 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.079 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.079 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.079 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.079 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.079 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.079 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.079 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.079 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.079 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_host": { 2024-08-26T00:14:47.079 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_host", 2024-08-26T00:14:47.079 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.079 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.080 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.080 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.080 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.080 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.080 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.080 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.080 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.080 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.080 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.080 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.080 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_port": { 2024-08-26T00:14:47.080 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_port", 2024-08-26T00:14:47.080 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.080 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.081 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.081 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10051", 2024-08-26T00:14:47.081 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.081 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.081 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.081 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.081 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.081 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.081 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.081 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.081 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_sender": { 2024-08-26T00:14:47.081 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_sender", 2024-08-26T00:14:47.081 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.081 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.081 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.082 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-26T00:14:47.082 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.082 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.082 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.082 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.082 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.082 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.082 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.082 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.082 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.082 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.082 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-08-26T00:14:47.083 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.083 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.083 INFO:teuthology.orchestra.run.smithi042.stdout: "gid": 24113, 2024-08-26T00:14:47.083 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "y", 2024-08-26T00:14:47.083 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_features": 4540701547738038271, 2024-08-26T00:14:47.083 INFO:teuthology.orchestra.run.smithi042.stdout: "available_modules": [ 2024-08-26T00:14:47.083 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.083 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "alerts", 2024-08-26T00:14:47.083 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.083 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.083 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.083 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-08-26T00:14:47.083 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-08-26T00:14:47.084 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.084 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.084 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.084 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-08-26T00:14:47.084 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.084 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.084 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.084 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How frequently to reexamine health status", 2024-08-26T00:14:47.084 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.084 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.084 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.084 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.084 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.084 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.085 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.085 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.085 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.085 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.085 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.085 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.085 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.085 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.085 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.085 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.085 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.085 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.085 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.086 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.086 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.086 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.086 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.086 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.086 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.086 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.086 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.086 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.086 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.086 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.086 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.086 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.087 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.087 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.087 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.087 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.087 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.087 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.087 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.087 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.087 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.087 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.087 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.087 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.087 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.087 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.088 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.088 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.088 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.088 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.088 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.088 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.088 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.088 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.088 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.088 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.088 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.088 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.088 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.089 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.089 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.089 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.089 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.089 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.089 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.089 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.089 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.089 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.089 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.089 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.089 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.089 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.089 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.090 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.090 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_destination": { 2024-08-26T00:14:47.090 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_destination", 2024-08-26T00:14:47.090 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.090 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.090 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.090 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.090 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.090 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.090 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.090 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Email address to send alerts to", 2024-08-26T00:14:47.090 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.090 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.091 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.091 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.091 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_from_name": { 2024-08-26T00:14:47.091 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_from_name", 2024-08-26T00:14:47.091 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.091 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.091 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.091 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "Ceph", 2024-08-26T00:14:47.091 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.091 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.091 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.091 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Email From: name", 2024-08-26T00:14:47.091 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.091 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.092 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.092 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.092 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_host": { 2024-08-26T00:14:47.092 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_host", 2024-08-26T00:14:47.092 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.092 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.092 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.092 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.092 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.092 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.092 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.092 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP server", 2024-08-26T00:14:47.092 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.092 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.092 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.093 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.093 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_password": { 2024-08-26T00:14:47.093 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_password", 2024-08-26T00:14:47.093 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.093 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.093 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.093 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.093 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.093 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.093 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.093 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Password to authenticate with", 2024-08-26T00:14:47.093 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.093 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.093 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.094 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_port": { 2024-08-26T00:14:47.094 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_port", 2024-08-26T00:14:47.094 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.094 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.094 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.094 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "465", 2024-08-26T00:14:47.094 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.094 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.094 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.094 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP port", 2024-08-26T00:14:47.094 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.094 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.095 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.095 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_sender": { 2024-08-26T00:14:47.095 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_sender", 2024-08-26T00:14:47.095 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.095 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.095 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.095 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.095 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.095 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.095 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.095 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP envelope sender", 2024-08-26T00:14:47.095 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.095 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.096 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.096 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.096 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_ssl": { 2024-08-26T00:14:47.096 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_ssl", 2024-08-26T00:14:47.096 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.096 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.096 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.096 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.096 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.096 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.096 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.096 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-26T00:14:47.096 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.097 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.097 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.097 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_user": { 2024-08-26T00:14:47.097 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_user", 2024-08-26T00:14:47.097 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.097 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.097 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.097 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.097 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.097 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.097 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.097 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "User to authenticate as", 2024-08-26T00:14:47.097 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.098 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.098 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.098 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.098 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.098 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.098 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "balancer", 2024-08-26T00:14:47.098 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.098 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.098 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.098 INFO:teuthology.orchestra.run.smithi042.stdout: "active": { 2024-08-26T00:14:47.098 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "active", 2024-08-26T00:14:47.098 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.099 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.099 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.099 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.099 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.099 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.099 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.099 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "automatically balance PGs across cluster", 2024-08-26T00:14:47.099 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.099 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.099 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.099 INFO:teuthology.orchestra.run.smithi042.stdout: "begin_time": { 2024-08-26T00:14:47.099 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "begin_time", 2024-08-26T00:14:47.099 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.100 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.100 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.100 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0000", 2024-08-26T00:14:47.100 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.100 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.100 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.100 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "beginning time of day to automatically balance", 2024-08-26T00:14:47.100 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-26T00:14:47.100 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.100 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.100 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.100 INFO:teuthology.orchestra.run.smithi042.stdout: "begin_weekday": { 2024-08-26T00:14:47.100 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "begin_weekday", 2024-08-26T00:14:47.101 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-08-26T00:14:47.101 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.101 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.101 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-08-26T00:14:47.101 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0", 2024-08-26T00:14:47.101 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "6", 2024-08-26T00:14:47.101 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.101 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-26T00:14:47.101 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-26T00:14:47.101 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.101 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.101 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_max_iterations": { 2024-08-26T00:14:47.101 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_max_iterations", 2024-08-26T00:14:47.102 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-08-26T00:14:47.102 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.102 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.102 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "25", 2024-08-26T00:14:47.102 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-08-26T00:14:47.102 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "250", 2024-08-26T00:14:47.102 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.102 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-26T00:14:47.102 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.102 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.102 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.102 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.102 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_metrics": { 2024-08-26T00:14:47.103 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_metrics", 2024-08-26T00:14:47.103 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.103 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.103 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.103 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "pgs,objects,bytes", 2024-08-26T00:14:47.103 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.103 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.103 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.103 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-26T00:14:47.103 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-26T00:14:47.103 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.103 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.103 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_step": { 2024-08-26T00:14:47.104 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_step", 2024-08-26T00:14:47.104 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-08-26T00:14:47.104 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.104 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.104 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0.5", 2024-08-26T00:14:47.104 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0.001", 2024-08-26T00:14:47.104 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "0.999", 2024-08-26T00:14:47.104 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.104 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "aggressiveness of optimization", 2024-08-26T00:14:47.104 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-26T00:14:47.104 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.104 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.104 INFO:teuthology.orchestra.run.smithi042.stdout: "end_time": { 2024-08-26T00:14:47.105 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "end_time", 2024-08-26T00:14:47.105 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.105 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.105 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.105 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "2359", 2024-08-26T00:14:47.105 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.105 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.105 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.105 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "ending time of day to automatically balance", 2024-08-26T00:14:47.105 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-26T00:14:47.105 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.105 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.105 INFO:teuthology.orchestra.run.smithi042.stdout: "end_weekday": { 2024-08-26T00:14:47.106 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "end_weekday", 2024-08-26T00:14:47.106 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-08-26T00:14:47.106 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.106 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.106 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-08-26T00:14:47.106 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0", 2024-08-26T00:14:47.106 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "6", 2024-08-26T00:14:47.106 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.106 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-26T00:14:47.106 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-26T00:14:47.106 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.106 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.106 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.107 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.107 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.107 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.107 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.107 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.107 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.107 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.107 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.107 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.107 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.107 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.107 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.107 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.107 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.107 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.108 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.108 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.108 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.108 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.108 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.108 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.108 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.108 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.108 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.108 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.108 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.108 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.108 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.108 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.109 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.109 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.109 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.109 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.109 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.109 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.109 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.109 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.109 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.109 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.109 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.109 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.109 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.110 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.110 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.110 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.110 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.110 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.110 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.110 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.110 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.110 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.110 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.110 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.110 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.110 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.111 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.111 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.111 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.111 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.111 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.111 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.111 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.111 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.111 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.111 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.111 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.111 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.112 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.112 INFO:teuthology.orchestra.run.smithi042.stdout: "min_score": { 2024-08-26T00:14:47.112 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "min_score", 2024-08-26T00:14:47.112 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-08-26T00:14:47.112 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.112 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.112 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-08-26T00:14:47.112 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.112 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.112 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.112 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-26T00:14:47.112 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.112 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.113 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.113 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": { 2024-08-26T00:14:47.113 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mode", 2024-08-26T00:14:47.113 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.113 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.113 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.113 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "upmap", 2024-08-26T00:14:47.113 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.113 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.113 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.113 INFO:teuthology.orchestra.run.smithi042.stdout: "crush-compat", 2024-08-26T00:14:47.113 INFO:teuthology.orchestra.run.smithi042.stdout: "none", 2024-08-26T00:14:47.113 INFO:teuthology.orchestra.run.smithi042.stdout: "read", 2024-08-26T00:14:47.114 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap", 2024-08-26T00:14:47.114 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap-read" 2024-08-26T00:14:47.114 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.114 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Balancer mode", 2024-08-26T00:14:47.114 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.114 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.114 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.114 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_ids": { 2024-08-26T00:14:47.114 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pool_ids", 2024-08-26T00:14:47.114 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.114 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.114 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.114 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.115 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.115 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.115 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.115 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-26T00:14:47.115 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.115 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.115 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.115 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-08-26T00:14:47.115 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-08-26T00:14:47.115 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.115 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.115 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.116 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-08-26T00:14:47.116 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.116 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.116 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.116 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-26T00:14:47.116 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.116 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.116 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.116 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap_max_deviation": { 2024-08-26T00:14:47.116 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "upmap_max_deviation", 2024-08-26T00:14:47.116 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.116 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.116 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.117 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-08-26T00:14:47.117 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-08-26T00:14:47.117 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.117 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.117 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-26T00:14:47.117 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-26T00:14:47.117 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.117 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.117 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap_max_optimizations": { 2024-08-26T00:14:47.117 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "upmap_max_optimizations", 2024-08-26T00:14:47.117 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-08-26T00:14:47.117 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.117 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.118 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:47.118 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.118 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.118 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.118 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-26T00:14:47.118 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.118 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.118 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.118 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.118 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.118 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cephadm", 2024-08-26T00:14:47.118 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.119 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.119 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.119 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_down_multiplier": { 2024-08-26T00:14:47.119 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_down_multiplier", 2024-08-26T00:14:47.119 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-08-26T00:14:47.119 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.119 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.119 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3.0", 2024-08-26T00:14:47.119 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.119 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.119 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.119 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-26T00:14:47.119 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.120 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.120 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.120 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_refresh_rate": { 2024-08-26T00:14:47.120 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_refresh_rate", 2024-08-26T00:14:47.120 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.120 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.120 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.120 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "20", 2024-08-26T00:14:47.120 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.120 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.120 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.120 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-26T00:14:47.120 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.120 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.121 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.121 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_starting_port": { 2024-08-26T00:14:47.121 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_starting_port", 2024-08-26T00:14:47.121 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.121 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.121 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.121 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "4721", 2024-08-26T00:14:47.121 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.121 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.121 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.121 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-26T00:14:47.121 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.122 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.122 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.122 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_ptrace": { 2024-08-26T00:14:47.122 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_ptrace", 2024-08-26T00:14:47.122 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.122 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.122 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.122 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.122 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.122 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.122 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.122 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-26T00:14:47.123 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-26T00:14:47.123 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.123 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.123 INFO:teuthology.orchestra.run.smithi042.stdout: "autotune_interval": { 2024-08-26T00:14:47.123 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "autotune_interval", 2024-08-26T00:14:47.123 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.123 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.123 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.123 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-08-26T00:14:47.123 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.123 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.123 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.124 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-26T00:14:47.124 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.124 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.124 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.124 INFO:teuthology.orchestra.run.smithi042.stdout: "autotune_memory_target_ratio": { 2024-08-26T00:14:47.124 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "autotune_memory_target_ratio", 2024-08-26T00:14:47.124 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-08-26T00:14:47.124 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.124 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.124 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0.7", 2024-08-26T00:14:47.124 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.124 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.124 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.125 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-26T00:14:47.125 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.125 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.125 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.125 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm_log_destination": { 2024-08-26T00:14:47.125 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cephadm_log_destination", 2024-08-26T00:14:47.125 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.125 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.125 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.125 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.125 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.125 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.125 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.126 INFO:teuthology.orchestra.run.smithi042.stdout: "file", 2024-08-26T00:14:47.126 INFO:teuthology.orchestra.run.smithi042.stdout: "file,syslog", 2024-08-26T00:14:47.126 INFO:teuthology.orchestra.run.smithi042.stdout: "syslog" 2024-08-26T00:14:47.126 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.126 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-26T00:14:47.126 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.126 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.126 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.126 INFO:teuthology.orchestra.run.smithi042.stdout: "cgroups_split": { 2024-08-26T00:14:47.126 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cgroups_split", 2024-08-26T00:14:47.126 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.126 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.127 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.127 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.127 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.127 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.127 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.127 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-26T00:14:47.127 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.127 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.127 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.127 INFO:teuthology.orchestra.run.smithi042.stdout: "config_checks_enabled": { 2024-08-26T00:14:47.127 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_checks_enabled", 2024-08-26T00:14:47.127 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.127 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.128 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.128 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.128 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.128 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.128 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.128 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-26T00:14:47.128 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.128 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.128 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.128 INFO:teuthology.orchestra.run.smithi042.stdout: "config_dashboard": { 2024-08-26T00:14:47.128 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_dashboard", 2024-08-26T00:14:47.128 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.128 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.129 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.129 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.129 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.129 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.129 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.129 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-26T00:14:47.129 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.129 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.129 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.129 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_alertmanager": { 2024-08-26T00:14:47.129 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_alertmanager", 2024-08-26T00:14:47.129 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.130 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.130 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.130 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-08-26T00:14:47.130 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.130 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.130 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.130 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-08-26T00:14:47.130 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.130 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.130 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.130 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_base": { 2024-08-26T00:14:47.130 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_base", 2024-08-26T00:14:47.130 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.131 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.131 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.131 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-26T00:14:47.131 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.131 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.131 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.131 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Container image name, without the tag", 2024-08-26T00:14:47.131 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.131 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.131 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.131 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_elasticsearch": { 2024-08-26T00:14:47.131 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_elasticsearch", 2024-08-26T00:14:47.131 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.132 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.132 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.132 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-26T00:14:47.132 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.132 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.132 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.132 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "elasticsearch container image", 2024-08-26T00:14:47.132 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.132 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.132 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.132 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_grafana": { 2024-08-26T00:14:47.132 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_grafana", 2024-08-26T00:14:47.132 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.133 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.133 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.133 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-08-26T00:14:47.133 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.133 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.133 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.133 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-08-26T00:14:47.133 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.133 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.133 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.133 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_haproxy": { 2024-08-26T00:14:47.133 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_haproxy", 2024-08-26T00:14:47.133 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.134 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.134 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.134 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-26T00:14:47.134 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.134 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.134 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.134 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "HAproxy container image", 2024-08-26T00:14:47.134 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.134 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.134 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.134 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_agent": { 2024-08-26T00:14:47.134 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_agent", 2024-08-26T00:14:47.134 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.135 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.135 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.135 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-26T00:14:47.135 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.135 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.135 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.135 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger agent container image", 2024-08-26T00:14:47.135 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.135 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.135 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.135 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_collector": { 2024-08-26T00:14:47.136 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_collector", 2024-08-26T00:14:47.136 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.136 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.136 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.136 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-26T00:14:47.136 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.136 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.136 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.136 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger collector container image", 2024-08-26T00:14:47.136 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.136 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.136 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.136 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_query": { 2024-08-26T00:14:47.137 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_query", 2024-08-26T00:14:47.137 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.137 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.137 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.137 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-26T00:14:47.137 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.137 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.137 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.137 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger query container image", 2024-08-26T00:14:47.137 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.137 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.137 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.137 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_keepalived": { 2024-08-26T00:14:47.138 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_keepalived", 2024-08-26T00:14:47.138 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.138 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.138 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.138 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-26T00:14:47.138 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.138 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.138 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.138 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Keepalived container image", 2024-08-26T00:14:47.138 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.138 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.138 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.139 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_loki": { 2024-08-26T00:14:47.139 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_loki", 2024-08-26T00:14:47.139 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.139 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.139 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.139 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-26T00:14:47.139 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.139 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.139 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.139 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Loki container image", 2024-08-26T00:14:47.139 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.139 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.139 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.140 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_node_exporter": { 2024-08-26T00:14:47.140 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_node_exporter", 2024-08-26T00:14:47.140 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.140 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.140 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.140 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-08-26T00:14:47.140 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.140 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.140 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.140 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-08-26T00:14:47.140 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.140 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.140 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.141 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_nvmeof": { 2024-08-26T00:14:47.141 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_nvmeof", 2024-08-26T00:14:47.141 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.141 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.141 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.141 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-08-26T00:14:47.141 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.141 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.141 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.141 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Nvme-of container image", 2024-08-26T00:14:47.141 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.141 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.141 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.142 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_prometheus": { 2024-08-26T00:14:47.142 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_prometheus", 2024-08-26T00:14:47.142 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.142 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.142 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.142 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-08-26T00:14:47.142 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.142 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.142 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.142 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-08-26T00:14:47.142 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.142 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.142 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.143 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_promtail": { 2024-08-26T00:14:47.143 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_promtail", 2024-08-26T00:14:47.143 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.143 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.143 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.143 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-26T00:14:47.143 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.143 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.143 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.143 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Promtail container image", 2024-08-26T00:14:47.143 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.143 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.143 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.144 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.144 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_samba": { 2024-08-26T00:14:47.144 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_samba", 2024-08-26T00:14:47.144 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.144 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.144 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.144 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-26T00:14:47.144 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.144 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.144 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.144 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Samba/SMB container image", 2024-08-26T00:14:47.144 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.144 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.144 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.145 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_snmp_gateway": { 2024-08-26T00:14:47.145 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_snmp_gateway", 2024-08-26T00:14:47.145 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.145 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.145 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.145 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-26T00:14:47.145 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.145 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.145 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.145 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SNMP Gateway container image", 2024-08-26T00:14:47.145 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.145 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.145 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.146 INFO:teuthology.orchestra.run.smithi042.stdout: "container_init": { 2024-08-26T00:14:47.146 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_init", 2024-08-26T00:14:47.146 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.146 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.146 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.146 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.146 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.146 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.146 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.146 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Run podman/docker with `--init`", 2024-08-26T00:14:47.146 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.146 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.146 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.147 INFO:teuthology.orchestra.run.smithi042.stdout: "daemon_cache_timeout": { 2024-08-26T00:14:47.147 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "daemon_cache_timeout", 2024-08-26T00:14:47.147 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.147 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.147 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.147 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-08-26T00:14:47.147 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.147 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.147 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.147 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-26T00:14:47.147 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.147 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.148 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.148 INFO:teuthology.orchestra.run.smithi042.stdout: "default_cephadm_command_timeout": { 2024-08-26T00:14:47.148 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "default_cephadm_command_timeout", 2024-08-26T00:14:47.148 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.148 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.148 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.148 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "900", 2024-08-26T00:14:47.148 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.148 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.148 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.148 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-26T00:14:47.148 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.148 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.149 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.149 INFO:teuthology.orchestra.run.smithi042.stdout: "default_registry": { 2024-08-26T00:14:47.149 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "default_registry", 2024-08-26T00:14:47.149 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.149 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.149 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.149 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io", 2024-08-26T00:14:47.149 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.149 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.149 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.149 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-26T00:14:47.149 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.149 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.150 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.150 INFO:teuthology.orchestra.run.smithi042.stdout: "device_cache_timeout": { 2024-08-26T00:14:47.150 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_cache_timeout", 2024-08-26T00:14:47.150 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.150 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.150 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.150 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1800", 2024-08-26T00:14:47.150 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.150 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.150 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.150 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache device inventory", 2024-08-26T00:14:47.150 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.151 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.151 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.151 INFO:teuthology.orchestra.run.smithi042.stdout: "device_enhanced_scan": { 2024-08-26T00:14:47.151 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_enhanced_scan", 2024-08-26T00:14:47.151 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.151 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.151 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.151 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.151 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.151 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.151 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.151 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-26T00:14:47.151 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.152 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.152 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.152 INFO:teuthology.orchestra.run.smithi042.stdout: "facts_cache_timeout": { 2024-08-26T00:14:47.152 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "facts_cache_timeout", 2024-08-26T00:14:47.152 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.152 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.152 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.152 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-08-26T00:14:47.152 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.152 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.152 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.152 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache host facts data", 2024-08-26T00:14:47.153 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.153 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.153 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.153 INFO:teuthology.orchestra.run.smithi042.stdout: "grafana_dashboards_path": { 2024-08-26T00:14:47.153 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "grafana_dashboards_path", 2024-08-26T00:14:47.153 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.153 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.153 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.153 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-26T00:14:47.153 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.153 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.153 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.153 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-26T00:14:47.154 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.154 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.154 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.154 INFO:teuthology.orchestra.run.smithi042.stdout: "host_check_interval": { 2024-08-26T00:14:47.154 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "host_check_interval", 2024-08-26T00:14:47.154 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.154 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.154 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.154 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-08-26T00:14:47.154 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.154 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.154 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.154 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to perform a host check", 2024-08-26T00:14:47.155 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.155 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.155 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.155 INFO:teuthology.orchestra.run.smithi042.stdout: "hw_monitoring": { 2024-08-26T00:14:47.155 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "hw_monitoring", 2024-08-26T00:14:47.155 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.155 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.155 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.155 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.155 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.155 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.155 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.155 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-26T00:14:47.156 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.156 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.156 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.156 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.156 INFO:teuthology.orchestra.run.smithi042.stdout: "inventory_list_all": { 2024-08-26T00:14:47.156 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "inventory_list_all", 2024-08-26T00:14:47.156 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.156 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.156 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.156 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.156 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.156 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.156 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.156 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-26T00:14:47.157 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.157 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.157 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.157 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.157 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.157 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.157 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.157 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.157 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.157 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.157 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.157 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.157 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.157 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.158 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.158 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.158 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.158 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.158 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.158 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.158 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.158 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.158 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.158 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.158 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.158 INFO:teuthology.orchestra.run.smithi042.stdout: "log_refresh_metadata": { 2024-08-26T00:14:47.158 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_refresh_metadata", 2024-08-26T00:14:47.159 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.159 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.159 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.159 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.159 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.159 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.159 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.159 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-26T00:14:47.159 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.159 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.159 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.159 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.160 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.160 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.160 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.160 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.160 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.160 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.160 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.160 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.160 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-26T00:14:47.160 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.160 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.160 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.160 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.161 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.161 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.161 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.161 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.161 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.161 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.161 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.161 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.161 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.161 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.161 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.161 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.161 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.161 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.162 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.162 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.162 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.162 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.162 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.162 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.162 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.162 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.162 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.162 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.162 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.162 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.162 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.163 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.163 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.163 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.163 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.163 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.163 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.163 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.163 INFO:teuthology.orchestra.run.smithi042.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-26T00:14:47.163 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-26T00:14:47.163 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.163 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.163 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.163 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.163 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.164 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.164 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.164 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-26T00:14:47.164 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.164 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.164 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.164 INFO:teuthology.orchestra.run.smithi042.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-26T00:14:47.164 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-26T00:14:47.164 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.164 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.164 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.164 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "*", 2024-08-26T00:14:47.164 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.165 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.165 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.165 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-26T00:14:47.165 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.165 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.165 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.165 INFO:teuthology.orchestra.run.smithi042.stdout: "max_count_per_host": { 2024-08-26T00:14:47.165 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_count_per_host", 2024-08-26T00:14:47.165 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.165 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.165 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.165 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:47.165 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.166 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.166 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.166 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "max number of daemons per service per host", 2024-08-26T00:14:47.166 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.166 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.166 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.166 INFO:teuthology.orchestra.run.smithi042.stdout: "max_osd_draining_count": { 2024-08-26T00:14:47.166 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_osd_draining_count", 2024-08-26T00:14:47.166 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.166 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.166 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.166 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:47.166 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.167 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.167 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.167 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-26T00:14:47.167 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.167 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.167 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.167 INFO:teuthology.orchestra.run.smithi042.stdout: "migration_current": { 2024-08-26T00:14:47.167 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "migration_current", 2024-08-26T00:14:47.167 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.167 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.167 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.167 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.167 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.168 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.168 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.168 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "internal - do not modify", 2024-08-26T00:14:47.168 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.168 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.168 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.168 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.168 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": { 2024-08-26T00:14:47.168 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mode", 2024-08-26T00:14:47.168 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.168 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.168 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.168 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "root", 2024-08-26T00:14:47.168 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.169 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.169 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.169 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm-package", 2024-08-26T00:14:47.169 INFO:teuthology.orchestra.run.smithi042.stdout: "root" 2024-08-26T00:14:47.169 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.169 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "mode for remote execution of cephadm", 2024-08-26T00:14:47.169 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.169 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.169 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.169 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.169 INFO:teuthology.orchestra.run.smithi042.stdout: "oob_default_addr": { 2024-08-26T00:14:47.169 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "oob_default_addr", 2024-08-26T00:14:47.169 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.169 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.170 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.170 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "169.254.1.1", 2024-08-26T00:14:47.170 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.170 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.170 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.170 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-26T00:14:47.170 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.170 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.170 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.170 INFO:teuthology.orchestra.run.smithi042.stdout: "prometheus_alerts_path": { 2024-08-26T00:14:47.170 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prometheus_alerts_path", 2024-08-26T00:14:47.170 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.170 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.171 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.171 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-26T00:14:47.171 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.171 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.171 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.171 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-26T00:14:47.171 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.171 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.171 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.171 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_insecure": { 2024-08-26T00:14:47.171 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_insecure", 2024-08-26T00:14:47.171 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.171 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.172 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.172 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.172 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.172 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.172 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.172 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-26T00:14:47.172 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.172 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.172 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.172 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_password": { 2024-08-26T00:14:47.172 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_password", 2024-08-26T00:14:47.172 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.173 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.173 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.173 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.173 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.173 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.173 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.173 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-26T00:14:47.173 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.173 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.173 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.173 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_url": { 2024-08-26T00:14:47.173 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_url", 2024-08-26T00:14:47.173 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.174 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.174 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.174 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.174 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.174 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.174 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.174 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-26T00:14:47.174 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.174 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.174 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.174 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.174 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_username": { 2024-08-26T00:14:47.174 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_username", 2024-08-26T00:14:47.175 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.175 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.175 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.175 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.175 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.175 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.175 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.175 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-26T00:14:47.175 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.175 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.175 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.175 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.175 INFO:teuthology.orchestra.run.smithi042.stdout: "secure_monitoring_stack": { 2024-08-26T00:14:47.175 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "secure_monitoring_stack", 2024-08-26T00:14:47.176 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.176 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.176 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.176 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.176 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.176 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.176 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.176 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-26T00:14:47.176 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.176 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.176 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.176 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.176 INFO:teuthology.orchestra.run.smithi042.stdout: "service_discovery_port": { 2024-08-26T00:14:47.176 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "service_discovery_port", 2024-08-26T00:14:47.177 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.177 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.177 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.177 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8765", 2024-08-26T00:14:47.177 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.177 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.177 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.177 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "cephadm service discovery port", 2024-08-26T00:14:47.177 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.177 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.177 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.177 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.177 INFO:teuthology.orchestra.run.smithi042.stdout: "ssh_config_file": { 2024-08-26T00:14:47.177 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssh_config_file", 2024-08-26T00:14:47.178 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.178 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.178 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.178 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.178 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.178 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.178 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.178 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-26T00:14:47.178 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.178 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.178 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.178 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.178 INFO:teuthology.orchestra.run.smithi042.stdout: "use_agent": { 2024-08-26T00:14:47.179 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "use_agent", 2024-08-26T00:14:47.179 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.179 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.179 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.179 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.179 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.179 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.179 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.179 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-26T00:14:47.179 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.179 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.179 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.179 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.179 INFO:teuthology.orchestra.run.smithi042.stdout: "use_repo_digest": { 2024-08-26T00:14:47.180 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "use_repo_digest", 2024-08-26T00:14:47.180 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.180 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.180 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.180 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.180 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.180 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.180 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.180 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-26T00:14:47.180 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.180 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.180 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.180 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.180 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_failed_host_check": { 2024-08-26T00:14:47.181 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_failed_host_check", 2024-08-26T00:14:47.181 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.181 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.181 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.181 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.181 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.181 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.181 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.181 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if the host check fails", 2024-08-26T00:14:47.181 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.181 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.181 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.181 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.181 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_stray_daemons": { 2024-08-26T00:14:47.182 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_stray_daemons", 2024-08-26T00:14:47.182 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.182 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.182 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.182 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.182 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.182 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.182 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.182 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-26T00:14:47.182 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.182 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.182 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.182 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.182 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_stray_hosts": { 2024-08-26T00:14:47.183 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_stray_hosts", 2024-08-26T00:14:47.183 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.183 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.183 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.183 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.183 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.183 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.183 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.183 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-26T00:14:47.183 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.183 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.183 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.183 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.183 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.184 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.184 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.184 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crash", 2024-08-26T00:14:47.184 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.184 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.184 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.184 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.184 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.184 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.184 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.184 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.184 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.184 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.184 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.185 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.185 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.185 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.185 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.185 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.185 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.185 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.185 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.185 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.185 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.185 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.185 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.185 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.186 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.186 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.186 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.186 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.186 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.186 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.186 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.186 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.186 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.186 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.186 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.186 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.186 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.186 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.187 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.187 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.187 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.187 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.187 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.187 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.187 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.187 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.187 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.187 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.187 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.187 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.187 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.188 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.188 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.188 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.188 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.188 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.188 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.188 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.188 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.188 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.188 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.188 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.188 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.188 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.188 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.189 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.189 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.189 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.189 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.189 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.189 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.189 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.189 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.189 INFO:teuthology.orchestra.run.smithi042.stdout: "retain_interval": { 2024-08-26T00:14:47.189 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "retain_interval", 2024-08-26T00:14:47.189 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.189 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.189 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.190 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "31536000", 2024-08-26T00:14:47.190 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.190 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.190 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.190 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-26T00:14:47.190 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.190 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.190 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.190 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.190 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_recent_interval": { 2024-08-26T00:14:47.190 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_recent_interval", 2024-08-26T00:14:47.190 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.190 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.191 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.191 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1209600", 2024-08-26T00:14:47.191 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.191 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.191 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.191 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-26T00:14:47.191 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.191 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.191 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.191 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.191 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.191 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.191 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.191 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "dashboard", 2024-08-26T00:14:47.192 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.192 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.192 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.192 INFO:teuthology.orchestra.run.smithi042.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-26T00:14:47.192 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-26T00:14:47.192 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.192 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.192 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.192 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:47.192 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.192 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.192 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.192 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.192 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.193 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.193 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.193 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.193 INFO:teuthology.orchestra.run.smithi042.stdout: "ALERTMANAGER_API_HOST": { 2024-08-26T00:14:47.193 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-26T00:14:47.193 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.193 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.193 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.193 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.193 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.193 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.193 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.193 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.193 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.194 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.194 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.194 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.194 INFO:teuthology.orchestra.run.smithi042.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-26T00:14:47.194 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-26T00:14:47.194 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.194 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.194 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.194 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.194 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.194 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.194 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.194 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.195 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.195 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.195 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.195 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.195 INFO:teuthology.orchestra.run.smithi042.stdout: "AUDIT_API_ENABLED": { 2024-08-26T00:14:47.195 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "AUDIT_API_ENABLED", 2024-08-26T00:14:47.195 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.195 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.195 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.195 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.195 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.195 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.195 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.195 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.196 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.196 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.196 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.196 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.196 INFO:teuthology.orchestra.run.smithi042.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-26T00:14:47.196 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-26T00:14:47.196 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.196 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.196 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.196 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.196 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.196 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.196 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.196 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.197 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.197 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.197 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.197 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.197 INFO:teuthology.orchestra.run.smithi042.stdout: "ENABLE_BROWSABLE_API": { 2024-08-26T00:14:47.197 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-26T00:14:47.197 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.197 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.197 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.197 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.197 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.197 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.197 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.197 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.198 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.198 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.198 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.198 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.198 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-26T00:14:47.198 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-26T00:14:47.198 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.198 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.198 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.198 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.198 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.198 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.198 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.199 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.199 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.199 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.199 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.199 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.199 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-26T00:14:47.199 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-26T00:14:47.199 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.199 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.199 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.199 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.199 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.199 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.199 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.200 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.200 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.200 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.200 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.200 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.200 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-26T00:14:47.200 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-26T00:14:47.200 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.200 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.200 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.200 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.200 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.200 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.201 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.201 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.201 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.201 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.201 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.201 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.201 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-26T00:14:47.201 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-26T00:14:47.201 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.201 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.201 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.201 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.201 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.201 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.202 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.202 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.202 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.202 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.202 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.202 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.202 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-26T00:14:47.202 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-26T00:14:47.202 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.202 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.202 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.202 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.202 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.202 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.203 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.203 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.203 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.203 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.203 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.203 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.203 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-26T00:14:47.203 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-26T00:14:47.203 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.203 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.203 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.203 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.203 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.203 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.204 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.204 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.204 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.204 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.204 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.204 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.204 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-26T00:14:47.204 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-26T00:14:47.204 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.204 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.204 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.204 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.204 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.204 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.205 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.205 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.205 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.205 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.205 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.205 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.205 INFO:teuthology.orchestra.run.smithi042.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-26T00:14:47.205 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-26T00:14:47.205 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.205 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.205 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.205 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.205 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.205 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_PASSWORD": { 2024-08-26T00:14:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-26T00:14:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-08-26T00:14:47.206 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.207 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.207 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.207 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.207 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.207 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.207 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.207 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.207 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-26T00:14:47.207 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-26T00:14:47.207 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.207 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.207 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.207 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.207 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.208 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.208 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.208 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.208 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.208 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.208 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.208 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.208 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_URL": { 2024-08-26T00:14:47.208 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_URL", 2024-08-26T00:14:47.208 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.208 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.208 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.208 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.208 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.208 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.209 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.209 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.209 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.209 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.209 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.209 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.209 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_USERNAME": { 2024-08-26T00:14:47.209 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-26T00:14:47.209 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.209 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.209 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.209 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-08-26T00:14:47.209 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.209 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.210 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.210 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.210 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.210 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.210 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.210 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.210 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-26T00:14:47.210 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-26T00:14:47.210 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.210 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.210 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.210 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.210 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.210 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.211 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.211 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.211 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.211 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.211 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.211 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.211 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-26T00:14:47.211 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-26T00:14:47.211 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.211 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.211 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.211 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.211 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.211 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.212 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.212 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.212 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.212 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.212 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.212 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.212 INFO:teuthology.orchestra.run.smithi042.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-26T00:14:47.212 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-26T00:14:47.212 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.212 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.212 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.212 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.212 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.213 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.213 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.213 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.213 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.213 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.213 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.213 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.213 INFO:teuthology.orchestra.run.smithi042.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-26T00:14:47.213 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-26T00:14:47.213 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.213 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.213 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.213 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.213 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.214 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.214 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.214 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.214 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.214 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.214 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.214 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.214 INFO:teuthology.orchestra.run.smithi042.stdout: "PROMETHEUS_API_HOST": { 2024-08-26T00:14:47.214 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-26T00:14:47.214 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.214 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.214 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.214 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.214 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.215 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.215 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.215 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.215 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.215 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.215 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.215 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.215 INFO:teuthology.orchestra.run.smithi042.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-26T00:14:47.215 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-26T00:14:47.215 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.215 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.215 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.215 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.216 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.216 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.216 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.216 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.216 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.216 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.216 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.216 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.216 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-26T00:14:47.216 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-26T00:14:47.216 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.216 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.216 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.216 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.217 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.217 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.217 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.217 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.217 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.217 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.217 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.217 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.217 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-26T00:14:47.217 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-26T00:14:47.217 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.217 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.217 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.217 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.218 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.218 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.218 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.218 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.218 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.218 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.218 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.218 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.218 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-26T00:14:47.218 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-26T00:14:47.218 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.218 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.218 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.218 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.219 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.219 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.219 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.219 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.219 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.219 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.219 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.219 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.219 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-26T00:14:47.219 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-26T00:14:47.219 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.219 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.219 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.219 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.220 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.220 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.220 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.220 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.220 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.220 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.220 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.220 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.220 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-26T00:14:47.220 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-26T00:14:47.220 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.220 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.220 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.220 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.221 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.221 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.221 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.221 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.221 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.221 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.221 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.221 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.221 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-26T00:14:47.221 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-26T00:14:47.221 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.221 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.221 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.221 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.221 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.222 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.222 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.222 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.222 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.222 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.222 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.222 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.222 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-26T00:14:47.222 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-26T00:14:47.222 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.222 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.222 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.222 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.222 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.223 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.223 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.223 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.223 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.223 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.223 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.223 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.223 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_ENABLED": { 2024-08-26T00:14:47.223 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-26T00:14:47.223 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.223 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.223 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.223 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.223 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.224 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.224 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.224 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.224 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.224 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.224 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.224 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.224 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-26T00:14:47.224 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-26T00:14:47.224 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.224 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.224 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.224 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-26T00:14:47.224 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.225 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.225 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.225 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.225 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.225 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.225 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.225 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.225 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-26T00:14:47.225 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-26T00:14:47.225 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.225 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.225 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.225 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:47.226 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.226 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.226 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.226 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.226 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.226 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.226 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.226 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.226 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-26T00:14:47.226 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-26T00:14:47.226 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.226 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.226 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.227 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8", 2024-08-26T00:14:47.227 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.227 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.227 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.227 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.227 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.227 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.227 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.227 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.227 INFO:teuthology.orchestra.run.smithi042.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-26T00:14:47.227 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-26T00:14:47.227 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.227 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.227 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.228 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "45", 2024-08-26T00:14:47.228 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.228 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.228 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.228 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.228 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.228 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.228 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.228 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.228 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_ACCESS_KEY": { 2024-08-26T00:14:47.228 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-26T00:14:47.228 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.228 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.228 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.229 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.229 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.229 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.229 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.229 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.229 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.229 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.229 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.229 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.229 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-26T00:14:47.229 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-26T00:14:47.229 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.229 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.229 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.230 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-08-26T00:14:47.230 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.230 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.230 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.230 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.230 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.230 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.230 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.230 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.230 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_SECRET_KEY": { 2024-08-26T00:14:47.230 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-26T00:14:47.230 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.230 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.231 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.231 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.231 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.231 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.231 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.231 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.231 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.231 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.231 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.231 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.231 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_SSL_VERIFY": { 2024-08-26T00:14:47.231 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-26T00:14:47.231 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.231 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.232 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.232 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.232 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.232 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.232 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.232 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.232 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.232 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.232 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.232 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.232 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-26T00:14:47.232 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-26T00:14:47.232 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.232 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.233 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.233 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-08-26T00:14:47.233 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.233 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.233 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.233 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.233 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.233 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.233 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.233 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.233 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-26T00:14:47.233 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-26T00:14:47.233 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.233 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.234 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.234 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:47.234 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.234 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.234 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.234 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.234 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.234 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.234 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.234 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.234 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-26T00:14:47.234 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-26T00:14:47.234 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.234 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.235 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.235 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-08-26T00:14:47.235 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.235 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.235 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.235 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.235 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.235 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.239 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.239 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.240 INFO:teuthology.orchestra.run.smithi042.stdout: "cross_origin_url": { 2024-08-26T00:14:47.240 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cross_origin_url", 2024-08-26T00:14:47.240 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.240 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.240 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.240 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.240 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.240 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.240 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.240 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.240 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.240 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.240 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.241 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.241 INFO:teuthology.orchestra.run.smithi042.stdout: "crt_file": { 2024-08-26T00:14:47.241 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crt_file", 2024-08-26T00:14:47.241 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.241 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.241 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.241 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.241 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.241 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.241 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.241 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.241 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.241 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.241 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.242 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.242 INFO:teuthology.orchestra.run.smithi042.stdout: "debug": { 2024-08-26T00:14:47.242 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "debug", 2024-08-26T00:14:47.242 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.242 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.242 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.242 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.242 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.242 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.242 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.242 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable/disable debug options", 2024-08-26T00:14:47.242 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.242 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.242 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.243 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.243 INFO:teuthology.orchestra.run.smithi042.stdout: "jwt_token_ttl": { 2024-08-26T00:14:47.243 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "jwt_token_ttl", 2024-08-26T00:14:47.243 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.243 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.243 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.243 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "28800", 2024-08-26T00:14:47.243 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.243 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.243 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.243 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.243 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.243 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.244 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.244 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.244 INFO:teuthology.orchestra.run.smithi042.stdout: "key_file": { 2024-08-26T00:14:47.244 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "key_file", 2024-08-26T00:14:47.244 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.244 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.244 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.244 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.244 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.244 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.244 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.244 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.244 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.244 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.245 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.245 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.245 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.245 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.245 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.245 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.245 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.245 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.245 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.245 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.245 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.245 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.245 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.246 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.246 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.246 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.246 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.246 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.246 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.246 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.246 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.246 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.246 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.246 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.246 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.246 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.246 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.247 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.247 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.247 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.247 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.247 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.247 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.247 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.247 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.247 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.247 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.247 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.247 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.247 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.247 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.248 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.248 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.248 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.248 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.248 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.248 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.248 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.248 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.248 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.248 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.248 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.248 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.248 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.248 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.249 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.249 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.249 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.249 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.249 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.249 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.249 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.249 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.249 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.249 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.249 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.249 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.249 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.249 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.250 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.250 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.250 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.250 INFO:teuthology.orchestra.run.smithi042.stdout: "motd": { 2024-08-26T00:14:47.250 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "motd", 2024-08-26T00:14:47.250 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.250 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.250 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.250 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.250 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.250 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.250 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.250 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "The message of the day", 2024-08-26T00:14:47.251 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.251 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.251 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.251 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.251 INFO:teuthology.orchestra.run.smithi042.stdout: "redirect_resolve_ip_addr": { 2024-08-26T00:14:47.251 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "redirect_resolve_ip_addr", 2024-08-26T00:14:47.251 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.251 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.251 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.251 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.251 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.251 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.251 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.251 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.252 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.252 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.252 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.252 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.252 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-08-26T00:14:47.252 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-08-26T00:14:47.252 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.252 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.252 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.252 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "::", 2024-08-26T00:14:47.252 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.252 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.252 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.252 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.252 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.253 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.253 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.253 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.253 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-08-26T00:14:47.253 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-08-26T00:14:47.253 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.253 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.253 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.253 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8080", 2024-08-26T00:14:47.253 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.253 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.253 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.253 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.253 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.254 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.254 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.254 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.254 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl": { 2024-08-26T00:14:47.254 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl", 2024-08-26T00:14:47.254 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.254 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.254 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.254 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.254 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.254 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.254 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.254 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.254 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.255 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.255 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.255 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.255 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl_server_port": { 2024-08-26T00:14:47.255 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl_server_port", 2024-08-26T00:14:47.255 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.255 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.255 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.255 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8443", 2024-08-26T00:14:47.255 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.255 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.255 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.255 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.255 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.256 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.256 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.256 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.256 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_behaviour": { 2024-08-26T00:14:47.256 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_behaviour", 2024-08-26T00:14:47.256 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.256 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.256 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.256 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "redirect", 2024-08-26T00:14:47.256 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.256 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.256 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.256 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.257 INFO:teuthology.orchestra.run.smithi042.stdout: "redirect" 2024-08-26T00:14:47.257 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.257 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.257 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.257 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.257 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.257 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.257 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_error_status_code": { 2024-08-26T00:14:47.257 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_error_status_code", 2024-08-26T00:14:47.257 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.257 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.257 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.257 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "500", 2024-08-26T00:14:47.258 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "400", 2024-08-26T00:14:47.258 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "599", 2024-08-26T00:14:47.258 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.258 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.258 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.258 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.258 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.258 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.258 INFO:teuthology.orchestra.run.smithi042.stdout: "url_prefix": { 2024-08-26T00:14:47.258 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "url_prefix", 2024-08-26T00:14:47.258 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.258 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.258 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.259 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.259 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.259 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.259 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.259 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.259 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.259 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.259 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.259 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.259 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.259 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.259 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.259 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "devicehealth", 2024-08-26T00:14:47.259 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.260 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.260 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.260 INFO:teuthology.orchestra.run.smithi042.stdout: "enable_monitoring": { 2024-08-26T00:14:47.260 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enable_monitoring", 2024-08-26T00:14:47.260 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.260 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.260 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.260 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.260 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.260 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.260 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.260 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "monitor device health metrics", 2024-08-26T00:14:47.261 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.261 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.261 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.261 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.261 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.261 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.261 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.261 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.261 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.261 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.261 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.261 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.261 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.262 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.262 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.262 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.262 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.262 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.262 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.262 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.262 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.262 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.262 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.262 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.262 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.262 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.263 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.263 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.263 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.263 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.263 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.263 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.263 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.263 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.263 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.263 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.263 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.263 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.263 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.263 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.264 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.264 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.264 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.264 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.264 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.264 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.264 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.264 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.264 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.264 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.264 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.264 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.264 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.265 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.265 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.265 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.265 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.265 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.265 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.265 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.265 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.265 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.265 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.265 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.265 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.265 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.265 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.266 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.266 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.266 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.266 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.266 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.266 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.266 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.266 INFO:teuthology.orchestra.run.smithi042.stdout: "mark_out_threshold": { 2024-08-26T00:14:47.266 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mark_out_threshold", 2024-08-26T00:14:47.266 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.266 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.266 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.266 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "2419200", 2024-08-26T00:14:47.266 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.267 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.267 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.267 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-26T00:14:47.267 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.267 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.267 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.267 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.267 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": { 2024-08-26T00:14:47.267 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pool_name", 2024-08-26T00:14:47.267 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.267 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.267 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.267 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "device_health_metrics", 2024-08-26T00:14:47.268 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.268 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.268 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.268 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-26T00:14:47.268 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.268 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.268 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.268 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.268 INFO:teuthology.orchestra.run.smithi042.stdout: "retention_period": { 2024-08-26T00:14:47.268 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "retention_period", 2024-08-26T00:14:47.268 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.268 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.268 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.268 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15552000", 2024-08-26T00:14:47.268 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.269 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.269 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.269 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long to retain device health metrics", 2024-08-26T00:14:47.269 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.269 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.269 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.269 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.269 INFO:teuthology.orchestra.run.smithi042.stdout: "scrape_frequency": { 2024-08-26T00:14:47.269 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "scrape_frequency", 2024-08-26T00:14:47.269 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.269 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.269 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.269 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "86400", 2024-08-26T00:14:47.270 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.270 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.270 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.270 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-26T00:14:47.270 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.270 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.270 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.270 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.270 INFO:teuthology.orchestra.run.smithi042.stdout: "self_heal": { 2024-08-26T00:14:47.270 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "self_heal", 2024-08-26T00:14:47.270 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.270 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.270 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.271 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.271 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.271 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.271 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.271 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-26T00:14:47.271 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.271 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.271 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.271 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-08-26T00:14:47.271 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-08-26T00:14:47.271 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.271 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.272 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.272 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-08-26T00:14:47.272 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.272 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.272 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.272 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to wake up and check device health", 2024-08-26T00:14:47.272 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.272 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.272 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.272 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.272 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_threshold": { 2024-08-26T00:14:47.272 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_threshold", 2024-08-26T00:14:47.272 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.272 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.273 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.273 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "7257600", 2024-08-26T00:14:47.273 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.273 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.273 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.273 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-26T00:14:47.273 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.273 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.273 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.273 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.273 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.273 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.273 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.274 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "diskprediction_local", 2024-08-26T00:14:47.274 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.274 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.274 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.274 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.274 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.274 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.274 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.274 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.274 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.274 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.274 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.274 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.275 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.275 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.275 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.275 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.275 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.275 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.275 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.275 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.275 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.275 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.275 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.275 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.275 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.276 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.276 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.276 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.276 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.276 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.276 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.276 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.276 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.276 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.276 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.276 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.276 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.276 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.276 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.276 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.277 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.277 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.277 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.277 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.277 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.277 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.277 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.277 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.277 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.277 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.277 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.277 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.277 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.278 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.278 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.278 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.278 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.278 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.278 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.278 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.278 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.278 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.278 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.278 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.278 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.278 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.278 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.279 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.279 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.279 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.279 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.279 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.279 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.279 INFO:teuthology.orchestra.run.smithi042.stdout: "predict_interval": { 2024-08-26T00:14:47.279 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "predict_interval", 2024-08-26T00:14:47.279 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.279 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.279 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.279 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "86400", 2024-08-26T00:14:47.279 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.279 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.279 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.280 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.280 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.280 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.280 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.280 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.280 INFO:teuthology.orchestra.run.smithi042.stdout: "predictor_model": { 2024-08-26T00:14:47.280 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "predictor_model", 2024-08-26T00:14:47.280 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.280 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.280 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.280 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "prophetstor", 2024-08-26T00:14:47.280 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.280 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.280 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.281 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.281 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.281 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.281 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.281 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.281 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-08-26T00:14:47.281 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-08-26T00:14:47.281 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.281 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.281 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.281 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-08-26T00:14:47.281 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.281 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.281 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.282 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.282 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.282 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.282 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.282 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.282 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.282 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.282 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.282 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "influx", 2024-08-26T00:14:47.282 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": false, 2024-08-26T00:14:47.282 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "influxdb python module not found", 2024-08-26T00:14:47.282 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.282 INFO:teuthology.orchestra.run.smithi042.stdout: "batch_size": { 2024-08-26T00:14:47.283 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "batch_size", 2024-08-26T00:14:47.283 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.283 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.283 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.283 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5000", 2024-08-26T00:14:47.283 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.283 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.283 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.283 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-26T00:14:47.283 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.283 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.283 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.283 INFO:teuthology.orchestra.run.smithi042.stdout: "database": { 2024-08-26T00:14:47.283 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "database", 2024-08-26T00:14:47.284 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.284 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.284 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.284 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "ceph", 2024-08-26T00:14:47.284 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.284 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.284 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.284 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-26T00:14:47.284 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.284 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.284 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.284 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.284 INFO:teuthology.orchestra.run.smithi042.stdout: "hostname": { 2024-08-26T00:14:47.285 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "hostname", 2024-08-26T00:14:47.285 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.285 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.285 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.285 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.285 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.285 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.285 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.285 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB server hostname", 2024-08-26T00:14:47.285 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.285 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.285 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.285 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.285 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-08-26T00:14:47.286 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-08-26T00:14:47.286 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.286 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.286 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.286 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "30", 2024-08-26T00:14:47.286 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "5", 2024-08-26T00:14:47.286 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.286 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.286 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-26T00:14:47.286 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.286 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.286 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.286 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.287 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.287 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.287 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.287 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.287 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.287 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.287 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.287 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.287 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.287 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.287 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.287 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.287 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.287 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.288 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.288 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.288 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.288 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.288 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.288 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.288 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.288 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.288 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.288 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.288 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.288 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.288 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.288 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.289 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.289 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.289 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.289 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.289 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.289 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.289 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.289 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.289 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.289 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.289 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.289 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.289 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.289 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.290 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.290 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.290 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.290 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.290 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.290 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.290 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.290 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.290 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.290 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.290 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.290 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.290 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.291 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.291 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.291 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.291 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.291 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.291 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.291 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.291 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.291 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.291 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.291 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.291 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.291 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.291 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.292 INFO:teuthology.orchestra.run.smithi042.stdout: "password": { 2024-08-26T00:14:47.292 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "password", 2024-08-26T00:14:47.292 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.292 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.292 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.292 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.292 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.292 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.292 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.292 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "password of InfluxDB server user", 2024-08-26T00:14:47.292 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.292 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.292 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.293 INFO:teuthology.orchestra.run.smithi042.stdout: "port": { 2024-08-26T00:14:47.293 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "port", 2024-08-26T00:14:47.293 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.293 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.293 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.293 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8086", 2024-08-26T00:14:47.293 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.293 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.293 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.293 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB server port", 2024-08-26T00:14:47.293 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.293 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.293 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.294 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl": { 2024-08-26T00:14:47.294 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl", 2024-08-26T00:14:47.294 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.294 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.294 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.294 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "false", 2024-08-26T00:14:47.294 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.294 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.294 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.294 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-26T00:14:47.294 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.294 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.294 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.295 INFO:teuthology.orchestra.run.smithi042.stdout: "threads": { 2024-08-26T00:14:47.295 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "threads", 2024-08-26T00:14:47.295 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.295 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.295 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.295 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-08-26T00:14:47.295 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-08-26T00:14:47.295 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "32", 2024-08-26T00:14:47.295 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.295 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-26T00:14:47.295 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.295 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.295 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.296 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.296 INFO:teuthology.orchestra.run.smithi042.stdout: "username": { 2024-08-26T00:14:47.296 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "username", 2024-08-26T00:14:47.296 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.296 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.296 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.296 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.296 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.296 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.296 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.296 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "username of InfluxDB server user", 2024-08-26T00:14:47.296 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.296 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.296 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.297 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.297 INFO:teuthology.orchestra.run.smithi042.stdout: "verify_ssl": { 2024-08-26T00:14:47.297 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "verify_ssl", 2024-08-26T00:14:47.297 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.297 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.297 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.297 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "true", 2024-08-26T00:14:47.297 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.297 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.297 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.297 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-26T00:14:47.297 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.297 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.298 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.298 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.298 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.298 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.298 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.298 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "insights", 2024-08-26T00:14:47.298 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.298 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.298 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.298 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.298 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.298 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.298 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.299 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.299 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.299 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.299 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.299 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.299 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.299 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.299 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.299 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.299 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.299 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.299 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.299 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.299 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.300 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.300 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.300 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.300 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.300 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.300 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.300 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.300 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.300 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.300 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.300 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.300 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.301 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.301 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.301 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.301 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.301 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.301 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.301 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.301 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.301 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.301 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.301 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.301 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.301 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.302 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.302 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.302 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.302 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.302 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.302 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.302 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.302 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.302 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.302 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.302 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.302 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.302 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.303 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.303 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.303 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.303 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.303 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.303 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.303 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.303 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.303 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.303 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.303 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.303 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.304 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.304 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "iostat", 2024-08-26T00:14:47.304 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.304 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.304 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.304 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.304 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.304 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.304 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.304 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.304 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.304 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.304 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.305 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.305 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.305 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.305 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.305 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.305 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.305 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.305 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.305 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.305 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.305 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.305 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.305 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.306 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.306 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.306 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.306 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.306 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.306 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.306 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.306 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.306 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.306 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.306 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.306 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.307 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.307 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.307 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.307 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.307 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.307 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.307 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.307 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.307 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.307 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.307 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.307 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.307 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.308 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.308 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.308 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.308 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.308 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.308 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.308 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.308 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.308 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.308 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.308 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.308 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.308 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.309 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.309 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.309 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.309 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.309 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.309 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.309 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.309 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.309 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.309 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "k8sevents", 2024-08-26T00:14:47.309 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.309 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.310 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.310 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_event_retention_days": { 2024-08-26T00:14:47.310 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ceph_event_retention_days", 2024-08-26T00:14:47.310 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.310 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.310 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.310 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "7", 2024-08-26T00:14:47.310 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.310 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.310 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.310 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-26T00:14:47.310 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.310 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.311 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.311 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.311 INFO:teuthology.orchestra.run.smithi042.stdout: "config_check_secs": { 2024-08-26T00:14:47.311 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_check_secs", 2024-08-26T00:14:47.311 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.311 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.311 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.311 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:47.311 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "10", 2024-08-26T00:14:47.311 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.311 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.311 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-26T00:14:47.311 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.311 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.312 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.312 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.312 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.312 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.312 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.312 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.312 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.312 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.312 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.312 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.312 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.312 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.313 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.313 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.313 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.313 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.313 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.313 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.313 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.313 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.313 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.313 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.313 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.313 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.313 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.314 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.314 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.314 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.314 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.314 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.314 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.314 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.314 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.314 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.314 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.314 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.314 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.314 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.315 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.315 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.315 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.315 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.315 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.315 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.315 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.315 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.315 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.315 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.315 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.315 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.315 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.316 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.316 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.316 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.316 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.316 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.316 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.316 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.316 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.316 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.316 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.316 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.316 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.316 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.316 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.317 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.317 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.317 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.317 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.317 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.317 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.317 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.317 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "localpool", 2024-08-26T00:14:47.317 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.317 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.317 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.317 INFO:teuthology.orchestra.run.smithi042.stdout: "failure_domain": { 2024-08-26T00:14:47.317 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "failure_domain", 2024-08-26T00:14:47.317 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.318 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.318 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.318 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "host", 2024-08-26T00:14:47.318 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.318 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.318 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.318 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "failure domain for any created local pool", 2024-08-26T00:14:47.318 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-26T00:14:47.318 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.318 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.318 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.318 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.318 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.319 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.319 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.319 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.319 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.319 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.319 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.319 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.319 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.319 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.319 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.319 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.319 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.319 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.319 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.320 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.320 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.320 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.320 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.320 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.320 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.320 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.320 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.320 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.320 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.320 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.320 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.320 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.321 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.321 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.321 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.321 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.321 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.321 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.321 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.321 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.321 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.321 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.321 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.321 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.322 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.322 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.322 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.322 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.322 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.322 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.322 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.322 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.322 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.322 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.322 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.322 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.322 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.322 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.323 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.323 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.323 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.323 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.323 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.323 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.323 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.323 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.323 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.323 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.323 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.323 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.323 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.324 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": { 2024-08-26T00:14:47.324 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "min_size", 2024-08-26T00:14:47.324 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.324 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.324 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.324 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.324 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.324 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.324 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.324 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default min_size for any created local pool", 2024-08-26T00:14:47.324 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-26T00:14:47.324 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.325 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.325 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.325 INFO:teuthology.orchestra.run.smithi042.stdout: "num_rep": { 2024-08-26T00:14:47.325 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "num_rep", 2024-08-26T00:14:47.325 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.325 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.325 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.325 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3", 2024-08-26T00:14:47.325 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.325 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.325 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.325 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default replica count for any created local pool", 2024-08-26T00:14:47.325 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.326 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.326 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.326 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": { 2024-08-26T00:14:47.326 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pg_num", 2024-08-26T00:14:47.326 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.326 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.326 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.326 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "128", 2024-08-26T00:14:47.326 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.326 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.327 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.327 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default pg_num for any created local pool", 2024-08-26T00:14:47.327 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.327 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.327 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.327 INFO:teuthology.orchestra.run.smithi042.stdout: "prefix": { 2024-08-26T00:14:47.327 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prefix", 2024-08-26T00:14:47.327 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.327 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.327 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.327 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.327 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.328 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.328 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.328 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "name prefix for any created local pool", 2024-08-26T00:14:47.328 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.328 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.328 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.328 INFO:teuthology.orchestra.run.smithi042.stdout: "subtree": { 2024-08-26T00:14:47.328 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "subtree", 2024-08-26T00:14:47.328 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.328 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.328 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.328 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "rack", 2024-08-26T00:14:47.329 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.329 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.329 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.329 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-26T00:14:47.329 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-26T00:14:47.329 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.329 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.329 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.329 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.329 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.329 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mds_autoscaler", 2024-08-26T00:14:47.329 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.329 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.330 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.330 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.330 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.330 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.330 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.330 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.330 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.330 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.330 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.330 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.330 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.330 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.330 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.330 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.331 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.331 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.331 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.331 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.331 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.331 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.331 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.331 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.331 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.331 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.331 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.331 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.331 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.332 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.332 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.332 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.332 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.332 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.332 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.332 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.332 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.332 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.332 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.332 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.332 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.332 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.333 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.333 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.333 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.333 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.333 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.333 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.333 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.333 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.333 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.333 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.333 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.333 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.333 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.333 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.334 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.334 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.334 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.334 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.334 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.334 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.334 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.334 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.334 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.334 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.334 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.334 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.334 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.334 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.335 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.335 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.335 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.335 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mirroring", 2024-08-26T00:14:47.335 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.335 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.335 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.335 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.335 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.335 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.335 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.335 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.335 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.336 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.336 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.336 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.336 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.336 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.336 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.336 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.336 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.336 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.336 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.336 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.336 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.336 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.336 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.337 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.337 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.337 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.337 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.337 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.337 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.337 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.337 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.337 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.337 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.337 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.337 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.337 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.338 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.338 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.338 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.338 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.338 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.338 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.338 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.338 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.338 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.338 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.338 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.338 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.338 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.339 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.339 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.339 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.339 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.339 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.339 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.339 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.339 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.339 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.339 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.339 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.339 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.339 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.340 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.340 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.340 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.340 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.340 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.340 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.340 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.340 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.340 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.340 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.340 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.340 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "nfs", 2024-08-26T00:14:47.341 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.341 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.341 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.341 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.341 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.341 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.341 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.341 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.341 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.341 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.341 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.341 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.341 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.342 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.342 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.342 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.342 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.342 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.342 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.342 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.342 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.342 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.342 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.342 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.343 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.343 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.343 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.343 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.343 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.343 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.343 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.343 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.343 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.343 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.343 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.343 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.343 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.344 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.344 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.344 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.344 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.344 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.344 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.344 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.344 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.344 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.344 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.344 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.344 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.344 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.344 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.345 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.345 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.345 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.345 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.345 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.345 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.345 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.345 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.345 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.345 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.345 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.345 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.346 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.346 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.346 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.346 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.346 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.346 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.346 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.346 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.346 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.346 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "orchestrator", 2024-08-26T00:14:47.346 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.346 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.347 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.347 INFO:teuthology.orchestra.run.smithi042.stdout: "fail_fs": { 2024-08-26T00:14:47.347 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "fail_fs", 2024-08-26T00:14:47.347 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.347 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.347 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.347 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.347 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.347 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.347 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.347 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-26T00:14:47.347 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.347 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.347 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.348 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.348 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.348 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.348 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.348 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.348 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.348 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.348 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.348 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.348 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.348 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.348 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.348 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.348 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.349 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.349 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.349 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.349 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.349 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.349 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.349 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.349 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.349 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.349 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.349 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.349 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.349 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.350 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.350 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.350 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.350 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.350 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.350 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.350 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.350 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.350 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.350 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.350 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.350 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.350 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.351 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.351 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.351 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.351 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.351 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.351 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.351 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.351 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.351 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.351 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.351 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.351 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.351 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.351 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.352 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.352 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.352 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.352 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.352 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.352 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.352 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.352 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.352 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.352 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.352 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.352 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.352 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.353 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.353 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.353 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator": { 2024-08-26T00:14:47.353 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "orchestrator", 2024-08-26T00:14:47.353 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.353 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.353 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.353 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.353 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.353 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.353 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.353 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm", 2024-08-26T00:14:47.353 INFO:teuthology.orchestra.run.smithi042.stdout: "rook", 2024-08-26T00:14:47.353 INFO:teuthology.orchestra.run.smithi042.stdout: "test_orchestrator" 2024-08-26T00:14:47.353 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.354 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Orchestrator backend", 2024-08-26T00:14:47.354 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.354 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.354 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.354 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.354 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.354 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.354 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.354 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "osd_perf_query", 2024-08-26T00:14:47.354 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.354 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.354 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.354 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.354 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.355 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.355 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.355 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.355 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.355 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.355 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.355 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.355 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.355 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.355 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.355 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.355 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.355 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.356 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.356 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.356 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.356 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.356 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.356 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.356 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.356 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.356 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.356 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.356 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.356 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.356 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.356 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.357 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.357 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.357 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.357 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.357 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.357 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.357 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.357 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.357 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.357 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.357 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.357 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.357 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.358 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.358 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.358 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.358 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.358 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.358 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.358 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.358 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.358 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.358 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.358 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.358 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.358 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.358 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.359 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.359 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.359 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.359 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.359 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.359 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.359 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.359 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.359 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.359 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.359 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.359 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.359 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.360 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.360 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.360 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.360 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.360 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "osd_support", 2024-08-26T00:14:47.360 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.360 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.360 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.360 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.360 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.360 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.360 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.360 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.360 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.361 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.361 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.361 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.361 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.361 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.361 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.361 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.361 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.361 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.361 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.361 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.361 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.361 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.362 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.362 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.362 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.362 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.362 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.362 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.362 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.362 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.362 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.362 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.362 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.362 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.362 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.362 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.363 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.363 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.363 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.363 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.363 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.363 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.363 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.363 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.363 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.363 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.363 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.363 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.363 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.363 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.364 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.364 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.364 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.364 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.364 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.364 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.364 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.364 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.364 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.364 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.364 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.364 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.364 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.365 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.365 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.365 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.365 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.365 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.365 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.365 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.365 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.365 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.365 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.365 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.365 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.365 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.365 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pg_autoscaler", 2024-08-26T00:14:47.366 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.366 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.366 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.366 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.366 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.366 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.366 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.366 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.366 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.366 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.366 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.366 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.366 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.367 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.367 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.367 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.367 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.367 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.367 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.367 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.367 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.367 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.367 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.367 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.368 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.368 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.368 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.368 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.368 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.368 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.368 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.368 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.368 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.368 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.368 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.368 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.368 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.368 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.369 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.369 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.369 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.369 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.369 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.369 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.369 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.369 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.369 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.369 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.369 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.369 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.369 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.369 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.369 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.370 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.370 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.370 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.370 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.370 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.370 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.370 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.370 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.370 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.370 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.370 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.370 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.371 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.371 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.371 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.371 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.371 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.371 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.371 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.371 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-08-26T00:14:47.371 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-08-26T00:14:47.371 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.371 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.371 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.371 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-08-26T00:14:47.372 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.372 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.372 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.372 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.372 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.372 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.372 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.372 INFO:teuthology.orchestra.run.smithi042.stdout: "threshold": { 2024-08-26T00:14:47.372 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "threshold", 2024-08-26T00:14:47.372 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-08-26T00:14:47.372 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.372 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.372 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3.0", 2024-08-26T00:14:47.373 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1.0", 2024-08-26T00:14:47.373 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.373 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.373 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "scaling threshold", 2024-08-26T00:14:47.373 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-26T00:14:47.373 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.373 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.373 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.373 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.373 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.373 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.373 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "progress", 2024-08-26T00:14:47.373 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.373 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.374 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.374 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_pg_recovery_event": { 2024-08-26T00:14:47.374 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_pg_recovery_event", 2024-08-26T00:14:47.374 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.374 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.374 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.374 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.374 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.374 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.374 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.374 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-26T00:14:47.374 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.374 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.374 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.375 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.375 INFO:teuthology.orchestra.run.smithi042.stdout: "enabled": { 2024-08-26T00:14:47.375 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enabled", 2024-08-26T00:14:47.375 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.375 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.375 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.375 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.375 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.375 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.375 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.375 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.375 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.375 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.376 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.376 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.376 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.376 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.376 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.376 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.376 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.376 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.376 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.376 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.376 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.376 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.376 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.376 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.377 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.377 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.377 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.377 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.377 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.377 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.377 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.377 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.377 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.377 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.377 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.377 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.377 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.377 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.378 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.378 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.378 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.378 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.378 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.378 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.378 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.378 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.378 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.378 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.378 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.378 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.378 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.378 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.379 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.379 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.379 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.379 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.379 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.379 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.379 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.379 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.379 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.379 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.379 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.379 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.379 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.379 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.380 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.380 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.380 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.380 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.380 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.380 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.380 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.380 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.380 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.380 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.380 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.380 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.380 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.380 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.381 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.381 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.381 INFO:teuthology.orchestra.run.smithi042.stdout: "max_completed_events": { 2024-08-26T00:14:47.381 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_completed_events", 2024-08-26T00:14:47.381 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.381 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.381 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.381 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "50", 2024-08-26T00:14:47.381 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.381 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.381 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.381 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "number of past completed events to remember", 2024-08-26T00:14:47.381 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.381 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.382 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.382 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.382 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-08-26T00:14:47.382 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-08-26T00:14:47.382 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.382 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.382 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.382 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-08-26T00:14:47.382 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.382 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.382 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.382 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long the module is going to sleep", 2024-08-26T00:14:47.382 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.382 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.383 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.383 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.383 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.383 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.383 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.383 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prometheus", 2024-08-26T00:14:47.383 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.383 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.383 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.383 INFO:teuthology.orchestra.run.smithi042.stdout: "cache": { 2024-08-26T00:14:47.383 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cache", 2024-08-26T00:14:47.383 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.383 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.384 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.384 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.384 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.384 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.384 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.384 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.384 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.384 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.384 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.384 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.384 INFO:teuthology.orchestra.run.smithi042.stdout: "exclude_perf_counters": { 2024-08-26T00:14:47.384 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "exclude_perf_counters", 2024-08-26T00:14:47.384 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.385 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.385 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.385 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.385 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.385 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.385 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.385 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-26T00:14:47.385 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-26T00:14:47.385 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.385 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.385 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.385 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.385 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.386 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.386 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.386 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.386 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.386 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.386 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.386 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.386 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.386 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.386 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.386 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.386 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.386 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.386 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.387 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.387 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.387 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.387 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.387 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.387 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.387 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.387 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.387 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.387 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.387 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.387 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.387 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.387 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.388 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.388 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.388 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.388 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.388 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.388 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.388 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.388 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.388 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.388 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.388 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.388 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.388 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.389 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.389 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.389 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.389 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.389 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.389 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.389 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.389 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.389 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.389 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.389 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.389 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.389 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.389 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.390 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.390 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.390 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.390 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.390 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.390 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.390 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.390 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.390 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.390 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.390 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.390 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.390 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.390 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_stats_pools": { 2024-08-26T00:14:47.391 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_stats_pools", 2024-08-26T00:14:47.391 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.391 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.391 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.391 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.391 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.391 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.391 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.391 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.391 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.391 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.391 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.391 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.392 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-26T00:14:47.392 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-26T00:14:47.392 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.392 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.392 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.392 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "300", 2024-08-26T00:14:47.392 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.392 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.392 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.392 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.392 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.392 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.392 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.392 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.393 INFO:teuthology.orchestra.run.smithi042.stdout: "scrape_interval": { 2024-08-26T00:14:47.393 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "scrape_interval", 2024-08-26T00:14:47.393 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-08-26T00:14:47.393 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.393 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.393 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15.0", 2024-08-26T00:14:47.393 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.393 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.393 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.393 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.393 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.393 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.393 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.394 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.394 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-08-26T00:14:47.394 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-08-26T00:14:47.394 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.394 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.394 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.394 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "::", 2024-08-26T00:14:47.394 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.394 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.394 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.394 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-26T00:14:47.394 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.394 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.395 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.395 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.395 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-08-26T00:14:47.395 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-08-26T00:14:47.395 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.395 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.395 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.395 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "9283", 2024-08-26T00:14:47.395 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.395 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.395 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.395 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-26T00:14:47.395 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.395 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.395 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.396 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.396 INFO:teuthology.orchestra.run.smithi042.stdout: "stale_cache_strategy": { 2024-08-26T00:14:47.396 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "stale_cache_strategy", 2024-08-26T00:14:47.396 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.396 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.396 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.396 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "log", 2024-08-26T00:14:47.396 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.396 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.396 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.396 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.396 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.396 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.396 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.397 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.397 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_behaviour": { 2024-08-26T00:14:47.397 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_behaviour", 2024-08-26T00:14:47.397 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.397 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.397 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.397 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "default", 2024-08-26T00:14:47.397 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.397 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.397 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.397 INFO:teuthology.orchestra.run.smithi042.stdout: "default", 2024-08-26T00:14:47.398 INFO:teuthology.orchestra.run.smithi042.stdout: "error" 2024-08-26T00:14:47.398 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.398 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.398 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.398 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.398 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.398 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.398 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_error_status_code": { 2024-08-26T00:14:47.398 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_error_status_code", 2024-08-26T00:14:47.398 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.398 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.398 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.398 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "500", 2024-08-26T00:14:47.399 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "400", 2024-08-26T00:14:47.399 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "599", 2024-08-26T00:14:47.399 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.399 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.399 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.399 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.399 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.399 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.399 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.399 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.399 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.399 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_support", 2024-08-26T00:14:47.399 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.399 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.400 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.400 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.400 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.400 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.400 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.400 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.400 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.400 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.400 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.400 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.400 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.400 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.400 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.401 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.401 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.401 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.401 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.401 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.401 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.401 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.401 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.401 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.401 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.401 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.401 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.401 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.401 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.402 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.402 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.402 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.402 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.402 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.402 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.402 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.402 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.402 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.402 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.402 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.402 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.402 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.403 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.403 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.403 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.403 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.403 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.403 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.403 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.403 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.403 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.403 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.403 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.403 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.403 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.404 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.404 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.404 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.404 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.404 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.404 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.404 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.404 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.404 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.404 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.404 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.404 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.404 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.404 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.405 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.405 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.405 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.405 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.405 INFO:teuthology.orchestra.run.smithi042.stdout: "max_concurrent_snap_create": { 2024-08-26T00:14:47.405 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_concurrent_snap_create", 2024-08-26T00:14:47.405 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.405 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.405 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.405 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:47.405 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.405 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.405 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.405 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.406 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.406 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.406 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.406 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.406 INFO:teuthology.orchestra.run.smithi042.stdout: "mirror_snapshot_schedule": { 2024-08-26T00:14:47.406 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mirror_snapshot_schedule", 2024-08-26T00:14:47.406 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.406 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.406 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.406 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.406 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.406 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.406 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.406 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.407 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.407 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.407 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.407 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.407 INFO:teuthology.orchestra.run.smithi042.stdout: "trash_purge_schedule": { 2024-08-26T00:14:47.407 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "trash_purge_schedule", 2024-08-26T00:14:47.407 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.407 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.407 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.407 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.407 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.407 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.407 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.407 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.408 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.408 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.408 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.408 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.408 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.408 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.408 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.408 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "restful", 2024-08-26T00:14:47.408 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.408 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.408 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.408 INFO:teuthology.orchestra.run.smithi042.stdout: "enable_auth": { 2024-08-26T00:14:47.408 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enable_auth", 2024-08-26T00:14:47.408 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.409 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.409 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.409 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.409 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.409 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.409 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.409 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.409 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.409 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.409 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.409 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.409 INFO:teuthology.orchestra.run.smithi042.stdout: "key_file": { 2024-08-26T00:14:47.409 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "key_file", 2024-08-26T00:14:47.410 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.410 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.410 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.410 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.410 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.410 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.410 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.410 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.410 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.410 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.410 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.410 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.410 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.410 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.411 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.411 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.411 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.411 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.411 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.411 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.411 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.411 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.411 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.411 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.411 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.411 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.411 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.412 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.412 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.412 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.412 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.412 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.412 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.412 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.412 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.412 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.412 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.412 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.412 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.412 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.413 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.413 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.413 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.413 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.413 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.413 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.413 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.413 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.413 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.413 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.413 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.413 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.413 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.413 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-08-26T00:14:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-08-26T00:14:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-08-26T00:14:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-08-26T00:14:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rgw", 2024-08-26T00:14:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rook", 2024-08-26T00:14:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: "storage_class": { 2024-08-26T00:14:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "storage_class", 2024-08-26T00:14:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "local", 2024-08-26T00:14:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-26T00:14:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "selftest", 2024-08-26T00:14:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: "roption1": { 2024-08-26T00:14:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "roption1", 2024-08-26T00:14:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: "roption2": { 2024-08-26T00:14:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "roption2", 2024-08-26T00:14:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "xyz", 2024-08-26T00:14:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption1": { 2024-08-26T00:14:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption1", 2024-08-26T00:14:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.439 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.439 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.442 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption2": { 2024-08-26T00:14:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption2", 2024-08-26T00:14:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption3": { 2024-08-26T00:14:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption3", 2024-08-26T00:14:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-08-26T00:14:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption4": { 2024-08-26T00:14:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption4", 2024-08-26T00:14:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption5": { 2024-08-26T00:14:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption5", 2024-08-26T00:14:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption6": { 2024-08-26T00:14:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption6", 2024-08-26T00:14:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption7": { 2024-08-26T00:14:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption7", 2024-08-26T00:14:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-08-26T00:14:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "42", 2024-08-26T00:14:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: "testkey": { 2024-08-26T00:14:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testkey", 2024-08-26T00:14:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: "testlkey": { 2024-08-26T00:14:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testlkey", 2024-08-26T00:14:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: "testnewline": { 2024-08-26T00:14:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testnewline", 2024-08-26T00:14:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snap_schedule", 2024-08-26T00:14:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_m_granularity": { 2024-08-26T00:14:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_m_granularity", 2024-08-26T00:14:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow minute scheduled snapshots", 2024-08-26T00:14:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: "dump_on_update": { 2024-08-26T00:14:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "dump_on_update", 2024-08-26T00:14:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "dump database to debug log on update", 2024-08-26T00:14:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "stats", 2024-08-26T00:14:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "status", 2024-08-26T00:14:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "telegraf", 2024-08-26T00:14:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: "address": { 2024-08-26T00:14:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "address", 2024-08-26T00:14:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-26T00:14:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-08-26T00:14:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-08-26T00:14:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15", 2024-08-26T00:14:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "telemetry", 2024-08-26T00:14:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_basic": { 2024-08-26T00:14:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_basic", 2024-08-26T00:14:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-26T00:14:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_crash": { 2024-08-26T00:14:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_crash", 2024-08-26T00:14:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-26T00:14:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_device": { 2024-08-26T00:14:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_device", 2024-08-26T00:14:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-26T00:14:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_ident": { 2024-08-26T00:14:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_ident", 2024-08-26T00:14:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-26T00:14:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_perf": { 2024-08-26T00:14:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_perf", 2024-08-26T00:14:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-26T00:14:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: "contact": { 2024-08-26T00:14:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "contact", 2024-08-26T00:14:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: "description": { 2024-08-26T00:14:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "description", 2024-08-26T00:14:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: "device_url": { 2024-08-26T00:14:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_url", 2024-08-26T00:14:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-26T00:14:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: "enabled": { 2024-08-26T00:14:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enabled", 2024-08-26T00:14:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-08-26T00:14:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-08-26T00:14:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "24", 2024-08-26T00:14:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "8", 2024-08-26T00:14:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: "last_opt_revision": { 2024-08-26T00:14:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "last_opt_revision", 2024-08-26T00:14:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1", 2024-08-26T00:14:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: "leaderboard": { 2024-08-26T00:14:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "leaderboard", 2024-08-26T00:14:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: "leaderboard_description": { 2024-08-26T00:14:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "leaderboard_description", 2024-08-26T00:14:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: "organization": { 2024-08-26T00:14:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "organization", 2024-08-26T00:14:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: "proxy": { 2024-08-26T00:14:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "proxy", 2024-08-26T00:14:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "url": { 2024-08-26T00:14:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "url", 2024-08-26T00:14:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-26T00:14:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "test_orchestrator", 2024-08-26T00:14:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "volumes", 2024-08-26T00:14:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: "max_concurrent_clones": { 2024-08-26T00:14:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_concurrent_clones", 2024-08-26T00:14:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "4", 2024-08-26T00:14:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-26T00:14:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: "periodic_async_work": { 2024-08-26T00:14:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "periodic_async_work", 2024-08-26T00:14:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Periodically check for async work", 2024-08-26T00:14:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: "snapshot_clone_delay": { 2024-08-26T00:14:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snapshot_clone_delay", 2024-08-26T00:14:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-08-26T00:14:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-26T00:14:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: "snapshot_clone_no_wait": { 2024-08-26T00:14:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snapshot_clone_no_wait", 2024-08-26T00:14:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-26T00:14:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix", 2024-08-26T00:14:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: "discovery_interval": { 2024-08-26T00:14:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "discovery_interval", 2024-08-26T00:14:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-08-26T00:14:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "100", 2024-08-26T00:14:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: "identifier": { 2024-08-26T00:14:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "identifier", 2024-08-26T00:14:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-08-26T00:14:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-08-26T00:14:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-08-26T00:14:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_host": { 2024-08-26T00:14:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_host", 2024-08-26T00:14:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_port": { 2024-08-26T00:14:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_port", 2024-08-26T00:14:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10051", 2024-08-26T00:14:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.528 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.528 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_sender": { 2024-08-26T00:14:47.528 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_sender", 2024-08-26T00:14:47.528 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.528 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.528 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.528 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-26T00:14:47.528 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.528 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.528 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.528 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.528 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.529 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.529 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.529 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.529 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.529 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.529 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-08-26T00:14:47.529 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.529 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.529 INFO:teuthology.orchestra.run.smithi042.stdout: "modules": [ 2024-08-26T00:14:47.529 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm", 2024-08-26T00:14:47.529 INFO:teuthology.orchestra.run.smithi042.stdout: "dashboard", 2024-08-26T00:14:47.529 INFO:teuthology.orchestra.run.smithi042.stdout: "iostat", 2024-08-26T00:14:47.529 INFO:teuthology.orchestra.run.smithi042.stdout: "nfs", 2024-08-26T00:14:47.529 INFO:teuthology.orchestra.run.smithi042.stdout: "restful" 2024-08-26T00:14:47.529 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.530 INFO:teuthology.orchestra.run.smithi042.stdout: "available_modules": [ 2024-08-26T00:14:47.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.530 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "alerts", 2024-08-26T00:14:47.530 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.530 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.530 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.530 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-08-26T00:14:47.530 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-08-26T00:14:47.530 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.530 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.530 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.530 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-08-26T00:14:47.530 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.531 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.531 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.531 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How frequently to reexamine health status", 2024-08-26T00:14:47.531 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.531 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.531 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.531 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.531 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.531 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.531 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.531 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.531 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.532 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.532 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.532 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.532 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.532 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.532 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.532 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.532 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.532 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.532 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.532 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.532 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.532 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.533 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.533 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.533 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.533 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.533 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.533 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.533 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.533 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.533 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.533 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.533 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.533 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.534 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.534 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.534 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.534 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.534 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.534 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.534 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.534 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.534 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.534 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.534 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.534 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.535 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.535 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.535 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.535 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.535 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.535 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.535 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.535 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.535 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.535 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.535 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.535 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.535 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.536 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.536 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.536 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.536 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.536 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.536 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.536 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.536 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.536 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.536 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.536 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_destination": { 2024-08-26T00:14:47.536 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_destination", 2024-08-26T00:14:47.536 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.537 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.537 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.537 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.537 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.537 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.537 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.537 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Email address to send alerts to", 2024-08-26T00:14:47.537 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.537 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.537 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.537 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_from_name": { 2024-08-26T00:14:47.537 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_from_name", 2024-08-26T00:14:47.538 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.538 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.538 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.538 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "Ceph", 2024-08-26T00:14:47.538 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.538 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.538 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.538 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Email From: name", 2024-08-26T00:14:47.538 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.538 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.538 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.538 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_host": { 2024-08-26T00:14:47.538 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_host", 2024-08-26T00:14:47.539 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.539 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.539 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.539 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.539 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.539 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.539 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.539 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP server", 2024-08-26T00:14:47.539 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.539 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.539 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.539 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_password": { 2024-08-26T00:14:47.540 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_password", 2024-08-26T00:14:47.540 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.540 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.540 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.540 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.540 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.540 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.540 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.540 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Password to authenticate with", 2024-08-26T00:14:47.540 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.540 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.540 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.540 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_port": { 2024-08-26T00:14:47.541 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_port", 2024-08-26T00:14:47.541 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.541 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.541 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.541 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "465", 2024-08-26T00:14:47.541 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.541 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.541 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.541 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP port", 2024-08-26T00:14:47.541 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.541 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.541 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.542 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_sender": { 2024-08-26T00:14:47.542 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_sender", 2024-08-26T00:14:47.542 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.542 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.542 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.542 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.542 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.542 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.542 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.542 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SMTP envelope sender", 2024-08-26T00:14:47.542 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.542 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.542 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.543 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_ssl": { 2024-08-26T00:14:47.543 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_ssl", 2024-08-26T00:14:47.543 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.543 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.543 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.543 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.543 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.543 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.543 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.543 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-26T00:14:47.543 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.543 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.543 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.544 INFO:teuthology.orchestra.run.smithi042.stdout: "smtp_user": { 2024-08-26T00:14:47.544 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "smtp_user", 2024-08-26T00:14:47.544 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.544 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.544 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.544 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.544 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.544 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.544 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.544 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "User to authenticate as", 2024-08-26T00:14:47.544 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.544 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.544 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.545 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.545 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.545 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "balancer", 2024-08-26T00:14:47.545 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.545 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.545 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.545 INFO:teuthology.orchestra.run.smithi042.stdout: "active": { 2024-08-26T00:14:47.545 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "active", 2024-08-26T00:14:47.545 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.545 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.545 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.545 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.546 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.546 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.546 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.546 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "automatically balance PGs across cluster", 2024-08-26T00:14:47.546 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.546 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.546 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.546 INFO:teuthology.orchestra.run.smithi042.stdout: "begin_time": { 2024-08-26T00:14:47.546 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "begin_time", 2024-08-26T00:14:47.546 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.546 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.546 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.546 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0000", 2024-08-26T00:14:47.547 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.547 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.547 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.547 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "beginning time of day to automatically balance", 2024-08-26T00:14:47.547 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-26T00:14:47.547 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.547 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.547 INFO:teuthology.orchestra.run.smithi042.stdout: "begin_weekday": { 2024-08-26T00:14:47.547 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "begin_weekday", 2024-08-26T00:14:47.547 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-08-26T00:14:47.547 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.547 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.548 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-08-26T00:14:47.548 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0", 2024-08-26T00:14:47.548 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "6", 2024-08-26T00:14:47.548 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.548 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-26T00:14:47.548 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-26T00:14:47.548 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.548 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.548 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_max_iterations": { 2024-08-26T00:14:47.548 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_max_iterations", 2024-08-26T00:14:47.548 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-08-26T00:14:47.548 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.549 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.549 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "25", 2024-08-26T00:14:47.549 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-08-26T00:14:47.549 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "250", 2024-08-26T00:14:47.549 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.549 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-26T00:14:47.549 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.549 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.549 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.549 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_metrics": { 2024-08-26T00:14:47.549 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_metrics", 2024-08-26T00:14:47.549 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.549 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.550 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.550 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "pgs,objects,bytes", 2024-08-26T00:14:47.550 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.550 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.550 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.550 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-26T00:14:47.550 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-26T00:14:47.550 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.550 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.550 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_compat_step": { 2024-08-26T00:14:47.550 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crush_compat_step", 2024-08-26T00:14:47.550 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-08-26T00:14:47.551 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.551 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.551 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0.5", 2024-08-26T00:14:47.551 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0.001", 2024-08-26T00:14:47.551 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "0.999", 2024-08-26T00:14:47.551 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.551 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "aggressiveness of optimization", 2024-08-26T00:14:47.551 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-26T00:14:47.551 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.551 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.551 INFO:teuthology.orchestra.run.smithi042.stdout: "end_time": { 2024-08-26T00:14:47.551 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "end_time", 2024-08-26T00:14:47.552 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.552 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.552 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.552 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "2359", 2024-08-26T00:14:47.552 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.552 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.552 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.552 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "ending time of day to automatically balance", 2024-08-26T00:14:47.552 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-26T00:14:47.552 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.552 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.552 INFO:teuthology.orchestra.run.smithi042.stdout: "end_weekday": { 2024-08-26T00:14:47.552 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "end_weekday", 2024-08-26T00:14:47.553 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-08-26T00:14:47.553 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.553 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.553 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-08-26T00:14:47.553 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "0", 2024-08-26T00:14:47.553 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "6", 2024-08-26T00:14:47.553 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.553 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-26T00:14:47.553 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-26T00:14:47.553 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.553 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.553 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.553 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.554 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.554 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.554 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.554 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.554 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.554 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.554 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.554 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.554 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.554 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.554 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.554 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.554 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.555 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.555 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.555 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.555 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.555 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.555 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.555 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.555 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.555 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.555 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.555 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.555 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.555 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.556 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.556 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.556 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.556 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.556 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.556 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.556 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.556 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.556 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.556 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.556 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.556 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.556 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.557 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.557 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.557 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.557 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.557 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.557 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.557 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.557 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.557 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.557 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.557 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.557 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.557 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.558 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.558 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.558 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.558 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.558 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.558 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.558 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.558 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.558 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.558 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.558 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.558 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.558 INFO:teuthology.orchestra.run.smithi042.stdout: "min_score": { 2024-08-26T00:14:47.559 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "min_score", 2024-08-26T00:14:47.559 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-08-26T00:14:47.559 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.559 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.559 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-08-26T00:14:47.559 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.559 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.559 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.559 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-26T00:14:47.559 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.559 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.559 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.560 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": { 2024-08-26T00:14:47.560 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mode", 2024-08-26T00:14:47.560 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.560 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.560 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.560 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "upmap", 2024-08-26T00:14:47.560 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.560 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.560 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.560 INFO:teuthology.orchestra.run.smithi042.stdout: "crush-compat", 2024-08-26T00:14:47.560 INFO:teuthology.orchestra.run.smithi042.stdout: "none", 2024-08-26T00:14:47.560 INFO:teuthology.orchestra.run.smithi042.stdout: "read", 2024-08-26T00:14:47.560 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap", 2024-08-26T00:14:47.560 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap-read" 2024-08-26T00:14:47.561 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.561 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Balancer mode", 2024-08-26T00:14:47.561 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.561 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.561 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.561 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_ids": { 2024-08-26T00:14:47.561 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pool_ids", 2024-08-26T00:14:47.561 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.561 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.561 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.561 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.561 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.561 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.562 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.562 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-26T00:14:47.562 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.562 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.562 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.562 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-08-26T00:14:47.562 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-08-26T00:14:47.562 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.562 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.562 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.562 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-08-26T00:14:47.562 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.563 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.563 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.563 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-26T00:14:47.563 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.563 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.563 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.563 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap_max_deviation": { 2024-08-26T00:14:47.563 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "upmap_max_deviation", 2024-08-26T00:14:47.563 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.563 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.563 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.563 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-08-26T00:14:47.564 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-08-26T00:14:47.564 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.564 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.564 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-26T00:14:47.564 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-26T00:14:47.564 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.564 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.564 INFO:teuthology.orchestra.run.smithi042.stdout: "upmap_max_optimizations": { 2024-08-26T00:14:47.564 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "upmap_max_optimizations", 2024-08-26T00:14:47.564 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-08-26T00:14:47.564 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.564 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.564 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:47.565 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.565 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.565 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.565 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-26T00:14:47.565 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.565 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.565 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.565 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.565 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.565 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.565 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cephadm", 2024-08-26T00:14:47.565 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.566 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.566 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.566 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_down_multiplier": { 2024-08-26T00:14:47.566 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_down_multiplier", 2024-08-26T00:14:47.566 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-08-26T00:14:47.566 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.566 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.566 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3.0", 2024-08-26T00:14:47.566 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.566 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.566 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.566 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-26T00:14:47.566 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.566 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.567 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.567 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_refresh_rate": { 2024-08-26T00:14:47.567 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_refresh_rate", 2024-08-26T00:14:47.567 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.567 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.567 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.567 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "20", 2024-08-26T00:14:47.567 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.567 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.567 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.567 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-26T00:14:47.567 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.568 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.568 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.568 INFO:teuthology.orchestra.run.smithi042.stdout: "agent_starting_port": { 2024-08-26T00:14:47.568 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "agent_starting_port", 2024-08-26T00:14:47.568 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.568 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.568 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.568 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "4721", 2024-08-26T00:14:47.568 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.568 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.568 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.568 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-26T00:14:47.568 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.569 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.569 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.569 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_ptrace": { 2024-08-26T00:14:47.569 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_ptrace", 2024-08-26T00:14:47.569 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.569 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.569 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.569 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.569 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.569 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.569 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.569 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-26T00:14:47.569 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-26T00:14:47.570 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.570 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.570 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.570 INFO:teuthology.orchestra.run.smithi042.stdout: "autotune_interval": { 2024-08-26T00:14:47.570 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "autotune_interval", 2024-08-26T00:14:47.570 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.570 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.570 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.570 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-08-26T00:14:47.570 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.570 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.570 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.570 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-26T00:14:47.571 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.571 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.571 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.571 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.571 INFO:teuthology.orchestra.run.smithi042.stdout: "autotune_memory_target_ratio": { 2024-08-26T00:14:47.571 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "autotune_memory_target_ratio", 2024-08-26T00:14:47.571 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-08-26T00:14:47.571 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.571 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.571 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0.7", 2024-08-26T00:14:47.571 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.571 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.571 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.571 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-26T00:14:47.572 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.572 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.572 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.572 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.572 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm_log_destination": { 2024-08-26T00:14:47.572 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cephadm_log_destination", 2024-08-26T00:14:47.572 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.572 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.572 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.572 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.572 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.572 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.572 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.572 INFO:teuthology.orchestra.run.smithi042.stdout: "file", 2024-08-26T00:14:47.573 INFO:teuthology.orchestra.run.smithi042.stdout: "file,syslog", 2024-08-26T00:14:47.573 INFO:teuthology.orchestra.run.smithi042.stdout: "syslog" 2024-08-26T00:14:47.573 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.573 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-26T00:14:47.573 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.573 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.573 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.573 INFO:teuthology.orchestra.run.smithi042.stdout: "cgroups_split": { 2024-08-26T00:14:47.573 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cgroups_split", 2024-08-26T00:14:47.573 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.573 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.573 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.573 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.574 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.574 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.574 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.574 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-26T00:14:47.574 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.574 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.574 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.574 INFO:teuthology.orchestra.run.smithi042.stdout: "config_checks_enabled": { 2024-08-26T00:14:47.574 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_checks_enabled", 2024-08-26T00:14:47.574 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.574 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.574 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.575 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.575 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.575 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.575 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.575 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-26T00:14:47.575 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.575 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.575 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.575 INFO:teuthology.orchestra.run.smithi042.stdout: "config_dashboard": { 2024-08-26T00:14:47.575 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_dashboard", 2024-08-26T00:14:47.575 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.575 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.575 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.576 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.576 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.576 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.576 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.576 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-26T00:14:47.576 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.576 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.576 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.576 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.576 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_alertmanager": { 2024-08-26T00:14:47.576 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_alertmanager", 2024-08-26T00:14:47.576 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.576 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.576 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.577 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-08-26T00:14:47.577 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.577 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.577 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.577 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-08-26T00:14:47.577 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.577 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.577 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.577 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.577 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_base": { 2024-08-26T00:14:47.577 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_base", 2024-08-26T00:14:47.577 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.577 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.577 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.577 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-26T00:14:47.578 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.578 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.578 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.578 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Container image name, without the tag", 2024-08-26T00:14:47.578 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.578 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.578 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.578 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.578 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_elasticsearch": { 2024-08-26T00:14:47.578 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_elasticsearch", 2024-08-26T00:14:47.578 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.578 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.578 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.579 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-26T00:14:47.579 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.579 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.579 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.579 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "elasticsearch container image", 2024-08-26T00:14:47.579 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.579 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.579 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.579 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.579 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_grafana": { 2024-08-26T00:14:47.579 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_grafana", 2024-08-26T00:14:47.579 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.579 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.580 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.580 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-08-26T00:14:47.580 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.580 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.580 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.580 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-08-26T00:14:47.580 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.580 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.580 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.580 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_haproxy": { 2024-08-26T00:14:47.580 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_haproxy", 2024-08-26T00:14:47.580 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.580 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.581 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.581 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-26T00:14:47.581 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.581 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.581 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.581 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "HAproxy container image", 2024-08-26T00:14:47.581 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.581 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.581 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.581 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_agent": { 2024-08-26T00:14:47.581 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_agent", 2024-08-26T00:14:47.581 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.581 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.582 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.582 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-26T00:14:47.582 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.582 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.582 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.582 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger agent container image", 2024-08-26T00:14:47.582 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.582 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.582 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.582 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_collector": { 2024-08-26T00:14:47.582 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_collector", 2024-08-26T00:14:47.582 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.583 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.583 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.583 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-26T00:14:47.583 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.583 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.583 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.583 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger collector container image", 2024-08-26T00:14:47.583 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.583 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.583 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.583 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_jaeger_query": { 2024-08-26T00:14:47.583 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_jaeger_query", 2024-08-26T00:14:47.583 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.584 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.584 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.584 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-26T00:14:47.584 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.584 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.584 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.584 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Jaeger query container image", 2024-08-26T00:14:47.584 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.584 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.584 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.584 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_keepalived": { 2024-08-26T00:14:47.584 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_keepalived", 2024-08-26T00:14:47.584 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.585 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.585 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.585 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-26T00:14:47.585 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.585 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.585 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.585 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Keepalived container image", 2024-08-26T00:14:47.585 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.585 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.585 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.585 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_loki": { 2024-08-26T00:14:47.585 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_loki", 2024-08-26T00:14:47.586 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.586 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.586 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.586 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-26T00:14:47.586 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.586 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.586 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.586 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Loki container image", 2024-08-26T00:14:47.586 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.586 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.586 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.586 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.586 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_node_exporter": { 2024-08-26T00:14:47.587 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_node_exporter", 2024-08-26T00:14:47.587 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.587 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.587 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.587 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-08-26T00:14:47.587 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.587 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.587 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.587 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-08-26T00:14:47.587 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.587 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.587 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.587 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_nvmeof": { 2024-08-26T00:14:47.588 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_nvmeof", 2024-08-26T00:14:47.588 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.588 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.588 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.588 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-08-26T00:14:47.588 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.588 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.588 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.588 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Nvme-of container image", 2024-08-26T00:14:47.588 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.588 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.588 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.588 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_prometheus": { 2024-08-26T00:14:47.589 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_prometheus", 2024-08-26T00:14:47.589 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.589 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.589 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.589 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-08-26T00:14:47.589 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.589 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.589 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.589 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Prometheus container image", 2024-08-26T00:14:47.589 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.589 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.589 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.589 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_promtail": { 2024-08-26T00:14:47.590 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_promtail", 2024-08-26T00:14:47.590 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.590 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.590 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.590 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-26T00:14:47.590 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.590 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.590 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.590 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Promtail container image", 2024-08-26T00:14:47.590 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.590 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.590 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.590 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_samba": { 2024-08-26T00:14:47.591 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_samba", 2024-08-26T00:14:47.591 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.591 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.591 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.591 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-26T00:14:47.591 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.591 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.591 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.591 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Samba/SMB container image", 2024-08-26T00:14:47.591 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.591 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.591 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.591 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image_snmp_gateway": { 2024-08-26T00:14:47.592 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_image_snmp_gateway", 2024-08-26T00:14:47.592 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.592 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.592 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.592 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-26T00:14:47.592 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.592 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.592 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.592 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "SNMP Gateway container image", 2024-08-26T00:14:47.592 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.592 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.592 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.593 INFO:teuthology.orchestra.run.smithi042.stdout: "container_init": { 2024-08-26T00:14:47.593 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "container_init", 2024-08-26T00:14:47.593 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.593 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.593 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.593 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.593 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.593 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.593 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.593 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Run podman/docker with `--init`", 2024-08-26T00:14:47.593 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.593 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.593 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.594 INFO:teuthology.orchestra.run.smithi042.stdout: "daemon_cache_timeout": { 2024-08-26T00:14:47.594 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "daemon_cache_timeout", 2024-08-26T00:14:47.594 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.594 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.594 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.594 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-08-26T00:14:47.594 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.594 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.594 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.594 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-26T00:14:47.594 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.594 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.594 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.595 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.595 INFO:teuthology.orchestra.run.smithi042.stdout: "default_cephadm_command_timeout": { 2024-08-26T00:14:47.595 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "default_cephadm_command_timeout", 2024-08-26T00:14:47.595 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.595 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.595 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.595 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "900", 2024-08-26T00:14:47.595 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.595 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.595 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.595 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-26T00:14:47.595 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.595 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.595 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.596 INFO:teuthology.orchestra.run.smithi042.stdout: "default_registry": { 2024-08-26T00:14:47.596 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "default_registry", 2024-08-26T00:14:47.596 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.596 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.596 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.596 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "docker.io", 2024-08-26T00:14:47.596 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.596 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.596 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.596 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-26T00:14:47.596 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.596 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.597 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.597 INFO:teuthology.orchestra.run.smithi042.stdout: "device_cache_timeout": { 2024-08-26T00:14:47.597 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_cache_timeout", 2024-08-26T00:14:47.597 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.597 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.597 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.597 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1800", 2024-08-26T00:14:47.597 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.597 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.597 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.597 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache device inventory", 2024-08-26T00:14:47.597 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.598 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.598 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.598 INFO:teuthology.orchestra.run.smithi042.stdout: "device_enhanced_scan": { 2024-08-26T00:14:47.598 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_enhanced_scan", 2024-08-26T00:14:47.598 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.598 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.598 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.598 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.598 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.598 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.598 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.598 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-26T00:14:47.599 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.599 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.599 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.599 INFO:teuthology.orchestra.run.smithi042.stdout: "facts_cache_timeout": { 2024-08-26T00:14:47.599 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "facts_cache_timeout", 2024-08-26T00:14:47.599 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.599 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.599 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.599 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-08-26T00:14:47.599 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.599 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.599 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.599 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "seconds to cache host facts data", 2024-08-26T00:14:47.600 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.600 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.600 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.600 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.600 INFO:teuthology.orchestra.run.smithi042.stdout: "grafana_dashboards_path": { 2024-08-26T00:14:47.600 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "grafana_dashboards_path", 2024-08-26T00:14:47.600 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.600 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.600 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.600 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-26T00:14:47.600 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.600 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.600 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.600 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-26T00:14:47.601 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.601 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.601 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.601 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.601 INFO:teuthology.orchestra.run.smithi042.stdout: "host_check_interval": { 2024-08-26T00:14:47.601 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "host_check_interval", 2024-08-26T00:14:47.601 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.601 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.601 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.601 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-08-26T00:14:47.601 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.601 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.601 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.601 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to perform a host check", 2024-08-26T00:14:47.602 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.602 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.602 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.602 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.602 INFO:teuthology.orchestra.run.smithi042.stdout: "hw_monitoring": { 2024-08-26T00:14:47.602 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "hw_monitoring", 2024-08-26T00:14:47.602 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.602 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.602 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.602 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.602 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.602 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.602 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.603 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-26T00:14:47.603 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.603 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.603 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.603 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.603 INFO:teuthology.orchestra.run.smithi042.stdout: "inventory_list_all": { 2024-08-26T00:14:47.603 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "inventory_list_all", 2024-08-26T00:14:47.603 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.603 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.603 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.603 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.603 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.603 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.603 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.604 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-26T00:14:47.604 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.604 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.604 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.604 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.604 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.604 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.604 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.604 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.604 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.604 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.604 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.604 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.604 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.604 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.605 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.605 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.605 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.605 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.605 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.605 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.605 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.605 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.605 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.605 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.605 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.605 INFO:teuthology.orchestra.run.smithi042.stdout: "log_refresh_metadata": { 2024-08-26T00:14:47.605 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_refresh_metadata", 2024-08-26T00:14:47.605 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.606 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.606 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.606 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.606 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.606 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.606 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.606 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-26T00:14:47.606 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.606 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.606 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.606 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.606 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.606 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.607 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.607 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.607 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.607 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.607 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.607 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.607 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.607 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-26T00:14:47.607 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.607 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.607 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.607 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.607 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.607 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.608 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.608 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.608 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.608 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.608 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.608 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.608 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.608 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.608 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.608 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.608 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.608 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.608 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.608 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.609 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.609 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.609 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.609 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.609 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.609 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.609 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.609 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.609 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.609 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.609 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.609 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.609 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.610 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.610 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.610 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.610 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.610 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.610 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.610 INFO:teuthology.orchestra.run.smithi042.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-26T00:14:47.610 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-26T00:14:47.610 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.610 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.610 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.610 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.610 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.610 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.611 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.611 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-26T00:14:47.611 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.611 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.611 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.611 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.611 INFO:teuthology.orchestra.run.smithi042.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-26T00:14:47.611 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-26T00:14:47.611 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.611 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.611 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.611 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "*", 2024-08-26T00:14:47.611 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.612 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.612 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.612 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-26T00:14:47.612 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.612 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.612 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.612 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.612 INFO:teuthology.orchestra.run.smithi042.stdout: "max_count_per_host": { 2024-08-26T00:14:47.612 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_count_per_host", 2024-08-26T00:14:47.612 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.612 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.612 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.612 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:47.612 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.613 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.613 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.613 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "max number of daemons per service per host", 2024-08-26T00:14:47.613 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.613 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.613 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.613 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.613 INFO:teuthology.orchestra.run.smithi042.stdout: "max_osd_draining_count": { 2024-08-26T00:14:47.613 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_osd_draining_count", 2024-08-26T00:14:47.613 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.613 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.613 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.613 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:47.614 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.614 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.614 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.614 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-26T00:14:47.614 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.614 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.614 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.614 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.614 INFO:teuthology.orchestra.run.smithi042.stdout: "migration_current": { 2024-08-26T00:14:47.614 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "migration_current", 2024-08-26T00:14:47.614 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.614 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.614 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.615 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.615 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.615 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.615 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.615 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "internal - do not modify", 2024-08-26T00:14:47.615 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.615 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.615 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.615 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.615 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": { 2024-08-26T00:14:47.615 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mode", 2024-08-26T00:14:47.615 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.615 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.615 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.616 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "root", 2024-08-26T00:14:47.616 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.616 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.616 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.616 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm-package", 2024-08-26T00:14:47.616 INFO:teuthology.orchestra.run.smithi042.stdout: "root" 2024-08-26T00:14:47.616 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.616 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "mode for remote execution of cephadm", 2024-08-26T00:14:47.616 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.616 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.616 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.616 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.616 INFO:teuthology.orchestra.run.smithi042.stdout: "oob_default_addr": { 2024-08-26T00:14:47.616 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "oob_default_addr", 2024-08-26T00:14:47.617 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.617 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.617 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.617 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "169.254.1.1", 2024-08-26T00:14:47.617 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.617 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.617 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.617 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-26T00:14:47.617 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.617 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.617 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.617 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.617 INFO:teuthology.orchestra.run.smithi042.stdout: "prometheus_alerts_path": { 2024-08-26T00:14:47.617 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prometheus_alerts_path", 2024-08-26T00:14:47.618 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.618 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.618 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.618 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-26T00:14:47.618 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.618 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.618 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.618 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-26T00:14:47.618 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.618 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.618 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.618 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.618 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_insecure": { 2024-08-26T00:14:47.618 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_insecure", 2024-08-26T00:14:47.619 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.619 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.619 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.619 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.619 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.619 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.619 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.619 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-26T00:14:47.619 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.619 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.619 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.619 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.619 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_password": { 2024-08-26T00:14:47.619 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_password", 2024-08-26T00:14:47.620 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.620 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.620 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.620 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.620 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.620 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.620 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.620 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-26T00:14:47.620 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.620 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.620 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.620 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.620 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_url": { 2024-08-26T00:14:47.620 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_url", 2024-08-26T00:14:47.621 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.621 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.621 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.621 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.621 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.621 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.621 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.621 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-26T00:14:47.621 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.621 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.621 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.621 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.621 INFO:teuthology.orchestra.run.smithi042.stdout: "registry_username": { 2024-08-26T00:14:47.621 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "registry_username", 2024-08-26T00:14:47.622 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.622 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.622 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.622 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.622 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.622 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.622 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.622 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-26T00:14:47.622 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.622 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.622 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.622 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.622 INFO:teuthology.orchestra.run.smithi042.stdout: "secure_monitoring_stack": { 2024-08-26T00:14:47.623 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "secure_monitoring_stack", 2024-08-26T00:14:47.623 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.623 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.623 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.623 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.623 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.623 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.623 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.623 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-26T00:14:47.623 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.623 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.623 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.623 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.623 INFO:teuthology.orchestra.run.smithi042.stdout: "service_discovery_port": { 2024-08-26T00:14:47.624 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "service_discovery_port", 2024-08-26T00:14:47.624 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.624 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.624 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.624 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8765", 2024-08-26T00:14:47.624 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.624 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.624 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.624 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "cephadm service discovery port", 2024-08-26T00:14:47.624 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.624 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.624 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.624 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.625 INFO:teuthology.orchestra.run.smithi042.stdout: "ssh_config_file": { 2024-08-26T00:14:47.625 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssh_config_file", 2024-08-26T00:14:47.625 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.625 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.625 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.625 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.625 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.625 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.625 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.625 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-26T00:14:47.625 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.625 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.625 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.625 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.626 INFO:teuthology.orchestra.run.smithi042.stdout: "use_agent": { 2024-08-26T00:14:47.626 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "use_agent", 2024-08-26T00:14:47.626 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.626 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.626 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.626 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.626 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.626 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.626 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.626 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-26T00:14:47.626 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.626 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.626 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.627 INFO:teuthology.orchestra.run.smithi042.stdout: "use_repo_digest": { 2024-08-26T00:14:47.627 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "use_repo_digest", 2024-08-26T00:14:47.627 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.627 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.627 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.627 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.627 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.627 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.627 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.627 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-26T00:14:47.627 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.627 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.627 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.628 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.628 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_failed_host_check": { 2024-08-26T00:14:47.628 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_failed_host_check", 2024-08-26T00:14:47.628 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.628 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.628 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.628 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.628 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.628 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.628 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.628 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if the host check fails", 2024-08-26T00:14:47.628 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.628 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.628 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.629 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.629 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_stray_daemons": { 2024-08-26T00:14:47.629 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_stray_daemons", 2024-08-26T00:14:47.629 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.629 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.629 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.629 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.629 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.629 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.629 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.629 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-26T00:14:47.629 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.629 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.629 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.630 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.630 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_on_stray_hosts": { 2024-08-26T00:14:47.630 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_on_stray_hosts", 2024-08-26T00:14:47.630 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.630 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.630 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.630 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.630 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.630 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.630 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.630 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-26T00:14:47.630 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.630 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.631 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.631 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.631 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.631 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.631 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crash", 2024-08-26T00:14:47.631 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.631 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.631 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.631 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.631 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.631 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.631 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.631 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.632 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.632 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.632 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.632 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.632 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.632 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.632 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.632 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.632 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.632 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.632 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.632 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.632 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.632 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.633 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.633 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.633 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.633 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.633 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.633 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.633 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.633 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.633 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.633 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.633 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.633 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.633 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.634 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.634 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.634 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.634 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.634 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.634 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.634 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.634 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.634 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.634 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.634 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.634 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.634 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.634 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.635 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.635 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.635 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.635 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.635 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.635 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.635 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.635 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.635 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.635 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.635 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.635 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.635 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.635 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.636 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.636 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.636 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.636 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.636 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.636 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.636 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.636 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.636 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.636 INFO:teuthology.orchestra.run.smithi042.stdout: "retain_interval": { 2024-08-26T00:14:47.636 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "retain_interval", 2024-08-26T00:14:47.636 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.636 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.636 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.637 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "31536000", 2024-08-26T00:14:47.637 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.637 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.637 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.637 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-26T00:14:47.637 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.637 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.637 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.637 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_recent_interval": { 2024-08-26T00:14:47.637 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_recent_interval", 2024-08-26T00:14:47.637 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.637 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.637 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.637 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1209600", 2024-08-26T00:14:47.638 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.638 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.638 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.638 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-26T00:14:47.638 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.638 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.638 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.638 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.638 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.638 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.638 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.638 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "dashboard", 2024-08-26T00:14:47.638 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.639 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.639 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.639 INFO:teuthology.orchestra.run.smithi042.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-26T00:14:47.639 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-26T00:14:47.639 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.639 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.639 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.639 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:47.639 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.639 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.639 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.639 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.639 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.640 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.640 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.640 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.640 INFO:teuthology.orchestra.run.smithi042.stdout: "ALERTMANAGER_API_HOST": { 2024-08-26T00:14:47.640 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-26T00:14:47.640 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.640 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.640 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.640 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.640 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.640 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.640 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.640 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.640 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.641 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.641 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.641 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.641 INFO:teuthology.orchestra.run.smithi042.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-26T00:14:47.641 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-26T00:14:47.641 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.641 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.641 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.641 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.641 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.641 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.641 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.641 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.642 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.642 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.642 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.642 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.642 INFO:teuthology.orchestra.run.smithi042.stdout: "AUDIT_API_ENABLED": { 2024-08-26T00:14:47.642 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "AUDIT_API_ENABLED", 2024-08-26T00:14:47.642 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.642 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.642 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.642 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.642 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.642 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.642 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.642 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.643 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.643 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.643 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.643 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.643 INFO:teuthology.orchestra.run.smithi042.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-26T00:14:47.643 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-26T00:14:47.643 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.643 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.643 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.643 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.643 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.643 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.643 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.647 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.647 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.647 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.647 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.647 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.647 INFO:teuthology.orchestra.run.smithi042.stdout: "ENABLE_BROWSABLE_API": { 2024-08-26T00:14:47.647 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-26T00:14:47.647 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.647 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.647 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.647 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.647 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.648 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.648 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.648 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.648 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.648 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.648 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.648 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.648 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-26T00:14:47.648 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-26T00:14:47.648 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.648 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.648 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.648 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.648 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.649 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.649 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.649 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.649 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.649 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.649 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.649 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-26T00:14:47.649 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-26T00:14:47.649 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.649 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.649 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.649 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.649 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.650 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.650 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.650 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.650 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.650 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.650 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.650 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-26T00:14:47.650 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-26T00:14:47.650 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.650 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.650 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.650 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.650 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.651 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.651 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.651 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.651 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.651 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.651 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.651 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.651 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-26T00:14:47.651 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-26T00:14:47.651 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.651 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.651 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.651 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.651 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.652 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.652 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.652 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.652 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.652 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.652 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.652 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.652 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-26T00:14:47.652 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-26T00:14:47.652 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.652 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.652 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.652 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.653 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.653 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.653 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.653 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.653 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.653 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.653 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.653 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.653 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-26T00:14:47.653 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-26T00:14:47.653 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.653 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.653 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.653 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.654 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.654 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.654 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.654 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.654 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.654 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.654 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.654 INFO:teuthology.orchestra.run.smithi042.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-26T00:14:47.654 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-26T00:14:47.654 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.654 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.654 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.654 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.655 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.655 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.655 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.655 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.655 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.655 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.655 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.655 INFO:teuthology.orchestra.run.smithi042.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-26T00:14:47.655 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-26T00:14:47.655 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.655 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.655 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.655 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.656 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.656 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.656 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.656 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.656 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.656 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.656 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.656 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_PASSWORD": { 2024-08-26T00:14:47.656 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-26T00:14:47.656 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.656 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.656 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.656 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-08-26T00:14:47.657 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.657 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.657 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.657 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.657 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.657 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.657 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.657 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-26T00:14:47.657 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-26T00:14:47.657 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.657 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.657 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.657 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.658 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.658 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.658 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.658 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.658 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.658 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.658 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.658 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_URL": { 2024-08-26T00:14:47.658 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_URL", 2024-08-26T00:14:47.658 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.658 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.658 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.658 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.659 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.659 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.659 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.659 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.659 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.659 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.659 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.659 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.659 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_API_USERNAME": { 2024-08-26T00:14:47.659 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-26T00:14:47.659 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.659 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.659 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.660 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-08-26T00:14:47.660 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.660 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.660 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.660 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.660 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.660 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.660 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.660 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-26T00:14:47.660 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-26T00:14:47.660 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.660 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.661 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.661 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.661 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.661 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.661 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.661 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.661 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.661 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.661 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.661 INFO:teuthology.orchestra.run.smithi042.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-26T00:14:47.661 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-26T00:14:47.661 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.661 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.662 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.662 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.662 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.662 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.662 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.662 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.662 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.662 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.662 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.662 INFO:teuthology.orchestra.run.smithi042.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-26T00:14:47.662 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-26T00:14:47.662 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.663 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.663 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.663 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.663 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.663 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.663 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.663 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.663 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.663 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.663 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.663 INFO:teuthology.orchestra.run.smithi042.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-26T00:14:47.663 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-26T00:14:47.663 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.664 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.664 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.664 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.664 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.664 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.664 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.664 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.664 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.664 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.664 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.664 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.664 INFO:teuthology.orchestra.run.smithi042.stdout: "PROMETHEUS_API_HOST": { 2024-08-26T00:14:47.664 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-26T00:14:47.665 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.665 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.665 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.665 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.665 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.665 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.665 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.665 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.665 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.665 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.665 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.665 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.665 INFO:teuthology.orchestra.run.smithi042.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-26T00:14:47.665 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-26T00:14:47.666 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.666 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.666 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.666 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.666 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.666 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.666 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.666 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.666 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.666 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.666 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.666 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.666 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-26T00:14:47.667 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-26T00:14:47.667 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.667 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.667 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.667 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.667 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.667 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.667 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.667 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.667 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.667 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.667 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.667 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-26T00:14:47.668 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-26T00:14:47.668 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.668 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.668 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.668 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.668 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.668 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.668 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.668 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.668 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.668 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.668 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.668 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.668 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-26T00:14:47.669 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-26T00:14:47.669 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.669 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.669 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.669 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.669 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.669 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.669 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.669 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.669 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.669 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.669 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.669 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-26T00:14:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-26T00:14:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-26T00:14:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-26T00:14:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-26T00:14:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-26T00:14:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.673 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-26T00:14:47.673 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-26T00:14:47.673 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.673 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.673 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.673 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.673 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.673 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.673 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.673 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.673 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.673 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.673 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.674 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_ENABLED": { 2024-08-26T00:14:47.674 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-26T00:14:47.674 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.674 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.674 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.674 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.674 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.674 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.674 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.674 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.674 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.674 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.674 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.674 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.675 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-26T00:14:47.675 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-26T00:14:47.675 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.675 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.675 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.675 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-26T00:14:47.675 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.675 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.675 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.675 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.675 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.675 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.675 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.676 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.676 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-26T00:14:47.676 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-26T00:14:47.676 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.676 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.676 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.676 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:47.676 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.676 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.676 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.676 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.676 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.676 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.677 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.677 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.677 INFO:teuthology.orchestra.run.smithi042.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-26T00:14:47.677 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-26T00:14:47.677 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.677 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.677 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.677 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8", 2024-08-26T00:14:47.677 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.677 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.677 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.677 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.677 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.677 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.678 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.678 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.678 INFO:teuthology.orchestra.run.smithi042.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-26T00:14:47.678 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-26T00:14:47.678 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.678 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.678 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.678 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "45", 2024-08-26T00:14:47.678 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.678 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.678 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.678 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.678 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.679 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.679 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.679 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.679 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_ACCESS_KEY": { 2024-08-26T00:14:47.679 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-26T00:14:47.679 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.679 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.679 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.679 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.679 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.679 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.679 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.679 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.680 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.680 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.680 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.680 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.680 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-26T00:14:47.680 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-26T00:14:47.680 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.680 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.680 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.680 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "admin", 2024-08-26T00:14:47.680 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.680 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.680 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.680 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.681 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.681 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.681 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.681 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.681 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_SECRET_KEY": { 2024-08-26T00:14:47.681 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-26T00:14:47.681 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.681 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.681 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.681 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.681 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.681 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.681 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.682 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.682 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.682 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.682 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.682 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.682 INFO:teuthology.orchestra.run.smithi042.stdout: "RGW_API_SSL_VERIFY": { 2024-08-26T00:14:47.682 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-26T00:14:47.682 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.682 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.682 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.682 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.682 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.682 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.682 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.683 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.683 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.683 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.683 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.683 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.683 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-26T00:14:47.683 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-26T00:14:47.683 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.683 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.683 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.683 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-08-26T00:14:47.683 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.683 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.684 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.684 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.684 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.684 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.684 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.684 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.684 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-26T00:14:47.684 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-26T00:14:47.684 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.684 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.684 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.684 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:47.684 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.684 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.685 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.685 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.685 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.685 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.685 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.685 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.685 INFO:teuthology.orchestra.run.smithi042.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-26T00:14:47.685 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-26T00:14:47.685 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.685 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.685 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.685 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-08-26T00:14:47.685 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.685 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.685 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.686 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.686 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.686 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.686 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.686 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.686 INFO:teuthology.orchestra.run.smithi042.stdout: "cross_origin_url": { 2024-08-26T00:14:47.686 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cross_origin_url", 2024-08-26T00:14:47.686 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.686 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.686 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.686 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.686 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.686 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.687 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.687 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.687 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.687 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.687 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.687 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.687 INFO:teuthology.orchestra.run.smithi042.stdout: "crt_file": { 2024-08-26T00:14:47.687 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "crt_file", 2024-08-26T00:14:47.687 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.687 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.687 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.687 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.687 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.687 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.688 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.688 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.688 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.688 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.688 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.688 INFO:teuthology.orchestra.run.smithi042.stdout: "debug": { 2024-08-26T00:14:47.688 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "debug", 2024-08-26T00:14:47.688 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.688 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.688 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.688 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.688 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.688 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.689 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.689 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Enable/disable debug options", 2024-08-26T00:14:47.689 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.689 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.689 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.689 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.689 INFO:teuthology.orchestra.run.smithi042.stdout: "jwt_token_ttl": { 2024-08-26T00:14:47.689 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "jwt_token_ttl", 2024-08-26T00:14:47.689 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.689 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.689 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.689 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "28800", 2024-08-26T00:14:47.689 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.690 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.690 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.690 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.690 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.690 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.690 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.690 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.690 INFO:teuthology.orchestra.run.smithi042.stdout: "key_file": { 2024-08-26T00:14:47.690 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "key_file", 2024-08-26T00:14:47.690 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.690 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.690 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.690 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.690 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.691 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.691 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.691 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.691 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.691 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.691 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.691 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.691 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.691 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.691 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.691 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.691 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.692 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.692 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.692 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.692 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.692 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.692 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.692 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.692 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.692 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.692 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.692 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.692 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.692 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.692 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.693 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.693 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.693 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.693 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.693 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.693 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.693 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.693 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.693 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.693 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.693 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.693 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.693 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.693 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.694 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.694 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.694 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.694 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.694 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.694 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.694 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.694 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.694 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.694 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.694 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.695 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.695 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.695 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.695 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.695 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.695 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.695 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.695 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.695 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.695 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.695 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.695 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.695 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.695 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.696 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.696 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.696 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.696 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.696 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.696 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.696 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.696 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.696 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.696 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.696 INFO:teuthology.orchestra.run.smithi042.stdout: "motd": { 2024-08-26T00:14:47.696 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "motd", 2024-08-26T00:14:47.696 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.696 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.697 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.697 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.697 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.697 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.697 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.697 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "The message of the day", 2024-08-26T00:14:47.697 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.697 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.697 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.697 INFO:teuthology.orchestra.run.smithi042.stdout: "redirect_resolve_ip_addr": { 2024-08-26T00:14:47.697 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "redirect_resolve_ip_addr", 2024-08-26T00:14:47.697 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.698 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.698 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.698 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.698 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.698 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.698 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.698 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.698 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.698 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.698 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.698 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-08-26T00:14:47.698 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-08-26T00:14:47.698 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.699 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.699 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.699 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "::", 2024-08-26T00:14:47.699 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.699 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.699 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.699 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.699 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.699 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.699 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.699 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-08-26T00:14:47.699 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-08-26T00:14:47.699 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.700 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.700 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.700 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8080", 2024-08-26T00:14:47.700 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.700 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.700 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.700 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.700 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.700 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.700 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.700 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.700 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl": { 2024-08-26T00:14:47.700 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl", 2024-08-26T00:14:47.701 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.701 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.701 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.701 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.701 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.701 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.701 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.701 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.701 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.701 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.701 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.701 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.701 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl_server_port": { 2024-08-26T00:14:47.701 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl_server_port", 2024-08-26T00:14:47.702 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.702 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.702 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.702 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8443", 2024-08-26T00:14:47.702 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.702 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.702 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.702 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.702 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.702 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.702 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.702 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_behaviour": { 2024-08-26T00:14:47.702 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_behaviour", 2024-08-26T00:14:47.703 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.703 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.703 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.703 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "redirect", 2024-08-26T00:14:47.703 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.703 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.703 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.703 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.703 INFO:teuthology.orchestra.run.smithi042.stdout: "redirect" 2024-08-26T00:14:47.703 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.703 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.703 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.703 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.703 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.704 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_error_status_code": { 2024-08-26T00:14:47.704 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_error_status_code", 2024-08-26T00:14:47.704 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.704 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.704 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.704 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "500", 2024-08-26T00:14:47.704 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "400", 2024-08-26T00:14:47.704 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "599", 2024-08-26T00:14:47.704 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.704 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.704 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.704 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.704 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.705 INFO:teuthology.orchestra.run.smithi042.stdout: "url_prefix": { 2024-08-26T00:14:47.705 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "url_prefix", 2024-08-26T00:14:47.705 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.705 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.705 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.705 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.705 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.705 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.705 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.705 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.705 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.705 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.705 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.706 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.706 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.706 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.706 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.706 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "devicehealth", 2024-08-26T00:14:47.706 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.706 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.706 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.706 INFO:teuthology.orchestra.run.smithi042.stdout: "enable_monitoring": { 2024-08-26T00:14:47.706 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enable_monitoring", 2024-08-26T00:14:47.706 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.706 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.706 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.706 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.707 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.707 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.707 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.707 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "monitor device health metrics", 2024-08-26T00:14:47.707 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.707 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.707 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.707 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.707 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.707 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.707 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.707 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.707 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.708 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.708 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.708 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.708 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.708 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.708 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.708 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.708 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.708 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.708 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.708 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.708 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.708 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.709 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.709 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.709 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.709 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.709 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.709 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.709 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.709 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.709 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.709 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.709 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.709 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.710 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.710 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.710 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.710 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.710 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.710 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.710 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.710 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.710 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.710 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.710 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.710 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.710 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.711 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.711 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.711 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.711 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.711 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.711 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.711 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.711 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.711 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.711 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.711 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.711 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.712 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.712 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.712 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.712 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.712 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.712 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.712 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.712 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.712 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.712 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.712 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.712 INFO:teuthology.orchestra.run.smithi042.stdout: "mark_out_threshold": { 2024-08-26T00:14:47.712 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mark_out_threshold", 2024-08-26T00:14:47.712 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.713 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.713 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.713 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "2419200", 2024-08-26T00:14:47.713 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.713 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.713 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.713 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-26T00:14:47.713 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.713 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.713 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.713 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.713 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": { 2024-08-26T00:14:47.713 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pool_name", 2024-08-26T00:14:47.714 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.714 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.714 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.714 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "device_health_metrics", 2024-08-26T00:14:47.714 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.714 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.714 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.714 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-26T00:14:47.714 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.714 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.714 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.714 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.714 INFO:teuthology.orchestra.run.smithi042.stdout: "retention_period": { 2024-08-26T00:14:47.714 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "retention_period", 2024-08-26T00:14:47.715 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.715 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.715 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.715 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15552000", 2024-08-26T00:14:47.715 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.715 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.715 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.715 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long to retain device health metrics", 2024-08-26T00:14:47.715 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.715 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.715 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.715 INFO:teuthology.orchestra.run.smithi042.stdout: "scrape_frequency": { 2024-08-26T00:14:47.716 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "scrape_frequency", 2024-08-26T00:14:47.716 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.716 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.716 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.716 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "86400", 2024-08-26T00:14:47.716 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.716 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.716 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.716 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-26T00:14:47.716 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.716 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.716 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.716 INFO:teuthology.orchestra.run.smithi042.stdout: "self_heal": { 2024-08-26T00:14:47.717 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "self_heal", 2024-08-26T00:14:47.717 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.717 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.717 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.717 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.717 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.717 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.717 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.717 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-26T00:14:47.717 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.717 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.717 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.718 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-08-26T00:14:47.718 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-08-26T00:14:47.718 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.718 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.718 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.718 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-08-26T00:14:47.718 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.718 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.718 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.718 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how frequently to wake up and check device health", 2024-08-26T00:14:47.718 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.718 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.718 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.718 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.719 INFO:teuthology.orchestra.run.smithi042.stdout: "warn_threshold": { 2024-08-26T00:14:47.719 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "warn_threshold", 2024-08-26T00:14:47.719 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.719 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.719 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.719 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "7257600", 2024-08-26T00:14:47.719 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.719 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.719 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.719 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-26T00:14:47.719 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.719 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.719 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.719 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.720 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.720 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.720 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "diskprediction_local", 2024-08-26T00:14:47.720 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.720 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.720 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.720 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.720 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.720 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.720 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.720 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.720 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.720 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.721 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.721 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.721 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.721 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.721 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.721 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.721 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.721 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.721 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.721 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.721 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.721 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.721 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.722 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.722 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.722 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.722 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.722 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.722 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.722 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.722 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.722 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.722 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.722 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.722 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.722 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.723 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.723 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.723 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.723 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.723 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.723 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.723 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.723 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.723 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.723 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.723 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.723 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.723 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.723 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.724 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.724 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.724 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.724 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.724 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.724 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.724 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.724 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.724 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.724 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.724 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.724 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.724 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.724 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.725 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.725 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.725 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.725 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.725 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.725 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.725 INFO:teuthology.orchestra.run.smithi042.stdout: "predict_interval": { 2024-08-26T00:14:47.725 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "predict_interval", 2024-08-26T00:14:47.725 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.725 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.725 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.726 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "86400", 2024-08-26T00:14:47.726 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.726 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.726 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.726 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.726 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.726 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.726 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.726 INFO:teuthology.orchestra.run.smithi042.stdout: "predictor_model": { 2024-08-26T00:14:47.726 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "predictor_model", 2024-08-26T00:14:47.726 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.727 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.727 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.727 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "prophetstor", 2024-08-26T00:14:47.727 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.727 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.727 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.727 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.727 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.727 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.727 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.727 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.727 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-08-26T00:14:47.727 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-08-26T00:14:47.728 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.728 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.728 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.728 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "600", 2024-08-26T00:14:47.728 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.728 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.728 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.728 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.728 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.728 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.728 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.728 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.728 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.729 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.729 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "influx", 2024-08-26T00:14:47.729 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": false, 2024-08-26T00:14:47.729 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "influxdb python module not found", 2024-08-26T00:14:47.729 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.729 INFO:teuthology.orchestra.run.smithi042.stdout: "batch_size": { 2024-08-26T00:14:47.729 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "batch_size", 2024-08-26T00:14:47.729 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.729 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.729 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.729 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5000", 2024-08-26T00:14:47.729 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.729 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.730 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.730 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-26T00:14:47.730 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.730 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.730 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.730 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.730 INFO:teuthology.orchestra.run.smithi042.stdout: "database": { 2024-08-26T00:14:47.730 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "database", 2024-08-26T00:14:47.730 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.730 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.730 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.730 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "ceph", 2024-08-26T00:14:47.730 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.730 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.731 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.731 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-26T00:14:47.731 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.731 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.731 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.731 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.731 INFO:teuthology.orchestra.run.smithi042.stdout: "hostname": { 2024-08-26T00:14:47.731 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "hostname", 2024-08-26T00:14:47.731 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.731 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.731 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.731 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.731 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.732 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.732 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.732 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB server hostname", 2024-08-26T00:14:47.732 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.732 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.732 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.732 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.732 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-08-26T00:14:47.732 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-08-26T00:14:47.732 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.732 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.732 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.732 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "30", 2024-08-26T00:14:47.732 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "5", 2024-08-26T00:14:47.733 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.733 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.733 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-26T00:14:47.733 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.733 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.733 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.733 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.733 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.733 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.733 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.733 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.733 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.733 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.733 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.734 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.734 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.734 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.734 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.734 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.734 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.734 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.734 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.734 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.734 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.734 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.734 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.734 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.735 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.735 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.735 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.735 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.735 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.735 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.735 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.735 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.735 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.735 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.735 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.735 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.735 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.736 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.736 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.736 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.736 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.736 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.736 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.736 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.736 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.736 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.736 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.736 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.736 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.736 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.736 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.737 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.737 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.737 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.737 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.737 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.737 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.737 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.737 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.737 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.737 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.737 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.737 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.737 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.737 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.738 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.738 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.738 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.738 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.738 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.738 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.738 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.738 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.738 INFO:teuthology.orchestra.run.smithi042.stdout: "password": { 2024-08-26T00:14:47.738 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "password", 2024-08-26T00:14:47.738 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.738 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.738 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.738 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.739 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.739 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.739 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.739 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "password of InfluxDB server user", 2024-08-26T00:14:47.739 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.739 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.739 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.739 INFO:teuthology.orchestra.run.smithi042.stdout: "port": { 2024-08-26T00:14:47.739 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "port", 2024-08-26T00:14:47.739 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.739 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.739 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.739 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "8086", 2024-08-26T00:14:47.740 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.740 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.740 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.740 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "InfluxDB server port", 2024-08-26T00:14:47.740 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.740 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.740 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.740 INFO:teuthology.orchestra.run.smithi042.stdout: "ssl": { 2024-08-26T00:14:47.740 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ssl", 2024-08-26T00:14:47.740 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.740 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.740 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.740 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "false", 2024-08-26T00:14:47.741 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.741 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.741 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.741 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-26T00:14:47.741 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.741 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.741 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.741 INFO:teuthology.orchestra.run.smithi042.stdout: "threads": { 2024-08-26T00:14:47.741 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "threads", 2024-08-26T00:14:47.741 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.741 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.741 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.741 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-08-26T00:14:47.742 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-08-26T00:14:47.742 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "32", 2024-08-26T00:14:47.742 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.742 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-26T00:14:47.742 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.742 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.742 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.742 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.742 INFO:teuthology.orchestra.run.smithi042.stdout: "username": { 2024-08-26T00:14:47.742 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "username", 2024-08-26T00:14:47.742 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.742 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.742 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.743 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.743 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.743 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.743 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.743 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "username of InfluxDB server user", 2024-08-26T00:14:47.743 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.743 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.743 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.743 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.743 INFO:teuthology.orchestra.run.smithi042.stdout: "verify_ssl": { 2024-08-26T00:14:47.743 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "verify_ssl", 2024-08-26T00:14:47.743 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.743 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.744 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.744 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "true", 2024-08-26T00:14:47.744 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.744 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.744 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.744 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-26T00:14:47.744 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.744 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.744 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.744 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.744 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.744 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.744 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.744 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "insights", 2024-08-26T00:14:47.745 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.745 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.745 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.745 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.745 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.745 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.745 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.745 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.745 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.745 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.745 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.745 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.745 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.745 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.746 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.746 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.746 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.746 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.746 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.746 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.746 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.746 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.746 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.746 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.746 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.746 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.746 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.747 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.747 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.747 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.747 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.747 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.747 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.747 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.747 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.747 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.747 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.747 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.747 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.747 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.748 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.748 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.748 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.748 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.748 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.748 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.748 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.748 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.748 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.748 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.748 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.748 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.748 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.748 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.749 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.749 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.749 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.749 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.749 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.749 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.749 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.749 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.749 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.749 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.749 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.749 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.749 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.750 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.750 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.750 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.750 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.750 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.750 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.750 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.750 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.750 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "iostat", 2024-08-26T00:14:47.750 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.750 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.750 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.750 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.750 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.751 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.751 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.751 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.751 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.751 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.751 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.751 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.751 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.751 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.751 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.751 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.751 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.751 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.751 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.752 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.752 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.752 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.752 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.752 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.752 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.752 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.752 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.752 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.752 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.752 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.752 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.752 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.753 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.753 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.753 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.753 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.753 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.753 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.753 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.753 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.753 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.753 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.753 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.753 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.753 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.754 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.754 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.754 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.754 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.754 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.754 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.754 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.754 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.754 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.754 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.754 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.754 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.754 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.755 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.755 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.755 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.755 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.755 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.755 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.755 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.755 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.755 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.755 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.755 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.755 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.755 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.755 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.756 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.756 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.756 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "k8sevents", 2024-08-26T00:14:47.756 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.756 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.756 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.756 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_event_retention_days": { 2024-08-26T00:14:47.756 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "ceph_event_retention_days", 2024-08-26T00:14:47.756 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.756 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.756 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.756 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "7", 2024-08-26T00:14:47.756 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.756 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.757 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.757 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-26T00:14:47.757 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.757 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.757 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.757 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.757 INFO:teuthology.orchestra.run.smithi042.stdout: "config_check_secs": { 2024-08-26T00:14:47.757 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "config_check_secs", 2024-08-26T00:14:47.757 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.757 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.757 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.757 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:47.757 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "10", 2024-08-26T00:14:47.757 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.758 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.758 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-26T00:14:47.758 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.758 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.758 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.758 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.758 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.758 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.758 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.758 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.758 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.758 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.759 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.759 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.759 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.759 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.759 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.759 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.759 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.759 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.759 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.759 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.759 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.759 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.759 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.759 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.760 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.760 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.760 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.760 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.760 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.760 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.760 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.760 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.760 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.760 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.760 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.760 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.760 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.761 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.761 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.761 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.761 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.761 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.761 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.761 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.761 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.761 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.761 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.761 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.761 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.761 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.761 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.762 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.762 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.762 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.762 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.762 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.762 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.762 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.762 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.762 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.762 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.762 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.762 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.762 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.763 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.763 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.763 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.763 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.763 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.763 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.763 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.763 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.763 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.763 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.763 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "localpool", 2024-08-26T00:14:47.763 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.764 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.764 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.764 INFO:teuthology.orchestra.run.smithi042.stdout: "failure_domain": { 2024-08-26T00:14:47.764 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "failure_domain", 2024-08-26T00:14:47.764 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.764 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.764 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.764 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "host", 2024-08-26T00:14:47.764 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.764 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.764 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.764 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "failure domain for any created local pool", 2024-08-26T00:14:47.764 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-26T00:14:47.764 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.765 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.765 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.765 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.765 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.765 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.765 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.765 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.765 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.765 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.765 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.765 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.765 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.765 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.766 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.766 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.766 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.766 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.766 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.766 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.766 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.766 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.766 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.766 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.766 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.766 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.767 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.767 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.767 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.767 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.767 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.767 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.767 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.767 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.767 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.767 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.767 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.767 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.767 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.768 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.768 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.768 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.768 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.768 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.768 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.768 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.768 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.768 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.768 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.768 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.768 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.768 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.769 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.769 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.769 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.769 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.769 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.769 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.769 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.769 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.769 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.769 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.769 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.769 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.769 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.769 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.770 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.770 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.770 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.770 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.770 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": { 2024-08-26T00:14:47.770 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "min_size", 2024-08-26T00:14:47.770 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.770 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.770 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.770 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.770 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.770 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.770 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.771 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default min_size for any created local pool", 2024-08-26T00:14:47.771 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-26T00:14:47.771 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.771 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.771 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.771 INFO:teuthology.orchestra.run.smithi042.stdout: "num_rep": { 2024-08-26T00:14:47.771 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "num_rep", 2024-08-26T00:14:47.771 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.771 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.771 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.771 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3", 2024-08-26T00:14:47.771 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.771 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.771 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.772 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default replica count for any created local pool", 2024-08-26T00:14:47.772 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.772 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.772 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.772 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.772 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": { 2024-08-26T00:14:47.772 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pg_num", 2024-08-26T00:14:47.772 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.772 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.772 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.772 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "128", 2024-08-26T00:14:47.772 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.772 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.772 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.773 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "default pg_num for any created local pool", 2024-08-26T00:14:47.773 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.773 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.773 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.773 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.773 INFO:teuthology.orchestra.run.smithi042.stdout: "prefix": { 2024-08-26T00:14:47.773 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prefix", 2024-08-26T00:14:47.773 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.773 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.773 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.773 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.773 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.773 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.773 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.774 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "name prefix for any created local pool", 2024-08-26T00:14:47.774 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.774 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.774 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.774 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.774 INFO:teuthology.orchestra.run.smithi042.stdout: "subtree": { 2024-08-26T00:14:47.774 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "subtree", 2024-08-26T00:14:47.774 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.774 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.774 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.774 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "rack", 2024-08-26T00:14:47.774 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.774 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.775 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.775 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-26T00:14:47.775 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-26T00:14:47.775 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.775 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.775 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.775 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.775 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.775 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.775 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mds_autoscaler", 2024-08-26T00:14:47.775 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.775 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.775 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.775 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.775 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.776 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.776 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.776 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.776 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.776 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.776 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.776 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.776 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.776 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.776 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.776 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.776 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.776 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.777 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.777 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.777 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.777 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.777 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.777 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.777 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.777 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.777 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.777 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.777 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.777 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.777 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.777 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.778 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.778 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.778 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.778 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.778 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.778 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.778 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.778 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.778 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.778 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.778 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.778 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.778 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.778 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.779 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.779 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.779 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.779 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.779 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.779 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.779 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.779 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.779 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.779 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.779 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.779 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.779 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.780 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.780 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.780 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.780 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.780 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.780 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.780 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.780 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.780 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.780 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.780 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.780 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.780 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.780 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.781 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.781 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.781 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.781 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mirroring", 2024-08-26T00:14:47.781 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.781 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.781 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.781 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.781 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.781 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.781 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.781 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.781 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.781 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.782 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.782 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.782 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.782 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.782 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.782 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.782 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.782 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.782 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.782 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.782 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.782 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.782 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.782 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.783 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.783 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.783 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.783 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.783 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.783 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.783 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.783 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.783 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.783 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.783 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.783 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.783 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.784 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.784 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.784 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.784 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.784 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.784 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.784 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.784 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.784 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.784 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.784 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.784 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.784 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.784 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.785 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.785 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.785 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.785 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.785 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.785 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.785 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.785 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.785 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.785 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.785 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.785 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.785 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.785 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.786 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.786 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.786 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.786 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.786 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.786 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.786 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.786 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.786 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.786 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.786 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.786 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "nfs", 2024-08-26T00:14:47.786 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.786 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.787 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.787 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.787 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.787 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.787 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.787 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.787 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.787 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.787 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.787 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.787 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.787 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.787 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.787 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.788 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.788 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.788 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.788 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.788 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.788 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.788 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.788 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.788 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.788 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.788 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.788 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.788 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.789 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.789 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.789 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.789 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.789 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.789 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.789 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.789 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.789 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.789 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.789 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.789 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.789 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.790 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.790 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.790 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.790 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.790 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.790 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.790 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.790 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.790 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.790 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.790 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.790 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.790 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.790 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.791 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.791 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.791 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.791 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.791 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.791 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.791 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.791 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.791 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.791 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.791 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.791 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.791 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.791 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.792 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.792 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.792 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.792 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.792 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.792 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "orchestrator", 2024-08-26T00:14:47.792 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.792 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.792 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.792 INFO:teuthology.orchestra.run.smithi042.stdout: "fail_fs": { 2024-08-26T00:14:47.792 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "fail_fs", 2024-08-26T00:14:47.792 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.792 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.792 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.793 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.793 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.793 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.793 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.793 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-26T00:14:47.793 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.793 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.793 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.793 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.793 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.793 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.793 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.793 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.793 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.794 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.794 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.794 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.794 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.794 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.794 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.794 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.794 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.794 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.794 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.794 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.794 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.794 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.796 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.796 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.796 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.796 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.796 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.796 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.796 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.796 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.796 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.796 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.796 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.796 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.796 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.797 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.797 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.797 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.797 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.797 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.797 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.797 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.797 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.797 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.797 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.797 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.797 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.797 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.797 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.798 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.798 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.798 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.798 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.798 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.798 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.798 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.798 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.798 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.798 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.798 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.798 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator": { 2024-08-26T00:14:47.798 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "orchestrator", 2024-08-26T00:14:47.799 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.799 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.799 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.799 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.799 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.799 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.799 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.799 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm", 2024-08-26T00:14:47.799 INFO:teuthology.orchestra.run.smithi042.stdout: "rook", 2024-08-26T00:14:47.799 INFO:teuthology.orchestra.run.smithi042.stdout: "test_orchestrator" 2024-08-26T00:14:47.799 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.799 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Orchestrator backend", 2024-08-26T00:14:47.799 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.799 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.800 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.800 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.800 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.800 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.800 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.800 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "osd_perf_query", 2024-08-26T00:14:47.800 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.800 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.800 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.800 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.800 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.800 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.800 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.800 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.801 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.801 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.801 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.801 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.801 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.801 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.801 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.801 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.801 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.801 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.801 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.801 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.801 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.801 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.802 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.802 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.802 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.802 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.802 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.802 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.802 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.802 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.802 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.802 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.802 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.802 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.802 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.803 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.803 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.803 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.803 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.803 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.803 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.803 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.803 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.803 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.803 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.803 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.803 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.803 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.803 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.804 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.804 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.804 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.804 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.804 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.804 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.804 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.804 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.804 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.804 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.804 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.804 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.804 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.804 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.805 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.805 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.805 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.805 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.805 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.805 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.805 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.805 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.805 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.805 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.805 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.805 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.805 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.805 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "osd_support", 2024-08-26T00:14:47.806 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.806 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.806 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.806 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.806 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.806 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.806 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.806 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.806 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.806 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.806 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.806 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.806 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.806 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.807 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.807 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.807 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.807 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.807 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.807 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.807 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.807 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.807 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.807 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.807 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.807 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.807 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.808 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.808 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.808 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.808 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.808 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.808 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.808 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.808 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.808 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.808 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.808 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.808 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.808 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.809 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.809 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.809 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.809 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.809 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.809 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.809 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.809 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.809 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.809 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.809 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.809 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.809 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.809 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.809 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.810 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.810 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.810 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.810 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.810 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.810 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.810 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.810 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.810 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.810 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.810 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.810 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.810 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.811 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.811 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.811 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.811 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.811 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.811 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.811 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.811 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "pg_autoscaler", 2024-08-26T00:14:47.811 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.811 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.811 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.811 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.811 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.811 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.812 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.812 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.812 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.812 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.812 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.812 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.812 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.812 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.812 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.812 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.812 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.812 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.812 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.812 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.813 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.813 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.813 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.813 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.813 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.813 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.813 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.813 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.813 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.813 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.813 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.813 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.813 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.814 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.814 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.814 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.814 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.814 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.814 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.814 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.814 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.814 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.814 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.814 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.814 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.814 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.814 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.815 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.815 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.815 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.815 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.815 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.815 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.815 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.815 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.815 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.815 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.815 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.815 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.816 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.816 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.816 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.816 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.816 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.816 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.816 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.816 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.816 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.816 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.816 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.816 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.816 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-08-26T00:14:47.817 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-08-26T00:14:47.817 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.817 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.817 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.817 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-08-26T00:14:47.817 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.817 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.817 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.817 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.817 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.817 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.817 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.817 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.817 INFO:teuthology.orchestra.run.smithi042.stdout: "threshold": { 2024-08-26T00:14:47.818 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "threshold", 2024-08-26T00:14:47.818 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-08-26T00:14:47.818 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.818 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.818 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "3.0", 2024-08-26T00:14:47.818 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1.0", 2024-08-26T00:14:47.818 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.818 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.818 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "scaling threshold", 2024-08-26T00:14:47.818 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-26T00:14:47.818 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.818 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.818 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.819 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.819 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.819 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.819 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "progress", 2024-08-26T00:14:47.819 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.819 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.819 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.819 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_pg_recovery_event": { 2024-08-26T00:14:47.819 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_pg_recovery_event", 2024-08-26T00:14:47.819 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.819 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.819 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.819 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.819 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.820 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.820 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.820 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-26T00:14:47.820 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.820 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.820 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.820 INFO:teuthology.orchestra.run.smithi042.stdout: "enabled": { 2024-08-26T00:14:47.820 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enabled", 2024-08-26T00:14:47.820 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.820 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.820 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.820 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.821 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.821 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.821 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.821 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.821 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.821 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.821 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.821 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.821 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.821 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.821 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.821 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.821 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.821 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.822 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.822 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.822 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.822 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.822 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.822 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.822 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.822 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.822 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.822 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.822 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.822 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.822 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.823 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.823 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.823 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.823 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.823 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.823 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.823 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.823 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.823 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.823 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.823 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.823 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.823 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.823 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.824 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.824 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.824 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.824 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.824 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.824 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.824 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.824 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.824 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.824 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.824 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.824 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.824 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.825 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.825 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.825 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.825 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.825 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.825 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.825 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.825 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.825 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.825 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.825 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.825 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.825 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.825 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.826 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.826 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.826 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.826 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.826 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.826 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.826 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.826 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.826 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.826 INFO:teuthology.orchestra.run.smithi042.stdout: "max_completed_events": { 2024-08-26T00:14:47.826 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_completed_events", 2024-08-26T00:14:47.826 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.826 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.826 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.827 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "50", 2024-08-26T00:14:47.827 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.827 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.827 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.827 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "number of past completed events to remember", 2024-08-26T00:14:47.827 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.827 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.827 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.827 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.827 INFO:teuthology.orchestra.run.smithi042.stdout: "sleep_interval": { 2024-08-26T00:14:47.827 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "sleep_interval", 2024-08-26T00:14:47.827 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.827 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.827 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.828 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "5", 2024-08-26T00:14:47.828 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.828 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.828 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.828 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "how long the module is going to sleep", 2024-08-26T00:14:47.828 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.828 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.828 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.828 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.828 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.828 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.828 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.828 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "prometheus", 2024-08-26T00:14:47.828 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.829 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.829 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.829 INFO:teuthology.orchestra.run.smithi042.stdout: "cache": { 2024-08-26T00:14:47.829 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cache", 2024-08-26T00:14:47.829 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.829 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.829 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.829 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.829 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.829 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.829 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.829 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.829 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.829 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.830 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.830 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.830 INFO:teuthology.orchestra.run.smithi042.stdout: "exclude_perf_counters": { 2024-08-26T00:14:47.830 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "exclude_perf_counters", 2024-08-26T00:14:47.830 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.830 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.830 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.830 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.830 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.830 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.830 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.830 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-26T00:14:47.830 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-26T00:14:47.831 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.831 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.831 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.831 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.831 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.831 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.831 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.831 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.831 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.831 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.831 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.831 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.831 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.832 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.832 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.832 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.832 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.832 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.832 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.832 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.832 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.832 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.832 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.832 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.832 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.832 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.832 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.833 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.833 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.833 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.833 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.833 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.833 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.833 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.833 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.833 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.833 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.833 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.833 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.833 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.833 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.834 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.834 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.834 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.834 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.834 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.834 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.834 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.834 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.834 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.834 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.834 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.834 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.834 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.835 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.835 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.835 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.835 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.835 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.835 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.835 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.835 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.835 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.835 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.835 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.835 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.835 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.835 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.836 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.836 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.836 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.836 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.836 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.836 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_stats_pools": { 2024-08-26T00:14:47.836 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_stats_pools", 2024-08-26T00:14:47.836 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.836 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.836 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.836 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.836 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.836 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.836 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.837 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.837 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.837 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.837 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.837 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.837 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-26T00:14:47.837 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-26T00:14:47.837 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.837 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.837 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.837 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "300", 2024-08-26T00:14:47.837 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.837 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.838 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.838 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.838 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.838 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.838 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.838 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.838 INFO:teuthology.orchestra.run.smithi042.stdout: "scrape_interval": { 2024-08-26T00:14:47.838 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "scrape_interval", 2024-08-26T00:14:47.838 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-08-26T00:14:47.838 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.838 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.838 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15.0", 2024-08-26T00:14:47.838 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.838 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.839 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.839 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.839 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.839 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.839 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.839 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.839 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-08-26T00:14:47.839 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-08-26T00:14:47.839 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.839 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.839 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.839 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "::", 2024-08-26T00:14:47.839 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.839 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.840 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.840 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-26T00:14:47.840 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.840 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.840 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.840 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.840 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-08-26T00:14:47.840 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-08-26T00:14:47.840 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.840 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.840 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.840 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "9283", 2024-08-26T00:14:47.840 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.840 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.841 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.841 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-26T00:14:47.841 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.841 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.841 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.841 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.841 INFO:teuthology.orchestra.run.smithi042.stdout: "stale_cache_strategy": { 2024-08-26T00:14:47.841 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "stale_cache_strategy", 2024-08-26T00:14:47.841 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.841 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.841 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.841 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "log", 2024-08-26T00:14:47.841 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.841 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.842 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.842 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.842 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.842 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.842 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.842 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.842 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_behaviour": { 2024-08-26T00:14:47.842 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_behaviour", 2024-08-26T00:14:47.842 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.842 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.842 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.842 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "default", 2024-08-26T00:14:47.842 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.843 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.843 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.843 INFO:teuthology.orchestra.run.smithi042.stdout: "default", 2024-08-26T00:14:47.843 INFO:teuthology.orchestra.run.smithi042.stdout: "error" 2024-08-26T00:14:47.843 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.843 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.843 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.843 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.843 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.843 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.843 INFO:teuthology.orchestra.run.smithi042.stdout: "standby_error_status_code": { 2024-08-26T00:14:47.843 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "standby_error_status_code", 2024-08-26T00:14:47.843 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.843 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.844 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.844 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "500", 2024-08-26T00:14:47.844 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "400", 2024-08-26T00:14:47.844 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "599", 2024-08-26T00:14:47.844 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.844 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.844 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.844 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.844 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.844 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.844 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.844 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.844 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.844 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_support", 2024-08-26T00:14:47.845 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.845 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.845 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.845 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.845 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.845 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.845 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.845 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.845 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.845 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.845 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.845 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.845 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.845 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.846 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.846 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.846 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.846 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.846 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.846 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.846 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.846 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.846 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.846 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.846 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.846 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.846 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.847 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.847 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.847 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.847 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.847 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.847 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.847 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.847 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.847 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.847 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.847 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.847 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.847 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.847 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.848 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.848 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.848 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.852 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.852 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.852 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.852 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.852 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.853 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.853 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.853 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.853 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.853 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.853 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.853 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.853 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.853 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.853 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.853 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.853 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.853 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.853 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.854 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.854 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.854 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.854 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.854 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.854 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.854 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.854 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.854 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.854 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.854 INFO:teuthology.orchestra.run.smithi042.stdout: "max_concurrent_snap_create": { 2024-08-26T00:14:47.854 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_concurrent_snap_create", 2024-08-26T00:14:47.854 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.855 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.855 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.855 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10", 2024-08-26T00:14:47.855 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.855 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.855 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.855 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.855 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.855 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.855 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.855 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.855 INFO:teuthology.orchestra.run.smithi042.stdout: "mirror_snapshot_schedule": { 2024-08-26T00:14:47.855 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mirror_snapshot_schedule", 2024-08-26T00:14:47.856 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.856 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.856 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.856 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.856 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.856 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.856 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.856 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.856 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.856 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.856 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.856 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.856 INFO:teuthology.orchestra.run.smithi042.stdout: "trash_purge_schedule": { 2024-08-26T00:14:47.856 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "trash_purge_schedule", 2024-08-26T00:14:47.857 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.857 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.857 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.857 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.857 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.857 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.857 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.857 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.857 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.857 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.857 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.857 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.857 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.858 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.858 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.858 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "restful", 2024-08-26T00:14:47.858 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.858 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.858 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.858 INFO:teuthology.orchestra.run.smithi042.stdout: "enable_auth": { 2024-08-26T00:14:47.858 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enable_auth", 2024-08-26T00:14:47.858 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.858 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.858 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.858 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.858 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.858 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.859 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.859 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.859 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.859 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.859 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.859 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.859 INFO:teuthology.orchestra.run.smithi042.stdout: "key_file": { 2024-08-26T00:14:47.859 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "key_file", 2024-08-26T00:14:47.859 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.859 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.859 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.859 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.859 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.860 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.860 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.860 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.860 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.860 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.860 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.860 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.860 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.860 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.860 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.860 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.860 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.860 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.860 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.861 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.861 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.861 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.861 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.861 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.861 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.861 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.861 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.861 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.861 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.861 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.861 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.861 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.861 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.861 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.862 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.862 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.862 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.862 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.862 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.862 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.862 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.862 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.862 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.862 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.862 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.862 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.862 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.863 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.863 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.863 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.863 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.863 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.863 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.863 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.863 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.863 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.863 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.863 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.863 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.863 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.863 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.864 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.864 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.864 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.864 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.864 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.864 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.864 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.864 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.864 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.864 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.864 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.864 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.864 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.864 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.865 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.865 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.865 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.865 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.865 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.865 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.865 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.865 INFO:teuthology.orchestra.run.smithi042.stdout: "server_addr": { 2024-08-26T00:14:47.865 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_addr", 2024-08-26T00:14:47.865 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.865 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.865 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.865 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.865 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.865 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.866 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.866 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.866 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.866 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.866 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.866 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.866 INFO:teuthology.orchestra.run.smithi042.stdout: "server_port": { 2024-08-26T00:14:47.866 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "server_port", 2024-08-26T00:14:47.866 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.866 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.866 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.866 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.866 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.866 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.867 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.867 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.867 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.867 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.867 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.867 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.867 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.867 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.867 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.867 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rgw", 2024-08-26T00:14:47.867 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.867 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.867 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.867 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.868 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.868 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.868 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.868 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.868 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.868 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.868 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.868 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.868 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.868 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.868 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.868 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.868 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.869 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.869 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.869 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.869 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.869 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.869 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.869 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.869 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.869 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.869 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.869 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.869 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.869 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.869 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.870 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.870 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.870 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.870 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.870 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.870 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.870 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.870 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.870 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.870 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.870 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.870 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.870 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.871 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.871 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.871 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.871 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.871 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.871 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.871 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.871 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.871 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.871 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.871 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.871 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.871 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.871 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.872 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.872 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.872 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.872 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.872 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.872 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.872 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.872 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.872 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.872 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.872 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.872 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.872 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.873 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.873 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.873 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.873 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.873 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.873 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rook", 2024-08-26T00:14:47.873 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.873 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.873 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.873 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.873 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.873 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.873 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.873 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.874 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.874 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.874 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.874 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.874 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.874 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.874 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.874 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.874 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.874 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.874 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.874 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.874 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.874 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.875 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.875 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.875 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.875 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.875 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.875 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.875 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.875 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.875 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.875 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.875 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.875 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.875 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.875 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.876 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.876 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.876 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.876 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.876 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.876 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.876 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.876 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.876 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.876 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.876 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.876 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.876 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.876 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.877 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.877 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.877 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.877 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.877 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.877 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.877 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.877 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.877 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.877 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.877 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.877 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.877 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.877 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.878 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.878 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.878 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.878 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.878 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.878 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.878 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.878 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.878 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.878 INFO:teuthology.orchestra.run.smithi042.stdout: "storage_class": { 2024-08-26T00:14:47.878 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "storage_class", 2024-08-26T00:14:47.878 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.878 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.878 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.879 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "local", 2024-08-26T00:14:47.879 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.879 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.879 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.879 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-26T00:14:47.879 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.879 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.879 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.879 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.879 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.879 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.879 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.879 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "selftest", 2024-08-26T00:14:47.879 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.880 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.880 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.880 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.880 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.880 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.880 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.880 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.880 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.880 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.880 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.880 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.880 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.880 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.880 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.881 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.881 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.881 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.881 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.881 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.881 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.881 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.881 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.881 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.881 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.881 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.881 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.881 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.881 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.882 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.882 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.882 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.882 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.882 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.882 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.882 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.882 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.882 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.882 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.882 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.882 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.882 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.882 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.883 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.883 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.883 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.883 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.883 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.883 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.883 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.883 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.883 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.883 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.883 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.883 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.883 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.883 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.884 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.884 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.884 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.884 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.884 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.884 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.884 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.884 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.884 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.884 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.884 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.884 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.884 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.884 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.884 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.885 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.885 INFO:teuthology.orchestra.run.smithi042.stdout: "roption1": { 2024-08-26T00:14:47.885 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "roption1", 2024-08-26T00:14:47.885 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.885 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.885 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.885 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.885 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.885 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.885 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.885 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.885 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.885 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.886 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.886 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.886 INFO:teuthology.orchestra.run.smithi042.stdout: "roption2": { 2024-08-26T00:14:47.886 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "roption2", 2024-08-26T00:14:47.886 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.886 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.886 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.886 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "xyz", 2024-08-26T00:14:47.886 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.886 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.886 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.886 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.886 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.887 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.887 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.887 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.887 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption1": { 2024-08-26T00:14:47.887 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption1", 2024-08-26T00:14:47.887 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.887 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.887 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.887 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.887 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.887 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.887 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.887 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.887 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.888 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.888 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.888 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.888 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption2": { 2024-08-26T00:14:47.888 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption2", 2024-08-26T00:14:47.888 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.888 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.888 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.888 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.888 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.888 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.888 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.888 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.888 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.889 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.889 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.889 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.889 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption3": { 2024-08-26T00:14:47.889 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption3", 2024-08-26T00:14:47.889 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "float", 2024-08-26T00:14:47.889 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.889 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.889 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.889 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.889 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.889 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.889 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.890 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.890 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.890 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.890 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.890 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption4": { 2024-08-26T00:14:47.890 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption4", 2024-08-26T00:14:47.890 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.890 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.890 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.890 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.890 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.890 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.890 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.890 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.891 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.891 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.891 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.891 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.891 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption5": { 2024-08-26T00:14:47.891 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption5", 2024-08-26T00:14:47.891 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.891 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.891 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.891 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.891 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.891 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.891 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.891 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.892 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.892 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.892 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.892 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.892 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption6": { 2024-08-26T00:14:47.892 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption6", 2024-08-26T00:14:47.892 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.892 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.892 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.892 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.892 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.892 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.892 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.893 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.893 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.893 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.893 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.893 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.893 INFO:teuthology.orchestra.run.smithi042.stdout: "rwoption7": { 2024-08-26T00:14:47.893 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rwoption7", 2024-08-26T00:14:47.893 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.893 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.893 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.893 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.893 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "1", 2024-08-26T00:14:47.893 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "42", 2024-08-26T00:14:47.893 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.894 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.894 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.894 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.894 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.894 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.894 INFO:teuthology.orchestra.run.smithi042.stdout: "testkey": { 2024-08-26T00:14:47.894 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testkey", 2024-08-26T00:14:47.894 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.894 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.894 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.894 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.894 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.894 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.894 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.895 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.895 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.895 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.895 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.895 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.895 INFO:teuthology.orchestra.run.smithi042.stdout: "testlkey": { 2024-08-26T00:14:47.895 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testlkey", 2024-08-26T00:14:47.895 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.895 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.895 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.895 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.895 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.895 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.895 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.896 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.896 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.896 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.896 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.896 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.896 INFO:teuthology.orchestra.run.smithi042.stdout: "testnewline": { 2024-08-26T00:14:47.896 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "testnewline", 2024-08-26T00:14:47.896 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.896 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.896 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.896 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.896 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.896 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.896 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.897 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.897 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.897 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.897 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.897 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.897 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.897 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.897 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.897 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snap_schedule", 2024-08-26T00:14:47.897 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.897 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.897 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.897 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_m_granularity": { 2024-08-26T00:14:47.897 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "allow_m_granularity", 2024-08-26T00:14:47.898 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.898 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.898 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.898 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.898 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.898 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.898 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.898 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "allow minute scheduled snapshots", 2024-08-26T00:14:47.898 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.898 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.898 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.898 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.898 INFO:teuthology.orchestra.run.smithi042.stdout: "dump_on_update": { 2024-08-26T00:14:47.899 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "dump_on_update", 2024-08-26T00:14:47.899 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.899 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.899 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.899 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.899 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.899 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.899 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.899 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "dump database to debug log on update", 2024-08-26T00:14:47.899 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.899 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.899 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.899 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.899 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.900 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.900 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.900 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.900 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.900 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.900 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.900 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.900 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.900 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.900 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.900 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.900 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.900 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.900 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.901 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.901 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.901 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.901 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.901 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.901 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.901 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.901 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.901 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.901 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.901 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.901 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.901 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.901 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.902 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.902 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.902 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.902 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.902 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.902 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.902 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.902 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.902 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.902 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.902 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.902 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.902 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.903 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.903 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.903 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.903 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.903 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.903 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.903 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.903 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.903 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.903 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.903 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.903 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.903 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.903 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.904 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.904 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.904 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.904 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.904 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.904 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.904 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.904 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.904 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.904 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.904 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.904 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.904 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.905 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.905 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.905 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.905 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.905 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "stats", 2024-08-26T00:14:47.905 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.905 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.905 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.905 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.905 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.905 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.905 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.905 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.905 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.906 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.906 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.906 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.906 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.906 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.906 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.906 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.906 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.906 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.906 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.906 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.906 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.906 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.906 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.907 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.907 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.907 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.907 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.907 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.907 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.907 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.907 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.907 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.907 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.907 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.907 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.907 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.908 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.908 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.908 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.908 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.908 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.908 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.908 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.908 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.908 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.908 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.908 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.908 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.908 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.908 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.909 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.909 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.909 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.909 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.909 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.909 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.909 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.909 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.909 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.909 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.909 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.909 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.909 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.910 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.910 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.910 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.910 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.910 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.910 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.910 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.910 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.910 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.910 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.910 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.910 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.910 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.911 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "status", 2024-08-26T00:14:47.911 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.911 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.911 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.911 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.911 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.911 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.911 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.911 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.911 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.911 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.911 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.911 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.911 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.912 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.912 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.912 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.912 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.912 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.912 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.912 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.912 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.912 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.912 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.912 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.912 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.912 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.913 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.913 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.913 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.913 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.913 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.913 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.913 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.913 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.913 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.913 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.913 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.913 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.913 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.913 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.914 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.914 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.914 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.914 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.914 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.914 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.914 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.914 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.914 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.914 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.914 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.914 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.914 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.914 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.915 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.915 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.915 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.915 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.915 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.915 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.915 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.915 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.915 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.915 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.915 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.915 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.915 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.915 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.916 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.916 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.916 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.916 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.916 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.916 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.916 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.916 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.916 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "telegraf", 2024-08-26T00:14:47.916 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.916 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.916 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.916 INFO:teuthology.orchestra.run.smithi042.stdout: "address": { 2024-08-26T00:14:47.916 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "address", 2024-08-26T00:14:47.917 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.917 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.917 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.917 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-26T00:14:47.917 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.917 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.917 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.917 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.917 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.917 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.917 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.917 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.917 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-08-26T00:14:47.917 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-08-26T00:14:47.918 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.918 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.918 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.918 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "15", 2024-08-26T00:14:47.918 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.918 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.918 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.918 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.918 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.918 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.918 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.918 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.918 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.918 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.919 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.919 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.919 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.919 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.919 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.919 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.919 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.919 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.919 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.919 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.919 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.919 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.919 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.919 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.920 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.920 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.920 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.920 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.920 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.920 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.920 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.920 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.920 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.920 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.920 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.920 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.920 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.920 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.921 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.921 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.921 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.921 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.921 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.921 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.921 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.921 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.921 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.921 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.921 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.921 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.921 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.921 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.922 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.922 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.922 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.922 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.922 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.922 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.922 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.922 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.922 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.922 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.922 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.922 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.922 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.923 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.923 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.923 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.923 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.923 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.923 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.923 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.923 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.923 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.923 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.923 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.923 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.923 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.923 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.924 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.924 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.924 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "telemetry", 2024-08-26T00:14:47.924 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.924 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.924 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.924 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_basic": { 2024-08-26T00:14:47.924 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_basic", 2024-08-26T00:14:47.924 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.924 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.924 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.924 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.924 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.924 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.925 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.925 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-26T00:14:47.925 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.925 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.925 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.925 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.925 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_crash": { 2024-08-26T00:14:47.925 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_crash", 2024-08-26T00:14:47.925 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.925 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.925 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.925 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.925 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.925 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.926 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.926 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-26T00:14:47.926 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.926 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.926 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.926 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.926 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_device": { 2024-08-26T00:14:47.926 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_device", 2024-08-26T00:14:47.926 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.926 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.926 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.926 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.926 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.927 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.927 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.927 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-26T00:14:47.927 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.927 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.927 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.927 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.927 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_ident": { 2024-08-26T00:14:47.927 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_ident", 2024-08-26T00:14:47.927 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.927 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.927 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.927 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.927 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.928 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.928 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.928 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-26T00:14:47.928 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.928 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.928 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.928 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.928 INFO:teuthology.orchestra.run.smithi042.stdout: "channel_perf": { 2024-08-26T00:14:47.928 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "channel_perf", 2024-08-26T00:14:47.928 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.928 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.928 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.928 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.928 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.929 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.929 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.929 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-26T00:14:47.929 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.929 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.929 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.929 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.929 INFO:teuthology.orchestra.run.smithi042.stdout: "contact": { 2024-08-26T00:14:47.929 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "contact", 2024-08-26T00:14:47.929 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.929 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.929 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.929 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.929 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.930 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.930 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.930 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.930 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.930 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.930 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.930 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.930 INFO:teuthology.orchestra.run.smithi042.stdout: "description": { 2024-08-26T00:14:47.930 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "description", 2024-08-26T00:14:47.930 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.930 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.930 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.930 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.930 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.931 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.931 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.931 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.931 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.931 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.931 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.931 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.931 INFO:teuthology.orchestra.run.smithi042.stdout: "device_url": { 2024-08-26T00:14:47.931 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "device_url", 2024-08-26T00:14:47.931 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.931 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.931 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.931 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-26T00:14:47.931 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.932 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.932 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.932 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.932 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.932 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.932 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.932 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.932 INFO:teuthology.orchestra.run.smithi042.stdout: "enabled": { 2024-08-26T00:14:47.932 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "enabled", 2024-08-26T00:14:47.932 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.932 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.932 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.932 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.932 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.933 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.933 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.933 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.933 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.933 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.933 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.933 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.933 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-08-26T00:14:47.933 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-08-26T00:14:47.933 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.933 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.933 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.933 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "24", 2024-08-26T00:14:47.934 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "8", 2024-08-26T00:14:47.934 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.934 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.934 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.934 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.934 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.934 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.934 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.934 INFO:teuthology.orchestra.run.smithi042.stdout: "last_opt_revision": { 2024-08-26T00:14:47.934 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "last_opt_revision", 2024-08-26T00:14:47.934 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.934 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.934 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.935 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "1", 2024-08-26T00:14:47.935 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.935 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.935 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.935 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.935 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.935 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.935 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.935 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.935 INFO:teuthology.orchestra.run.smithi042.stdout: "leaderboard": { 2024-08-26T00:14:47.935 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "leaderboard", 2024-08-26T00:14:47.935 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.935 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.935 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.936 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.936 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.936 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.936 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.936 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.936 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.936 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.936 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.936 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.936 INFO:teuthology.orchestra.run.smithi042.stdout: "leaderboard_description": { 2024-08-26T00:14:47.936 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "leaderboard_description", 2024-08-26T00:14:47.936 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.936 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.936 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.937 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.937 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.937 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.937 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.937 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.937 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.937 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.937 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.937 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.937 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.937 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.937 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.937 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.937 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.938 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.938 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.938 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.938 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.938 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.938 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.938 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.938 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.938 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.938 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.938 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.938 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.938 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.939 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.939 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.939 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.939 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.939 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.939 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.939 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.939 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.939 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.939 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.939 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.939 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.939 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.939 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.940 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.940 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.940 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.940 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.940 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.940 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.940 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.940 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.940 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.940 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.940 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.940 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.940 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.940 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.941 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.941 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.941 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.941 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.941 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.941 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.941 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.941 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.941 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.941 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.941 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.941 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.941 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.942 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.942 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.942 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.942 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.942 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.942 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.942 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.942 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.942 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.942 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.942 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.942 INFO:teuthology.orchestra.run.smithi042.stdout: "organization": { 2024-08-26T00:14:47.942 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "organization", 2024-08-26T00:14:47.943 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.943 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.943 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.943 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.943 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.943 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.943 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.943 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.943 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.943 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.943 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.943 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.943 INFO:teuthology.orchestra.run.smithi042.stdout: "proxy": { 2024-08-26T00:14:47.943 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "proxy", 2024-08-26T00:14:47.944 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.944 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.944 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.944 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.944 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.944 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.944 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.944 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.944 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.944 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.944 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.944 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.944 INFO:teuthology.orchestra.run.smithi042.stdout: "url": { 2024-08-26T00:14:47.944 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "url", 2024-08-26T00:14:47.945 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.945 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.945 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.945 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-26T00:14:47.945 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.945 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.945 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.945 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.945 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.945 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.945 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.945 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.945 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.946 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.946 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.946 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "test_orchestrator", 2024-08-26T00:14:47.946 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.946 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.946 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.946 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.946 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.946 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.946 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.946 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.946 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.946 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.946 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.947 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.947 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.947 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.947 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.947 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.947 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.947 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.947 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.947 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.947 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.947 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.947 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.947 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.947 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.948 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.948 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.948 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.948 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.948 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.948 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.948 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.948 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.948 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.948 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.948 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.948 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.948 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.948 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.949 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.949 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.949 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.949 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.949 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.949 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.949 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.949 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.949 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.949 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.949 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.949 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.949 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.949 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.950 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.950 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.950 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.950 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.950 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.950 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.950 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.950 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.950 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.950 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.950 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.950 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.950 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.950 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.951 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.951 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.951 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.951 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.951 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.951 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.951 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.951 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.951 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.951 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "volumes", 2024-08-26T00:14:47.951 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.951 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.951 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.951 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.952 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.952 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.952 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.952 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.952 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.952 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.952 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.952 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.952 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.952 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.952 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.952 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.952 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.952 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.953 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.953 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.953 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.953 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.953 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.953 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.953 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.953 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.953 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.953 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.953 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.953 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.953 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.953 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.954 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.954 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.954 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.954 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.954 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.954 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.954 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.954 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.954 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.954 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.954 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.954 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.954 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.954 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.955 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.955 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.955 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.955 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.955 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.955 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.955 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.955 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.955 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.955 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.955 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.955 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.955 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.956 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.956 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.956 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.956 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.956 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.956 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.956 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.956 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.956 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.956 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.956 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.956 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.956 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.956 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.957 INFO:teuthology.orchestra.run.smithi042.stdout: "max_concurrent_clones": { 2024-08-26T00:14:47.957 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "max_concurrent_clones", 2024-08-26T00:14:47.957 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.957 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.957 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.957 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "4", 2024-08-26T00:14:47.957 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.957 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.957 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.957 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-26T00:14:47.957 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.957 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.957 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.957 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.958 INFO:teuthology.orchestra.run.smithi042.stdout: "periodic_async_work": { 2024-08-26T00:14:47.958 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "periodic_async_work", 2024-08-26T00:14:47.958 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.958 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.958 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.958 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.958 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.958 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.958 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.958 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Periodically check for async work", 2024-08-26T00:14:47.958 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.958 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.958 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.959 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.959 INFO:teuthology.orchestra.run.smithi042.stdout: "snapshot_clone_delay": { 2024-08-26T00:14:47.959 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snapshot_clone_delay", 2024-08-26T00:14:47.959 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.959 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.959 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.959 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "0", 2024-08-26T00:14:47.959 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.959 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.959 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.959 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-26T00:14:47.959 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.959 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.960 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.960 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.960 INFO:teuthology.orchestra.run.smithi042.stdout: "snapshot_clone_no_wait": { 2024-08-26T00:14:47.960 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "snapshot_clone_no_wait", 2024-08-26T00:14:47.960 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.960 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.960 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.960 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "True", 2024-08-26T00:14:47.960 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.960 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.960 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.960 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-26T00:14:47.960 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.960 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.961 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.961 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.961 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.961 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.961 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.961 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix", 2024-08-26T00:14:47.961 INFO:teuthology.orchestra.run.smithi042.stdout: "can_run": true, 2024-08-26T00:14:47.961 INFO:teuthology.orchestra.run.smithi042.stdout: "error_string": "", 2024-08-26T00:14:47.961 INFO:teuthology.orchestra.run.smithi042.stdout: "module_options": { 2024-08-26T00:14:47.961 INFO:teuthology.orchestra.run.smithi042.stdout: "discovery_interval": { 2024-08-26T00:14:47.961 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "discovery_interval", 2024-08-26T00:14:47.961 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "uint", 2024-08-26T00:14:47.961 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.961 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.962 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "100", 2024-08-26T00:14:47.962 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.962 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.962 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.962 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.962 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.962 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.962 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.962 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.962 INFO:teuthology.orchestra.run.smithi042.stdout: "identifier": { 2024-08-26T00:14:47.962 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "identifier", 2024-08-26T00:14:47.962 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.962 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.962 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.963 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.963 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.963 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.963 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.963 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.963 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.963 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.963 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.963 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.963 INFO:teuthology.orchestra.run.smithi042.stdout: "interval": { 2024-08-26T00:14:47.963 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "interval", 2024-08-26T00:14:47.963 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "secs", 2024-08-26T00:14:47.963 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.963 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.964 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "60", 2024-08-26T00:14:47.964 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.964 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.964 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.964 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.964 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.964 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.964 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.964 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.964 INFO:teuthology.orchestra.run.smithi042.stdout: "log_level": { 2024-08-26T00:14:47.964 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_level", 2024-08-26T00:14:47.964 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.964 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.964 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.965 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.965 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.965 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.965 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.965 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.965 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.965 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.965 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.965 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.965 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.965 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.965 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.965 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.966 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.966 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.966 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.966 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster": { 2024-08-26T00:14:47.966 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster", 2024-08-26T00:14:47.966 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.966 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.966 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.966 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.966 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.966 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.966 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.966 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.966 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.967 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.967 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.967 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.967 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_cluster_level": { 2024-08-26T00:14:47.967 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_cluster_level", 2024-08-26T00:14:47.967 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.967 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.967 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.967 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "info", 2024-08-26T00:14:47.967 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.967 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.967 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [ 2024-08-26T00:14:47.967 INFO:teuthology.orchestra.run.smithi042.stdout: "", 2024-08-26T00:14:47.967 INFO:teuthology.orchestra.run.smithi042.stdout: "critical", 2024-08-26T00:14:47.968 INFO:teuthology.orchestra.run.smithi042.stdout: "debug", 2024-08-26T00:14:47.968 INFO:teuthology.orchestra.run.smithi042.stdout: "error", 2024-08-26T00:14:47.968 INFO:teuthology.orchestra.run.smithi042.stdout: "info", 2024-08-26T00:14:47.968 INFO:teuthology.orchestra.run.smithi042.stdout: "warning" 2024-08-26T00:14:47.968 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.968 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.968 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.968 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.968 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.968 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.968 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": { 2024-08-26T00:14:47.968 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "log_to_file", 2024-08-26T00:14:47.968 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "bool", 2024-08-26T00:14:47.968 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.969 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-08-26T00:14:47.969 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "False", 2024-08-26T00:14:47.969 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.969 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.969 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.969 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.969 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.969 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.969 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.969 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.969 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_host": { 2024-08-26T00:14:47.969 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_host", 2024-08-26T00:14:47.969 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.969 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.970 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.970 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "", 2024-08-26T00:14:47.970 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.970 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.970 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.970 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.970 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.970 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.970 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.970 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.970 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_port": { 2024-08-26T00:14:47.970 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_port", 2024-08-26T00:14:47.970 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "int", 2024-08-26T00:14:47.970 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.971 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.971 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "10051", 2024-08-26T00:14:47.971 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.971 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.971 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.971 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.971 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.971 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.971 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.971 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.971 INFO:teuthology.orchestra.run.smithi042.stdout: "zabbix_sender": { 2024-08-26T00:14:47.971 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "zabbix_sender", 2024-08-26T00:14:47.971 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "str", 2024-08-26T00:14:47.971 INFO:teuthology.orchestra.run.smithi042.stdout: "level": "advanced", 2024-08-26T00:14:47.972 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 0, 2024-08-26T00:14:47.972 INFO:teuthology.orchestra.run.smithi042.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-26T00:14:47.972 INFO:teuthology.orchestra.run.smithi042.stdout: "min": "", 2024-08-26T00:14:47.972 INFO:teuthology.orchestra.run.smithi042.stdout: "max": "", 2024-08-26T00:14:47.972 INFO:teuthology.orchestra.run.smithi042.stdout: "enum_allowed": [], 2024-08-26T00:14:47.972 INFO:teuthology.orchestra.run.smithi042.stdout: "desc": "", 2024-08-26T00:14:47.972 INFO:teuthology.orchestra.run.smithi042.stdout: "long_desc": "", 2024-08-26T00:14:47.972 INFO:teuthology.orchestra.run.smithi042.stdout: "tags": [], 2024-08-26T00:14:47.972 INFO:teuthology.orchestra.run.smithi042.stdout: "see_also": [] 2024-08-26T00:14:47.972 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.972 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.972 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.972 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.972 INFO:teuthology.orchestra.run.smithi042.stdout: "services": { 2024-08-26T00:14:47.973 INFO:teuthology.orchestra.run.smithi042.stdout: "dashboard": "https://172.21.15.42:8443/" 2024-08-26T00:14:47.973 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.973 INFO:teuthology.orchestra.run.smithi042.stdout: "always_on_modules": { 2024-08-26T00:14:47.973 INFO:teuthology.orchestra.run.smithi042.stdout: "octopus": [ 2024-08-26T00:14:47.973 INFO:teuthology.orchestra.run.smithi042.stdout: "balancer", 2024-08-26T00:14:47.973 INFO:teuthology.orchestra.run.smithi042.stdout: "crash", 2024-08-26T00:14:47.973 INFO:teuthology.orchestra.run.smithi042.stdout: "devicehealth", 2024-08-26T00:14:47.973 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator", 2024-08-26T00:14:47.973 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscaler", 2024-08-26T00:14:47.973 INFO:teuthology.orchestra.run.smithi042.stdout: "progress", 2024-08-26T00:14:47.973 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_support", 2024-08-26T00:14:47.973 INFO:teuthology.orchestra.run.smithi042.stdout: "status", 2024-08-26T00:14:47.973 INFO:teuthology.orchestra.run.smithi042.stdout: "telemetry", 2024-08-26T00:14:47.973 INFO:teuthology.orchestra.run.smithi042.stdout: "volumes" 2024-08-26T00:14:47.973 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.974 INFO:teuthology.orchestra.run.smithi042.stdout: "pacific": [ 2024-08-26T00:14:47.974 INFO:teuthology.orchestra.run.smithi042.stdout: "balancer", 2024-08-26T00:14:47.974 INFO:teuthology.orchestra.run.smithi042.stdout: "crash", 2024-08-26T00:14:47.974 INFO:teuthology.orchestra.run.smithi042.stdout: "devicehealth", 2024-08-26T00:14:47.974 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator", 2024-08-26T00:14:47.974 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscaler", 2024-08-26T00:14:47.974 INFO:teuthology.orchestra.run.smithi042.stdout: "progress", 2024-08-26T00:14:47.974 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_support", 2024-08-26T00:14:47.974 INFO:teuthology.orchestra.run.smithi042.stdout: "status", 2024-08-26T00:14:47.974 INFO:teuthology.orchestra.run.smithi042.stdout: "telemetry", 2024-08-26T00:14:47.974 INFO:teuthology.orchestra.run.smithi042.stdout: "volumes" 2024-08-26T00:14:47.974 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.974 INFO:teuthology.orchestra.run.smithi042.stdout: "quincy": [ 2024-08-26T00:14:47.975 INFO:teuthology.orchestra.run.smithi042.stdout: "balancer", 2024-08-26T00:14:47.975 INFO:teuthology.orchestra.run.smithi042.stdout: "crash", 2024-08-26T00:14:47.975 INFO:teuthology.orchestra.run.smithi042.stdout: "devicehealth", 2024-08-26T00:14:47.975 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator", 2024-08-26T00:14:47.975 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscaler", 2024-08-26T00:14:47.975 INFO:teuthology.orchestra.run.smithi042.stdout: "progress", 2024-08-26T00:14:47.975 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_support", 2024-08-26T00:14:47.975 INFO:teuthology.orchestra.run.smithi042.stdout: "status", 2024-08-26T00:14:47.975 INFO:teuthology.orchestra.run.smithi042.stdout: "telemetry", 2024-08-26T00:14:47.975 INFO:teuthology.orchestra.run.smithi042.stdout: "volumes" 2024-08-26T00:14:47.975 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.975 INFO:teuthology.orchestra.run.smithi042.stdout: "reef": [ 2024-08-26T00:14:47.975 INFO:teuthology.orchestra.run.smithi042.stdout: "balancer", 2024-08-26T00:14:47.975 INFO:teuthology.orchestra.run.smithi042.stdout: "crash", 2024-08-26T00:14:47.976 INFO:teuthology.orchestra.run.smithi042.stdout: "devicehealth", 2024-08-26T00:14:47.976 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator", 2024-08-26T00:14:47.976 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscaler", 2024-08-26T00:14:47.976 INFO:teuthology.orchestra.run.smithi042.stdout: "progress", 2024-08-26T00:14:47.976 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_support", 2024-08-26T00:14:47.976 INFO:teuthology.orchestra.run.smithi042.stdout: "status", 2024-08-26T00:14:47.976 INFO:teuthology.orchestra.run.smithi042.stdout: "telemetry", 2024-08-26T00:14:47.976 INFO:teuthology.orchestra.run.smithi042.stdout: "volumes" 2024-08-26T00:14:47.976 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-08-26T00:14:47.976 INFO:teuthology.orchestra.run.smithi042.stdout: "squid": [ 2024-08-26T00:14:47.976 INFO:teuthology.orchestra.run.smithi042.stdout: "balancer", 2024-08-26T00:14:47.976 INFO:teuthology.orchestra.run.smithi042.stdout: "crash", 2024-08-26T00:14:47.976 INFO:teuthology.orchestra.run.smithi042.stdout: "devicehealth", 2024-08-26T00:14:47.976 INFO:teuthology.orchestra.run.smithi042.stdout: "orchestrator", 2024-08-26T00:14:47.976 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscaler", 2024-08-26T00:14:47.977 INFO:teuthology.orchestra.run.smithi042.stdout: "progress", 2024-08-26T00:14:47.977 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_support", 2024-08-26T00:14:47.977 INFO:teuthology.orchestra.run.smithi042.stdout: "status", 2024-08-26T00:14:47.977 INFO:teuthology.orchestra.run.smithi042.stdout: "telemetry", 2024-08-26T00:14:47.977 INFO:teuthology.orchestra.run.smithi042.stdout: "volumes" 2024-08-26T00:14:47.977 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-08-26T00:14:47.977 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.977 INFO:teuthology.orchestra.run.smithi042.stdout: "last_failure_osd_epoch": 3, 2024-08-26T00:14:47.977 INFO:teuthology.orchestra.run.smithi042.stdout: "active_clients": [ 2024-08-26T00:14:47.977 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.977 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "devicehealth", 2024-08-26T00:14:47.977 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-08-26T00:14:47.977 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.977 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-08-26T00:14:47.978 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:0", 2024-08-26T00:14:47.978 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 1073308372 2024-08-26T00:14:47.978 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.978 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-08-26T00:14:47.978 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.978 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.978 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "libcephsqlite", 2024-08-26T00:14:47.978 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-08-26T00:14:47.978 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.978 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-08-26T00:14:47.978 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:0", 2024-08-26T00:14:47.978 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3771818851 2024-08-26T00:14:47.978 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.978 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-08-26T00:14:47.979 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.979 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.979 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "rbd_support", 2024-08-26T00:14:47.979 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-08-26T00:14:47.979 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.979 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-08-26T00:14:47.979 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:0", 2024-08-26T00:14:47.979 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 2851540126 2024-08-26T00:14:47.979 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.979 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-08-26T00:14:47.979 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:47.979 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.979 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "volumes", 2024-08-26T00:14:47.979 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-08-26T00:14:47.980 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-26T00:14:47.980 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-08-26T00:14:47.980 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:0", 2024-08-26T00:14:47.980 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 2925536692 2024-08-26T00:14:47.980 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.980 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-08-26T00:14:47.980 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:47.980 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-08-26T00:14:47.980 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:14:47.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:47 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/3018150899' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-08-26T00:14:47.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:47 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/41314756' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-08-26T00:14:47.982 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:47 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/3018150899' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-08-26T00:14:47.982 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:47 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/41314756' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-08-26T00:14:47.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.592+0000 7fc32a200640 1 -- 172.21.15.42:0/41314756 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc3080a2b90 msgr2=0x7fc3080a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:47.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.592+0000 7fc32a200640 1 --2- 172.21.15.42:0/41314756 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc3080a2b90 0x7fc3080a5050 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc32419b290 tx=0x7fc314005f90 comp rx=0 tx=0).stop 2024-08-26T00:14:47.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.592+0000 7fc32a200640 1 -- 172.21.15.42:0/41314756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc324104cc0 msgr2=0x7fc32419a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:14:47.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.592+0000 7fc32a200640 1 --2- 172.21.15.42:0/41314756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc324104cc0 0x7fc32419a300 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc31000e9f0 tx=0x7fc31000eeb0 comp rx=0 tx=0).stop 2024-08-26T00:14:47.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.592+0000 7fc32a200640 1 -- 172.21.15.42:0/41314756 shutdown_connections 2024-08-26T00:14:47.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.592+0000 7fc32a200640 1 --2- 172.21.15.42:0/41314756 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fc3080a2b90 0x7fc3080a5050 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:47.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.592+0000 7fc32a200640 1 --2- 172.21.15.42:0/41314756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc324105680 0x7fc3241a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:47.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.592+0000 7fc32a200640 1 --2- 172.21.15.42:0/41314756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc324104cc0 0x7fc32419a300 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:47.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.592+0000 7fc32a200640 1 --2- 172.21.15.42:0/41314756 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc324103ad0 0x7fc324199dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:14:47.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.592+0000 7fc32a200640 1 -- 172.21.15.42:0/41314756 >> 172.21.15.42:0/41314756 conn(0x7fc3240ff250 msgr2=0x7fc324107fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:14:47.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.592+0000 7fc32a200640 1 -- 172.21.15.42:0/41314756 shutdown_connections 2024-08-26T00:14:47.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:14:46.593+0000 7fc32a200640 1 -- 172.21.15.42:0/41314756 wait complete. 2024-08-26T00:14:47.989 DEBUG:tasks.check_counter:Getting stats from a 2024-08-26T00:14:47.990 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph daemon mds.a perf dump 2024-08-26T00:14:47.990 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:47 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/3018150899' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-08-26T00:14:47.990 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:47 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/41314756' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-08-26T00:14:48.379 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:14:48.411 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:48 smithi043 ceph-mon[22091]: pgmap v707: 97 pgs: 97 active+clean; 645 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 342 op/s 2024-08-26T00:14:48.518 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:48 smithi042 ceph-mon[17225]: pgmap v707: 97 pgs: 97 active+clean; 645 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 342 op/s 2024-08-26T00:14:48.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:48 smithi181 ceph-mon[22102]: pgmap v707: 97 pgs: 97 active+clean; 645 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 342 op/s 2024-08-26T00:14:48.970 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:14:48.971 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-0": { 2024-08-26T00:14:48.971 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 237, 2024-08-26T00:14:48.971 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 234, 2024-08-26T00:14:48.971 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 483136, 2024-08-26T00:14:48.971 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 144064, 2024-08-26T00:14:48.971 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 4, 2024-08-26T00:14:48.971 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 0, 2024-08-26T00:14:48.971 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.055401033, 2024-08-26T00:14:48.971 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.028083711, 2024-08-26T00:14:48.971 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.027534550, 2024-08-26T00:14:48.971 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-26T00:14:48.972 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:14:48.972 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 233, 2024-08-26T00:14:48.972 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.023178667, 2024-08-26T00:14:48.972 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000099479 2024-08-26T00:14:48.972 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:48.972 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:14:48.972 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-08-26T00:14:48.972 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-08-26T00:14:48.972 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-08-26T00:14:48.972 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:48.972 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 483136, 2024-08-26T00:14:48.972 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 144064 2024-08-26T00:14:48.972 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:48.973 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-1": { 2024-08-26T00:14:48.973 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 5, 2024-08-26T00:14:48.973 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 180, 2024-08-26T00:14:48.973 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 3152, 2024-08-26T00:14:48.973 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 110080, 2024-08-26T00:14:48.973 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 3, 2024-08-26T00:14:48.973 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 2, 2024-08-26T00:14:48.973 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.027259329, 2024-08-26T00:14:48.973 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.019708865, 2024-08-26T00:14:48.973 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.004939752, 2024-08-26T00:14:48.973 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-26T00:14:48.973 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:14:48.973 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 179, 2024-08-26T00:14:48.973 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.024656016, 2024-08-26T00:14:48.973 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000137743 2024-08-26T00:14:48.974 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:48.974 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:14:48.974 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-08-26T00:14:48.974 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-08-26T00:14:48.974 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-08-26T00:14:48.974 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:48.974 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-08-26T00:14:48.974 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 110080 2024-08-26T00:14:48.974 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:48.974 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-2": { 2024-08-26T00:14:48.974 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 0, 2024-08-26T00:14:48.975 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 2, 2024-08-26T00:14:48.975 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 0, 2024-08-26T00:14:48.975 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 0, 2024-08-26T00:14:48.975 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 2, 2024-08-26T00:14:48.975 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 1, 2024-08-26T00:14:48.975 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.000551975, 2024-08-26T00:14:48.975 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.000000000, 2024-08-26T00:14:48.975 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.000403898, 2024-08-26T00:14:48.975 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-26T00:14:48.975 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:14:48.975 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-08-26T00:14:48.975 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-08-26T00:14:48.976 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-08-26T00:14:48.976 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:48.976 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:14:48.976 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-08-26T00:14:48.976 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-08-26T00:14:48.976 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-08-26T00:14:48.976 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:48.976 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-26T00:14:48.976 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 0 2024-08-26T00:14:48.976 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:48.976 INFO:teuthology.orchestra.run.smithi042.stdout: "cct": { 2024-08-26T00:14:48.976 INFO:teuthology.orchestra.run.smithi042.stdout: "total_workers": 0, 2024-08-26T00:14:48.977 INFO:teuthology.orchestra.run.smithi042.stdout: "unhealthy_workers": 0 2024-08-26T00:14:48.977 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:48.977 INFO:teuthology.orchestra.run.smithi042.stdout: "mempool": { 2024-08-26T00:14:48.977 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_bytes": 0, 2024-08-26T00:14:48.977 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_items": 0, 2024-08-26T00:14:48.977 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_bytes": 0, 2024-08-26T00:14:48.977 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_items": 0, 2024-08-26T00:14:48.977 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_bytes": 0, 2024-08-26T00:14:48.977 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_items": 0, 2024-08-26T00:14:48.977 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-26T00:14:48.977 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_items": 0, 2024-08-26T00:14:48.978 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-26T00:14:48.978 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_items": 0, 2024-08-26T00:14:48.978 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_bytes": 0, 2024-08-26T00:14:48.978 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_items": 0, 2024-08-26T00:14:48.978 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-26T00:14:48.978 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_items": 0, 2024-08-26T00:14:48.978 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_bytes": 0, 2024-08-26T00:14:48.978 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_items": 0, 2024-08-26T00:14:48.978 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_bytes": 0, 2024-08-26T00:14:48.978 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_items": 0, 2024-08-26T00:14:48.978 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-26T00:14:48.978 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_items": 0, 2024-08-26T00:14:48.978 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-26T00:14:48.979 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_items": 0, 2024-08-26T00:14:48.979 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_bytes": 0, 2024-08-26T00:14:48.979 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_items": 0, 2024-08-26T00:14:48.979 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_bytes": 0, 2024-08-26T00:14:48.979 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_items": 0, 2024-08-26T00:14:48.979 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-26T00:14:48.979 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_items": 0, 2024-08-26T00:14:48.979 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_bytes": 0, 2024-08-26T00:14:48.979 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_items": 0, 2024-08-26T00:14:48.980 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_bytes": 0, 2024-08-26T00:14:48.980 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_items": 0, 2024-08-26T00:14:48.980 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_bytes": 0, 2024-08-26T00:14:48.980 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_items": 0, 2024-08-26T00:14:48.980 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_bytes": 0, 2024-08-26T00:14:48.980 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_items": 0, 2024-08-26T00:14:48.980 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_bytes": 148967, 2024-08-26T00:14:48.980 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_items": 29, 2024-08-26T00:14:48.980 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_bytes": 0, 2024-08-26T00:14:48.980 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_items": 0, 2024-08-26T00:14:48.980 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bytes": 0, 2024-08-26T00:14:48.981 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_items": 0, 2024-08-26T00:14:48.981 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_bytes": 0, 2024-08-26T00:14:48.981 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_items": 0, 2024-08-26T00:14:48.981 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_bytes": 0, 2024-08-26T00:14:48.981 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_items": 0, 2024-08-26T00:14:48.981 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_bytes": 0, 2024-08-26T00:14:48.981 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_items": 0, 2024-08-26T00:14:48.981 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_bytes": 0, 2024-08-26T00:14:48.981 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_items": 0, 2024-08-26T00:14:48.981 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_bytes": 0, 2024-08-26T00:14:48.981 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_items": 0, 2024-08-26T00:14:48.982 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_bytes": 928, 2024-08-26T00:14:48.982 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_items": 2, 2024-08-26T00:14:48.982 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_bytes": 0, 2024-08-26T00:14:48.982 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_items": 0, 2024-08-26T00:14:48.982 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_bytes": 0, 2024-08-26T00:14:48.982 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_items": 0 2024-08-26T00:14:48.982 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:48.982 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-26T00:14:48.982 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-08-26T00:14:48.982 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-08-26T00:14:48.982 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-08-26T00:14:48.982 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 238, 2024-08-26T00:14:48.982 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 449628, 2024-08-26T00:14:48.983 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-08-26T00:14:48.983 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 238, 2024-08-26T00:14:48.983 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-08-26T00:14:48.983 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-08-26T00:14:48.983 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 238, 2024-08-26T00:14:48.983 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 449628, 2024-08-26T00:14:48.983 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-08-26T00:14:48.983 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-08-26T00:14:48.983 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-08-26T00:14:48.983 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-08-26T00:14:48.983 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:48.983 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:48.983 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:14:49.792 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-08-26T00:14:49.793 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-08-26T00:14:49.793 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-08-26T00:14:49.793 DEBUG:tasks.check_counter:Getting stats from d 2024-08-26T00:14:49.793 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph daemon mds.d perf dump 2024-08-26T00:14:50.174 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:14:50.455 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:50 smithi042 ceph-mon[17225]: pgmap v708: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 319 op/s 2024-08-26T00:14:50.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:50 smithi043 ceph-mon[22091]: pgmap v708: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 319 op/s 2024-08-26T00:14:50.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:50 smithi181 ceph-mon[22102]: pgmap v708: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 319 op/s 2024-08-26T00:14:50.761 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:14:50.761 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-0": { 2024-08-26T00:14:50.761 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 0, 2024-08-26T00:14:50.761 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 2, 2024-08-26T00:14:50.761 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 0, 2024-08-26T00:14:50.761 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 0, 2024-08-26T00:14:50.761 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 4, 2024-08-26T00:14:50.762 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 0, 2024-08-26T00:14:50.762 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.003454870, 2024-08-26T00:14:50.762 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.000000000, 2024-08-26T00:14:50.762 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.000501624, 2024-08-26T00:14:50.762 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-26T00:14:50.762 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:14:50.762 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-08-26T00:14:50.762 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-08-26T00:14:50.762 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-08-26T00:14:50.762 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:50.762 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:14:50.762 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-08-26T00:14:50.763 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-08-26T00:14:50.763 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-08-26T00:14:50.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:50.763 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-26T00:14:50.763 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 0 2024-08-26T00:14:50.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:50.763 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-1": { 2024-08-26T00:14:50.763 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 1, 2024-08-26T00:14:50.763 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 182, 2024-08-26T00:14:50.763 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 160, 2024-08-26T00:14:50.763 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 110336, 2024-08-26T00:14:50.763 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 3, 2024-08-26T00:14:50.763 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 2, 2024-08-26T00:14:50.764 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.020425881, 2024-08-26T00:14:50.764 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.016771100, 2024-08-26T00:14:50.764 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.001339362, 2024-08-26T00:14:50.764 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-26T00:14:50.764 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:14:50.764 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 180, 2024-08-26T00:14:50.764 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.020123111, 2024-08-26T00:14:50.764 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000111795 2024-08-26T00:14:50.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:50.764 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:14:50.764 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-08-26T00:14:50.765 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-08-26T00:14:50.765 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-08-26T00:14:50.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:50.765 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-26T00:14:50.765 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 110336 2024-08-26T00:14:50.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:50.765 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-2": { 2024-08-26T00:14:50.765 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 246, 2024-08-26T00:14:50.765 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 241, 2024-08-26T00:14:50.765 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 487488, 2024-08-26T00:14:50.765 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 147712, 2024-08-26T00:14:50.765 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 2, 2024-08-26T00:14:50.765 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 1, 2024-08-26T00:14:50.766 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.057089526, 2024-08-26T00:14:50.766 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.024873926, 2024-08-26T00:14:50.766 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.034879834, 2024-08-26T00:14:50.766 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-26T00:14:50.766 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:14:50.766 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 241, 2024-08-26T00:14:50.766 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.039672969, 2024-08-26T00:14:50.766 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000164618 2024-08-26T00:14:50.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:50.766 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:14:50.766 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-08-26T00:14:50.766 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-08-26T00:14:50.766 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-08-26T00:14:50.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:50.767 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 487488, 2024-08-26T00:14:50.767 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 147712 2024-08-26T00:14:50.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:50.767 INFO:teuthology.orchestra.run.smithi042.stdout: "cct": { 2024-08-26T00:14:50.767 INFO:teuthology.orchestra.run.smithi042.stdout: "total_workers": 0, 2024-08-26T00:14:50.767 INFO:teuthology.orchestra.run.smithi042.stdout: "unhealthy_workers": 0 2024-08-26T00:14:50.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:50.767 INFO:teuthology.orchestra.run.smithi042.stdout: "mempool": { 2024-08-26T00:14:50.767 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_bytes": 0, 2024-08-26T00:14:50.767 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_items": 0, 2024-08-26T00:14:50.767 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_bytes": 0, 2024-08-26T00:14:50.767 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_items": 0, 2024-08-26T00:14:50.767 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_bytes": 0, 2024-08-26T00:14:50.767 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_items": 0, 2024-08-26T00:14:50.768 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-26T00:14:50.768 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_items": 0, 2024-08-26T00:14:50.768 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-26T00:14:50.768 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_items": 0, 2024-08-26T00:14:50.768 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_bytes": 0, 2024-08-26T00:14:50.768 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_items": 0, 2024-08-26T00:14:50.768 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-26T00:14:50.768 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_items": 0, 2024-08-26T00:14:50.768 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_bytes": 0, 2024-08-26T00:14:50.768 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_items": 0, 2024-08-26T00:14:50.768 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_bytes": 0, 2024-08-26T00:14:50.768 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_items": 0, 2024-08-26T00:14:50.768 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-26T00:14:50.768 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_items": 0, 2024-08-26T00:14:50.769 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-26T00:14:50.769 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_items": 0, 2024-08-26T00:14:50.769 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_bytes": 0, 2024-08-26T00:14:50.769 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_items": 0, 2024-08-26T00:14:50.769 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_bytes": 0, 2024-08-26T00:14:50.769 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_items": 0, 2024-08-26T00:14:50.769 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-26T00:14:50.769 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_items": 0, 2024-08-26T00:14:50.769 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_bytes": 0, 2024-08-26T00:14:50.769 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_items": 0, 2024-08-26T00:14:50.769 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_bytes": 0, 2024-08-26T00:14:50.769 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_items": 0, 2024-08-26T00:14:50.769 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_bytes": 0, 2024-08-26T00:14:50.770 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_items": 0, 2024-08-26T00:14:50.770 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_bytes": 0, 2024-08-26T00:14:50.770 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_items": 0, 2024-08-26T00:14:50.770 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_bytes": 148967, 2024-08-26T00:14:50.770 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_items": 29, 2024-08-26T00:14:50.770 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_bytes": 0, 2024-08-26T00:14:50.770 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_items": 0, 2024-08-26T00:14:50.770 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bytes": 0, 2024-08-26T00:14:50.770 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_items": 0, 2024-08-26T00:14:50.770 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_bytes": 0, 2024-08-26T00:14:50.770 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_items": 0, 2024-08-26T00:14:50.770 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_bytes": 0, 2024-08-26T00:14:50.770 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_items": 0, 2024-08-26T00:14:50.770 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_bytes": 0, 2024-08-26T00:14:50.771 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_items": 0, 2024-08-26T00:14:50.771 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_bytes": 0, 2024-08-26T00:14:50.771 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_items": 0, 2024-08-26T00:14:50.771 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_bytes": 0, 2024-08-26T00:14:50.771 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_items": 0, 2024-08-26T00:14:50.771 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_bytes": 928, 2024-08-26T00:14:50.771 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_items": 2, 2024-08-26T00:14:50.771 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_bytes": 0, 2024-08-26T00:14:50.771 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_items": 0, 2024-08-26T00:14:50.771 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_bytes": 0, 2024-08-26T00:14:50.771 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_items": 0 2024-08-26T00:14:50.771 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:50.771 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-26T00:14:50.771 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-08-26T00:14:50.771 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-08-26T00:14:50.772 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-08-26T00:14:50.772 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 243, 2024-08-26T00:14:50.772 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 450278, 2024-08-26T00:14:50.772 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-08-26T00:14:50.772 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 243, 2024-08-26T00:14:50.772 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-08-26T00:14:50.772 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-08-26T00:14:50.772 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 243, 2024-08-26T00:14:50.772 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 450278, 2024-08-26T00:14:50.772 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-08-26T00:14:50.772 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-08-26T00:14:50.772 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-08-26T00:14:50.772 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-08-26T00:14:50.772 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:50.773 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:50.773 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:14:51.499 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-08-26T00:14:51.499 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-08-26T00:14:51.499 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-08-26T00:14:51.499 DEBUG:tasks.check_counter:Getting stats from g 2024-08-26T00:14:51.499 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph daemon mds.g perf dump 2024-08-26T00:14:51.876 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:14:52.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:52 smithi042 ceph-mon[17225]: pgmap v709: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 866 KiB/s wr, 247 op/s 2024-08-26T00:14:52.455 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:14:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-0": { 2024-08-26T00:14:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 0, 2024-08-26T00:14:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 2, 2024-08-26T00:14:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 0, 2024-08-26T00:14:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 0, 2024-08-26T00:14:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 4, 2024-08-26T00:14:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 0, 2024-08-26T00:14:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.003278361, 2024-08-26T00:14:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.000000000, 2024-08-26T00:14:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.000456274, 2024-08-26T00:14:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-26T00:14:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:14:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-08-26T00:14:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-08-26T00:14:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-08-26T00:14:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:14:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-08-26T00:14:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-08-26T00:14:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-08-26T00:14:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-26T00:14:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 0 2024-08-26T00:14:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-1": { 2024-08-26T00:14:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 239, 2024-08-26T00:14:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 236, 2024-08-26T00:14:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 483680, 2024-08-26T00:14:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 145344, 2024-08-26T00:14:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 2, 2024-08-26T00:14:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 1, 2024-08-26T00:14:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.052685441, 2024-08-26T00:14:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.025949979, 2024-08-26T00:14:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.029391360, 2024-08-26T00:14:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-26T00:14:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:14:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 235, 2024-08-26T00:14:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.023422180, 2024-08-26T00:14:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000099668 2024-08-26T00:14:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:14:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-08-26T00:14:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-08-26T00:14:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-08-26T00:14:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 483680, 2024-08-26T00:14:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 145344 2024-08-26T00:14:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-2": { 2024-08-26T00:14:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 5, 2024-08-26T00:14:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 181, 2024-08-26T00:14:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 3152, 2024-08-26T00:14:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 110256, 2024-08-26T00:14:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 3, 2024-08-26T00:14:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 2, 2024-08-26T00:14:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.025854412, 2024-08-26T00:14:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.019436189, 2024-08-26T00:14:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.004184280, 2024-08-26T00:14:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-26T00:14:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:14:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 180, 2024-08-26T00:14:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.028187960, 2024-08-26T00:14:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000156599 2024-08-26T00:14:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:14:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-08-26T00:14:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-08-26T00:14:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-08-26T00:14:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-08-26T00:14:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 110256 2024-08-26T00:14:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: "cct": { 2024-08-26T00:14:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: "total_workers": 0, 2024-08-26T00:14:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: "unhealthy_workers": 0 2024-08-26T00:14:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: "mempool": { 2024-08-26T00:14:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_bytes": 0, 2024-08-26T00:14:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_items": 0, 2024-08-26T00:14:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_bytes": 0, 2024-08-26T00:14:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_items": 0, 2024-08-26T00:14:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_bytes": 0, 2024-08-26T00:14:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_items": 0, 2024-08-26T00:14:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-26T00:14:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_items": 0, 2024-08-26T00:14:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-26T00:14:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_items": 0, 2024-08-26T00:14:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_bytes": 0, 2024-08-26T00:14:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_items": 0, 2024-08-26T00:14:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-26T00:14:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_items": 0, 2024-08-26T00:14:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_bytes": 0, 2024-08-26T00:14:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_items": 0, 2024-08-26T00:14:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_bytes": 0, 2024-08-26T00:14:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_items": 0, 2024-08-26T00:14:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-26T00:14:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_items": 0, 2024-08-26T00:14:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-26T00:14:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_items": 0, 2024-08-26T00:14:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_bytes": 0, 2024-08-26T00:14:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_items": 0, 2024-08-26T00:14:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_bytes": 0, 2024-08-26T00:14:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_items": 0, 2024-08-26T00:14:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-26T00:14:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_items": 0, 2024-08-26T00:14:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_bytes": 0, 2024-08-26T00:14:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_items": 0, 2024-08-26T00:14:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_bytes": 0, 2024-08-26T00:14:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_items": 0, 2024-08-26T00:14:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_bytes": 0, 2024-08-26T00:14:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_items": 0, 2024-08-26T00:14:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_bytes": 0, 2024-08-26T00:14:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_items": 0, 2024-08-26T00:14:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_bytes": 148967, 2024-08-26T00:14:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_items": 29, 2024-08-26T00:14:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_bytes": 0, 2024-08-26T00:14:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_items": 0, 2024-08-26T00:14:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bytes": 0, 2024-08-26T00:14:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_items": 0, 2024-08-26T00:14:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_bytes": 0, 2024-08-26T00:14:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_items": 0, 2024-08-26T00:14:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_bytes": 0, 2024-08-26T00:14:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_items": 0, 2024-08-26T00:14:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_bytes": 0, 2024-08-26T00:14:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_items": 0, 2024-08-26T00:14:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_bytes": 0, 2024-08-26T00:14:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_items": 0, 2024-08-26T00:14:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_bytes": 0, 2024-08-26T00:14:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_items": 0, 2024-08-26T00:14:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_bytes": 928, 2024-08-26T00:14:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_items": 2, 2024-08-26T00:14:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_bytes": 0, 2024-08-26T00:14:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_items": 0, 2024-08-26T00:14:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_bytes": 0, 2024-08-26T00:14:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_items": 0 2024-08-26T00:14:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-26T00:14:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-08-26T00:14:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-08-26T00:14:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-08-26T00:14:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 240, 2024-08-26T00:14:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 449888, 2024-08-26T00:14:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-08-26T00:14:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 240, 2024-08-26T00:14:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-08-26T00:14:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-08-26T00:14:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 240, 2024-08-26T00:14:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 449888, 2024-08-26T00:14:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-08-26T00:14:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-08-26T00:14:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-08-26T00:14:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-08-26T00:14:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:52.467 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:14:52.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:52 smithi043 ceph-mon[22091]: pgmap v709: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 866 KiB/s wr, 247 op/s 2024-08-26T00:14:52.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:52 smithi181 ceph-mon[22102]: pgmap v709: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 866 KiB/s wr, 247 op/s 2024-08-26T00:14:53.309 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-08-26T00:14:53.309 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-08-26T00:14:53.309 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-08-26T00:14:53.309 DEBUG:tasks.check_counter:Getting stats from j 2024-08-26T00:14:53.310 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph daemon mds.j perf dump 2024-08-26T00:14:53.698 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:14:54.265 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:54 smithi042 ceph-mon[17225]: pgmap v710: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 751 KiB/s wr, 213 op/s 2024-08-26T00:14:54.426 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-26T00:14:54.426 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-0": { 2024-08-26T00:14:54.426 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 249, 2024-08-26T00:14:54.426 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 244, 2024-08-26T00:14:54.426 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 488928, 2024-08-26T00:14:54.426 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 149328, 2024-08-26T00:14:54.426 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 4, 2024-08-26T00:14:54.427 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 0, 2024-08-26T00:14:54.427 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.062139151, 2024-08-26T00:14:54.427 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.031339622, 2024-08-26T00:14:54.427 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.032942708, 2024-08-26T00:14:54.427 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-26T00:14:54.427 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:14:54.427 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 244, 2024-08-26T00:14:54.427 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.030058111, 2024-08-26T00:14:54.427 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000123188 2024-08-26T00:14:54.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:54.427 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:14:54.427 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-08-26T00:14:54.427 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-08-26T00:14:54.428 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-08-26T00:14:54.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:54.428 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 488928, 2024-08-26T00:14:54.428 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 149328 2024-08-26T00:14:54.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:54.428 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-1": { 2024-08-26T00:14:54.428 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 2, 2024-08-26T00:14:54.428 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 185, 2024-08-26T00:14:54.428 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 320, 2024-08-26T00:14:54.428 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 189520, 2024-08-26T00:14:54.428 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 4, 2024-08-26T00:14:54.428 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 2, 2024-08-26T00:14:54.428 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.023865019, 2024-08-26T00:14:54.428 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.018605317, 2024-08-26T00:14:54.429 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.002711528, 2024-08-26T00:14:54.429 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-26T00:14:54.429 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:14:54.429 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 183, 2024-08-26T00:14:54.429 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.017164040, 2024-08-26T00:14:54.429 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000093792 2024-08-26T00:14:54.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:54.429 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:14:54.429 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-08-26T00:14:54.429 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-08-26T00:14:54.429 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-08-26T00:14:54.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:54.429 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-26T00:14:54.430 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 189520 2024-08-26T00:14:54.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:54.430 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-2": { 2024-08-26T00:14:54.430 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 0, 2024-08-26T00:14:54.430 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 2, 2024-08-26T00:14:54.430 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 0, 2024-08-26T00:14:54.430 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 0, 2024-08-26T00:14:54.430 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 2, 2024-08-26T00:14:54.430 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 1, 2024-08-26T00:14:54.431 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.000806333, 2024-08-26T00:14:54.431 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.000000000, 2024-08-26T00:14:54.431 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.000638163, 2024-08-26T00:14:54.431 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-26T00:14:54.431 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:14:54.431 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-08-26T00:14:54.431 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-08-26T00:14:54.431 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-08-26T00:14:54.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:54.431 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:14:54.432 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-08-26T00:14:54.432 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-08-26T00:14:54.432 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-08-26T00:14:54.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:54.432 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-26T00:14:54.432 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 0 2024-08-26T00:14:54.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:54.432 INFO:teuthology.orchestra.run.smithi042.stdout: "cct": { 2024-08-26T00:14:54.432 INFO:teuthology.orchestra.run.smithi042.stdout: "total_workers": 0, 2024-08-26T00:14:54.432 INFO:teuthology.orchestra.run.smithi042.stdout: "unhealthy_workers": 0 2024-08-26T00:14:54.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:54.432 INFO:teuthology.orchestra.run.smithi042.stdout: "mempool": { 2024-08-26T00:14:54.432 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_bytes": 0, 2024-08-26T00:14:54.432 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_items": 0, 2024-08-26T00:14:54.433 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_bytes": 0, 2024-08-26T00:14:54.433 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_items": 0, 2024-08-26T00:14:54.433 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_bytes": 0, 2024-08-26T00:14:54.433 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_items": 0, 2024-08-26T00:14:54.433 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-26T00:14:54.433 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_items": 0, 2024-08-26T00:14:54.433 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-26T00:14:54.433 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_items": 0, 2024-08-26T00:14:54.433 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_bytes": 0, 2024-08-26T00:14:54.433 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_items": 0, 2024-08-26T00:14:54.433 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-26T00:14:54.433 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_items": 0, 2024-08-26T00:14:54.433 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_bytes": 0, 2024-08-26T00:14:54.433 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_items": 0, 2024-08-26T00:14:54.434 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_bytes": 0, 2024-08-26T00:14:54.434 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_items": 0, 2024-08-26T00:14:54.434 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-26T00:14:54.434 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_items": 0, 2024-08-26T00:14:54.434 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-26T00:14:54.434 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_items": 0, 2024-08-26T00:14:54.434 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_bytes": 0, 2024-08-26T00:14:54.434 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_items": 0, 2024-08-26T00:14:54.434 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_bytes": 0, 2024-08-26T00:14:54.434 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_items": 0, 2024-08-26T00:14:54.434 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-26T00:14:54.434 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_items": 0, 2024-08-26T00:14:54.434 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_bytes": 0, 2024-08-26T00:14:54.435 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_items": 0, 2024-08-26T00:14:54.435 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_bytes": 0, 2024-08-26T00:14:54.435 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_items": 0, 2024-08-26T00:14:54.435 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_bytes": 0, 2024-08-26T00:14:54.435 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_items": 0, 2024-08-26T00:14:54.435 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_bytes": 0, 2024-08-26T00:14:54.435 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_items": 0, 2024-08-26T00:14:54.435 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_bytes": 149998, 2024-08-26T00:14:54.435 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_items": 30, 2024-08-26T00:14:54.435 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_bytes": 0, 2024-08-26T00:14:54.435 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_items": 0, 2024-08-26T00:14:54.435 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bytes": 0, 2024-08-26T00:14:54.435 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_items": 0, 2024-08-26T00:14:54.435 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_bytes": 0, 2024-08-26T00:14:54.436 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_items": 0, 2024-08-26T00:14:54.436 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_bytes": 0, 2024-08-26T00:14:54.436 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_items": 0, 2024-08-26T00:14:54.436 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_bytes": 0, 2024-08-26T00:14:54.436 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_items": 0, 2024-08-26T00:14:54.436 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_bytes": 0, 2024-08-26T00:14:54.436 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_items": 0, 2024-08-26T00:14:54.436 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_bytes": 0, 2024-08-26T00:14:54.436 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_items": 0, 2024-08-26T00:14:54.436 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_bytes": 928, 2024-08-26T00:14:54.436 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_items": 2, 2024-08-26T00:14:54.436 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_bytes": 0, 2024-08-26T00:14:54.436 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_items": 0, 2024-08-26T00:14:54.436 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_bytes": 0, 2024-08-26T00:14:54.437 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_items": 0 2024-08-26T00:14:54.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-26T00:14:54.437 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-26T00:14:54.437 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-08-26T00:14:54.437 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-08-26T00:14:54.437 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-08-26T00:14:54.437 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 247, 2024-08-26T00:14:54.437 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 451332, 2024-08-26T00:14:54.437 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-08-26T00:14:54.437 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 247, 2024-08-26T00:14:54.437 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-08-26T00:14:54.437 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-08-26T00:14:54.437 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 247, 2024-08-26T00:14:54.437 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 451332, 2024-08-26T00:14:54.438 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-08-26T00:14:54.438 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-08-26T00:14:54.438 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-08-26T00:14:54.438 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-08-26T00:14:54.438 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:54.438 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-26T00:14:54.438 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-26T00:14:54.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:54 smithi043 ceph-mon[22091]: pgmap v710: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 751 KiB/s wr, 213 op/s 2024-08-26T00:14:54.533 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:54 smithi181 ceph-mon[22102]: pgmap v710: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 751 KiB/s wr, 213 op/s 2024-08-26T00:14:55.167 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-08-26T00:14:55.167 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-08-26T00:14:55.167 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-08-26T00:14:55.167 DEBUG:tasks.check_counter:Getting stats from b 2024-08-26T00:14:55.167 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph daemon mds.b perf dump 2024-08-26T00:14:55.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:55 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:14:55.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:55 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:14:55.510 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:55 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:14:55.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:55 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:14:55.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:55 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:14:55.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:55 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:14:55.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:55 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:14:55.511 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:55 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:14:55.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:55 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:14:55.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:55 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:14:55.533 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:55 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:14:55.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:55 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:14:55.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:55 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:14:55.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:55 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:14:55.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:55 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:14:55.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:55 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:14:55.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:55 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-26T00:14:55.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:55 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:14:55.534 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:55 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:14:55.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:55 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:14:55.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:55 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:14:55.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:55 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-26T00:14:55.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:55 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-26T00:14:55.535 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:55 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' 2024-08-26T00:14:56.638 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.b/config 2024-08-26T00:14:57.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:56 smithi043 ceph-mon[22091]: pgmap v711: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 748 KiB/s wr, 136 op/s 2024-08-26T00:14:57.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:56 smithi042 ceph-mon[17225]: pgmap v711: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 748 KiB/s wr, 136 op/s 2024-08-26T00:14:57.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:56 smithi181 ceph-mon[22102]: pgmap v711: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 748 KiB/s wr, 136 op/s 2024-08-26T00:14:58.985 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:14:58 smithi043 ceph-mon[22091]: pgmap v712: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 394 KiB/s wr, 96 op/s 2024-08-26T00:14:59.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:14:58 smithi042 ceph-mon[17225]: pgmap v712: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 394 KiB/s wr, 96 op/s 2024-08-26T00:14:59.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:14:58 smithi181 ceph-mon[22102]: pgmap v712: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 394 KiB/s wr, 96 op/s 2024-08-26T00:14:59.740 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-08-26T00:14:59.740 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-0": { 2024-08-26T00:14:59.740 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 122000, 2024-08-26T00:14:59.740 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 132652, 2024-08-26T00:14:59.741 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 55360660, 2024-08-26T00:14:59.741 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 220396983, 2024-08-26T00:14:59.741 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 30, 2024-08-26T00:14:59.741 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 4, 2024-08-26T00:14:59.741 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 7.487107030, 2024-08-26T00:14:59.741 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 2.639085969, 2024-08-26T00:14:59.741 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 2.991078169, 2024-08-26T00:14:59.741 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 1.933280890, 2024-08-26T00:14:59.742 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:14:59.742 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 132651, 2024-08-26T00:14:59.742 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 11.530558831, 2024-08-26T00:14:59.742 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000086924 2024-08-26T00:14:59.742 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.742 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:14:59.742 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 112230, 2024-08-26T00:14:59.742 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.019134508, 2024-08-26T00:14:59.743 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000170 2024-08-26T00:14:59.743 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.743 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 559648, 2024-08-26T00:14:59.743 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 214928 2024-08-26T00:14:59.743 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.743 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-1": { 2024-08-26T00:14:59.743 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 189119, 2024-08-26T00:14:59.744 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 226876, 2024-08-26T00:14:59.744 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 74378459, 2024-08-26T00:14:59.744 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 248906626, 2024-08-26T00:14:59.744 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 13, 2024-08-26T00:14:59.744 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 5, 2024-08-26T00:14:59.744 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 11.808244790, 2024-08-26T00:14:59.745 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 4.823284621, 2024-08-26T00:14:59.745 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 4.720263490, 2024-08-26T00:14:59.745 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 2.470799607, 2024-08-26T00:14:59.745 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:14:59.745 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 226875, 2024-08-26T00:14:59.745 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 13.611224957, 2024-08-26T00:14:59.745 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000059994 2024-08-26T00:14:59.745 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.746 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:14:59.746 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 232907, 2024-08-26T00:14:59.746 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.039818577, 2024-08-26T00:14:59.746 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000170 2024-08-26T00:14:59.746 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.746 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-08-26T00:14:59.746 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 400432 2024-08-26T00:14:59.747 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.747 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-2": { 2024-08-26T00:14:59.747 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 400208, 2024-08-26T00:14:59.747 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 688952, 2024-08-26T00:14:59.747 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 158369607, 2024-08-26T00:14:59.747 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 703304230, 2024-08-26T00:14:59.747 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 9, 2024-08-26T00:14:59.747 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 5, 2024-08-26T00:14:59.748 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 26.922442773, 2024-08-26T00:14:59.748 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 13.073446666, 2024-08-26T00:14:59.748 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 42.610997563, 2024-08-26T00:14:59.748 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 2.124694104, 2024-08-26T00:14:59.748 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:14:59.748 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 688950, 2024-08-26T00:14:59.748 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 33.285993512, 2024-08-26T00:14:59.748 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000048314 2024-08-26T00:14:59.749 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.749 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:14:59.749 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 698152, 2024-08-26T00:14:59.749 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.120373298, 2024-08-26T00:14:59.749 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000172 2024-08-26T00:14:59.749 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.749 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 133244160, 2024-08-26T00:14:59.749 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 324998560 2024-08-26T00:14:59.750 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.750 INFO:teuthology.orchestra.run.smithi043.stdout: "cct": { 2024-08-26T00:14:59.750 INFO:teuthology.orchestra.run.smithi043.stdout: "total_workers": 1, 2024-08-26T00:14:59.750 INFO:teuthology.orchestra.run.smithi043.stdout: "unhealthy_workers": 0 2024-08-26T00:14:59.750 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.750 INFO:teuthology.orchestra.run.smithi043.stdout: "finisher-MDSRank": { 2024-08-26T00:14:59.750 INFO:teuthology.orchestra.run.smithi043.stdout: "queue_len": 0, 2024-08-26T00:14:59.750 INFO:teuthology.orchestra.run.smithi043.stdout: "complete_latency": { 2024-08-26T00:14:59.751 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 121171, 2024-08-26T00:14:59.751 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 187.738112494, 2024-08-26T00:14:59.751 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.001549365 2024-08-26T00:14:59.751 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:14:59.751 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.751 INFO:teuthology.orchestra.run.smithi043.stdout: "finisher-PurgeQueue": { 2024-08-26T00:14:59.751 INFO:teuthology.orchestra.run.smithi043.stdout: "queue_len": 0, 2024-08-26T00:14:59.752 INFO:teuthology.orchestra.run.smithi043.stdout: "complete_latency": { 2024-08-26T00:14:59.752 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 84588, 2024-08-26T00:14:59.752 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 15.996923783, 2024-08-26T00:14:59.752 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000189115 2024-08-26T00:14:59.752 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:14:59.752 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.752 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2024-08-26T00:14:59.753 INFO:teuthology.orchestra.run.smithi043.stdout: "request": 193790, 2024-08-26T00:14:59.753 INFO:teuthology.orchestra.run.smithi043.stdout: "reply": 185585, 2024-08-26T00:14:59.753 INFO:teuthology.orchestra.run.smithi043.stdout: "reply_latency": { 2024-08-26T00:14:59.753 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 185585, 2024-08-26T00:14:59.753 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 1448.078252704, 2024-08-26T00:14:59.753 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.007802776 2024-08-26T00:14:59.753 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.754 INFO:teuthology.orchestra.run.smithi043.stdout: "slow_reply": 0, 2024-08-26T00:14:59.754 INFO:teuthology.orchestra.run.smithi043.stdout: "forward": 8205, 2024-08-26T00:14:59.754 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_fetch_complete": 12, 2024-08-26T00:14:59.754 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_fetch_keys": 0, 2024-08-26T00:14:59.754 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_commit": 2087, 2024-08-26T00:14:59.754 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_split": 201, 2024-08-26T00:14:59.754 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_merge": 10, 2024-08-26T00:14:59.754 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes": 3152, 2024-08-26T00:14:59.755 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_top": 2165, 2024-08-26T00:14:59.755 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_bottom": 931, 2024-08-26T00:14:59.755 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_pin_tail": 56, 2024-08-26T00:14:59.755 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_pinned": 59, 2024-08-26T00:14:59.755 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_expired": 81316, 2024-08-26T00:14:59.755 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_with_caps": 0, 2024-08-26T00:14:59.755 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": 0, 2024-08-26T00:14:59.755 INFO:teuthology.orchestra.run.smithi043.stdout: "subtrees": 4, 2024-08-26T00:14:59.755 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse": 296106, 2024-08-26T00:14:59.756 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_hit": 260273, 2024-08-26T00:14:59.756 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_forward": 7953, 2024-08-26T00:14:59.756 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_discover": 1266, 2024-08-26T00:14:59.756 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_dir_fetch": 1, 2024-08-26T00:14:59.756 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_remote_ino": 0, 2024-08-26T00:14:59.756 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_lock": 550, 2024-08-26T00:14:59.756 INFO:teuthology.orchestra.run.smithi043.stdout: "load_cent": 14799, 2024-08-26T00:14:59.756 INFO:teuthology.orchestra.run.smithi043.stdout: "q": 0, 2024-08-26T00:14:59.756 INFO:teuthology.orchestra.run.smithi043.stdout: "exported": 170, 2024-08-26T00:14:59.756 INFO:teuthology.orchestra.run.smithi043.stdout: "exported_inodes": 67333, 2024-08-26T00:14:59.756 INFO:teuthology.orchestra.run.smithi043.stdout: "imported": 213, 2024-08-26T00:14:59.756 INFO:teuthology.orchestra.run.smithi043.stdout: "imported_inodes": 65014, 2024-08-26T00:14:59.756 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_dir_fetch": 0, 2024-08-26T00:14:59.757 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_backtrace_fetch": 151599, 2024-08-26T00:14:59.757 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_peer_discover": 1, 2024-08-26T00:14:59.757 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rfiles": 44955, 2024-08-26T00:14:59.757 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rbytes": 942800409, 2024-08-26T00:14:59.757 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rsnaps": 0, 2024-08-26T00:14:59.757 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_backtrace_fetch": 151599, 2024-08-26T00:14:59.757 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_set_tag": 0, 2024-08-26T00:14:59.757 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_backtrace_repaired": 0, 2024-08-26T00:14:59.757 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_inotable_repaired": 0, 2024-08-26T00:14:59.757 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dir_inodes": 1079, 2024-08-26T00:14:59.757 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dir_base_inodes": 0, 2024-08-26T00:14:59.757 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dirfrag_rstats": 1079, 2024-08-26T00:14:59.757 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_file_inodes": 150520, 2024-08-26T00:14:59.758 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_inode_file_caps": 1150, 2024-08-26T00:14:59.758 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_revoke": 39122, 2024-08-26T00:14:59.758 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_grant": 106413, 2024-08-26T00:14:59.758 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_trunc": 1, 2024-08-26T00:14:59.758 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-26T00:14:59.758 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-26T00:14:59.758 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_caps": 107511, 2024-08-26T00:14:59.758 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_caps_dirty": 41647, 2024-08-26T00:14:59.758 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_cap_release": 2277, 2024-08-26T00:14:59.758 INFO:teuthology.orchestra.run.smithi043.stdout: "process_request_cap_release": 108228 2024-08-26T00:14:59.758 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.758 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache": { 2024-08-26T00:14:59.758 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_update": 0, 2024-08-26T00:14:59.759 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_update_receipt": 0, 2024-08-26T00:14:59.759 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_try_discover": 0, 2024-08-26T00:14:59.759 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_send_discover": 1300, 2024-08-26T00:14:59.759 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_handle_discover": 2091, 2024-08-26T00:14:59.760 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays": 41, 2024-08-26T00:14:59.760 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays_delayed": 0, 2024-08-26T00:14:59.760 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays_enqueuing": 0, 2024-08-26T00:14:59.760 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_created": 50157, 2024-08-26T00:14:59.760 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_enqueued": 50116, 2024-08-26T00:14:59.760 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_reintegrated": 0, 2024-08-26T00:14:59.760 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_migrated": 0, 2024-08-26T00:14:59.761 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_processing": 0, 2024-08-26T00:14:59.761 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_enqueued": 0, 2024-08-26T00:14:59.761 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_prioritized": 0, 2024-08-26T00:14:59.761 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_started": 0, 2024-08-26T00:14:59.761 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_completed": 0, 2024-08-26T00:14:59.761 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_quiesce_path": 0, 2024-08-26T00:14:59.762 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_quiesce_inode": 0, 2024-08-26T00:14:59.762 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_enqueue_scrub": 0, 2024-08-26T00:14:59.762 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_exportdir": 170, 2024-08-26T00:14:59.762 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_flush": 0, 2024-08-26T00:14:59.762 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_fragmentdir": 215, 2024-08-26T00:14:59.762 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_fragstats": 0, 2024-08-26T00:14:59.762 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_inodestats": 0 2024-08-26T00:14:59.762 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.762 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log": { 2024-08-26T00:14:59.762 INFO:teuthology.orchestra.run.smithi043.stdout: "evlrg": 5, 2024-08-26T00:14:59.762 INFO:teuthology.orchestra.run.smithi043.stdout: "evadd": 298064, 2024-08-26T00:14:59.762 INFO:teuthology.orchestra.run.smithi043.stdout: "evex": 198689, 2024-08-26T00:14:59.763 INFO:teuthology.orchestra.run.smithi043.stdout: "evtrm": 196641, 2024-08-26T00:14:59.763 INFO:teuthology.orchestra.run.smithi043.stdout: "ev": 101423, 2024-08-26T00:14:59.763 INFO:teuthology.orchestra.run.smithi043.stdout: "evexg": 0, 2024-08-26T00:14:59.763 INFO:teuthology.orchestra.run.smithi043.stdout: "evexd": 2048, 2024-08-26T00:14:59.763 INFO:teuthology.orchestra.run.smithi043.stdout: "segadd": 376, 2024-08-26T00:14:59.763 INFO:teuthology.orchestra.run.smithi043.stdout: "segex": 248, 2024-08-26T00:14:59.763 INFO:teuthology.orchestra.run.smithi043.stdout: "segtrm": 246, 2024-08-26T00:14:59.763 INFO:teuthology.orchestra.run.smithi043.stdout: "seg": 130, 2024-08-26T00:14:59.763 INFO:teuthology.orchestra.run.smithi043.stdout: "segmjr": 9, 2024-08-26T00:14:59.763 INFO:teuthology.orchestra.run.smithi043.stdout: "segexg": 0, 2024-08-26T00:14:59.763 INFO:teuthology.orchestra.run.smithi043.stdout: "segexd": 2, 2024-08-26T00:14:59.763 INFO:teuthology.orchestra.run.smithi043.stdout: "expos": 458059492, 2024-08-26T00:14:59.763 INFO:teuthology.orchestra.run.smithi043.stdout: "wrpos": 650546376, 2024-08-26T00:14:59.764 INFO:teuthology.orchestra.run.smithi043.stdout: "rdpos": 0, 2024-08-26T00:14:59.764 INFO:teuthology.orchestra.run.smithi043.stdout: "jlat": { 2024-08-26T00:14:59.764 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 5394, 2024-08-26T00:14:59.764 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 211.105164865, 2024-08-26T00:14:59.764 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.039137034 2024-08-26T00:14:59.764 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.764 INFO:teuthology.orchestra.run.smithi043.stdout: "replayed": 0 2024-08-26T00:14:59.764 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.764 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_mem": { 2024-08-26T00:14:59.764 INFO:teuthology.orchestra.run.smithi043.stdout: "ino": 69, 2024-08-26T00:14:59.764 INFO:teuthology.orchestra.run.smithi043.stdout: "ino+": 78157, 2024-08-26T00:14:59.764 INFO:teuthology.orchestra.run.smithi043.stdout: "ino-": 78088, 2024-08-26T00:14:59.765 INFO:teuthology.orchestra.run.smithi043.stdout: "dir": 327, 2024-08-26T00:14:59.765 INFO:teuthology.orchestra.run.smithi043.stdout: "dir+": 3603, 2024-08-26T00:14:59.765 INFO:teuthology.orchestra.run.smithi043.stdout: "dir-": 3276, 2024-08-26T00:14:59.765 INFO:teuthology.orchestra.run.smithi043.stdout: "dn": 3152, 2024-08-26T00:14:59.765 INFO:teuthology.orchestra.run.smithi043.stdout: "dn+": 193358, 2024-08-26T00:14:59.765 INFO:teuthology.orchestra.run.smithi043.stdout: "dn-": 190206, 2024-08-26T00:14:59.765 INFO:teuthology.orchestra.run.smithi043.stdout: "cap": 0, 2024-08-26T00:14:59.765 INFO:teuthology.orchestra.run.smithi043.stdout: "cap+": 90950, 2024-08-26T00:14:59.765 INFO:teuthology.orchestra.run.smithi043.stdout: "cap-": 90950, 2024-08-26T00:14:59.765 INFO:teuthology.orchestra.run.smithi043.stdout: "rss": 152032, 2024-08-26T00:14:59.765 INFO:teuthology.orchestra.run.smithi043.stdout: "heap": 223520 2024-08-26T00:14:59.765 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.766 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_server": { 2024-08-26T00:14:59.766 INFO:teuthology.orchestra.run.smithi043.stdout: "dispatch_client_request": 239410, 2024-08-26T00:14:59.766 INFO:teuthology.orchestra.run.smithi043.stdout: "dispatch_server_request": 18323, 2024-08-26T00:14:59.766 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_request": 193790, 2024-08-26T00:14:59.766 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_session": 441, 2024-08-26T00:14:59.766 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_peer_request": 36255, 2024-08-26T00:14:59.766 INFO:teuthology.orchestra.run.smithi043.stdout: "req_create_latency": { 2024-08-26T00:14:59.766 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 48344, 2024-08-26T00:14:59.766 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 198.001040479, 2024-08-26T00:14:59.766 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.004095669 2024-08-26T00:14:59.766 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.766 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getattr_latency": { 2024-08-26T00:14:59.766 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 1827, 2024-08-26T00:14:59.767 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 95.519823692, 2024-08-26T00:14:59.767 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.052282333 2024-08-26T00:14:59.767 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.767 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getfilelock_latency": { 2024-08-26T00:14:59.767 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.767 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.767 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.767 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.767 INFO:teuthology.orchestra.run.smithi043.stdout: "req_link_latency": { 2024-08-26T00:14:59.767 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.768 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.768 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.768 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.768 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookup_latency": { 2024-08-26T00:14:59.768 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 31258, 2024-08-26T00:14:59.768 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 472.884484658, 2024-08-26T00:14:59.768 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.015128430 2024-08-26T00:14:59.768 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.768 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookuphash_latency": { 2024-08-26T00:14:59.768 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.768 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.768 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.768 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.768 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupino_latency": { 2024-08-26T00:14:59.769 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.769 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.769 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.769 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.769 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupname_latency": { 2024-08-26T00:14:59.769 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.769 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.769 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.769 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.769 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupparent_latency": { 2024-08-26T00:14:59.769 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.769 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.769 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.769 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.770 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupsnap_latency": { 2024-08-26T00:14:59.770 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.770 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.770 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.770 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.770 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lssnap_latency": { 2024-08-26T00:14:59.770 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.770 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.770 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.770 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.770 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mkdir_latency": { 2024-08-26T00:14:59.770 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 296, 2024-08-26T00:14:59.771 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 2.824251073, 2024-08-26T00:14:59.771 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.009541388 2024-08-26T00:14:59.771 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.771 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mknod_latency": { 2024-08-26T00:14:59.771 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.771 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.771 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.771 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.771 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mksnap_latency": { 2024-08-26T00:14:59.771 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.771 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.771 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.772 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.772 INFO:teuthology.orchestra.run.smithi043.stdout: "req_open_latency": { 2024-08-26T00:14:59.772 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 11639, 2024-08-26T00:14:59.772 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 54.979648027, 2024-08-26T00:14:59.772 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.004723743 2024-08-26T00:14:59.772 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.772 INFO:teuthology.orchestra.run.smithi043.stdout: "req_readdir_latency": { 2024-08-26T00:14:59.772 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 1900, 2024-08-26T00:14:59.772 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 2.343315558, 2024-08-26T00:14:59.772 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.001233323 2024-08-26T00:14:59.772 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.772 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rename_latency": { 2024-08-26T00:14:59.773 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 48389, 2024-08-26T00:14:59.773 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 522.062661930, 2024-08-26T00:14:59.773 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.010788870 2024-08-26T00:14:59.773 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.773 INFO:teuthology.orchestra.run.smithi043.stdout: "req_renamesnap_latency": { 2024-08-26T00:14:59.773 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.773 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.773 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.773 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.773 INFO:teuthology.orchestra.run.smithi043.stdout: "req_snapdiff_latency": { 2024-08-26T00:14:59.773 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.773 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.773 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.774 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.774 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmdir_latency": { 2024-08-26T00:14:59.774 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 289, 2024-08-26T00:14:59.774 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 30.516248339, 2024-08-26T00:14:59.774 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.105592554 2024-08-26T00:14:59.774 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.774 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmsnap_latency": { 2024-08-26T00:14:59.774 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.774 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.775 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.775 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.775 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmxattr_latency": { 2024-08-26T00:14:59.775 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.775 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.775 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.775 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.775 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setattr_latency": { 2024-08-26T00:14:59.775 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 1, 2024-08-26T00:14:59.775 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.003448278, 2024-08-26T00:14:59.775 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.003448278 2024-08-26T00:14:59.775 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.775 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setdirlayout_latency": { 2024-08-26T00:14:59.776 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.776 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.776 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.776 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.776 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setfilelock_latency": { 2024-08-26T00:14:59.776 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.776 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.776 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.776 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.776 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setlayout_latency": { 2024-08-26T00:14:59.776 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.776 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.776 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.777 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.777 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setxattr_latency": { 2024-08-26T00:14:59.777 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.777 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.777 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.777 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.777 INFO:teuthology.orchestra.run.smithi043.stdout: "req_symlink_latency": { 2024-08-26T00:14:59.777 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.777 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.777 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.777 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.777 INFO:teuthology.orchestra.run.smithi043.stdout: "req_unlink_latency": { 2024-08-26T00:14:59.777 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 41642, 2024-08-26T00:14:59.777 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 68.943330670, 2024-08-26T00:14:59.778 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.001655620 2024-08-26T00:14:59.778 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.778 INFO:teuthology.orchestra.run.smithi043.stdout: "cap_revoke_eviction": 0, 2024-08-26T00:14:59.778 INFO:teuthology.orchestra.run.smithi043.stdout: "cap_acquisition_throttle": 0, 2024-08-26T00:14:59.778 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getvxattr_latency": { 2024-08-26T00:14:59.778 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.778 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.778 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.778 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:14:59.778 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.779 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_sessions": { 2024-08-26T00:14:59.779 INFO:teuthology.orchestra.run.smithi043.stdout: "session_count": 1, 2024-08-26T00:14:59.779 INFO:teuthology.orchestra.run.smithi043.stdout: "session_add": 1, 2024-08-26T00:14:59.779 INFO:teuthology.orchestra.run.smithi043.stdout: "session_remove": 0, 2024-08-26T00:14:59.779 INFO:teuthology.orchestra.run.smithi043.stdout: "sessions_open": 1, 2024-08-26T00:14:59.779 INFO:teuthology.orchestra.run.smithi043.stdout: "sessions_stale": 0, 2024-08-26T00:14:59.779 INFO:teuthology.orchestra.run.smithi043.stdout: "total_load": 25122, 2024-08-26T00:14:59.779 INFO:teuthology.orchestra.run.smithi043.stdout: "average_load": 25122, 2024-08-26T00:14:59.779 INFO:teuthology.orchestra.run.smithi043.stdout: "avg_session_uptime": 740, 2024-08-26T00:14:59.779 INFO:teuthology.orchestra.run.smithi043.stdout: "mdthresh_evicted": 0 2024-08-26T00:14:59.779 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.779 INFO:teuthology.orchestra.run.smithi043.stdout: "mempool": { 2024-08-26T00:14:59.779 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_bytes": 0, 2024-08-26T00:14:59.780 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_items": 0, 2024-08-26T00:14:59.780 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_bytes": 0, 2024-08-26T00:14:59.780 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_items": 0, 2024-08-26T00:14:59.780 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_bytes": 0, 2024-08-26T00:14:59.780 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_items": 0, 2024-08-26T00:14:59.780 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-26T00:14:59.780 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_items": 0, 2024-08-26T00:14:59.780 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-26T00:14:59.780 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_items": 0, 2024-08-26T00:14:59.780 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_bytes": 0, 2024-08-26T00:14:59.780 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_items": 0, 2024-08-26T00:14:59.780 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-26T00:14:59.780 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_items": 0, 2024-08-26T00:14:59.781 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_bytes": 0, 2024-08-26T00:14:59.781 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_items": 0, 2024-08-26T00:14:59.781 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_bytes": 0, 2024-08-26T00:14:59.781 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_items": 0, 2024-08-26T00:14:59.781 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-26T00:14:59.781 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_items": 0, 2024-08-26T00:14:59.781 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-26T00:14:59.781 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_items": 0, 2024-08-26T00:14:59.781 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_bytes": 0, 2024-08-26T00:14:59.781 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_items": 0, 2024-08-26T00:14:59.781 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_bytes": 0, 2024-08-26T00:14:59.781 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_items": 0, 2024-08-26T00:14:59.781 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-26T00:14:59.782 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_items": 0, 2024-08-26T00:14:59.782 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_bytes": 0, 2024-08-26T00:14:59.782 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_items": 0, 2024-08-26T00:14:59.782 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_bytes": 0, 2024-08-26T00:14:59.782 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_items": 0, 2024-08-26T00:14:59.782 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_bytes": 0, 2024-08-26T00:14:59.782 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_items": 0, 2024-08-26T00:14:59.782 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_bytes": 0, 2024-08-26T00:14:59.782 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_items": 0, 2024-08-26T00:14:59.782 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_bytes": 316872, 2024-08-26T00:14:59.782 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_items": 161, 2024-08-26T00:14:59.782 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_bytes": 264, 2024-08-26T00:14:59.782 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_items": 3, 2024-08-26T00:14:59.783 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bytes": 0, 2024-08-26T00:14:59.783 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_items": 0, 2024-08-26T00:14:59.783 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_bytes": 0, 2024-08-26T00:14:59.783 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_items": 0, 2024-08-26T00:14:59.783 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_bytes": 0, 2024-08-26T00:14:59.783 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_items": 0, 2024-08-26T00:14:59.783 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_bytes": 7592, 2024-08-26T00:14:59.783 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_items": 156, 2024-08-26T00:14:59.783 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_bytes": 0, 2024-08-26T00:14:59.783 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_items": 0, 2024-08-26T00:14:59.783 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_bytes": 0, 2024-08-26T00:14:59.783 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_items": 0, 2024-08-26T00:14:59.783 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_bytes": 3037872, 2024-08-26T00:14:59.784 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_items": 44293, 2024-08-26T00:14:59.784 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_bytes": 0, 2024-08-26T00:14:59.784 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_items": 0, 2024-08-26T00:14:59.784 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_bytes": 0, 2024-08-26T00:14:59.784 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_items": 0 2024-08-26T00:14:59.784 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.784 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter": { 2024-08-26T00:14:59.784 INFO:teuthology.orchestra.run.smithi043.stdout: "op_active": 0, 2024-08-26T00:14:59.784 INFO:teuthology.orchestra.run.smithi043.stdout: "op_laggy": 0, 2024-08-26T00:14:59.784 INFO:teuthology.orchestra.run.smithi043.stdout: "op_send": 222523, 2024-08-26T00:14:59.784 INFO:teuthology.orchestra.run.smithi043.stdout: "op_send_bytes": 698603249, 2024-08-26T00:14:59.784 INFO:teuthology.orchestra.run.smithi043.stdout: "op_resend": 32, 2024-08-26T00:14:59.784 INFO:teuthology.orchestra.run.smithi043.stdout: "op_reply": 222523, 2024-08-26T00:14:59.784 INFO:teuthology.orchestra.run.smithi043.stdout: "op_latency": { 2024-08-26T00:14:59.785 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 222523, 2024-08-26T00:14:59.785 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 1868.316984094, 2024-08-26T00:14:59.785 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.008396062 2024-08-26T00:14:59.785 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.785 INFO:teuthology.orchestra.run.smithi043.stdout: "op_inflight": 0, 2024-08-26T00:14:59.785 INFO:teuthology.orchestra.run.smithi043.stdout: "oplen_avg": { 2024-08-26T00:14:59.785 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 222523, 2024-08-26T00:14:59.785 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 240852 2024-08-26T00:14:59.785 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.785 INFO:teuthology.orchestra.run.smithi043.stdout: "op": 222523, 2024-08-26T00:14:59.785 INFO:teuthology.orchestra.run.smithi043.stdout: "op_r": 152951, 2024-08-26T00:14:59.785 INFO:teuthology.orchestra.run.smithi043.stdout: "op_w": 69572, 2024-08-26T00:14:59.785 INFO:teuthology.orchestra.run.smithi043.stdout: "op_rmw": 0, 2024-08-26T00:14:59.786 INFO:teuthology.orchestra.run.smithi043.stdout: "op_pg": 0, 2024-08-26T00:14:59.786 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_stat": 254, 2024-08-26T00:14:59.786 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_create": 7299, 2024-08-26T00:14:59.786 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_read": 1320, 2024-08-26T00:14:59.786 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_write": 6718, 2024-08-26T00:14:59.786 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_writefull": 672, 2024-08-26T00:14:59.786 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_writesame": 0, 2024-08-26T00:14:59.786 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_append": 0, 2024-08-26T00:14:59.786 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_zero": 0, 2024-08-26T00:14:59.786 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_truncate": 201, 2024-08-26T00:14:59.786 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_delete": 52060, 2024-08-26T00:14:59.786 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_mapext": 0, 2024-08-26T00:14:59.787 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_sparse_read": 0, 2024-08-26T00:14:59.787 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_clonerange": 0, 2024-08-26T00:14:59.787 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_getxattr": 151601, 2024-08-26T00:14:59.787 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_setxattr": 14598, 2024-08-26T00:14:59.787 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_cmpxattr": 0, 2024-08-26T00:14:59.787 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_rmxattr": 0, 2024-08-26T00:14:59.787 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_resetxattrs": 0, 2024-08-26T00:14:59.787 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_call": 0, 2024-08-26T00:14:59.787 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_watch": 0, 2024-08-26T00:14:59.787 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_notify": 0, 2024-08-26T00:14:59.787 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_src_cmpxattr": 0, 2024-08-26T00:14:59.787 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_pgls": 0, 2024-08-26T00:14:59.787 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_pgls_filter": 0, 2024-08-26T00:14:59.788 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_other": 1, 2024-08-26T00:14:59.788 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_active": 0, 2024-08-26T00:14:59.788 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_send": 0, 2024-08-26T00:14:59.788 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_resend": 0, 2024-08-26T00:14:59.788 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_ping": 0, 2024-08-26T00:14:59.788 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_active": 0, 2024-08-26T00:14:59.788 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_send": 0, 2024-08-26T00:14:59.788 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_resend": 0, 2024-08-26T00:14:59.788 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_active": 0, 2024-08-26T00:14:59.788 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_send": 0, 2024-08-26T00:14:59.788 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_resend": 0, 2024-08-26T00:14:59.788 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_active": 0, 2024-08-26T00:14:59.788 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_send": 0, 2024-08-26T00:14:59.789 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_resend": 0, 2024-08-26T00:14:59.789 INFO:teuthology.orchestra.run.smithi043.stdout: "command_active": 0, 2024-08-26T00:14:59.789 INFO:teuthology.orchestra.run.smithi043.stdout: "command_send": 0, 2024-08-26T00:14:59.789 INFO:teuthology.orchestra.run.smithi043.stdout: "command_resend": 0, 2024-08-26T00:14:59.789 INFO:teuthology.orchestra.run.smithi043.stdout: "map_epoch": 80, 2024-08-26T00:14:59.789 INFO:teuthology.orchestra.run.smithi043.stdout: "map_full": 0, 2024-08-26T00:14:59.789 INFO:teuthology.orchestra.run.smithi043.stdout: "map_inc": 2, 2024-08-26T00:14:59.789 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_sessions": 12, 2024-08-26T00:14:59.789 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_session_open": 12, 2024-08-26T00:14:59.789 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_session_close": 0, 2024-08-26T00:14:59.789 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_laggy": 0, 2024-08-26T00:14:59.789 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_wr": 5178, 2024-08-26T00:14:59.789 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_rd": 44, 2024-08-26T00:14:59.790 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_del": 906 2024-08-26T00:14:59.790 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.790 INFO:teuthology.orchestra.run.smithi043.stdout: "oft": { 2024-08-26T00:14:59.790 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_objs": 1, 2024-08-26T00:14:59.790 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_kv_pairs": 0, 2024-08-26T00:14:59.790 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_updates": 0, 2024-08-26T00:14:59.790 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_removes": 0 2024-08-26T00:14:59.790 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.790 INFO:teuthology.orchestra.run.smithi043.stdout: "osd-slow-ops": { 2024-08-26T00:14:59.790 INFO:teuthology.orchestra.run.smithi043.stdout: "slow_ops_count": 0 2024-08-26T00:14:59.790 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.790 INFO:teuthology.orchestra.run.smithi043.stdout: "purge_queue": { 2024-08-26T00:14:59.791 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_ops": 0, 2024-08-26T00:14:59.791 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_ops_high_water": 18, 2024-08-26T00:14:59.791 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing": 0, 2024-08-26T00:14:59.791 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_high_water": 10, 2024-08-26T00:14:59.791 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executed_ops": 51728, 2024-08-26T00:14:59.791 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executed": 50116, 2024-08-26T00:14:59.791 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_item_in_journal": 0 2024-08-26T00:14:59.791 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.791 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-26T00:14:59.791 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-08-26T00:14:59.791 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-08-26T00:14:59.791 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-08-26T00:14:59.792 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 711323, 2024-08-26T00:14:59.792 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 208458250, 2024-08-26T00:14:59.792 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-08-26T00:14:59.792 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 711323, 2024-08-26T00:14:59.792 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-08-26T00:14:59.792 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-08-26T00:14:59.792 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 711323, 2024-08-26T00:14:59.792 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 208458250, 2024-08-26T00:14:59.792 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-08-26T00:14:59.793 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.793 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.793 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.793 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:14:59.793 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.793 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-objecter_bytes": { 2024-08-26T00:14:59.793 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-08-26T00:14:59.793 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-08-26T00:14:59.793 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-08-26T00:14:59.793 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-08-26T00:14:59.793 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-08-26T00:14:59.794 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-08-26T00:14:59.794 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-08-26T00:14:59.794 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 222523, 2024-08-26T00:14:59.794 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 703665719, 2024-08-26T00:14:59.794 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 222523, 2024-08-26T00:14:59.794 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 703665719, 2024-08-26T00:14:59.794 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-08-26T00:14:59.794 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.794 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.794 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.794 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:14:59.794 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.794 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-objecter_ops": { 2024-08-26T00:14:59.795 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-08-26T00:14:59.795 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 1024, 2024-08-26T00:14:59.795 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-08-26T00:14:59.795 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-08-26T00:14:59.795 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-08-26T00:14:59.795 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-08-26T00:14:59.795 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-08-26T00:14:59.795 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 222523, 2024-08-26T00:14:59.796 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 222523, 2024-08-26T00:14:59.796 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 222523, 2024-08-26T00:14:59.796 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 222523, 2024-08-26T00:14:59.796 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-08-26T00:14:59.796 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.796 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.796 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.796 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:14:59.796 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.796 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-write_buf_throttle": { 2024-08-26T00:14:59.796 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-08-26T00:14:59.797 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 3758096384, 2024-08-26T00:14:59.797 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-08-26T00:14:59.797 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 50116, 2024-08-26T00:14:59.797 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 5063348, 2024-08-26T00:14:59.797 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-08-26T00:14:59.797 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 50116, 2024-08-26T00:14:59.798 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-08-26T00:14:59.798 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-08-26T00:14:59.798 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 1322, 2024-08-26T00:14:59.798 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 5063348, 2024-08-26T00:14:59.798 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-08-26T00:14:59.798 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.798 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.798 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.798 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:14:59.798 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:14:59.798 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-write_buf_throttle-0x56277ce9c960": { 2024-08-26T00:14:59.798 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-08-26T00:14:59.799 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 3758096384, 2024-08-26T00:14:59.799 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-08-26T00:14:59.799 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 298064, 2024-08-26T00:14:59.799 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 646352072, 2024-08-26T00:14:59.799 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-08-26T00:14:59.799 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 298064, 2024-08-26T00:14:59.799 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-08-26T00:14:59.799 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-08-26T00:14:59.799 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 5394, 2024-08-26T00:14:59.799 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 646352072, 2024-08-26T00:14:59.800 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-08-26T00:14:59.800 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:14:59.800 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:14:59.800 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:14:59.800 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:14:59.800 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:14:59.800 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-08-26T00:15:00.951 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:00 smithi043 ceph-mon[22091]: pgmap v713: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 41 op/s 2024-08-26T00:15:00.981 INFO:tasks.check_counter:Daemon mds.b mds.exported=170 2024-08-26T00:15:00.982 INFO:tasks.check_counter:Daemon mds.b mds.imported=213 2024-08-26T00:15:00.982 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=201 2024-08-26T00:15:00.982 DEBUG:tasks.check_counter:Getting stats from e 2024-08-26T00:15:00.982 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph daemon mds.e perf dump 2024-08-26T00:15:01.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:00 smithi042 ceph-mon[17225]: pgmap v713: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 41 op/s 2024-08-26T00:15:01.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:00 smithi181 ceph-mon[22102]: pgmap v713: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 41 op/s 2024-08-26T00:15:01.236 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.b/config 2024-08-26T00:15:01.892 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-08-26T00:15:01.893 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-0": { 2024-08-26T00:15:01.893 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 1039, 2024-08-26T00:15:01.893 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 1039, 2024-08-26T00:15:01.893 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 140389298, 2024-08-26T00:15:01.893 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 329642, 2024-08-26T00:15:01.893 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 8, 2024-08-26T00:15:01.893 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 4, 2024-08-26T00:15:01.893 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.148244225, 2024-08-26T00:15:01.893 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.024188118, 2024-08-26T00:15:01.893 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.093358748, 2024-08-26T00:15:01.893 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.023059373, 2024-08-26T00:15:01.893 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:15:01.893 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 1038, 2024-08-26T00:15:01.894 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.036500016, 2024-08-26T00:15:01.894 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000035163 2024-08-26T00:15:01.894 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.894 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:15:01.894 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.894 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.894 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.894 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.894 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-26T00:15:01.894 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 448 2024-08-26T00:15:01.894 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.894 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-1": { 2024-08-26T00:15:01.895 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 882, 2024-08-26T00:15:01.895 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 1065, 2024-08-26T00:15:01.895 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 130250034, 2024-08-26T00:15:01.895 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 678083, 2024-08-26T00:15:01.895 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 7, 2024-08-26T00:15:01.895 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 6, 2024-08-26T00:15:01.895 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.144651997, 2024-08-26T00:15:01.895 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.023883430, 2024-08-26T00:15:01.895 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.091471607, 2024-08-26T00:15:01.895 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.021840639, 2024-08-26T00:15:01.895 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:15:01.895 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 1063, 2024-08-26T00:15:01.895 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.038410991, 2024-08-26T00:15:01.896 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000036134 2024-08-26T00:15:01.896 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.896 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:15:01.896 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.896 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.896 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.896 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.896 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-26T00:15:01.896 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 397920 2024-08-26T00:15:01.896 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.896 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-2": { 2024-08-26T00:15:01.896 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 1501, 2024-08-26T00:15:01.896 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 1488, 2024-08-26T00:15:01.897 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 93205921, 2024-08-26T00:15:01.897 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 544066, 2024-08-26T00:15:01.897 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 5, 2024-08-26T00:15:01.897 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 4, 2024-08-26T00:15:01.897 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.182652744, 2024-08-26T00:15:01.897 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.045128009, 2024-08-26T00:15:01.897 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.100449510, 2024-08-26T00:15:01.897 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.033326697, 2024-08-26T00:15:01.897 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:15:01.897 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 1487, 2024-08-26T00:15:01.897 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.054084044, 2024-08-26T00:15:01.897 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000036371 2024-08-26T00:15:01.898 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.898 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:15:01.898 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.898 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.898 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.898 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.898 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 543664, 2024-08-26T00:15:01.898 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 150064 2024-08-26T00:15:01.898 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.898 INFO:teuthology.orchestra.run.smithi043.stdout: "cct": { 2024-08-26T00:15:01.898 INFO:teuthology.orchestra.run.smithi043.stdout: "total_workers": 1, 2024-08-26T00:15:01.898 INFO:teuthology.orchestra.run.smithi043.stdout: "unhealthy_workers": 0 2024-08-26T00:15:01.899 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.899 INFO:teuthology.orchestra.run.smithi043.stdout: "finisher-MDSRank": { 2024-08-26T00:15:01.899 INFO:teuthology.orchestra.run.smithi043.stdout: "queue_len": 0, 2024-08-26T00:15:01.899 INFO:teuthology.orchestra.run.smithi043.stdout: "complete_latency": { 2024-08-26T00:15:01.899 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 5115, 2024-08-26T00:15:01.899 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.151574836, 2024-08-26T00:15:01.899 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000029633 2024-08-26T00:15:01.899 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:15:01.899 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.899 INFO:teuthology.orchestra.run.smithi043.stdout: "finisher-PurgeQueue": { 2024-08-26T00:15:01.899 INFO:teuthology.orchestra.run.smithi043.stdout: "queue_len": 0, 2024-08-26T00:15:01.899 INFO:teuthology.orchestra.run.smithi043.stdout: "complete_latency": { 2024-08-26T00:15:01.899 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.900 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.900 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.900 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:15:01.900 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.900 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2024-08-26T00:15:01.900 INFO:teuthology.orchestra.run.smithi043.stdout: "request": 0, 2024-08-26T00:15:01.900 INFO:teuthology.orchestra.run.smithi043.stdout: "reply": 0, 2024-08-26T00:15:01.900 INFO:teuthology.orchestra.run.smithi043.stdout: "reply_latency": { 2024-08-26T00:15:01.900 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.900 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.900 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.900 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.900 INFO:teuthology.orchestra.run.smithi043.stdout: "slow_reply": 0, 2024-08-26T00:15:01.900 INFO:teuthology.orchestra.run.smithi043.stdout: "forward": 0, 2024-08-26T00:15:01.901 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_fetch_complete": 0, 2024-08-26T00:15:01.901 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_fetch_keys": 0, 2024-08-26T00:15:01.901 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_commit": 0, 2024-08-26T00:15:01.901 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_split": 0, 2024-08-26T00:15:01.901 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_merge": 0, 2024-08-26T00:15:01.901 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes": 19770, 2024-08-26T00:15:01.901 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_top": 2632, 2024-08-26T00:15:01.901 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_bottom": 17138, 2024-08-26T00:15:01.901 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_pin_tail": 0, 2024-08-26T00:15:01.901 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_pinned": 16009, 2024-08-26T00:15:01.901 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_expired": 0, 2024-08-26T00:15:01.901 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_with_caps": 0, 2024-08-26T00:15:01.901 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": 0, 2024-08-26T00:15:01.902 INFO:teuthology.orchestra.run.smithi043.stdout: "subtrees": 1, 2024-08-26T00:15:01.902 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse": 0, 2024-08-26T00:15:01.902 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_hit": 0, 2024-08-26T00:15:01.902 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_forward": 0, 2024-08-26T00:15:01.902 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_discover": 0, 2024-08-26T00:15:01.902 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_dir_fetch": 0, 2024-08-26T00:15:01.902 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_remote_ino": 0, 2024-08-26T00:15:01.902 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_lock": 0, 2024-08-26T00:15:01.902 INFO:teuthology.orchestra.run.smithi043.stdout: "load_cent": 0, 2024-08-26T00:15:01.902 INFO:teuthology.orchestra.run.smithi043.stdout: "q": 0, 2024-08-26T00:15:01.902 INFO:teuthology.orchestra.run.smithi043.stdout: "exported": 0, 2024-08-26T00:15:01.902 INFO:teuthology.orchestra.run.smithi043.stdout: "exported_inodes": 0, 2024-08-26T00:15:01.902 INFO:teuthology.orchestra.run.smithi043.stdout: "imported": 0, 2024-08-26T00:15:01.903 INFO:teuthology.orchestra.run.smithi043.stdout: "imported_inodes": 0, 2024-08-26T00:15:01.903 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_dir_fetch": 0, 2024-08-26T00:15:01.903 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_backtrace_fetch": 0, 2024-08-26T00:15:01.903 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_peer_discover": 0, 2024-08-26T00:15:01.903 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rfiles": 0, 2024-08-26T00:15:01.903 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rbytes": 0, 2024-08-26T00:15:01.903 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rsnaps": 0, 2024-08-26T00:15:01.903 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_backtrace_fetch": 0, 2024-08-26T00:15:01.903 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_set_tag": 0, 2024-08-26T00:15:01.903 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_backtrace_repaired": 0, 2024-08-26T00:15:01.903 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_inotable_repaired": 0, 2024-08-26T00:15:01.903 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dir_inodes": 0, 2024-08-26T00:15:01.903 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dir_base_inodes": 0, 2024-08-26T00:15:01.904 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dirfrag_rstats": 0, 2024-08-26T00:15:01.904 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_file_inodes": 0, 2024-08-26T00:15:01.904 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_inode_file_caps": 0, 2024-08-26T00:15:01.904 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_revoke": 0, 2024-08-26T00:15:01.904 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_grant": 0, 2024-08-26T00:15:01.904 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_trunc": 0, 2024-08-26T00:15:01.904 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-26T00:15:01.904 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-26T00:15:01.904 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_caps": 0, 2024-08-26T00:15:01.904 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_caps_dirty": 0, 2024-08-26T00:15:01.904 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_cap_release": 0, 2024-08-26T00:15:01.904 INFO:teuthology.orchestra.run.smithi043.stdout: "process_request_cap_release": 0 2024-08-26T00:15:01.904 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.904 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache": { 2024-08-26T00:15:01.905 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_update": 0, 2024-08-26T00:15:01.905 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_update_receipt": 0, 2024-08-26T00:15:01.905 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_try_discover": 0, 2024-08-26T00:15:01.905 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_send_discover": 0, 2024-08-26T00:15:01.905 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_handle_discover": 0, 2024-08-26T00:15:01.905 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays": 0, 2024-08-26T00:15:01.905 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays_delayed": 0, 2024-08-26T00:15:01.905 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays_enqueuing": 0, 2024-08-26T00:15:01.905 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_created": 0, 2024-08-26T00:15:01.905 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_enqueued": 0, 2024-08-26T00:15:01.905 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_reintegrated": 0, 2024-08-26T00:15:01.905 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_migrated": 0, 2024-08-26T00:15:01.905 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_processing": 0, 2024-08-26T00:15:01.905 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_enqueued": 0, 2024-08-26T00:15:01.906 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_prioritized": 0, 2024-08-26T00:15:01.906 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_started": 0, 2024-08-26T00:15:01.906 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_completed": 0, 2024-08-26T00:15:01.906 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_quiesce_path": 0, 2024-08-26T00:15:01.906 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_quiesce_inode": 0, 2024-08-26T00:15:01.906 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_enqueue_scrub": 0, 2024-08-26T00:15:01.906 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_exportdir": 0, 2024-08-26T00:15:01.906 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_flush": 0, 2024-08-26T00:15:01.906 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_fragmentdir": 0, 2024-08-26T00:15:01.906 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_fragstats": 0, 2024-08-26T00:15:01.906 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_inodestats": 0 2024-08-26T00:15:01.906 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.906 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log": { 2024-08-26T00:15:01.906 INFO:teuthology.orchestra.run.smithi043.stdout: "evlrg": 0, 2024-08-26T00:15:01.907 INFO:teuthology.orchestra.run.smithi043.stdout: "evadd": 0, 2024-08-26T00:15:01.907 INFO:teuthology.orchestra.run.smithi043.stdout: "evex": 0, 2024-08-26T00:15:01.907 INFO:teuthology.orchestra.run.smithi043.stdout: "evtrm": 0, 2024-08-26T00:15:01.907 INFO:teuthology.orchestra.run.smithi043.stdout: "ev": 163273, 2024-08-26T00:15:01.907 INFO:teuthology.orchestra.run.smithi043.stdout: "evexg": 0, 2024-08-26T00:15:01.907 INFO:teuthology.orchestra.run.smithi043.stdout: "evexd": 0, 2024-08-26T00:15:01.907 INFO:teuthology.orchestra.run.smithi043.stdout: "segadd": 0, 2024-08-26T00:15:01.907 INFO:teuthology.orchestra.run.smithi043.stdout: "segex": 0, 2024-08-26T00:15:01.907 INFO:teuthology.orchestra.run.smithi043.stdout: "segtrm": 0, 2024-08-26T00:15:01.907 INFO:teuthology.orchestra.run.smithi043.stdout: "seg": 137, 2024-08-26T00:15:01.907 INFO:teuthology.orchestra.run.smithi043.stdout: "segmjr": 15, 2024-08-26T00:15:01.907 INFO:teuthology.orchestra.run.smithi043.stdout: "segexg": 0, 2024-08-26T00:15:01.907 INFO:teuthology.orchestra.run.smithi043.stdout: "segexd": 0, 2024-08-26T00:15:01.907 INFO:teuthology.orchestra.run.smithi043.stdout: "expos": 115305183, 2024-08-26T00:15:01.907 INFO:teuthology.orchestra.run.smithi043.stdout: "wrpos": 366603941, 2024-08-26T00:15:01.908 INFO:teuthology.orchestra.run.smithi043.stdout: "rdpos": 366602803, 2024-08-26T00:15:01.908 INFO:teuthology.orchestra.run.smithi043.stdout: "jlat": { 2024-08-26T00:15:01.908 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.908 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.908 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.908 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.908 INFO:teuthology.orchestra.run.smithi043.stdout: "replayed": 163273 2024-08-26T00:15:01.908 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.908 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_mem": { 2024-08-26T00:15:01.908 INFO:teuthology.orchestra.run.smithi043.stdout: "ino": 13, 2024-08-26T00:15:01.908 INFO:teuthology.orchestra.run.smithi043.stdout: "ino+": 56318, 2024-08-26T00:15:01.908 INFO:teuthology.orchestra.run.smithi043.stdout: "ino-": 56305, 2024-08-26T00:15:01.908 INFO:teuthology.orchestra.run.smithi043.stdout: "dir": 11, 2024-08-26T00:15:01.909 INFO:teuthology.orchestra.run.smithi043.stdout: "dir+": 2299, 2024-08-26T00:15:01.909 INFO:teuthology.orchestra.run.smithi043.stdout: "dir-": 2288, 2024-08-26T00:15:01.909 INFO:teuthology.orchestra.run.smithi043.stdout: "dn": 19770, 2024-08-26T00:15:01.909 INFO:teuthology.orchestra.run.smithi043.stdout: "dn+": 106116, 2024-08-26T00:15:01.909 INFO:teuthology.orchestra.run.smithi043.stdout: "dn-": 86346, 2024-08-26T00:15:01.909 INFO:teuthology.orchestra.run.smithi043.stdout: "cap": 0, 2024-08-26T00:15:01.909 INFO:teuthology.orchestra.run.smithi043.stdout: "cap+": 0, 2024-08-26T00:15:01.909 INFO:teuthology.orchestra.run.smithi043.stdout: "cap-": 0, 2024-08-26T00:15:01.909 INFO:teuthology.orchestra.run.smithi043.stdout: "rss": 111212, 2024-08-26T00:15:01.909 INFO:teuthology.orchestra.run.smithi043.stdout: "heap": 215328 2024-08-26T00:15:01.909 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.909 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_server": { 2024-08-26T00:15:01.909 INFO:teuthology.orchestra.run.smithi043.stdout: "dispatch_client_request": 0, 2024-08-26T00:15:01.909 INFO:teuthology.orchestra.run.smithi043.stdout: "dispatch_server_request": 0, 2024-08-26T00:15:01.909 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_request": 0, 2024-08-26T00:15:01.910 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_session": 0, 2024-08-26T00:15:01.910 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_peer_request": 0, 2024-08-26T00:15:01.910 INFO:teuthology.orchestra.run.smithi043.stdout: "req_create_latency": { 2024-08-26T00:15:01.910 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.910 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.910 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.910 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.910 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getattr_latency": { 2024-08-26T00:15:01.910 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.910 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.910 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.910 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.911 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getfilelock_latency": { 2024-08-26T00:15:01.911 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.911 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.911 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.911 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.911 INFO:teuthology.orchestra.run.smithi043.stdout: "req_link_latency": { 2024-08-26T00:15:01.911 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.911 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.911 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.911 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.911 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookup_latency": { 2024-08-26T00:15:01.911 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.911 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.912 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.912 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.912 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookuphash_latency": { 2024-08-26T00:15:01.912 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.912 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.912 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.912 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.912 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupino_latency": { 2024-08-26T00:15:01.912 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.912 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.912 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.912 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.912 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupname_latency": { 2024-08-26T00:15:01.912 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.912 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.913 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.913 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.913 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupparent_latency": { 2024-08-26T00:15:01.913 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.913 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.913 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.913 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.913 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupsnap_latency": { 2024-08-26T00:15:01.913 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.913 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.913 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.913 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.913 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lssnap_latency": { 2024-08-26T00:15:01.913 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.914 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.914 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.914 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.914 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mkdir_latency": { 2024-08-26T00:15:01.914 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.914 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.914 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.914 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.914 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mknod_latency": { 2024-08-26T00:15:01.914 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.914 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.914 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.915 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.915 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mksnap_latency": { 2024-08-26T00:15:01.915 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.915 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.915 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.915 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.915 INFO:teuthology.orchestra.run.smithi043.stdout: "req_open_latency": { 2024-08-26T00:15:01.915 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.915 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.915 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.915 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.915 INFO:teuthology.orchestra.run.smithi043.stdout: "req_readdir_latency": { 2024-08-26T00:15:01.916 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.916 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.916 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.916 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.916 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rename_latency": { 2024-08-26T00:15:01.916 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.916 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.916 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.916 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.916 INFO:teuthology.orchestra.run.smithi043.stdout: "req_renamesnap_latency": { 2024-08-26T00:15:01.916 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.916 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.916 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.917 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.917 INFO:teuthology.orchestra.run.smithi043.stdout: "req_snapdiff_latency": { 2024-08-26T00:15:01.917 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.917 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.917 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.917 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.917 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmdir_latency": { 2024-08-26T00:15:01.917 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.917 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.917 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.917 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.917 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmsnap_latency": { 2024-08-26T00:15:01.917 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.917 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.918 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.918 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.918 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmxattr_latency": { 2024-08-26T00:15:01.918 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.918 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.918 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.918 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.918 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setattr_latency": { 2024-08-26T00:15:01.918 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.918 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.918 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.918 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.918 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setdirlayout_latency": { 2024-08-26T00:15:01.919 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.919 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.919 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.919 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.919 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setfilelock_latency": { 2024-08-26T00:15:01.919 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.919 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.919 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.919 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.919 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setlayout_latency": { 2024-08-26T00:15:01.919 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.919 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.919 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.920 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.920 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setxattr_latency": { 2024-08-26T00:15:01.920 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.920 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.920 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.920 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.920 INFO:teuthology.orchestra.run.smithi043.stdout: "req_symlink_latency": { 2024-08-26T00:15:01.920 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.920 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.920 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.921 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.921 INFO:teuthology.orchestra.run.smithi043.stdout: "req_unlink_latency": { 2024-08-26T00:15:01.921 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.921 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.921 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.921 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.921 INFO:teuthology.orchestra.run.smithi043.stdout: "cap_revoke_eviction": 0, 2024-08-26T00:15:01.921 INFO:teuthology.orchestra.run.smithi043.stdout: "cap_acquisition_throttle": 0, 2024-08-26T00:15:01.921 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getvxattr_latency": { 2024-08-26T00:15:01.921 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.921 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.922 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.922 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:15:01.922 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.922 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_sessions": { 2024-08-26T00:15:01.922 INFO:teuthology.orchestra.run.smithi043.stdout: "session_count": 1, 2024-08-26T00:15:01.922 INFO:teuthology.orchestra.run.smithi043.stdout: "session_add": 2, 2024-08-26T00:15:01.922 INFO:teuthology.orchestra.run.smithi043.stdout: "session_remove": 1, 2024-08-26T00:15:01.922 INFO:teuthology.orchestra.run.smithi043.stdout: "sessions_open": 1, 2024-08-26T00:15:01.922 INFO:teuthology.orchestra.run.smithi043.stdout: "sessions_stale": 0, 2024-08-26T00:15:01.922 INFO:teuthology.orchestra.run.smithi043.stdout: "total_load": 0, 2024-08-26T00:15:01.922 INFO:teuthology.orchestra.run.smithi043.stdout: "average_load": 0, 2024-08-26T00:15:01.922 INFO:teuthology.orchestra.run.smithi043.stdout: "avg_session_uptime": 1890, 2024-08-26T00:15:01.922 INFO:teuthology.orchestra.run.smithi043.stdout: "mdthresh_evicted": 0 2024-08-26T00:15:01.922 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.923 INFO:teuthology.orchestra.run.smithi043.stdout: "mempool": { 2024-08-26T00:15:01.923 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_bytes": 0, 2024-08-26T00:15:01.923 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_items": 0, 2024-08-26T00:15:01.923 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_bytes": 0, 2024-08-26T00:15:01.923 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_items": 0, 2024-08-26T00:15:01.923 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_bytes": 0, 2024-08-26T00:15:01.923 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_items": 0, 2024-08-26T00:15:01.923 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-26T00:15:01.923 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_items": 0, 2024-08-26T00:15:01.923 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-26T00:15:01.923 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_items": 0, 2024-08-26T00:15:01.923 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_bytes": 0, 2024-08-26T00:15:01.923 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_items": 0, 2024-08-26T00:15:01.924 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-26T00:15:01.924 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_items": 0, 2024-08-26T00:15:01.924 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_bytes": 0, 2024-08-26T00:15:01.924 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_items": 0, 2024-08-26T00:15:01.924 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_bytes": 0, 2024-08-26T00:15:01.924 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_items": 0, 2024-08-26T00:15:01.924 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-26T00:15:01.924 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_items": 0, 2024-08-26T00:15:01.924 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-26T00:15:01.924 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_items": 0, 2024-08-26T00:15:01.924 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_bytes": 0, 2024-08-26T00:15:01.924 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_items": 0, 2024-08-26T00:15:01.924 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_bytes": 0, 2024-08-26T00:15:01.924 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_items": 0, 2024-08-26T00:15:01.925 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-26T00:15:01.925 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_items": 0, 2024-08-26T00:15:01.925 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_bytes": 0, 2024-08-26T00:15:01.925 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_items": 0, 2024-08-26T00:15:01.925 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_bytes": 0, 2024-08-26T00:15:01.925 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_items": 0, 2024-08-26T00:15:01.925 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_bytes": 0, 2024-08-26T00:15:01.925 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_items": 0, 2024-08-26T00:15:01.925 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_bytes": 0, 2024-08-26T00:15:01.925 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_items": 0, 2024-08-26T00:15:01.925 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_bytes": 240255, 2024-08-26T00:15:01.925 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_items": 81, 2024-08-26T00:15:01.925 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_bytes": 0, 2024-08-26T00:15:01.926 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_items": 0, 2024-08-26T00:15:01.926 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bytes": 0, 2024-08-26T00:15:01.926 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_items": 0, 2024-08-26T00:15:01.926 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_bytes": 0, 2024-08-26T00:15:01.926 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_items": 0, 2024-08-26T00:15:01.926 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_bytes": 0, 2024-08-26T00:15:01.926 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_items": 0, 2024-08-26T00:15:01.926 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_bytes": 7592, 2024-08-26T00:15:01.926 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_items": 156, 2024-08-26T00:15:01.926 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_bytes": 0, 2024-08-26T00:15:01.926 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_items": 0, 2024-08-26T00:15:01.926 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_bytes": 0, 2024-08-26T00:15:01.926 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_items": 0, 2024-08-26T00:15:01.927 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_bytes": 13961672, 2024-08-26T00:15:01.927 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_items": 79208, 2024-08-26T00:15:01.927 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_bytes": 0, 2024-08-26T00:15:01.927 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_items": 0, 2024-08-26T00:15:01.927 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_bytes": 0, 2024-08-26T00:15:01.927 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_items": 0 2024-08-26T00:15:01.927 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.927 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter": { 2024-08-26T00:15:01.927 INFO:teuthology.orchestra.run.smithi043.stdout: "op_active": 0, 2024-08-26T00:15:01.927 INFO:teuthology.orchestra.run.smithi043.stdout: "op_laggy": 0, 2024-08-26T00:15:01.927 INFO:teuthology.orchestra.run.smithi043.stdout: "op_send": 3155, 2024-08-26T00:15:01.927 INFO:teuthology.orchestra.run.smithi043.stdout: "op_send_bytes": 21, 2024-08-26T00:15:01.927 INFO:teuthology.orchestra.run.smithi043.stdout: "op_resend": 3, 2024-08-26T00:15:01.927 INFO:teuthology.orchestra.run.smithi043.stdout: "op_reply": 3155, 2024-08-26T00:15:01.928 INFO:teuthology.orchestra.run.smithi043.stdout: "op_latency": { 2024-08-26T00:15:01.928 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 3155, 2024-08-26T00:15:01.928 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 21.820742274, 2024-08-26T00:15:01.928 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.006916241 2024-08-26T00:15:01.928 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.928 INFO:teuthology.orchestra.run.smithi043.stdout: "op_inflight": 0, 2024-08-26T00:15:01.928 INFO:teuthology.orchestra.run.smithi043.stdout: "oplen_avg": { 2024-08-26T00:15:01.928 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 3155, 2024-08-26T00:15:01.928 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 3156 2024-08-26T00:15:01.928 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.928 INFO:teuthology.orchestra.run.smithi043.stdout: "op": 3155, 2024-08-26T00:15:01.928 INFO:teuthology.orchestra.run.smithi043.stdout: "op_r": 3155, 2024-08-26T00:15:01.928 INFO:teuthology.orchestra.run.smithi043.stdout: "op_w": 0, 2024-08-26T00:15:01.929 INFO:teuthology.orchestra.run.smithi043.stdout: "op_rmw": 0, 2024-08-26T00:15:01.929 INFO:teuthology.orchestra.run.smithi043.stdout: "op_pg": 0, 2024-08-26T00:15:01.929 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_stat": 1888, 2024-08-26T00:15:01.929 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_create": 0, 2024-08-26T00:15:01.929 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_read": 1265, 2024-08-26T00:15:01.929 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_write": 0, 2024-08-26T00:15:01.929 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_writefull": 0, 2024-08-26T00:15:01.929 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_writesame": 0, 2024-08-26T00:15:01.929 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_append": 0, 2024-08-26T00:15:01.929 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_zero": 0, 2024-08-26T00:15:01.929 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_truncate": 0, 2024-08-26T00:15:01.929 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_delete": 0, 2024-08-26T00:15:01.929 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_mapext": 0, 2024-08-26T00:15:01.929 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_sparse_read": 0, 2024-08-26T00:15:01.930 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_clonerange": 0, 2024-08-26T00:15:01.930 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_getxattr": 1, 2024-08-26T00:15:01.930 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_setxattr": 0, 2024-08-26T00:15:01.930 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_cmpxattr": 0, 2024-08-26T00:15:01.930 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_rmxattr": 0, 2024-08-26T00:15:01.930 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_resetxattrs": 0, 2024-08-26T00:15:01.930 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_call": 0, 2024-08-26T00:15:01.930 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_watch": 0, 2024-08-26T00:15:01.930 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_notify": 0, 2024-08-26T00:15:01.930 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_src_cmpxattr": 0, 2024-08-26T00:15:01.930 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_pgls": 0, 2024-08-26T00:15:01.930 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_pgls_filter": 0, 2024-08-26T00:15:01.930 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_other": 0, 2024-08-26T00:15:01.930 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_active": 0, 2024-08-26T00:15:01.931 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_send": 0, 2024-08-26T00:15:01.931 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_resend": 0, 2024-08-26T00:15:01.931 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_ping": 0, 2024-08-26T00:15:01.931 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_active": 0, 2024-08-26T00:15:01.931 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_send": 0, 2024-08-26T00:15:01.931 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_resend": 0, 2024-08-26T00:15:01.931 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_active": 0, 2024-08-26T00:15:01.931 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_send": 0, 2024-08-26T00:15:01.931 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_resend": 0, 2024-08-26T00:15:01.931 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_active": 0, 2024-08-26T00:15:01.931 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_send": 0, 2024-08-26T00:15:01.931 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_resend": 0, 2024-08-26T00:15:01.931 INFO:teuthology.orchestra.run.smithi043.stdout: "command_active": 0, 2024-08-26T00:15:01.932 INFO:teuthology.orchestra.run.smithi043.stdout: "command_send": 0, 2024-08-26T00:15:01.932 INFO:teuthology.orchestra.run.smithi043.stdout: "command_resend": 0, 2024-08-26T00:15:01.932 INFO:teuthology.orchestra.run.smithi043.stdout: "map_epoch": 80, 2024-08-26T00:15:01.932 INFO:teuthology.orchestra.run.smithi043.stdout: "map_full": 0, 2024-08-26T00:15:01.932 INFO:teuthology.orchestra.run.smithi043.stdout: "map_inc": 2, 2024-08-26T00:15:01.932 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_sessions": 11, 2024-08-26T00:15:01.932 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_session_open": 11, 2024-08-26T00:15:01.932 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_session_close": 0, 2024-08-26T00:15:01.932 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_laggy": 0, 2024-08-26T00:15:01.932 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_wr": 0, 2024-08-26T00:15:01.932 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_rd": 2, 2024-08-26T00:15:01.932 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_del": 0 2024-08-26T00:15:01.932 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.932 INFO:teuthology.orchestra.run.smithi043.stdout: "oft": { 2024-08-26T00:15:01.933 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_objs": 0, 2024-08-26T00:15:01.933 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_kv_pairs": 0, 2024-08-26T00:15:01.933 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_updates": 0, 2024-08-26T00:15:01.933 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_removes": 0 2024-08-26T00:15:01.933 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.933 INFO:teuthology.orchestra.run.smithi043.stdout: "osd-slow-ops": { 2024-08-26T00:15:01.933 INFO:teuthology.orchestra.run.smithi043.stdout: "slow_ops_count": 0 2024-08-26T00:15:01.933 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.933 INFO:teuthology.orchestra.run.smithi043.stdout: "purge_queue": { 2024-08-26T00:15:01.933 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_ops": 0, 2024-08-26T00:15:01.933 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_ops_high_water": 0, 2024-08-26T00:15:01.933 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing": 0, 2024-08-26T00:15:01.933 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_high_water": 0, 2024-08-26T00:15:01.934 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executed_ops": 0, 2024-08-26T00:15:01.934 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executed": 0, 2024-08-26T00:15:01.934 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_item_in_journal": 0 2024-08-26T00:15:01.934 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.934 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-26T00:15:01.934 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-08-26T00:15:01.934 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-08-26T00:15:01.934 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-08-26T00:15:01.934 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 3418, 2024-08-26T00:15:01.934 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 363521183, 2024-08-26T00:15:01.934 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:01.934 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 3418, 2024-08-26T00:15:01.934 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-08-26T00:15:01.935 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-08-26T00:15:01.935 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 3418, 2024-08-26T00:15:01.935 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 363521183, 2024-08-26T00:15:01.935 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-08-26T00:15:01.935 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.935 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.935 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.935 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:15:01.935 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.935 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-objecter_bytes": { 2024-08-26T00:15:01.935 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-08-26T00:15:01.935 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-08-26T00:15:01.936 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-08-26T00:15:01.936 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-08-26T00:15:01.936 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-08-26T00:15:01.936 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:01.936 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-08-26T00:15:01.936 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 3155, 2024-08-26T00:15:01.936 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 362424243, 2024-08-26T00:15:01.936 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 3155, 2024-08-26T00:15:01.936 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 362424243, 2024-08-26T00:15:01.936 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-08-26T00:15:01.936 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.936 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.936 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.936 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:15:01.937 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.937 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-objecter_ops": { 2024-08-26T00:15:01.937 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-08-26T00:15:01.937 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 1024, 2024-08-26T00:15:01.937 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-08-26T00:15:01.937 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-08-26T00:15:01.937 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-08-26T00:15:01.937 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:01.937 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-08-26T00:15:01.937 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 3155, 2024-08-26T00:15:01.937 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 3155, 2024-08-26T00:15:01.937 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 3155, 2024-08-26T00:15:01.937 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 3155, 2024-08-26T00:15:01.937 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-08-26T00:15:01.938 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.938 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.938 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.938 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:15:01.938 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.938 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-write_buf_throttle": { 2024-08-26T00:15:01.938 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-08-26T00:15:01.938 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 3758096384, 2024-08-26T00:15:01.938 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-08-26T00:15:01.938 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-08-26T00:15:01.938 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-08-26T00:15:01.938 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:01.938 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-08-26T00:15:01.938 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-08-26T00:15:01.939 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-08-26T00:15:01.939 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 0, 2024-08-26T00:15:01.939 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 0, 2024-08-26T00:15:01.939 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-08-26T00:15:01.939 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.939 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.939 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.939 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:15:01.939 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:01.939 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-write_buf_throttle-0x564d5fe44b40": { 2024-08-26T00:15:01.939 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-08-26T00:15:01.939 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 3758096384, 2024-08-26T00:15:01.939 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-08-26T00:15:01.939 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-08-26T00:15:01.940 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-08-26T00:15:01.940 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:01.940 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-08-26T00:15:01.940 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-08-26T00:15:01.940 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-08-26T00:15:01.940 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 0, 2024-08-26T00:15:01.940 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 0, 2024-08-26T00:15:01.940 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-08-26T00:15:01.940 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:01.940 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:01.940 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:01.940 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:15:01.940 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:15:01.940 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-08-26T00:15:02.697 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:02 smithi043 ceph-mon[22091]: pgmap v714: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.0 KiB/s wr, 9 op/s 2024-08-26T00:15:02.729 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-08-26T00:15:02.729 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-08-26T00:15:02.729 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-08-26T00:15:02.729 DEBUG:tasks.check_counter:Getting stats from h 2024-08-26T00:15:02.729 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph daemon mds.h perf dump 2024-08-26T00:15:02.987 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.b/config 2024-08-26T00:15:03.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:02 smithi042 ceph-mon[17225]: pgmap v714: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.0 KiB/s wr, 9 op/s 2024-08-26T00:15:03.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:02 smithi181 ceph-mon[22102]: pgmap v714: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.0 KiB/s wr, 9 op/s 2024-08-26T00:15:03.575 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-08-26T00:15:03.575 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-0": { 2024-08-26T00:15:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 1723, 2024-08-26T00:15:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 1710, 2024-08-26T00:15:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 144019300, 2024-08-26T00:15:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 614322, 2024-08-26T00:15:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 7, 2024-08-26T00:15:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 3, 2024-08-26T00:15:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.208076492, 2024-08-26T00:15:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.053265424, 2024-08-26T00:15:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.113964951, 2024-08-26T00:15:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.035147640, 2024-08-26T00:15:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:15:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 1709, 2024-08-26T00:15:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.061729356, 2024-08-26T00:15:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000036120 2024-08-26T00:15:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:15:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 542496, 2024-08-26T00:15:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 149088 2024-08-26T00:15:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-1": { 2024-08-26T00:15:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 715, 2024-08-26T00:15:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 897, 2024-08-26T00:15:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 205714567, 2024-08-26T00:15:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 626474, 2024-08-26T00:15:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 7, 2024-08-26T00:15:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 6, 2024-08-26T00:15:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.145987653, 2024-08-26T00:15:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.021253095, 2024-08-26T00:15:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.104180842, 2024-08-26T00:15:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.014654309, 2024-08-26T00:15:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:15:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 895, 2024-08-26T00:15:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.025422730, 2024-08-26T00:15:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000028405 2024-08-26T00:15:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:15:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-26T00:15:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 399360 2024-08-26T00:15:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-2": { 2024-08-26T00:15:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 1470, 2024-08-26T00:15:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 1470, 2024-08-26T00:15:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 298193661, 2024-08-26T00:15:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 466643, 2024-08-26T00:15:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 6, 2024-08-26T00:15:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 5, 2024-08-26T00:15:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.251711232, 2024-08-26T00:15:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.025160056, 2024-08-26T00:15:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.187108337, 2024-08-26T00:15:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.030980554, 2024-08-26T00:15:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:15:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 1469, 2024-08-26T00:15:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.043664357, 2024-08-26T00:15:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000029723 2024-08-26T00:15:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:15:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-26T00:15:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 448 2024-08-26T00:15:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "cct": { 2024-08-26T00:15:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "total_workers": 1, 2024-08-26T00:15:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "unhealthy_workers": 0 2024-08-26T00:15:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "finisher-MDSRank": { 2024-08-26T00:15:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "queue_len": 0, 2024-08-26T00:15:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "complete_latency": { 2024-08-26T00:15:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 5732, 2024-08-26T00:15:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.182311722, 2024-08-26T00:15:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000031805 2024-08-26T00:15:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:15:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "finisher-PurgeQueue": { 2024-08-26T00:15:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "queue_len": 0, 2024-08-26T00:15:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "complete_latency": { 2024-08-26T00:15:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:15:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2024-08-26T00:15:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "request": 0, 2024-08-26T00:15:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "reply": 0, 2024-08-26T00:15:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "reply_latency": { 2024-08-26T00:15:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "slow_reply": 0, 2024-08-26T00:15:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "forward": 0, 2024-08-26T00:15:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_fetch_complete": 0, 2024-08-26T00:15:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_fetch_keys": 0, 2024-08-26T00:15:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_commit": 0, 2024-08-26T00:15:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_split": 0, 2024-08-26T00:15:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_merge": 0, 2024-08-26T00:15:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes": 60373, 2024-08-26T00:15:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_top": 12233, 2024-08-26T00:15:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_bottom": 48140, 2024-08-26T00:15:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_pin_tail": 0, 2024-08-26T00:15:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_pinned": 42897, 2024-08-26T00:15:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_expired": 0, 2024-08-26T00:15:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_with_caps": 0, 2024-08-26T00:15:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": 0, 2024-08-26T00:15:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "subtrees": 1, 2024-08-26T00:15:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse": 0, 2024-08-26T00:15:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_hit": 0, 2024-08-26T00:15:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_forward": 0, 2024-08-26T00:15:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_discover": 0, 2024-08-26T00:15:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_dir_fetch": 0, 2024-08-26T00:15:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_remote_ino": 0, 2024-08-26T00:15:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_lock": 0, 2024-08-26T00:15:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "load_cent": 0, 2024-08-26T00:15:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "q": 0, 2024-08-26T00:15:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "exported": 0, 2024-08-26T00:15:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "exported_inodes": 0, 2024-08-26T00:15:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "imported": 0, 2024-08-26T00:15:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "imported_inodes": 0, 2024-08-26T00:15:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_dir_fetch": 0, 2024-08-26T00:15:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_backtrace_fetch": 0, 2024-08-26T00:15:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_peer_discover": 0, 2024-08-26T00:15:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rfiles": 0, 2024-08-26T00:15:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rbytes": 0, 2024-08-26T00:15:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rsnaps": 0, 2024-08-26T00:15:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_backtrace_fetch": 0, 2024-08-26T00:15:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_set_tag": 0, 2024-08-26T00:15:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_backtrace_repaired": 0, 2024-08-26T00:15:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_inotable_repaired": 0, 2024-08-26T00:15:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dir_inodes": 0, 2024-08-26T00:15:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dir_base_inodes": 0, 2024-08-26T00:15:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dirfrag_rstats": 0, 2024-08-26T00:15:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_file_inodes": 0, 2024-08-26T00:15:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_inode_file_caps": 0, 2024-08-26T00:15:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_revoke": 0, 2024-08-26T00:15:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_grant": 0, 2024-08-26T00:15:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_trunc": 0, 2024-08-26T00:15:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-26T00:15:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-26T00:15:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_caps": 0, 2024-08-26T00:15:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_caps_dirty": 0, 2024-08-26T00:15:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_cap_release": 0, 2024-08-26T00:15:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "process_request_cap_release": 0 2024-08-26T00:15:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache": { 2024-08-26T00:15:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_update": 0, 2024-08-26T00:15:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_update_receipt": 0, 2024-08-26T00:15:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_try_discover": 0, 2024-08-26T00:15:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_send_discover": 0, 2024-08-26T00:15:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_handle_discover": 0, 2024-08-26T00:15:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays": 0, 2024-08-26T00:15:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays_delayed": 0, 2024-08-26T00:15:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays_enqueuing": 0, 2024-08-26T00:15:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_created": 0, 2024-08-26T00:15:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_enqueued": 0, 2024-08-26T00:15:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_reintegrated": 0, 2024-08-26T00:15:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_migrated": 0, 2024-08-26T00:15:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_processing": 0, 2024-08-26T00:15:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_enqueued": 0, 2024-08-26T00:15:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_prioritized": 0, 2024-08-26T00:15:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_started": 0, 2024-08-26T00:15:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_completed": 0, 2024-08-26T00:15:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_quiesce_path": 0, 2024-08-26T00:15:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_quiesce_inode": 0, 2024-08-26T00:15:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_enqueue_scrub": 0, 2024-08-26T00:15:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_exportdir": 0, 2024-08-26T00:15:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_flush": 0, 2024-08-26T00:15:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_fragmentdir": 0, 2024-08-26T00:15:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_fragstats": 0, 2024-08-26T00:15:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_inodestats": 0 2024-08-26T00:15:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log": { 2024-08-26T00:15:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "evlrg": 0, 2024-08-26T00:15:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "evadd": 0, 2024-08-26T00:15:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "evex": 0, 2024-08-26T00:15:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "evtrm": 0, 2024-08-26T00:15:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "ev": 298064, 2024-08-26T00:15:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "evexg": 0, 2024-08-26T00:15:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "evexd": 0, 2024-08-26T00:15:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "segadd": 0, 2024-08-26T00:15:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "segex": 0, 2024-08-26T00:15:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "segtrm": 0, 2024-08-26T00:15:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "seg": 130, 2024-08-26T00:15:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "segmjr": 26, 2024-08-26T00:15:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "segexg": 0, 2024-08-26T00:15:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "segexd": 0, 2024-08-26T00:15:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "expos": 458059492, 2024-08-26T00:15:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "wrpos": 650546376, 2024-08-26T00:15:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "rdpos": 650544725, 2024-08-26T00:15:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "jlat": { 2024-08-26T00:15:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: "replayed": 298064 2024-08-26T00:15:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_mem": { 2024-08-26T00:15:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: "ino": 54, 2024-08-26T00:15:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: "ino+": 88977, 2024-08-26T00:15:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: "ino-": 88923, 2024-08-26T00:15:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: "dir": 311, 2024-08-26T00:15:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "dir+": 3850, 2024-08-26T00:15:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "dir-": 3539, 2024-08-26T00:15:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "dn": 60373, 2024-08-26T00:15:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "dn+": 195949, 2024-08-26T00:15:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "dn-": 135576, 2024-08-26T00:15:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "cap": 0, 2024-08-26T00:15:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "cap+": 0, 2024-08-26T00:15:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "cap-": 0, 2024-08-26T00:15:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "rss": 120016, 2024-08-26T00:15:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "heap": 215328 2024-08-26T00:15:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_server": { 2024-08-26T00:15:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "dispatch_client_request": 0, 2024-08-26T00:15:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "dispatch_server_request": 0, 2024-08-26T00:15:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_request": 0, 2024-08-26T00:15:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_session": 0, 2024-08-26T00:15:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_peer_request": 0, 2024-08-26T00:15:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "req_create_latency": { 2024-08-26T00:15:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getattr_latency": { 2024-08-26T00:15:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getfilelock_latency": { 2024-08-26T00:15:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "req_link_latency": { 2024-08-26T00:15:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookup_latency": { 2024-08-26T00:15:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookuphash_latency": { 2024-08-26T00:15:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupino_latency": { 2024-08-26T00:15:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupname_latency": { 2024-08-26T00:15:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.596 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.596 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.596 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupparent_latency": { 2024-08-26T00:15:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupsnap_latency": { 2024-08-26T00:15:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lssnap_latency": { 2024-08-26T00:15:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.599 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.599 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.599 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mkdir_latency": { 2024-08-26T00:15:03.599 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mknod_latency": { 2024-08-26T00:15:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mksnap_latency": { 2024-08-26T00:15:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "req_open_latency": { 2024-08-26T00:15:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "req_readdir_latency": { 2024-08-26T00:15:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rename_latency": { 2024-08-26T00:15:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "req_renamesnap_latency": { 2024-08-26T00:15:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "req_snapdiff_latency": { 2024-08-26T00:15:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmdir_latency": { 2024-08-26T00:15:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmsnap_latency": { 2024-08-26T00:15:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmxattr_latency": { 2024-08-26T00:15:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.604 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setattr_latency": { 2024-08-26T00:15:03.604 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.604 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.604 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.604 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.604 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setdirlayout_latency": { 2024-08-26T00:15:03.604 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.604 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.604 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.604 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.604 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setfilelock_latency": { 2024-08-26T00:15:03.604 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.604 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.604 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.605 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.605 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setlayout_latency": { 2024-08-26T00:15:03.605 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.605 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.605 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.605 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.605 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setxattr_latency": { 2024-08-26T00:15:03.605 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.605 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.605 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.605 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.605 INFO:teuthology.orchestra.run.smithi043.stdout: "req_symlink_latency": { 2024-08-26T00:15:03.605 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "req_unlink_latency": { 2024-08-26T00:15:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "cap_revoke_eviction": 0, 2024-08-26T00:15:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "cap_acquisition_throttle": 0, 2024-08-26T00:15:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getvxattr_latency": { 2024-08-26T00:15:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:15:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_sessions": { 2024-08-26T00:15:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "session_count": 1, 2024-08-26T00:15:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "session_add": 1, 2024-08-26T00:15:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "session_remove": 0, 2024-08-26T00:15:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "sessions_open": 1, 2024-08-26T00:15:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "sessions_stale": 0, 2024-08-26T00:15:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "total_load": 0, 2024-08-26T00:15:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "average_load": 0, 2024-08-26T00:15:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "avg_session_uptime": 1893, 2024-08-26T00:15:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "mdthresh_evicted": 0 2024-08-26T00:15:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "mempool": { 2024-08-26T00:15:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_bytes": 0, 2024-08-26T00:15:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_items": 0, 2024-08-26T00:15:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_bytes": 0, 2024-08-26T00:15:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_items": 0, 2024-08-26T00:15:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_bytes": 0, 2024-08-26T00:15:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_items": 0, 2024-08-26T00:15:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-26T00:15:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_items": 0, 2024-08-26T00:15:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-26T00:15:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_items": 0, 2024-08-26T00:15:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_bytes": 0, 2024-08-26T00:15:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_items": 0, 2024-08-26T00:15:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-26T00:15:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_items": 0, 2024-08-26T00:15:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_bytes": 0, 2024-08-26T00:15:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_items": 0, 2024-08-26T00:15:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_bytes": 0, 2024-08-26T00:15:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_items": 0, 2024-08-26T00:15:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-26T00:15:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_items": 0, 2024-08-26T00:15:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-26T00:15:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_items": 0, 2024-08-26T00:15:03.610 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_bytes": 0, 2024-08-26T00:15:03.610 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_items": 0, 2024-08-26T00:15:03.610 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_bytes": 0, 2024-08-26T00:15:03.610 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_items": 0, 2024-08-26T00:15:03.610 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-26T00:15:03.610 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_items": 0, 2024-08-26T00:15:03.610 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_bytes": 0, 2024-08-26T00:15:03.610 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_items": 0, 2024-08-26T00:15:03.610 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_bytes": 0, 2024-08-26T00:15:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_items": 0, 2024-08-26T00:15:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_bytes": 0, 2024-08-26T00:15:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_items": 0, 2024-08-26T00:15:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_bytes": 0, 2024-08-26T00:15:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_items": 0, 2024-08-26T00:15:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_bytes": 240181, 2024-08-26T00:15:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_items": 118, 2024-08-26T00:15:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_bytes": 0, 2024-08-26T00:15:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_items": 0, 2024-08-26T00:15:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bytes": 0, 2024-08-26T00:15:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_items": 0, 2024-08-26T00:15:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_bytes": 0, 2024-08-26T00:15:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_items": 0, 2024-08-26T00:15:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_bytes": 0, 2024-08-26T00:15:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_items": 0, 2024-08-26T00:15:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_bytes": 7592, 2024-08-26T00:15:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_items": 156, 2024-08-26T00:15:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_bytes": 0, 2024-08-26T00:15:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_items": 0, 2024-08-26T00:15:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_bytes": 0, 2024-08-26T00:15:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_items": 0, 2024-08-26T00:15:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_bytes": 43085988, 2024-08-26T00:15:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_items": 310654, 2024-08-26T00:15:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_bytes": 0, 2024-08-26T00:15:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_items": 0, 2024-08-26T00:15:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_bytes": 0, 2024-08-26T00:15:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_items": 0 2024-08-26T00:15:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter": { 2024-08-26T00:15:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "op_active": 0, 2024-08-26T00:15:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "op_laggy": 0, 2024-08-26T00:15:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "op_send": 3643, 2024-08-26T00:15:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "op_send_bytes": 21, 2024-08-26T00:15:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "op_resend": 3, 2024-08-26T00:15:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "op_reply": 3643, 2024-08-26T00:15:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "op_latency": { 2024-08-26T00:15:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 3643, 2024-08-26T00:15:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 14.612827531, 2024-08-26T00:15:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.004011207 2024-08-26T00:15:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "op_inflight": 0, 2024-08-26T00:15:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "oplen_avg": { 2024-08-26T00:15:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 3643, 2024-08-26T00:15:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 3644 2024-08-26T00:15:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "op": 3643, 2024-08-26T00:15:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "op_r": 3643, 2024-08-26T00:15:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "op_w": 0, 2024-08-26T00:15:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "op_rmw": 0, 2024-08-26T00:15:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "op_pg": 0, 2024-08-26T00:15:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_stat": 2177, 2024-08-26T00:15:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_create": 0, 2024-08-26T00:15:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_read": 1464, 2024-08-26T00:15:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_write": 0, 2024-08-26T00:15:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_writefull": 0, 2024-08-26T00:15:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_writesame": 0, 2024-08-26T00:15:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_append": 0, 2024-08-26T00:15:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_zero": 0, 2024-08-26T00:15:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_truncate": 0, 2024-08-26T00:15:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_delete": 0, 2024-08-26T00:15:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_mapext": 0, 2024-08-26T00:15:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_sparse_read": 0, 2024-08-26T00:15:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_clonerange": 0, 2024-08-26T00:15:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_getxattr": 1, 2024-08-26T00:15:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_setxattr": 0, 2024-08-26T00:15:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_cmpxattr": 0, 2024-08-26T00:15:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_rmxattr": 0, 2024-08-26T00:15:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_resetxattrs": 0, 2024-08-26T00:15:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_call": 0, 2024-08-26T00:15:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_watch": 0, 2024-08-26T00:15:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_notify": 0, 2024-08-26T00:15:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_src_cmpxattr": 0, 2024-08-26T00:15:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_pgls": 0, 2024-08-26T00:15:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_pgls_filter": 0, 2024-08-26T00:15:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_other": 0, 2024-08-26T00:15:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_active": 0, 2024-08-26T00:15:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_send": 0, 2024-08-26T00:15:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_resend": 0, 2024-08-26T00:15:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_ping": 0, 2024-08-26T00:15:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_active": 0, 2024-08-26T00:15:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_send": 0, 2024-08-26T00:15:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_resend": 0, 2024-08-26T00:15:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_active": 0, 2024-08-26T00:15:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_send": 0, 2024-08-26T00:15:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_resend": 0, 2024-08-26T00:15:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_active": 0, 2024-08-26T00:15:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_send": 0, 2024-08-26T00:15:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_resend": 0, 2024-08-26T00:15:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "command_active": 0, 2024-08-26T00:15:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "command_send": 0, 2024-08-26T00:15:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "command_resend": 0, 2024-08-26T00:15:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "map_epoch": 80, 2024-08-26T00:15:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "map_full": 0, 2024-08-26T00:15:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "map_inc": 2, 2024-08-26T00:15:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_sessions": 11, 2024-08-26T00:15:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_session_open": 11, 2024-08-26T00:15:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_session_close": 0, 2024-08-26T00:15:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_laggy": 0, 2024-08-26T00:15:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_wr": 0, 2024-08-26T00:15:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_rd": 2, 2024-08-26T00:15:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_del": 0 2024-08-26T00:15:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "oft": { 2024-08-26T00:15:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_objs": 0, 2024-08-26T00:15:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_kv_pairs": 0, 2024-08-26T00:15:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_updates": 0, 2024-08-26T00:15:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_removes": 0 2024-08-26T00:15:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "osd-slow-ops": { 2024-08-26T00:15:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "slow_ops_count": 0 2024-08-26T00:15:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "purge_queue": { 2024-08-26T00:15:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_ops": 0, 2024-08-26T00:15:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_ops_high_water": 0, 2024-08-26T00:15:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing": 0, 2024-08-26T00:15:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_high_water": 0, 2024-08-26T00:15:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executed_ops": 0, 2024-08-26T00:15:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executed": 0, 2024-08-26T00:15:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_item_in_journal": 0 2024-08-26T00:15:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-26T00:15:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-08-26T00:15:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-08-26T00:15:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-08-26T00:15:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 3904, 2024-08-26T00:15:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 647559809, 2024-08-26T00:15:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 3904, 2024-08-26T00:15:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-08-26T00:15:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-08-26T00:15:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 3904, 2024-08-26T00:15:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 647559809, 2024-08-26T00:15:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-08-26T00:15:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:15:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-objecter_bytes": { 2024-08-26T00:15:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-08-26T00:15:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-08-26T00:15:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-08-26T00:15:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-08-26T00:15:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-08-26T00:15:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-08-26T00:15:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 3643, 2024-08-26T00:15:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 646380394, 2024-08-26T00:15:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 3643, 2024-08-26T00:15:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 646380394, 2024-08-26T00:15:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-08-26T00:15:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:15:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-objecter_ops": { 2024-08-26T00:15:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-08-26T00:15:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 1024, 2024-08-26T00:15:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-08-26T00:15:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-08-26T00:15:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-08-26T00:15:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-08-26T00:15:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 3643, 2024-08-26T00:15:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 3643, 2024-08-26T00:15:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 3643, 2024-08-26T00:15:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 3643, 2024-08-26T00:15:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-08-26T00:15:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:15:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-write_buf_throttle": { 2024-08-26T00:15:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-08-26T00:15:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 3758096384, 2024-08-26T00:15:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-08-26T00:15:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-08-26T00:15:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-08-26T00:15:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-08-26T00:15:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-08-26T00:15:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-08-26T00:15:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 0, 2024-08-26T00:15:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 0, 2024-08-26T00:15:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-08-26T00:15:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:15:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-write_buf_throttle-0x56214ab74b40": { 2024-08-26T00:15:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-08-26T00:15:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 3758096384, 2024-08-26T00:15:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-08-26T00:15:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-08-26T00:15:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-08-26T00:15:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-08-26T00:15:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-08-26T00:15:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-08-26T00:15:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 0, 2024-08-26T00:15:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 0, 2024-08-26T00:15:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-08-26T00:15:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:03.626 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:15:03.626 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:15:03.626 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-08-26T00:15:04.318 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-08-26T00:15:04.318 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-08-26T00:15:04.318 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-08-26T00:15:04.318 DEBUG:tasks.check_counter:Getting stats from k 2024-08-26T00:15:04.319 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph daemon mds.k perf dump 2024-08-26T00:15:04.571 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.b/config 2024-08-26T00:15:04.808 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:04 smithi043 ceph-mon[22091]: pgmap v715: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.5 KiB/s wr, 10 op/s 2024-08-26T00:15:05.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:04 smithi042 ceph-mon[17225]: pgmap v715: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.5 KiB/s wr, 10 op/s 2024-08-26T00:15:05.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:04 smithi181 ceph-mon[22102]: pgmap v715: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.5 KiB/s wr, 10 op/s 2024-08-26T00:15:05.037 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-08-26T00:15:05.037 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-0": { 2024-08-26T00:15:05.037 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 0, 2024-08-26T00:15:05.037 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 2, 2024-08-26T00:15:05.037 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 0, 2024-08-26T00:15:05.037 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 0, 2024-08-26T00:15:05.037 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 4, 2024-08-26T00:15:05.037 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 0, 2024-08-26T00:15:05.037 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.001054396, 2024-08-26T00:15:05.037 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.000000000, 2024-08-26T00:15:05.038 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.000178929, 2024-08-26T00:15:05.038 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-26T00:15:05.038 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:15:05.038 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:05.038 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:05.038 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:05.038 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:05.038 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:15:05.038 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:05.038 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:05.038 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:05.038 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:05.038 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-26T00:15:05.038 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 0 2024-08-26T00:15:05.039 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:05.039 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-1": { 2024-08-26T00:15:05.039 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 6, 2024-08-26T00:15:05.039 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 190, 2024-08-26T00:15:05.039 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 3312, 2024-08-26T00:15:05.039 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 190496, 2024-08-26T00:15:05.039 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 4, 2024-08-26T00:15:05.039 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 2, 2024-08-26T00:15:05.039 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.012497806, 2024-08-26T00:15:05.039 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.007467198, 2024-08-26T00:15:05.039 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.003304366, 2024-08-26T00:15:05.039 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-26T00:15:05.039 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:15:05.040 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 189, 2024-08-26T00:15:05.040 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.015329288, 2024-08-26T00:15:05.040 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000081107 2024-08-26T00:15:05.040 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:05.040 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:15:05.040 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:05.040 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:05.040 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:05.040 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:05.040 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-08-26T00:15:05.040 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 190496 2024-08-26T00:15:05.040 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:05.040 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-2": { 2024-08-26T00:15:05.041 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 249, 2024-08-26T00:15:05.041 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 246, 2024-08-26T00:15:05.041 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 487024, 2024-08-26T00:15:05.041 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 151424, 2024-08-26T00:15:05.041 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 2, 2024-08-26T00:15:05.041 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 1, 2024-08-26T00:15:05.041 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.030673902, 2024-08-26T00:15:05.041 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.013557651, 2024-08-26T00:15:05.041 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.022639854, 2024-08-26T00:15:05.041 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-26T00:15:05.041 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:15:05.041 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 245, 2024-08-26T00:15:05.041 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.010852402, 2024-08-26T00:15:05.042 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000044295 2024-08-26T00:15:05.042 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:05.042 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:15:05.042 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:05.042 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:05.042 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:05.042 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:05.042 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 487024, 2024-08-26T00:15:05.042 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 151424 2024-08-26T00:15:05.042 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:05.042 INFO:teuthology.orchestra.run.smithi043.stdout: "cct": { 2024-08-26T00:15:05.042 INFO:teuthology.orchestra.run.smithi043.stdout: "total_workers": 0, 2024-08-26T00:15:05.042 INFO:teuthology.orchestra.run.smithi043.stdout: "unhealthy_workers": 0 2024-08-26T00:15:05.043 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:05.043 INFO:teuthology.orchestra.run.smithi043.stdout: "mempool": { 2024-08-26T00:15:05.043 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_bytes": 0, 2024-08-26T00:15:05.043 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_items": 0, 2024-08-26T00:15:05.043 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_bytes": 0, 2024-08-26T00:15:05.043 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_items": 0, 2024-08-26T00:15:05.043 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_bytes": 0, 2024-08-26T00:15:05.043 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_items": 0, 2024-08-26T00:15:05.043 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-26T00:15:05.043 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_items": 0, 2024-08-26T00:15:05.044 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-26T00:15:05.044 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_items": 0, 2024-08-26T00:15:05.044 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_bytes": 0, 2024-08-26T00:15:05.044 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_items": 0, 2024-08-26T00:15:05.044 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-26T00:15:05.044 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_items": 0, 2024-08-26T00:15:05.044 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_bytes": 0, 2024-08-26T00:15:05.044 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_items": 0, 2024-08-26T00:15:05.044 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_bytes": 0, 2024-08-26T00:15:05.044 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_items": 0, 2024-08-26T00:15:05.044 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-26T00:15:05.044 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_items": 0, 2024-08-26T00:15:05.044 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-26T00:15:05.045 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_items": 0, 2024-08-26T00:15:05.045 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_bytes": 0, 2024-08-26T00:15:05.045 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_items": 0, 2024-08-26T00:15:05.045 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_bytes": 0, 2024-08-26T00:15:05.045 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_items": 0, 2024-08-26T00:15:05.045 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-26T00:15:05.045 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_items": 0, 2024-08-26T00:15:05.045 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_bytes": 0, 2024-08-26T00:15:05.045 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_items": 0, 2024-08-26T00:15:05.045 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_bytes": 0, 2024-08-26T00:15:05.046 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_items": 0, 2024-08-26T00:15:05.046 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_bytes": 0, 2024-08-26T00:15:05.046 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_items": 0, 2024-08-26T00:15:05.046 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_bytes": 0, 2024-08-26T00:15:05.046 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_items": 0, 2024-08-26T00:15:05.046 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_bytes": 147898, 2024-08-26T00:15:05.046 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_items": 27, 2024-08-26T00:15:05.046 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_bytes": 0, 2024-08-26T00:15:05.046 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_items": 0, 2024-08-26T00:15:05.046 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bytes": 0, 2024-08-26T00:15:05.046 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_items": 0, 2024-08-26T00:15:05.046 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_bytes": 0, 2024-08-26T00:15:05.046 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_items": 0, 2024-08-26T00:15:05.047 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_bytes": 0, 2024-08-26T00:15:05.047 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_items": 0, 2024-08-26T00:15:05.047 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_bytes": 0, 2024-08-26T00:15:05.047 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_items": 0, 2024-08-26T00:15:05.047 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_bytes": 0, 2024-08-26T00:15:05.047 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_items": 0, 2024-08-26T00:15:05.047 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_bytes": 0, 2024-08-26T00:15:05.047 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_items": 0, 2024-08-26T00:15:05.047 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_bytes": 928, 2024-08-26T00:15:05.047 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_items": 2, 2024-08-26T00:15:05.047 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_bytes": 0, 2024-08-26T00:15:05.047 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_items": 0, 2024-08-26T00:15:05.047 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_bytes": 0, 2024-08-26T00:15:05.048 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_items": 0 2024-08-26T00:15:05.048 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-08-26T00:15:05.048 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-26T00:15:05.048 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-08-26T00:15:05.048 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-08-26T00:15:05.048 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-08-26T00:15:05.048 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 251, 2024-08-26T00:15:05.048 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 451852, 2024-08-26T00:15:05.048 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:05.048 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 251, 2024-08-26T00:15:05.048 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-08-26T00:15:05.048 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-08-26T00:15:05.048 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 251, 2024-08-26T00:15:05.048 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 451852, 2024-08-26T00:15:05.049 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-08-26T00:15:05.049 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-08-26T00:15:05.049 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-08-26T00:15:05.049 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-08-26T00:15:05.049 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:15:05.049 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-08-26T00:15:05.049 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-08-26T00:15:05.819 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-08-26T00:15:05.819 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-08-26T00:15:05.819 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-08-26T00:15:05.819 DEBUG:tasks.check_counter:Getting stats from c 2024-08-26T00:15:05.820 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph daemon mds.c perf dump 2024-08-26T00:15:06.123 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.c/config 2024-08-26T00:15:06.702 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-08-26T00:15:06.702 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-08-26T00:15:06.702 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 77732, 2024-08-26T00:15:06.702 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 76184, 2024-08-26T00:15:06.702 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 25347618, 2024-08-26T00:15:06.702 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 215631456, 2024-08-26T00:15:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 25, 2024-08-26T00:15:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 4, 2024-08-26T00:15:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 5.795088373, 2024-08-26T00:15:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 2.557421211, 2024-08-26T00:15:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 2.038855467, 2024-08-26T00:15:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 1.265774542, 2024-08-26T00:15:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:15:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 76185, 2024-08-26T00:15:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 5.915674130, 2024-08-26T00:15:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000077648 2024-08-26T00:15:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:15:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 74679, 2024-08-26T00:15:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.011662484, 2024-08-26T00:15:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000156 2024-08-26T00:15:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-26T00:15:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 448 2024-08-26T00:15:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-08-26T00:15:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 74665, 2024-08-26T00:15:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 74850, 2024-08-26T00:15:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 22022682, 2024-08-26T00:15:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 164258314, 2024-08-26T00:15:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 18, 2024-08-26T00:15:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 7, 2024-08-26T00:15:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 6.139635568, 2024-08-26T00:15:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 2.531161510, 2024-08-26T00:15:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 1.059971468, 2024-08-26T00:15:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 2.184268559, 2024-08-26T00:15:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:15:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 74846, 2024-08-26T00:15:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 14.125748913, 2024-08-26T00:15:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000188730 2024-08-26T00:15:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:15:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 8, 2024-08-26T00:15:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000755, 2024-08-26T00:15:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000094 2024-08-26T00:15:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-26T00:15:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 488736 2024-08-26T00:15:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-08-26T00:15:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 421337, 2024-08-26T00:15:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 547065, 2024-08-26T00:15:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 191682600, 2024-08-26T00:15:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 306612662, 2024-08-26T00:15:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 11, 2024-08-26T00:15:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 6, 2024-08-26T00:15:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 21.345149211, 2024-08-26T00:15:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 9.608921842, 2024-08-26T00:15:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 39.021244117, 2024-08-26T00:15:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 1.295106098, 2024-08-26T00:15:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:15:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 547064, 2024-08-26T00:15:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 33.082477296, 2024-08-26T00:15:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000060472 2024-08-26T00:15:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:15:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 688643, 2024-08-26T00:15:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.104366946, 2024-08-26T00:15:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000151 2024-08-26T00:15:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 96955632, 2024-08-26T00:15:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 198769968 2024-08-26T00:15:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-08-26T00:15:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 1, 2024-08-26T00:15:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-08-26T00:15:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-MDSRank": { 2024-08-26T00:15:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-08-26T00:15:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-08-26T00:15:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 94168, 2024-08-26T00:15:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 125.251063677, 2024-08-26T00:15:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001330080 2024-08-26T00:15:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-PurgeQueue": { 2024-08-26T00:15:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-08-26T00:15:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-08-26T00:15:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 35463, 2024-08-26T00:15:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 7.513518907, 2024-08-26T00:15:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000211869 2024-08-26T00:15:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": { 2024-08-26T00:15:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: "request": 103269, 2024-08-26T00:15:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: "reply": 102188, 2024-08-26T00:15:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "reply_latency": { 2024-08-26T00:15:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 102188, 2024-08-26T00:15:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 1277.950090249, 2024-08-26T00:15:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.012505872 2024-08-26T00:15:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_reply": 0, 2024-08-26T00:15:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "forward": 1081, 2024-08-26T00:15:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_complete": 37, 2024-08-26T00:15:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_keys": 0, 2024-08-26T00:15:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_commit": 1546, 2024-08-26T00:15:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_split": 129, 2024-08-26T00:15:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_merge": 1, 2024-08-26T00:15:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes": 30, 2024-08-26T00:15:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_top": 10, 2024-08-26T00:15:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_bottom": 10, 2024-08-26T00:15:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pin_tail": 10, 2024-08-26T00:15:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pinned": 14, 2024-08-26T00:15:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_expired": 85637, 2024-08-26T00:15:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_with_caps": 1, 2024-08-26T00:15:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": 1, 2024-08-26T00:15:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "subtrees": 4, 2024-08-26T00:15:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse": 179141, 2024-08-26T00:15:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_hit": 156305, 2024-08-26T00:15:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_forward": 657, 2024-08-26T00:15:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_discover": 1555, 2024-08-26T00:15:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_dir_fetch": 0, 2024-08-26T00:15:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_remote_ino": 0, 2024-08-26T00:15:06.712 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_lock": 690, 2024-08-26T00:15:06.712 INFO:teuthology.orchestra.run.smithi181.stdout: "load_cent": 0, 2024-08-26T00:15:06.712 INFO:teuthology.orchestra.run.smithi181.stdout: "q": 0, 2024-08-26T00:15:06.712 INFO:teuthology.orchestra.run.smithi181.stdout: "exported": 182, 2024-08-26T00:15:06.712 INFO:teuthology.orchestra.run.smithi181.stdout: "exported_inodes": 60822, 2024-08-26T00:15:06.712 INFO:teuthology.orchestra.run.smithi181.stdout: "imported": 215, 2024-08-26T00:15:06.712 INFO:teuthology.orchestra.run.smithi181.stdout: "imported_inodes": 41678, 2024-08-26T00:15:06.712 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_dir_fetch": 0, 2024-08-26T00:15:06.712 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_backtrace_fetch": 119833, 2024-08-26T00:15:06.712 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_peer_discover": 0, 2024-08-26T00:15:06.712 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rfiles": 44955, 2024-08-26T00:15:06.712 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rbytes": 942800409, 2024-08-26T00:15:06.712 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rsnaps": 0, 2024-08-26T00:15:06.713 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_fetch": 119833, 2024-08-26T00:15:06.713 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_set_tag": 0, 2024-08-26T00:15:06.713 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_repaired": 0, 2024-08-26T00:15:06.713 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_inotable_repaired": 0, 2024-08-26T00:15:06.713 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_inodes": 777, 2024-08-26T00:15:06.713 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_base_inodes": 0, 2024-08-26T00:15:06.713 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dirfrag_rstats": 777, 2024-08-26T00:15:06.713 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_file_inodes": 119056, 2024-08-26T00:15:06.713 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_inode_file_caps": 485, 2024-08-26T00:15:06.713 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_revoke": 32627, 2024-08-26T00:15:06.713 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_grant": 55452, 2024-08-26T00:15:06.713 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_trunc": 1, 2024-08-26T00:15:06.713 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-26T00:15:06.713 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-26T00:15:06.714 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps": 85681, 2024-08-26T00:15:06.714 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps_dirty": 34637, 2024-08-26T00:15:06.714 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_cap_release": 1550, 2024-08-26T00:15:06.714 INFO:teuthology.orchestra.run.smithi181.stdout: "process_request_cap_release": 59173 2024-08-26T00:15:06.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.714 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_cache": { 2024-08-26T00:15:06.714 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update": 0, 2024-08-26T00:15:06.714 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update_receipt": 3, 2024-08-26T00:15:06.714 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_try_discover": 2, 2024-08-26T00:15:06.714 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_send_discover": 1661, 2024-08-26T00:15:06.714 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_handle_discover": 1998, 2024-08-26T00:15:06.714 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays": 0, 2024-08-26T00:15:06.714 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_delayed": 0, 2024-08-26T00:15:06.714 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_enqueuing": 0, 2024-08-26T00:15:06.715 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_created": 19760, 2024-08-26T00:15:06.715 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_enqueued": 19760, 2024-08-26T00:15:06.715 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_reintegrated": 0, 2024-08-26T00:15:06.715 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_migrated": 0, 2024-08-26T00:15:06.715 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_processing": 0, 2024-08-26T00:15:06.715 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_enqueued": 0, 2024-08-26T00:15:06.715 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_prioritized": 0, 2024-08-26T00:15:06.715 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_started": 0, 2024-08-26T00:15:06.715 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_completed": 0, 2024-08-26T00:15:06.715 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_path": 0, 2024-08-26T00:15:06.715 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_inode": 0, 2024-08-26T00:15:06.715 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_enqueue_scrub": 0, 2024-08-26T00:15:06.715 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_exportdir": 183, 2024-08-26T00:15:06.716 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_flush": 0, 2024-08-26T00:15:06.716 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragmentdir": 130, 2024-08-26T00:15:06.716 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragstats": 0, 2024-08-26T00:15:06.716 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_inodestats": 0 2024-08-26T00:15:06.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.716 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_log": { 2024-08-26T00:15:06.716 INFO:teuthology.orchestra.run.smithi181.stdout: "evlrg": 4, 2024-08-26T00:15:06.716 INFO:teuthology.orchestra.run.smithi181.stdout: "evadd": 163273, 2024-08-26T00:15:06.716 INFO:teuthology.orchestra.run.smithi181.stdout: "evex": 57244, 2024-08-26T00:15:06.716 INFO:teuthology.orchestra.run.smithi181.stdout: "evtrm": 49161, 2024-08-26T00:15:06.716 INFO:teuthology.orchestra.run.smithi181.stdout: "ev": 114112, 2024-08-26T00:15:06.716 INFO:teuthology.orchestra.run.smithi181.stdout: "evexg": 0, 2024-08-26T00:15:06.716 INFO:teuthology.orchestra.run.smithi181.stdout: "evexd": 8083, 2024-08-26T00:15:06.716 INFO:teuthology.orchestra.run.smithi181.stdout: "segadd": 195, 2024-08-26T00:15:06.717 INFO:teuthology.orchestra.run.smithi181.stdout: "segex": 67, 2024-08-26T00:15:06.717 INFO:teuthology.orchestra.run.smithi181.stdout: "segtrm": 58, 2024-08-26T00:15:06.717 INFO:teuthology.orchestra.run.smithi181.stdout: "seg": 137, 2024-08-26T00:15:06.717 INFO:teuthology.orchestra.run.smithi181.stdout: "segmjr": 10, 2024-08-26T00:15:06.717 INFO:teuthology.orchestra.run.smithi181.stdout: "segexg": 0, 2024-08-26T00:15:06.717 INFO:teuthology.orchestra.run.smithi181.stdout: "segexd": 9, 2024-08-26T00:15:06.717 INFO:teuthology.orchestra.run.smithi181.stdout: "expos": 115305183, 2024-08-26T00:15:06.717 INFO:teuthology.orchestra.run.smithi181.stdout: "wrpos": 366603941, 2024-08-26T00:15:06.717 INFO:teuthology.orchestra.run.smithi181.stdout: "rdpos": 0, 2024-08-26T00:15:06.717 INFO:teuthology.orchestra.run.smithi181.stdout: "jlat": { 2024-08-26T00:15:06.717 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 4092, 2024-08-26T00:15:06.717 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 147.401313790, 2024-08-26T00:15:06.717 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.036021826 2024-08-26T00:15:06.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.718 INFO:teuthology.orchestra.run.smithi181.stdout: "replayed": 0 2024-08-26T00:15:06.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.718 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_mem": { 2024-08-26T00:15:06.718 INFO:teuthology.orchestra.run.smithi181.stdout: "ino": 35, 2024-08-26T00:15:06.718 INFO:teuthology.orchestra.run.smithi181.stdout: "ino+": 57368, 2024-08-26T00:15:06.718 INFO:teuthology.orchestra.run.smithi181.stdout: "ino-": 57333, 2024-08-26T00:15:06.718 INFO:teuthology.orchestra.run.smithi181.stdout: "dir": 34, 2024-08-26T00:15:06.718 INFO:teuthology.orchestra.run.smithi181.stdout: "dir+": 2361, 2024-08-26T00:15:06.718 INFO:teuthology.orchestra.run.smithi181.stdout: "dir-": 2327, 2024-08-26T00:15:06.718 INFO:teuthology.orchestra.run.smithi181.stdout: "dn": 30, 2024-08-26T00:15:06.718 INFO:teuthology.orchestra.run.smithi181.stdout: "dn+": 120201, 2024-08-26T00:15:06.718 INFO:teuthology.orchestra.run.smithi181.stdout: "dn-": 120171, 2024-08-26T00:15:06.718 INFO:teuthology.orchestra.run.smithi181.stdout: "cap": 1, 2024-08-26T00:15:06.719 INFO:teuthology.orchestra.run.smithi181.stdout: "cap+": 56095, 2024-08-26T00:15:06.719 INFO:teuthology.orchestra.run.smithi181.stdout: "cap-": 56094, 2024-08-26T00:15:06.719 INFO:teuthology.orchestra.run.smithi181.stdout: "rss": 157856, 2024-08-26T00:15:06.719 INFO:teuthology.orchestra.run.smithi181.stdout: "heap": 223520 2024-08-26T00:15:06.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.719 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_server": { 2024-08-26T00:15:06.719 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_client_request": 123688, 2024-08-26T00:15:06.719 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_server_request": 10286, 2024-08-26T00:15:06.719 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_request": 103269, 2024-08-26T00:15:06.719 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_session": 621, 2024-08-26T00:15:06.719 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_peer_request": 22913, 2024-08-26T00:15:06.719 INFO:teuthology.orchestra.run.smithi181.stdout: "req_create_latency": { 2024-08-26T00:15:06.719 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 30641, 2024-08-26T00:15:06.720 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 133.648856675, 2024-08-26T00:15:06.720 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.004361765 2024-08-26T00:15:06.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.720 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getattr_latency": { 2024-08-26T00:15:06.720 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 93, 2024-08-26T00:15:06.720 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 2.735372627, 2024-08-26T00:15:06.720 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.029412608 2024-08-26T00:15:06.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.720 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getfilelock_latency": { 2024-08-26T00:15:06.720 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.720 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.720 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.720 INFO:teuthology.orchestra.run.smithi181.stdout: "req_link_latency": { 2024-08-26T00:15:06.721 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.721 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.721 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.721 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookup_latency": { 2024-08-26T00:15:06.721 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 21425, 2024-08-26T00:15:06.721 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 624.108567143, 2024-08-26T00:15:06.721 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.029129921 2024-08-26T00:15:06.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.721 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookuphash_latency": { 2024-08-26T00:15:06.721 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.721 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.721 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.722 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupino_latency": { 2024-08-26T00:15:06.722 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.722 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.722 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.722 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupname_latency": { 2024-08-26T00:15:06.722 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.722 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.722 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.722 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupparent_latency": { 2024-08-26T00:15:06.722 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.722 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.722 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.723 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupsnap_latency": { 2024-08-26T00:15:06.723 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.723 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.724 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.724 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lssnap_latency": { 2024-08-26T00:15:06.724 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.724 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.724 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.724 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mkdir_latency": { 2024-08-26T00:15:06.724 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 131, 2024-08-26T00:15:06.724 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 2.477251587, 2024-08-26T00:15:06.724 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.018910317 2024-08-26T00:15:06.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.724 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mknod_latency": { 2024-08-26T00:15:06.724 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.725 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.725 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.725 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mksnap_latency": { 2024-08-26T00:15:06.725 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.725 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.725 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.725 INFO:teuthology.orchestra.run.smithi181.stdout: "req_open_latency": { 2024-08-26T00:15:06.725 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 7610, 2024-08-26T00:15:06.725 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 34.859439600, 2024-08-26T00:15:06.725 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.004580741 2024-08-26T00:15:06.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.726 INFO:teuthology.orchestra.run.smithi181.stdout: "req_readdir_latency": { 2024-08-26T00:15:06.726 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 473, 2024-08-26T00:15:06.726 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 1.188192125, 2024-08-26T00:15:06.726 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.002512034 2024-08-26T00:15:06.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.726 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rename_latency": { 2024-08-26T00:15:06.726 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 30561, 2024-08-26T00:15:06.726 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 450.229914102, 2024-08-26T00:15:06.726 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.014732172 2024-08-26T00:15:06.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.726 INFO:teuthology.orchestra.run.smithi181.stdout: "req_renamesnap_latency": { 2024-08-26T00:15:06.726 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.727 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.727 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.727 INFO:teuthology.orchestra.run.smithi181.stdout: "req_snapdiff_latency": { 2024-08-26T00:15:06.727 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.727 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.727 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.727 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmdir_latency": { 2024-08-26T00:15:06.727 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 63, 2024-08-26T00:15:06.727 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 8.629864551, 2024-08-26T00:15:06.728 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.136981977 2024-08-26T00:15:06.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.728 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmsnap_latency": { 2024-08-26T00:15:06.728 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.728 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.728 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.728 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmxattr_latency": { 2024-08-26T00:15:06.728 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.728 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.728 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.728 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setattr_latency": { 2024-08-26T00:15:06.728 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1, 2024-08-26T00:15:06.729 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.013925019, 2024-08-26T00:15:06.729 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.013925019 2024-08-26T00:15:06.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.729 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setdirlayout_latency": { 2024-08-26T00:15:06.729 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.729 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.729 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.729 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setfilelock_latency": { 2024-08-26T00:15:06.729 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.729 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.729 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.730 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setlayout_latency": { 2024-08-26T00:15:06.730 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.730 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.730 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.730 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setxattr_latency": { 2024-08-26T00:15:06.730 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.730 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.730 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.730 INFO:teuthology.orchestra.run.smithi181.stdout: "req_symlink_latency": { 2024-08-26T00:15:06.730 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.730 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.731 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.731 INFO:teuthology.orchestra.run.smithi181.stdout: "req_unlink_latency": { 2024-08-26T00:15:06.731 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 11190, 2024-08-26T00:15:06.731 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 20.058706820, 2024-08-26T00:15:06.731 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001792556 2024-08-26T00:15:06.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.731 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_revoke_eviction": 0, 2024-08-26T00:15:06.731 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_acquisition_throttle": 0, 2024-08-26T00:15:06.731 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getvxattr_latency": { 2024-08-26T00:15:06.731 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.731 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.731 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.732 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:06.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.732 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_sessions": { 2024-08-26T00:15:06.732 INFO:teuthology.orchestra.run.smithi181.stdout: "session_count": 1, 2024-08-26T00:15:06.732 INFO:teuthology.orchestra.run.smithi181.stdout: "session_add": 2, 2024-08-26T00:15:06.732 INFO:teuthology.orchestra.run.smithi181.stdout: "session_remove": 1, 2024-08-26T00:15:06.732 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_open": 1, 2024-08-26T00:15:06.732 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_stale": 0, 2024-08-26T00:15:06.732 INFO:teuthology.orchestra.run.smithi181.stdout: "total_load": 4448, 2024-08-26T00:15:06.732 INFO:teuthology.orchestra.run.smithi181.stdout: "average_load": 4448, 2024-08-26T00:15:06.732 INFO:teuthology.orchestra.run.smithi181.stdout: "avg_session_uptime": 756, 2024-08-26T00:15:06.732 INFO:teuthology.orchestra.run.smithi181.stdout: "mdthresh_evicted": 0 2024-08-26T00:15:06.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.732 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-08-26T00:15:06.733 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-08-26T00:15:06.733 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-08-26T00:15:06.733 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-08-26T00:15:06.733 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-08-26T00:15:06.733 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-08-26T00:15:06.733 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-08-26T00:15:06.733 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-26T00:15:06.733 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-08-26T00:15:06.733 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-26T00:15:06.733 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-08-26T00:15:06.733 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-08-26T00:15:06.733 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-08-26T00:15:06.733 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-26T00:15:06.734 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-08-26T00:15:06.734 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-08-26T00:15:06.734 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-08-26T00:15:06.734 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-08-26T00:15:06.734 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-08-26T00:15:06.734 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-26T00:15:06.734 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-08-26T00:15:06.734 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-26T00:15:06.734 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-08-26T00:15:06.734 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-08-26T00:15:06.734 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-08-26T00:15:06.734 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-08-26T00:15:06.734 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-08-26T00:15:06.734 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-26T00:15:06.735 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-08-26T00:15:06.735 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-08-26T00:15:06.735 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-08-26T00:15:06.735 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-08-26T00:15:06.735 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-08-26T00:15:06.735 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-08-26T00:15:06.735 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-08-26T00:15:06.735 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-08-26T00:15:06.735 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-08-26T00:15:06.735 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 299915, 2024-08-26T00:15:06.735 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 117, 2024-08-26T00:15:06.735 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-08-26T00:15:06.735 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-08-26T00:15:06.735 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-08-26T00:15:06.736 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-08-26T00:15:06.736 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-08-26T00:15:06.736 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-08-26T00:15:06.736 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-08-26T00:15:06.736 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-08-26T00:15:06.736 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 7592, 2024-08-26T00:15:06.736 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 156, 2024-08-26T00:15:06.736 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-08-26T00:15:06.736 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-08-26T00:15:06.736 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-08-26T00:15:06.736 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-08-26T00:15:06.736 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 145813, 2024-08-26T00:15:06.736 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 660, 2024-08-26T00:15:06.736 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-08-26T00:15:06.737 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-08-26T00:15:06.737 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-08-26T00:15:06.737 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-08-26T00:15:06.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.737 INFO:teuthology.orchestra.run.smithi181.stdout: "objecter": { 2024-08-26T00:15:06.737 INFO:teuthology.orchestra.run.smithi181.stdout: "op_active": 0, 2024-08-26T00:15:06.737 INFO:teuthology.orchestra.run.smithi181.stdout: "op_laggy": 0, 2024-08-26T00:15:06.737 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send": 157269, 2024-08-26T00:15:06.737 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send_bytes": 399797395, 2024-08-26T00:15:06.737 INFO:teuthology.orchestra.run.smithi181.stdout: "op_resend": 28, 2024-08-26T00:15:06.737 INFO:teuthology.orchestra.run.smithi181.stdout: "op_reply": 157269, 2024-08-26T00:15:06.737 INFO:teuthology.orchestra.run.smithi181.stdout: "op_latency": { 2024-08-26T00:15:06.737 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 157269, 2024-08-26T00:15:06.737 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 2112.428033345, 2024-08-26T00:15:06.738 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.013431941 2024-08-26T00:15:06.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.738 INFO:teuthology.orchestra.run.smithi181.stdout: "op_inflight": 0, 2024-08-26T00:15:06.738 INFO:teuthology.orchestra.run.smithi181.stdout: "oplen_avg": { 2024-08-26T00:15:06.738 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 157269, 2024-08-26T00:15:06.738 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 177873 2024-08-26T00:15:06.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.738 INFO:teuthology.orchestra.run.smithi181.stdout: "op": 157269, 2024-08-26T00:15:06.738 INFO:teuthology.orchestra.run.smithi181.stdout: "op_r": 120773, 2024-08-26T00:15:06.738 INFO:teuthology.orchestra.run.smithi181.stdout: "op_w": 36496, 2024-08-26T00:15:06.738 INFO:teuthology.orchestra.run.smithi181.stdout: "op_rmw": 0, 2024-08-26T00:15:06.738 INFO:teuthology.orchestra.run.smithi181.stdout: "op_pg": 0, 2024-08-26T00:15:06.738 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_stat": 370, 2024-08-26T00:15:06.738 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_create": 8725, 2024-08-26T00:15:06.739 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_read": 843, 2024-08-26T00:15:06.739 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_write": 4937, 2024-08-26T00:15:06.739 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writefull": 454, 2024-08-26T00:15:06.739 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writesame": 0, 2024-08-26T00:15:06.739 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_append": 0, 2024-08-26T00:15:06.739 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_zero": 0, 2024-08-26T00:15:06.739 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_truncate": 129, 2024-08-26T00:15:06.739 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_delete": 20292, 2024-08-26T00:15:06.739 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_mapext": 0, 2024-08-26T00:15:06.739 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_sparse_read": 0, 2024-08-26T00:15:06.739 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_clonerange": 0, 2024-08-26T00:15:06.739 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_getxattr": 119833, 2024-08-26T00:15:06.739 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_setxattr": 17450, 2024-08-26T00:15:06.739 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_cmpxattr": 0, 2024-08-26T00:15:06.740 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_rmxattr": 0, 2024-08-26T00:15:06.740 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_resetxattrs": 0, 2024-08-26T00:15:06.740 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_call": 0, 2024-08-26T00:15:06.740 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_watch": 0, 2024-08-26T00:15:06.740 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_notify": 0, 2024-08-26T00:15:06.740 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_src_cmpxattr": 0, 2024-08-26T00:15:06.740 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls": 0, 2024-08-26T00:15:06.740 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls_filter": 0, 2024-08-26T00:15:06.740 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_other": 1, 2024-08-26T00:15:06.740 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_active": 0, 2024-08-26T00:15:06.740 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_send": 0, 2024-08-26T00:15:06.740 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_resend": 0, 2024-08-26T00:15:06.740 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_ping": 0, 2024-08-26T00:15:06.740 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_active": 0, 2024-08-26T00:15:06.741 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_send": 0, 2024-08-26T00:15:06.741 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_resend": 0, 2024-08-26T00:15:06.741 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_active": 0, 2024-08-26T00:15:06.741 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_send": 0, 2024-08-26T00:15:06.741 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_resend": 0, 2024-08-26T00:15:06.741 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_active": 0, 2024-08-26T00:15:06.741 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_send": 0, 2024-08-26T00:15:06.741 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_resend": 0, 2024-08-26T00:15:06.741 INFO:teuthology.orchestra.run.smithi181.stdout: "command_active": 0, 2024-08-26T00:15:06.741 INFO:teuthology.orchestra.run.smithi181.stdout: "command_send": 0, 2024-08-26T00:15:06.741 INFO:teuthology.orchestra.run.smithi181.stdout: "command_resend": 0, 2024-08-26T00:15:06.741 INFO:teuthology.orchestra.run.smithi181.stdout: "map_epoch": 80, 2024-08-26T00:15:06.741 INFO:teuthology.orchestra.run.smithi181.stdout: "map_full": 0, 2024-08-26T00:15:06.741 INFO:teuthology.orchestra.run.smithi181.stdout: "map_inc": 2, 2024-08-26T00:15:06.742 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_sessions": 12, 2024-08-26T00:15:06.742 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_open": 12, 2024-08-26T00:15:06.742 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_close": 0, 2024-08-26T00:15:06.742 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_laggy": 0, 2024-08-26T00:15:06.742 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_wr": 3853, 2024-08-26T00:15:06.742 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_rd": 134, 2024-08-26T00:15:06.742 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_del": 852 2024-08-26T00:15:06.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.742 INFO:teuthology.orchestra.run.smithi181.stdout: "oft": { 2024-08-26T00:15:06.742 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_objs": 1, 2024-08-26T00:15:06.742 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_kv_pairs": 0, 2024-08-26T00:15:06.742 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_updates": 0, 2024-08-26T00:15:06.742 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_removes": 0 2024-08-26T00:15:06.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.743 INFO:teuthology.orchestra.run.smithi181.stdout: "osd-slow-ops": { 2024-08-26T00:15:06.743 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_ops_count": 1 2024-08-26T00:15:06.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.743 INFO:teuthology.orchestra.run.smithi181.stdout: "purge_queue": { 2024-08-26T00:15:06.743 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops": 0, 2024-08-26T00:15:06.743 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops_high_water": 18, 2024-08-26T00:15:06.743 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing": 0, 2024-08-26T00:15:06.743 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_high_water": 10, 2024-08-26T00:15:06.743 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed_ops": 20160, 2024-08-26T00:15:06.743 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed": 19760, 2024-08-26T00:15:06.743 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_item_in_journal": 0 2024-08-26T00:15:06.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.743 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-26T00:15:06.743 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-08-26T00:15:06.744 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-08-26T00:15:06.744 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-08-26T00:15:06.744 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 573730, 2024-08-26T00:15:06.744 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 176287552, 2024-08-26T00:15:06.744 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:06.744 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 573730, 2024-08-26T00:15:06.744 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-08-26T00:15:06.744 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-08-26T00:15:06.744 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 573730, 2024-08-26T00:15:06.744 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 176287552, 2024-08-26T00:15:06.744 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-08-26T00:15:06.744 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.744 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.745 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.745 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:06.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.745 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_bytes": { 2024-08-26T00:15:06.745 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-08-26T00:15:06.745 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-08-26T00:15:06.745 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-08-26T00:15:06.745 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-08-26T00:15:06.745 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-08-26T00:15:06.745 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:06.745 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-08-26T00:15:06.745 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 157269, 2024-08-26T00:15:06.745 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 401790868, 2024-08-26T00:15:06.745 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 157269, 2024-08-26T00:15:06.746 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 401790868, 2024-08-26T00:15:06.746 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-08-26T00:15:06.746 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.746 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.746 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.746 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:06.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.746 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_ops": { 2024-08-26T00:15:06.746 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-08-26T00:15:06.746 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 1024, 2024-08-26T00:15:06.746 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-08-26T00:15:06.746 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-08-26T00:15:06.746 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-08-26T00:15:06.746 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:06.747 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-08-26T00:15:06.747 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 157269, 2024-08-26T00:15:06.747 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 157269, 2024-08-26T00:15:06.747 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 157269, 2024-08-26T00:15:06.747 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 157269, 2024-08-26T00:15:06.747 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-08-26T00:15:06.747 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.747 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.747 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.747 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:06.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.747 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle": { 2024-08-26T00:15:06.747 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-08-26T00:15:06.748 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-08-26T00:15:06.748 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-08-26T00:15:06.748 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 19760, 2024-08-26T00:15:06.748 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 1996160, 2024-08-26T00:15:06.748 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:06.748 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 19760, 2024-08-26T00:15:06.748 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-08-26T00:15:06.748 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-08-26T00:15:06.748 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 844, 2024-08-26T00:15:06.748 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 1996160, 2024-08-26T00:15:06.748 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-08-26T00:15:06.748 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.748 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.749 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.749 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:06.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:06.749 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle-0x558ec16e4960": { 2024-08-26T00:15:06.749 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-08-26T00:15:06.749 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-08-26T00:15:06.749 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-08-26T00:15:06.749 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 163273, 2024-08-26T00:15:06.749 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 362409637, 2024-08-26T00:15:06.749 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:06.749 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 163273, 2024-08-26T00:15:06.749 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-08-26T00:15:06.749 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-08-26T00:15:06.750 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 4092, 2024-08-26T00:15:06.750 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 362409637, 2024-08-26T00:15:06.750 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-08-26T00:15:06.750 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:06.750 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:06.750 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:06.750 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:06.750 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:06.750 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-08-26T00:15:07.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:06 smithi043 ceph-mon[22091]: pgmap v716: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-08-26T00:15:07.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:06 smithi042 ceph-mon[17225]: pgmap v716: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-08-26T00:15:07.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:06 smithi181 ceph-mon[22102]: pgmap v716: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-08-26T00:15:07.767 INFO:tasks.check_counter:Daemon mds.c mds.exported=182 2024-08-26T00:15:07.768 INFO:tasks.check_counter:Daemon mds.c mds.imported=215 2024-08-26T00:15:07.768 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=129 2024-08-26T00:15:07.768 DEBUG:tasks.check_counter:Getting stats from f 2024-08-26T00:15:07.768 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph daemon mds.f perf dump 2024-08-26T00:15:08.016 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.c/config 2024-08-26T00:15:08.561 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-08-26T00:15:08.561 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-08-26T00:15:08.562 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 2071, 2024-08-26T00:15:08.562 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 2055, 2024-08-26T00:15:08.562 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 156277105, 2024-08-26T00:15:08.562 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 724352, 2024-08-26T00:15:08.562 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 7, 2024-08-26T00:15:08.562 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 3, 2024-08-26T00:15:08.562 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.256116160, 2024-08-26T00:15:08.562 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.057025728, 2024-08-26T00:15:08.562 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.145808593, 2024-08-26T00:15:08.562 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.044877168, 2024-08-26T00:15:08.562 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:15:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 2055, 2024-08-26T00:15:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.072130759, 2024-08-26T00:15:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000035100 2024-08-26T00:15:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:15:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 547088, 2024-08-26T00:15:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 151312 2024-08-26T00:15:08.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.564 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-08-26T00:15:08.564 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 654, 2024-08-26T00:15:08.564 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 838, 2024-08-26T00:15:08.564 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 115353368, 2024-08-26T00:15:08.564 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 696842, 2024-08-26T00:15:08.564 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 8, 2024-08-26T00:15:08.564 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 6, 2024-08-26T00:15:08.564 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.112623431, 2024-08-26T00:15:08.564 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.020719773, 2024-08-26T00:15:08.564 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.072612023, 2024-08-26T00:15:08.564 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.014050732, 2024-08-26T00:15:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:15:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 836, 2024-08-26T00:15:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.035563416, 2024-08-26T00:15:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000042539 2024-08-26T00:15:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:15:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-26T00:15:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 489440 2024-08-26T00:15:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.565 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-08-26T00:15:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 1036, 2024-08-26T00:15:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 1038, 2024-08-26T00:15:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 172245195, 2024-08-26T00:15:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 329455, 2024-08-26T00:15:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 6, 2024-08-26T00:15:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 5, 2024-08-26T00:15:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.160767122, 2024-08-26T00:15:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.025244873, 2024-08-26T00:15:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.103348180, 2024-08-26T00:15:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.025114077, 2024-08-26T00:15:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:15:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1036, 2024-08-26T00:15:08.566 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.031262943, 2024-08-26T00:15:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000030176 2024-08-26T00:15:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:15:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-26T00:15:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 0 2024-08-26T00:15:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-08-26T00:15:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 1, 2024-08-26T00:15:08.567 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-08-26T00:15:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-MDSRank": { 2024-08-26T00:15:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-08-26T00:15:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-08-26T00:15:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 5526, 2024-08-26T00:15:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.193933051, 2024-08-26T00:15:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000035094 2024-08-26T00:15:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-PurgeQueue": { 2024-08-26T00:15:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-08-26T00:15:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-08-26T00:15:08.568 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.569 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.569 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.569 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:08.569 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.569 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": { 2024-08-26T00:15:08.569 INFO:teuthology.orchestra.run.smithi181.stdout: "request": 0, 2024-08-26T00:15:08.569 INFO:teuthology.orchestra.run.smithi181.stdout: "reply": 0, 2024-08-26T00:15:08.569 INFO:teuthology.orchestra.run.smithi181.stdout: "reply_latency": { 2024-08-26T00:15:08.569 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.569 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.569 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.569 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.569 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_reply": 0, 2024-08-26T00:15:08.570 INFO:teuthology.orchestra.run.smithi181.stdout: "forward": 0, 2024-08-26T00:15:08.570 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_complete": 0, 2024-08-26T00:15:08.570 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_keys": 0, 2024-08-26T00:15:08.570 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_commit": 0, 2024-08-26T00:15:08.570 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_split": 0, 2024-08-26T00:15:08.570 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_merge": 0, 2024-08-26T00:15:08.570 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes": 39099, 2024-08-26T00:15:08.570 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_top": 5244, 2024-08-26T00:15:08.570 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_bottom": 33855, 2024-08-26T00:15:08.570 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pin_tail": 0, 2024-08-26T00:15:08.570 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pinned": 31607, 2024-08-26T00:15:08.570 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_expired": 0, 2024-08-26T00:15:08.571 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_with_caps": 0, 2024-08-26T00:15:08.571 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": 0, 2024-08-26T00:15:08.571 INFO:teuthology.orchestra.run.smithi181.stdout: "subtrees": 2, 2024-08-26T00:15:08.571 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse": 0, 2024-08-26T00:15:08.571 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_hit": 0, 2024-08-26T00:15:08.571 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_forward": 0, 2024-08-26T00:15:08.571 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_discover": 0, 2024-08-26T00:15:08.571 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_dir_fetch": 0, 2024-08-26T00:15:08.571 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_remote_ino": 0, 2024-08-26T00:15:08.571 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_lock": 0, 2024-08-26T00:15:08.571 INFO:teuthology.orchestra.run.smithi181.stdout: "load_cent": 0, 2024-08-26T00:15:08.571 INFO:teuthology.orchestra.run.smithi181.stdout: "q": 0, 2024-08-26T00:15:08.571 INFO:teuthology.orchestra.run.smithi181.stdout: "exported": 0, 2024-08-26T00:15:08.572 INFO:teuthology.orchestra.run.smithi181.stdout: "exported_inodes": 0, 2024-08-26T00:15:08.572 INFO:teuthology.orchestra.run.smithi181.stdout: "imported": 0, 2024-08-26T00:15:08.572 INFO:teuthology.orchestra.run.smithi181.stdout: "imported_inodes": 0, 2024-08-26T00:15:08.572 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_dir_fetch": 0, 2024-08-26T00:15:08.572 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_backtrace_fetch": 0, 2024-08-26T00:15:08.572 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_peer_discover": 0, 2024-08-26T00:15:08.572 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rfiles": 4, 2024-08-26T00:15:08.572 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rbytes": 234, 2024-08-26T00:15:08.572 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rsnaps": 0, 2024-08-26T00:15:08.572 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_fetch": 0, 2024-08-26T00:15:08.572 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_set_tag": 0, 2024-08-26T00:15:08.572 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_repaired": 0, 2024-08-26T00:15:08.573 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_inotable_repaired": 0, 2024-08-26T00:15:08.573 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_inodes": 0, 2024-08-26T00:15:08.573 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_base_inodes": 0, 2024-08-26T00:15:08.573 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dirfrag_rstats": 0, 2024-08-26T00:15:08.573 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_file_inodes": 0, 2024-08-26T00:15:08.573 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_inode_file_caps": 0, 2024-08-26T00:15:08.573 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_revoke": 0, 2024-08-26T00:15:08.573 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_grant": 0, 2024-08-26T00:15:08.573 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_trunc": 0, 2024-08-26T00:15:08.573 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-26T00:15:08.573 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-26T00:15:08.573 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps": 0, 2024-08-26T00:15:08.573 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps_dirty": 0, 2024-08-26T00:15:08.574 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_cap_release": 0, 2024-08-26T00:15:08.574 INFO:teuthology.orchestra.run.smithi181.stdout: "process_request_cap_release": 0 2024-08-26T00:15:08.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.574 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_cache": { 2024-08-26T00:15:08.574 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update": 0, 2024-08-26T00:15:08.574 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update_receipt": 0, 2024-08-26T00:15:08.574 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_try_discover": 0, 2024-08-26T00:15:08.574 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_send_discover": 0, 2024-08-26T00:15:08.574 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_handle_discover": 0, 2024-08-26T00:15:08.574 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays": 0, 2024-08-26T00:15:08.574 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_delayed": 0, 2024-08-26T00:15:08.574 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_enqueuing": 0, 2024-08-26T00:15:08.574 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_created": 0, 2024-08-26T00:15:08.575 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_enqueued": 0, 2024-08-26T00:15:08.575 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_reintegrated": 0, 2024-08-26T00:15:08.575 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_migrated": 0, 2024-08-26T00:15:08.575 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_processing": 0, 2024-08-26T00:15:08.575 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_enqueued": 0, 2024-08-26T00:15:08.575 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_prioritized": 0, 2024-08-26T00:15:08.575 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_started": 0, 2024-08-26T00:15:08.575 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_completed": 0, 2024-08-26T00:15:08.575 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_path": 0, 2024-08-26T00:15:08.575 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_inode": 0, 2024-08-26T00:15:08.575 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_enqueue_scrub": 0, 2024-08-26T00:15:08.575 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_exportdir": 0, 2024-08-26T00:15:08.575 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_flush": 0, 2024-08-26T00:15:08.575 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragmentdir": 0, 2024-08-26T00:15:08.576 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragstats": 0, 2024-08-26T00:15:08.576 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_inodestats": 0 2024-08-26T00:15:08.576 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.576 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_log": { 2024-08-26T00:15:08.576 INFO:teuthology.orchestra.run.smithi181.stdout: "evlrg": 0, 2024-08-26T00:15:08.576 INFO:teuthology.orchestra.run.smithi181.stdout: "evadd": 0, 2024-08-26T00:15:08.576 INFO:teuthology.orchestra.run.smithi181.stdout: "evex": 0, 2024-08-26T00:15:08.576 INFO:teuthology.orchestra.run.smithi181.stdout: "evtrm": 0, 2024-08-26T00:15:08.576 INFO:teuthology.orchestra.run.smithi181.stdout: "ev": 206291, 2024-08-26T00:15:08.576 INFO:teuthology.orchestra.run.smithi181.stdout: "evexg": 0, 2024-08-26T00:15:08.576 INFO:teuthology.orchestra.run.smithi181.stdout: "evexd": 0, 2024-08-26T00:15:08.576 INFO:teuthology.orchestra.run.smithi181.stdout: "segadd": 0, 2024-08-26T00:15:08.576 INFO:teuthology.orchestra.run.smithi181.stdout: "segex": 0, 2024-08-26T00:15:08.576 INFO:teuthology.orchestra.run.smithi181.stdout: "segtrm": 0, 2024-08-26T00:15:08.577 INFO:teuthology.orchestra.run.smithi181.stdout: "seg": 136, 2024-08-26T00:15:08.577 INFO:teuthology.orchestra.run.smithi181.stdout: "segmjr": 18, 2024-08-26T00:15:08.577 INFO:teuthology.orchestra.run.smithi181.stdout: "segexg": 0, 2024-08-26T00:15:08.577 INFO:teuthology.orchestra.run.smithi181.stdout: "segexd": 0, 2024-08-26T00:15:08.577 INFO:teuthology.orchestra.run.smithi181.stdout: "expos": 238097013, 2024-08-26T00:15:08.577 INFO:teuthology.orchestra.run.smithi181.stdout: "wrpos": 446531693, 2024-08-26T00:15:08.577 INFO:teuthology.orchestra.run.smithi181.stdout: "rdpos": 446530042, 2024-08-26T00:15:08.577 INFO:teuthology.orchestra.run.smithi181.stdout: "jlat": { 2024-08-26T00:15:08.577 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.577 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.577 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.577 INFO:teuthology.orchestra.run.smithi181.stdout: "replayed": 206291 2024-08-26T00:15:08.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.578 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_mem": { 2024-08-26T00:15:08.578 INFO:teuthology.orchestra.run.smithi181.stdout: "ino": 26, 2024-08-26T00:15:08.578 INFO:teuthology.orchestra.run.smithi181.stdout: "ino+": 58356, 2024-08-26T00:15:08.578 INFO:teuthology.orchestra.run.smithi181.stdout: "ino-": 58330, 2024-08-26T00:15:08.578 INFO:teuthology.orchestra.run.smithi181.stdout: "dir": 35, 2024-08-26T00:15:08.578 INFO:teuthology.orchestra.run.smithi181.stdout: "dir+": 2440, 2024-08-26T00:15:08.578 INFO:teuthology.orchestra.run.smithi181.stdout: "dir-": 2405, 2024-08-26T00:15:08.578 INFO:teuthology.orchestra.run.smithi181.stdout: "dn": 39099, 2024-08-26T00:15:08.578 INFO:teuthology.orchestra.run.smithi181.stdout: "dn+": 136380, 2024-08-26T00:15:08.578 INFO:teuthology.orchestra.run.smithi181.stdout: "dn-": 97281, 2024-08-26T00:15:08.578 INFO:teuthology.orchestra.run.smithi181.stdout: "cap": 0, 2024-08-26T00:15:08.578 INFO:teuthology.orchestra.run.smithi181.stdout: "cap+": 0, 2024-08-26T00:15:08.578 INFO:teuthology.orchestra.run.smithi181.stdout: "cap-": 0, 2024-08-26T00:15:08.578 INFO:teuthology.orchestra.run.smithi181.stdout: "rss": 114356, 2024-08-26T00:15:08.579 INFO:teuthology.orchestra.run.smithi181.stdout: "heap": 215328 2024-08-26T00:15:08.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.579 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_server": { 2024-08-26T00:15:08.579 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_client_request": 0, 2024-08-26T00:15:08.579 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_server_request": 0, 2024-08-26T00:15:08.579 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_request": 0, 2024-08-26T00:15:08.579 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_session": 0, 2024-08-26T00:15:08.579 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_peer_request": 0, 2024-08-26T00:15:08.579 INFO:teuthology.orchestra.run.smithi181.stdout: "req_create_latency": { 2024-08-26T00:15:08.579 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.579 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.579 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.579 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getattr_latency": { 2024-08-26T00:15:08.580 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.580 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.580 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.580 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getfilelock_latency": { 2024-08-26T00:15:08.580 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.580 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.580 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.580 INFO:teuthology.orchestra.run.smithi181.stdout: "req_link_latency": { 2024-08-26T00:15:08.580 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.580 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.580 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.581 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookup_latency": { 2024-08-26T00:15:08.581 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.581 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.581 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.581 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookuphash_latency": { 2024-08-26T00:15:08.581 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.581 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.581 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.581 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupino_latency": { 2024-08-26T00:15:08.581 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.581 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.581 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.582 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupname_latency": { 2024-08-26T00:15:08.582 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.582 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.582 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.582 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupparent_latency": { 2024-08-26T00:15:08.582 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.582 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.582 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.582 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupsnap_latency": { 2024-08-26T00:15:08.582 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.583 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.583 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.583 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lssnap_latency": { 2024-08-26T00:15:08.583 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.583 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.583 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.583 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mkdir_latency": { 2024-08-26T00:15:08.583 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.583 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.583 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.583 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mknod_latency": { 2024-08-26T00:15:08.584 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.584 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.584 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.584 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mksnap_latency": { 2024-08-26T00:15:08.584 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.584 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.584 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.584 INFO:teuthology.orchestra.run.smithi181.stdout: "req_open_latency": { 2024-08-26T00:15:08.584 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.584 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.584 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.585 INFO:teuthology.orchestra.run.smithi181.stdout: "req_readdir_latency": { 2024-08-26T00:15:08.585 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.585 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.585 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.585 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rename_latency": { 2024-08-26T00:15:08.585 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.585 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.585 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.585 INFO:teuthology.orchestra.run.smithi181.stdout: "req_renamesnap_latency": { 2024-08-26T00:15:08.585 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.585 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.586 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.586 INFO:teuthology.orchestra.run.smithi181.stdout: "req_snapdiff_latency": { 2024-08-26T00:15:08.586 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.586 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.586 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.586 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmdir_latency": { 2024-08-26T00:15:08.586 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.586 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.586 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.586 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmsnap_latency": { 2024-08-26T00:15:08.586 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.587 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.587 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.587 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmxattr_latency": { 2024-08-26T00:15:08.587 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.587 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.587 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.587 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setattr_latency": { 2024-08-26T00:15:08.587 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.587 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.587 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.588 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setdirlayout_latency": { 2024-08-26T00:15:08.588 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.588 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.588 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.588 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setfilelock_latency": { 2024-08-26T00:15:08.588 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.588 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.588 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.588 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setlayout_latency": { 2024-08-26T00:15:08.588 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.589 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.589 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.589 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setxattr_latency": { 2024-08-26T00:15:08.589 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.589 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.589 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.589 INFO:teuthology.orchestra.run.smithi181.stdout: "req_symlink_latency": { 2024-08-26T00:15:08.589 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.589 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.589 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.589 INFO:teuthology.orchestra.run.smithi181.stdout: "req_unlink_latency": { 2024-08-26T00:15:08.590 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.590 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.590 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.590 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_revoke_eviction": 0, 2024-08-26T00:15:08.590 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_acquisition_throttle": 0, 2024-08-26T00:15:08.590 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getvxattr_latency": { 2024-08-26T00:15:08.590 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.590 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.590 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.590 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:08.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.590 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_sessions": { 2024-08-26T00:15:08.591 INFO:teuthology.orchestra.run.smithi181.stdout: "session_count": 1, 2024-08-26T00:15:08.591 INFO:teuthology.orchestra.run.smithi181.stdout: "session_add": 2, 2024-08-26T00:15:08.591 INFO:teuthology.orchestra.run.smithi181.stdout: "session_remove": 1, 2024-08-26T00:15:08.591 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_open": 1, 2024-08-26T00:15:08.591 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_stale": 0, 2024-08-26T00:15:08.591 INFO:teuthology.orchestra.run.smithi181.stdout: "total_load": 0, 2024-08-26T00:15:08.591 INFO:teuthology.orchestra.run.smithi181.stdout: "average_load": 0, 2024-08-26T00:15:08.591 INFO:teuthology.orchestra.run.smithi181.stdout: "avg_session_uptime": 1886, 2024-08-26T00:15:08.591 INFO:teuthology.orchestra.run.smithi181.stdout: "mdthresh_evicted": 0 2024-08-26T00:15:08.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.591 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-08-26T00:15:08.591 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-08-26T00:15:08.591 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-08-26T00:15:08.592 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-08-26T00:15:08.592 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-08-26T00:15:08.592 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-08-26T00:15:08.592 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-08-26T00:15:08.592 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-26T00:15:08.592 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-08-26T00:15:08.592 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-26T00:15:08.592 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-08-26T00:15:08.592 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-08-26T00:15:08.592 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-08-26T00:15:08.592 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-26T00:15:08.592 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-08-26T00:15:08.592 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-08-26T00:15:08.592 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-08-26T00:15:08.593 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-08-26T00:15:08.593 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-08-26T00:15:08.593 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-26T00:15:08.593 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-08-26T00:15:08.593 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-26T00:15:08.593 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-08-26T00:15:08.593 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-08-26T00:15:08.593 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-08-26T00:15:08.593 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-08-26T00:15:08.593 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-08-26T00:15:08.593 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-26T00:15:08.593 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-08-26T00:15:08.593 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-08-26T00:15:08.593 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-08-26T00:15:08.594 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-08-26T00:15:08.594 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-08-26T00:15:08.594 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-08-26T00:15:08.594 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-08-26T00:15:08.594 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-08-26T00:15:08.594 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-08-26T00:15:08.594 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 239526, 2024-08-26T00:15:08.594 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 80, 2024-08-26T00:15:08.594 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-08-26T00:15:08.594 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-08-26T00:15:08.594 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-08-26T00:15:08.594 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-08-26T00:15:08.595 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-08-26T00:15:08.595 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-08-26T00:15:08.595 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-08-26T00:15:08.595 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-08-26T00:15:08.595 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 7592, 2024-08-26T00:15:08.595 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 156, 2024-08-26T00:15:08.595 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-08-26T00:15:08.595 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-08-26T00:15:08.595 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-08-26T00:15:08.595 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-08-26T00:15:08.595 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 27630992, 2024-08-26T00:15:08.595 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 157848, 2024-08-26T00:15:08.595 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-08-26T00:15:08.595 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-08-26T00:15:08.596 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-08-26T00:15:08.596 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-08-26T00:15:08.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.596 INFO:teuthology.orchestra.run.smithi181.stdout: "objecter": { 2024-08-26T00:15:08.596 INFO:teuthology.orchestra.run.smithi181.stdout: "op_active": 0, 2024-08-26T00:15:08.596 INFO:teuthology.orchestra.run.smithi181.stdout: "op_laggy": 0, 2024-08-26T00:15:08.596 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send": 3490, 2024-08-26T00:15:08.596 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send_bytes": 26, 2024-08-26T00:15:08.596 INFO:teuthology.orchestra.run.smithi181.stdout: "op_resend": 4, 2024-08-26T00:15:08.596 INFO:teuthology.orchestra.run.smithi181.stdout: "op_reply": 3490, 2024-08-26T00:15:08.596 INFO:teuthology.orchestra.run.smithi181.stdout: "op_latency": { 2024-08-26T00:15:08.596 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 3490, 2024-08-26T00:15:08.596 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 14.825708132, 2024-08-26T00:15:08.597 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.004248053 2024-08-26T00:15:08.597 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.597 INFO:teuthology.orchestra.run.smithi181.stdout: "op_inflight": 0, 2024-08-26T00:15:08.597 INFO:teuthology.orchestra.run.smithi181.stdout: "oplen_avg": { 2024-08-26T00:15:08.597 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 3490, 2024-08-26T00:15:08.597 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 3491 2024-08-26T00:15:08.597 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.597 INFO:teuthology.orchestra.run.smithi181.stdout: "op": 3490, 2024-08-26T00:15:08.597 INFO:teuthology.orchestra.run.smithi181.stdout: "op_r": 3490, 2024-08-26T00:15:08.597 INFO:teuthology.orchestra.run.smithi181.stdout: "op_w": 0, 2024-08-26T00:15:08.597 INFO:teuthology.orchestra.run.smithi181.stdout: "op_rmw": 0, 2024-08-26T00:15:08.597 INFO:teuthology.orchestra.run.smithi181.stdout: "op_pg": 0, 2024-08-26T00:15:08.597 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_stat": 2087, 2024-08-26T00:15:08.597 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_create": 0, 2024-08-26T00:15:08.598 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_read": 1400, 2024-08-26T00:15:08.598 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_write": 0, 2024-08-26T00:15:08.598 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writefull": 0, 2024-08-26T00:15:08.598 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writesame": 0, 2024-08-26T00:15:08.598 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_append": 0, 2024-08-26T00:15:08.598 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_zero": 0, 2024-08-26T00:15:08.598 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_truncate": 0, 2024-08-26T00:15:08.598 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_delete": 0, 2024-08-26T00:15:08.598 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_mapext": 0, 2024-08-26T00:15:08.598 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_sparse_read": 0, 2024-08-26T00:15:08.598 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_clonerange": 0, 2024-08-26T00:15:08.598 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_getxattr": 2, 2024-08-26T00:15:08.599 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_setxattr": 0, 2024-08-26T00:15:08.599 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_cmpxattr": 0, 2024-08-26T00:15:08.599 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_rmxattr": 0, 2024-08-26T00:15:08.599 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_resetxattrs": 0, 2024-08-26T00:15:08.599 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_call": 0, 2024-08-26T00:15:08.599 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_watch": 0, 2024-08-26T00:15:08.599 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_notify": 0, 2024-08-26T00:15:08.599 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_src_cmpxattr": 0, 2024-08-26T00:15:08.599 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls": 0, 2024-08-26T00:15:08.599 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls_filter": 0, 2024-08-26T00:15:08.599 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_other": 0, 2024-08-26T00:15:08.599 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_active": 0, 2024-08-26T00:15:08.599 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_send": 0, 2024-08-26T00:15:08.600 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_resend": 0, 2024-08-26T00:15:08.600 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_ping": 0, 2024-08-26T00:15:08.600 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_active": 0, 2024-08-26T00:15:08.600 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_send": 0, 2024-08-26T00:15:08.600 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_resend": 0, 2024-08-26T00:15:08.600 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_active": 0, 2024-08-26T00:15:08.600 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_send": 0, 2024-08-26T00:15:08.600 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_resend": 0, 2024-08-26T00:15:08.600 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_active": 0, 2024-08-26T00:15:08.600 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_send": 0, 2024-08-26T00:15:08.600 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_resend": 0, 2024-08-26T00:15:08.600 INFO:teuthology.orchestra.run.smithi181.stdout: "command_active": 0, 2024-08-26T00:15:08.600 INFO:teuthology.orchestra.run.smithi181.stdout: "command_send": 0, 2024-08-26T00:15:08.601 INFO:teuthology.orchestra.run.smithi181.stdout: "command_resend": 0, 2024-08-26T00:15:08.601 INFO:teuthology.orchestra.run.smithi181.stdout: "map_epoch": 80, 2024-08-26T00:15:08.601 INFO:teuthology.orchestra.run.smithi181.stdout: "map_full": 0, 2024-08-26T00:15:08.601 INFO:teuthology.orchestra.run.smithi181.stdout: "map_inc": 2, 2024-08-26T00:15:08.601 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_sessions": 11, 2024-08-26T00:15:08.601 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_open": 11, 2024-08-26T00:15:08.601 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_close": 0, 2024-08-26T00:15:08.601 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_laggy": 0, 2024-08-26T00:15:08.601 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_wr": 0, 2024-08-26T00:15:08.601 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_rd": 2, 2024-08-26T00:15:08.601 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_del": 0 2024-08-26T00:15:08.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.601 INFO:teuthology.orchestra.run.smithi181.stdout: "oft": { 2024-08-26T00:15:08.602 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_objs": 0, 2024-08-26T00:15:08.602 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_kv_pairs": 0, 2024-08-26T00:15:08.602 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_updates": 0, 2024-08-26T00:15:08.602 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_removes": 0 2024-08-26T00:15:08.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.602 INFO:teuthology.orchestra.run.smithi181.stdout: "osd-slow-ops": { 2024-08-26T00:15:08.602 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_ops_count": 0 2024-08-26T00:15:08.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.602 INFO:teuthology.orchestra.run.smithi181.stdout: "purge_queue": { 2024-08-26T00:15:08.602 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops": 0, 2024-08-26T00:15:08.602 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops_high_water": 0, 2024-08-26T00:15:08.602 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing": 0, 2024-08-26T00:15:08.603 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_high_water": 0, 2024-08-26T00:15:08.603 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed_ops": 0, 2024-08-26T00:15:08.603 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed": 0, 2024-08-26T00:15:08.603 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_item_in_journal": 0 2024-08-26T00:15:08.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.603 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-26T00:15:08.603 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-08-26T00:15:08.603 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-08-26T00:15:08.603 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-08-26T00:15:08.603 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 3757, 2024-08-26T00:15:08.603 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 443520947, 2024-08-26T00:15:08.603 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:08.603 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 3757, 2024-08-26T00:15:08.603 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-08-26T00:15:08.604 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-08-26T00:15:08.604 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 3757, 2024-08-26T00:15:08.604 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 443520947, 2024-08-26T00:15:08.604 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-08-26T00:15:08.604 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.604 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.604 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.604 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:08.604 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.604 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_bytes": { 2024-08-26T00:15:08.604 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-08-26T00:15:08.604 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-08-26T00:15:08.604 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-08-26T00:15:08.604 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-08-26T00:15:08.605 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-08-26T00:15:08.605 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:08.605 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-08-26T00:15:08.605 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 3490, 2024-08-26T00:15:08.605 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 442367836, 2024-08-26T00:15:08.605 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 3490, 2024-08-26T00:15:08.605 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 442367836, 2024-08-26T00:15:08.605 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-08-26T00:15:08.605 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.605 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.605 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.605 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:08.605 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.606 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_ops": { 2024-08-26T00:15:08.606 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-08-26T00:15:08.606 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 1024, 2024-08-26T00:15:08.606 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-08-26T00:15:08.606 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-08-26T00:15:08.606 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-08-26T00:15:08.606 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:08.606 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-08-26T00:15:08.606 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 3490, 2024-08-26T00:15:08.606 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 3490, 2024-08-26T00:15:08.606 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 3490, 2024-08-26T00:15:08.606 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 3490, 2024-08-26T00:15:08.606 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-08-26T00:15:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle": { 2024-08-26T00:15:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-08-26T00:15:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-08-26T00:15:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-08-26T00:15:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-08-26T00:15:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-08-26T00:15:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-08-26T00:15:08.608 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-08-26T00:15:08.608 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-08-26T00:15:08.608 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-08-26T00:15:08.608 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-08-26T00:15:08.608 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-08-26T00:15:08.608 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.608 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.608 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.608 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:08.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:08.608 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle-0x557d80cbcb40": { 2024-08-26T00:15:08.608 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-08-26T00:15:08.608 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-08-26T00:15:08.608 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-08-26T00:15:08.609 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-08-26T00:15:08.609 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-08-26T00:15:08.609 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:08.609 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-08-26T00:15:08.609 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-08-26T00:15:08.609 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-08-26T00:15:08.609 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-08-26T00:15:08.609 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-08-26T00:15:08.609 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-08-26T00:15:08.609 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:08.609 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:08.609 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:08.609 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:08.609 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:08.610 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-08-26T00:15:08.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:08 smithi181 ceph-mon[22102]: pgmap v717: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 7 op/s 2024-08-26T00:15:09.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:08 smithi043 ceph-mon[22091]: pgmap v717: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 7 op/s 2024-08-26T00:15:09.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:08 smithi042 ceph-mon[17225]: pgmap v717: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 7 op/s 2024-08-26T00:15:09.490 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-08-26T00:15:09.491 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-08-26T00:15:09.491 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-08-26T00:15:09.491 DEBUG:tasks.check_counter:Getting stats from i 2024-08-26T00:15:09.491 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph daemon mds.i perf dump 2024-08-26T00:15:09.753 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.c/config 2024-08-26T00:15:10.445 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-08-26T00:15:10.446 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-08-26T00:15:10.446 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 121840, 2024-08-26T00:15:10.446 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 111149, 2024-08-26T00:15:10.446 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 59124997, 2024-08-26T00:15:10.446 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 222744532, 2024-08-26T00:15:10.446 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 94, 2024-08-26T00:15:10.446 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 3, 2024-08-26T00:15:10.446 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 8.247837297, 2024-08-26T00:15:10.446 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 3.587183113, 2024-08-26T00:15:10.446 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 3.149238552, 2024-08-26T00:15:10.446 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 1.754327696, 2024-08-26T00:15:10.447 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:15:10.447 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 111151, 2024-08-26T00:15:10.447 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 13.367184614, 2024-08-26T00:15:10.447 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000120261 2024-08-26T00:15:10.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.447 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:15:10.447 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 114141, 2024-08-26T00:15:10.447 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.017997731, 2024-08-26T00:15:10.447 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000157 2024-08-26T00:15:10.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.447 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 568880, 2024-08-26T00:15:10.447 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 240352 2024-08-26T00:15:10.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.448 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-08-26T00:15:10.448 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 377105, 2024-08-26T00:15:10.448 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 563368, 2024-08-26T00:15:10.448 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 147536004, 2024-08-26T00:15:10.448 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 420170744, 2024-08-26T00:15:10.448 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 12, 2024-08-26T00:15:10.448 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 5, 2024-08-26T00:15:10.448 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 22.990731033, 2024-08-26T00:15:10.448 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 10.446886445, 2024-08-26T00:15:10.448 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 39.336994671, 2024-08-26T00:15:10.448 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 2.598868506, 2024-08-26T00:15:10.448 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:15:10.448 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 563366, 2024-08-26T00:15:10.448 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 108.318992589, 2024-08-26T00:15:10.449 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000192271 2024-08-26T00:15:10.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.449 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:15:10.449 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 552964, 2024-08-26T00:15:10.449 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.093826011, 2024-08-26T00:15:10.449 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000169 2024-08-26T00:15:10.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.449 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 116479936, 2024-08-26T00:15:10.449 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 241666704 2024-08-26T00:15:10.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.449 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-08-26T00:15:10.449 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 109243, 2024-08-26T00:15:10.450 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 110791, 2024-08-26T00:15:10.450 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 49391146, 2024-08-26T00:15:10.450 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 184681210, 2024-08-26T00:15:10.450 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 11, 2024-08-26T00:15:10.450 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 7, 2024-08-26T00:15:10.450 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 8.059735772, 2024-08-26T00:15:10.450 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 3.403945746, 2024-08-26T00:15:10.450 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 2.657484245, 2024-08-26T00:15:10.450 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 2.034964818, 2024-08-26T00:15:10.450 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:15:10.450 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 110787, 2024-08-26T00:15:10.450 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 19.193047459, 2024-08-26T00:15:10.450 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000173242 2024-08-26T00:15:10.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.451 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:15:10.451 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 75138, 2024-08-26T00:15:10.451 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.017976475, 2024-08-26T00:15:10.451 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000239 2024-08-26T00:15:10.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.451 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-26T00:15:10.451 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 448 2024-08-26T00:15:10.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.451 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-08-26T00:15:10.451 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 1, 2024-08-26T00:15:10.452 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-08-26T00:15:10.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.452 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-MDSRank": { 2024-08-26T00:15:10.452 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-08-26T00:15:10.452 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-08-26T00:15:10.452 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 103227, 2024-08-26T00:15:10.452 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 157.990085450, 2024-08-26T00:15:10.452 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001530511 2024-08-26T00:15:10.452 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:10.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.452 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-PurgeQueue": { 2024-08-26T00:15:10.452 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-08-26T00:15:10.453 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-08-26T00:15:10.453 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 65141, 2024-08-26T00:15:10.453 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 13.337655407, 2024-08-26T00:15:10.453 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000204750 2024-08-26T00:15:10.453 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:10.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.453 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": { 2024-08-26T00:15:10.453 INFO:teuthology.orchestra.run.smithi181.stdout: "request": 139382, 2024-08-26T00:15:10.453 INFO:teuthology.orchestra.run.smithi181.stdout: "reply": 137361, 2024-08-26T00:15:10.453 INFO:teuthology.orchestra.run.smithi181.stdout: "reply_latency": { 2024-08-26T00:15:10.453 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 137361, 2024-08-26T00:15:10.453 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 1215.733430162, 2024-08-26T00:15:10.453 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.008850644 2024-08-26T00:15:10.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.454 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_reply": 0, 2024-08-26T00:15:10.454 INFO:teuthology.orchestra.run.smithi181.stdout: "forward": 2021, 2024-08-26T00:15:10.454 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_complete": 78, 2024-08-26T00:15:10.454 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_keys": 0, 2024-08-26T00:15:10.454 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_commit": 1862, 2024-08-26T00:15:10.454 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_split": 133, 2024-08-26T00:15:10.454 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_merge": 5, 2024-08-26T00:15:10.454 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes": 421, 2024-08-26T00:15:10.454 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_top": 281, 2024-08-26T00:15:10.454 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_bottom": 127, 2024-08-26T00:15:10.454 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pin_tail": 13, 2024-08-26T00:15:10.454 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pinned": 19, 2024-08-26T00:15:10.455 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_expired": 54193, 2024-08-26T00:15:10.455 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_with_caps": 3, 2024-08-26T00:15:10.455 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": 3, 2024-08-26T00:15:10.455 INFO:teuthology.orchestra.run.smithi181.stdout: "subtrees": 4, 2024-08-26T00:15:10.455 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse": 225565, 2024-08-26T00:15:10.455 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_hit": 196119, 2024-08-26T00:15:10.455 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_forward": 1752, 2024-08-26T00:15:10.455 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_discover": 1611, 2024-08-26T00:15:10.455 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_dir_fetch": 0, 2024-08-26T00:15:10.455 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_remote_ino": 0, 2024-08-26T00:15:10.455 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_lock": 541, 2024-08-26T00:15:10.455 INFO:teuthology.orchestra.run.smithi181.stdout: "load_cent": 25, 2024-08-26T00:15:10.456 INFO:teuthology.orchestra.run.smithi181.stdout: "q": 0, 2024-08-26T00:15:10.456 INFO:teuthology.orchestra.run.smithi181.stdout: "exported": 266, 2024-08-26T00:15:10.456 INFO:teuthology.orchestra.run.smithi181.stdout: "exported_inodes": 33249, 2024-08-26T00:15:10.456 INFO:teuthology.orchestra.run.smithi181.stdout: "imported": 190, 2024-08-26T00:15:10.456 INFO:teuthology.orchestra.run.smithi181.stdout: "imported_inodes": 54712, 2024-08-26T00:15:10.456 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_dir_fetch": 0, 2024-08-26T00:15:10.456 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_backtrace_fetch": 151647, 2024-08-26T00:15:10.456 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_peer_discover": 0, 2024-08-26T00:15:10.456 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rfiles": 4, 2024-08-26T00:15:10.456 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rbytes": 234, 2024-08-26T00:15:10.456 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rsnaps": 0, 2024-08-26T00:15:10.456 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_fetch": 151647, 2024-08-26T00:15:10.457 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_set_tag": 0, 2024-08-26T00:15:10.457 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_repaired": 0, 2024-08-26T00:15:10.457 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_inotable_repaired": 0, 2024-08-26T00:15:10.457 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_inodes": 1105, 2024-08-26T00:15:10.457 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_base_inodes": 11, 2024-08-26T00:15:10.457 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dirfrag_rstats": 1094, 2024-08-26T00:15:10.457 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_file_inodes": 150542, 2024-08-26T00:15:10.457 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_inode_file_caps": 697, 2024-08-26T00:15:10.457 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_revoke": 34388, 2024-08-26T00:15:10.457 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_grant": 75746, 2024-08-26T00:15:10.457 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_trunc": 4, 2024-08-26T00:15:10.457 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-26T00:15:10.457 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-26T00:15:10.458 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps": 88948, 2024-08-26T00:15:10.458 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps_dirty": 32778, 2024-08-26T00:15:10.458 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_cap_release": 1509, 2024-08-26T00:15:10.458 INFO:teuthology.orchestra.run.smithi181.stdout: "process_request_cap_release": 76859 2024-08-26T00:15:10.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.458 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_cache": { 2024-08-26T00:15:10.458 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update": 1, 2024-08-26T00:15:10.458 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update_receipt": 0, 2024-08-26T00:15:10.458 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_try_discover": 0, 2024-08-26T00:15:10.458 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_send_discover": 1659, 2024-08-26T00:15:10.458 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_handle_discover": 1423, 2024-08-26T00:15:10.458 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays": 3, 2024-08-26T00:15:10.459 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_delayed": 0, 2024-08-26T00:15:10.459 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_enqueuing": 0, 2024-08-26T00:15:10.459 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_created": 38740, 2024-08-26T00:15:10.459 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_enqueued": 38737, 2024-08-26T00:15:10.459 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_reintegrated": 0, 2024-08-26T00:15:10.459 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_migrated": 0, 2024-08-26T00:15:10.459 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_processing": 0, 2024-08-26T00:15:10.459 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_enqueued": 0, 2024-08-26T00:15:10.459 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_prioritized": 0, 2024-08-26T00:15:10.459 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_started": 0, 2024-08-26T00:15:10.459 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_completed": 0, 2024-08-26T00:15:10.459 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_path": 0, 2024-08-26T00:15:10.459 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_inode": 0, 2024-08-26T00:15:10.459 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_enqueue_scrub": 11, 2024-08-26T00:15:10.460 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_exportdir": 268, 2024-08-26T00:15:10.460 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_flush": 0, 2024-08-26T00:15:10.460 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragmentdir": 138, 2024-08-26T00:15:10.460 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragstats": 0, 2024-08-26T00:15:10.460 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_inodestats": 0 2024-08-26T00:15:10.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.460 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_log": { 2024-08-26T00:15:10.460 INFO:teuthology.orchestra.run.smithi181.stdout: "evlrg": 5, 2024-08-26T00:15:10.460 INFO:teuthology.orchestra.run.smithi181.stdout: "evadd": 206291, 2024-08-26T00:15:10.460 INFO:teuthology.orchestra.run.smithi181.stdout: "evex": 104571, 2024-08-26T00:15:10.460 INFO:teuthology.orchestra.run.smithi181.stdout: "evtrm": 98321, 2024-08-26T00:15:10.460 INFO:teuthology.orchestra.run.smithi181.stdout: "ev": 107970, 2024-08-26T00:15:10.460 INFO:teuthology.orchestra.run.smithi181.stdout: "evexg": 0, 2024-08-26T00:15:10.461 INFO:teuthology.orchestra.run.smithi181.stdout: "evexd": 6250, 2024-08-26T00:15:10.461 INFO:teuthology.orchestra.run.smithi181.stdout: "segadd": 260, 2024-08-26T00:15:10.461 INFO:teuthology.orchestra.run.smithi181.stdout: "segex": 132, 2024-08-26T00:15:10.461 INFO:teuthology.orchestra.run.smithi181.stdout: "segtrm": 124, 2024-08-26T00:15:10.461 INFO:teuthology.orchestra.run.smithi181.stdout: "seg": 136, 2024-08-26T00:15:10.461 INFO:teuthology.orchestra.run.smithi181.stdout: "segmjr": 9, 2024-08-26T00:15:10.461 INFO:teuthology.orchestra.run.smithi181.stdout: "segexg": 0, 2024-08-26T00:15:10.461 INFO:teuthology.orchestra.run.smithi181.stdout: "segexd": 8, 2024-08-26T00:15:10.461 INFO:teuthology.orchestra.run.smithi181.stdout: "expos": 238097013, 2024-08-26T00:15:10.461 INFO:teuthology.orchestra.run.smithi181.stdout: "wrpos": 446531693, 2024-08-26T00:15:10.461 INFO:teuthology.orchestra.run.smithi181.stdout: "rdpos": 0, 2024-08-26T00:15:10.461 INFO:teuthology.orchestra.run.smithi181.stdout: "jlat": { 2024-08-26T00:15:10.461 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 3968, 2024-08-26T00:15:10.461 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 132.518854674, 2024-08-26T00:15:10.462 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.033396888 2024-08-26T00:15:10.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.462 INFO:teuthology.orchestra.run.smithi181.stdout: "replayed": 0 2024-08-26T00:15:10.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.462 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_mem": { 2024-08-26T00:15:10.462 INFO:teuthology.orchestra.run.smithi181.stdout: "ino": 48, 2024-08-26T00:15:10.462 INFO:teuthology.orchestra.run.smithi181.stdout: "ino+": 59184, 2024-08-26T00:15:10.462 INFO:teuthology.orchestra.run.smithi181.stdout: "ino-": 59136, 2024-08-26T00:15:10.462 INFO:teuthology.orchestra.run.smithi181.stdout: "dir": 57, 2024-08-26T00:15:10.462 INFO:teuthology.orchestra.run.smithi181.stdout: "dir+": 2305, 2024-08-26T00:15:10.462 INFO:teuthology.orchestra.run.smithi181.stdout: "dir-": 2248, 2024-08-26T00:15:10.462 INFO:teuthology.orchestra.run.smithi181.stdout: "dn": 421, 2024-08-26T00:15:10.462 INFO:teuthology.orchestra.run.smithi181.stdout: "dn+": 144329, 2024-08-26T00:15:10.463 INFO:teuthology.orchestra.run.smithi181.stdout: "dn-": 143908, 2024-08-26T00:15:10.463 INFO:teuthology.orchestra.run.smithi181.stdout: "cap": 3, 2024-08-26T00:15:10.463 INFO:teuthology.orchestra.run.smithi181.stdout: "cap+": 60207, 2024-08-26T00:15:10.463 INFO:teuthology.orchestra.run.smithi181.stdout: "cap-": 60204, 2024-08-26T00:15:10.463 INFO:teuthology.orchestra.run.smithi181.stdout: "rss": 157236, 2024-08-26T00:15:10.463 INFO:teuthology.orchestra.run.smithi181.stdout: "heap": 231712 2024-08-26T00:15:10.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.463 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_server": { 2024-08-26T00:15:10.463 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_client_request": 164196, 2024-08-26T00:15:10.463 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_server_request": 6997, 2024-08-26T00:15:10.463 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_request": 139382, 2024-08-26T00:15:10.463 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_session": 443, 2024-08-26T00:15:10.463 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_peer_request": 19736, 2024-08-26T00:15:10.464 INFO:teuthology.orchestra.run.smithi181.stdout: "req_create_latency": { 2024-08-26T00:15:10.464 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 29105, 2024-08-26T00:15:10.464 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 103.329355599, 2024-08-26T00:15:10.464 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.003550226 2024-08-26T00:15:10.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.464 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getattr_latency": { 2024-08-26T00:15:10.464 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 4999, 2024-08-26T00:15:10.464 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 103.885628879, 2024-08-26T00:15:10.464 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.020781282 2024-08-26T00:15:10.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.464 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getfilelock_latency": { 2024-08-26T00:15:10.464 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:10.464 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:10.464 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:10.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.465 INFO:teuthology.orchestra.run.smithi181.stdout: "req_link_latency": { 2024-08-26T00:15:10.465 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:10.465 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:10.465 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:10.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.465 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookup_latency": { 2024-08-26T00:15:10.465 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 33526, 2024-08-26T00:15:10.465 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 591.070929615, 2024-08-26T00:15:10.465 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.017630225 2024-08-26T00:15:10.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.465 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookuphash_latency": { 2024-08-26T00:15:10.465 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:10.465 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:10.466 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:10.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.466 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupino_latency": { 2024-08-26T00:15:10.466 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 2, 2024-08-26T00:15:10.466 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000279578, 2024-08-26T00:15:10.466 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000139789 2024-08-26T00:15:10.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.466 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupname_latency": { 2024-08-26T00:15:10.466 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:10.466 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:10.466 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:10.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.466 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupparent_latency": { 2024-08-26T00:15:10.467 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:10.467 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:10.467 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:10.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.467 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupsnap_latency": { 2024-08-26T00:15:10.467 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:10.467 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:10.467 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:10.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.467 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lssnap_latency": { 2024-08-26T00:15:10.467 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:10.467 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:10.467 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:10.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.468 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mkdir_latency": { 2024-08-26T00:15:10.468 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 147, 2024-08-26T00:15:10.468 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.893567926, 2024-08-26T00:15:10.468 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.006078693 2024-08-26T00:15:10.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.468 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mknod_latency": { 2024-08-26T00:15:10.468 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:10.468 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:10.468 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:10.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.468 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mksnap_latency": { 2024-08-26T00:15:10.468 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:10.468 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:10.469 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:10.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.469 INFO:teuthology.orchestra.run.smithi181.stdout: "req_open_latency": { 2024-08-26T00:15:10.469 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 8197, 2024-08-26T00:15:10.469 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 27.288717011, 2024-08-26T00:15:10.469 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.003329110 2024-08-26T00:15:10.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.469 INFO:teuthology.orchestra.run.smithi181.stdout: "req_readdir_latency": { 2024-08-26T00:15:10.469 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1429, 2024-08-26T00:15:10.469 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 2.110743419, 2024-08-26T00:15:10.469 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001477077 2024-08-26T00:15:10.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.470 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rename_latency": { 2024-08-26T00:15:10.470 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 28762, 2024-08-26T00:15:10.470 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 307.102194785, 2024-08-26T00:15:10.470 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.010677358 2024-08-26T00:15:10.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.470 INFO:teuthology.orchestra.run.smithi181.stdout: "req_renamesnap_latency": { 2024-08-26T00:15:10.470 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:10.470 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:10.470 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:10.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.470 INFO:teuthology.orchestra.run.smithi181.stdout: "req_snapdiff_latency": { 2024-08-26T00:15:10.470 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:10.470 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:10.471 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:10.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.471 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmdir_latency": { 2024-08-26T00:15:10.471 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 216, 2024-08-26T00:15:10.471 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 27.640077706, 2024-08-26T00:15:10.471 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.127963322 2024-08-26T00:15:10.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.471 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmsnap_latency": { 2024-08-26T00:15:10.471 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:10.471 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:10.471 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:10.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.471 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmxattr_latency": { 2024-08-26T00:15:10.472 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:10.472 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:10.472 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:10.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.472 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setattr_latency": { 2024-08-26T00:15:10.472 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 5, 2024-08-26T00:15:10.472 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.025923270, 2024-08-26T00:15:10.472 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.005184654 2024-08-26T00:15:10.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.472 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setdirlayout_latency": { 2024-08-26T00:15:10.472 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:10.472 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:10.472 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:10.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.473 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setfilelock_latency": { 2024-08-26T00:15:10.473 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:10.473 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:10.473 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:10.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.473 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setlayout_latency": { 2024-08-26T00:15:10.473 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:10.473 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:10.473 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:10.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.473 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setxattr_latency": { 2024-08-26T00:15:10.473 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 7, 2024-08-26T00:15:10.474 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.020595112, 2024-08-26T00:15:10.474 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.002942158 2024-08-26T00:15:10.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.474 INFO:teuthology.orchestra.run.smithi181.stdout: "req_symlink_latency": { 2024-08-26T00:15:10.474 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 3, 2024-08-26T00:15:10.474 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.001738445, 2024-08-26T00:15:10.474 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000579481 2024-08-26T00:15:10.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.474 INFO:teuthology.orchestra.run.smithi181.stdout: "req_unlink_latency": { 2024-08-26T00:15:10.474 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 30963, 2024-08-26T00:15:10.474 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 52.363678817, 2024-08-26T00:15:10.474 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001691169 2024-08-26T00:15:10.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.475 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_revoke_eviction": 0, 2024-08-26T00:15:10.475 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_acquisition_throttle": 0, 2024-08-26T00:15:10.475 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getvxattr_latency": { 2024-08-26T00:15:10.475 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:10.475 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:10.475 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:10.475 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:10.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.475 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_sessions": { 2024-08-26T00:15:10.475 INFO:teuthology.orchestra.run.smithi181.stdout: "session_count": 1, 2024-08-26T00:15:10.475 INFO:teuthology.orchestra.run.smithi181.stdout: "session_add": 2, 2024-08-26T00:15:10.476 INFO:teuthology.orchestra.run.smithi181.stdout: "session_remove": 1, 2024-08-26T00:15:10.476 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_open": 1, 2024-08-26T00:15:10.476 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_stale": 0, 2024-08-26T00:15:10.476 INFO:teuthology.orchestra.run.smithi181.stdout: "total_load": 11703, 2024-08-26T00:15:10.476 INFO:teuthology.orchestra.run.smithi181.stdout: "average_load": 11703, 2024-08-26T00:15:10.476 INFO:teuthology.orchestra.run.smithi181.stdout: "avg_session_uptime": 762, 2024-08-26T00:15:10.476 INFO:teuthology.orchestra.run.smithi181.stdout: "mdthresh_evicted": 0 2024-08-26T00:15:10.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.476 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-08-26T00:15:10.476 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-08-26T00:15:10.476 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-08-26T00:15:10.476 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-08-26T00:15:10.476 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-08-26T00:15:10.477 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-08-26T00:15:10.477 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-08-26T00:15:10.477 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-26T00:15:10.477 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-08-26T00:15:10.477 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-26T00:15:10.477 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-08-26T00:15:10.477 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-08-26T00:15:10.477 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-08-26T00:15:10.477 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-26T00:15:10.477 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-08-26T00:15:10.477 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-08-26T00:15:10.477 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-08-26T00:15:10.477 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-08-26T00:15:10.478 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-08-26T00:15:10.478 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-26T00:15:10.478 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-08-26T00:15:10.478 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-26T00:15:10.478 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-08-26T00:15:10.478 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-08-26T00:15:10.478 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-08-26T00:15:10.478 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-08-26T00:15:10.478 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-08-26T00:15:10.478 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-26T00:15:10.478 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-08-26T00:15:10.478 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-08-26T00:15:10.478 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-08-26T00:15:10.479 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-08-26T00:15:10.479 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-08-26T00:15:10.479 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-08-26T00:15:10.479 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-08-26T00:15:10.479 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-08-26T00:15:10.479 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-08-26T00:15:10.479 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 310587, 2024-08-26T00:15:10.479 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 116, 2024-08-26T00:15:10.479 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-08-26T00:15:10.479 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-08-26T00:15:10.479 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-08-26T00:15:10.479 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-08-26T00:15:10.479 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-08-26T00:15:10.480 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-08-26T00:15:10.480 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-08-26T00:15:10.480 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-08-26T00:15:10.480 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 7592, 2024-08-26T00:15:10.480 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 156, 2024-08-26T00:15:10.480 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-08-26T00:15:10.480 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-08-26T00:15:10.480 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-08-26T00:15:10.480 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-08-26T00:15:10.480 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 508169, 2024-08-26T00:15:10.480 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 5849, 2024-08-26T00:15:10.480 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-08-26T00:15:10.480 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-08-26T00:15:10.481 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-08-26T00:15:10.481 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-08-26T00:15:10.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.481 INFO:teuthology.orchestra.run.smithi181.stdout: "objecter": { 2024-08-26T00:15:10.481 INFO:teuthology.orchestra.run.smithi181.stdout: "op_active": 0, 2024-08-26T00:15:10.481 INFO:teuthology.orchestra.run.smithi181.stdout: "op_laggy": 0, 2024-08-26T00:15:10.481 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send": 216986, 2024-08-26T00:15:10.481 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send_bytes": 491377105, 2024-08-26T00:15:10.481 INFO:teuthology.orchestra.run.smithi181.stdout: "op_resend": 37, 2024-08-26T00:15:10.481 INFO:teuthology.orchestra.run.smithi181.stdout: "op_reply": 216986, 2024-08-26T00:15:10.481 INFO:teuthology.orchestra.run.smithi181.stdout: "op_latency": { 2024-08-26T00:15:10.481 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 216986, 2024-08-26T00:15:10.481 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 5809.474806440, 2024-08-26T00:15:10.481 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.026773500 2024-08-26T00:15:10.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.482 INFO:teuthology.orchestra.run.smithi181.stdout: "op_inflight": 0, 2024-08-26T00:15:10.482 INFO:teuthology.orchestra.run.smithi181.stdout: "oplen_avg": { 2024-08-26T00:15:10.482 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 216986, 2024-08-26T00:15:10.482 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 252513 2024-08-26T00:15:10.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.482 INFO:teuthology.orchestra.run.smithi181.stdout: "op": 216986, 2024-08-26T00:15:10.482 INFO:teuthology.orchestra.run.smithi181.stdout: "op_r": 152729, 2024-08-26T00:15:10.482 INFO:teuthology.orchestra.run.smithi181.stdout: "op_w": 64257, 2024-08-26T00:15:10.482 INFO:teuthology.orchestra.run.smithi181.stdout: "op_rmw": 0, 2024-08-26T00:15:10.482 INFO:teuthology.orchestra.run.smithi181.stdout: "op_pg": 0, 2024-08-26T00:15:10.482 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_stat": 622, 2024-08-26T00:15:10.482 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_create": 15717, 2024-08-26T00:15:10.483 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_read": 873, 2024-08-26T00:15:10.483 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_write": 4832, 2024-08-26T00:15:10.483 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writefull": 475, 2024-08-26T00:15:10.483 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writesame": 0, 2024-08-26T00:15:10.483 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_append": 0, 2024-08-26T00:15:10.483 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_zero": 0, 2024-08-26T00:15:10.483 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_truncate": 133, 2024-08-26T00:15:10.483 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_delete": 40730, 2024-08-26T00:15:10.483 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_mapext": 0, 2024-08-26T00:15:10.483 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_sparse_read": 0, 2024-08-26T00:15:10.483 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_clonerange": 0, 2024-08-26T00:15:10.483 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_getxattr": 151659, 2024-08-26T00:15:10.483 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_setxattr": 31434, 2024-08-26T00:15:10.484 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_cmpxattr": 0, 2024-08-26T00:15:10.484 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_rmxattr": 0, 2024-08-26T00:15:10.484 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_resetxattrs": 0, 2024-08-26T00:15:10.484 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_call": 0, 2024-08-26T00:15:10.484 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_watch": 0, 2024-08-26T00:15:10.484 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_notify": 0, 2024-08-26T00:15:10.484 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_src_cmpxattr": 0, 2024-08-26T00:15:10.484 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls": 0, 2024-08-26T00:15:10.484 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls_filter": 0, 2024-08-26T00:15:10.484 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_other": 4, 2024-08-26T00:15:10.484 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_active": 0, 2024-08-26T00:15:10.484 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_send": 0, 2024-08-26T00:15:10.484 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_resend": 0, 2024-08-26T00:15:10.484 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_ping": 0, 2024-08-26T00:15:10.485 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_active": 0, 2024-08-26T00:15:10.485 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_send": 0, 2024-08-26T00:15:10.485 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_resend": 0, 2024-08-26T00:15:10.485 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_active": 0, 2024-08-26T00:15:10.485 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_send": 0, 2024-08-26T00:15:10.485 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_resend": 0, 2024-08-26T00:15:10.485 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_active": 0, 2024-08-26T00:15:10.485 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_send": 0, 2024-08-26T00:15:10.485 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_resend": 0, 2024-08-26T00:15:10.485 INFO:teuthology.orchestra.run.smithi181.stdout: "command_active": 0, 2024-08-26T00:15:10.485 INFO:teuthology.orchestra.run.smithi181.stdout: "command_send": 0, 2024-08-26T00:15:10.485 INFO:teuthology.orchestra.run.smithi181.stdout: "command_resend": 0, 2024-08-26T00:15:10.485 INFO:teuthology.orchestra.run.smithi181.stdout: "map_epoch": 80, 2024-08-26T00:15:10.486 INFO:teuthology.orchestra.run.smithi181.stdout: "map_full": 0, 2024-08-26T00:15:10.486 INFO:teuthology.orchestra.run.smithi181.stdout: "map_inc": 2, 2024-08-26T00:15:10.486 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_sessions": 12, 2024-08-26T00:15:10.486 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_open": 12, 2024-08-26T00:15:10.486 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_close": 0, 2024-08-26T00:15:10.486 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_laggy": 0, 2024-08-26T00:15:10.486 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_wr": 4630, 2024-08-26T00:15:10.486 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_rd": 276, 2024-08-26T00:15:10.486 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_del": 1128 2024-08-26T00:15:10.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.486 INFO:teuthology.orchestra.run.smithi181.stdout: "oft": { 2024-08-26T00:15:10.486 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_objs": 1, 2024-08-26T00:15:10.486 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_kv_pairs": 0, 2024-08-26T00:15:10.487 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_updates": 0, 2024-08-26T00:15:10.487 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_removes": 0 2024-08-26T00:15:10.487 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.487 INFO:teuthology.orchestra.run.smithi181.stdout: "osd-slow-ops": { 2024-08-26T00:15:10.487 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_ops_count": 0 2024-08-26T00:15:10.487 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.487 INFO:teuthology.orchestra.run.smithi181.stdout: "purge_queue": { 2024-08-26T00:15:10.487 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops": 0, 2024-08-26T00:15:10.487 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops_high_water": 18, 2024-08-26T00:15:10.487 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing": 0, 2024-08-26T00:15:10.487 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_high_water": 10, 2024-08-26T00:15:10.487 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed_ops": 40022, 2024-08-26T00:15:10.487 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed": 38737, 2024-08-26T00:15:10.488 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_item_in_journal": 0 2024-08-26T00:15:10.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.488 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-26T00:15:10.488 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-08-26T00:15:10.488 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-08-26T00:15:10.488 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-08-26T00:15:10.488 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 608184, 2024-08-26T00:15:10.488 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 187816111, 2024-08-26T00:15:10.488 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:10.488 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 608184, 2024-08-26T00:15:10.488 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-08-26T00:15:10.488 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-08-26T00:15:10.489 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 608184, 2024-08-26T00:15:10.489 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 187816111, 2024-08-26T00:15:10.489 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-08-26T00:15:10.489 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:10.489 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:10.489 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:10.489 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:10.489 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.489 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_bytes": { 2024-08-26T00:15:10.489 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-08-26T00:15:10.489 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-08-26T00:15:10.489 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-08-26T00:15:10.489 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-08-26T00:15:10.490 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-08-26T00:15:10.490 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:10.490 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-08-26T00:15:10.490 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 216986, 2024-08-26T00:15:10.490 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 495285402, 2024-08-26T00:15:10.490 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 216986, 2024-08-26T00:15:10.490 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 495285402, 2024-08-26T00:15:10.490 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-08-26T00:15:10.490 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:10.490 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:10.490 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:10.490 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:10.490 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.491 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_ops": { 2024-08-26T00:15:10.491 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-08-26T00:15:10.491 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 1024, 2024-08-26T00:15:10.491 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-08-26T00:15:10.491 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-08-26T00:15:10.491 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-08-26T00:15:10.491 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:10.491 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-08-26T00:15:10.491 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 216986, 2024-08-26T00:15:10.491 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 216986, 2024-08-26T00:15:10.491 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 216986, 2024-08-26T00:15:10.491 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 216986, 2024-08-26T00:15:10.491 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-08-26T00:15:10.491 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:10.492 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:10.492 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:10.492 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:10.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.492 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle": { 2024-08-26T00:15:10.492 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-08-26T00:15:10.492 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-08-26T00:15:10.492 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-08-26T00:15:10.492 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 38737, 2024-08-26T00:15:10.492 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 3913733, 2024-08-26T00:15:10.492 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:10.492 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 38737, 2024-08-26T00:15:10.492 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-08-26T00:15:10.493 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-08-26T00:15:10.493 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 863, 2024-08-26T00:15:10.493 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 3913733, 2024-08-26T00:15:10.493 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-08-26T00:15:10.493 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:10.493 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:10.493 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:10.493 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:10.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:10.493 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle-0x55da5e482960": { 2024-08-26T00:15:10.493 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-08-26T00:15:10.493 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-08-26T00:15:10.493 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-08-26T00:15:10.493 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 206291, 2024-08-26T00:15:10.494 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 442337389, 2024-08-26T00:15:10.494 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:10.494 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 206291, 2024-08-26T00:15:10.494 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-08-26T00:15:10.494 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-08-26T00:15:10.494 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 3968, 2024-08-26T00:15:10.494 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 442337389, 2024-08-26T00:15:10.494 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-08-26T00:15:10.494 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:10.494 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:10.494 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:10.494 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:10.494 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:10.495 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-08-26T00:15:10.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:10 smithi181 ceph-mon[22102]: pgmap v718: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-26T00:15:11.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:10 smithi043 ceph-mon[22091]: pgmap v718: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-26T00:15:11.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:10 smithi042 ceph-mon[17225]: pgmap v718: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-26T00:15:11.246 INFO:tasks.check_counter:Daemon mds.i mds.exported=266 2024-08-26T00:15:11.247 INFO:tasks.check_counter:Daemon mds.i mds.imported=190 2024-08-26T00:15:11.247 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=133 2024-08-26T00:15:11.247 DEBUG:tasks.check_counter:Getting stats from l 2024-08-26T00:15:11.247 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph daemon mds.l perf dump 2024-08-26T00:15:11.493 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.c/config 2024-08-26T00:15:11.995 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-08-26T00:15:11.995 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-08-26T00:15:11.995 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 0, 2024-08-26T00:15:11.995 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 2, 2024-08-26T00:15:11.995 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 0, 2024-08-26T00:15:11.995 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 0, 2024-08-26T00:15:11.996 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 4, 2024-08-26T00:15:11.996 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 0, 2024-08-26T00:15:11.996 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.000910892, 2024-08-26T00:15:11.996 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.000000000, 2024-08-26T00:15:11.996 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.000105357, 2024-08-26T00:15:11.996 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-26T00:15:11.996 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:15:11.996 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:11.996 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:11.996 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:11.996 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:11.996 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:15:11.996 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:11.997 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:11.997 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:11.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:11.997 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-26T00:15:11.997 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 0 2024-08-26T00:15:11.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:11.997 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-08-26T00:15:11.997 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 255, 2024-08-26T00:15:11.997 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 250, 2024-08-26T00:15:11.997 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 490560, 2024-08-26T00:15:11.997 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 153168, 2024-08-26T00:15:11.997 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 2, 2024-08-26T00:15:11.997 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 1, 2024-08-26T00:15:11.997 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.031381761, 2024-08-26T00:15:11.998 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.013519655, 2024-08-26T00:15:11.998 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.022603737, 2024-08-26T00:15:11.998 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-26T00:15:11.998 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:15:11.998 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 250, 2024-08-26T00:15:11.998 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.015693217, 2024-08-26T00:15:11.998 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000062772 2024-08-26T00:15:11.998 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:11.998 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:15:11.998 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:11.998 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:11.998 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:11.998 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:11.998 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 490560, 2024-08-26T00:15:11.999 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 153168 2024-08-26T00:15:11.999 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:11.999 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-08-26T00:15:11.999 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 2, 2024-08-26T00:15:11.999 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 190, 2024-08-26T00:15:11.999 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 320, 2024-08-26T00:15:11.999 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 190400, 2024-08-26T00:15:11.999 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 4, 2024-08-26T00:15:11.999 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 2, 2024-08-26T00:15:12.000 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.009492659, 2024-08-26T00:15:12.000 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.006830305, 2024-08-26T00:15:12.000 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.000733586, 2024-08-26T00:15:12.000 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-26T00:15:12.000 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-08-26T00:15:12.000 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 188, 2024-08-26T00:15:12.001 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.010035481, 2024-08-26T00:15:12.001 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000053380 2024-08-26T00:15:12.001 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:12.001 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-08-26T00:15:12.001 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:12.001 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:12.001 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:12.001 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:12.001 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-26T00:15:12.001 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 190400 2024-08-26T00:15:12.001 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:12.001 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-08-26T00:15:12.001 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 0, 2024-08-26T00:15:12.002 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-08-26T00:15:12.002 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:12.002 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-08-26T00:15:12.002 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-08-26T00:15:12.002 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-08-26T00:15:12.002 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-08-26T00:15:12.002 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-08-26T00:15:12.002 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-08-26T00:15:12.002 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-08-26T00:15:12.002 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-26T00:15:12.002 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-08-26T00:15:12.002 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-26T00:15:12.002 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-08-26T00:15:12.002 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-08-26T00:15:12.003 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-08-26T00:15:12.003 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-26T00:15:12.003 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-08-26T00:15:12.003 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-08-26T00:15:12.003 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-08-26T00:15:12.003 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-08-26T00:15:12.003 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-08-26T00:15:12.003 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-26T00:15:12.003 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-08-26T00:15:12.003 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-26T00:15:12.003 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-08-26T00:15:12.003 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-08-26T00:15:12.003 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-08-26T00:15:12.003 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-08-26T00:15:12.003 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-08-26T00:15:12.004 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-26T00:15:12.004 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-08-26T00:15:12.004 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-08-26T00:15:12.004 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-08-26T00:15:12.004 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-08-26T00:15:12.004 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-08-26T00:15:12.004 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-08-26T00:15:12.004 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-08-26T00:15:12.004 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-08-26T00:15:12.004 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-08-26T00:15:12.004 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 148660, 2024-08-26T00:15:12.004 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 29, 2024-08-26T00:15:12.004 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-08-26T00:15:12.004 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-08-26T00:15:12.005 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-08-26T00:15:12.005 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-08-26T00:15:12.005 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-08-26T00:15:12.005 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-08-26T00:15:12.005 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-08-26T00:15:12.005 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-08-26T00:15:12.005 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 0, 2024-08-26T00:15:12.005 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 0, 2024-08-26T00:15:12.005 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-08-26T00:15:12.005 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-08-26T00:15:12.005 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-08-26T00:15:12.005 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-08-26T00:15:12.005 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 928, 2024-08-26T00:15:12.006 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 2, 2024-08-26T00:15:12.006 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-08-26T00:15:12.006 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-08-26T00:15:12.006 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-08-26T00:15:12.006 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-08-26T00:15:12.006 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-08-26T00:15:12.006 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-26T00:15:12.007 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-08-26T00:15:12.007 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-08-26T00:15:12.007 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-08-26T00:15:12.007 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 253, 2024-08-26T00:15:12.007 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 452112, 2024-08-26T00:15:12.007 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-08-26T00:15:12.007 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 253, 2024-08-26T00:15:12.007 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-08-26T00:15:12.007 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-08-26T00:15:12.007 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 253, 2024-08-26T00:15:12.007 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 452112, 2024-08-26T00:15:12.007 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-08-26T00:15:12.007 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-08-26T00:15:12.007 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-08-26T00:15:12.007 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-08-26T00:15:12.008 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:12.008 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-08-26T00:15:12.008 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-08-26T00:15:12.677 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-08-26T00:15:12.677 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-08-26T00:15:12.677 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-08-26T00:15:12.677 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-26T00:15:12.688 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-26T00:15:12.688 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-26T00:15:12.688 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-26T00:15:12.730 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-26T00:15:12.730 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-26T00:15:12.809 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd blocklist ls 2024-08-26T00:15:12.901 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:12 smithi042 ceph-mon[17225]: pgmap v719: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-26T00:15:13.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:12 smithi043 ceph-mon[22091]: pgmap v719: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-26T00:15:13.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:12 smithi181 ceph-mon[22102]: pgmap v719: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-26T00:15:13.234 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:15:13.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.857+0000 7f5faae00640 1 -- 172.21.15.42:0/3427310539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fa410e160 msgr2=0x7f5fa41105b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:13.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.857+0000 7f5faae00640 1 --2- 172.21.15.42:0/3427310539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fa410e160 0x7f5fa41105b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009ca0 tx=0x7f5f9c02a950 comp rx=0 tx=0).stop 2024-08-26T00:15:13.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.857+0000 7f5faae00640 1 -- 172.21.15.42:0/3427310539 shutdown_connections 2024-08-26T00:15:13.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.857+0000 7f5faae00640 1 --2- 172.21.15.42:0/3427310539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fa410e160 0x7f5fa41105b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:13.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.857+0000 7f5faae00640 1 --2- 172.21.15.42:0/3427310539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fa4074ce0 0x7f5fa410dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:13.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.857+0000 7f5faae00640 1 --2- 172.21.15.42:0/3427310539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fa40743c0 0x7f5fa40747a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:13.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.857+0000 7f5faae00640 1 -- 172.21.15.42:0/3427310539 >> 172.21.15.42:0/3427310539 conn(0x7f5fa40fd660 msgr2=0x7f5fa40ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:15:13.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.857+0000 7f5faae00640 1 -- 172.21.15.42:0/3427310539 shutdown_connections 2024-08-26T00:15:13.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.857+0000 7f5faae00640 1 -- 172.21.15.42:0/3427310539 wait complete. 2024-08-26T00:15:13.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.858+0000 7f5faae00640 1 Processor -- start 2024-08-26T00:15:13.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.858+0000 7f5faae00640 1 -- start start 2024-08-26T00:15:13.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.859+0000 7f5faae00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fa40743c0 0x7f5fa419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:13.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.859+0000 7f5faae00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fa4074ce0 0x7f5fa419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:13.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.859+0000 7f5faae00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fa410e160 0x7f5fa419ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:13.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.859+0000 7f5faae00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa4113f60 con 0x7f5fa410e160 2024-08-26T00:15:13.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.859+0000 7f5faae00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa4113de0 con 0x7f5fa40743c0 2024-08-26T00:15:13.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.859+0000 7f5faae00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa41140e0 con 0x7f5fa4074ce0 2024-08-26T00:15:13.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.859+0000 7f5fa3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fa40743c0 0x7f5fa419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:13.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.859+0000 7f5fa8e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fa410e160 0x7f5fa419ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:13.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.859+0000 7f5f9be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fa4074ce0 0x7f5fa419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:13.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.859+0000 7f5fa3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fa40743c0 0x7f5fa419a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:56322/0 (socket says 172.21.15.42:56322) 2024-08-26T00:15:13.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.859+0000 7f5fa3e00640 1 -- 172.21.15.42:0/2278709297 learned_addr learned my addr 172.21.15.42:0/2278709297 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:15:13.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.860+0000 7f5fa3e00640 1 -- 172.21.15.42:0/2278709297 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fa4074ce0 msgr2=0x7f5fa419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:13.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.860+0000 7f5fa3e00640 1 --2- 172.21.15.42:0/2278709297 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fa4074ce0 0x7f5fa419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:13.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.860+0000 7f5fa3e00640 1 -- 172.21.15.42:0/2278709297 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fa410e160 msgr2=0x7f5fa419ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:13.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.860+0000 7f5fa3e00640 1 --2- 172.21.15.42:0/2278709297 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fa410e160 0x7f5fa419ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:13.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.860+0000 7f5fa3e00640 1 -- 172.21.15.42:0/2278709297 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa419f470 con 0x7f5fa40743c0 2024-08-26T00:15:13.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.860+0000 7f5fa3e00640 1 --2- 172.21.15.42:0/2278709297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fa40743c0 0x7f5fa419a4c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5f9400e9f0 tx=0x7f5f9400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:15:13.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.860+0000 7f5fa1600640 1 -- 172.21.15.42:0/2278709297 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9400cd80 con 0x7f5fa40743c0 2024-08-26T00:15:13.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.860+0000 7f5fa1600640 1 -- 172.21.15.42:0/2278709297 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f94005500 con 0x7f5fa40743c0 2024-08-26T00:15:13.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.860+0000 7f5faae00640 1 -- 172.21.15.42:0/2278709297 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fa419f760 con 0x7f5fa40743c0 2024-08-26T00:15:13.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.861+0000 7f5fa1600640 1 -- 172.21.15.42:0/2278709297 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f94010690 con 0x7f5fa40743c0 2024-08-26T00:15:13.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.861+0000 7f5faae00640 1 -- 172.21.15.42:0/2278709297 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fa41a7040 con 0x7f5fa40743c0 2024-08-26T00:15:13.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.862+0000 7f5faae00640 1 -- 172.21.15.42:0/2278709297 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fa40747a0 con 0x7f5fa40743c0 2024-08-26T00:15:13.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.864+0000 7f5fa1600640 1 -- 172.21.15.42:0/2278709297 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5f940046c0 con 0x7f5fa40743c0 2024-08-26T00:15:13.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.865+0000 7f5fa1600640 1 --2- 172.21.15.42:0/2278709297 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5f880a2b80 0x7f5f880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:13.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.865+0000 7f5fa1600640 1 -- 172.21.15.42:0/2278709297 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f5f940cf4a0 con 0x7f5fa40743c0 2024-08-26T00:15:13.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.866+0000 7f5f9be00640 1 --2- 172.21.15.42:0/2278709297 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5f880a2b80 0x7f5f880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:13.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.866+0000 7f5f9be00640 1 --2- 172.21.15.42:0/2278709297 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5f880a2b80 0x7f5f880a5040 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c0095f0 tx=0x7f5f8c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:15:13.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:13.867+0000 7f5fa1600640 1 -- 172.21.15.42:0/2278709297 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5f9409c3c0 con 0x7f5fa40743c0 2024-08-26T00:15:14.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:14.066+0000 7f5faae00640 1 -- 172.21.15.42:0/2278709297 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5fa419b820 con 0x7f5fa40743c0 2024-08-26T00:15:14.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:14.066+0000 7f5fa1600640 1 -- 172.21.15.42:0/2278709297 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v80) ==== 81+0+590 (secure 0 0 0) 0x7f5f9409bcc0 con 0x7f5fa40743c0 2024-08-26T00:15:14.068 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/3711239085 2024-08-26T23:53:05.122858+0000 2024-08-26T00:15:14.068 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6801/723045064 2024-08-26T23:53:32.406179+0000 2024-08-26T00:15:14.068 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/2983166615 2024-08-26T23:53:05.122858+0000 2024-08-26T00:15:14.068 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/2974122891 2024-08-26T23:53:32.406179+0000 2024-08-26T00:15:14.068 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/2980210051 2024-08-26T23:53:05.122858+0000 2024-08-26T00:15:14.068 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/4227793902 2024-08-26T23:53:32.406179+0000 2024-08-26T00:15:14.068 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6801/1517739376 2024-08-26T23:53:05.122858+0000 2024-08-26T00:15:14.068 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6800/723045064 2024-08-26T23:53:32.406179+0000 2024-08-26T00:15:14.069 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:0/1775009918 2024-08-26T23:53:32.406179+0000 2024-08-26T00:15:14.069 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6800/1517739376 2024-08-26T23:53:05.122858+0000 2024-08-26T00:15:14.069 INFO:teuthology.orchestra.run.smithi042.stderr:listed 10 entries 2024-08-26T00:15:14.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:14.068+0000 7f5faae00640 1 -- 172.21.15.42:0/2278709297 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5f880a2b80 msgr2=0x7f5f880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:14.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:14.068+0000 7f5faae00640 1 --2- 172.21.15.42:0/2278709297 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5f880a2b80 0x7f5f880a5040 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c0095f0 tx=0x7f5f8c005f90 comp rx=0 tx=0).stop 2024-08-26T00:15:14.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:14.069+0000 7f5faae00640 1 -- 172.21.15.42:0/2278709297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fa40743c0 msgr2=0x7f5fa419a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:14.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:14.069+0000 7f5faae00640 1 --2- 172.21.15.42:0/2278709297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fa40743c0 0x7f5fa419a4c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5f9400e9f0 tx=0x7f5f9400edf0 comp rx=0 tx=0).stop 2024-08-26T00:15:14.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:14.069+0000 7f5faae00640 1 -- 172.21.15.42:0/2278709297 shutdown_connections 2024-08-26T00:15:14.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:14.069+0000 7f5faae00640 1 --2- 172.21.15.42:0/2278709297 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f5f880a2b80 0x7f5f880a5040 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:14.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:14.069+0000 7f5faae00640 1 --2- 172.21.15.42:0/2278709297 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fa410e160 0x7f5fa419ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:14.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:14.069+0000 7f5faae00640 1 --2- 172.21.15.42:0/2278709297 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fa4074ce0 0x7f5fa419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:14.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:14.069+0000 7f5faae00640 1 --2- 172.21.15.42:0/2278709297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fa40743c0 0x7f5fa419a4c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:14.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:14.069+0000 7f5faae00640 1 -- 172.21.15.42:0/2278709297 >> 172.21.15.42:0/2278709297 conn(0x7f5fa40fd660 msgr2=0x7f5fa40fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:15:14.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:14.069+0000 7f5faae00640 1 -- 172.21.15.42:0/2278709297 shutdown_connections 2024-08-26T00:15:14.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:14.069+0000 7f5faae00640 1 -- 172.21.15.42:0/2278709297 wait complete. 2024-08-26T00:15:14.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:14 smithi042 ceph-mon[17225]: pgmap v720: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-26T00:15:14.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:14 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2278709297' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-26T00:15:15.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:14 smithi043 ceph-mon[22091]: pgmap v720: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-26T00:15:15.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:14 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/2278709297' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-26T00:15:15.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:14 smithi181 ceph-mon[22102]: pgmap v720: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-26T00:15:15.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:14 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/2278709297' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-26T00:15:15.092 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-26T00:15:15.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-26T00:15:15.092 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-26T00:15:15.277 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-08-26T00:15:15.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-26T00:15:15.277 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-26T00:15:15.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-26T00:15:15.359 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-08-26T00:15:15.439 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-26T00:15:15.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-26T00:15:15.440 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-26T00:15:15.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-26T00:15:15.573 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-08-26T00:15:15.875 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-26T00:15:15.876 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-26T00:15:15.876 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-26T00:15:15.912 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053405,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/12f0d9242f97e504e1e30bbef05dc324ebef07626bc9b28e31933bf623f46dfb/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/WXZKOPK4SKTQG2U3BMYM2UNUQK:/var/lib/containers/storage/overlay/l/LLJ6DBPF2VOIV2H5G3NX5XQZ46,upperdir=/var/lib/containers/storage/overlay/12f0d9242f97e504e1e30bbef05dc324ebef07626bc9b28e31933bf623f46dfb/diff,workdir=/var/lib/containers/storage/overlay/12f0d9242f97e504e1e30bbef05dc324ebef07626bc9b28e31933bf623f46dfb/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/f236a41712c7eb7de3c65d5d562a4d7a1be43b2d9932fef319ca811ad38a984a/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/WXZKOPK4SKTQG2U3BMYM2UNUQK:/var/lib/containers/storage/overlay/l/LLJ6DBPF2VOIV2H5G3NX5XQZ46,upperdir=/var/lib/containers/storage/overlay/f236a41712c7eb7de3c65d5d562a4d7a1be43b2d9932fef319ca811ad38a984a/diff,workdir=/var/lib/containers/storage/overlay/f236a41712c7eb7de3c65d5d562a4d7a1be43b2d9932fef319ca811ad38a984a/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/2b451251d6a0de8e65039871699a57246b2430a1f2e90483bd8f1fa5141d6998/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/WXZKOPK4SKTQG2U3BMYM2UNUQK:/var/lib/containers/storage/overlay/l/LLJ6DBPF2VOIV2H5G3NX5XQZ46,upperdir=/var/lib/containers/storage/overlay/2b451251d6a0de8e65039871699a57246b2430a1f2e90483bd8f1fa5141d6998/diff,workdir=/var/lib/containers/storage/overlay/2b451251d6a0de8e65039871699a57246b2430a1f2e90483bd8f1fa5141d6998/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/14fb6cc5ac70ce0d3f62348963c152d1b10da3f975fadc659f6c9953e3c6aeb6/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/WXZKOPK4SKTQG2U3BMYM2UNUQK:/var/lib/containers/storage/overlay/l/LLJ6DBPF2VOIV2H5G3NX5XQZ46,upperdir=/var/lib/containers/storage/overlay/14fb6cc5ac70ce0d3f62348963c152d1b10da3f975fadc659f6c9953e3c6aeb6/diff,workdir=/var/lib/containers/storage/overlay/14fb6cc5ac70ce0d3f62348963c152d1b10da3f975fadc659f6c9953e3c6aeb6/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/58d628cf11e4c2cae2d85480e08e29391d5aeb8a44adbe828222fb11eb73e928/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/WXZKOPK4SKTQG2U3BMYM2UNUQK:/var/lib/containers/storage/overlay/l/LLJ6DBPF2VOIV2H5G3NX5XQZ46,upperdir=/var/lib/containers/storage/overlay/58d628cf11e4c2cae2d85480e08e29391d5aeb8a44adbe828222fb11eb73e928/diff,workdir=/var/lib/containers/storage/overlay/58d628cf11e4c2cae2d85480e08e29391d5aeb8a44adbe828222fb11eb73e928/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/750c424941c3b0e93398043aaf6adf17ece09c989db4af3928d87c69fb390688/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/WXZKOPK4SKTQG2U3BMYM2UNUQK:/var/lib/containers/storage/overlay/l/LLJ6DBPF2VOIV2H5G3NX5XQZ46,upperdir=/var/lib/containers/storage/overlay/750c424941c3b0e93398043aaf6adf17ece09c989db4af3928d87c69fb390688/diff,workdir=/var/lib/containers/storage/overlay/750c424941c3b0e93398043aaf6adf17ece09c989db4af3928d87c69fb390688/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/7582b9db187f3cbca0fce7d472e3033155dd2039e934fc6ccf7df1eb498bf9d3/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/WXZKOPK4SKTQG2U3BMYM2UNUQK:/var/lib/containers/storage/overlay/l/LLJ6DBPF2VOIV2H5G3NX5XQZ46,upperdir=/var/lib/containers/storage/overlay/7582b9db187f3cbca0fce7d472e3033155dd2039e934fc6ccf7df1eb498bf9d3/diff,workdir=/var/lib/containers/storage/overlay/7582b9db187f3cbca0fce7d472e3033155dd2039e934fc6ccf7df1eb498bf9d3/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/ae66e722b5bfd932abb14d268ccdc6ff6c67488f04802b2de926effa8ea332d8/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/WXZKOPK4SKTQG2U3BMYM2UNUQK:/var/lib/containers/storage/overlay/l/LLJ6DBPF2VOIV2H5G3NX5XQZ46,upperdir=/var/lib/containers/storage/overlay/ae66e722b5bfd932abb14d268ccdc6ff6c67488f04802b2de926effa8ea332d8/diff,workdir=/var/lib/containers/storage/overlay/ae66e722b5bfd932abb14d268ccdc6ff6c67488f04802b2de926effa8ea332d8/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/5bd8e30a0730edb8c4f85e2c334a0a78d38d3ea9cb70da90a7331d28c05be30a/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/WXZKOPK4SKTQG2U3BMYM2UNUQK:/var/lib/containers/storage/overlay/l/LLJ6DBPF2VOIV2H5G3NX5XQZ46,upperdir=/var/lib/containers/storage/overlay/5bd8e30a0730edb8c4f85e2c334a0a78d38d3ea9cb70da90a7331d28c05be30a/diff,workdir=/var/lib/containers/storage/overlay/5bd8e30a0730edb8c4f85e2c334a0a78d38d3ea9cb70da90a7331d28c05be30a/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/a3eba256a823770ef036b585ace489e1197da921166649bd97c9f7e198220db9/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/WXZKOPK4SKTQG2U3BMYM2UNUQK:/var/lib/containers/storage/overlay/l/LLJ6DBPF2VOIV2H5G3NX5XQZ46,upperdir=/var/lib/containers/storage/overlay/a3eba256a823770ef036b585ace489e1197da921166649bd97c9f7e198220db9/diff,workdir=/var/lib/containers/storage/overlay/a3eba256a823770ef036b585ace489e1197da921166649bd97c9f7e198220db9/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 2024-08-26T00:15:15.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-26T00:15:15.913 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-08-26T00:15:15.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-26T00:15:15.988 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-08-26T00:15:16.089 INFO:teuthology.orchestra.run.smithi042.stderr:Cannot find device "ceph-brx" 2024-08-26T00:15:16.092 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-26T00:15:16.092 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-08-26T00:15:16.106 INFO:tasks.cephadm:Teardown begin 2024-08-26T00:15:16.106 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-26T00:15:16.106 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:15:16.486 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:15:16.878 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:16 smithi042 ceph-mon[17225]: pgmap v721: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-26T00:15:17.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:16 smithi043 ceph-mon[22091]: pgmap v721: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-26T00:15:17.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:16 smithi181 ceph-mon[22102]: pgmap v721: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-26T00:15:17.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.141+0000 7f6522200640 1 -- 172.21.15.42:0/1178756157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f651c109c00 msgr2=0x7f651c109fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:17.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.141+0000 7f6522200640 1 --2- 172.21.15.42:0/1178756157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f651c109c00 0x7f651c109fe0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f650c009930 tx=0x7f650c02a420 comp rx=0 tx=0).stop 2024-08-26T00:15:17.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.141+0000 7f6522200640 1 -- 172.21.15.42:0/1178756157 shutdown_connections 2024-08-26T00:15:17.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.141+0000 7f6522200640 1 --2- 172.21.15.42:0/1178756157 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f651c1044f0 0x7f651c1109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:17.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.141+0000 7f6522200640 1 --2- 172.21.15.42:0/1178756157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f651c103b50 0x7f651c103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:17.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.141+0000 7f6522200640 1 --2- 172.21.15.42:0/1178756157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f651c109c00 0x7f651c109fe0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:17.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.141+0000 7f6522200640 1 -- 172.21.15.42:0/1178756157 >> 172.21.15.42:0/1178756157 conn(0x7f651c0ff830 msgr2=0x7f651c101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:15:17.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.141+0000 7f6522200640 1 -- 172.21.15.42:0/1178756157 shutdown_connections 2024-08-26T00:15:17.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.141+0000 7f6522200640 1 -- 172.21.15.42:0/1178756157 wait complete. 2024-08-26T00:15:17.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.142+0000 7f6522200640 1 Processor -- start 2024-08-26T00:15:17.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.143+0000 7f6522200640 1 -- start start 2024-08-26T00:15:17.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.143+0000 7f6522200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f651c103b50 0x7f651c110830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:17.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.143+0000 7f6522200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f651c1044f0 0x7f651c10d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:17.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.143+0000 7f6522200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f651c109c00 0x7f651c10de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:17.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.143+0000 7f6522200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f651c113fb0 con 0x7f651c1044f0 2024-08-26T00:15:17.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.143+0000 7f6522200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f651c113e30 con 0x7f651c109c00 2024-08-26T00:15:17.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.143+0000 7f6522200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f651c114130 con 0x7f651c103b50 2024-08-26T00:15:17.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.143+0000 7f6512a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f651c1044f0 0x7f651c10d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:17.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.143+0000 7f651b400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f651c103b50 0x7f651c110830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:17.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.143+0000 7f6512a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f651c1044f0 0x7f651c10d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41630/0 (socket says 172.21.15.42:41630) 2024-08-26T00:15:17.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.143+0000 7f6512a00640 1 -- 172.21.15.42:0/1143638571 learned_addr learned my addr 172.21.15.42:0/1143638571 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:15:17.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.143+0000 7f651be00640 1 --2- 172.21.15.42:0/1143638571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f651c109c00 0x7f651c10de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:17.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.144+0000 7f6512a00640 1 -- 172.21.15.42:0/1143638571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f651c103b50 msgr2=0x7f651c110830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:17.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.144+0000 7f6512a00640 1 --2- 172.21.15.42:0/1143638571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f651c103b50 0x7f651c110830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:17.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.144+0000 7f6512a00640 1 -- 172.21.15.42:0/1143638571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f651c109c00 msgr2=0x7f651c10de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:17.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.144+0000 7f6512a00640 1 --2- 172.21.15.42:0/1143638571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f651c109c00 0x7f651c10de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:17.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.144+0000 7f6512a00640 1 -- 172.21.15.42:0/1143638571 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f651c10e6b0 con 0x7f651c1044f0 2024-08-26T00:15:17.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.144+0000 7f651b400640 1 --2- 172.21.15.42:0/1143638571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f651c103b50 0x7f651c110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:15:17.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.144+0000 7f651be00640 1 --2- 172.21.15.42:0/1143638571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f651c109c00 0x7f651c10de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:15:17.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.144+0000 7f6512a00640 1 --2- 172.21.15.42:0/1143638571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f651c1044f0 0x7f651c10d8e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f650400e9f0 tx=0x7f650400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:15:17.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.144+0000 7f6518c00640 1 -- 172.21.15.42:0/1143638571 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650400ccc0 con 0x7f651c1044f0 2024-08-26T00:15:17.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.144+0000 7f6518c00640 1 -- 172.21.15.42:0/1143638571 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f650400ce60 con 0x7f651c1044f0 2024-08-26T00:15:17.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.144+0000 7f6518c00640 1 -- 172.21.15.42:0/1143638571 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6504010690 con 0x7f651c1044f0 2024-08-26T00:15:17.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.144+0000 7f6522200640 1 -- 172.21.15.42:0/1143638571 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f651c1aad50 con 0x7f651c1044f0 2024-08-26T00:15:17.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.145+0000 7f6522200640 1 -- 172.21.15.42:0/1143638571 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f651c1ab1e0 con 0x7f651c1044f0 2024-08-26T00:15:17.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.146+0000 7f6522200640 1 -- 172.21.15.42:0/1143638571 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f651c105200 con 0x7f651c1044f0 2024-08-26T00:15:17.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.148+0000 7f6518c00640 1 -- 172.21.15.42:0/1143638571 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f65040046c0 con 0x7f651c1044f0 2024-08-26T00:15:17.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.149+0000 7f6518c00640 1 --2- 172.21.15.42:0/1143638571 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f65000a2b80 0x7f65000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:17.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.150+0000 7f6518c00640 1 -- 172.21.15.42:0/1143638571 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f65040cf4e0 con 0x7f651c1044f0 2024-08-26T00:15:17.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.150+0000 7f651b400640 1 --2- 172.21.15.42:0/1143638571 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f65000a2b80 0x7f65000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:17.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.151+0000 7f651b400640 1 --2- 172.21.15.42:0/1143638571 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f65000a2b80 0x7f65000a5040 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f650c006010 tx=0x7f650c031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:15:17.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.154+0000 7f6518c00640 1 -- 172.21.15.42:0/1143638571 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f650409c400 con 0x7f651c1044f0 2024-08-26T00:15:17.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.374+0000 7f6522200640 1 -- 172.21.15.42:0/1143638571 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f651c02d6a0 con 0x7f651c1044f0 2024-08-26T00:15:17.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.375+0000 7f6518c00640 1 -- 172.21.15.42:0/1143638571 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11919 (secure 0 0 0) 0x7f650409bd00 con 0x7f651c1044f0 2024-08-26T00:15:17.377 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:15:17.377 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":32,"btime":"2024-08-26T00:12:35:857942+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3168581452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3168581452},{"type":"v1","addr":"172.21.15.42:6839","nonce":3168581452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/3533492491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":3533492491},{"type":"v1","addr":"172.21.15.42:6841","nonce":3533492491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-26T00:00:30.169633+0000","modified":"2024-08-26T00:12:35.440797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24532,"mds_1":24527,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":189,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6839/2653014277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2653014277},{"type":"v1","addr":"172.21.15.43:6839","nonce":2653014277}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24532,"qdb_cluster":[24532,24527,24514]},"id":1}]} 2024-08-26T00:15:17.378 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 32 2024-08-26T00:15:17.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.377+0000 7f6522200640 1 -- 172.21.15.42:0/1143638571 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f65000a2b80 msgr2=0x7f65000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:17.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.377+0000 7f6522200640 1 --2- 172.21.15.42:0/1143638571 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f65000a2b80 0x7f65000a5040 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f650c006010 tx=0x7f650c031510 comp rx=0 tx=0).stop 2024-08-26T00:15:17.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.377+0000 7f6522200640 1 -- 172.21.15.42:0/1143638571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f651c1044f0 msgr2=0x7f651c10d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:17.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.377+0000 7f6522200640 1 --2- 172.21.15.42:0/1143638571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f651c1044f0 0x7f651c10d8e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f650400e9f0 tx=0x7f650400edf0 comp rx=0 tx=0).stop 2024-08-26T00:15:17.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.377+0000 7f6522200640 1 -- 172.21.15.42:0/1143638571 shutdown_connections 2024-08-26T00:15:17.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.377+0000 7f6522200640 1 --2- 172.21.15.42:0/1143638571 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f65000a2b80 0x7f65000a5040 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:17.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.377+0000 7f6522200640 1 --2- 172.21.15.42:0/1143638571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f651c109c00 0x7f651c10de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:17.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.377+0000 7f6522200640 1 --2- 172.21.15.42:0/1143638571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f651c1044f0 0x7f651c10d8e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:17.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.377+0000 7f6522200640 1 --2- 172.21.15.42:0/1143638571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f651c103b50 0x7f651c110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:17.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.377+0000 7f6522200640 1 -- 172.21.15.42:0/1143638571 >> 172.21.15.42:0/1143638571 conn(0x7f651c0ff830 msgr2=0x7f651c100f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:15:17.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.377+0000 7f6522200640 1 -- 172.21.15.42:0/1143638571 shutdown_connections 2024-08-26T00:15:17.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:17.377+0000 7f6522200640 1 -- 172.21.15.42:0/1143638571 wait complete. 2024-08-26T00:15:18.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:17 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1143638571' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:15:18.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:17 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1143638571' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:15:18.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:17 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1143638571' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:15:18.290 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs dump --format=json 2024-08-26T00:15:18.671 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:15:18.910 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:18 smithi043 ceph-mon[22091]: pgmap v722: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-26T00:15:18.942 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:18 smithi042 ceph-mon[17225]: pgmap v722: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-26T00:15:19.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:18 smithi181 ceph-mon[22102]: pgmap v722: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-26T00:15:19.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.208+0000 7f9fa4600640 1 -- 172.21.15.42:0/169442050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f9c109c00 msgr2=0x7f9f9c109fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:19.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.208+0000 7f9fa4600640 1 --2- 172.21.15.42:0/169442050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f9c109c00 0x7f9f9c109fe0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009900 tx=0x7f9f9002a3f0 comp rx=0 tx=0).stop 2024-08-26T00:15:19.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.208+0000 7f9fa4600640 1 -- 172.21.15.42:0/169442050 shutdown_connections 2024-08-26T00:15:19.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.208+0000 7f9fa4600640 1 --2- 172.21.15.42:0/169442050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f9c1044f0 0x7f9f9c1109d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:19.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.208+0000 7f9fa4600640 1 --2- 172.21.15.42:0/169442050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f9c103b50 0x7f9f9c103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:19.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.208+0000 7f9fa4600640 1 --2- 172.21.15.42:0/169442050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f9c109c00 0x7f9f9c109fe0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:19.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.208+0000 7f9fa4600640 1 -- 172.21.15.42:0/169442050 >> 172.21.15.42:0/169442050 conn(0x7f9f9c0ff830 msgr2=0x7f9f9c101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:15:19.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.208+0000 7f9fa4600640 1 -- 172.21.15.42:0/169442050 shutdown_connections 2024-08-26T00:15:19.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.208+0000 7f9fa4600640 1 -- 172.21.15.42:0/169442050 wait complete. 2024-08-26T00:15:19.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.209+0000 7f9fa4600640 1 Processor -- start 2024-08-26T00:15:19.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.209+0000 7f9fa4600640 1 -- start start 2024-08-26T00:15:19.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.210+0000 7f9fa4600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f9c103b50 0x7f9f9c19a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:19.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.210+0000 7f9fa4600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f9c1044f0 0x7f9f9c19a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:19.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.210+0000 7f9fa4600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f9c109c00 0x7f9f9c19ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:19.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.210+0000 7f9fa4600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9c113fb0 con 0x7f9f9c103b50 2024-08-26T00:15:19.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.210+0000 7f9fa4600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9c113e30 con 0x7f9f9c1044f0 2024-08-26T00:15:19.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.210+0000 7f9fa4600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9c114130 con 0x7f9f9c109c00 2024-08-26T00:15:19.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.210+0000 7f9fa1200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f9c1044f0 0x7f9f9c19a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:19.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.210+0000 7f9fa1c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f9c103b50 0x7f9f9c19a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:19.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.210+0000 7f9fa1200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f9c1044f0 0x7f9f9c19a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:50612/0 (socket says 172.21.15.42:50612) 2024-08-26T00:15:19.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.210+0000 7f9fa1200640 1 -- 172.21.15.42:0/2159531729 learned_addr learned my addr 172.21.15.42:0/2159531729 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:15:19.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.210+0000 7f9fa2600640 1 --2- 172.21.15.42:0/2159531729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f9c109c00 0x7f9f9c19ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:19.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.211+0000 7f9fa1200640 1 -- 172.21.15.42:0/2159531729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f9c109c00 msgr2=0x7f9f9c19ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:19.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.211+0000 7f9fa1200640 1 --2- 172.21.15.42:0/2159531729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f9c109c00 0x7f9f9c19ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:19.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.211+0000 7f9fa1200640 1 -- 172.21.15.42:0/2159531729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f9c103b50 msgr2=0x7f9f9c19a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:19.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.211+0000 7f9fa1200640 1 --2- 172.21.15.42:0/2159531729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f9c103b50 0x7f9f9c19a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:19.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.211+0000 7f9fa1200640 1 -- 172.21.15.42:0/2159531729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f9c19f360 con 0x7f9f9c1044f0 2024-08-26T00:15:19.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.211+0000 7f9fa1200640 1 --2- 172.21.15.42:0/2159531729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f9c1044f0 0x7f9f9c19a8f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800e9f0 tx=0x7f9f8800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:15:19.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.211+0000 7f9f9a000640 1 -- 172.21.15.42:0/2159531729 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8800ccc0 con 0x7f9f9c1044f0 2024-08-26T00:15:19.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.211+0000 7f9fa4600640 1 -- 172.21.15.42:0/2159531729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f9c19f650 con 0x7f9f9c1044f0 2024-08-26T00:15:19.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.211+0000 7f9f9a000640 1 -- 172.21.15.42:0/2159531729 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f8800ce60 con 0x7f9f9c1044f0 2024-08-26T00:15:19.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.211+0000 7f9f9a000640 1 -- 172.21.15.42:0/2159531729 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f88010690 con 0x7f9f9c1044f0 2024-08-26T00:15:19.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.211+0000 7f9fa4600640 1 -- 172.21.15.42:0/2159531729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f9c1a6f30 con 0x7f9f9c1044f0 2024-08-26T00:15:19.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.212+0000 7f9fa4600640 1 -- 172.21.15.42:0/2159531729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f9c103fb0 con 0x7f9f9c1044f0 2024-08-26T00:15:19.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.214+0000 7f9f9a000640 1 -- 172.21.15.42:0/2159531729 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9f880046c0 con 0x7f9f9c1044f0 2024-08-26T00:15:19.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.215+0000 7f9f9a000640 1 --2- 172.21.15.42:0/2159531729 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9f840a2b80 0x7f9f840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:19.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.216+0000 7f9f9a000640 1 -- 172.21.15.42:0/2159531729 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f9f880cf440 con 0x7f9f9c1044f0 2024-08-26T00:15:19.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.216+0000 7f9fa1c00640 1 --2- 172.21.15.42:0/2159531729 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9f840a2b80 0x7f9f840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:19.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.216+0000 7f9fa1c00640 1 --2- 172.21.15.42:0/2159531729 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9f840a2b80 0x7f9f840a5040 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9f90000c00 tx=0x7f9f90005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:15:19.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.222+0000 7f9f9a000640 1 -- 172.21.15.42:0/2159531729 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f9f8809c360 con 0x7f9f9c1044f0 2024-08-26T00:15:19.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.448+0000 7f9fa4600640 1 -- 172.21.15.42:0/2159531729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f9c02d6a0 con 0x7f9f9c1044f0 2024-08-26T00:15:19.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.449+0000 7f9f9a000640 1 -- 172.21.15.42:0/2159531729 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11919 (secure 0 0 0) 0x7f9f8809bc60 con 0x7f9f9c1044f0 2024-08-26T00:15:19.451 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:15:19.451 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":32,"btime":"2024-08-26T00:12:35:857942+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1208862457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1208862457},{"type":"v1","addr":"172.21.15.42:6835","nonce":1208862457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14469,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1832026661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1832026661},{"type":"v1","addr":"172.21.15.42:6837","nonce":1832026661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6839/3168581452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6838","nonce":3168581452},{"type":"v1","addr":"172.21.15.42:6839","nonce":3168581452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6841/3533492491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":3533492491},{"type":"v1","addr":"172.21.15.42:6841","nonce":3533492491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6833/368996647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":368996647},{"type":"v1","addr":"172.21.15.43:6833","nonce":368996647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2147486121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2147486121},{"type":"v1","addr":"172.21.15.181:6833","nonce":2147486121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-26T00:00:30.169633+0000","modified":"2024-08-26T00:12:35.440797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24532,"mds_1":24527,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6835/4195804691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4195804691},{"type":"v1","addr":"172.21.15.43:6835","nonce":4195804691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6837/2817851173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2817851173},{"type":"v1","addr":"172.21.15.43:6837","nonce":2817851173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1496959020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1496959020},{"type":"v1","addr":"172.21.15.181:6835","nonce":1496959020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":189,"addr":"172.21.15.181:6837/3332104552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3332104552},{"type":"v1","addr":"172.21.15.181:6837","nonce":3332104552}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6839/2653014277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":2653014277},{"type":"v1","addr":"172.21.15.43:6839","nonce":2653014277}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.181:6839/351429985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":351429985},{"type":"v1","addr":"172.21.15.181:6839","nonce":351429985}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24532,"qdb_cluster":[24532,24527,24514]},"id":1}]} 2024-08-26T00:15:19.451 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 32 2024-08-26T00:15:19.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.451+0000 7f9fa4600640 1 -- 172.21.15.42:0/2159531729 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9f840a2b80 msgr2=0x7f9f840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:19.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.451+0000 7f9fa4600640 1 --2- 172.21.15.42:0/2159531729 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9f840a2b80 0x7f9f840a5040 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9f90000c00 tx=0x7f9f90005b50 comp rx=0 tx=0).stop 2024-08-26T00:15:19.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.451+0000 7f9fa4600640 1 -- 172.21.15.42:0/2159531729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f9c1044f0 msgr2=0x7f9f9c19a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:19.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.451+0000 7f9fa4600640 1 --2- 172.21.15.42:0/2159531729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f9c1044f0 0x7f9f9c19a8f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800e9f0 tx=0x7f9f8800edf0 comp rx=0 tx=0).stop 2024-08-26T00:15:19.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.452+0000 7f9fa4600640 1 -- 172.21.15.42:0/2159531729 shutdown_connections 2024-08-26T00:15:19.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.452+0000 7f9fa4600640 1 --2- 172.21.15.42:0/2159531729 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f9f840a2b80 0x7f9f840a5040 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:19.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.452+0000 7f9fa4600640 1 --2- 172.21.15.42:0/2159531729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f9c109c00 0x7f9f9c19ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:19.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.452+0000 7f9fa4600640 1 --2- 172.21.15.42:0/2159531729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f9c1044f0 0x7f9f9c19a8f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:19.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.452+0000 7f9fa4600640 1 --2- 172.21.15.42:0/2159531729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f9c103b50 0x7f9f9c19a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:19.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.452+0000 7f9fa4600640 1 -- 172.21.15.42:0/2159531729 >> 172.21.15.42:0/2159531729 conn(0x7f9f9c0ff830 msgr2=0x7f9f9c100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:15:19.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.452+0000 7f9fa4600640 1 -- 172.21.15.42:0/2159531729 shutdown_connections 2024-08-26T00:15:19.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:19.452+0000 7f9fa4600640 1 -- 172.21.15.42:0/2159531729 wait complete. 2024-08-26T00:15:19.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:19 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2159531729' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:15:19.905 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:19 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/2159531729' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:15:20.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:19 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/2159531729' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-26T00:15:20.370 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd dump --format=json 2024-08-26T00:15:20.750 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:15:20.890 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:20 smithi042 ceph-mon[17225]: pgmap v723: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 682 B/s wr, 7 op/s 2024-08-26T00:15:21.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:20 smithi043 ceph-mon[22091]: pgmap v723: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 682 B/s wr, 7 op/s 2024-08-26T00:15:21.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:20 smithi181 ceph-mon[22102]: pgmap v723: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 682 B/s wr, 7 op/s 2024-08-26T00:15:21.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.299+0000 7f4736c00640 1 -- 172.21.15.42:0/91930238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4730104310 msgr2=0x7f4730110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:21.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.299+0000 7f4736c00640 1 --2- 172.21.15.42:0/91930238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4730104310 0x7f4730110840 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4728009cd0 tx=0x7f472802a8e0 comp rx=0 tx=0).stop 2024-08-26T00:15:21.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.299+0000 7f4736c00640 1 -- 172.21.15.42:0/91930238 shutdown_connections 2024-08-26T00:15:21.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.299+0000 7f4736c00640 1 --2- 172.21.15.42:0/91930238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4730104310 0x7f4730110840 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:21.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.299+0000 7f4736c00640 1 --2- 172.21.15.42:0/91930238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4730103970 0x7f4730103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:21.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.299+0000 7f4736c00640 1 --2- 172.21.15.42:0/91930238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4730109970 0x7f4730109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:21.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.299+0000 7f4736c00640 1 -- 172.21.15.42:0/91930238 >> 172.21.15.42:0/91930238 conn(0x7f47300ff670 msgr2=0x7f4730101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:15:21.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.299+0000 7f4736c00640 1 -- 172.21.15.42:0/91930238 shutdown_connections 2024-08-26T00:15:21.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.299+0000 7f4736c00640 1 -- 172.21.15.42:0/91930238 wait complete. 2024-08-26T00:15:21.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.300+0000 7f4736c00640 1 Processor -- start 2024-08-26T00:15:21.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.300+0000 7f4736c00640 1 -- start start 2024-08-26T00:15:21.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.301+0000 7f4736c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4730103970 0x7f473019a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:21.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.301+0000 7f4736c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4730104310 0x7f473019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:21.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.301+0000 7f4736c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4730109970 0x7f473019eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:21.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.301+0000 7f4736c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4730113d70 con 0x7f4730103970 2024-08-26T00:15:21.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.301+0000 7f4736c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4730113bf0 con 0x7f4730104310 2024-08-26T00:15:21.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.301+0000 7f4736c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4730113ef0 con 0x7f4730109970 2024-08-26T00:15:21.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.301+0000 7f4736200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4730109970 0x7f473019eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:21.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.301+0000 7f4735800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4730103970 0x7f473019a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:21.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.301+0000 7f4736200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4730109970 0x7f473019eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:57732/0 (socket says 172.21.15.42:57732) 2024-08-26T00:15:21.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.301+0000 7f4736200640 1 -- 172.21.15.42:0/698854480 learned_addr learned my addr 172.21.15.42:0/698854480 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:15:21.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.301+0000 7f4734e00640 1 --2- 172.21.15.42:0/698854480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4730104310 0x7f473019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:21.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.302+0000 7f4736200640 1 -- 172.21.15.42:0/698854480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4730104310 msgr2=0x7f473019a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:21.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.302+0000 7f4736200640 1 --2- 172.21.15.42:0/698854480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4730104310 0x7f473019a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:21.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.302+0000 7f4736200640 1 -- 172.21.15.42:0/698854480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4730103970 msgr2=0x7f473019a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:21.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.302+0000 7f4736200640 1 --2- 172.21.15.42:0/698854480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4730103970 0x7f473019a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:21.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.302+0000 7f4736200640 1 -- 172.21.15.42:0/698854480 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473019f1e0 con 0x7f4730109970 2024-08-26T00:15:21.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.302+0000 7f4734e00640 1 --2- 172.21.15.42:0/698854480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4730104310 0x7f473019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:15:21.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.302+0000 7f4736200640 1 --2- 172.21.15.42:0/698854480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4730109970 0x7f473019eb00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4728005cc0 tx=0x7f47280093d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:15:21.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.302+0000 7f472e000640 1 -- 172.21.15.42:0/698854480 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728003e00 con 0x7f4730109970 2024-08-26T00:15:21.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.302+0000 7f4736c00640 1 -- 172.21.15.42:0/698854480 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f473019f470 con 0x7f4730109970 2024-08-26T00:15:21.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.303+0000 7f472e000640 1 -- 172.21.15.42:0/698854480 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4728004520 con 0x7f4730109970 2024-08-26T00:15:21.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.303+0000 7f472e000640 1 -- 172.21.15.42:0/698854480 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728030db0 con 0x7f4730109970 2024-08-26T00:15:21.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.303+0000 7f4736c00640 1 -- 172.21.15.42:0/698854480 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47301a6db0 con 0x7f4730109970 2024-08-26T00:15:21.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.304+0000 7f4736c00640 1 -- 172.21.15.42:0/698854480 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4730103dd0 con 0x7f4730109970 2024-08-26T00:15:21.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.306+0000 7f472e000640 1 -- 172.21.15.42:0/698854480 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f47280046d0 con 0x7f4730109970 2024-08-26T00:15:21.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.307+0000 7f472e000640 1 --2- 172.21.15.42:0/698854480 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47180a2b80 0x7f47180a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:21.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.307+0000 7f472e000640 1 -- 172.21.15.42:0/698854480 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f472802e030 con 0x7f4730109970 2024-08-26T00:15:21.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.307+0000 7f4735800640 1 --2- 172.21.15.42:0/698854480 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47180a2b80 0x7f47180a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:21.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.308+0000 7f4735800640 1 --2- 172.21.15.42:0/698854480 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47180a2b80 0x7f47180a5040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4724009b50 tx=0x7f4724005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:15:21.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.309+0000 7f472e000640 1 -- 172.21.15.42:0/698854480 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f472804b060 con 0x7f4730109970 2024-08-26T00:15:21.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.495+0000 7f4736c00640 1 -- 172.21.15.42:0/698854480 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f473019b590 con 0x7f4730109970 2024-08-26T00:15:21.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.497+0000 7f472e000640 1 -- 172.21.15.42:0/698854480 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22625 (secure 0 0 0) 0x7f473019b590 con 0x7f4730109970 2024-08-26T00:15:21.498 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-26T00:15:21.499 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":80,"fsid":"f89d317a-633c-11ef-bcd2-c7b262605968","created":"2024-08-25T23:52:39.598509+0000","modified":"2024-08-26T00:01:33.588911+0000","last_up_change":"2024-08-25T23:59:35.047575+0000","last_in_change":"2024-08-25T23:59:12.796940+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-25T23:55:51.022219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-26T00:00:25.606536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-26T00:00:28.322822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"980d8635-bca1-4c5a-b78e-4b44f9315d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6803","nonce":2657450248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6805","nonce":2657450248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6809","nonce":2657450248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2657450248},{"type":"v1","addr":"172.21.15.42:6807","nonce":2657450248}]},"public_addr":"172.21.15.42:6803/2657450248","cluster_addr":"172.21.15.42:6805/2657450248","heartbeat_back_addr":"172.21.15.42:6809/2657450248","heartbeat_front_addr":"172.21.15.42:6807/2657450248","state":["exists","up"]},{"osd":1,"uuid":"e5f8dc3b-876a-4bdd-b6b0-b0d99d098d95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6801","nonce":2396081001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6803","nonce":2396081001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6807","nonce":2396081001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":2396081001},{"type":"v1","addr":"172.21.15.43:6805","nonce":2396081001}]},"public_addr":"172.21.15.43:6801/2396081001","cluster_addr":"172.21.15.43:6803/2396081001","heartbeat_back_addr":"172.21.15.43:6807/2396081001","heartbeat_front_addr":"172.21.15.43:6805/2396081001","state":["exists","up"]},{"osd":2,"uuid":"06eb25af-8e3d-4f90-bc24-28a9bc224c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6801","nonce":189987070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6803","nonce":189987070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6807","nonce":189987070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":189987070},{"type":"v1","addr":"172.21.15.181:6805","nonce":189987070}]},"public_addr":"172.21.15.181:6801/189987070","cluster_addr":"172.21.15.181:6803/189987070","heartbeat_back_addr":"172.21.15.181:6807/189987070","heartbeat_front_addr":"172.21.15.181:6805/189987070","state":["exists","up"]},{"osd":3,"uuid":"c78dbc49-b5c7-4f82-be36-c76a89496520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6811","nonce":251017896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6813","nonce":251017896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6817","nonce":251017896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":251017896},{"type":"v1","addr":"172.21.15.42:6815","nonce":251017896}]},"public_addr":"172.21.15.42:6811/251017896","cluster_addr":"172.21.15.42:6813/251017896","heartbeat_back_addr":"172.21.15.42:6817/251017896","heartbeat_front_addr":"172.21.15.42:6815/251017896","state":["exists","up"]},{"osd":4,"uuid":"ba633f66-25af-492f-bbf2-76032a4cd3d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6809","nonce":1315420796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6811","nonce":1315420796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6815","nonce":1315420796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":1315420796},{"type":"v1","addr":"172.21.15.43:6813","nonce":1315420796}]},"public_addr":"172.21.15.43:6809/1315420796","cluster_addr":"172.21.15.43:6811/1315420796","heartbeat_back_addr":"172.21.15.43:6815/1315420796","heartbeat_front_addr":"172.21.15.43:6813/1315420796","state":["exists","up"]},{"osd":5,"uuid":"04e47ad9-21ba-43da-9793-d5cf83150dc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6809","nonce":246971403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6811","nonce":246971403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6815","nonce":246971403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":246971403},{"type":"v1","addr":"172.21.15.181:6813","nonce":246971403}]},"public_addr":"172.21.15.181:6809/246971403","cluster_addr":"172.21.15.181:6811/246971403","heartbeat_back_addr":"172.21.15.181:6815/246971403","heartbeat_front_addr":"172.21.15.181:6813/246971403","state":["exists","up"]},{"osd":6,"uuid":"f48161cd-bc44-4d99-8248-1bb845111129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6819","nonce":2910656480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6821","nonce":2910656480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6825","nonce":2910656480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2910656480},{"type":"v1","addr":"172.21.15.42:6823","nonce":2910656480}]},"public_addr":"172.21.15.42:6819/2910656480","cluster_addr":"172.21.15.42:6821/2910656480","heartbeat_back_addr":"172.21.15.42:6825/2910656480","heartbeat_front_addr":"172.21.15.42:6823/2910656480","state":["exists","up"]},{"osd":7,"uuid":"65470b06-b14d-4d8e-9bcb-e6927c37fda5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6817","nonce":624542778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6819","nonce":624542778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6823","nonce":624542778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":624542778},{"type":"v1","addr":"172.21.15.43:6821","nonce":624542778}]},"public_addr":"172.21.15.43:6817/624542778","cluster_addr":"172.21.15.43:6819/624542778","heartbeat_back_addr":"172.21.15.43:6823/624542778","heartbeat_front_addr":"172.21.15.43:6821/624542778","state":["exists","up"]},{"osd":8,"uuid":"1f4c9152-4b7c-415f-9cb9-d1e926fad5ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6817","nonce":728226568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6819","nonce":728226568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6823","nonce":728226568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":728226568},{"type":"v1","addr":"172.21.15.181:6821","nonce":728226568}]},"public_addr":"172.21.15.181:6817/728226568","cluster_addr":"172.21.15.181:6819/728226568","heartbeat_back_addr":"172.21.15.181:6823/728226568","heartbeat_front_addr":"172.21.15.181:6821/728226568","state":["exists","up"]},{"osd":9,"uuid":"fb387fbe-19b4-4a3e-8e40-81bd1363b55c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6827","nonce":1052069444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6829","nonce":1052069444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6833","nonce":1052069444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":1052069444},{"type":"v1","addr":"172.21.15.42:6831","nonce":1052069444}]},"public_addr":"172.21.15.42:6827/1052069444","cluster_addr":"172.21.15.42:6829/1052069444","heartbeat_back_addr":"172.21.15.42:6833/1052069444","heartbeat_front_addr":"172.21.15.42:6831/1052069444","state":["exists","up"]},{"osd":10,"uuid":"fe5bbeec-2341-4ea9-97ab-cc45d738d741","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6825","nonce":3417487386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6827","nonce":3417487386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6831","nonce":3417487386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3417487386},{"type":"v1","addr":"172.21.15.43:6829","nonce":3417487386}]},"public_addr":"172.21.15.43:6825/3417487386","cluster_addr":"172.21.15.43:6827/3417487386","heartbeat_back_addr":"172.21.15.43:6831/3417487386","heartbeat_front_addr":"172.21.15.43:6829/3417487386","state":["exists","up"]},{"osd":11,"uuid":"cee07741-3ab7-481e-8477-54319f4f178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6825","nonce":3817502913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6827","nonce":3817502913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6831","nonce":3817502913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3817502913},{"type":"v1","addr":"172.21.15.181:6829","nonce":3817502913}]},"public_addr":"172.21.15.181:6825/3817502913","cluster_addr":"172.21.15.181:6827/3817502913","heartbeat_back_addr":"172.21.15.181:6831/3817502913","heartbeat_front_addr":"172.21.15.181:6829/3817502913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:00.603592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:24.637326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:55:47.587859+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:14.978783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:56:39.025819+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:01.965471+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:29.753475+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:57:54.162377+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:17.970871+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:58:46.175576+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:10.590220+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-25T23:59:33.216701+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/3711239085":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6801/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2983166615":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/2974122891":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/2980210051":"2024-08-26T23:53:05.122858+0000","172.21.15.42:0/4227793902":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6801/1517739376":"2024-08-26T23:53:05.122858+0000","172.21.15.42:6800/723045064":"2024-08-26T23:53:32.406179+0000","172.21.15.42:0/1775009918":"2024-08-26T23:53:32.406179+0000","172.21.15.42:6800/1517739376":"2024-08-26T23:53:05.122858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-26T00:15:21.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.499+0000 7f4736c00640 1 -- 172.21.15.42:0/698854480 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47180a2b80 msgr2=0x7f47180a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:21.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.499+0000 7f4736c00640 1 --2- 172.21.15.42:0/698854480 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47180a2b80 0x7f47180a5040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4724009b50 tx=0x7f4724005f90 comp rx=0 tx=0).stop 2024-08-26T00:15:21.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.499+0000 7f4736c00640 1 -- 172.21.15.42:0/698854480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4730109970 msgr2=0x7f473019eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:21.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.499+0000 7f4736c00640 1 --2- 172.21.15.42:0/698854480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4730109970 0x7f473019eb00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4728005cc0 tx=0x7f47280093d0 comp rx=0 tx=0).stop 2024-08-26T00:15:21.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.499+0000 7f4736c00640 1 -- 172.21.15.42:0/698854480 shutdown_connections 2024-08-26T00:15:21.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.499+0000 7f4736c00640 1 --2- 172.21.15.42:0/698854480 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f47180a2b80 0x7f47180a5040 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:21.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.499+0000 7f4736c00640 1 --2- 172.21.15.42:0/698854480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4730109970 0x7f473019eb00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:21.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.499+0000 7f4736c00640 1 --2- 172.21.15.42:0/698854480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4730104310 0x7f473019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:21.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.499+0000 7f4736c00640 1 --2- 172.21.15.42:0/698854480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4730103970 0x7f473019a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:21.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.499+0000 7f4736c00640 1 -- 172.21.15.42:0/698854480 >> 172.21.15.42:0/698854480 conn(0x7f47300ff670 msgr2=0x7f4730100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:15:21.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.499+0000 7f4736c00640 1 -- 172.21.15.42:0/698854480 shutdown_connections 2024-08-26T00:15:21.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:21.500+0000 7f4736c00640 1 -- 172.21.15.42:0/698854480 wait complete. 2024-08-26T00:15:21.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:21 smithi042 ceph-mon[17225]: pgmap v724: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 767 B/s wr, 6 op/s 2024-08-26T00:15:21.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:21 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/698854480' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:15:22.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:21 smithi043 ceph-mon[22091]: pgmap v724: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 767 B/s wr, 6 op/s 2024-08-26T00:15:22.010 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:21 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/698854480' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:15:22.033 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:21 smithi181 ceph-mon[22102]: pgmap v724: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 767 B/s wr, 6 op/s 2024-08-26T00:15:22.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:21 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/698854480' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-26T00:15:22.254 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs fail cephfs 2024-08-26T00:15:22.630 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:15:23.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.209+0000 7f1c27200640 1 -- 172.21.15.42:0/2211130875 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c28107760 msgr2=0x7f1c28107b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:23.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.209+0000 7f1c27200640 1 --2- 172.21.15.42:0/2211130875 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c28107760 0x7f1c28107b40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009cd0 tx=0x7f1c1802a8f0 comp rx=0 tx=0).stop 2024-08-26T00:15:23.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.209+0000 7f1c27200640 1 -- 172.21.15.42:0/2211130875 shutdown_connections 2024-08-26T00:15:23.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.209+0000 7f1c27200640 1 --2- 172.21.15.42:0/2211130875 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c28102100 0x7f1c2810e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:23.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.209+0000 7f1c27200640 1 --2- 172.21.15.42:0/2211130875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c28101760 0x7f1c28101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:23.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.209+0000 7f1c27200640 1 --2- 172.21.15.42:0/2211130875 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c28107760 0x7f1c28107b40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:23.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.209+0000 7f1c27200640 1 -- 172.21.15.42:0/2211130875 >> 172.21.15.42:0/2211130875 conn(0x7f1c280fd4e0 msgr2=0x7f1c280ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:15:23.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.209+0000 7f1c27200640 1 -- 172.21.15.42:0/2211130875 shutdown_connections 2024-08-26T00:15:23.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.209+0000 7f1c27200640 1 -- 172.21.15.42:0/2211130875 wait complete. 2024-08-26T00:15:23.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.210+0000 7f1c27200640 1 Processor -- start 2024-08-26T00:15:23.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.210+0000 7f1c27200640 1 -- start start 2024-08-26T00:15:23.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.211+0000 7f1c27200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c28101760 0x7f1c2819a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:23.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.211+0000 7f1c27200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c28102100 0x7f1c2819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:23.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.211+0000 7f1c27200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c28107760 0x7f1c2819ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:23.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.211+0000 7f1c27200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1c28111bb0 con 0x7f1c28107760 2024-08-26T00:15:23.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.211+0000 7f1c27200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1c28111a30 con 0x7f1c28101760 2024-08-26T00:15:23.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.211+0000 7f1c27200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1c28111d30 con 0x7f1c28102100 2024-08-26T00:15:23.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.211+0000 7f1c25e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c28101760 0x7f1c2819a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:23.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.211+0000 7f1c25e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c28101760 0x7f1c2819a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:50644/0 (socket says 172.21.15.42:50644) 2024-08-26T00:15:23.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.211+0000 7f1c25e00640 1 -- 172.21.15.42:0/1642756263 learned_addr learned my addr 172.21.15.42:0/1642756263 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:15:23.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.211+0000 7f1c26800640 1 --2- 172.21.15.42:0/1642756263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c28107760 0x7f1c2819ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:23.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.211+0000 7f1c1d400640 1 --2- 172.21.15.42:0/1642756263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c28102100 0x7f1c2819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:23.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.212+0000 7f1c25e00640 1 -- 172.21.15.42:0/1642756263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c28102100 msgr2=0x7f1c2819a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:23.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.212+0000 7f1c25e00640 1 --2- 172.21.15.42:0/1642756263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c28102100 0x7f1c2819a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:23.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.212+0000 7f1c25e00640 1 -- 172.21.15.42:0/1642756263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c28107760 msgr2=0x7f1c2819ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:23.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.212+0000 7f1c25e00640 1 --2- 172.21.15.42:0/1642756263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c28107760 0x7f1c2819ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:23.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.212+0000 7f1c25e00640 1 -- 172.21.15.42:0/1642756263 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c2819f170 con 0x7f1c28101760 2024-08-26T00:15:23.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.212+0000 7f1c26800640 1 --2- 172.21.15.42:0/1642756263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c28107760 0x7f1c2819ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:15:23.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.212+0000 7f1c25e00640 1 --2- 172.21.15.42:0/1642756263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c28101760 0x7f1c2819a1c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1c18000f80 tx=0x7f1c18003f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:15:23.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.212+0000 7f1c1f400640 1 -- 172.21.15.42:0/1642756263 <== mon.2 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18030ec0 con 0x7f1c28101760 2024-08-26T00:15:23.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.212+0000 7f1c1f400640 1 -- 172.21.15.42:0/1642756263 <== mon.2 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c18040070 con 0x7f1c28101760 2024-08-26T00:15:23.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.212+0000 7f1c27200640 1 -- 172.21.15.42:0/1642756263 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c2819f400 con 0x7f1c28101760 2024-08-26T00:15:23.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.212+0000 7f1c1f400640 1 -- 172.21.15.42:0/1642756263 <== mon.2 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18045bb0 con 0x7f1c28101760 2024-08-26T00:15:23.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.213+0000 7f1c27200640 1 -- 172.21.15.42:0/1642756263 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c281a6d40 con 0x7f1c28101760 2024-08-26T00:15:23.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.214+0000 7f1c27200640 1 -- 172.21.15.42:0/1642756263 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c28101bc0 con 0x7f1c28101760 2024-08-26T00:15:23.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.216+0000 7f1c1f400640 1 -- 172.21.15.42:0/1642756263 <== mon.2 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1c18004b40 con 0x7f1c28101760 2024-08-26T00:15:23.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.217+0000 7f1c1f400640 1 --2- 172.21.15.42:0/1642756263 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1c0c0a2da0 0x7f1c0c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:23.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.217+0000 7f1c1f400640 1 -- 172.21.15.42:0/1642756263 <== mon.2 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f1c180f0450 con 0x7f1c28101760 2024-08-26T00:15:23.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.217+0000 7f1c1d400640 1 --2- 172.21.15.42:0/1642756263 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1c0c0a2da0 0x7f1c0c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:23.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.218+0000 7f1c1d400640 1 --2- 172.21.15.42:0/1642756263 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1c0c0a2da0 0x7f1c0c0a5260 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1c2810e2e0 tx=0x7f1c10005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:15:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.219+0000 7f1c1f400640 1 -- 172.21.15.42:0/1642756263 <== mon.2 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f1c180bd490 con 0x7f1c28101760 2024-08-26T00:15:23.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.441+0000 7f1c27200640 1 -- 172.21.15.42:0/1642756263 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1c281a6f10 con 0x7f1c28101760 2024-08-26T00:15:23.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.450+0000 7f1c1f400640 1 -- 172.21.15.42:0/1642756263 <== mon.2 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) ==== 161+0+0 (secure 0 0 0) 0x7f1c180bcd90 con 0x7f1c28101760 2024-08-26T00:15:23.452 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-26T00:15:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.453+0000 7f1c27200640 1 -- 172.21.15.42:0/1642756263 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1c0c0a2da0 msgr2=0x7f1c0c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.453+0000 7f1c27200640 1 --2- 172.21.15.42:0/1642756263 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1c0c0a2da0 0x7f1c0c0a5260 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1c2810e2e0 tx=0x7f1c10005f90 comp rx=0 tx=0).stop 2024-08-26T00:15:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.453+0000 7f1c27200640 1 -- 172.21.15.42:0/1642756263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c28101760 msgr2=0x7f1c2819a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.453+0000 7f1c27200640 1 --2- 172.21.15.42:0/1642756263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c28101760 0x7f1c2819a1c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1c18000f80 tx=0x7f1c18003f80 comp rx=0 tx=0).stop 2024-08-26T00:15:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.453+0000 7f1c27200640 1 -- 172.21.15.42:0/1642756263 shutdown_connections 2024-08-26T00:15:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.453+0000 7f1c27200640 1 --2- 172.21.15.42:0/1642756263 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f1c0c0a2da0 0x7f1c0c0a5260 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.453+0000 7f1c27200640 1 --2- 172.21.15.42:0/1642756263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c28107760 0x7f1c2819ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.453+0000 7f1c27200640 1 --2- 172.21.15.42:0/1642756263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c28102100 0x7f1c2819a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.453+0000 7f1c27200640 1 --2- 172.21.15.42:0/1642756263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c28101760 0x7f1c2819a1c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.453+0000 7f1c27200640 1 -- 172.21.15.42:0/1642756263 >> 172.21.15.42:0/1642756263 conn(0x7f1c280fd4e0 msgr2=0x7f1c280fea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:15:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.453+0000 7f1c27200640 1 -- 172.21.15.42:0/1642756263 shutdown_connections 2024-08-26T00:15:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:23.453+0000 7f1c27200640 1 -- 172.21.15.42:0/1642756263 wait complete. 2024-08-26T00:15:23.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:23 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-a[17221]: 2024-08-26T00:15:23.442+0000 7f1a85a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-26T00:15:23.784 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:15:23 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: ignoring --setuser ceph since I am not root 2024-08-26T00:15:23.784 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:15:23 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: ignoring --setgroup ceph since I am not root 2024-08-26T00:15:23.784 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:15:23 smithi181 ceph-mds[52696]: -- 172.21.15.181:0/585841525 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e48663dc20 con 0x55e48661b000 2024-08-26T00:15:23.784 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:15:23 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: starting mds.c at 2024-08-26T00:15:23.784 INFO:journalctl@ceph.mds.i.smithi181.stdout:Aug 26 00:15:23 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-i[52991]: ignoring --setuser ceph since I am not root 2024-08-26T00:15:23.785 INFO:journalctl@ceph.mds.i.smithi181.stdout:Aug 26 00:15:23 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-i[52991]: ignoring --setgroup ceph since I am not root 2024-08-26T00:15:23.785 INFO:journalctl@ceph.mds.i.smithi181.stdout:Aug 26 00:15:23 smithi181 ceph-mds[52995]: -- 172.21.15.181:0/1657097404 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559b796ab860 con 0x559b79689000 2024-08-26T00:15:23.785 INFO:journalctl@ceph.mds.i.smithi181.stdout:Aug 26 00:15:23 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-i[52991]: starting mds.i at 2024-08-26T00:15:23.785 INFO:journalctl@ceph.mds.f.smithi181.stdout:Aug 26 00:15:23 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-f[52393]: ignoring --setuser ceph since I am not root 2024-08-26T00:15:23.785 INFO:journalctl@ceph.mds.f.smithi181.stdout:Aug 26 00:15:23 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-f[52393]: ignoring --setgroup ceph since I am not root 2024-08-26T00:15:23.785 INFO:journalctl@ceph.mds.f.smithi181.stdout:Aug 26 00:15:23 smithi181 ceph-mds[52397]: -- 172.21.15.181:0/711643187 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5646d4265860 con 0x5646d4243000 2024-08-26T00:15:23.785 INFO:journalctl@ceph.mds.f.smithi181.stdout:Aug 26 00:15:23 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-f[52393]: starting mds.f at 2024-08-26T00:15:23.879 INFO:journalctl@ceph.mds.e.smithi043.stdout:Aug 26 00:15:23 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-e[52349]: ignoring --setuser ceph since I am not root 2024-08-26T00:15:23.879 INFO:journalctl@ceph.mds.e.smithi043.stdout:Aug 26 00:15:23 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-e[52349]: ignoring --setgroup ceph since I am not root 2024-08-26T00:15:23.879 INFO:journalctl@ceph.mds.e.smithi043.stdout:Aug 26 00:15:23 smithi043 ceph-mds[52353]: -- 172.21.15.43:0/1162101945 <== mon.0 v2:172.21.15.42:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f6c2ccd860 con 0x55f6c2caa800 2024-08-26T00:15:23.879 INFO:journalctl@ceph.mds.e.smithi043.stdout:Aug 26 00:15:23 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-e[52349]: starting mds.e at 2024-08-26T00:15:23.880 INFO:journalctl@ceph.mds.h.smithi043.stdout:Aug 26 00:15:23 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-h[52664]: ignoring --setuser ceph since I am not root 2024-08-26T00:15:23.880 INFO:journalctl@ceph.mds.h.smithi043.stdout:Aug 26 00:15:23 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-h[52664]: ignoring --setgroup ceph since I am not root 2024-08-26T00:15:23.880 INFO:journalctl@ceph.mds.h.smithi043.stdout:Aug 26 00:15:23 smithi043 ceph-mds[52668]: -- 172.21.15.43:0/1037688974 <== mon.2 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5616abaa5860 con 0x5616aba83000 2024-08-26T00:15:23.880 INFO:journalctl@ceph.mds.h.smithi043.stdout:Aug 26 00:15:23 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-h[52664]: starting mds.h at 2024-08-26T00:15:23.880 INFO:journalctl@ceph.mds.b.smithi043.stdout:Aug 26 00:15:23 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-b[52979]: ignoring --setuser ceph since I am not root 2024-08-26T00:15:23.881 INFO:journalctl@ceph.mds.b.smithi043.stdout:Aug 26 00:15:23 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-b[52979]: ignoring --setgroup ceph since I am not root 2024-08-26T00:15:23.881 INFO:journalctl@ceph.mds.b.smithi043.stdout:Aug 26 00:15:23 smithi043 ceph-mds[52983]: -- 172.21.15.43:0/1133390594 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556ad9d6f860 con 0x556ad9d4c800 2024-08-26T00:15:23.881 INFO:journalctl@ceph.mds.b.smithi043.stdout:Aug 26 00:15:23 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-b[52979]: starting mds.b at 2024-08-26T00:15:24.185 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:23 smithi042 ceph-mon[17225]: pgmap v725: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 8 op/s 2024-08-26T00:15:24.185 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:23 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1642756263' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-08-26T00:15:24.185 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:23 smithi042 ceph-mon[17225]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-08-26T00:15:24.185 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:23 smithi042 ceph-mon[17225]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-26T00:15:24.185 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:23 smithi042 ceph-mon[17225]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-26T00:15:24.185 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:23 smithi042 ceph-mon[17225]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2024-08-26T00:15:24.185 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:23 smithi042 ceph-mon[17225]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-26T00:15:24.186 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:23 smithi042 ceph-mon[17225]: osdmap e81: 12 total, 12 up, 12 in 2024-08-26T00:15:24.186 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:23 smithi042 ceph-mon[17225]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-08-26T00:15:24.228 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-08-26T00:15:24.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:23 smithi043 ceph-mon[22091]: pgmap v725: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 8 op/s 2024-08-26T00:15:24.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:23 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1642756263' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-08-26T00:15:24.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:23 smithi043 ceph-mon[22091]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-08-26T00:15:24.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:23 smithi043 ceph-mon[22091]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-26T00:15:24.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:23 smithi043 ceph-mon[22091]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-26T00:15:24.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:23 smithi043 ceph-mon[22091]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2024-08-26T00:15:24.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:23 smithi043 ceph-mon[22091]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-26T00:15:24.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:23 smithi043 ceph-mon[22091]: osdmap e81: 12 total, 12 up, 12 in 2024-08-26T00:15:24.261 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:23 smithi043 ceph-mon[22091]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-08-26T00:15:24.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:23 smithi181 ceph-mon[22102]: pgmap v725: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 8 op/s 2024-08-26T00:15:24.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:23 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1642756263' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-08-26T00:15:24.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:23 smithi181 ceph-mon[22102]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-08-26T00:15:24.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:23 smithi181 ceph-mon[22102]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-26T00:15:24.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:23 smithi181 ceph-mon[22102]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-26T00:15:24.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:23 smithi181 ceph-mon[22102]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2024-08-26T00:15:24.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:23 smithi181 ceph-mon[22102]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-26T00:15:24.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:23 smithi181 ceph-mon[22102]: osdmap e81: 12 total, 12 up, 12 in 2024-08-26T00:15:24.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:23 smithi181 ceph-mon[22102]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-08-26T00:15:24.609 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:15:25.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.237+0000 7f83b3200640 1 -- 172.21.15.42:0/4056237897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83ac10e000 msgr2=0x7f83ac1103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:25.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.237+0000 7f83b3200640 1 --2- 172.21.15.42:0/4056237897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83ac10e000 0x7f83ac1103f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009ca0 tx=0x7f83a802a950 comp rx=0 tx=0).stop 2024-08-26T00:15:25.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.237+0000 7f83b3200640 1 -- 172.21.15.42:0/4056237897 shutdown_connections 2024-08-26T00:15:25.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.237+0000 7f83b3200640 1 --2- 172.21.15.42:0/4056237897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83ac10e000 0x7f83ac1103f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:25.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.237+0000 7f83b3200640 1 --2- 172.21.15.42:0/4056237897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83ac074c80 0x7f83ac10dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:25.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.237+0000 7f83b3200640 1 --2- 172.21.15.42:0/4056237897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83ac074360 0x7f83ac074740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:25.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.237+0000 7f83b3200640 1 -- 172.21.15.42:0/4056237897 >> 172.21.15.42:0/4056237897 conn(0x7f83ac0fd4e0 msgr2=0x7f83ac0ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:15:25.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.237+0000 7f83b3200640 1 -- 172.21.15.42:0/4056237897 shutdown_connections 2024-08-26T00:15:25.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.237+0000 7f83b3200640 1 -- 172.21.15.42:0/4056237897 wait complete. 2024-08-26T00:15:25.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.238+0000 7f83b3200640 1 Processor -- start 2024-08-26T00:15:25.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.239+0000 7f83b3200640 1 -- start start 2024-08-26T00:15:25.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.239+0000 7f83b3200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83ac074360 0x7f83ac19a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:25.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.239+0000 7f83b3200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83ac074c80 0x7f83ac19a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:25.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.239+0000 7f83b3200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83ac10e000 0x7f83ac19eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:25.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.239+0000 7f83b3200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac113d50 con 0x7f83ac074c80 2024-08-26T00:15:25.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.239+0000 7f83b3200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac113bd0 con 0x7f83ac10e000 2024-08-26T00:15:25.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.239+0000 7f83b3200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac113ed0 con 0x7f83ac074360 2024-08-26T00:15:25.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.239+0000 7f83b1e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83ac074360 0x7f83ac19a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:25.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.239+0000 7f83b1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83ac074c80 0x7f83ac19a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:25.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.239+0000 7f83b1e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83ac074360 0x7f83ac19a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.42:60446/0 (socket says 172.21.15.42:60446) 2024-08-26T00:15:25.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.239+0000 7f83b1e00640 1 -- 172.21.15.42:0/2304110991 learned_addr learned my addr 172.21.15.42:0/2304110991 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:15:25.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.239+0000 7f83b2800640 1 --2- 172.21.15.42:0/2304110991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83ac10e000 0x7f83ac19eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:25.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.240+0000 7f83b1e00640 1 -- 172.21.15.42:0/2304110991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83ac10e000 msgr2=0x7f83ac19eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:25.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.240+0000 7f83b1e00640 1 --2- 172.21.15.42:0/2304110991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83ac10e000 0x7f83ac19eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:25.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.240+0000 7f83b1e00640 1 -- 172.21.15.42:0/2304110991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83ac074c80 msgr2=0x7f83ac19a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:25.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.240+0000 7f83b1e00640 1 --2- 172.21.15.42:0/2304110991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83ac074c80 0x7f83ac19a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:25.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.240+0000 7f83b1e00640 1 -- 172.21.15.42:0/2304110991 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ac19f190 con 0x7f83ac074360 2024-08-26T00:15:25.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.240+0000 7f83b1e00640 1 --2- 172.21.15.42:0/2304110991 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83ac074360 0x7f83ac19a1e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f83a000e9f0 tx=0x7f83a000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:15:25.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.240+0000 7f83a6a00640 1 -- 172.21.15.42:0/2304110991 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a000cd80 con 0x7f83ac074360 2024-08-26T00:15:25.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.241+0000 7f83b3200640 1 -- 172.21.15.42:0/2304110991 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83ac19f480 con 0x7f83ac074360 2024-08-26T00:15:25.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.241+0000 7f83a6a00640 1 -- 172.21.15.42:0/2304110991 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83a0010910 con 0x7f83ac074360 2024-08-26T00:15:25.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.241+0000 7f83a6a00640 1 -- 172.21.15.42:0/2304110991 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a00188f0 con 0x7f83ac074360 2024-08-26T00:15:25.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.241+0000 7f83b3200640 1 -- 172.21.15.42:0/2304110991 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83ac1a6d60 con 0x7f83ac074360 2024-08-26T00:15:25.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.242+0000 7f83b3200640 1 -- 172.21.15.42:0/2304110991 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83ac074740 con 0x7f83ac074360 2024-08-26T00:15:25.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.244+0000 7f83a6a00640 1 -- 172.21.15.42:0/2304110991 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f83a0010ac0 con 0x7f83ac074360 2024-08-26T00:15:25.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.245+0000 7f83a6a00640 1 --2- 172.21.15.42:0/2304110991 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f83940a2c00 0x7f83940a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:25.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.245+0000 7f83a6a00640 1 -- 172.21.15.42:0/2304110991 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8498+0+0 (secure 0 0 0) 0x7f83a00cf8a0 con 0x7f83ac074360 2024-08-26T00:15:25.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.245+0000 7f83b1400640 1 --2- 172.21.15.42:0/2304110991 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f83940a2c00 0x7f83940a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:25.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.246+0000 7f83b1400640 1 --2- 172.21.15.42:0/2304110991 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f83940a2c00 0x7f83940a50c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f83ac10f390 tx=0x7f839c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:15:25.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.247+0000 7f83a6a00640 1 -- 172.21.15.42:0/2304110991 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f83a009c040 con 0x7f83ac074360 2024-08-26T00:15:25.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:25.473+0000 7f83b3200640 1 -- 172.21.15.42:0/2304110991 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f83ac02d6a0 con 0x7f83ac074360 2024-08-26T00:15:25.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:25 smithi043 ceph-mon[22091]: mds.? [v2:172.21.15.181:6834/3595703895,v1:172.21.15.181:6835/3595703895] up:boot 2024-08-26T00:15:25.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:25 smithi043 ceph-mon[22091]: mds.? [v2:172.21.15.181:6836/2292231246,v1:172.21.15.181:6837/2292231246] up:boot 2024-08-26T00:15:25.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:25 smithi043 ceph-mon[22091]: mds.? [v2:172.21.15.181:6838/1173201677,v1:172.21.15.181:6839/1173201677] up:boot 2024-08-26T00:15:25.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:25 smithi043 ceph-mon[22091]: mds.? [v2:172.21.15.43:6835/946996158,v1:172.21.15.43:6838/946996158] up:boot 2024-08-26T00:15:25.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:25 smithi043 ceph-mon[22091]: mds.? [v2:172.21.15.43:6834/2584332557,v1:172.21.15.43:6837/2584332557] up:boot 2024-08-26T00:15:25.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:25 smithi043 ceph-mon[22091]: mds.? [v2:172.21.15.43:6836/2236749927,v1:172.21.15.43:6839/2236749927] up:boot 2024-08-26T00:15:25.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:25 smithi043 ceph-mon[22091]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-08-26T00:15:25.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:25 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-26T00:15:25.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:25 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-26T00:15:25.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:25 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-26T00:15:25.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:25 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-26T00:15:25.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:25 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-26T00:15:25.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:25 smithi043 ceph-mon[22091]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-26T00:15:25.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:25 smithi042 ceph-mon[17225]: mds.? [v2:172.21.15.181:6834/3595703895,v1:172.21.15.181:6835/3595703895] up:boot 2024-08-26T00:15:25.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:25 smithi042 ceph-mon[17225]: mds.? [v2:172.21.15.181:6836/2292231246,v1:172.21.15.181:6837/2292231246] up:boot 2024-08-26T00:15:25.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:25 smithi042 ceph-mon[17225]: mds.? [v2:172.21.15.181:6838/1173201677,v1:172.21.15.181:6839/1173201677] up:boot 2024-08-26T00:15:25.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:25 smithi042 ceph-mon[17225]: mds.? [v2:172.21.15.43:6835/946996158,v1:172.21.15.43:6838/946996158] up:boot 2024-08-26T00:15:25.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:25 smithi042 ceph-mon[17225]: mds.? [v2:172.21.15.43:6834/2584332557,v1:172.21.15.43:6837/2584332557] up:boot 2024-08-26T00:15:25.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:25 smithi042 ceph-mon[17225]: mds.? [v2:172.21.15.43:6836/2236749927,v1:172.21.15.43:6839/2236749927] up:boot 2024-08-26T00:15:25.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:25 smithi042 ceph-mon[17225]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-08-26T00:15:25.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:25 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-26T00:15:25.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:25 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-26T00:15:25.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:25 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-26T00:15:25.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:25 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-26T00:15:25.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:25 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-26T00:15:25.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:25 smithi042 ceph-mon[17225]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-26T00:15:25.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:25 smithi181 ceph-mon[22102]: mds.? [v2:172.21.15.181:6834/3595703895,v1:172.21.15.181:6835/3595703895] up:boot 2024-08-26T00:15:25.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:25 smithi181 ceph-mon[22102]: mds.? [v2:172.21.15.181:6836/2292231246,v1:172.21.15.181:6837/2292231246] up:boot 2024-08-26T00:15:25.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:25 smithi181 ceph-mon[22102]: mds.? [v2:172.21.15.181:6838/1173201677,v1:172.21.15.181:6839/1173201677] up:boot 2024-08-26T00:15:25.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:25 smithi181 ceph-mon[22102]: mds.? [v2:172.21.15.43:6835/946996158,v1:172.21.15.43:6838/946996158] up:boot 2024-08-26T00:15:25.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:25 smithi181 ceph-mon[22102]: mds.? [v2:172.21.15.43:6834/2584332557,v1:172.21.15.43:6837/2584332557] up:boot 2024-08-26T00:15:25.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:25 smithi181 ceph-mon[22102]: mds.? [v2:172.21.15.43:6836/2236749927,v1:172.21.15.43:6839/2236749927] up:boot 2024-08-26T00:15:25.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:25 smithi181 ceph-mon[22102]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-08-26T00:15:25.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:25 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-26T00:15:25.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:25 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-26T00:15:25.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:25 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-26T00:15:25.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:25 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-26T00:15:25.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:25 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-26T00:15:25.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:25 smithi181 ceph-mon[22102]: from='mgr.14150 172.21.15.42:0/4138692641' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-26T00:15:26.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:26.462+0000 7f83a6a00640 1 -- 172.21.15.42:0/2304110991 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v35) ==== 104+0+0 (secure 0 0 0) 0x7f83a00a0340 con 0x7f83ac074360 2024-08-26T00:15:26.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:26.465+0000 7f83b3200640 1 -- 172.21.15.42:0/2304110991 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f83940a2c00 msgr2=0x7f83940a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:26.465+0000 7f83b3200640 1 --2- 172.21.15.42:0/2304110991 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f83940a2c00 0x7f83940a50c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f83ac10f390 tx=0x7f839c00b390 comp rx=0 tx=0).stop 2024-08-26T00:15:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:26.465+0000 7f83b3200640 1 -- 172.21.15.42:0/2304110991 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83ac074360 msgr2=0x7f83ac19a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:26.465+0000 7f83b3200640 1 --2- 172.21.15.42:0/2304110991 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83ac074360 0x7f83ac19a1e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f83a000e9f0 tx=0x7f83a000eeb0 comp rx=0 tx=0).stop 2024-08-26T00:15:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:26.465+0000 7f83b3200640 1 -- 172.21.15.42:0/2304110991 shutdown_connections 2024-08-26T00:15:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:26.465+0000 7f83b3200640 1 --2- 172.21.15.42:0/2304110991 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f83940a2c00 0x7f83940a50c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:26.465+0000 7f83b3200640 1 --2- 172.21.15.42:0/2304110991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83ac10e000 0x7f83ac19eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:26.465+0000 7f83b3200640 1 --2- 172.21.15.42:0/2304110991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83ac074c80 0x7f83ac19a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:26.465+0000 7f83b3200640 1 --2- 172.21.15.42:0/2304110991 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83ac074360 0x7f83ac19a1e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:26.465+0000 7f83b3200640 1 -- 172.21.15.42:0/2304110991 >> 172.21.15.42:0/2304110991 conn(0x7f83ac0fd4e0 msgr2=0x7f83ac0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:15:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:26.465+0000 7f83b3200640 1 -- 172.21.15.42:0/2304110991 shutdown_connections 2024-08-26T00:15:26.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:26.466+0000 7f83b3200640 1 -- 172.21.15.42:0/2304110991 wait complete. 2024-08-26T00:15:26.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:26 smithi043 ceph-mon[22091]: pgmap v727: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 921 B/s wr, 7 op/s 2024-08-26T00:15:26.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:26 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/2304110991' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-08-26T00:15:26.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:26 smithi043 ceph-mon[22091]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-08-26T00:15:26.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:26 smithi042 ceph-mon[17225]: pgmap v727: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 921 B/s wr, 7 op/s 2024-08-26T00:15:26.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:26 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/2304110991' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-08-26T00:15:26.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:26 smithi042 ceph-mon[17225]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-08-26T00:15:26.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:26 smithi181 ceph-mon[22102]: pgmap v727: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 921 B/s wr, 7 op/s 2024-08-26T00:15:26.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:26 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/2304110991' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-08-26T00:15:26.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:26 smithi181 ceph-mon[22102]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-08-26T00:15:27.188 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-26T00:15:27.577 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:15:27.716 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:27 smithi042 ceph-mon[17225]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-26T00:15:27.716 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:27 smithi042 ceph-mon[17225]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-26T00:15:27.716 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:27 smithi042 ceph-mon[17225]: Cluster is now healthy 2024-08-26T00:15:27.716 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:27 smithi042 ceph-mon[17225]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-26T00:15:27.717 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:27 smithi042 ceph-mon[17225]: fsmap 12 up:standby 2024-08-26T00:15:27.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:27 smithi043 ceph-mon[22091]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-26T00:15:27.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:27 smithi043 ceph-mon[22091]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-26T00:15:27.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:27 smithi043 ceph-mon[22091]: Cluster is now healthy 2024-08-26T00:15:27.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:27 smithi043 ceph-mon[22091]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-26T00:15:27.761 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:27 smithi043 ceph-mon[22091]: fsmap 12 up:standby 2024-08-26T00:15:27.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:27 smithi181 ceph-mon[22102]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-26T00:15:27.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:27 smithi181 ceph-mon[22102]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-26T00:15:27.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:27 smithi181 ceph-mon[22102]: Cluster is now healthy 2024-08-26T00:15:27.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:27 smithi181 ceph-mon[22102]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-26T00:15:27.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:27 smithi181 ceph-mon[22102]: fsmap 12 up:standby 2024-08-26T00:15:28.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.112+0000 7fe3bc200640 1 -- 172.21.15.42:0/1397024101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3b4076de0 msgr2=0x7fe3b4112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:28.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.112+0000 7fe3bc200640 1 --2- 172.21.15.42:0/1397024101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3b4076de0 0x7fe3b4112290 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0009900 tx=0x7fe3a002a410 comp rx=0 tx=0).stop 2024-08-26T00:15:28.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.112+0000 7fe3bc200640 1 -- 172.21.15.42:0/1397024101 shutdown_connections 2024-08-26T00:15:28.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.112+0000 7fe3bc200640 1 --2- 172.21.15.42:0/1397024101 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3b41127d0 0x7fe3b4114bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:28.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.112+0000 7fe3bc200640 1 --2- 172.21.15.42:0/1397024101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3b4076de0 0x7fe3b4112290 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:28.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.112+0000 7fe3bc200640 1 --2- 172.21.15.42:0/1397024101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3b40764c0 0x7fe3b40768a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:28.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.112+0000 7fe3bc200640 1 -- 172.21.15.42:0/1397024101 >> 172.21.15.42:0/1397024101 conn(0x7fe3b40ff830 msgr2=0x7fe3b4101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:15:28.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.112+0000 7fe3bc200640 1 -- 172.21.15.42:0/1397024101 shutdown_connections 2024-08-26T00:15:28.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.112+0000 7fe3bc200640 1 -- 172.21.15.42:0/1397024101 wait complete. 2024-08-26T00:15:28.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.113+0000 7fe3bc200640 1 Processor -- start 2024-08-26T00:15:28.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.113+0000 7fe3bc200640 1 -- start start 2024-08-26T00:15:28.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.114+0000 7fe3bc200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3b40764c0 0x7fe3b41a4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:28.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.114+0000 7fe3bc200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3b4076de0 0x7fe3b41a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:28.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.114+0000 7fe3bc200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3b41127d0 0x7fe3b419e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:28.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.114+0000 7fe3bc200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b41183a0 con 0x7fe3b41127d0 2024-08-26T00:15:28.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.114+0000 7fe3bc200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b4118220 con 0x7fe3b4076de0 2024-08-26T00:15:28.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.114+0000 7fe3bc200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b4118520 con 0x7fe3b40764c0 2024-08-26T00:15:28.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.114+0000 7fe3b8e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3b4076de0 0x7fe3b41a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:28.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.114+0000 7fe3ba200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3b41127d0 0x7fe3b419e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:28.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.114+0000 7fe3b8e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3b4076de0 0x7fe3b41a4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:35130/0 (socket says 172.21.15.42:35130) 2024-08-26T00:15:28.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.114+0000 7fe3b9800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3b40764c0 0x7fe3b41a4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:28.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.114+0000 7fe3b8e00640 1 -- 172.21.15.42:0/1323390695 learned_addr learned my addr 172.21.15.42:0/1323390695 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:15:28.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.115+0000 7fe3ba200640 1 -- 172.21.15.42:0/1323390695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3b40764c0 msgr2=0x7fe3b41a4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:28.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.115+0000 7fe3ba200640 1 --2- 172.21.15.42:0/1323390695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3b40764c0 0x7fe3b41a4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:28.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.115+0000 7fe3ba200640 1 -- 172.21.15.42:0/1323390695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3b4076de0 msgr2=0x7fe3b41a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:28.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.115+0000 7fe3ba200640 1 --2- 172.21.15.42:0/1323390695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3b4076de0 0x7fe3b41a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:28.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.115+0000 7fe3ba200640 1 -- 172.21.15.42:0/1323390695 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b419eed0 con 0x7fe3b41127d0 2024-08-26T00:15:28.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.115+0000 7fe3b9800640 1 --2- 172.21.15.42:0/1323390695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3b40764c0 0x7fe3b41a4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:15:28.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.115+0000 7fe3ba200640 1 --2- 172.21.15.42:0/1323390695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3b41127d0 0x7fe3b419e660 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe3b407a7b0 tx=0x7fe3ac00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:15:28.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.115+0000 7fe3b2000640 1 -- 172.21.15.42:0/1323390695 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac00cdf0 con 0x7fe3b41127d0 2024-08-26T00:15:28.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.116+0000 7fe3b2000640 1 -- 172.21.15.42:0/1323390695 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3ac005020 con 0x7fe3b41127d0 2024-08-26T00:15:28.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.116+0000 7fe3b2000640 1 -- 172.21.15.42:0/1323390695 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac010670 con 0x7fe3b41127d0 2024-08-26T00:15:28.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.116+0000 7fe3bc200640 1 -- 172.21.15.42:0/1323390695 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3b419f1c0 con 0x7fe3b41127d0 2024-08-26T00:15:28.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.116+0000 7fe3bc200640 1 -- 172.21.15.42:0/1323390695 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3b41ab510 con 0x7fe3b41127d0 2024-08-26T00:15:28.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.117+0000 7fe3bc200640 1 -- 172.21.15.42:0/1323390695 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3b4077c00 con 0x7fe3b41127d0 2024-08-26T00:15:28.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.119+0000 7fe3b2000640 1 -- 172.21.15.42:0/1323390695 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe3ac0054d0 con 0x7fe3b41127d0 2024-08-26T00:15:28.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.120+0000 7fe3b2000640 1 --2- 172.21.15.42:0/1323390695 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe39c0a2c00 0x7fe39c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:28.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.120+0000 7fe3b2000640 1 -- 172.21.15.42:0/1323390695 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8498+0+0 (secure 0 0 0) 0x7fe3ac0cf760 con 0x7fe3b41127d0 2024-08-26T00:15:28.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.120+0000 7fe3b9800640 1 --2- 172.21.15.42:0/1323390695 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe39c0a2c00 0x7fe39c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:28.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.121+0000 7fe3b9800640 1 --2- 172.21.15.42:0/1323390695 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe39c0a2c00 0x7fe39c0a50c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8009fc0 tx=0x7fe3a8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:15:28.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.124+0000 7fe3b2000640 1 -- 172.21.15.42:0/1323390695 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe3ac09c550 con 0x7fe3b41127d0 2024-08-26T00:15:28.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.312+0000 7fe3bc200640 1 -- 172.21.15.42:0/1323390695 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe3b410d960 con 0x7fe3b41127d0 2024-08-26T00:15:28.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.479+0000 7fe3b2000640 1 -- 172.21.15.42:0/1323390695 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v82) ==== 181+0+0 (secure 0 0 0) 0x7fe3ac09be50 con 0x7fe3b41127d0 2024-08-26T00:15:28.481 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-08-26T00:15:28.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.484+0000 7fe3bc200640 1 -- 172.21.15.42:0/1323390695 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe39c0a2c00 msgr2=0x7fe39c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:28.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.484+0000 7fe3bc200640 1 --2- 172.21.15.42:0/1323390695 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe39c0a2c00 0x7fe39c0a50c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8009fc0 tx=0x7fe3a8005f90 comp rx=0 tx=0).stop 2024-08-26T00:15:28.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.484+0000 7fe3bc200640 1 -- 172.21.15.42:0/1323390695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3b41127d0 msgr2=0x7fe3b419e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:28.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.484+0000 7fe3bc200640 1 --2- 172.21.15.42:0/1323390695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3b41127d0 0x7fe3b419e660 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe3b407a7b0 tx=0x7fe3ac00ef10 comp rx=0 tx=0).stop 2024-08-26T00:15:28.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.484+0000 7fe3bc200640 1 -- 172.21.15.42:0/1323390695 shutdown_connections 2024-08-26T00:15:28.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.484+0000 7fe3bc200640 1 --2- 172.21.15.42:0/1323390695 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7fe39c0a2c00 0x7fe39c0a50c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:28.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.484+0000 7fe3bc200640 1 --2- 172.21.15.42:0/1323390695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3b41127d0 0x7fe3b419e660 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:28.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.484+0000 7fe3bc200640 1 --2- 172.21.15.42:0/1323390695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3b4076de0 0x7fe3b41a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:28.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.484+0000 7fe3bc200640 1 --2- 172.21.15.42:0/1323390695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3b40764c0 0x7fe3b41a4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:28.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.484+0000 7fe3bc200640 1 -- 172.21.15.42:0/1323390695 >> 172.21.15.42:0/1323390695 conn(0x7fe3b40ff830 msgr2=0x7fe3b4101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:15:28.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.484+0000 7fe3bc200640 1 -- 172.21.15.42:0/1323390695 shutdown_connections 2024-08-26T00:15:28.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:28.485+0000 7fe3bc200640 1 -- 172.21.15.42:0/1323390695 wait complete. 2024-08-26T00:15:28.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:28 smithi043 ceph-mon[22091]: pgmap v728: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 614 B/s wr, 6 op/s 2024-08-26T00:15:28.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:28 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1323390695' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-26T00:15:28.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:28 smithi181 ceph-mon[22102]: pgmap v728: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 614 B/s wr, 6 op/s 2024-08-26T00:15:28.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:28 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1323390695' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-26T00:15:28.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:28 smithi042 ceph-mon[17225]: pgmap v728: 97 pgs: 97 active+clean; 635 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 614 B/s wr, 6 op/s 2024-08-26T00:15:28.784 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:28 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1323390695' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-26T00:15:29.188 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13 shell --fsid f89d317a-633c-11ef-bcd2-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-26T00:15:29.581 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/mon.a/config 2024-08-26T00:15:29.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:29 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1323390695' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-26T00:15:29.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:29 smithi043 ceph-mon[22091]: osdmap e82: 12 total, 12 up, 12 in 2024-08-26T00:15:29.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:29 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1323390695' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-26T00:15:29.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:29 smithi042 ceph-mon[17225]: osdmap e82: 12 total, 12 up, 12 in 2024-08-26T00:15:29.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:29 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1323390695' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-26T00:15:29.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:29 smithi181 ceph-mon[22102]: osdmap e82: 12 total, 12 up, 12 in 2024-08-26T00:15:30.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.079+0000 7f9683e00640 1 -- 172.21.15.42:0/2007920958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9684102100 msgr2=0x7f968410e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:30.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.079+0000 7f9683e00640 1 --2- 172.21.15.42:0/2007920958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9684102100 0x7f968410e630 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f967c009cd0 tx=0x7f967c02a8f0 comp rx=0 tx=0).stop 2024-08-26T00:15:30.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.079+0000 7f9683e00640 1 -- 172.21.15.42:0/2007920958 shutdown_connections 2024-08-26T00:15:30.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.079+0000 7f9683e00640 1 --2- 172.21.15.42:0/2007920958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9684102100 0x7f968410e630 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:30.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.079+0000 7f9683e00640 1 --2- 172.21.15.42:0/2007920958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9684101760 0x7f9684101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:30.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.079+0000 7f9683e00640 1 --2- 172.21.15.42:0/2007920958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9684107760 0x7f9684107b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:30.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.079+0000 7f9683e00640 1 -- 172.21.15.42:0/2007920958 >> 172.21.15.42:0/2007920958 conn(0x7f96840fd4e0 msgr2=0x7f96840ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:15:30.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.079+0000 7f9683e00640 1 -- 172.21.15.42:0/2007920958 shutdown_connections 2024-08-26T00:15:30.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.079+0000 7f9683e00640 1 -- 172.21.15.42:0/2007920958 wait complete. 2024-08-26T00:15:30.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.080+0000 7f9683e00640 1 Processor -- start 2024-08-26T00:15:30.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.080+0000 7f9683e00640 1 -- start start 2024-08-26T00:15:30.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.080+0000 7f9683e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9684101760 0x7f9684074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:30.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.081+0000 7f9683e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9684102100 0x7f96840747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:30.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.081+0000 7f9683e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9684107760 0x7f9684074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:30.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.081+0000 7f9683e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9684111b60 con 0x7f9684102100 2024-08-26T00:15:30.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.081+0000 7f9683e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f96841119e0 con 0x7f9684101760 2024-08-26T00:15:30.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.081+0000 7f9683e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9684111ce0 con 0x7f9684107760 2024-08-26T00:15:30.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.081+0000 7f9682000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9684102100 0x7f96840747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:30.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.081+0000 7f9682000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9684102100 0x7f96840747d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45682/0 (socket says 172.21.15.42:45682) 2024-08-26T00:15:30.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.081+0000 7f9682a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9684101760 0x7f9684074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:30.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.081+0000 7f9682000640 1 -- 172.21.15.42:0/1837594381 learned_addr learned my addr 172.21.15.42:0/1837594381 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-26T00:15:30.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.081+0000 7f9683400640 1 --2- 172.21.15.42:0/1837594381 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9684107760 0x7f9684074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:30.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.081+0000 7f9682000640 1 -- 172.21.15.42:0/1837594381 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9684107760 msgr2=0x7f9684074d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:30.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.081+0000 7f9682000640 1 --2- 172.21.15.42:0/1837594381 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9684107760 0x7f9684074d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:30.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.081+0000 7f9682000640 1 -- 172.21.15.42:0/1837594381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9684101760 msgr2=0x7f9684074290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:30.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.081+0000 7f9682000640 1 --2- 172.21.15.42:0/1837594381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9684101760 0x7f9684074290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:30.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.081+0000 7f9682000640 1 -- 172.21.15.42:0/1837594381 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96841a64c0 con 0x7f9684102100 2024-08-26T00:15:30.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.081+0000 7f9682a00640 1 --2- 172.21.15.42:0/1837594381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9684101760 0x7f9684074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-26T00:15:30.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.082+0000 7f9682000640 1 --2- 172.21.15.42:0/1837594381 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9684102100 0x7f96840747d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f967000d950 tx=0x7f967000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:15:30.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.082+0000 7f967b400640 1 -- 172.21.15.42:0/1837594381 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9670017070 con 0x7f9684102100 2024-08-26T00:15:30.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.082+0000 7f9683e00640 1 -- 172.21.15.42:0/1837594381 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96841a67b0 con 0x7f9684102100 2024-08-26T00:15:30.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.082+0000 7f967b400640 1 -- 172.21.15.42:0/1837594381 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9670009c30 con 0x7f9684102100 2024-08-26T00:15:30.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.082+0000 7f967b400640 1 -- 172.21.15.42:0/1837594381 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967000f6b0 con 0x7f9684102100 2024-08-26T00:15:30.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.082+0000 7f9683e00640 1 -- 172.21.15.42:0/1837594381 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96841a6cf0 con 0x7f9684102100 2024-08-26T00:15:30.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.083+0000 7f9683e00640 1 -- 172.21.15.42:0/1837594381 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9684101bc0 con 0x7f9684102100 2024-08-26T00:15:30.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.086+0000 7f967b400640 1 -- 172.21.15.42:0/1837594381 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f96700109d0 con 0x7f9684102100 2024-08-26T00:15:30.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.087+0000 7f967b400640 1 --2- 172.21.15.42:0/1837594381 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f96680a2b80 0x7f96680a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-26T00:15:30.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.088+0000 7f967b400640 1 -- 172.21.15.42:0/1837594381 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7944+0+0 (secure 0 0 0) 0x7f96700ceae0 con 0x7f9684102100 2024-08-26T00:15:30.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.088+0000 7f9682a00640 1 --2- 172.21.15.42:0/1837594381 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f96680a2b80 0x7f96680a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-26T00:15:30.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.088+0000 7f9682a00640 1 --2- 172.21.15.42:0/1837594381 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f96680a2b80 0x7f96680a5040 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9674009f40 tx=0x7f9674005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-26T00:15:30.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.089+0000 7f967b400640 1 -- 172.21.15.42:0/1837594381 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f9670009de0 con 0x7f9684102100 2024-08-26T00:15:30.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.280+0000 7f9683e00640 1 -- 172.21.15.42:0/1837594381 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9684109cd0 con 0x7f9684102100 2024-08-26T00:15:30.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.500+0000 7f967b400640 1 -- 172.21.15.42:0/1837594381 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v83) ==== 169+0+0 (secure 0 0 0) 0x7f967009b4c0 con 0x7f9684102100 2024-08-26T00:15:30.501 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-08-26T00:15:30.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.506+0000 7f9683e00640 1 -- 172.21.15.42:0/1837594381 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f96680a2b80 msgr2=0x7f96680a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:30.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.506+0000 7f9683e00640 1 --2- 172.21.15.42:0/1837594381 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f96680a2b80 0x7f96680a5040 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9674009f40 tx=0x7f9674005f90 comp rx=0 tx=0).stop 2024-08-26T00:15:30.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.506+0000 7f9683e00640 1 -- 172.21.15.42:0/1837594381 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9684102100 msgr2=0x7f96840747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-26T00:15:30.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.506+0000 7f9683e00640 1 --2- 172.21.15.42:0/1837594381 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9684102100 0x7f96840747d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f967000d950 tx=0x7f967000de10 comp rx=0 tx=0).stop 2024-08-26T00:15:30.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.509+0000 7f9683e00640 1 -- 172.21.15.42:0/1837594381 shutdown_connections 2024-08-26T00:15:30.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.509+0000 7f9683e00640 1 --2- 172.21.15.42:0/1837594381 >> [v2:172.21.15.42:6800/22448279,v1:172.21.15.42:6801/22448279] conn(0x7f96680a2b80 0x7f96680a5040 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:30.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.509+0000 7f9683e00640 1 --2- 172.21.15.42:0/1837594381 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9684107760 0x7f9684074d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:30.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.509+0000 7f9683e00640 1 --2- 172.21.15.42:0/1837594381 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9684102100 0x7f96840747d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:30.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.509+0000 7f9683e00640 1 --2- 172.21.15.42:0/1837594381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9684101760 0x7f9684074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-26T00:15:30.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.509+0000 7f9683e00640 1 -- 172.21.15.42:0/1837594381 >> 172.21.15.42:0/1837594381 conn(0x7f96840fd4e0 msgr2=0x7f96840fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-26T00:15:30.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.510+0000 7f9683e00640 1 -- 172.21.15.42:0/1837594381 shutdown_connections 2024-08-26T00:15:30.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-26T00:15:30.510+0000 7f9683e00640 1 -- 172.21.15.42:0/1837594381 wait complete. 2024-08-26T00:15:30.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:30 smithi043 ceph-mon[22091]: pgmap v730: 65 pgs: 65 active+clean; 577 KiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:15:30.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:30 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1837594381' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-26T00:15:30.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:30 smithi042 ceph-mon[17225]: pgmap v730: 65 pgs: 65 active+clean; 577 KiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:15:30.783 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:30 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1837594381' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-26T00:15:30.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:30 smithi181 ceph-mon[22102]: pgmap v730: 65 pgs: 65 active+clean; 577 KiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-26T00:15:30.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:30 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1837594381' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-26T00:15:31.311 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-26T00:15:31.367 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-26T00:15:31.409 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-26T00:15:31.452 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-08-26T00:15:31.452 DEBUG:teuthology.orchestra.run.smithi042:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-26T00:15:31.487 DEBUG:teuthology.orchestra.run.smithi043:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-26T00:15:31.503 DEBUG:teuthology.orchestra.run.smithi181:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-26T00:15:31.518 INFO:tasks.cephadm:Stopping all daemons... 2024-08-26T00:15:31.518 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-08-26T00:15:31.519 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mon.a 2024-08-26T00:15:31.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:31 smithi042 ceph-mon[17225]: from='client.? 172.21.15.42:0/1837594381' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-26T00:15:31.534 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:31 smithi042 ceph-mon[17225]: osdmap e83: 12 total, 12 up, 12 in 2024-08-26T00:15:31.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:31 smithi043 ceph-mon[22091]: from='client.? 172.21.15.42:0/1837594381' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-26T00:15:31.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:31 smithi043 ceph-mon[22091]: osdmap e83: 12 total, 12 up, 12 in 2024-08-26T00:15:31.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:31 smithi181 ceph-mon[22102]: from='client.? 172.21.15.42:0/1837594381' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-26T00:15:31.784 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:31 smithi181 ceph-mon[22102]: osdmap e83: 12 total, 12 up, 12 in 2024-08-26T00:15:31.925 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:31 smithi042 systemd[1]: Stopping Ceph mon.a for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:15:32.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:31 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-a[17221]: 2024-08-26T00:15:31.923+0000 7f1a8c800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:15:32.283 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:31 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-a[17221]: 2024-08-26T00:15:31.923+0000 7f1a8c800640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-08-26T00:15:32.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:32 smithi042 podman[86034]: 2024-08-26 00:15:32.037652489 +0000 UTC m=+0.226069611 container died 368b9008b40ed112c93a689198ab76910296bd7fe223a274edc5848f737fa473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-a, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f273685, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux ) 2024-08-26T00:15:32.715 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:32 smithi042 podman[86034]: 2024-08-26 00:15:32.454582933 +0000 UTC m=+0.643000055 container cleanup 368b9008b40ed112c93a689198ab76910296bd7fe223a274edc5848f737fa473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-a, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-f273685, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-08-26T00:15:32.715 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:32 smithi042 bash[86034]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-a 2024-08-26T00:15:32.992 INFO:journalctl@ceph.mon.a.smithi042.stdout:Aug 26 00:15:32 smithi042 podman[86046]: 2024-08-26 00:15:32.714546731 +0000 UTC m=+0.665281643 container remove 368b9008b40ed112c93a689198ab76910296bd7fe223a274edc5848f737fa473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-f273685, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-26T00:15:33.020 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mon.a.service' 2024-08-26T00:15:33.106 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:15:33.107 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-08-26T00:15:33.107 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-08-26T00:15:33.107 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mon.b 2024-08-26T00:15:33.476 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:33 smithi043 systemd[1]: Stopping Ceph mon.b for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:15:33.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:33 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-b[22087]: 2024-08-26T00:15:33.475+0000 7f607b59e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:15:33.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:33 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-b[22087]: 2024-08-26T00:15:33.475+0000 7f607b59e640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-08-26T00:15:33.760 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:33 smithi043 podman[58156]: 2024-08-26 00:15:33.659553958 +0000 UTC m=+0.291347217 container died 61c98c271844fb487bb0fb32c1b2f4151d6b2539d807ee03e82228f86caaae48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-f273685, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-08-26T00:15:34.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:34 smithi043 podman[58156]: 2024-08-26 00:15:34.033784038 +0000 UTC m=+0.665577295 container cleanup 61c98c271844fb487bb0fb32c1b2f4151d6b2539d807ee03e82228f86caaae48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-f273685, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.build-date=20240731) 2024-08-26T00:15:34.260 INFO:journalctl@ceph.mon.b.smithi043.stdout:Aug 26 00:15:34 smithi043 bash[58156]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-b 2024-08-26T00:15:34.427 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mon.b.service' 2024-08-26T00:15:34.474 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:15:34.474 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-08-26T00:15:34.475 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-08-26T00:15:34.475 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mon.c 2024-08-26T00:15:34.783 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:34 smithi181 systemd[1]: Stopping Ceph mon.c for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:15:35.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-c[22098]: 2024-08-26T00:15:34.836+0000 7fab13bca640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:15:35.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-c[22098]: 2024-08-26T00:15:34.836+0000 7fab13bca640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-08-26T00:15:35.284 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:35 smithi181 podman[57894]: 2024-08-26 00:15:35.080971454 +0000 UTC m=+0.377256070 container died d7280061e31326acb1d8d8d8047d2a5d5305a255e5d83b5480ad994213c448a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-c, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-f273685, ceph=True, GIT_CLEAN=True) 2024-08-26T00:15:35.729 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:35 smithi181 podman[57894]: 2024-08-26 00:15:35.461548339 +0000 UTC m=+0.757832958 container cleanup d7280061e31326acb1d8d8d8047d2a5d5305a255e5d83b5480ad994213c448a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-c, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, RELEASE=squid-f273685, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-26T00:15:35.729 INFO:journalctl@ceph.mon.c.smithi181.stdout:Aug 26 00:15:35 smithi181 bash[57894]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mon-c 2024-08-26T00:15:35.889 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mon.c.service' 2024-08-26T00:15:35.939 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:15:35.939 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-08-26T00:15:35.939 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-08-26T00:15:35.939 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mgr.x 2024-08-26T00:15:36.283 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 26 00:15:36 smithi042 systemd[1]: Stopping Ceph mgr.x for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:15:36.783 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 26 00:15:36 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-26T00:15:36.379+0000 7f1425400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:15:36.783 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 26 00:15:36 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x[17451]: 2024-08-26T00:15:36.379+0000 7f1425400640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-08-26T00:15:36.783 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 26 00:15:36 smithi042 podman[86153]: 2024-08-26 00:15:36.4629681 +0000 UTC m=+0.228109964 container died 375b4bd2b8cbb2786152a6ea330a2b9e627c46abd4750f23e46db423444a647d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f273685, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-08-26T00:15:37.187 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 26 00:15:36 smithi042 podman[86153]: 2024-08-26 00:15:36.96017033 +0000 UTC m=+0.725312198 container cleanup 375b4bd2b8cbb2786152a6ea330a2b9e627c46abd4750f23e46db423444a647d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x, RELEASE=squid-f273685, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True) 2024-08-26T00:15:37.188 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 26 00:15:36 smithi042 bash[86153]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x 2024-08-26T00:15:37.441 INFO:journalctl@ceph.mgr.x.smithi042.stdout:Aug 26 00:15:37 smithi042 podman[86165]: 2024-08-26 00:15:37.18737301 +0000 UTC m=+0.709682512 container remove 375b4bd2b8cbb2786152a6ea330a2b9e627c46abd4750f23e46db423444a647d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f273685f88d22802ccbd8a96b393734630028a13, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, RELEASE=squid-f273685, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-26T00:15:37.463 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mgr.x.service' 2024-08-26T00:15:37.536 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:15:37.536 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-08-26T00:15:37.536 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-08-26T00:15:37.537 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mgr.y 2024-08-26T00:15:37.860 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 26 00:15:37 smithi043 systemd[1]: Stopping Ceph mgr.y for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:15:38.124 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 26 00:15:37 smithi043 podman[58279]: 2024-08-26 00:15:37.859595931 +0000 UTC m=+0.119832085 container died 676365bc2567502b3c9fe0231a55c44b9a0da27e91a8b356676c1d2ad0d4edc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y, RELEASE=squid-f273685, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1) 2024-08-26T00:15:38.510 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 26 00:15:38 smithi043 podman[58279]: 2024-08-26 00:15:38.205609524 +0000 UTC m=+0.465845676 container cleanup 676365bc2567502b3c9fe0231a55c44b9a0da27e91a8b356676c1d2ad0d4edc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-f273685, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-08-26T00:15:38.510 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 26 00:15:38 smithi043 bash[58279]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y 2024-08-26T00:15:38.510 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 26 00:15:38 smithi043 podman[58292]: 2024-08-26 00:15:38.365310719 +0000 UTC m=+0.498104721 container remove 676365bc2567502b3c9fe0231a55c44b9a0da27e91a8b356676c1d2ad0d4edc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-f273685) 2024-08-26T00:15:38.511 INFO:journalctl@ceph.mgr.y.smithi043.stdout:Aug 26 00:15:38 smithi043 systemd[1]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-08-26T00:15:38.628 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mgr.y.service' 2024-08-26T00:15:38.662 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:15:38.662 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-08-26T00:15:38.662 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-08-26T00:15:38.662 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mgr.z 2024-08-26T00:15:39.034 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 26 00:15:38 smithi181 systemd[1]: Stopping Ceph mgr.z for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:15:39.441 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 26 00:15:39 smithi181 podman[58018]: 2024-08-26 00:15:39.187173532 +0000 UTC m=+0.323391057 container died 89be3d7353b3aa529ff3b7f72f93a9d5a4120c1c68986719ac919da1d1f6e4cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-f273685, GIT_BRANCH=HEAD) 2024-08-26T00:15:39.783 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 26 00:15:39 smithi181 podman[58018]: 2024-08-26 00:15:39.558071998 +0000 UTC m=+0.694289509 container cleanup 89be3d7353b3aa529ff3b7f72f93a9d5a4120c1c68986719ac919da1d1f6e4cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-f273685, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-26T00:15:39.783 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Aug 26 00:15:39 smithi181 bash[58018]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mgr-z 2024-08-26T00:15:39.987 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mgr.z.service' 2024-08-26T00:15:40.022 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:15:40.022 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-08-26T00:15:40.022 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-08-26T00:15:40.022 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.0 2024-08-26T00:15:40.428 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 26 00:15:40 smithi042 systemd[1]: Stopping Ceph osd.0 for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:15:40.783 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 26 00:15:40 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-0[31013]: 2024-08-26T00:15:40.426+0000 7ff737c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:15:40.783 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 26 00:15:40 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-0[31013]: 2024-08-26T00:15:40.426+0000 7ff737c00640 -1 osd.0 83 *** Got signal Terminated *** 2024-08-26T00:15:40.783 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 26 00:15:40 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-0[31013]: 2024-08-26T00:15:40.426+0000 7ff737c00640 -1 osd.0 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-26T00:15:46.243 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 26 00:15:45 smithi042 podman[86272]: 2024-08-26 00:15:45.948362941 +0000 UTC m=+5.641862670 container died 557db4a97cda1448004b93626b8a7d5926ec83a1570929f4a3220fd456142e4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, RELEASE=squid-f273685, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-08-26T00:15:46.500 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 26 00:15:46 smithi042 podman[86272]: 2024-08-26 00:15:46.465789683 +0000 UTC m=+6.159289451 container cleanup 557db4a97cda1448004b93626b8a7d5926ec83a1570929f4a3220fd456142e4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-f273685, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-26T00:15:46.500 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 26 00:15:46 smithi042 bash[86272]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-0 2024-08-26T00:15:46.783 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 26 00:15:46 smithi042 podman[86289]: 2024-08-26 00:15:46.725973131 +0000 UTC m=+0.765192048 container remove 557db4a97cda1448004b93626b8a7d5926ec83a1570929f4a3220fd456142e4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, RELEASE=squid-f273685, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True) 2024-08-26T00:15:47.533 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 26 00:15:47 smithi042 podman[86382]: 2024-08-26 00:15:47.175729327 +0000 UTC m=+0.027426810 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34 2024-08-26T00:15:47.533 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 26 00:15:47 smithi042 podman[86382]: 2024-08-26 00:15:47.310349501 +0000 UTC m=+0.162046978 container create 1dfca54ffab95d2f965d43ecc173cd87811e5ff45ee2dca1bb29542eafc4a55d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-0-deactivate, ceph=True, RELEASE=squid-f273685, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1) 2024-08-26T00:15:47.859 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 26 00:15:47 smithi042 podman[86382]: 2024-08-26 00:15:47.588538444 +0000 UTC m=+0.440235925 container init 1dfca54ffab95d2f965d43ecc173cd87811e5ff45ee2dca1bb29542eafc4a55d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-f273685, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-08-26T00:15:47.859 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 26 00:15:47 smithi042 podman[86382]: 2024-08-26 00:15:47.595427405 +0000 UTC m=+0.447124885 container start 1dfca54ffab95d2f965d43ecc173cd87811e5ff45ee2dca1bb29542eafc4a55d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-f273685, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-26T00:15:47.861 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 26 00:15:47 smithi042 podman[86382]: 2024-08-26 00:15:47.67987779 +0000 UTC m=+0.531575281 container attach 1dfca54ffab95d2f965d43ecc173cd87811e5ff45ee2dca1bb29542eafc4a55d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-f273685, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-26T00:15:47.861 INFO:journalctl@ceph.osd.0.smithi042.stdout:Aug 26 00:15:47 smithi042 podman[86382]: 2024-08-26 00:15:47.859006569 +0000 UTC m=+0.710704061 container died 1dfca54ffab95d2f965d43ecc173cd87811e5ff45ee2dca1bb29542eafc4a55d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-f273685, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-26T00:15:48.621 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.0.service' 2024-08-26T00:15:48.702 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:15:48.702 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-08-26T00:15:48.702 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-08-26T00:15:48.702 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.1 2024-08-26T00:15:49.010 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 26 00:15:48 smithi043 systemd[1]: Stopping Ceph osd.1 for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:15:49.510 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 26 00:15:49 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-1[26524]: 2024-08-26T00:15:49.051+0000 7fa0f2c37640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:15:49.510 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 26 00:15:49 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-1[26524]: 2024-08-26T00:15:49.051+0000 7fa0f2c37640 -1 osd.1 83 *** Got signal Terminated *** 2024-08-26T00:15:49.510 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 26 00:15:49 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-1[26524]: 2024-08-26T00:15:49.051+0000 7fa0f2c37640 -1 osd.1 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-26T00:15:54.853 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 26 00:15:54 smithi043 podman[58402]: 2024-08-26 00:15:54.599985079 +0000 UTC m=+5.680368324 container died 6eee71876f3533356eaf1b8faa4116d3c528d0f0d7fc32f7683856212facdb6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-f273685, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-08-26T00:15:55.244 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 26 00:15:54 smithi043 podman[58402]: 2024-08-26 00:15:54.951197001 +0000 UTC m=+6.031580239 container cleanup 6eee71876f3533356eaf1b8faa4116d3c528d0f0d7fc32f7683856212facdb6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-1, org.label-schema.build-date=20240731, RELEASE=squid-f273685, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-26T00:15:55.245 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 26 00:15:54 smithi043 bash[58402]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-1 2024-08-26T00:15:55.510 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 26 00:15:55 smithi043 podman[58429]: 2024-08-26 00:15:55.244650145 +0000 UTC m=+0.644396522 container remove 6eee71876f3533356eaf1b8faa4116d3c528d0f0d7fc32f7683856212facdb6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f273685, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1) 2024-08-26T00:15:55.865 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 26 00:15:55 smithi043 podman[58521]: 2024-08-26 00:15:55.488126316 +0000 UTC m=+0.015615417 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34 2024-08-26T00:15:55.865 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 26 00:15:55 smithi043 podman[58521]: 2024-08-26 00:15:55.604206442 +0000 UTC m=+0.131695577 container create 2b0210e35d1cb1ce6a5a155aa60eb5c64a317c88ee808f0e6353f8daaedafe5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-f273685, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.1) 2024-08-26T00:15:55.865 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 26 00:15:55 smithi043 podman[58521]: 2024-08-26 00:15:55.865012575 +0000 UTC m=+0.392501664 container init 2b0210e35d1cb1ce6a5a155aa60eb5c64a317c88ee808f0e6353f8daaedafe5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-f273685, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-08-26T00:15:56.183 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 26 00:15:55 smithi043 podman[58521]: 2024-08-26 00:15:55.868501991 +0000 UTC m=+0.395991080 container start 2b0210e35d1cb1ce6a5a155aa60eb5c64a317c88ee808f0e6353f8daaedafe5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-f273685, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-08-26T00:15:56.184 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 26 00:15:55 smithi043 podman[58521]: 2024-08-26 00:15:55.981926004 +0000 UTC m=+0.509415103 container attach 2b0210e35d1cb1ce6a5a155aa60eb5c64a317c88ee808f0e6353f8daaedafe5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-f273685, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-26T00:15:56.468 INFO:journalctl@ceph.osd.1.smithi043.stdout:Aug 26 00:15:56 smithi043 podman[58521]: 2024-08-26 00:15:56.183386183 +0000 UTC m=+0.710875277 container died 2b0210e35d1cb1ce6a5a155aa60eb5c64a317c88ee808f0e6353f8daaedafe5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-f273685, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-08-26T00:15:56.744 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.1.service' 2024-08-26T00:15:56.786 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:15:56.786 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-08-26T00:15:56.786 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-08-26T00:15:56.787 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.2 2024-08-26T00:15:57.171 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 26 00:15:56 smithi181 systemd[1]: Stopping Ceph osd.2 for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:15:57.533 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 26 00:15:57 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-2[27056]: 2024-08-26T00:15:57.169+0000 7fe241af6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:15:57.534 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 26 00:15:57 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-2[27056]: 2024-08-26T00:15:57.169+0000 7fe241af6640 -1 osd.2 83 *** Got signal Terminated *** 2024-08-26T00:15:57.534 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 26 00:15:57 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-2[27056]: 2024-08-26T00:15:57.169+0000 7fe241af6640 -1 osd.2 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-26T00:16:02.897 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 26 00:16:02 smithi181 podman[58144]: 2024-08-26 00:16:02.613367905 +0000 UTC m=+5.624970684 container died 86cc15547eaa9baa8de55d6635b2946b851acd2c90d6df9957cb36b531805680 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, RELEASE=squid-f273685, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-26T00:16:03.254 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 26 00:16:02 smithi181 podman[58144]: 2024-08-26 00:16:02.994639762 +0000 UTC m=+6.006242530 container cleanup 86cc15547eaa9baa8de55d6635b2946b851acd2c90d6df9957cb36b531805680 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-f273685, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-08-26T00:16:03.254 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 26 00:16:02 smithi181 bash[58144]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-2 2024-08-26T00:16:03.533 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 26 00:16:03 smithi181 podman[58172]: 2024-08-26 00:16:03.254408119 +0000 UTC m=+0.637198539 container remove 86cc15547eaa9baa8de55d6635b2946b851acd2c90d6df9957cb36b531805680 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-f273685, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-26T00:16:03.866 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 26 00:16:03 smithi181 podman[58256]: 2024-08-26 00:16:03.555273705 +0000 UTC m=+0.109063532 container create 066a6f949ac3b97f63a623b0d73c958ae3185df55df951fa3e98ce97e0a88580 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-2-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f273685, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-26T00:16:03.867 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 26 00:16:03 smithi181 podman[58256]: 2024-08-26 00:16:03.46207568 +0000 UTC m=+0.015865479 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34 2024-08-26T00:16:03.867 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 26 00:16:03 smithi181 podman[58256]: 2024-08-26 00:16:03.766248343 +0000 UTC m=+0.320038127 container init 066a6f949ac3b97f63a623b0d73c958ae3185df55df951fa3e98ce97e0a88580 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f273685, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-08-26T00:16:03.867 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 26 00:16:03 smithi181 podman[58256]: 2024-08-26 00:16:03.769698047 +0000 UTC m=+0.323487833 container start 066a6f949ac3b97f63a623b0d73c958ae3185df55df951fa3e98ce97e0a88580 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f273685, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-26T00:16:03.867 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 26 00:16:03 smithi181 podman[58256]: 2024-08-26 00:16:03.866348303 +0000 UTC m=+0.420138100 container attach 066a6f949ac3b97f63a623b0d73c958ae3185df55df951fa3e98ce97e0a88580 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-f273685, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-08-26T00:16:04.283 INFO:journalctl@ceph.osd.2.smithi181.stdout:Aug 26 00:16:04 smithi181 podman[58256]: 2024-08-26 00:16:04.007756328 +0000 UTC m=+0.561546139 container died 066a6f949ac3b97f63a623b0d73c958ae3185df55df951fa3e98ce97e0a88580 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f273685, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0) 2024-08-26T00:16:04.602 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.2.service' 2024-08-26T00:16:04.642 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:16:04.642 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-08-26T00:16:04.642 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-08-26T00:16:04.642 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.3 2024-08-26T00:16:05.033 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 26 00:16:04 smithi042 systemd[1]: Stopping Ceph osd.3 for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:16:05.533 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 26 00:16:05 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-3[37508]: 2024-08-26T00:16:05.082+0000 7f9198200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:16:05.533 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 26 00:16:05 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-3[37508]: 2024-08-26T00:16:05.082+0000 7f9198200640 -1 osd.3 83 *** Got signal Terminated *** 2024-08-26T00:16:05.533 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 26 00:16:05 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-3[37508]: 2024-08-26T00:16:05.082+0000 7f9198200640 -1 osd.3 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-26T00:16:07.284 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:06 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:06.904+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.842110+0000 front 2024-08-26T00:15:42.841902+0000 (oldest deadline 2024-08-26T00:16:06.341971+0000) 2024-08-26T00:16:08.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:07 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:07.947+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:08.284 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:07 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:07.944+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.842110+0000 front 2024-08-26T00:15:42.841902+0000 (oldest deadline 2024-08-26T00:16:06.341971+0000) 2024-08-26T00:16:08.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:07 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:07.792+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:09.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:08 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:08.930+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:09.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:08 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:08.929+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:09.284 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:08 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:08.973+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.842110+0000 front 2024-08-26T00:15:42.841902+0000 (oldest deadline 2024-08-26T00:16:06.341971+0000) 2024-08-26T00:16:09.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:08 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:08.832+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:10.270 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:09 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:09.902+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:10.294 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:09 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:09.920+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:10.294 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:09 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:09.950+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.842110+0000 front 2024-08-26T00:15:42.841902+0000 (oldest deadline 2024-08-26T00:16:06.341971+0000) 2024-08-26T00:16:10.295 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:09 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:09.852+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:10.914 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 26 00:16:10 smithi042 podman[86496]: 2024-08-26 00:16:10.625070033 +0000 UTC m=+5.681881330 container died e11f56fba6a64f64e072ca5bf83ccf1db9899603e25d742589193e027fbae345 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-3, RELEASE=squid-f273685, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.1) 2024-08-26T00:16:11.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:10 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:10.882+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:11.272 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 26 00:16:11 smithi042 podman[86496]: 2024-08-26 00:16:11.07076633 +0000 UTC m=+6.127577626 container cleanup e11f56fba6a64f64e072ca5bf83ccf1db9899603e25d742589193e027fbae345 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-f273685, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-08-26T00:16:11.272 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 26 00:16:11 smithi042 bash[86496]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-3 2024-08-26T00:16:11.272 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:10 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:10.945+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:11.283 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:10 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:10.996+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.842110+0000 front 2024-08-26T00:15:42.841902+0000 (oldest deadline 2024-08-26T00:16:06.341971+0000) 2024-08-26T00:16:11.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:10 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:10.876+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:11.533 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 26 00:16:11 smithi042 podman[86512]: 2024-08-26 00:16:11.271896669 +0000 UTC m=+0.642725668 container remove e11f56fba6a64f64e072ca5bf83ccf1db9899603e25d742589193e027fbae345 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, RELEASE=squid-f273685, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-26T00:16:11.940 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 26 00:16:11 smithi042 podman[86599]: 2024-08-26 00:16:11.746592423 +0000 UTC m=+0.028162444 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34 2024-08-26T00:16:11.940 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 26 00:16:11 smithi042 podman[86599]: 2024-08-26 00:16:11.856273075 +0000 UTC m=+0.137843083 container create b05aa0115c3ba233218b3401f08510bde5f751296797697f91f3a28b977c369c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-f273685, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-08-26T00:16:11.940 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:11 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:11.671+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.379716+0000 front 2024-08-26T00:15:45.379772+0000 (oldest deadline 2024-08-26T00:16:11.279975+0000) 2024-08-26T00:16:12.218 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:11 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:11.939+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:12.218 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 26 00:16:12 smithi042 podman[86599]: 2024-08-26 00:16:12.126366185 +0000 UTC m=+0.407936194 container init b05aa0115c3ba233218b3401f08510bde5f751296797697f91f3a28b977c369c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-f273685, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, ceph=True, org.label-schema.build-date=20240731) 2024-08-26T00:16:12.218 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 26 00:16:12 smithi042 podman[86599]: 2024-08-26 00:16:12.133204799 +0000 UTC m=+0.414774815 container start b05aa0115c3ba233218b3401f08510bde5f751296797697f91f3a28b977c369c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-f273685, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-08-26T00:16:12.218 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 26 00:16:12 smithi042 podman[86599]: 2024-08-26 00:16:12.217776357 +0000 UTC m=+0.499346366 container attach b05aa0115c3ba233218b3401f08510bde5f751296797697f91f3a28b977c369c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-f273685, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.1) 2024-08-26T00:16:12.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:11 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:11.885+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:12.283 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:11 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:11.966+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.842110+0000 front 2024-08-26T00:15:42.841902+0000 (oldest deadline 2024-08-26T00:16:06.341971+0000) 2024-08-26T00:16:12.283 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:11 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:11.843+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:12.533 INFO:journalctl@ceph.osd.3.smithi042.stdout:Aug 26 00:16:12 smithi042 podman[86622]: 2024-08-26 00:16:12.443302811 +0000 UTC m=+0.027291218 container died b05aa0115c3ba233218b3401f08510bde5f751296797697f91f3a28b977c369c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-f273685) 2024-08-26T00:16:12.979 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:12 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:12.720+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.379716+0000 front 2024-08-26T00:15:45.379772+0000 (oldest deadline 2024-08-26T00:16:11.279975+0000) 2024-08-26T00:16:13.062 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.3.service' 2024-08-26T00:16:13.141 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:16:13.141 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-08-26T00:16:13.141 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-08-26T00:16:13.141 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.4 2024-08-26T00:16:13.169 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:12 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:12.872+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:13.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:12 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:12.978+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:13.283 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:12 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:12.942+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.842110+0000 front 2024-08-26T00:15:42.841902+0000 (oldest deadline 2024-08-26T00:16:06.341971+0000) 2024-08-26T00:16:13.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:12 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:12.871+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:13.446 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:16:13 smithi043 systemd[1]: Stopping Ceph osd.4 for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:16:13.760 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:16:13 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-4[33459]: 2024-08-26T00:16:13.445+0000 7fcc6b018640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:16:13.760 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:16:13 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-4[33459]: 2024-08-26T00:16:13.445+0000 7fcc6b018640 -1 osd.4 83 *** Got signal Terminated *** 2024-08-26T00:16:13.760 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:16:13 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-4[33459]: 2024-08-26T00:16:13.445+0000 7fcc6b018640 -1 osd.4 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-26T00:16:14.033 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:13 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:13.740+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.379716+0000 front 2024-08-26T00:15:45.379772+0000 (oldest deadline 2024-08-26T00:16:11.279975+0000) 2024-08-26T00:16:14.033 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:13 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:13.984+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:14.096 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:13 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:13.950+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.842110+0000 front 2024-08-26T00:15:42.841902+0000 (oldest deadline 2024-08-26T00:16:06.341971+0000) 2024-08-26T00:16:14.096 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:13 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:13.836+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:14.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:13 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:13.905+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:15.033 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:14 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:14.781+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.379716+0000 front 2024-08-26T00:15:45.379772+0000 (oldest deadline 2024-08-26T00:16:11.279975+0000) 2024-08-26T00:16:15.033 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:14 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:14.979+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:15.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:14 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:14.947+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:15.283 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:14 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:14.808+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:15.284 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:14 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:14.969+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.842110+0000 front 2024-08-26T00:15:42.841902+0000 (oldest deadline 2024-08-26T00:16:06.341971+0000) 2024-08-26T00:16:16.033 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:15 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:15.747+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.379716+0000 front 2024-08-26T00:15:45.379772+0000 (oldest deadline 2024-08-26T00:16:11.279975+0000) 2024-08-26T00:16:16.033 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:15 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:15.954+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:16.159 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:15 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:15.787+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:16.159 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:15 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:15.988+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.842110+0000 front 2024-08-26T00:15:42.841902+0000 (oldest deadline 2024-08-26T00:16:06.341971+0000) 2024-08-26T00:16:16.159 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:15 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:15.988+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:50.343830+0000 front 2024-08-26T00:15:50.343871+0000 (oldest deadline 2024-08-26T00:16:15.043764+0000) 2024-08-26T00:16:16.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:15 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:15.931+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:16.533 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:16 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:16.158+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:17.033 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:16 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:16.736+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.379716+0000 front 2024-08-26T00:15:45.379772+0000 (oldest deadline 2024-08-26T00:16:11.279975+0000) 2024-08-26T00:16:17.034 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:16 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:16.978+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:17.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:16 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:16.760+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:17.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:16 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:16.760+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:17.035 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:17 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:17.005+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.842110+0000 front 2024-08-26T00:15:42.841902+0000 (oldest deadline 2024-08-26T00:16:06.341971+0000) 2024-08-26T00:16:17.035 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:17 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:17.005+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:50.343830+0000 front 2024-08-26T00:15:50.343871+0000 (oldest deadline 2024-08-26T00:16:15.043764+0000) 2024-08-26T00:16:17.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:16 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:16.936+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:17.533 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:17 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:17.169+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:18.019 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:17 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:17.761+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.379716+0000 front 2024-08-26T00:15:45.379772+0000 (oldest deadline 2024-08-26T00:16:11.279975+0000) 2024-08-26T00:16:18.019 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:17 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:17.761+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:51.280770+0000 front 2024-08-26T00:15:51.280733+0000 (oldest deadline 2024-08-26T00:16:17.180977+0000) 2024-08-26T00:16:18.123 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:17 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:17.810+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:18.123 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:17 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:17.810+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:18.123 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:18 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:18.024+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.842110+0000 front 2024-08-26T00:15:42.841902+0000 (oldest deadline 2024-08-26T00:16:06.341971+0000) 2024-08-26T00:16:18.123 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:18 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:18.024+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:50.343830+0000 front 2024-08-26T00:15:50.343871+0000 (oldest deadline 2024-08-26T00:16:15.043764+0000) 2024-08-26T00:16:18.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:17 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:17.977+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:18.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:18 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:18.018+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:18.533 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:18 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:18.122+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:19.033 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:18 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:18.723+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.379716+0000 front 2024-08-26T00:15:45.379772+0000 (oldest deadline 2024-08-26T00:16:11.279975+0000) 2024-08-26T00:16:19.033 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:18 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:18.723+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:51.280770+0000 front 2024-08-26T00:15:51.280733+0000 (oldest deadline 2024-08-26T00:16:17.180977+0000) 2024-08-26T00:16:19.107 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:18 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:18.827+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:19.107 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:18 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:18.828+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:19.107 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:19 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:19.014+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.842110+0000 front 2024-08-26T00:15:42.841902+0000 (oldest deadline 2024-08-26T00:16:06.341971+0000) 2024-08-26T00:16:19.108 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:19 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:19.014+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:50.343830+0000 front 2024-08-26T00:15:50.343871+0000 (oldest deadline 2024-08-26T00:16:15.043764+0000) 2024-08-26T00:16:19.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:18 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:18.933+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:19.260 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:16:19 smithi043 podman[58627]: 2024-08-26 00:16:19.014992844 +0000 UTC m=+5.674258225 container died 85064d8bca561e53ff9fb4214d410c4f4b2a6d366a61ef2e688bcbb8d0821a54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-f273685) 2024-08-26T00:16:19.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:19 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:19.050+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:19.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:19 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:19.050+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:19.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:19 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:19.106+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:19.615 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:16:19 smithi043 podman[58627]: 2024-08-26 00:16:19.354271347 +0000 UTC m=+6.013536725 container cleanup 85064d8bca561e53ff9fb4214d410c4f4b2a6d366a61ef2e688bcbb8d0821a54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-4, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-f273685, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-08-26T00:16:19.615 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:16:19 smithi043 bash[58627]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-4 2024-08-26T00:16:19.957 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:16:19 smithi043 podman[58644]: 2024-08-26 00:16:19.613992195 +0000 UTC m=+0.597604676 container remove 85064d8bca561e53ff9fb4214d410c4f4b2a6d366a61ef2e688bcbb8d0821a54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-f273685, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-26T00:16:20.033 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:19 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:19.746+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.379716+0000 front 2024-08-26T00:15:45.379772+0000 (oldest deadline 2024-08-26T00:16:11.279975+0000) 2024-08-26T00:16:20.033 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:19 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:19.746+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:51.280770+0000 front 2024-08-26T00:15:51.280733+0000 (oldest deadline 2024-08-26T00:16:17.180977+0000) 2024-08-26T00:16:20.132 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:19 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:19.794+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:20.132 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:19 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:19.794+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:20.132 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:20 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:20.013+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.842110+0000 front 2024-08-26T00:15:42.841902+0000 (oldest deadline 2024-08-26T00:16:06.341971+0000) 2024-08-26T00:16:20.132 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:20 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:20.013+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:50.343830+0000 front 2024-08-26T00:15:50.343871+0000 (oldest deadline 2024-08-26T00:16:15.043764+0000) 2024-08-26T00:16:20.227 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:19 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:19.955+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:20.228 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:19 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:19.955+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:20.228 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:16:19 smithi043 podman[58733]: 2024-08-26 00:16:19.998149392 +0000 UTC m=+0.096532531 container create 3cff53827f36b71acad4e482ab4643bf99c9e72c84e957bcd1711193ee421bc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-f273685, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-08-26T00:16:20.228 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:16:20 smithi043 podman[58733]: 2024-08-26 00:16:19.918558511 +0000 UTC m=+0.016941645 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34 2024-08-26T00:16:20.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:20 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:20.309+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.690248+0000 front 2024-08-26T00:15:53.690280+0000 (oldest deadline 2024-08-26T00:16:19.590409+0000) 2024-08-26T00:16:20.511 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:16:20 smithi043 podman[58733]: 2024-08-26 00:16:20.225769032 +0000 UTC m=+0.324152168 container init 3cff53827f36b71acad4e482ab4643bf99c9e72c84e957bcd1711193ee421bc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-f273685) 2024-08-26T00:16:20.511 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:16:20 smithi043 podman[58733]: 2024-08-26 00:16:20.229229103 +0000 UTC m=+0.327612236 container start 3cff53827f36b71acad4e482ab4643bf99c9e72c84e957bcd1711193ee421bc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, RELEASE=squid-f273685, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-08-26T00:16:20.511 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:16:20 smithi043 podman[58733]: 2024-08-26 00:16:20.309223288 +0000 UTC m=+0.407606436 container attach 3cff53827f36b71acad4e482ab4643bf99c9e72c84e957bcd1711193ee421bc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_CLEAN=True, RELEASE=squid-f273685, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-08-26T00:16:20.511 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:16:20 smithi043 podman[58733]: 2024-08-26 00:16:20.418222565 +0000 UTC m=+0.516605699 container died 3cff53827f36b71acad4e482ab4643bf99c9e72c84e957bcd1711193ee421bc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-f273685, io.buildah.version=1.37.1, org.label-schema.license=GPLv2) 2024-08-26T00:16:20.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:20 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:20.089+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:20.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:20 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:20.089+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:20.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:20 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:20.130+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:20.959 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.4.service' 2024-08-26T00:16:20.973 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:16:20 smithi043 podman[58756]: 2024-08-26 00:16:20.937608187 +0000 UTC m=+0.512953142 container remove 3cff53827f36b71acad4e482ab4643bf99c9e72c84e957bcd1711193ee421bc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-f273685, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-08-26T00:16:20.973 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:16:20 smithi043 systemd[1]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.4.service: Deactivated successfully. 2024-08-26T00:16:20.973 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:16:20 smithi043 systemd[1]: Stopped Ceph osd.4 for f89d317a-633c-11ef-bcd2-c7b262605968. 2024-08-26T00:16:20.973 INFO:journalctl@ceph.osd.4.smithi043.stdout:Aug 26 00:16:20 smithi043 systemd[1]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.4.service: Consumed 2min 23.324s CPU time. 2024-08-26T00:16:21.014 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:16:21.014 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-08-26T00:16:21.014 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-08-26T00:16:21.015 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.5 2024-08-26T00:16:21.033 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:20 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:20.770+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.379716+0000 front 2024-08-26T00:15:45.379772+0000 (oldest deadline 2024-08-26T00:16:11.279975+0000) 2024-08-26T00:16:21.033 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:20 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:20.770+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:51.280770+0000 front 2024-08-26T00:15:51.280733+0000 (oldest deadline 2024-08-26T00:16:17.180977+0000) 2024-08-26T00:16:21.151 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:20 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:20.832+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:21.151 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:20 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:20.832+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:21.151 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:20 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:20.969+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.842110+0000 front 2024-08-26T00:15:42.841902+0000 (oldest deadline 2024-08-26T00:16:06.341971+0000) 2024-08-26T00:16:21.151 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:20 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:20.969+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:50.343830+0000 front 2024-08-26T00:15:50.343871+0000 (oldest deadline 2024-08-26T00:16:15.043764+0000) 2024-08-26T00:16:21.151 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:21 smithi181 systemd[1]: Stopping Ceph osd.5 for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:16:21.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:20 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:20.971+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:21.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:20 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:20.971+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:21.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:21 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:21.098+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:21.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:21 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:21.098+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:21.534 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:21 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:21.314+0000 7f65c5af9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:16:21.534 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:21 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:21.314+0000 7f65c5af9640 -1 osd.5 83 *** Got signal Terminated *** 2024-08-26T00:16:21.534 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:21 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:21.314+0000 7f65c5af9640 -1 osd.5 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-26T00:16:21.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:21 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:21.150+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:21.760 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:21 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:21.334+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.690248+0000 front 2024-08-26T00:15:53.690280+0000 (oldest deadline 2024-08-26T00:16:19.590409+0000) 2024-08-26T00:16:22.076 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:21 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:21.793+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.379716+0000 front 2024-08-26T00:15:45.379772+0000 (oldest deadline 2024-08-26T00:16:11.279975+0000) 2024-08-26T00:16:22.077 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:21 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:21.793+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:51.280770+0000 front 2024-08-26T00:15:51.280733+0000 (oldest deadline 2024-08-26T00:16:17.180977+0000) 2024-08-26T00:16:22.106 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:21 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:21.989+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.842110+0000 front 2024-08-26T00:15:42.841902+0000 (oldest deadline 2024-08-26T00:16:06.341971+0000) 2024-08-26T00:16:22.106 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:21 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:21.989+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:50.343830+0000 front 2024-08-26T00:15:50.343871+0000 (oldest deadline 2024-08-26T00:16:15.043764+0000) 2024-08-26T00:16:22.107 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:21 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:21.845+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:22.107 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:21 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:21.845+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:22.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:21 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:21.937+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:22.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:21 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:21.937+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:22.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:22 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:22.076+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:22.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:22 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:22.076+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:22.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:22 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:22.105+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:22.760 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:22 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:22.301+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.690248+0000 front 2024-08-26T00:15:53.690280+0000 (oldest deadline 2024-08-26T00:16:19.590409+0000) 2024-08-26T00:16:23.118 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:22 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:22.796+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.379716+0000 front 2024-08-26T00:15:45.379772+0000 (oldest deadline 2024-08-26T00:16:11.279975+0000) 2024-08-26T00:16:23.118 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:22 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:22.796+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:51.280770+0000 front 2024-08-26T00:15:51.280733+0000 (oldest deadline 2024-08-26T00:16:17.180977+0000) 2024-08-26T00:16:23.142 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:23 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:23.022+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.842110+0000 front 2024-08-26T00:15:42.841902+0000 (oldest deadline 2024-08-26T00:16:06.341971+0000) 2024-08-26T00:16:23.142 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:23 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:23.023+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:50.343830+0000 front 2024-08-26T00:15:50.343871+0000 (oldest deadline 2024-08-26T00:16:15.043764+0000) 2024-08-26T00:16:23.142 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:22 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:22.860+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:23.142 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:22 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:22.860+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:23.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:22 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:22.984+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:23.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:22 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:22.984+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:23.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:23 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:23.116+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:23.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:23 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:23.116+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:23.533 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:23 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:23.141+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:23.533 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:23 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:23.141+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:23.760 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:23 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:23.343+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.690248+0000 front 2024-08-26T00:15:53.690280+0000 (oldest deadline 2024-08-26T00:16:19.590409+0000) 2024-08-26T00:16:24.129 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:24 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:24.022+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.842110+0000 front 2024-08-26T00:15:42.841902+0000 (oldest deadline 2024-08-26T00:16:06.341971+0000) 2024-08-26T00:16:24.129 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:24 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:24.022+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:50.343830+0000 front 2024-08-26T00:15:50.343871+0000 (oldest deadline 2024-08-26T00:16:15.043764+0000) 2024-08-26T00:16:24.130 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:23 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:23.849+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:24.130 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:23 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:23.849+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:24.136 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:23 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:23.810+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.379716+0000 front 2024-08-26T00:15:45.379772+0000 (oldest deadline 2024-08-26T00:16:11.279975+0000) 2024-08-26T00:16:24.136 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:23 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:23.810+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:51.280770+0000 front 2024-08-26T00:15:51.280733+0000 (oldest deadline 2024-08-26T00:16:17.180977+0000) 2024-08-26T00:16:24.136 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:23 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:23.810+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:57.181828+0000 front 2024-08-26T00:15:57.181692+0000 (oldest deadline 2024-08-26T00:16:22.982598+0000) 2024-08-26T00:16:24.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:23 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:23.992+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:24.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:23 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:23.992+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:24.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:23 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:23.992+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:24.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:24 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:24.134+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:24.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:24 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:24.134+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:24.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:24 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:24.134+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:24.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:24 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:24.128+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:24.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:24 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:24.128+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:24.760 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:24 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:24.346+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.690248+0000 front 2024-08-26T00:15:53.690280+0000 (oldest deadline 2024-08-26T00:16:19.590409+0000) 2024-08-26T00:16:24.760 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:24 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:24.346+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.591071+0000 front 2024-08-26T00:15:59.591004+0000 (oldest deadline 2024-08-26T00:16:24.291093+0000) 2024-08-26T00:16:25.095 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:24 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:24.824+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.379716+0000 front 2024-08-26T00:15:45.379772+0000 (oldest deadline 2024-08-26T00:16:11.279975+0000) 2024-08-26T00:16:25.096 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:24 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:24.824+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:51.280770+0000 front 2024-08-26T00:15:51.280733+0000 (oldest deadline 2024-08-26T00:16:17.180977+0000) 2024-08-26T00:16:25.096 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:24 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:24.824+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:57.181828+0000 front 2024-08-26T00:15:57.181692+0000 (oldest deadline 2024-08-26T00:16:22.982598+0000) 2024-08-26T00:16:25.099 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:25 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:25.039+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.842110+0000 front 2024-08-26T00:15:42.841902+0000 (oldest deadline 2024-08-26T00:16:06.341971+0000) 2024-08-26T00:16:25.099 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:25 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:25.039+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:50.343830+0000 front 2024-08-26T00:15:50.343871+0000 (oldest deadline 2024-08-26T00:16:15.043764+0000) 2024-08-26T00:16:25.100 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:24 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:24.800+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:25.100 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:24 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:24.800+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:25.100 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:24 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:24.800+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:25.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:24 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:24.979+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:25.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:24 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:24.979+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:25.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:24 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:24.979+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:25.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:25 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:25.094+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:25.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:25 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:25.094+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:25.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:25 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:25.094+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:25.533 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:25 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:25.099+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:25.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:25 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:25.099+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:25.760 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:25 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:25.372+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.690248+0000 front 2024-08-26T00:15:53.690280+0000 (oldest deadline 2024-08-26T00:16:19.590409+0000) 2024-08-26T00:16:25.760 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:25 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:25.372+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.591071+0000 front 2024-08-26T00:15:59.591004+0000 (oldest deadline 2024-08-26T00:16:24.291093+0000) 2024-08-26T00:16:26.031 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:25 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:25.775+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:26.031 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:25 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:25.775+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:26.031 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:25 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:25.775+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:26.127 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:25 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:25.784+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.379716+0000 front 2024-08-26T00:15:45.379772+0000 (oldest deadline 2024-08-26T00:16:11.279975+0000) 2024-08-26T00:16:26.127 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:25 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:25.784+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:51.280770+0000 front 2024-08-26T00:15:51.280733+0000 (oldest deadline 2024-08-26T00:16:17.180977+0000) 2024-08-26T00:16:26.127 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:25 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:25.784+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:57.181828+0000 front 2024-08-26T00:15:57.181692+0000 (oldest deadline 2024-08-26T00:16:22.982598+0000) 2024-08-26T00:16:26.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:25 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:25.976+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:26.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:25 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:25.976+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:26.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:25 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:25.976+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:26.283 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:26 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:26.030+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.842110+0000 front 2024-08-26T00:15:42.841902+0000 (oldest deadline 2024-08-26T00:16:06.341971+0000) 2024-08-26T00:16:26.284 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:26 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5[33844]: 2024-08-26T00:16:26.030+0000 7f65c20fe640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:50.343830+0000 front 2024-08-26T00:15:50.343871+0000 (oldest deadline 2024-08-26T00:16:15.043764+0000) 2024-08-26T00:16:26.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:26 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:26.063+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:26.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:26 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:26.063+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:26.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:26 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:26.126+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:26.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:26 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:26.126+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:26.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:26 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:26.126+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:26.760 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:26 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:26.372+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.690248+0000 front 2024-08-26T00:15:53.690280+0000 (oldest deadline 2024-08-26T00:16:19.590409+0000) 2024-08-26T00:16:26.760 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:26 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:26.372+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.591071+0000 front 2024-08-26T00:15:59.591004+0000 (oldest deadline 2024-08-26T00:16:24.291093+0000) 2024-08-26T00:16:27.033 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:26 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:26.741+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.379716+0000 front 2024-08-26T00:15:45.379772+0000 (oldest deadline 2024-08-26T00:16:11.279975+0000) 2024-08-26T00:16:27.033 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:26 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:26.741+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:51.280770+0000 front 2024-08-26T00:15:51.280733+0000 (oldest deadline 2024-08-26T00:16:17.180977+0000) 2024-08-26T00:16:27.033 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:26 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:26.741+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:57.181828+0000 front 2024-08-26T00:15:57.181692+0000 (oldest deadline 2024-08-26T00:16:22.982598+0000) 2024-08-26T00:16:27.034 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:26 smithi181 podman[58359]: 2024-08-26 00:16:26.754627113 +0000 UTC m=+5.544305692 container died 99fdcc55ec680925f8117ba2e55d4f240cfb4f97879a08fe5aa54d158b502483 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-f273685, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-08-26T00:16:27.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:26 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:26.793+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:27.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:26 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:26.793+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:27.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:26 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:26.793+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:27.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:27 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:27.003+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:27.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:27 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:27.003+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:27.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:27 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:27.003+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:27.375 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:27 smithi181 podman[58359]: 2024-08-26 00:16:27.147252572 +0000 UTC m=+5.936931147 container cleanup 99fdcc55ec680925f8117ba2e55d4f240cfb4f97879a08fe5aa54d158b502483 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-f273685, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True) 2024-08-26T00:16:27.375 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:27 smithi181 bash[58359]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5 2024-08-26T00:16:27.376 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:27 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:27.049+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:27.376 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:27 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:27.049+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:27.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:27 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:27.085+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:27.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:27 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:27.085+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:27.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:27 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:27.085+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:27.683 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:27 smithi181 podman[58385]: 2024-08-26 00:16:27.373599202 +0000 UTC m=+0.618055087 container remove 99fdcc55ec680925f8117ba2e55d4f240cfb4f97879a08fe5aa54d158b502483 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-f273685, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-08-26T00:16:27.760 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:27 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:27.334+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.690248+0000 front 2024-08-26T00:15:53.690280+0000 (oldest deadline 2024-08-26T00:16:19.590409+0000) 2024-08-26T00:16:27.760 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:27 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:27.334+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.591071+0000 front 2024-08-26T00:15:59.591004+0000 (oldest deadline 2024-08-26T00:16:24.291093+0000) 2024-08-26T00:16:27.943 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:27 smithi181 podman[58476]: 2024-08-26 00:16:27.586071755 +0000 UTC m=+0.015668467 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34 2024-08-26T00:16:27.943 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:27 smithi181 podman[58476]: 2024-08-26 00:16:27.707831229 +0000 UTC m=+0.137427941 container create 476228ed507b20042217c8bf534983c97667482104515155ff305113639405a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f273685, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.license=GPLv2) 2024-08-26T00:16:27.944 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:27 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:27.787+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:27.944 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:27 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:27.787+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:27.944 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:27 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:27.787+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:28.033 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:27 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:27.777+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.379716+0000 front 2024-08-26T00:15:45.379772+0000 (oldest deadline 2024-08-26T00:16:11.279975+0000) 2024-08-26T00:16:28.033 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:27 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:27.777+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:51.280770+0000 front 2024-08-26T00:15:51.280733+0000 (oldest deadline 2024-08-26T00:16:17.180977+0000) 2024-08-26T00:16:28.033 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:27 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:27.777+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:57.181828+0000 front 2024-08-26T00:15:57.181692+0000 (oldest deadline 2024-08-26T00:16:22.982598+0000) 2024-08-26T00:16:28.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:28 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:28.036+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:28.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:28 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:28.036+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:28.284 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:27 smithi181 podman[58476]: 2024-08-26 00:16:27.943438441 +0000 UTC m=+0.373035165 container init 476228ed507b20042217c8bf534983c97667482104515155ff305113639405a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-f273685, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-08-26T00:16:28.285 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:27 smithi181 podman[58476]: 2024-08-26 00:16:27.946870736 +0000 UTC m=+0.376467449 container start 476228ed507b20042217c8bf534983c97667482104515155ff305113639405a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-f273685, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=) 2024-08-26T00:16:28.285 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:28 smithi181 podman[58476]: 2024-08-26 00:16:28.026617012 +0000 UTC m=+0.456213740 container attach 476228ed507b20042217c8bf534983c97667482104515155ff305113639405a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-f273685, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-26T00:16:28.285 INFO:journalctl@ceph.osd.5.smithi181.stdout:Aug 26 00:16:28 smithi181 podman[58499]: 2024-08-26 00:16:28.162570527 +0000 UTC m=+0.017121372 container died 476228ed507b20042217c8bf534983c97667482104515155ff305113639405a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-5-deactivate, RELEASE=squid-f273685, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-26T00:16:28.342 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:28 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:28.015+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:28.342 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:28 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:28.015+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:28.342 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:28 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:28.015+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:28.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:28 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:28.039+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:28.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:28 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:28.039+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:28.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:28 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:28.039+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:28.701 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.5.service' 2024-08-26T00:16:28.741 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:16:28.741 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-08-26T00:16:28.742 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-08-26T00:16:28.742 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.6 2024-08-26T00:16:28.760 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:28 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:28.341+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.690248+0000 front 2024-08-26T00:15:53.690280+0000 (oldest deadline 2024-08-26T00:16:19.590409+0000) 2024-08-26T00:16:28.760 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:28 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:28.341+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.591071+0000 front 2024-08-26T00:15:59.591004+0000 (oldest deadline 2024-08-26T00:16:24.291093+0000) 2024-08-26T00:16:29.024 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:28 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:28.804+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:29.024 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:28 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:28.804+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:29.025 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:28 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:28.804+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:29.033 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:29 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:29.018+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:29.033 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:29 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:29.018+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:29.034 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:29 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:29.018+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:29.034 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:28 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:28.772+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.379716+0000 front 2024-08-26T00:15:45.379772+0000 (oldest deadline 2024-08-26T00:16:11.279975+0000) 2024-08-26T00:16:29.034 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:28 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:28.772+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:51.280770+0000 front 2024-08-26T00:15:51.280733+0000 (oldest deadline 2024-08-26T00:16:17.180977+0000) 2024-08-26T00:16:29.034 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:28 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:28.772+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:57.181828+0000 front 2024-08-26T00:15:57.181692+0000 (oldest deadline 2024-08-26T00:16:22.982598+0000) 2024-08-26T00:16:29.034 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:28 smithi042 systemd[1]: Stopping Ceph osd.6 for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:16:29.283 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:29 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:29.023+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:29.283 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:29 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:29.023+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:29.352 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:29 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:29.011+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:29.352 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:29 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:29.011+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:29.352 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:29 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:29.011+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:29.533 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:29 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:29.169+0000 7f4fe3200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:16:29.533 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:29 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:29.169+0000 7f4fe3200640 -1 osd.6 83 *** Got signal Terminated *** 2024-08-26T00:16:29.533 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:29 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:29.169+0000 7f4fe3200640 -1 osd.6 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-26T00:16:29.760 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:29 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:29.350+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.690248+0000 front 2024-08-26T00:15:53.690280+0000 (oldest deadline 2024-08-26T00:16:19.590409+0000) 2024-08-26T00:16:29.760 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:29 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:29.350+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.591071+0000 front 2024-08-26T00:15:59.591004+0000 (oldest deadline 2024-08-26T00:16:24.291093+0000) 2024-08-26T00:16:30.033 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:29 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:29.775+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.379716+0000 front 2024-08-26T00:15:45.379772+0000 (oldest deadline 2024-08-26T00:16:11.279975+0000) 2024-08-26T00:16:30.033 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:29 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:29.775+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:51.280770+0000 front 2024-08-26T00:15:51.280733+0000 (oldest deadline 2024-08-26T00:16:17.180977+0000) 2024-08-26T00:16:30.033 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:29 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:29.775+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:57.181828+0000 front 2024-08-26T00:15:57.181692+0000 (oldest deadline 2024-08-26T00:16:22.982598+0000) 2024-08-26T00:16:30.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:29 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:29.971+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:30.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:29 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:29.971+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:30.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:29 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:29.971+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:30.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:29 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:29.991+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:30.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:29 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:29.991+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:30.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:29 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:29.813+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:30.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:29 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:29.813+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:30.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:29 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:29.813+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:30.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:30 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:30.039+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:30.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:30 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:30.039+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:30.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:30 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:30.039+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:30.760 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:30 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:30.318+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.690248+0000 front 2024-08-26T00:15:53.690280+0000 (oldest deadline 2024-08-26T00:16:19.590409+0000) 2024-08-26T00:16:30.760 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:30 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:30.318+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.591071+0000 front 2024-08-26T00:15:59.591004+0000 (oldest deadline 2024-08-26T00:16:24.291093+0000) 2024-08-26T00:16:31.283 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:30 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:30.789+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.379716+0000 front 2024-08-26T00:15:45.379772+0000 (oldest deadline 2024-08-26T00:16:11.279975+0000) 2024-08-26T00:16:31.283 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:30 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:30.789+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:51.280770+0000 front 2024-08-26T00:15:51.280733+0000 (oldest deadline 2024-08-26T00:16:17.180977+0000) 2024-08-26T00:16:31.283 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:30 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:30.789+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:57.181828+0000 front 2024-08-26T00:15:57.181692+0000 (oldest deadline 2024-08-26T00:16:22.982598+0000) 2024-08-26T00:16:31.284 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:31 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:31.011+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:31.284 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:31 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:31.011+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:31.284 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:31 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:31.011+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:31.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:31.030+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:31.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:31.030+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:31.285 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:30 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:30.817+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:31.285 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:30 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:30.818+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:31.285 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:30 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:30.818+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:31.285 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:30 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:30.818+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:31.299 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:31 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:31.010+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:31.299 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:31 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:31.010+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:31.299 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:31 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:31.010+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:31.760 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:31 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:31.298+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.690248+0000 front 2024-08-26T00:15:53.690280+0000 (oldest deadline 2024-08-26T00:16:19.590409+0000) 2024-08-26T00:16:31.760 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:31 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:31.298+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.591071+0000 front 2024-08-26T00:15:59.591004+0000 (oldest deadline 2024-08-26T00:16:24.291093+0000) 2024-08-26T00:16:32.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:32.023+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:32.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:32.023+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:32.284 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:32 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:32.027+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:32.284 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:32 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:32.027+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:32.284 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:32 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:32.027+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:32.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:31.826+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:32.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:31.826+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:32.285 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:31.826+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:32.285 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:31 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:31.826+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:32.285 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:31 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:31.817+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.379716+0000 front 2024-08-26T00:15:45.379772+0000 (oldest deadline 2024-08-26T00:16:11.279975+0000) 2024-08-26T00:16:32.285 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:31 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:31.817+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:51.280770+0000 front 2024-08-26T00:15:51.280733+0000 (oldest deadline 2024-08-26T00:16:17.180977+0000) 2024-08-26T00:16:32.285 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:31 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:31.817+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:57.181828+0000 front 2024-08-26T00:15:57.181692+0000 (oldest deadline 2024-08-26T00:16:22.982598+0000) 2024-08-26T00:16:32.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:32 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:32.059+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:32.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:32 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:32.059+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:32.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:32 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:32.059+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:32.511 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:32 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:32.250+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.690248+0000 front 2024-08-26T00:15:53.690280+0000 (oldest deadline 2024-08-26T00:16:19.590409+0000) 2024-08-26T00:16:32.511 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:32 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:32.250+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.591071+0000 front 2024-08-26T00:15:59.591004+0000 (oldest deadline 2024-08-26T00:16:24.291093+0000) 2024-08-26T00:16:32.511 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:32 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:32.250+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.992580+0000 front 2024-08-26T00:16:08.992258+0000 (oldest deadline 2024-08-26T00:16:31.892296+0000) 2024-08-26T00:16:33.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:33 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:33.005+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:33.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:33 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:33.005+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:33.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:33 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:33.005+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:33.284 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:32 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:32.813+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.379716+0000 front 2024-08-26T00:15:45.379772+0000 (oldest deadline 2024-08-26T00:16:11.279975+0000) 2024-08-26T00:16:33.284 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:32 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:32.813+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:51.280770+0000 front 2024-08-26T00:15:51.280733+0000 (oldest deadline 2024-08-26T00:16:17.180977+0000) 2024-08-26T00:16:33.284 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:32 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:32.813+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:57.181828+0000 front 2024-08-26T00:15:57.181692+0000 (oldest deadline 2024-08-26T00:16:22.982598+0000) 2024-08-26T00:16:33.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:32.988+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:33.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:32.988+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:33.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:32.799+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:33.285 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:32.799+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:33.285 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:32.799+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:33.285 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:32 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:32.799+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:33.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:33 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:33.108+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:33.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:33 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:33.108+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:33.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:33 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:33.108+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:33.511 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:33 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:33.263+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.690248+0000 front 2024-08-26T00:15:53.690280+0000 (oldest deadline 2024-08-26T00:16:19.590409+0000) 2024-08-26T00:16:33.511 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:33 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:33.263+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.591071+0000 front 2024-08-26T00:15:59.591004+0000 (oldest deadline 2024-08-26T00:16:24.291093+0000) 2024-08-26T00:16:33.511 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:33 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:33.263+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.992580+0000 front 2024-08-26T00:16:08.992258+0000 (oldest deadline 2024-08-26T00:16:31.892296+0000) 2024-08-26T00:16:34.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:34 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:34.029+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:34.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:34 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:34.029+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:34.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:34 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:34.029+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:34.284 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:33 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:33.830+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.379716+0000 front 2024-08-26T00:15:45.379772+0000 (oldest deadline 2024-08-26T00:16:11.279975+0000) 2024-08-26T00:16:34.284 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:33 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:33.830+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:51.280770+0000 front 2024-08-26T00:15:51.280733+0000 (oldest deadline 2024-08-26T00:16:17.180977+0000) 2024-08-26T00:16:34.284 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:33 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:33.830+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:57.181828+0000 front 2024-08-26T00:15:57.181692+0000 (oldest deadline 2024-08-26T00:16:22.982598+0000) 2024-08-26T00:16:34.284 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:33 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6[44137]: 2024-08-26T00:16:33.830+0000 7f4fd9c00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.784815+0000 front 2024-08-26T00:16:08.784781+0000 (oldest deadline 2024-08-26T00:16:32.884923+0000) 2024-08-26T00:16:34.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:33.947+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:34.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:33.947+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:34.285 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:33.791+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:34.285 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:33.791+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:34.285 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:33.791+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:34.285 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:33 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:33.791+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:34.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:34 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:34.114+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:34.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:34 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:34.114+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:34.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:34 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:34.114+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:34.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:34 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:34.291+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.690248+0000 front 2024-08-26T00:15:53.690280+0000 (oldest deadline 2024-08-26T00:16:19.590409+0000) 2024-08-26T00:16:34.511 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:34 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:34.291+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.591071+0000 front 2024-08-26T00:15:59.591004+0000 (oldest deadline 2024-08-26T00:16:24.291093+0000) 2024-08-26T00:16:34.511 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:34 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:34.291+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.992580+0000 front 2024-08-26T00:16:08.992258+0000 (oldest deadline 2024-08-26T00:16:31.892296+0000) 2024-08-26T00:16:34.952 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:34 smithi042 podman[86713]: 2024-08-26 00:16:34.652451813 +0000 UTC m=+5.615705035 container died 60e423688e0d4bf8f392010d1bcc305bb4323bdf00c5454a4fb4effd110f22b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-f273685, CEPH_POINT_RELEASE=) 2024-08-26T00:16:35.283 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:35 smithi042 podman[86713]: 2024-08-26 00:16:35.158531738 +0000 UTC m=+6.121784954 container cleanup 60e423688e0d4bf8f392010d1bcc305bb4323bdf00c5454a4fb4effd110f22b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, RELEASE=squid-f273685, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True) 2024-08-26T00:16:35.283 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:35 smithi042 bash[86713]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6 2024-08-26T00:16:35.284 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:34 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:34.981+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:35.284 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:34 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:34.981+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:35.284 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:34 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:34.981+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:35.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:34.956+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:35.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:34.956+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:35.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:34.840+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:35.285 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:34.840+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:35.285 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:34.840+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:35.285 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:34 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:34.840+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:35.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:35 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:35.334+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.690248+0000 front 2024-08-26T00:15:53.690280+0000 (oldest deadline 2024-08-26T00:16:19.590409+0000) 2024-08-26T00:16:35.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:35 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:35.334+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.591071+0000 front 2024-08-26T00:15:59.591004+0000 (oldest deadline 2024-08-26T00:16:24.291093+0000) 2024-08-26T00:16:35.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:35 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:35.334+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.992580+0000 front 2024-08-26T00:16:08.992258+0000 (oldest deadline 2024-08-26T00:16:31.892296+0000) 2024-08-26T00:16:35.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:35 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:35.124+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:35.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:35 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:35.124+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:35.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:35 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:35.124+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:35.783 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:35 smithi042 podman[86731]: 2024-08-26 00:16:35.451727686 +0000 UTC m=+0.783952783 container remove 60e423688e0d4bf8f392010d1bcc305bb4323bdf00c5454a4fb4effd110f22b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-f273685, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-26T00:16:36.197 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:35 smithi042 podman[86816]: 2024-08-26 00:16:35.806617318 +0000 UTC m=+0.028267827 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34 2024-08-26T00:16:36.197 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:35 smithi042 podman[86816]: 2024-08-26 00:16:35.91955133 +0000 UTC m=+0.141201827 container create 54cf8d379ee11b028b505d906ccef73081c715b1e6b36004b67d696c8dddc99f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-f273685, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-26T00:16:36.197 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:36 smithi042 podman[86816]: 2024-08-26 00:16:36.197074736 +0000 UTC m=+0.418725237 container init 54cf8d379ee11b028b505d906ccef73081c715b1e6b36004b67d696c8dddc99f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-f273685, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-26T00:16:36.197 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:35.939+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:36.198 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:35.939+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:36.198 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:35.939+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:36.198 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:35 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:35.939+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.537738+0000 front 2024-08-26T00:16:09.538072+0000 (oldest deadline 2024-08-26T00:16:35.438042+0000) 2024-08-26T00:16:36.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:35 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:35.981+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:36.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:35 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:35.981+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:36.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:35 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:35.981+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.718795+0000 front 2024-08-26T00:16:09.718888+0000 (oldest deadline 2024-08-26T00:16:35.618638+0000) 2024-08-26T00:16:36.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:35 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:35.825+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:36.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:35 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:35.825+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:36.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:35 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:35.825+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:36.285 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:35 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:35.825+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:36.469 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:36 smithi042 podman[86816]: 2024-08-26 00:16:36.204282833 +0000 UTC m=+0.425933332 container start 54cf8d379ee11b028b505d906ccef73081c715b1e6b36004b67d696c8dddc99f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f273685, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-26T00:16:36.469 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:36 smithi042 podman[86816]: 2024-08-26 00:16:36.296838651 +0000 UTC m=+0.518489168 container attach 54cf8d379ee11b028b505d906ccef73081c715b1e6b36004b67d696c8dddc99f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-f273685, ceph=True, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-26T00:16:36.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:36 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:36.308+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.690248+0000 front 2024-08-26T00:15:53.690280+0000 (oldest deadline 2024-08-26T00:16:19.590409+0000) 2024-08-26T00:16:36.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:36 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:36.308+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.591071+0000 front 2024-08-26T00:15:59.591004+0000 (oldest deadline 2024-08-26T00:16:24.291093+0000) 2024-08-26T00:16:36.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:36 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:36.308+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.992580+0000 front 2024-08-26T00:16:08.992258+0000 (oldest deadline 2024-08-26T00:16:31.892296+0000) 2024-08-26T00:16:36.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:36 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:36.129+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:36.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:36 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:36.129+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:36.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:36 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:36.129+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:36.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:36 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:36.129+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:36.783 INFO:journalctl@ceph.osd.6.smithi042.stdout:Aug 26 00:16:36 smithi042 podman[86816]: 2024-08-26 00:16:36.468821269 +0000 UTC m=+0.690471777 container died 54cf8d379ee11b028b505d906ccef73081c715b1e6b36004b67d696c8dddc99f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-f273685, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-08-26T00:16:37.026 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:36 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:36.792+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:37.026 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:36 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:36.792+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:37.026 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:36 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:36.792+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:37.026 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:36 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:36.792+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:37.092 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:36 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:36.902+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:37.092 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:36 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:36.902+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:37.093 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:36 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:36.902+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:37.093 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:36 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:36.902+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.537738+0000 front 2024-08-26T00:16:09.538072+0000 (oldest deadline 2024-08-26T00:16:35.438042+0000) 2024-08-26T00:16:37.118 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.6.service' 2024-08-26T00:16:37.193 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:16:37.193 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-08-26T00:16:37.194 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-08-26T00:16:37.194 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.7 2024-08-26T00:16:37.283 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:37 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:37.025+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:37.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:37 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:37.025+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:37.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:37 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:37.025+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.718795+0000 front 2024-08-26T00:16:09.718888+0000 (oldest deadline 2024-08-26T00:16:35.618638+0000) 2024-08-26T00:16:37.499 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:37 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:37.095+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:37.499 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:37 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:37.095+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:37.499 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:37 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:37.095+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:37.499 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:37 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:37.095+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:37.499 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:37 smithi043 systemd[1]: Stopping Ceph osd.7 for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:16:37.499 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:37 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:37.304+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.690248+0000 front 2024-08-26T00:15:53.690280+0000 (oldest deadline 2024-08-26T00:16:19.590409+0000) 2024-08-26T00:16:37.499 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:37 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:37.304+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.591071+0000 front 2024-08-26T00:15:59.591004+0000 (oldest deadline 2024-08-26T00:16:24.291093+0000) 2024-08-26T00:16:37.500 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:37 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:37.304+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.992580+0000 front 2024-08-26T00:16:08.992258+0000 (oldest deadline 2024-08-26T00:16:31.892296+0000) 2024-08-26T00:16:37.500 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:37 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:37.497+0000 7f955a3c8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:16:37.500 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:37 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:37.497+0000 7f955a3c8640 -1 osd.7 83 *** Got signal Terminated *** 2024-08-26T00:16:37.500 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:37 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:37.497+0000 7f955a3c8640 -1 osd.7 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-26T00:16:38.062 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:37 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:37.793+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:38.063 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:37 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:37.793+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:38.063 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:37 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:37.793+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:38.063 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:37 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:37.793+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:38.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:37 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:37.877+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:38.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:37 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:37.877+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:38.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:37 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:37.877+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:38.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:37 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:37.877+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.537738+0000 front 2024-08-26T00:16:09.538072+0000 (oldest deadline 2024-08-26T00:16:35.438042+0000) 2024-08-26T00:16:38.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:38 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:38.270+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.690248+0000 front 2024-08-26T00:15:53.690280+0000 (oldest deadline 2024-08-26T00:16:19.590409+0000) 2024-08-26T00:16:38.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:38 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:38.270+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.591071+0000 front 2024-08-26T00:15:59.591004+0000 (oldest deadline 2024-08-26T00:16:24.291093+0000) 2024-08-26T00:16:38.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:38 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:38.270+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.992580+0000 front 2024-08-26T00:16:08.992258+0000 (oldest deadline 2024-08-26T00:16:31.892296+0000) 2024-08-26T00:16:38.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:38 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:38.103+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:38.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:38 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:38.103+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:38.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:38 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:38.103+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:38.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:38 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:38.103+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:38.533 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:38 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:38.062+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:38.533 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:38 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:38.062+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:38.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:38 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:38.062+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.718795+0000 front 2024-08-26T00:16:09.718888+0000 (oldest deadline 2024-08-26T00:16:35.618638+0000) 2024-08-26T00:16:39.073 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:38 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:38.788+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:39.073 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:38 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:38.788+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:39.073 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:38 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:38.788+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:39.073 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:38 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:38.788+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:39.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:38 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:38.913+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:39.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:38 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:38.913+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:39.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:38 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:38.913+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:39.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:38 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:38.913+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.537738+0000 front 2024-08-26T00:16:09.538072+0000 (oldest deadline 2024-08-26T00:16:35.438042+0000) 2024-08-26T00:16:39.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:39 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:39.238+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.690248+0000 front 2024-08-26T00:15:53.690280+0000 (oldest deadline 2024-08-26T00:16:19.590409+0000) 2024-08-26T00:16:39.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:39 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:39.238+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.591071+0000 front 2024-08-26T00:15:59.591004+0000 (oldest deadline 2024-08-26T00:16:24.291093+0000) 2024-08-26T00:16:39.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:39 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:39.238+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.992580+0000 front 2024-08-26T00:16:08.992258+0000 (oldest deadline 2024-08-26T00:16:31.892296+0000) 2024-08-26T00:16:39.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:39 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:39.103+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:39.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:39 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:39.103+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:39.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:39 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:39.103+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:39.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:39 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:39.103+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:39.533 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:39 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:39.072+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:39.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:39 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:39.072+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:39.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:39 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:39.072+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.718795+0000 front 2024-08-26T00:16:09.718888+0000 (oldest deadline 2024-08-26T00:16:35.618638+0000) 2024-08-26T00:16:40.113 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:39 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:39.831+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:40.113 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:39 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:39.831+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:40.114 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:39 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:39.831+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:40.114 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:39 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:39.831+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:40.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:39 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:39.942+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:40.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:39 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:39.942+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:40.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:39 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:39.942+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:40.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:39 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:39.942+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.537738+0000 front 2024-08-26T00:16:09.538072+0000 (oldest deadline 2024-08-26T00:16:35.438042+0000) 2024-08-26T00:16:40.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:40 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:40.235+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.690248+0000 front 2024-08-26T00:15:53.690280+0000 (oldest deadline 2024-08-26T00:16:19.590409+0000) 2024-08-26T00:16:40.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:40 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:40.235+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.591071+0000 front 2024-08-26T00:15:59.591004+0000 (oldest deadline 2024-08-26T00:16:24.291093+0000) 2024-08-26T00:16:40.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:40 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:40.235+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.992580+0000 front 2024-08-26T00:16:08.992258+0000 (oldest deadline 2024-08-26T00:16:31.892296+0000) 2024-08-26T00:16:40.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:40 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:40.133+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:40.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:40 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:40.133+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:40.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:40 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:40.133+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:40.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:40 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:40.133+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:40.533 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:40 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:40.113+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:40.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:40 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:40.113+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:40.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:40 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:40.113+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.718795+0000 front 2024-08-26T00:16:09.718888+0000 (oldest deadline 2024-08-26T00:16:35.618638+0000) 2024-08-26T00:16:41.142 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:40 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:40.879+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:41.243 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:40 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:40.879+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:41.243 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:40 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:40.879+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:41.243 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:40 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:40.879+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:41.244 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:40 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:40.879+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:16:41.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:40 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:40.946+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:41.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:40 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:40.946+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:41.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:40 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:40.946+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:41.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:40 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:40.946+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.537738+0000 front 2024-08-26T00:16:09.538072+0000 (oldest deadline 2024-08-26T00:16:35.438042+0000) 2024-08-26T00:16:41.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:40 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:40.946+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.438791+0000 front 2024-08-26T00:16:15.438689+0000 (oldest deadline 2024-08-26T00:16:40.638978+0000) 2024-08-26T00:16:41.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:41 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:41.200+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.690248+0000 front 2024-08-26T00:15:53.690280+0000 (oldest deadline 2024-08-26T00:16:19.590409+0000) 2024-08-26T00:16:41.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:41 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:41.200+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.591071+0000 front 2024-08-26T00:15:59.591004+0000 (oldest deadline 2024-08-26T00:16:24.291093+0000) 2024-08-26T00:16:41.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:41 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:41.200+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.992580+0000 front 2024-08-26T00:16:08.992258+0000 (oldest deadline 2024-08-26T00:16:31.892296+0000) 2024-08-26T00:16:41.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:41 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:41.147+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:41.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:41 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:41.147+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:41.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:41 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:41.147+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:41.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:41 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:41.147+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:41.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:41 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:41.141+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:41.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:41 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:41.141+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:41.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:41 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:41.141+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.718795+0000 front 2024-08-26T00:16:09.718888+0000 (oldest deadline 2024-08-26T00:16:35.618638+0000) 2024-08-26T00:16:41.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:41 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:41.141+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.619331+0000 front 2024-08-26T00:16:15.619471+0000 (oldest deadline 2024-08-26T00:16:40.919294+0000) 2024-08-26T00:16:42.188 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:41 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:41.908+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:42.188 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:41 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:41.908+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:42.189 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:41 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:41.908+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:42.189 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:41 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:41.908+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:42.189 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:41 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:41.908+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:16:42.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:41 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:41.987+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:42.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:41 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:41.987+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:42.284 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:41 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:41.987+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:42.284 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:41 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:41.987+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.537738+0000 front 2024-08-26T00:16:09.538072+0000 (oldest deadline 2024-08-26T00:16:35.438042+0000) 2024-08-26T00:16:42.284 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:41 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:41.987+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.438791+0000 front 2024-08-26T00:16:15.438689+0000 (oldest deadline 2024-08-26T00:16:40.638978+0000) 2024-08-26T00:16:42.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:42 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:42.226+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.690248+0000 front 2024-08-26T00:15:53.690280+0000 (oldest deadline 2024-08-26T00:16:19.590409+0000) 2024-08-26T00:16:42.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:42 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:42.226+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.591071+0000 front 2024-08-26T00:15:59.591004+0000 (oldest deadline 2024-08-26T00:16:24.291093+0000) 2024-08-26T00:16:42.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:42 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7[40429]: 2024-08-26T00:16:42.226+0000 7f95529c5640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.992580+0000 front 2024-08-26T00:16:08.992258+0000 (oldest deadline 2024-08-26T00:16:31.892296+0000) 2024-08-26T00:16:42.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:42 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:42.143+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:42.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:42 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:42.143+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:42.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:42 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:42.143+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:42.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:42 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:42.143+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:42.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:42 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:42.143+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:16:42.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:42 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:42.187+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:42.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:42 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:42.187+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:42.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:42 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:42.187+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.718795+0000 front 2024-08-26T00:16:09.718888+0000 (oldest deadline 2024-08-26T00:16:35.618638+0000) 2024-08-26T00:16:42.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:42 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:42.187+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.619331+0000 front 2024-08-26T00:16:15.619471+0000 (oldest deadline 2024-08-26T00:16:40.919294+0000) 2024-08-26T00:16:43.150 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:42 smithi043 podman[58836]: 2024-08-26 00:16:42.877782177 +0000 UTC m=+5.488627306 container died 1f77215a990452102de34e1a6b997201243650d2346308f6ec21e770c9399279 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7, GIT_CLEAN=True, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-f273685, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-08-26T00:16:43.150 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:43 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:43.121+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:43.150 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:43 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:43.121+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:43.150 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:43 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:43.121+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:43.150 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:43 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:43.121+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:43.150 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:43 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:43.121+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:16:43.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:42 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:42.997+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:43.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:42 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:42.997+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:43.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:42 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:42.997+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:43.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:42 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:42.997+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.537738+0000 front 2024-08-26T00:16:09.538072+0000 (oldest deadline 2024-08-26T00:16:35.438042+0000) 2024-08-26T00:16:43.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:42 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:42.997+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.438791+0000 front 2024-08-26T00:16:15.438689+0000 (oldest deadline 2024-08-26T00:16:40.638978+0000) 2024-08-26T00:16:43.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:42 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:42.952+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:43.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:42 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:42.952+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:43.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:42 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:42.952+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:43.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:42 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:42.952+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:43.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:42 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:42.952+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:16:43.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:43 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:43.177+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:43.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:43 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:43.177+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:43.285 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:43 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:43.177+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.718795+0000 front 2024-08-26T00:16:09.718888+0000 (oldest deadline 2024-08-26T00:16:35.618638+0000) 2024-08-26T00:16:43.285 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:43 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:43.177+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.619331+0000 front 2024-08-26T00:16:15.619471+0000 (oldest deadline 2024-08-26T00:16:40.919294+0000) 2024-08-26T00:16:43.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:43 smithi043 podman[58836]: 2024-08-26 00:16:43.240157541 +0000 UTC m=+5.851002672 container cleanup 1f77215a990452102de34e1a6b997201243650d2346308f6ec21e770c9399279 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-f273685, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.1) 2024-08-26T00:16:43.510 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:43 smithi043 bash[58836]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7 2024-08-26T00:16:43.834 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:43 smithi043 podman[58852]: 2024-08-26 00:16:43.533148612 +0000 UTC m=+0.652846819 container remove 1f77215a990452102de34e1a6b997201243650d2346308f6ec21e770c9399279 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f273685, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-08-26T00:16:44.112 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:43 smithi043 podman[58939]: 2024-08-26 00:16:43.833986039 +0000 UTC m=+0.103762934 container create 8b20cf28444c4e56d2e8ae73eb3e2a5181b82f8e8ba0d0fa09edcf0363682fcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7-deactivate, ceph=True, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-f273685, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-08-26T00:16:44.112 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:43 smithi043 podman[58939]: 2024-08-26 00:16:43.746189965 +0000 UTC m=+0.015966861 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34 2024-08-26T00:16:44.112 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:44 smithi043 podman[58939]: 2024-08-26 00:16:44.044925312 +0000 UTC m=+0.314702208 container init 8b20cf28444c4e56d2e8ae73eb3e2a5181b82f8e8ba0d0fa09edcf0363682fcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-f273685, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-26T00:16:44.112 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:44 smithi043 podman[58939]: 2024-08-26 00:16:44.049310269 +0000 UTC m=+0.319087171 container start 8b20cf28444c4e56d2e8ae73eb3e2a5181b82f8e8ba0d0fa09edcf0363682fcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, RELEASE=squid-f273685, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-08-26T00:16:44.112 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:44 smithi043 podman[58939]: 2024-08-26 00:16:44.111510473 +0000 UTC m=+0.381287378 container attach 8b20cf28444c4e56d2e8ae73eb3e2a5181b82f8e8ba0d0fa09edcf0363682fcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-f273685, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1) 2024-08-26T00:16:44.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:44 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:44.027+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:44.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:44 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:44.027+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:44.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:44 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:44.027+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:44.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:44 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:44.027+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.537738+0000 front 2024-08-26T00:16:09.538072+0000 (oldest deadline 2024-08-26T00:16:35.438042+0000) 2024-08-26T00:16:44.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:44 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:44.027+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.438791+0000 front 2024-08-26T00:16:15.438689+0000 (oldest deadline 2024-08-26T00:16:40.638978+0000) 2024-08-26T00:16:44.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:44 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:44.186+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:44.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:44 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:44.186+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:44.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:44 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:44.186+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.718795+0000 front 2024-08-26T00:16:09.718888+0000 (oldest deadline 2024-08-26T00:16:35.618638+0000) 2024-08-26T00:16:44.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:44 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:44.186+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.619331+0000 front 2024-08-26T00:16:15.619471+0000 (oldest deadline 2024-08-26T00:16:40.919294+0000) 2024-08-26T00:16:44.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:43 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:43.937+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:44.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:43 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:43.937+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:44.285 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:43 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:43.937+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:44.285 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:43 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:43.937+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:44.285 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:43 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:43.937+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:16:44.448 INFO:journalctl@ceph.osd.7.smithi043.stdout:Aug 26 00:16:44 smithi043 podman[58939]: 2024-08-26 00:16:44.232340806 +0000 UTC m=+0.502117706 container died 8b20cf28444c4e56d2e8ae73eb3e2a5181b82f8e8ba0d0fa09edcf0363682fcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, RELEASE=squid-f273685, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-08-26T00:16:44.449 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:44 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:44.141+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:44.449 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:44 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:44.141+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:44.449 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:44 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:44.141+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:44.449 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:44 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:44.141+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:44.449 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:44 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:44.141+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:16:44.800 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.7.service' 2024-08-26T00:16:44.841 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:16:44.841 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-08-26T00:16:44.841 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-08-26T00:16:44.841 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.8 2024-08-26T00:16:45.138 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:44 smithi181 systemd[1]: Stopping Ceph osd.8 for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:16:45.138 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:45 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:45.137+0000 7f33359e1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:16:45.138 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:45 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:45.137+0000 7f33359e1640 -1 osd.8 83 *** Got signal Terminated *** 2024-08-26T00:16:45.138 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:45 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:45.137+0000 7f33359e1640 -1 osd.8 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-26T00:16:45.139 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:44 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:44.903+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:45.139 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:44 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:44.903+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:45.139 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:44 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:44.903+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:45.139 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:44 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:44.903+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:45.139 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:44 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:44.903+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:16:45.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:45 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:45.165+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:45.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:45 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:45.165+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:45.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:45 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:45.165+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:45.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:45 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:45.165+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:45.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:45 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:45.165+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:16:45.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:45 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:45.051+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:45.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:45 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:45.051+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:45.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:45 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:45.051+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:45.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:45 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:45.051+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.537738+0000 front 2024-08-26T00:16:09.538072+0000 (oldest deadline 2024-08-26T00:16:35.438042+0000) 2024-08-26T00:16:45.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:45 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:45.051+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.438791+0000 front 2024-08-26T00:16:15.438689+0000 (oldest deadline 2024-08-26T00:16:40.638978+0000) 2024-08-26T00:16:45.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:45 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:45.213+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:45.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:45 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:45.213+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:45.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:45 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:45.213+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.718795+0000 front 2024-08-26T00:16:09.718888+0000 (oldest deadline 2024-08-26T00:16:35.618638+0000) 2024-08-26T00:16:45.534 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:45 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:45.213+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.619331+0000 front 2024-08-26T00:16:15.619471+0000 (oldest deadline 2024-08-26T00:16:40.919294+0000) 2024-08-26T00:16:46.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:45 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:45.911+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:46.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:45 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:45.911+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:46.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:45 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:45.911+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:46.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:45 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:45.911+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:46.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:45 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:45.911+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:16:46.435 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:46 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:46.066+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:46.435 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:46 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:46.066+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:46.435 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:46 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:46.066+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:46.435 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:46 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:46.066+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.537738+0000 front 2024-08-26T00:16:09.538072+0000 (oldest deadline 2024-08-26T00:16:35.438042+0000) 2024-08-26T00:16:46.435 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:46 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:46.066+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.438791+0000 front 2024-08-26T00:16:15.438689+0000 (oldest deadline 2024-08-26T00:16:40.638978+0000) 2024-08-26T00:16:46.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:46 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:46.213+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:46.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:46 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:46.213+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:46.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:46 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:46.213+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:46.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:46 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:46.213+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:46.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:46 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:46.213+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:16:46.533 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:46 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:46.249+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:46.533 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:46 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:46.249+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:46.533 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:46 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:46.249+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.718795+0000 front 2024-08-26T00:16:09.718888+0000 (oldest deadline 2024-08-26T00:16:35.618638+0000) 2024-08-26T00:16:46.533 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:46 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:46.249+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.619331+0000 front 2024-08-26T00:16:15.619471+0000 (oldest deadline 2024-08-26T00:16:40.919294+0000) 2024-08-26T00:16:47.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:46 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:46.901+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:47.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:46 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:46.901+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:47.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:46 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:46.901+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:47.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:46 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:46.901+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:47.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:46 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:46.901+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:16:47.462 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:47 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:47.076+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:47.463 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:47 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:47.076+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:47.463 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:47 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:47.076+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:47.463 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:47 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:47.076+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.537738+0000 front 2024-08-26T00:16:09.538072+0000 (oldest deadline 2024-08-26T00:16:35.438042+0000) 2024-08-26T00:16:47.463 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:47 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:47.076+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.438791+0000 front 2024-08-26T00:16:15.438689+0000 (oldest deadline 2024-08-26T00:16:40.638978+0000) 2024-08-26T00:16:47.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:47 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:47.204+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:47.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:47 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:47.204+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:47.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:47 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:47.204+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:47.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:47 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:47.204+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:47.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:47 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:47.204+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:16:47.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:47 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:47.204+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.879005+0000 front 2024-08-26T00:16:25.879080+0000 (oldest deadline 2024-08-26T00:16:46.879491+0000) 2024-08-26T00:16:47.784 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:47 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:47.298+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:47.784 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:47 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:47.298+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:47.784 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:47 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:47.298+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.718795+0000 front 2024-08-26T00:16:09.718888+0000 (oldest deadline 2024-08-26T00:16:35.618638+0000) 2024-08-26T00:16:47.784 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:47 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:47.298+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.619331+0000 front 2024-08-26T00:16:15.619471+0000 (oldest deadline 2024-08-26T00:16:40.919294+0000) 2024-08-26T00:16:47.784 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:47 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:47.298+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:20.919605+0000 front 2024-08-26T00:16:20.919651+0000 (oldest deadline 2024-08-26T00:16:46.819737+0000) 2024-08-26T00:16:48.283 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:47 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:47.898+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:48.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:47 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:47.898+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:48.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:47 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:47.898+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:48.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:47 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:47.899+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:48.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:47 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:47.899+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:16:48.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:48 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:48.244+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:48.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:48 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:48.244+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:48.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:48 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:48.244+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:48.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:48 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:48.244+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:48.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:48 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:48.244+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:16:48.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:48 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:48.244+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.879005+0000 front 2024-08-26T00:16:25.879080+0000 (oldest deadline 2024-08-26T00:16:46.879491+0000) 2024-08-26T00:16:48.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:48 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:48.070+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:48.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:48 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:48.070+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:48.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:48 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:48.070+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:48.534 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:48 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:48.070+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.537738+0000 front 2024-08-26T00:16:09.538072+0000 (oldest deadline 2024-08-26T00:16:35.438042+0000) 2024-08-26T00:16:48.534 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:48 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:48.070+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.438791+0000 front 2024-08-26T00:16:15.438689+0000 (oldest deadline 2024-08-26T00:16:40.638978+0000) 2024-08-26T00:16:48.784 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:48 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:48.329+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:48.784 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:48 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:48.329+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:48.784 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:48 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:48.329+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.718795+0000 front 2024-08-26T00:16:09.718888+0000 (oldest deadline 2024-08-26T00:16:35.618638+0000) 2024-08-26T00:16:48.784 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:48 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:48.329+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.619331+0000 front 2024-08-26T00:16:15.619471+0000 (oldest deadline 2024-08-26T00:16:40.919294+0000) 2024-08-26T00:16:48.784 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:48 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:48.329+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:20.919605+0000 front 2024-08-26T00:16:20.919651+0000 (oldest deadline 2024-08-26T00:16:46.819737+0000) 2024-08-26T00:16:49.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:49 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:49.071+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:49.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:49 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:49.071+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:49.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:49 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:49.071+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:49.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:49 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:49.071+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.537738+0000 front 2024-08-26T00:16:09.538072+0000 (oldest deadline 2024-08-26T00:16:35.438042+0000) 2024-08-26T00:16:49.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:49 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:49.071+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.438791+0000 front 2024-08-26T00:16:15.438689+0000 (oldest deadline 2024-08-26T00:16:40.638978+0000) 2024-08-26T00:16:49.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:49 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:49.071+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.340086+0000 front 2024-08-26T00:16:25.340200+0000 (oldest deadline 2024-08-26T00:16:48.839956+0000) 2024-08-26T00:16:49.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:48 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:48.907+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:49.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:48 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:48.907+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:49.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:48 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:48.907+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:49.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:48 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:48.907+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:49.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:48 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:48.907+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:16:49.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:48 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:48.907+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:16:49.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:49 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:49.229+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:49.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:49 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:49.229+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:49.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:49 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:49.229+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:49.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:49 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:49.229+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:49.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:49 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:49.229+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:16:49.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:49 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:49.229+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.879005+0000 front 2024-08-26T00:16:25.879080+0000 (oldest deadline 2024-08-26T00:16:46.879491+0000) 2024-08-26T00:16:49.784 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:49 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:49.316+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.915481+0000 front 2024-08-26T00:15:49.915544+0000 (oldest deadline 2024-08-26T00:16:15.815629+0000) 2024-08-26T00:16:49.784 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:49 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:49.316+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:56.316567+0000 front 2024-08-26T00:15:56.316492+0000 (oldest deadline 2024-08-26T00:16:22.717182+0000) 2024-08-26T00:16:49.784 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:49 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:49.316+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.718795+0000 front 2024-08-26T00:16:09.718888+0000 (oldest deadline 2024-08-26T00:16:35.618638+0000) 2024-08-26T00:16:49.784 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:49 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:49.316+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.619331+0000 front 2024-08-26T00:16:15.619471+0000 (oldest deadline 2024-08-26T00:16:40.919294+0000) 2024-08-26T00:16:49.784 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:49 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8[40815]: 2024-08-26T00:16:49.316+0000 7f332dfde640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:20.919605+0000 front 2024-08-26T00:16:20.919651+0000 (oldest deadline 2024-08-26T00:16:46.819737+0000) 2024-08-26T00:16:50.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:49 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:49.859+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:50.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:49 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:49.859+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:50.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:49 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:49.859+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:50.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:49 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:49.859+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:50.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:49 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:49.859+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:16:50.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:49 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:49.859+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:16:50.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:50 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:50.230+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:50.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:50 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:50.230+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:50.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:50 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:50.230+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:50.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:50 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:50.230+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:50.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:50 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:50.230+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:16:50.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:50 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:50.230+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.879005+0000 front 2024-08-26T00:16:25.879080+0000 (oldest deadline 2024-08-26T00:16:46.879491+0000) 2024-08-26T00:16:50.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:50 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:50.045+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:50.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:50 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:50.045+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:50.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:50 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:50.045+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:50.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:50 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:50.045+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.537738+0000 front 2024-08-26T00:16:09.538072+0000 (oldest deadline 2024-08-26T00:16:35.438042+0000) 2024-08-26T00:16:50.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:50 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:50.045+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.438791+0000 front 2024-08-26T00:16:15.438689+0000 (oldest deadline 2024-08-26T00:16:40.638978+0000) 2024-08-26T00:16:50.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:50 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:50.045+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.340086+0000 front 2024-08-26T00:16:25.340200+0000 (oldest deadline 2024-08-26T00:16:48.839956+0000) 2024-08-26T00:16:50.913 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:50 smithi181 podman[58579]: 2024-08-26 00:16:50.619930811 +0000 UTC m=+5.583498374 container died e2d5db855e00484dc91840c0747c9c1f1f98fc258110c1fe7d2dcbb818c866f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8, CEPH_POINT_RELEASE=, RELEASE=squid-f273685, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-26T00:16:50.913 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:50 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:50.816+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:50.913 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:50 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:50.816+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:50.913 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:50 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:50.816+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:50.913 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:50 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:50.816+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:50.913 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:50 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:50.816+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:16:50.913 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:50 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:50.816+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:16:51.239 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:51 smithi181 podman[58579]: 2024-08-26 00:16:51.029030137 +0000 UTC m=+5.992597699 container cleanup e2d5db855e00484dc91840c0747c9c1f1f98fc258110c1fe7d2dcbb818c866f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f273685, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-26T00:16:51.239 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:51 smithi181 bash[58579]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8 2024-08-26T00:16:51.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:51 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:51.023+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:51.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:51 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:51.023+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:51.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:51 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:51.023+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:51.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:51 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:51.023+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.537738+0000 front 2024-08-26T00:16:09.538072+0000 (oldest deadline 2024-08-26T00:16:35.438042+0000) 2024-08-26T00:16:51.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:51 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:51.023+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.438791+0000 front 2024-08-26T00:16:15.438689+0000 (oldest deadline 2024-08-26T00:16:40.638978+0000) 2024-08-26T00:16:51.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:51 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:51.023+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.340086+0000 front 2024-08-26T00:16:25.340200+0000 (oldest deadline 2024-08-26T00:16:48.839956+0000) 2024-08-26T00:16:51.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:51 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:51.223+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:51.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:51 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:51.223+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:51.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:51 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:51.223+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:51.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:51 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:51.223+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:51.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:51 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:51.223+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:16:51.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:51 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:51.223+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.879005+0000 front 2024-08-26T00:16:25.879080+0000 (oldest deadline 2024-08-26T00:16:46.879491+0000) 2024-08-26T00:16:51.533 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:51 smithi181 podman[58594]: 2024-08-26 00:16:51.238763637 +0000 UTC m=+0.617554848 container remove e2d5db855e00484dc91840c0747c9c1f1f98fc258110c1fe7d2dcbb818c866f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-f273685, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-26T00:16:51.950 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:51 smithi181 podman[58681]: 2024-08-26 00:16:51.5347403 +0000 UTC m=+0.015890276 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34 2024-08-26T00:16:51.950 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:51 smithi181 podman[58681]: 2024-08-26 00:16:51.63956993 +0000 UTC m=+0.120719936 container create 85c7e3d4684f3cb4a6dd77096f511c1702db602e054ead1a05984d54ffb939de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-f273685, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-08-26T00:16:51.950 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:51 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:51.856+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:51.950 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:51 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:51.856+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:51.951 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:51 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:51.856+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:51.951 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:51 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:51.856+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:51.951 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:51 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:51.856+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:16:51.951 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:51 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:51.856+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:16:52.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:51 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:51.987+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:52.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:51 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:51.987+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:52.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:51 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:51.987+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:52.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:51 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:51.987+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.537738+0000 front 2024-08-26T00:16:09.538072+0000 (oldest deadline 2024-08-26T00:16:35.438042+0000) 2024-08-26T00:16:52.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:51 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:51.987+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.438791+0000 front 2024-08-26T00:16:15.438689+0000 (oldest deadline 2024-08-26T00:16:40.638978+0000) 2024-08-26T00:16:52.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:51 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:51.987+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.340086+0000 front 2024-08-26T00:16:25.340200+0000 (oldest deadline 2024-08-26T00:16:48.839956+0000) 2024-08-26T00:16:52.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:51 smithi181 podman[58681]: 2024-08-26 00:16:51.950161149 +0000 UTC m=+0.431311118 container init 85c7e3d4684f3cb4a6dd77096f511c1702db602e054ead1a05984d54ffb939de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8-deactivate, ceph=True, RELEASE=squid-f273685, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-26T00:16:52.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:51 smithi181 podman[58681]: 2024-08-26 00:16:51.953602356 +0000 UTC m=+0.434752325 container start 85c7e3d4684f3cb4a6dd77096f511c1702db602e054ead1a05984d54ffb939de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-f273685, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-08-26T00:16:52.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:52 smithi181 podman[58681]: 2024-08-26 00:16:52.025014477 +0000 UTC m=+0.506164442 container attach 85c7e3d4684f3cb4a6dd77096f511c1702db602e054ead1a05984d54ffb939de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-f273685, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-08-26T00:16:52.284 INFO:journalctl@ceph.osd.8.smithi181.stdout:Aug 26 00:16:52 smithi181 podman[58681]: 2024-08-26 00:16:52.137566615 +0000 UTC m=+0.618716586 container died 85c7e3d4684f3cb4a6dd77096f511c1702db602e054ead1a05984d54ffb939de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f273685) 2024-08-26T00:16:52.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:52 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:52.223+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:52.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:52 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:52.223+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:52.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:52 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:52.223+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:52.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:52 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:52.223+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:52.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:52 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:52.223+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:16:52.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:52 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:52.223+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.879005+0000 front 2024-08-26T00:16:25.879080+0000 (oldest deadline 2024-08-26T00:16:46.879491+0000) 2024-08-26T00:16:52.684 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.8.service' 2024-08-26T00:16:52.722 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:16:52.722 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-08-26T00:16:52.723 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-08-26T00:16:52.723 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.9 2024-08-26T00:16:53.033 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:52 smithi042 systemd[1]: Stopping Ceph osd.9 for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:16:53.033 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:52 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:52.973+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:53.033 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:52 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:52.973+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:53.033 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:52 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:52.973+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:53.033 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:52 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:52.973+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.537738+0000 front 2024-08-26T00:16:09.538072+0000 (oldest deadline 2024-08-26T00:16:35.438042+0000) 2024-08-26T00:16:53.033 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:52 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:52.973+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.438791+0000 front 2024-08-26T00:16:15.438689+0000 (oldest deadline 2024-08-26T00:16:40.638978+0000) 2024-08-26T00:16:53.034 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:52 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:52.973+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.340086+0000 front 2024-08-26T00:16:25.340200+0000 (oldest deadline 2024-08-26T00:16:48.839956+0000) 2024-08-26T00:16:53.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:52 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:52.888+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:53.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:52 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:52.888+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:53.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:52 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:52.888+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:53.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:52 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:52.888+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:53.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:52 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:52.888+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:16:53.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:52 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:52.888+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:16:53.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:53 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:53.177+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:53.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:53 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:53.177+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:53.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:53 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:53.177+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:53.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:53 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:53.177+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:53.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:53 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:53.177+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:16:53.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:53 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:53.177+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.879005+0000 front 2024-08-26T00:16:25.879080+0000 (oldest deadline 2024-08-26T00:16:46.879491+0000) 2024-08-26T00:16:53.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:53 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:53.122+0000 7f5116200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:16:53.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:53 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:53.122+0000 7f5116200640 -1 osd.9 83 *** Got signal Terminated *** 2024-08-26T00:16:53.533 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:53 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:53.122+0000 7f5116200640 -1 osd.9 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-26T00:16:54.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:53 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:53.991+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:54.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:53 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:53.991+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:54.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:53 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:53.991+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:54.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:53 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:53.991+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.537738+0000 front 2024-08-26T00:16:09.538072+0000 (oldest deadline 2024-08-26T00:16:35.438042+0000) 2024-08-26T00:16:54.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:53 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:53.991+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.438791+0000 front 2024-08-26T00:16:15.438689+0000 (oldest deadline 2024-08-26T00:16:40.638978+0000) 2024-08-26T00:16:54.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:53 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:53.991+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.340086+0000 front 2024-08-26T00:16:25.340200+0000 (oldest deadline 2024-08-26T00:16:48.839956+0000) 2024-08-26T00:16:54.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:53 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:53.866+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:54.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:53 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:53.866+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:54.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:53 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:53.866+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:54.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:53 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:53.866+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:54.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:53 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:53.866+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:16:54.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:53 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:53.866+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:16:54.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:54 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:54.198+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:54.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:54 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:54.198+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:54.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:54 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:54.198+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:54.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:54 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:54.198+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:54.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:54 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:54.198+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:16:54.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:54 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:54.198+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.879005+0000 front 2024-08-26T00:16:25.879080+0000 (oldest deadline 2024-08-26T00:16:46.879491+0000) 2024-08-26T00:16:55.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:54 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:54.989+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:55.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:54 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:54.989+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:55.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:54 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:54.989+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:55.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:54 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:54.989+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.537738+0000 front 2024-08-26T00:16:09.538072+0000 (oldest deadline 2024-08-26T00:16:35.438042+0000) 2024-08-26T00:16:55.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:54 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:54.989+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.438791+0000 front 2024-08-26T00:16:15.438689+0000 (oldest deadline 2024-08-26T00:16:40.638978+0000) 2024-08-26T00:16:55.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:54 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:54.989+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.340086+0000 front 2024-08-26T00:16:25.340200+0000 (oldest deadline 2024-08-26T00:16:48.839956+0000) 2024-08-26T00:16:55.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:54 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:54.879+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:55.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:54 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:54.879+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:55.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:54 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:54.879+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:55.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:54 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:54.879+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:55.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:54 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:54.879+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:16:55.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:54 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:54.879+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:16:55.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:55 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:55.167+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:55.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:55 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:55.167+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:55.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:55 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:55.167+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:55.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:55 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:55.167+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:55.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:55 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:55.167+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:16:55.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:55 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:55.167+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.879005+0000 front 2024-08-26T00:16:25.879080+0000 (oldest deadline 2024-08-26T00:16:46.879491+0000) 2024-08-26T00:16:56.185 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:55 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:55.854+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:56.185 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:55 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:55.854+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:56.185 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:55 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:55.854+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:56.186 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:55 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:55.854+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:56.186 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:55 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:55.854+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:16:56.186 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:55 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:55.854+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:16:56.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:56 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:56.019+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:56.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:56 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:56.019+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:56.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:56 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:56.019+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:56.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:56 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:56.019+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.537738+0000 front 2024-08-26T00:16:09.538072+0000 (oldest deadline 2024-08-26T00:16:35.438042+0000) 2024-08-26T00:16:56.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:56 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:56.019+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.438791+0000 front 2024-08-26T00:16:15.438689+0000 (oldest deadline 2024-08-26T00:16:40.638978+0000) 2024-08-26T00:16:56.284 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:56 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:56.019+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.340086+0000 front 2024-08-26T00:16:25.340200+0000 (oldest deadline 2024-08-26T00:16:48.839956+0000) 2024-08-26T00:16:56.284 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:56 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:56.019+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-08-26T00:16:33.441525+0000 front 2024-08-26T00:16:33.441595+0000 (oldest deadline 2024-08-26T00:16:55.741506+0000) 2024-08-26T00:16:56.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:56 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:56.123+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:56.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:56 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:56.123+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:56.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:56 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:56.123+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:56.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:56 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:56.123+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:56.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:56 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:56.123+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:16:56.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:56 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:56.123+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.879005+0000 front 2024-08-26T00:16:25.879080+0000 (oldest deadline 2024-08-26T00:16:46.879491+0000) 2024-08-26T00:16:57.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:57 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:57.030+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:57.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:57 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:57.030+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:57.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:57 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:57.030+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:57.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:57 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:57.030+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.537738+0000 front 2024-08-26T00:16:09.538072+0000 (oldest deadline 2024-08-26T00:16:35.438042+0000) 2024-08-26T00:16:57.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:57 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:57.030+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.438791+0000 front 2024-08-26T00:16:15.438689+0000 (oldest deadline 2024-08-26T00:16:40.638978+0000) 2024-08-26T00:16:57.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:57 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:57.030+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.340086+0000 front 2024-08-26T00:16:25.340200+0000 (oldest deadline 2024-08-26T00:16:48.839956+0000) 2024-08-26T00:16:57.284 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:57 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:57.030+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-08-26T00:16:33.441525+0000 front 2024-08-26T00:16:33.441595+0000 (oldest deadline 2024-08-26T00:16:55.741506+0000) 2024-08-26T00:16:57.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:56 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:56.821+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:57.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:56 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:56.821+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:57.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:56 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:56.821+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:57.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:56 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:56.821+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:57.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:56 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:56.821+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:16:57.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:56 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:56.821+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:16:57.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:57 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:57.096+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:57.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:57 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:57.096+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:57.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:57 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:57.096+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:57.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:57 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:57.096+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:57.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:57 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:57.096+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:16:57.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:57 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:57.096+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.879005+0000 front 2024-08-26T00:16:25.879080+0000 (oldest deadline 2024-08-26T00:16:46.879491+0000) 2024-08-26T00:16:58.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:57 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:57.998+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.032723+0000 front 2024-08-26T00:15:45.032763+0000 (oldest deadline 2024-08-26T00:16:07.932889+0000) 2024-08-26T00:16:58.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:57 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:57.998+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:49.034208+0000 front 2024-08-26T00:15:49.034251+0000 (oldest deadline 2024-08-26T00:16:18.435484+0000) 2024-08-26T00:16:58.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:57 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:57.998+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:58.436276+0000 front 2024-08-26T00:15:58.436200+0000 (oldest deadline 2024-08-26T00:16:23.136414+0000) 2024-08-26T00:16:58.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:57 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:57.998+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:09.537738+0000 front 2024-08-26T00:16:09.538072+0000 (oldest deadline 2024-08-26T00:16:35.438042+0000) 2024-08-26T00:16:58.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:57 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:57.998+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.438791+0000 front 2024-08-26T00:16:15.438689+0000 (oldest deadline 2024-08-26T00:16:40.638978+0000) 2024-08-26T00:16:58.284 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:57 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:57.998+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.340086+0000 front 2024-08-26T00:16:25.340200+0000 (oldest deadline 2024-08-26T00:16:48.839956+0000) 2024-08-26T00:16:58.284 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:57 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9[51158]: 2024-08-26T00:16:57.998+0000 7f5111c00640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-08-26T00:16:33.441525+0000 front 2024-08-26T00:16:33.441595+0000 (oldest deadline 2024-08-26T00:16:55.741506+0000) 2024-08-26T00:16:58.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:57 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:57.835+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:58.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:57 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:57.835+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:58.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:57 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:57.835+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:58.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:57 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:57.835+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:58.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:57 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:57.835+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:16:58.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:57 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:57.835+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:16:58.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:58 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:58.086+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:58.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:58 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:58.086+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:58.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:58 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:58.086+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:58.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:58 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:58.086+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:58.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:58 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:58.086+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:16:58.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:58 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:58.086+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.879005+0000 front 2024-08-26T00:16:25.879080+0000 (oldest deadline 2024-08-26T00:16:46.879491+0000) 2024-08-26T00:16:59.006 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:58 smithi042 podman[86929]: 2024-08-26 00:16:58.71068411 +0000 UTC m=+5.690134167 container died 23b463d4c1237ed1850dbc9d0e2d056bc147266f5e8815cabd7974d0e7d86261 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-f273685, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-26T00:16:59.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:59 smithi042 podman[86929]: 2024-08-26 00:16:59.179472364 +0000 UTC m=+6.158922421 container cleanup 23b463d4c1237ed1850dbc9d0e2d056bc147266f5e8815cabd7974d0e7d86261 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-f273685) 2024-08-26T00:16:59.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:59 smithi042 bash[86929]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9 2024-08-26T00:16:59.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:58 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:58.858+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:16:59.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:58 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:58.858+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:16:59.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:58 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:58.858+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:16:59.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:58 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:58.858+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:16:59.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:58 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:58.858+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:16:59.285 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:58 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:58.858+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:16:59.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:59 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:59.111+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:16:59.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:59 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:59.111+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:16:59.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:59 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:59.111+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:16:59.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:59 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:59.111+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:16:59.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:59 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:59.111+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:16:59.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:16:59 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:16:59.111+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.879005+0000 front 2024-08-26T00:16:25.879080+0000 (oldest deadline 2024-08-26T00:16:46.879491+0000) 2024-08-26T00:16:59.783 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:59 smithi042 podman[86946]: 2024-08-26 00:16:59.522698566 +0000 UTC m=+0.797397051 container remove 23b463d4c1237ed1850dbc9d0e2d056bc147266f5e8815cabd7974d0e7d86261 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-f273685) 2024-08-26T00:17:00.283 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:59 smithi042 podman[87034]: 2024-08-26 00:16:59.990428871 +0000 UTC m=+0.118219936 container create 47ff367bd1f6df6b3d0f8e19cfa99e7dafa8c752141bd5cd529c8de2facb94fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-f273685, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-08-26T00:17:00.284 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:16:59 smithi042 podman[87034]: 2024-08-26 00:16:59.900079759 +0000 UTC m=+0.027870850 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34 2024-08-26T00:17:00.284 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:17:00 smithi042 podman[87034]: 2024-08-26 00:17:00.226417036 +0000 UTC m=+0.354208114 container init 47ff367bd1f6df6b3d0f8e19cfa99e7dafa8c752141bd5cd529c8de2facb94fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, RELEASE=squid-f273685, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-08-26T00:17:00.284 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:17:00 smithi042 podman[87034]: 2024-08-26 00:17:00.233620883 +0000 UTC m=+0.361411950 container start 47ff367bd1f6df6b3d0f8e19cfa99e7dafa8c752141bd5cd529c8de2facb94fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f273685, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-08-26T00:17:00.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:59 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:59.840+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:17:00.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:59 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:59.840+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:17:00.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:59 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:59.840+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:17:00.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:59 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:59.840+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:17:00.285 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:59 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:59.840+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:17:00.285 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:16:59 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:16:59.840+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:17:00.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:00 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:00.146+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:17:00.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:00 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:00.146+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:17:00.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:00 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:00.146+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:17:00.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:00 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:00.146+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:17:00.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:00 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:00.146+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:17:00.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:00 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:00.146+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.879005+0000 front 2024-08-26T00:16:25.879080+0000 (oldest deadline 2024-08-26T00:16:46.879491+0000) 2024-08-26T00:17:00.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:00 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:00.146+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-08-26T00:16:33.881458+0000 front 2024-08-26T00:16:33.881510+0000 (oldest deadline 2024-08-26T00:16:59.181085+0000) 2024-08-26T00:17:00.720 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:17:00 smithi042 podman[87034]: 2024-08-26 00:17:00.336827228 +0000 UTC m=+0.464618319 container attach 47ff367bd1f6df6b3d0f8e19cfa99e7dafa8c752141bd5cd529c8de2facb94fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-f273685) 2024-08-26T00:17:00.720 INFO:journalctl@ceph.osd.9.smithi042.stdout:Aug 26 00:17:00 smithi042 podman[87034]: 2024-08-26 00:17:00.505544392 +0000 UTC m=+0.633335459 container died 47ff367bd1f6df6b3d0f8e19cfa99e7dafa8c752141bd5cd529c8de2facb94fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-f273685, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=) 2024-08-26T00:17:01.159 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.9.service' 2024-08-26T00:17:01.236 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:17:01.236 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-08-26T00:17:01.236 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-08-26T00:17:01.237 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.10 2024-08-26T00:17:01.286 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:00 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:00.855+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:17:01.287 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:00 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:00.855+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:17:01.287 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:00 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:00.855+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:17:01.287 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:00 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:00.855+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:17:01.287 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:00 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:00.855+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:17:01.287 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:00 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:00.855+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:17:01.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:01 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:01.128+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:17:01.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:01 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:01.128+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:17:01.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:01 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:01.128+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:17:01.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:01 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:01.128+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:17:01.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:01 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:01.128+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:17:01.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:01 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:01.128+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.879005+0000 front 2024-08-26T00:16:25.879080+0000 (oldest deadline 2024-08-26T00:16:46.879491+0000) 2024-08-26T00:17:01.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:01 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:01.128+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-08-26T00:16:33.881458+0000 front 2024-08-26T00:16:33.881510+0000 (oldest deadline 2024-08-26T00:16:59.181085+0000) 2024-08-26T00:17:01.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:01 smithi043 systemd[1]: Stopping Ceph osd.10 for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:17:02.010 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:01 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:01.542+0000 7f6318ae0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:17:02.010 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:01 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:01.543+0000 7f6318ae0640 -1 osd.10 83 *** Got signal Terminated *** 2024-08-26T00:17:02.010 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:01 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:01.543+0000 7f6318ae0640 -1 osd.10 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-26T00:17:02.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:01 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:01.833+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:17:02.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:01 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:01.833+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:17:02.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:01 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:01.833+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:17:02.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:01 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:01.833+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:17:02.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:01 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:01.833+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:17:02.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:01 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:01.833+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:17:02.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:02 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:02.164+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:17:02.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:02 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:02.164+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:17:02.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:02 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:02.164+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:17:02.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:02 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:02.164+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:17:02.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:02 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:02.164+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:17:02.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:02 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:02.164+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.879005+0000 front 2024-08-26T00:16:25.879080+0000 (oldest deadline 2024-08-26T00:16:46.879491+0000) 2024-08-26T00:17:02.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:02 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:02.164+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-08-26T00:16:33.881458+0000 front 2024-08-26T00:16:33.881510+0000 (oldest deadline 2024-08-26T00:16:59.181085+0000) 2024-08-26T00:17:03.283 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:02 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:02.828+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:17:03.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:02 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:02.828+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:17:03.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:02 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:02.828+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:17:03.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:02 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:02.828+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:17:03.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:02 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:02.828+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:17:03.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:02 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:02.828+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:17:03.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:03 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:03.138+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:17:03.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:03 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:03.138+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:17:03.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:03 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:03.138+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:17:03.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:03 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:03.138+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:17:03.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:03 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:03.138+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:17:03.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:03 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:03.138+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.879005+0000 front 2024-08-26T00:16:25.879080+0000 (oldest deadline 2024-08-26T00:16:46.879491+0000) 2024-08-26T00:17:03.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:03 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:03.138+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-08-26T00:16:33.881458+0000 front 2024-08-26T00:16:33.881510+0000 (oldest deadline 2024-08-26T00:16:59.181085+0000) 2024-08-26T00:17:04.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:03 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:03.824+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:17:04.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:03 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:03.824+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:17:04.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:03 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:03.824+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:17:04.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:03 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:03.824+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:17:04.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:03 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:03.824+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:17:04.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:03 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:03.824+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:17:04.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:03 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:03.824+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6820 osd.7 since back 2024-08-26T00:16:40.953472+0000 front 2024-08-26T00:16:40.953589+0000 (oldest deadline 2024-08-26T00:17:03.253403+0000) 2024-08-26T00:17:04.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:04 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:04.171+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:17:04.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:04 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:04.171+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:17:04.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:04 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:04.171+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:17:04.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:04 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:04.171+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:17:04.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:04 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:04.171+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:17:04.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:04 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:04.171+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.879005+0000 front 2024-08-26T00:16:25.879080+0000 (oldest deadline 2024-08-26T00:16:46.879491+0000) 2024-08-26T00:17:04.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:04 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:04.171+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-08-26T00:16:33.881458+0000 front 2024-08-26T00:16:33.881510+0000 (oldest deadline 2024-08-26T00:16:59.181085+0000) 2024-08-26T00:17:05.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:04 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:04.834+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:17:05.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:04 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:04.834+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:17:05.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:04 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:04.834+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:17:05.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:04 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:04.834+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:17:05.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:04 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:04.834+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:17:05.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:04 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:04.834+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:17:05.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:04 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:04.834+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6820 osd.7 since back 2024-08-26T00:16:40.953472+0000 front 2024-08-26T00:16:40.953589+0000 (oldest deadline 2024-08-26T00:17:03.253403+0000) 2024-08-26T00:17:05.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:05 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:05.204+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:17:05.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:05 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:05.204+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:17:05.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:05 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:05.204+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:17:05.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:05 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:05.204+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:17:05.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:05 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:05.204+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:17:05.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:05 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:05.204+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.879005+0000 front 2024-08-26T00:16:25.879080+0000 (oldest deadline 2024-08-26T00:16:46.879491+0000) 2024-08-26T00:17:05.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:05 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:05.204+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-08-26T00:16:33.881458+0000 front 2024-08-26T00:16:33.881510+0000 (oldest deadline 2024-08-26T00:16:59.181085+0000) 2024-08-26T00:17:06.250 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:05 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:05.808+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:17:06.251 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:05 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:05.808+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:17:06.251 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:05 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:05.808+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:17:06.251 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:05 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:05.808+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:17:06.251 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:05 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:05.808+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:17:06.251 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:05 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:05.808+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:17:06.251 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:05 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:05.808+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6820 osd.7 since back 2024-08-26T00:16:40.953472+0000 front 2024-08-26T00:16:40.953589+0000 (oldest deadline 2024-08-26T00:17:03.253403+0000) 2024-08-26T00:17:06.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:06 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:06.217+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:45.270713+0000 front 2024-08-26T00:15:45.270676+0000 (oldest deadline 2024-08-26T00:16:08.770778+0000) 2024-08-26T00:17:06.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:06 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:06.217+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.972538+0000 front 2024-08-26T00:15:53.972483+0000 (oldest deadline 2024-08-26T00:16:19.272684+0000) 2024-08-26T00:17:06.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:06 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:06.217+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:15:59.773660+0000 front 2024-08-26T00:15:59.773632+0000 (oldest deadline 2024-08-26T00:16:23.273828+0000) 2024-08-26T00:17:06.510 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:06 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:06.217+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:10.076887+0000 front 2024-08-26T00:16:10.076770+0000 (oldest deadline 2024-08-26T00:16:35.976735+0000) 2024-08-26T00:17:06.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:06 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:06.217+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:16.477539+0000 front 2024-08-26T00:16:16.477514+0000 (oldest deadline 2024-08-26T00:16:41.177746+0000) 2024-08-26T00:17:06.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:06 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:06.217+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:25.879005+0000 front 2024-08-26T00:16:25.879080+0000 (oldest deadline 2024-08-26T00:16:46.879491+0000) 2024-08-26T00:17:06.511 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:06 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10[47412]: 2024-08-26T00:17:06.217+0000 7f63110dd640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.42:6822 osd.6 since back 2024-08-26T00:16:33.881458+0000 front 2024-08-26T00:16:33.881510+0000 (oldest deadline 2024-08-26T00:16:59.181085+0000) 2024-08-26T00:17:07.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:07 smithi043 podman[59053]: 2024-08-26 00:17:07.000600251 +0000 UTC m=+5.556792352 container died d242790adf927981ed35c9ee82b8b0f0328c95086812cc4f9ea3e8f0d5e44b4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f273685, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.build-date=20240731) 2024-08-26T00:17:07.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:06 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:06.814+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:17:07.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:06 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:06.814+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:17:07.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:06 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:06.814+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:17:07.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:06 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:06.814+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:17:07.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:06 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:06.814+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:17:07.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:06 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:06.814+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:17:07.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:06 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:06.814+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6820 osd.7 since back 2024-08-26T00:16:40.953472+0000 front 2024-08-26T00:16:40.953589+0000 (oldest deadline 2024-08-26T00:17:03.253403+0000) 2024-08-26T00:17:07.760 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:07 smithi043 podman[59053]: 2024-08-26 00:17:07.334173609 +0000 UTC m=+5.890365709 container cleanup d242790adf927981ed35c9ee82b8b0f0328c95086812cc4f9ea3e8f0d5e44b4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-f273685, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1) 2024-08-26T00:17:07.760 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:07 smithi043 bash[59053]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10 2024-08-26T00:17:07.760 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:07 smithi043 podman[59069]: 2024-08-26 00:17:07.510569345 +0000 UTC m=+0.507726208 container remove d242790adf927981ed35c9ee82b8b0f0328c95086812cc4f9ea3e8f0d5e44b4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-f273685, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-26T00:17:08.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:07 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:07.777+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:17:08.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:07 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:07.777+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:17:08.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:07 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:07.777+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:17:08.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:07 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:07.777+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:17:08.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:07 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:07.777+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:17:08.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:07 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:07.777+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:17:08.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:07 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:07.777+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6820 osd.7 since back 2024-08-26T00:16:40.953472+0000 front 2024-08-26T00:16:40.953589+0000 (oldest deadline 2024-08-26T00:17:03.253403+0000) 2024-08-26T00:17:08.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:07 smithi043 podman[59160]: 2024-08-26 00:17:07.852127416 +0000 UTC m=+0.015858284 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34 2024-08-26T00:17:08.260 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:08 smithi043 podman[59160]: 2024-08-26 00:17:08.069831007 +0000 UTC m=+0.233561916 container create c6f86d92d0df501d14594c77ffc28a08b96da4a898cbc1bd9738a728ecd4108f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10-deactivate, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, RELEASE=squid-f273685, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-26T00:17:08.760 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:08 smithi043 podman[59160]: 2024-08-26 00:17:08.288757201 +0000 UTC m=+0.452488069 container init c6f86d92d0df501d14594c77ffc28a08b96da4a898cbc1bd9738a728ecd4108f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f273685, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_BRANCH=HEAD) 2024-08-26T00:17:08.760 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:08 smithi043 podman[59160]: 2024-08-26 00:17:08.292186906 +0000 UTC m=+0.455917774 container start c6f86d92d0df501d14594c77ffc28a08b96da4a898cbc1bd9738a728ecd4108f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-f273685, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-08-26T00:17:08.760 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:08 smithi043 podman[59160]: 2024-08-26 00:17:08.363610747 +0000 UTC m=+0.527341630 container attach c6f86d92d0df501d14594c77ffc28a08b96da4a898cbc1bd9738a728ecd4108f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-f273685, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-08-26T00:17:08.760 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:08 smithi043 podman[59160]: 2024-08-26 00:17:08.48023495 +0000 UTC m=+0.643965827 container died c6f86d92d0df501d14594c77ffc28a08b96da4a898cbc1bd9738a728ecd4108f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.1, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f273685) 2024-08-26T00:17:09.003 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.10.service' 2024-08-26T00:17:09.028 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:08 smithi043 podman[59183]: 2024-08-26 00:17:08.983646379 +0000 UTC m=+0.494869932 container remove c6f86d92d0df501d14594c77ffc28a08b96da4a898cbc1bd9738a728ecd4108f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f273685, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-26T00:17:09.028 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:08 smithi043 systemd[1]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.10.service: Deactivated successfully. 2024-08-26T00:17:09.028 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:09 smithi043 systemd[1]: Stopped Ceph osd.10 for f89d317a-633c-11ef-bcd2-c7b262605968. 2024-08-26T00:17:09.028 INFO:journalctl@ceph.osd.10.smithi043.stdout:Aug 26 00:17:09 smithi043 systemd[1]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.10.service: Consumed 2min 31.062s CPU time. 2024-08-26T00:17:09.033 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:08 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:08.743+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:17:09.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:08 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:08.743+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:17:09.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:08 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:08.743+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:17:09.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:08 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:08.743+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:17:09.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:08 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:08.743+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:17:09.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:08 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:08.743+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:17:09.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:08 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:08.743+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6820 osd.7 since back 2024-08-26T00:16:40.953472+0000 front 2024-08-26T00:16:40.953589+0000 (oldest deadline 2024-08-26T00:17:03.253403+0000) 2024-08-26T00:17:09.044 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:17:09.044 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-08-26T00:17:09.044 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-08-26T00:17:09.044 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.11 2024-08-26T00:17:09.533 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:09 smithi181 systemd[1]: Stopping Ceph osd.11 for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:17:10.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:09 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:09.563+0000 7fdf50bcf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:17:10.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:09 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:09.563+0000 7fdf50bcf640 -1 osd.11 83 *** Got signal Terminated *** 2024-08-26T00:17:10.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:09 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:09.563+0000 7fdf50bcf640 -1 osd.11 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-26T00:17:10.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:09 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:09.716+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:17:10.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:09 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:09.716+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:17:10.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:09 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:09.716+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:17:10.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:09 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:09.716+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:17:10.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:09 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:09.716+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:17:10.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:09 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:09.716+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:17:10.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:09 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:09.716+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6820 osd.7 since back 2024-08-26T00:16:40.953472+0000 front 2024-08-26T00:16:40.953589+0000 (oldest deadline 2024-08-26T00:17:03.253403+0000) 2024-08-26T00:17:11.033 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:10 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:10.747+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:17:11.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:10 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:10.747+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:17:11.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:10 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:10.747+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:17:11.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:10 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:10.747+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:17:11.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:10 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:10.747+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:17:11.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:10 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:10.747+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:17:11.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:10 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:10.747+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6820 osd.7 since back 2024-08-26T00:16:40.953472+0000 front 2024-08-26T00:16:40.953589+0000 (oldest deadline 2024-08-26T00:17:03.253403+0000) 2024-08-26T00:17:12.039 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:11 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:11.755+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:17:12.040 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:11 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:11.755+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:17:12.040 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:11 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:11.755+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:17:12.040 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:11 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:11.755+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:17:12.040 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:11 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:11.755+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:17:12.040 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:11 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:11.755+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:17:12.040 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:11 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:11.755+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6820 osd.7 since back 2024-08-26T00:16:40.953472+0000 front 2024-08-26T00:16:40.953589+0000 (oldest deadline 2024-08-26T00:17:03.253403+0000) 2024-08-26T00:17:13.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:12 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:12.770+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:17:13.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:12 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:12.770+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:17:13.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:12 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:12.770+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:17:13.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:12 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:12.770+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:17:13.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:12 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:12.770+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:17:13.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:12 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:12.770+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:17:13.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:12 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:12.770+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6820 osd.7 since back 2024-08-26T00:16:40.953472+0000 front 2024-08-26T00:16:40.953589+0000 (oldest deadline 2024-08-26T00:17:03.253403+0000) 2024-08-26T00:17:13.034 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:12 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:12.770+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6820 osd.8 since back 2024-08-26T00:16:47.954599+0000 front 2024-08-26T00:16:47.954621+0000 (oldest deadline 2024-08-26T00:17:12.654600+0000) 2024-08-26T00:17:14.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:13 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:13.803+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6806 osd.0 since back 2024-08-26T00:15:42.942211+0000 front 2024-08-26T00:15:42.942176+0000 (oldest deadline 2024-08-26T00:16:07.042092+0000) 2024-08-26T00:17:14.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:13 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:13.803+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6804 osd.1 since back 2024-08-26T00:15:53.145757+0000 front 2024-08-26T00:15:53.145816+0000 (oldest deadline 2024-08-26T00:16:16.045799+0000) 2024-08-26T00:17:14.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:13 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:13.803+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-08-26T00:16:00.746730+0000 front 2024-08-26T00:16:00.746700+0000 (oldest deadline 2024-08-26T00:16:24.246813+0000) 2024-08-26T00:17:14.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:13 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:13.803+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.42:6814 osd.3 since back 2024-08-26T00:16:08.948156+0000 front 2024-08-26T00:16:08.947920+0000 (oldest deadline 2024-08-26T00:16:30.648036+0000) 2024-08-26T00:17:14.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:13 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:13.803+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6812 osd.4 since back 2024-08-26T00:16:15.750462+0000 front 2024-08-26T00:16:15.750588+0000 (oldest deadline 2024-08-26T00:16:39.850443+0000) 2024-08-26T00:17:14.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:13 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:13.803+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-08-26T00:16:22.751432+0000 front 2024-08-26T00:16:22.751361+0000 (oldest deadline 2024-08-26T00:16:48.651442+0000) 2024-08-26T00:17:14.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:13 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:13.803+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.43:6820 osd.7 since back 2024-08-26T00:16:40.953472+0000 front 2024-08-26T00:16:40.953589+0000 (oldest deadline 2024-08-26T00:17:03.253403+0000) 2024-08-26T00:17:14.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:13 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11[47833]: 2024-08-26T00:17:13.803+0000 7fdf491cc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.181:6820 osd.8 since back 2024-08-26T00:16:47.954599+0000 front 2024-08-26T00:16:47.954621+0000 (oldest deadline 2024-08-26T00:17:12.654600+0000) 2024-08-26T00:17:15.284 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:14 smithi181 podman[58794]: 2024-08-26 00:17:14.969707445 +0000 UTC m=+5.730528415 container died cd02f09ef1565e068341bb3733ecf0dccb4300a2decee55491199b7d70be4bab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.license=GPLv2, RELEASE=squid-f273685, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-26T00:17:15.784 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:15 smithi181 podman[58794]: 2024-08-26 00:17:15.288091387 +0000 UTC m=+6.048912399 container cleanup cd02f09ef1565e068341bb3733ecf0dccb4300a2decee55491199b7d70be4bab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-f273685, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-26T00:17:15.784 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:15 smithi181 bash[58794]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11 2024-08-26T00:17:15.784 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:15 smithi181 podman[58811]: 2024-08-26 00:17:15.480928838 +0000 UTC m=+0.511842218 container remove cd02f09ef1565e068341bb3733ecf0dccb4300a2decee55491199b7d70be4bab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-f273685, GIT_BRANCH=HEAD, io.buildah.version=1.37.1) 2024-08-26T00:17:16.151 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:15 smithi181 podman[58900]: 2024-08-26 00:17:15.802065937 +0000 UTC m=+0.015819358 image pull c7be02d964cfccf3f9d2be96e4410163e63945bd3dbba7d396792dd76de4a5e4 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34 2024-08-26T00:17:16.151 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:15 smithi181 podman[58900]: 2024-08-26 00:17:15.906685819 +0000 UTC m=+0.120439225 container create fe7f816ff12da3056a2f8a245535369186b03f4af497d5a4dd99644f55f4b70b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-f273685, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-08-26T00:17:16.533 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:16 smithi181 podman[58900]: 2024-08-26 00:17:16.150814382 +0000 UTC m=+0.364567794 container init fe7f816ff12da3056a2f8a245535369186b03f4af497d5a4dd99644f55f4b70b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-f273685, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.1) 2024-08-26T00:17:16.534 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:16 smithi181 podman[58900]: 2024-08-26 00:17:16.15433444 +0000 UTC m=+0.368087849 container start fe7f816ff12da3056a2f8a245535369186b03f4af497d5a4dd99644f55f4b70b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11-deactivate, RELEASE=squid-f273685, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-26T00:17:16.534 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:16 smithi181 podman[58900]: 2024-08-26 00:17:16.225769574 +0000 UTC m=+0.439522986 container attach fe7f816ff12da3056a2f8a245535369186b03f4af497d5a4dd99644f55f4b70b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-f273685, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-08-26T00:17:16.534 INFO:journalctl@ceph.osd.11.smithi181.stdout:Aug 26 00:17:16 smithi181 podman[58900]: 2024-08-26 00:17:16.341755865 +0000 UTC m=+0.555509272 container died fe7f816ff12da3056a2f8a245535369186b03f4af497d5a4dd99644f55f4b70b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-f273685, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-08-26T00:17:16.896 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@osd.11.service' 2024-08-26T00:17:16.936 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:17:16.937 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-08-26T00:17:16.937 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-08-26T00:17:16.937 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.a 2024-08-26T00:17:17.283 INFO:journalctl@ceph.mds.a.smithi042.stdout:Aug 26 00:17:17 smithi042 systemd[1]: Stopping Ceph mds.a for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:17:17.783 INFO:journalctl@ceph.mds.a.smithi042.stdout:Aug 26 00:17:17 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-a[58076]: 2024-08-26T00:17:17.376+0000 7f20eb600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:17:17.783 INFO:journalctl@ceph.mds.a.smithi042.stdout:Aug 26 00:17:17 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-a[58076]: 2024-08-26T00:17:17.376+0000 7f20eb600640 -1 mds.a *** got signal Terminated *** 2024-08-26T00:17:19.773 INFO:journalctl@ceph.mds.a.smithi042.stdout:Aug 26 00:17:19 smithi042 podman[87146]: 2024-08-26 00:17:19.483085428 +0000 UTC m=+2.244512309 container died 5b670d163482cd7324f4718067eae2f76cdb8e02726ac1f956ce960458674801 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-f273685, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-26T00:17:20.409 INFO:journalctl@ceph.mds.a.smithi042.stdout:Aug 26 00:17:20 smithi042 podman[87146]: 2024-08-26 00:17:20.140696688 +0000 UTC m=+2.902123568 container cleanup 5b670d163482cd7324f4718067eae2f76cdb8e02726ac1f956ce960458674801 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-a, RELEASE=squid-f273685, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux ) 2024-08-26T00:17:20.410 INFO:journalctl@ceph.mds.a.smithi042.stdout:Aug 26 00:17:20 smithi042 bash[87146]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-a 2024-08-26T00:17:20.669 INFO:journalctl@ceph.mds.a.smithi042.stdout:Aug 26 00:17:20 smithi042 podman[87170]: 2024-08-26 00:17:20.409158647 +0000 UTC m=+0.912133773 container remove 5b670d163482cd7324f4718067eae2f76cdb8e02726ac1f956ce960458674801 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-a, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-f273685, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-26T00:17:20.693 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.a.service' 2024-08-26T00:17:20.766 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:17:20.766 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-08-26T00:17:20.766 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-08-26T00:17:20.766 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.d 2024-08-26T00:17:21.033 INFO:journalctl@ceph.mds.d.smithi042.stdout:Aug 26 00:17:20 smithi042 systemd[1]: Stopping Ceph mds.d for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:17:21.533 INFO:journalctl@ceph.mds.d.smithi042.stdout:Aug 26 00:17:21 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-d[56978]: 2024-08-26T00:17:21.222+0000 7f5b54c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:17:21.533 INFO:journalctl@ceph.mds.d.smithi042.stdout:Aug 26 00:17:21 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-d[56978]: 2024-08-26T00:17:21.222+0000 7f5b54c00640 -1 mds.d *** got signal Terminated *** 2024-08-26T00:17:24.422 INFO:journalctl@ceph.mds.d.smithi042.stdout:Aug 26 00:17:24 smithi042 podman[87280]: 2024-08-26 00:17:24.113379967 +0000 UTC m=+3.018043330 container died 038bfaedb1141d0f58fd82e556eda63ddd4781f45bd8a78323e4038246a7fff9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-d, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f273685, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-08-26T00:17:24.783 INFO:journalctl@ceph.mds.d.smithi042.stdout:Aug 26 00:17:24 smithi042 podman[87280]: 2024-08-26 00:17:24.612083153 +0000 UTC m=+3.516746515 container cleanup 038bfaedb1141d0f58fd82e556eda63ddd4781f45bd8a78323e4038246a7fff9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-d, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-f273685, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-26T00:17:24.783 INFO:journalctl@ceph.mds.d.smithi042.stdout:Aug 26 00:17:24 smithi042 bash[87280]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-d 2024-08-26T00:17:25.107 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.d.service' 2024-08-26T00:17:25.155 INFO:journalctl@ceph.mds.d.smithi042.stdout:Aug 26 00:17:24 smithi042 podman[87291]: 2024-08-26 00:17:24.897274784 +0000 UTC m=+0.771980200 container remove 038bfaedb1141d0f58fd82e556eda63ddd4781f45bd8a78323e4038246a7fff9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-d, RELEASE=squid-f273685, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-26T00:17:25.155 INFO:journalctl@ceph.mds.d.smithi042.stdout:Aug 26 00:17:25 smithi042 systemd[1]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.d.service: Deactivated successfully. 2024-08-26T00:17:25.155 INFO:journalctl@ceph.mds.d.smithi042.stdout:Aug 26 00:17:25 smithi042 systemd[1]: Stopped Ceph mds.d for f89d317a-633c-11ef-bcd2-c7b262605968. 2024-08-26T00:17:25.155 INFO:journalctl@ceph.mds.d.smithi042.stdout:Aug 26 00:17:25 smithi042 systemd[1]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.d.service: Consumed 1.596s CPU time. 2024-08-26T00:17:25.177 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:17:25.178 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-08-26T00:17:25.178 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-08-26T00:17:25.178 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.g 2024-08-26T00:17:25.533 INFO:journalctl@ceph.mds.g.smithi042.stdout:Aug 26 00:17:25 smithi042 systemd[1]: Stopping Ceph mds.g for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:17:26.033 INFO:journalctl@ceph.mds.g.smithi042.stdout:Aug 26 00:17:25 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-g[57745]: 2024-08-26T00:17:25.577+0000 7f6764600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:17:26.033 INFO:journalctl@ceph.mds.g.smithi042.stdout:Aug 26 00:17:25 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-g[57745]: 2024-08-26T00:17:25.577+0000 7f6764600640 -1 mds.g *** got signal Terminated *** 2024-08-26T00:17:28.769 INFO:journalctl@ceph.mds.g.smithi042.stdout:Aug 26 00:17:28 smithi042 podman[87398]: 2024-08-26 00:17:28.470086545 +0000 UTC m=+3.012289764 container died f79a3cac1c034b074d272fcd7e49ced5e322ce5b9f792ecd92263de1922e4480 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-g, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f273685, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-08-26T00:17:29.033 INFO:journalctl@ceph.mds.g.smithi042.stdout:Aug 26 00:17:28 smithi042 podman[87398]: 2024-08-26 00:17:28.975470438 +0000 UTC m=+3.517673657 container cleanup f79a3cac1c034b074d272fcd7e49ced5e322ce5b9f792ecd92263de1922e4480 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-g, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-f273685, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-08-26T00:17:29.033 INFO:journalctl@ceph.mds.g.smithi042.stdout:Aug 26 00:17:28 smithi042 bash[87398]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-g 2024-08-26T00:17:29.525 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.g.service' 2024-08-26T00:17:29.594 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:17:29.595 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-08-26T00:17:29.595 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-08-26T00:17:29.595 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.j 2024-08-26T00:17:29.856 INFO:journalctl@ceph.mds.j.smithi042.stdout:Aug 26 00:17:29 smithi042 systemd[1]: Stopping Ceph mds.j for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:17:30.533 INFO:journalctl@ceph.mds.j.smithi042.stdout:Aug 26 00:17:30 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-j[56568]: 2024-08-26T00:17:30.165+0000 7f1623c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:17:30.533 INFO:journalctl@ceph.mds.j.smithi042.stdout:Aug 26 00:17:30 smithi042 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-j[56568]: 2024-08-26T00:17:30.165+0000 7f1623c00640 -1 mds.j *** got signal Terminated *** 2024-08-26T00:17:32.756 INFO:journalctl@ceph.mds.j.smithi042.stdout:Aug 26 00:17:32 smithi042 podman[87517]: 2024-08-26 00:17:32.50268775 +0000 UTC m=+2.594098352 container died 1ec190fe0970cb091e3a3deaf4b2e27d6aaedf6551a772e8090508675a83d60a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-j, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-f273685) 2024-08-26T00:17:33.033 INFO:journalctl@ceph.mds.j.smithi042.stdout:Aug 26 00:17:32 smithi042 podman[87517]: 2024-08-26 00:17:32.862817357 +0000 UTC m=+2.954227949 container cleanup 1ec190fe0970cb091e3a3deaf4b2e27d6aaedf6551a772e8090508675a83d60a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-f273685, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-26T00:17:33.034 INFO:journalctl@ceph.mds.j.smithi042.stdout:Aug 26 00:17:32 smithi042 bash[87517]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-j 2024-08-26T00:17:33.338 INFO:journalctl@ceph.mds.j.smithi042.stdout:Aug 26 00:17:33 smithi042 podman[87541]: 2024-08-26 00:17:33.081424826 +0000 UTC m=+0.571857922 container remove 1ec190fe0970cb091e3a3deaf4b2e27d6aaedf6551a772e8090508675a83d60a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-f273685, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-26T00:17:33.358 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.j.service' 2024-08-26T00:17:33.430 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:17:33.430 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-08-26T00:17:33.430 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-08-26T00:17:33.430 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.b 2024-08-26T00:17:33.735 INFO:journalctl@ceph.mds.b.smithi043.stdout:Aug 26 00:17:33 smithi043 systemd[1]: Stopping Ceph mds.b for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:17:34.010 INFO:journalctl@ceph.mds.b.smithi043.stdout:Aug 26 00:17:33 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-b[52979]: 2024-08-26T00:17:33.734+0000 7f091b948640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:17:34.010 INFO:journalctl@ceph.mds.b.smithi043.stdout:Aug 26 00:17:33 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-b[52979]: 2024-08-26T00:17:33.734+0000 7f091b948640 -1 mds.b *** got signal Terminated *** 2024-08-26T00:17:35.810 INFO:journalctl@ceph.mds.b.smithi043.stdout:Aug 26 00:17:35 smithi043 podman[59261]: 2024-08-26 00:17:35.53832846 +0000 UTC m=+1.899649176 container died 186e65419a0f912af47099e818fbea5cb7db843361712f68de0d7d5e14782daa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-b, RELEASE=squid-f273685, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.license=GPLv2) 2024-08-26T00:17:36.069 INFO:journalctl@ceph.mds.b.smithi043.stdout:Aug 26 00:17:35 smithi043 podman[59261]: 2024-08-26 00:17:35.883677833 +0000 UTC m=+2.244998552 container cleanup 186e65419a0f912af47099e818fbea5cb7db843361712f68de0d7d5e14782daa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-b, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-f273685, org.label-schema.schema-version=1.0) 2024-08-26T00:17:36.069 INFO:journalctl@ceph.mds.b.smithi043.stdout:Aug 26 00:17:35 smithi043 bash[59261]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-b 2024-08-26T00:17:36.301 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.b.service' 2024-08-26T00:17:36.323 INFO:journalctl@ceph.mds.b.smithi043.stdout:Aug 26 00:17:36 smithi043 podman[59285]: 2024-08-26 00:17:36.068283546 +0000 UTC m=+0.523027698 container remove 186e65419a0f912af47099e818fbea5cb7db843361712f68de0d7d5e14782daa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-b, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-f273685, io.buildah.version=1.37.1) 2024-08-26T00:17:36.323 INFO:journalctl@ceph.mds.b.smithi043.stdout:Aug 26 00:17:36 smithi043 systemd[1]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.b.service: Deactivated successfully. 2024-08-26T00:17:36.323 INFO:journalctl@ceph.mds.b.smithi043.stdout:Aug 26 00:17:36 smithi043 systemd[1]: Stopped Ceph mds.b for f89d317a-633c-11ef-bcd2-c7b262605968. 2024-08-26T00:17:36.323 INFO:journalctl@ceph.mds.b.smithi043.stdout:Aug 26 00:17:36 smithi043 systemd[1]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.b.service: Consumed 10min 51.877s CPU time. 2024-08-26T00:17:36.337 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:17:36.337 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-08-26T00:17:36.337 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-08-26T00:17:36.337 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.e 2024-08-26T00:17:36.679 INFO:journalctl@ceph.mds.e.smithi043.stdout:Aug 26 00:17:36 smithi043 systemd[1]: Stopping Ceph mds.e for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:17:37.010 INFO:journalctl@ceph.mds.e.smithi043.stdout:Aug 26 00:17:36 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-e[52349]: 2024-08-26T00:17:36.679+0000 7f919872a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:17:37.010 INFO:journalctl@ceph.mds.e.smithi043.stdout:Aug 26 00:17:36 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-e[52349]: 2024-08-26T00:17:36.679+0000 7f919872a640 -1 mds.e *** got signal Terminated *** 2024-08-26T00:17:39.880 INFO:journalctl@ceph.mds.e.smithi043.stdout:Aug 26 00:17:39 smithi043 podman[59396]: 2024-08-26 00:17:39.535516692 +0000 UTC m=+2.973490198 container died 4f6ceec12568490610585362d88eb49a68264f879f4c90cb8757a6cb084d3466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-f273685, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-26T00:17:40.172 INFO:journalctl@ceph.mds.e.smithi043.stdout:Aug 26 00:17:39 smithi043 podman[59396]: 2024-08-26 00:17:39.954300279 +0000 UTC m=+3.392273788 container cleanup 4f6ceec12568490610585362d88eb49a68264f879f4c90cb8757a6cb084d3466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-e, RELEASE=squid-f273685, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.1) 2024-08-26T00:17:40.172 INFO:journalctl@ceph.mds.e.smithi043.stdout:Aug 26 00:17:39 smithi043 bash[59396]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-e 2024-08-26T00:17:40.319 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.e.service' 2024-08-26T00:17:40.354 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:17:40.354 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-08-26T00:17:40.354 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-08-26T00:17:40.355 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.h 2024-08-26T00:17:40.760 INFO:journalctl@ceph.mds.h.smithi043.stdout:Aug 26 00:17:40 smithi043 systemd[1]: Stopping Ceph mds.h for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:17:40.760 INFO:journalctl@ceph.mds.h.smithi043.stdout:Aug 26 00:17:40 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-h[52664]: 2024-08-26T00:17:40.674+0000 7f51ae177640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:17:40.760 INFO:journalctl@ceph.mds.h.smithi043.stdout:Aug 26 00:17:40 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-h[52664]: 2024-08-26T00:17:40.674+0000 7f51ae177640 -1 mds.h *** got signal Terminated *** 2024-08-26T00:17:43.792 INFO:journalctl@ceph.mds.h.smithi043.stdout:Aug 26 00:17:43 smithi043 podman[59518]: 2024-08-26 00:17:43.534709245 +0000 UTC m=+2.963386898 container died 56cb0f11a01ea10b82cd10239a7a5b8f33f787601623311d26f27de0c37070e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-f273685, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-26T00:17:44.242 INFO:journalctl@ceph.mds.h.smithi043.stdout:Aug 26 00:17:43 smithi043 podman[59518]: 2024-08-26 00:17:43.883046125 +0000 UTC m=+3.311723778 container cleanup 56cb0f11a01ea10b82cd10239a7a5b8f33f787601623311d26f27de0c37070e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-h, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-f273685, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-08-26T00:17:44.243 INFO:journalctl@ceph.mds.h.smithi043.stdout:Aug 26 00:17:43 smithi043 bash[59518]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-h 2024-08-26T00:17:44.459 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.h.service' 2024-08-26T00:17:44.491 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:17:44.491 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-08-26T00:17:44.491 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-08-26T00:17:44.491 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.k 2024-08-26T00:17:45.010 INFO:journalctl@ceph.mds.k.smithi043.stdout:Aug 26 00:17:44 smithi043 systemd[1]: Stopping Ceph mds.k for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:17:45.010 INFO:journalctl@ceph.mds.k.smithi043.stdout:Aug 26 00:17:44 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-k[52041]: 2024-08-26T00:17:44.794+0000 7fb3e9872640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:17:45.010 INFO:journalctl@ceph.mds.k.smithi043.stdout:Aug 26 00:17:44 smithi043 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-k[52041]: 2024-08-26T00:17:44.794+0000 7fb3e9872640 -1 mds.k *** got signal Terminated *** 2024-08-26T00:17:48.771 INFO:journalctl@ceph.mds.k.smithi043.stdout:Aug 26 00:17:48 smithi043 podman[59641]: 2024-08-26 00:17:48.514827113 +0000 UTC m=+3.807680402 container died 1803b8d455ffc47d34115acd4903b8c71f7ddd9f99b7acd4b3ae28d5474ca87e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-k, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f273685, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-08-26T00:17:49.138 INFO:journalctl@ceph.mds.k.smithi043.stdout:Aug 26 00:17:48 smithi043 podman[59641]: 2024-08-26 00:17:48.870321534 +0000 UTC m=+4.163174825 container cleanup 1803b8d455ffc47d34115acd4903b8c71f7ddd9f99b7acd4b3ae28d5474ca87e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-k, GIT_BRANCH=HEAD, RELEASE=squid-f273685, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-08-26T00:17:49.138 INFO:journalctl@ceph.mds.k.smithi043.stdout:Aug 26 00:17:48 smithi043 bash[59641]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-k 2024-08-26T00:17:49.257 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.k.service' 2024-08-26T00:17:49.289 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:17:49.289 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-08-26T00:17:49.289 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-08-26T00:17:49.289 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.c 2024-08-26T00:17:49.587 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:17:49 smithi181 systemd[1]: Stopping Ceph mds.c for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:17:49.850 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:17:49 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:17:49.585+0000 7fd250f0d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:17:49.850 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:17:49 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c[52692]: 2024-08-26T00:17:49.585+0000 7fd250f0d640 -1 mds.c *** got signal Terminated *** 2024-08-26T00:17:51.783 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:17:51 smithi181 podman[59002]: 2024-08-26 00:17:51.514888847 +0000 UTC m=+2.024130597 container died 6a38a30aa9617b90121800e0a4311b513d9ef44d19fe2cb8f64a639c4914746b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-f273685, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-08-26T00:17:52.271 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:17:51 smithi181 podman[59002]: 2024-08-26 00:17:51.969484915 +0000 UTC m=+2.478726667 container cleanup 6a38a30aa9617b90121800e0a4311b513d9ef44d19fe2cb8f64a639c4914746b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-f273685, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-26T00:17:52.271 INFO:journalctl@ceph.mds.c.smithi181.stdout:Aug 26 00:17:51 smithi181 bash[59002]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-c 2024-08-26T00:17:52.450 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.c.service' 2024-08-26T00:17:52.486 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:17:52.487 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-08-26T00:17:52.487 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-08-26T00:17:52.487 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.f 2024-08-26T00:17:52.841 INFO:journalctl@ceph.mds.f.smithi181.stdout:Aug 26 00:17:52 smithi181 systemd[1]: Stopping Ceph mds.f for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:17:53.283 INFO:journalctl@ceph.mds.f.smithi181.stdout:Aug 26 00:17:52 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-f[52393]: 2024-08-26T00:17:52.839+0000 7f7c2fd26640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:17:53.284 INFO:journalctl@ceph.mds.f.smithi181.stdout:Aug 26 00:17:52 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-f[52393]: 2024-08-26T00:17:52.839+0000 7f7c2fd26640 -1 mds.f *** got signal Terminated *** 2024-08-26T00:17:55.783 INFO:journalctl@ceph.mds.f.smithi181.stdout:Aug 26 00:17:55 smithi181 podman[59135]: 2024-08-26 00:17:55.521782414 +0000 UTC m=+2.816971559 container died f77e962be4bf62eb5d43d14775efb7612fee9b1303ee944de59885bfdd4cd611 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-f, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-f273685, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-26T00:17:56.166 INFO:journalctl@ceph.mds.f.smithi181.stdout:Aug 26 00:17:55 smithi181 podman[59135]: 2024-08-26 00:17:55.881654301 +0000 UTC m=+3.176843437 container cleanup f77e962be4bf62eb5d43d14775efb7612fee9b1303ee944de59885bfdd4cd611 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-f, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-f273685, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-08-26T00:17:56.166 INFO:journalctl@ceph.mds.f.smithi181.stdout:Aug 26 00:17:55 smithi181 bash[59135]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-f 2024-08-26T00:17:56.304 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.f.service' 2024-08-26T00:17:56.338 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:17:56.338 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-08-26T00:17:56.338 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-08-26T00:17:56.339 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.i 2024-08-26T00:17:56.533 INFO:journalctl@ceph.mds.i.smithi181.stdout:Aug 26 00:17:56 smithi181 systemd[1]: Stopping Ceph mds.i for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:17:57.033 INFO:journalctl@ceph.mds.i.smithi181.stdout:Aug 26 00:17:56 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-i[52991]: 2024-08-26T00:17:56.642+0000 7fb9f19fc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:17:57.033 INFO:journalctl@ceph.mds.i.smithi181.stdout:Aug 26 00:17:56 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-i[52991]: 2024-08-26T00:17:56.642+0000 7fb9f19fc640 -1 mds.i *** got signal Terminated *** 2024-08-26T00:17:59.783 INFO:journalctl@ceph.mds.i.smithi181.stdout:Aug 26 00:17:59 smithi181 podman[59256]: 2024-08-26 00:17:59.522000412 +0000 UTC m=+2.970475416 container died 3f20ac14b5ad905ea744d1b519de37e8d18f3a94de5a716e86ed8689cdcbc764 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-f273685, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-26T00:18:00.161 INFO:journalctl@ceph.mds.i.smithi181.stdout:Aug 26 00:17:59 smithi181 podman[59256]: 2024-08-26 00:17:59.876343651 +0000 UTC m=+3.324818643 container cleanup 3f20ac14b5ad905ea744d1b519de37e8d18f3a94de5a716e86ed8689cdcbc764 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-i, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-f273685, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-26T00:18:00.161 INFO:journalctl@ceph.mds.i.smithi181.stdout:Aug 26 00:17:59 smithi181 bash[59256]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-i 2024-08-26T00:18:00.311 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.i.service' 2024-08-26T00:18:00.344 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:18:00.344 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-08-26T00:18:00.344 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-08-26T00:18:00.344 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.l 2024-08-26T00:18:00.783 INFO:journalctl@ceph.mds.l.smithi181.stdout:Aug 26 00:18:00 smithi181 systemd[1]: Stopping Ceph mds.l for f89d317a-633c-11ef-bcd2-c7b262605968... 2024-08-26T00:18:00.783 INFO:journalctl@ceph.mds.l.smithi181.stdout:Aug 26 00:18:00 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-l[52083]: 2024-08-26T00:18:00.662+0000 7f6be4450640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-26T00:18:00.784 INFO:journalctl@ceph.mds.l.smithi181.stdout:Aug 26 00:18:00 smithi181 ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-l[52083]: 2024-08-26T00:18:00.662+0000 7f6be4450640 -1 mds.l *** got signal Terminated *** 2024-08-26T00:18:02.283 INFO:journalctl@ceph.mds.l.smithi181.stdout:Aug 26 00:18:02 smithi181 podman[59376]: 2024-08-26 00:18:02.026060342 +0000 UTC m=+1.458972309 container died 6e69c707ad48dc52527fd61cfb7d3d19541f163211f8505b8b294aa4712b57ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-l, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, RELEASE=squid-f273685, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-26T00:18:02.648 INFO:journalctl@ceph.mds.l.smithi181.stdout:Aug 26 00:18:02 smithi181 podman[59376]: 2024-08-26 00:18:02.389161938 +0000 UTC m=+1.822073903 container cleanup 6e69c707ad48dc52527fd61cfb7d3d19541f163211f8505b8b294aa4712b57ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:31aedc96ad4ee61033d5ca745539af523d5b7020c2b74a58b91bf9a89e2c5e34, name=ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-l, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-f273685, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-08-26T00:18:02.648 INFO:journalctl@ceph.mds.l.smithi181.stdout:Aug 26 00:18:02 smithi181 bash[59376]: ceph-f89d317a-633c-11ef-bcd2-c7b262605968-mds-l 2024-08-26T00:18:02.808 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f89d317a-633c-11ef-bcd2-c7b262605968@mds.l.service' 2024-08-26T00:18:02.841 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-26T00:18:02.841 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-08-26T00:18:02.841 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f89d317a-633c-11ef-bcd2-c7b262605968 --force --keep-logs 2024-08-26T00:18:03.124 INFO:teuthology.orchestra.run.smithi042.stdout:Deleting cluster with fsid: f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-26T00:18:07.083 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f89d317a-633c-11ef-bcd2-c7b262605968 --force --keep-logs 2024-08-26T00:18:07.291 INFO:teuthology.orchestra.run.smithi043.stdout:Deleting cluster with fsid: f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-26T00:18:09.841 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f89d317a-633c-11ef-bcd2-c7b262605968 --force --keep-logs 2024-08-26T00:18:10.043 INFO:teuthology.orchestra.run.smithi181.stdout:Deleting cluster with fsid: f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-26T00:18:12.468 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-26T00:18:12.532 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-26T00:18:12.565 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-26T00:18:12.592 INFO:tasks.cephadm:Archiving crash dumps... 2024-08-26T00:18:12.594 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-08-25_21:24:02-fs-squid-distro-default-smithi/7872309/remote/smithi042/crash 2024-08-26T00:18:12.595 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/crash -- . 2024-08-26T00:18:12.653 INFO:teuthology.orchestra.run.smithi042.stderr:tar: /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/crash: Cannot open: No such file or directory 2024-08-26T00:18:12.653 INFO:teuthology.orchestra.run.smithi042.stderr:tar: Error is not recoverable: exiting now 2024-08-26T00:18:12.656 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-08-25_21:24:02-fs-squid-distro-default-smithi/7872309/remote/smithi043/crash 2024-08-26T00:18:12.657 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/crash -- . 2024-08-26T00:18:12.696 INFO:teuthology.orchestra.run.smithi043.stderr:tar: /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/crash: Cannot open: No such file or directory 2024-08-26T00:18:12.696 INFO:teuthology.orchestra.run.smithi043.stderr:tar: Error is not recoverable: exiting now 2024-08-26T00:18:12.698 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-08-25_21:24:02-fs-squid-distro-default-smithi/7872309/remote/smithi181/crash 2024-08-26T00:18:12.698 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/crash -- . 2024-08-26T00:18:12.732 INFO:teuthology.orchestra.run.smithi181.stderr:tar: /var/lib/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/crash: Cannot open: No such file or directory 2024-08-26T00:18:12.733 INFO:teuthology.orchestra.run.smithi181.stderr:tar: Error is not recoverable: exiting now 2024-08-26T00:18:12.734 INFO:tasks.cephadm:Checking cluster log for badness... 2024-08-26T00:18:12.734 DEBUG:teuthology.orchestra.run.smithi042:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-26T00:18:12.818 INFO:teuthology.orchestra.run.smithi042.stdout:2024-08-26T00:12:31.003515+0000 mds.c (mds.2) 929 : cluster [WRN] Scrub error on inode 0x100000027e0 (/volumes/qa/sv_1/269f5507-8998-422b-97df-9053d1be8750/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-271/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-08-26T00:18:12.819 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-08-26T00:18:12.819 INFO:tasks.cephadm:Compressing logs... 2024-08-26T00:18:12.820 DEBUG:teuthology.orchestra.run.smithi042:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-26T00:18:12.823 DEBUG:teuthology.orchestra.run.smithi043:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-26T00:18:12.826 DEBUG:teuthology.orchestra.run.smithi181:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-26T00:18:12.853 INFO:teuthology.orchestra.run.smithi043.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.e.log 2024-08-26T00:18:12.853 INFO:teuthology.orchestra.run.smithi043.stderr:: No such file or directory 2024-08-26T00:18:12.853 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mon.b.log 2024-08-26T00:18:12.853 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.k.log 2024-08-26T00:18:12.855 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.10.log 2024-08-26T00:18:12.855 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mgr.y.log 2024-08-26T00:18:12.855 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.log 2024-08-26T00:18:12.855 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.cephadm.log 2024-08-26T00:18:12.858 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.h.log 2024-08-26T00:18:12.858 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-volume.log 2024-08-26T00:18:12.858 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.1.log 2024-08-26T00:18:12.858 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.audit.log 2024-08-26T00:18:12.858 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.b.log 2024-08-26T00:18:12.858 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.7.log 2024-08-26T00:18:12.858 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.4.log 2024-08-26T00:18:12.858 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-26T00:18:12.858 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.4.log: 94.6% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.k.log.gz 2024-08-26T00:18:12.859 INFO:teuthology.orchestra.run.smithi181.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mon.c.log 2024-08-26T00:18:12.860 INFO:teuthology.orchestra.run.smithi181.stderr:: No such file or directory 2024-08-26T00:18:12.860 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.l.log 2024-08-26T00:18:12.860 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.2.log 2024-08-26T00:18:12.860 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mon.c.log: /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.log 2024-08-26T00:18:12.860 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mgr.z.log 2024-08-26T00:18:12.863 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.cephadm.log 2024-08-26T00:18:12.863 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.i.log 2024-08-26T00:18:12.863 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.f.log 2024-08-26T00:18:12.863 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.c.log 2024-08-26T00:18:12.863 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.8.log 2024-08-26T00:18:12.863 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-volume.log 2024-08-26T00:18:12.863 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.audit.log 2024-08-26T00:18:12.863 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.11.log 2024-08-26T00:18:12.863 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.5.log 2024-08-26T00:18:12.863 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-26T00:18:12.863 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.5.log: /var/log/ceph/cephadm.log: 94.6% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.l.log.gz 2024-08-26T00:18:12.874 INFO:teuthology.orchestra.run.smithi042.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.d.log 2024-08-26T00:18:12.874 INFO:teuthology.orchestra.run.smithi042.stderr:: No such file or directory 2024-08-26T00:18:12.875 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.a.log 2024-08-26T00:18:12.875 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.log 2024-08-26T00:18:12.876 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.cephadm.log 2024-08-26T00:18:12.877 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.0.log 2024-08-26T00:18:12.878 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.3.log 2024-08-26T00:18:12.879 INFO:teuthology.orchestra.run.smithi042.stderr: 82.6% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.cephadm.log.gz 2024-08-26T00:18:12.880 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.0.log: 94.5% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.d.log.gz 2024-08-26T00:18:12.881 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.g.log 2024-08-26T00:18:12.881 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.j.log 2024-08-26T00:18:12.881 INFO:teuthology.orchestra.run.smithi042.stderr: 94.6% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.a.log.gz 2024-08-26T00:18:12.882 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mgr.x.log 2024-08-26T00:18:12.883 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.j.log: 89.9% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.log.gz 2024-08-26T00:18:12.883 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-volume.log 2024-08-26T00:18:12.884 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.6.log 2024-08-26T00:18:12.885 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mgr.x.log: /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.audit.log 2024-08-26T00:18:12.886 INFO:teuthology.orchestra.run.smithi042.stderr: 94.5% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.g.log.gz 2024-08-26T00:18:12.886 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mon.a.log 2024-08-26T00:18:12.889 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.audit.log: /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mon.a.log: 94.7%gzip -5 --verbose -- /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.9.log 2024-08-26T00:18:12.889 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.j.log.gz 2024-08-26T00:18:12.892 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-26T00:18:12.892 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.9.log: 90.3% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.audit.log.gz 2024-08-26T00:18:12.899 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/cephadm.log: 90.8% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-volume.log.gz 2024-08-26T00:18:12.904 INFO:teuthology.orchestra.run.smithi181.stderr: 93.0% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mgr.z.log.gz 2024-08-26T00:18:12.904 INFO:teuthology.orchestra.run.smithi042.stderr: 94.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-26T00:18:12.923 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/cephadm.log: 92.9% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mgr.y.log.gz 2024-08-26T00:18:12.926 INFO:teuthology.orchestra.run.smithi181.stderr: 82.5% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.cephadm.log.gz 2024-08-26T00:18:12.957 INFO:teuthology.orchestra.run.smithi043.stderr: 90.8% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-volume.log.gz 2024-08-26T00:18:12.973 INFO:teuthology.orchestra.run.smithi181.stderr: 90.5% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.audit.log.gz 2024-08-26T00:18:12.993 INFO:teuthology.orchestra.run.smithi181.stderr: 89.9% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.log.gz 2024-08-26T00:18:13.051 INFO:teuthology.orchestra.run.smithi181.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-26T00:18:13.052 INFO:teuthology.orchestra.run.smithi043.stderr: 82.6% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.cephadm.log.gz 2024-08-26T00:18:13.095 INFO:teuthology.orchestra.run.smithi181.stderr: 90.8% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-volume.log.gz 2024-08-26T00:18:13.173 INFO:teuthology.orchestra.run.smithi043.stderr: 90.4% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.audit.log.gz 2024-08-26T00:18:13.203 INFO:teuthology.orchestra.run.smithi042.stderr: 90.7% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mgr.x.log.gz 2024-08-26T00:18:13.322 INFO:teuthology.orchestra.run.smithi043.stderr: 89.9% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph.log.gz 2024-08-26T00:18:13.322 INFO:teuthology.orchestra.run.smithi043.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-26T00:18:13.786 INFO:teuthology.orchestra.run.smithi042.stderr: 90.3% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mon.a.log.gz 2024-08-26T00:18:14.154 INFO:teuthology.orchestra.run.smithi181.stderr: 91.7% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mon.c.log.gz 2024-08-26T00:18:15.664 INFO:teuthology.orchestra.run.smithi043.stderr: 91.6% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mon.b.log.gz 2024-08-26T00:18:20.926 INFO:teuthology.orchestra.run.smithi042.stderr: 93.9% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.9.log.gz 2024-08-26T00:18:26.980 INFO:teuthology.orchestra.run.smithi042.stderr: 94.0% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.6.log.gz 2024-08-26T00:18:29.038 INFO:teuthology.orchestra.run.smithi042.stderr: 94.0% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.0.log.gz 2024-08-26T00:18:30.158 INFO:teuthology.orchestra.run.smithi042.stderr: 93.9% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.3.log.gz 2024-08-26T00:18:30.161 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-08-26T00:18:30.161 INFO:teuthology.orchestra.run.smithi042.stderr:real 0m17.309s 2024-08-26T00:18:30.161 INFO:teuthology.orchestra.run.smithi042.stderr:user 0m52.231s 2024-08-26T00:18:30.161 INFO:teuthology.orchestra.run.smithi042.stderr:sys 0m4.675s 2024-08-26T00:18:48.064 INFO:teuthology.orchestra.run.smithi043.stderr: 94.0% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.4.log.gz 2024-08-26T00:18:56.658 INFO:teuthology.orchestra.run.smithi181.stderr: 94.0% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.2.log.gz 2024-08-26T00:19:15.804 INFO:teuthology.orchestra.run.smithi043.stderr: 95.3% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.e.log.gz 2024-08-26T00:19:22.930 INFO:teuthology.orchestra.run.smithi181.stderr: 94.1% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.11.log.gz 2024-08-26T00:19:31.857 INFO:teuthology.orchestra.run.smithi043.stderr: 94.0% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.1.log.gz 2024-08-26T00:19:42.127 INFO:teuthology.orchestra.run.smithi181.stderr: 95.4% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.f.log.gz 2024-08-26T00:19:42.623 INFO:teuthology.orchestra.run.smithi043.stderr: 94.0% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.10.log.gz 2024-08-26T00:19:46.839 INFO:teuthology.orchestra.run.smithi181.stderr: 93.9% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.5.log.gz 2024-08-26T00:20:01.396 INFO:teuthology.orchestra.run.smithi181.stderr: 94.0% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.8.log.gz 2024-08-26T00:20:07.183 INFO:teuthology.orchestra.run.smithi043.stderr: 94.2% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-osd.7.log.gz 2024-08-26T00:20:13.199 INFO:teuthology.orchestra.run.smithi043.stderr: 95.4% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.h.log.gz 2024-08-26T00:24:13.741 INFO:teuthology.orchestra.run.smithi043.stderr: 93.4% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.b.log.gz 2024-08-26T00:24:13.743 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-08-26T00:24:13.743 INFO:teuthology.orchestra.run.smithi043.stderr:real 6m0.901s 2024-08-26T00:24:13.743 INFO:teuthology.orchestra.run.smithi043.stderr:user 5m20.738s 2024-08-26T00:24:13.744 INFO:teuthology.orchestra.run.smithi043.stderr:sys 0m11.037s 2024-08-26T00:25:31.152 INFO:teuthology.orchestra.run.smithi181.stderr: 93.6% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.c.log.gz 2024-08-26T00:26:10.400 INFO:teuthology.orchestra.run.smithi181.stderr: 93.5% -- replaced with /var/log/ceph/f89d317a-633c-11ef-bcd2-c7b262605968/ceph-mds.i.log.gz 2024-08-26T00:26:10.414 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-08-26T00:26:10.414 INFO:teuthology.orchestra.run.smithi181.stderr:real 7m57.573s 2024-08-26T00:26:10.414 INFO:teuthology.orchestra.run.smithi181.stderr:user 6m5.171s 2024-08-26T00:26:10.414 INFO:teuthology.orchestra.run.smithi181.stderr:sys 0m15.127s 2024-08-26T00:26:10.415 INFO:tasks.cephadm:Archiving logs... 2024-08-26T00:26:10.416 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-25_21:24:02-fs-squid-distro-default-smithi/7872309/remote/smithi042/log 2024-08-26T00:26:10.417 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-26T00:26:18.640 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-25_21:24:02-fs-squid-distro-default-smithi/7872309/remote/smithi043/log 2024-08-26T00:26:18.641 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-26T00:27:04.126 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-25_21:24:02-fs-squid-distro-default-smithi/7872309/remote/smithi181/log 2024-08-26T00:27:04.127 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-26T00:27:56.215 INFO:tasks.cephadm:Removing cluster... 2024-08-26T00:27:56.216 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f89d317a-633c-11ef-bcd2-c7b262605968 --force 2024-08-26T00:27:56.502 INFO:teuthology.orchestra.run.smithi042.stdout:Deleting cluster with fsid: f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-26T00:27:57.115 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f89d317a-633c-11ef-bcd2-c7b262605968 --force 2024-08-26T00:27:57.631 INFO:teuthology.orchestra.run.smithi043.stdout:Deleting cluster with fsid: f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-26T00:27:58.213 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f89d317a-633c-11ef-bcd2-c7b262605968 --force 2024-08-26T00:27:58.523 INFO:teuthology.orchestra.run.smithi181.stdout:Deleting cluster with fsid: f89d317a-633c-11ef-bcd2-c7b262605968 2024-08-26T00:27:59.101 INFO:tasks.cephadm:Removing cephadm ... 2024-08-26T00:27:59.101 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-26T00:27:59.142 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-26T00:27:59.162 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-26T00:27:59.178 INFO:tasks.cephadm:Teardown complete 2024-08-26T00:27:59.179 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-26T00:27:59.189 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-26T00:27:59.190 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-26T00:27:59.194 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-26T00:27:59.204 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-26T00:27:59.347 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-26T00:27:59.359 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-26T00:27:59.360 DEBUG:teuthology.orchestra.run.smithi042:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-26T00:27:59.364 DEBUG:teuthology.orchestra.run.smithi043:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-26T00:27:59.367 DEBUG:teuthology.orchestra.run.smithi181:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-26T00:27:59.381 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-08-26T00:27:59.382 INFO:teuthology.orchestra.run.smithi043.stderr:bash: line 1: ntpq: command not found 2024-08-26T00:27:59.394 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-26T00:27:59.394 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-08-26T00:27:59.395 INFO:teuthology.orchestra.run.smithi181.stdout:^* hv01.front.sepia.ceph.com 3 6 377 28 +696us[ +694us] +/- 54ms 2024-08-26T00:27:59.395 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 27 -1189us[-1189us] +/- 81ms 2024-08-26T00:27:59.395 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 29 -10us[ -12us] +/- 77ms 2024-08-26T00:27:59.395 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-26T00:27:59.395 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-08-26T00:27:59.402 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-26T00:27:59.402 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-08-26T00:27:59.402 INFO:teuthology.orchestra.run.smithi042.stdout:^* hv01.front.sepia.ceph.com 3 6 377 29 +752us[ +754us] +/- 54ms 2024-08-26T00:27:59.403 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 23 -1135us[-1135us] +/- 81ms 2024-08-26T00:27:59.403 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 25 +49us[ +49us] +/- 77ms 2024-08-26T00:27:59.403 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-26T00:27:59.420 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-26T00:27:59.420 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2024-08-26T00:27:59.420 INFO:teuthology.orchestra.run.smithi043.stdout:^* hv01.front.sepia.ceph.com 3 6 377 25 +713us[ +714us] +/- 54ms 2024-08-26T00:27:59.420 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 27 -1184us[-1183us] +/- 81ms 2024-08-26T00:27:59.420 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 +6661ns[+7660ns] +/- 77ms 2024-08-26T00:27:59.420 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-26T00:27:59.421 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-26T00:27:59.431 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-26T00:27:59.432 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-26T00:27:59.441 DEBUG:teuthology.orchestra.run.smithi042:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-26T00:27:59.560 DEBUG:teuthology.orchestra.run.smithi043:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-26T00:27:59.632 DEBUG:teuthology.orchestra.run.smithi181:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-26T00:27:59.725 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-26T00:27:59.785 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-26T00:27:59.785 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-26T00:27:59.817 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-26T00:27:59.817 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-26T00:27:59.844 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-26T00:27:59.845 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-26T00:27:59.855 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-26T00:27:59.866 INFO:teuthology.task.internal:Duration was 2423.540816 seconds 2024-08-26T00:27:59.866 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-26T00:27:59.877 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-26T00:27:59.877 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-26T00:27:59.881 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-26T00:27:59.884 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-26T00:27:59.945 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-26T00:27:59.967 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-26T00:27:59.968 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-26T00:28:00.345 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-26T00:28:00.345 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi042.front.sepia.ceph.com 2024-08-26T00:28:00.345 DEBUG:teuthology.orchestra.run.smithi042:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-26T00:28:00.395 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi043.front.sepia.ceph.com 2024-08-26T00:28:00.396 DEBUG:teuthology.orchestra.run.smithi043:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-26T00:28:00.429 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi181.front.sepia.ceph.com 2024-08-26T00:28:00.430 DEBUG:teuthology.orchestra.run.smithi181:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-26T00:28:00.458 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-26T00:28:00.458 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-26T00:28:00.462 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-26T00:28:00.472 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-26T00:28:00.530 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-26T00:28:00.530 DEBUG:teuthology.orchestra.run.smithi042:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-26T00:28:00.534 DEBUG:teuthology.orchestra.run.smithi043:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-26T00:28:00.543 DEBUG:teuthology.orchestra.run.smithi181:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-26T00:28:01.465 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-26T00:28:01.477 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-26T00:28:01.477 DEBUG:teuthology.orchestra.run.smithi042:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-26T00:28:01.533 DEBUG:teuthology.orchestra.run.smithi043:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-26T00:28:01.569 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-26T00:28:01.613 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-26T00:28:01.632 DEBUG:teuthology.orchestra.run.smithi042:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-26T00:28:01.636 DEBUG:teuthology.orchestra.run.smithi043:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-26T00:28:01.638 DEBUG:teuthology.orchestra.run.smithi181:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-26T00:28:01.677 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = core 2024-08-26T00:28:01.702 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = core 2024-08-26T00:28:01.710 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = core 2024-08-26T00:28:01.735 DEBUG:teuthology.orchestra.run.smithi042:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-26T00:28:01.768 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-26T00:28:01.769 DEBUG:teuthology.orchestra.run.smithi043:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-26T00:28:01.784 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-26T00:28:01.784 DEBUG:teuthology.orchestra.run.smithi181:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-26T00:28:01.802 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-26T00:28:01.802 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-26T00:28:01.812 INFO:teuthology.task.internal:Transferring archived files... 2024-08-26T00:28:01.814 DEBUG:teuthology.misc:Transferring archived files from smithi042:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-25_21:24:02-fs-squid-distro-default-smithi/7872309/remote/smithi042 2024-08-26T00:28:01.814 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-26T00:28:01.891 DEBUG:teuthology.misc:Transferring archived files from smithi043:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-25_21:24:02-fs-squid-distro-default-smithi/7872309/remote/smithi043 2024-08-26T00:28:01.891 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-26T00:28:01.927 DEBUG:teuthology.misc:Transferring archived files from smithi181:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-25_21:24:02-fs-squid-distro-default-smithi/7872309/remote/smithi181 2024-08-26T00:28:01.927 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-26T00:28:01.962 INFO:teuthology.task.internal:Removing archive directory... 2024-08-26T00:28:01.963 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-26T00:28:01.967 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-26T00:28:01.969 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-26T00:28:02.015 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-26T00:28:02.027 INFO:teuthology.task.internal:Not uploading archives. 2024-08-26T00:28:02.027 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-26T00:28:02.038 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-26T00:28:02.038 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-26T00:28:02.043 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-26T00:28:02.046 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-26T00:28:02.059 INFO:teuthology.orchestra.run.smithi043.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 26 00:28 /home/ubuntu/cephtest 2024-08-26T00:28:02.072 INFO:teuthology.orchestra.run.smithi181.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 26 00:28 /home/ubuntu/cephtest 2024-08-26T00:28:02.074 INFO:teuthology.orchestra.run.smithi042.stdout: 393253 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 26 00:28 /home/ubuntu/cephtest 2024-08-26T00:28:02.076 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-26T00:28:02.087 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-26T00:28:02.112 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8618c856c9a644ad80ca70c748bebe0c9b6227d4 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/blogbench}} duration: 2423.540815591812 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-08-26T00:28:02.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-26T00:28:02.206 INFO:teuthology.run:FAIL